Create Account

Has Parity Improved: An Analysis of the FHM Era of the SHL
#16

05-20-2023, 07:49 PMCitizen of Adraa Wrote: So what I see is what I could probably gather from the league myself anyway - we kinda don't have mid table teams at all. Half the league at any given moment is in "fighting for cup" caliber, half the league is pretty much openly tanking or at least freshly out of the position, and we get absolute minimum of sort of "ok, but like round 2 ok" teams, which isn't fantastically realistic compared to the NHL. The way GMs here operate is that we are far more likely to just explode a middling team on the spot, because there is very little punishment for not performing unlike a real GM could face while trying to rebuild/retool, and that then translates into a state where teams are on either extremes of performance, and very rarely in the middle. That then creates the issue of playoffs being seemingly very uncompetetive in round 1, and a lot of blowouts - it's effectively as if you attempted to mash 10 NHL playoff teams and 10 AHL teams and tried to pretend there is ever going to be any competition between them. I think it's more of a symptom of the way the league is, rather than an outright issue with the sim itself, and I think it's going to be very hard to properly fix unless we actively put in rules that would for example allow HO to replace GMs underperforming for large periods of time continuosly, therefore making GMs far less likely to explode a team even if the rebuild hasn't exactly worked to at least hit some .500+ seasons, and to not get fired for underperforming.

Part of the blow it up mentality is also because of how consistent the results are based on the rosters, so having a middling team in FHM is basically just a waste of time even if you like the LR because you have very small change of doing anything with a sub-top roster. If the sim had some more randomness, or if we found a way to get TPE to matter a bit less consistently through black magic, maybe we keep more mid-table teams in tact just to have a few more shots at the cup on the way down, and rebuilding teams are always going to be middle of the pack teams, but there are less of them.
Reply
#17

05-20-2023, 07:49 PMCitizen of Adraa Wrote: So what I see is what I could probably gather from the league myself anyway - we kinda don't have mid table teams at all. Half the league at any given moment is in "fighting for cup" caliber, half the league is pretty much openly tanking or at least freshly out of the position, and we get absolute minimum of sort of "ok, but like round 2 ok" teams, which isn't fantastically realistic compared to the NHL. The way GMs here operate is that we are far more likely to just explode a middling team on the spot, because there is very little punishment for not performing unlike a real GM could face while trying to rebuild/retool, and that then translates into a state where teams are on either extremes of performance, and very rarely in the middle. That then creates the issue of playoffs being seemingly very uncompetetive in round 1, and a lot of blowouts - it's effectively as if you attempted to mash 10 NHL playoff teams and 10 AHL teams and tried to pretend there is ever going to be any competition between them. I think it's more of a symptom of the way the league is, rather than an outright issue with the sim itself, and I think it's going to be very hard to properly fix unless we actively put in rules that would for example allow HO to replace GMs underperforming for large periods of time continuosly, therefore making GMs far less likely to explode a team even if the rebuild hasn't exactly worked to at least hit some .500+ seasons, and to not get fired for underperforming.
are you still awake?

 
[Image: UCTqPUg.png]
Reply
#18
(This post was last modified: 05-20-2023, 07:59 PM by luke. Edited 1 time in total.)

05-20-2023, 07:46 PMspooked Wrote: Looks like I was expecting, 10% of all games being won by 6+ goals is a lot, 18~% when you drop it down to 5+ seems a bit much too. from what I can tell NHL only had 4 games with 8+ goal differential, and 5 at 7, with more games played total. So we probably have a pretty large bias toward blowouts.

Yes but the NHL also doesnt have this many teams just tanking.

This season there is a 100 point difference from 1st in the league and last in the league. It isnt like that in NHL. This is something where you just can't compare it to the NHL. Its asinine because the incentives are different from NHL to SHL. Also we are on an engine we aren't playing it on the ice. The players pride isnt on the line. Also the average Goals Per Game is completely different between the NHL and SHL, because in FHM we set the goals per game

and again, tell me the last time a NHL team has won 6 games in 1 season. Like toronto did this year

[Image: 0XJkcN5.png]
Czechoslovakia PROFILE || UPDATE || RAGE. Rage 
[Image: luketd.gif]




Reply
#19

Should we get rid of teams?
Reply
#20

05-20-2023, 07:59 PMluke Wrote: Yes but the NHL also doesnt have this many teams just tanking.

This season there is a 100 point difference from 1st in the league and last in the league. It isnt like that in NHL. This is something where you just can't compare it to the NHL. Its asinine because the incentives are different from NHL to SHL. Also we are on an engine we aren't playing it on the ice. The players pride isnt on the line. Also the average Goals Per Game is completely different between the NHL and SHL, because in FHM we set the goals per game

and again, tell me the last time a NHL team has won 6 games in 1 season. Like toronto did this year

The 44 rangers were a great team! you take that back!
Reply
#21

05-20-2023, 08:00 PMhockeyfan Wrote: Should we get rid of teams?

It’s something to think about certainly. But in the same vien, the 16 team playoff format is the best format in FHM, so do we really want to go to 18 teams? Hell even 16? I’m not sure

[Image: 0XJkcN5.png]
Czechoslovakia PROFILE || UPDATE || RAGE. Rage 
[Image: luketd.gif]




Reply
#22
(This post was last modified: 05-20-2023, 09:37 PM by spooked.)

05-20-2023, 07:59 PMluke Wrote: Yes but the NHL also doesnt have this many teams just tanking.

This season there is a 100 point difference from 1st in the league and last in the league. It isnt like that in NHL. This is something where you just can't compare it to the NHL. Its asinine because the incentives are different from NHL to SHL. Also we are on an engine we aren't playing it on the ice. The players pride isnt on the line. Also the average Goals Per Game is completely different between the NHL and SHL, because in FHM we set the goals per game

and again, tell me the last time a NHL team has won 6 games in 1 season. Like toronto did this year
Ottawa won 10 in their first season in existence tbf.

And yes we are not the NHL, but that doesn't mean we can't look at OUR results and think about maybe we could adjust something so game results aren't quite so one sided just for pure entertainment of OUR league. I have no idea where the GPG setting is at right now, but maybe it needs a tweak atm.
Reply
#23
(This post was last modified: 05-20-2023, 10:10 PM by luke. Edited 1 time in total.)

05-20-2023, 09:37 PMspooked Wrote: Ottawa won 10 in their first season in existence tbf.

And yes we are not the NHL, but that doesn't mean we can't look at OUR results and think about maybe we could adjust something so game results aren't quite so one sided just for pure entertainment of OUR league. I have no idea where the GPG setting is at right now, but maybe it needs a tweak atm.

[Image: image.png]

Here I did the math. About 7200 games for each league. Basically, we have a lot less 1 goal games, a slightly more 4,5,6,7 goal differential games. I dont see the problem. NHL has more 1 goal games because you are playing in the real world. In FHM, its not the real world, its a simulation.


When you look at the SHL dataset

[Image: image.png]

Which is 7,260 games, having those numbers is good! We are talking about 46% are two goal games, another 35% are 3/4 goal differential games(which lines up with the NHL at 33%). We just see more 5+ goal games(1304 of them) because you have 1600 TPE average teams going against 800 TPE average teams. Its a large spread of really good teams, and really bad teams

[Image: 0XJkcN5.png]
Czechoslovakia PROFILE || UPDATE || RAGE. Rage 
[Image: luketd.gif]




Reply
#24

Nerd

[Image: gurbs.gif]

Reply
#25
(This post was last modified: 05-21-2023, 01:28 AM by spooked. Edited 1 time in total.)

05-20-2023, 10:09 PMluke Wrote: [Image: image.png]

Here I did the math. About 7200 games for each league. Basically, we have a lot less 1 goal games, a slightly more 4,5,6,7 goal differential games. I dont see the problem. NHL has more 1 goal games because you are playing in the real world. In FHM, its not the real world, its a simulation.


When you look at the SHL dataset

[Image: image.png]

Which is 7,260 games, having those numbers is good! We are talking about 46% are two goal games, another 35% are 3/4 goal differential games(which lines up with the NHL at 33%). We just see more 5+ goal games(1304 of them) because you have 1600 TPE average teams going against 800 TPE average teams. Its a large spread of really good teams, and really bad teams

If you look at it from the other side, it's not that good really though. the NHL ratio would see only ~4 games per team (80 games) end at 5+ goal diff, we have avg of ~12 per team (240 games), which is a pretty significant chunk of the season when you consider that is the average. I understand the spread will be larger to some degree cause the way things are right now, but my whole feeling is that it's kind of a turn off to see teams getting slaughtered in a pretty significant chunk of games, and it's not just the TPE mismatch games either. NEW lost to PHI in a couple crazy games this season too 8-1 and then 9-6, which only shakes out at a 3 diff, but that wouldn't even look bad in this metric despite clearly being an insane scoreline.

If you want to attribute the weird results to TPE mismatches fine, it doesn't take long to find examples that disprove that being the sole reason, but fine. But if that is the case, why wouldn't we want to raise the replacement level players ability to compete so games are so stretched out to a completely unrealistic level? Losing is one thing, having be a complete slaughter is another.

And if you look deeper beyond just diff, why are some games ending at like 15+ goals in the first place? Where do we have the goal slider at where this is happening? I just think there are a lot of weird abnormalities in the results the sim has been spitting out in specific games that are either completely insane, or doesn't even feel close to realistic for the matchup, even if one team "had an off game" the scorelines are insane. If the league has no appetite to simulate a professional sports league, fine, but to me that was kind of the whole point.. and the engines we use are trying to do that as well, so it kind of makes sense we are getting wonky outcomes when we aren't using the engine close to how it was designed.
Reply
#26
(This post was last modified: 05-21-2023, 08:18 AM by RomanesEuntDomus. Edited 3 times in total.)

Thanks for your post luke and for bringing some more data into this. I think it's also useful in clarifying some of the language around the topic. We keep talking about "parity" when you are right that this isn't actually really the core of the issue anymore, there are enough different teams winning at this point and not just singular powerhouses who stay on top forever. The core issue as I would define it is "predictability", the fact that at the start of a season you already pretty much know instantly who will have a chance to compete and who won't, and the latter category isn't just limited to the tanking teams, but includes the majority of the midfield as well. The surprise runs and upsets are so rare not just in #1 vs #16 series, but when the #4-#6 seeds are playing the #10-13 seeds as well, which is when thing should start to become wide open, but they don't.

CoAs observation that there isn't really a midfield anymore is a direct result of that, because naturally GMs have started to adapt to this competitive landscape. Over the last few years they have slowly learned that there isn't really a point in hanging around in that 7th to 12th place range, play a solid regular season and then hope to do some damage in the playoffs if you manage to run hot. They know that it's boom or bust, you either are among the absolute top of the league or in a rebuild, and everything between those two extremes is a waste of time. I don't think that's a good situation overall and having almost half of the league tanking/rebuilding at the same time doesn't seem like something we'd want to see.

Also, an additional point that we could take from your data, is considering changes to playoff seeding. I don't know how many options FHM gives us there, but maybe the fact that the same teams keep running into each other at the same points in the playoff tree are part of the problem. I have definitely heard some people talk about how they think it's boring that they are playing the same teams again and again in the playoffs, that their first and second round series are all against the same teams etc. It's not an issue I've looked at in-depth at all, but maybe there is some potential here to make things better in a rather non-invasive way.

Evan Winter
Edmonton Blizzard
Player Page - Update Page


[Image: winter-500.png]
Reply
#27

05-21-2023, 08:14 AMRomanesEuntDomus Wrote: Thanks for your post luke and for bringing some more data into this. I think it's also useful in clarifying some of the language around the topic. We keep talking about "parity" when you are right that this isn't actually really the core of the issue anymore, there are enough different teams winning at this point and not just singular powerhouses who stay on top forever. The core issue as I would define it is "predictability", the fact that at the start of a season you already pretty much know instantly who will have a chance to compete and who won't, and the latter category isn't just limited to the tanking teams, but includes the majority of the midfield as well. The surprise runs and upsets are so rare not just in #1 vs #16 series, but when the #4-#6 seeds are playing the #10-13 seeds as well, which is when thing should start to become wide open, but they don't.

CoAs observation that there isn't really a midfield anymore is a direct result of that, because naturally GMs have started to adapt to this competitive landscape. Over the last few years they have slowly learned that there isn't really a point in hanging around in that 7th to 12th place range, play a solid regular season and then hope to do some damage in the playoffs if you manage to run hot. They know that it's boom or bust, you either are among the absolute top of the league or in a rebuild, and everything between those two extremes is a waste of time. I don't think that's a good situation overall and having almost half of the league tanking/rebuilding at the same time doesn't seem like something we'd want to see.

Also, an additional point that we could take from your data, is considering changes to playoff seeding. I don't know how many options FHM gives us there, but maybe the fact that the same teams keep running into each other at the same points in the playoff tree are part of the problem. I have definitely heard some people talk about how they think it's boring that they are playing the same teams again and again in the playoffs, that their first and second round series are all against the same teams etc. It's not an issue I've looked at in-depth at all, but maybe there is some potential here to make things better in a rather non-invasive way.


RED, we need more data before we throw out anything as truth. I repeatedly said it in the article. There has only been 6 seasons of FHM8, we can’t simply say the #7-12 don’t have a chance at all because we don’t know. Manhattan was the 9 seed when they went to the finals twice and lost in game 7. I was the 6th in the league . 4 point difference between 6 and 7. Philly was the 5th seed when they won. The predictability of the 1 vs 16, yeah 99% of the time the 1st seed will win because the 16 team is just tanking. but anyone in the top 10 I believe can beat anyone, but we will just need time and data to prove that or disprove it. There just isn’t enough of a dataset to say it.


But I do agree with COA, but the range I more the 11-16 range of the “middle” that found that it’s not worth it and decided to tank harder(look at the section about tanking”. Clearly it’s a shift in mindset, and from that the shift to sign a lot of players that’s less than 600 tpe. It’s shown in the data that in the last 10 seasons the gap has widened because a lot more teams has used worse IA fillers.

For playoff seeding we basically have the NHL format(what we are using right now) or a 1-16 format where the 1 seed in the conference plays the 8th seed, 2&7, 3&6, 4&5

[Image: 0XJkcN5.png]
Czechoslovakia PROFILE || UPDATE || RAGE. Rage 
[Image: luketd.gif]




Reply
#28

back to sths

[Image: unknown.png]



UsaScarecrowsBlizzardSpecters | [Image: specterspp.png][Image: spectersupdate.png] | TimberArmadaSpectersFinland

[Image: cainbanner_35.jpg]
Reply
#29

05-21-2023, 01:27 AMspooked Wrote: If you look at it from the other side, it's not that good really though. the NHL ratio would see only ~4 games per team (80 games) end at 5+ goal diff, we have avg of ~12 per team (240 games), which is a pretty significant chunk of the season when you consider that is the average. I understand the spread will be larger to some degree cause the way things are right now, but my whole feeling is that it's kind of a turn off to see teams getting slaughtered in a pretty significant chunk of games, and it's not just the TPE mismatch games either. NEW lost to PHI in a couple crazy games this season too 8-1 and then 9-6, which only shakes out at a 3 diff, but that wouldn't even look bad in this metric despite clearly being an insane scoreline.

If you want to attribute the weird results to TPE mismatches fine, it doesn't take long to find examples that disprove that being the sole reason, but fine. But if that is the case, why wouldn't we want to raise the replacement level players ability to compete so games are so stretched out to a completely unrealistic level? Losing is one thing, having be a complete slaughter is another.

And if you look deeper beyond just diff, why are some games ending at like 15+ goals in the first place? Where do we have the goal slider at where this is happening? I just think there are a lot of weird abnormalities in the results the sim has been spitting out in specific games that are either completely insane, or doesn't even feel close to realistic for the matchup, even if one team "had an off game" the scorelines are insane. If the league has no appetite to simulate a professional sports league, fine, but to me that was kind of the whole point.. and the engines we use are trying to do that as well, so it kind of makes sense we are getting wonky outcomes when we aren't using the engine close to how it was designed.

First on the goal slider, we lowered it to NHL goal sliders https://simulationhockey.com/showthread.php?tid=127954

Quote:Second - As many of you have noticed, scoring overall, particularly in individual games has increased tremendously to a level we don’t think is realistic (and definitely isn’t enjoyable for goalies, who admittedly already have a rough go of it in FHM). We are still gathering data on the reason for this, and ways to address it, but for S68 we will be decreasing the average number of goals per game from the current value of 6.27 to 6.1 (this is the value used by FHM for NHL leagues).

So its about 6.1 goals per game. If you want to petition HO to lower it, talk to Finn. I personally think its fine looking at the data I provided. I don't think thats the reason why we see a lot of blowouts, its just the way our league is set up, and FHM engine reacting to how we do it. Maybe we should lower it, its not my call to make.

Ok onto the just the amount of goals scored in general. This is number when one team scored 7+ goals or got scored 7+ goals against

[Image: image.png]

Shows pretty much what the eye shows. Yes, good teams also give up a lot of goals. But they score a lot more 7+ goal games. This is also S60-S70, so it gives a good amount of context. Someone like NEW, NOL, BAP. They were good at one portion but tanking the other, so thats why they are disproportionate. Minnesota got scored on almost 10% of all 7+ goals allowed, so maybe you are seeing it with different point of view because you are the team that is getting blown out the most.


No engine is perfect, and the way we are using the FHM engine is completely different than what FHM expects us to be. Like go try our tactics in a NHL gamemode. I tried it, the team did terrible. Of course we want to try to get it near NHL, but its impossible to get there exactly. So whats the number for you. Is it 80% there? is it 90% there?

[Image: 0XJkcN5.png]
Czechoslovakia PROFILE || UPDATE || RAGE. Rage 
[Image: luketd.gif]




Reply
#30

We really are just data dorks in a simulation world.

[Image: Wally.png]






Reply




Users browsing this thread:
1 Guest(s)




Navigation

 

Extra Menu

 

About us

The Simulation Hockey League is a free online forums based sim league where you create your own fantasy hockey player. Join today and create your player, become a GM, get drafted, sign contracts, make trades and compete against hundreds of players from around the world.