In Defence of Sim Testing
|
caltroit_red_flames
Trading Card Admins S45 Challenge Cup Champion 07-15-2022, 06:47 PMCrunk Wrote:i feel like you don't understand all of the work that would require07-15-2022, 06:41 PMCitizen of Adraa Wrote: You technically don't give a shit about the file. As a matter of fact, the file is freely available.We can play FHM 8.
RomanesEuntDomus
Appeals Committee S10 Challenge Cup Champion
07-15-2022, 07:04 PM
(This post was last modified: 07-15-2022, 07:13 PM by RomanesEuntDomus. Edited 3 times in total.)
Nice read, I think it's important for these points to be heard so that we can get a complete picture and look at this issue from all sides. However, I still largely disagree and think that the benefits of the new rules largely outweigh the risks. Sure, there probably are loopholes in there already and there will be unforeseen circumstances, but the arms race that is test simming has become such a bane on the health of this league and the enjoyment of it's users, that it's still worth it to take these drastic measures despite the possible drawbacks.
To get into some of your points in more details: Quote:The ban is virtually unenforceable That's true but that's why the penalty for it is so harsh. Yes, you are unlikely to get caught, but if you are you are absolutely fucked. It's the best detriment we have unfortunately aside from appealing to peoples moral instincts, which maybe isn't as naive as it sounds. Because... Quote:People are almost certainly going to do it anyway ... over the last few months we've heard even from the people who have been doing a lot of test simming that they don't really enjoy it and only did it because they felt they had to in order to give their team a chance to keep up in that neverending arms race. It sounds like such an unhealthy cycle where people don't actually want to do bad things but feel forced to do them in order to not fall behind, and maybe that's our chance now to break that cycle. That's the naive, optimistic view, that people stop test simming if we take away that feeling of being forced to do it in order to not let their team down. The colder, more cynical view is that I'd probably still prefer an SHL where a handful of hypercompetitive assholes do test simming in secreat over an SHL where everyone is forced to test sim no matter if they want to or not and the lack of player agency that creates, because the entire league has just become a GM dick measuring contest where the ones that can sink the most time into the game have a huge advantage and the players who aren't GMs don't really have an impact at all. And lastly, I don't mind people being snitched on here. If you notice someone doing something that is that harmful to the community as a whole for super selfish reasons, by all means snitch on them, they deserve it. What is noble about protecting someone who does such shitty things? It's a shitty view that you can only have if you've watched too many shitty gangster movies? It's not snitching, it's whistleblowing in my book. And it's gonna be a crucial part of our toolbox to enforce these rules, the risk of being told on, the risk of someone blowing the whistle. Sure if your teammates find out that you are test-simming they might not tell on you because well, they are your teammates, you are in this together. But who knows, a few seasons down the line some of these people might not be your teammates anymore... Maybe you've even had a falling out with one of them? Will they still keep their mouths shut and protect you then? How sure are you of that? We want the illegal test simmers to ask themselves these very questions, to have a target on their back, to not be able to every quite be at ease. We want to make this kind of cheating such a miserable experience that it just isn't worth it anymore. Quote:There will be witch hunts I think the opposite is true actually. We already are in a situation where some teams are seen with so much suspicion that no matter if they actually do something bad or not, every good/surprising result from them leads to accusations and basically witch hunts because everyone assumes test-simming shenanigans at play. We would likely get much less of these witch hunts with test-simming banned for everyone, not more. Quote:Decompiling isn’t explicitly banned That part of your post is just depressing. I'd hate it so much if that is the approach that people want to take to this game nowadays, I just hope we can be better than that. But either way, "if we can't ban decompiling then why ban test simming" isn't a very strong argument imho. Quote:So much TPE could be unwittingly wasted That's actually a good thing in my eyes. Make builds matter again, make it so that people build different kinds of players, some of which work better than others. The choices we make in regards to our players only have meaning when they actually have consequences, including the possibility of failure. That's much more rewarding than everyone grinding their way towards 2000 TPE and building more or less the same way, wait their turn to be a Superstar for a few seasons using the same mold that everyone before them had been using as well. Having too much information and too much of a meta makes the player building experience worse, not matter. Quote:Strats are just guesswork now That's a legitimate concern that I'll concede, but for other reasons than the ones you've mentioned. I see the risk here more in the fact that there clearly is a knowledge gap between teams/GMs at this point even without test simming, and it will be harder for the inexperienced GMs to catch up without test simming as one of their tools. That's why we need publicly available resources and essentially databases where people share their sim knowledge that are available to everyone, and I think it's fair to doubt that we'll get that anytime soon. What I strongly disagree with is your point of "The role of GM has been reduced, and I think this is a shame." Hell no! If there's one thing the SHL needs then it's to reduce the role and importance of the GMs, to give more agency back to the players so that their decisions matter again and they aren't just pawns in a GM chess game. This league is a player league first and foremost, of course GMs should still be important but they shouldn't be the sole factor that decides a teams success as they are now. Quote:RNG and guesswork will have more impact than ever I usually don't like RNG in video games but in a sports sim like the SHL, it is crucial to have a good amount of it. If the last decade and a half of SHL hockey have shown us anything, its that there hasn't been enough randomness. Things are too predictable. Every season has been pretty much pre-determined, teams more or less knew going into the year where they'd finish in the Standings with almost no surprises, upsets, cinderella runs, chokes etc... The below-average teams knew that they'd have no chance right from the start, making things boring for everyone on those squads, and for the good teams everything before the playoffs was largely meaningless as well because they were guaranteed to make the postseason from the start. Nothing really happened in the regular season aside from individual stat counting. And even in the playoffs, where the fact that you only need a few lucky breaks to beat a much stronger opponent in a series should create a lot more excitement, those upsets rarely ever happened. And when they did, they tended to came from the (alleged) test-simming giants. It's just a broken system that actually needs more randomness and unpredictability. Quote:Some of us enjoy sim testing Frankly, my dear, I don't give a damn. Sorry to sound harsh, I don't mean to get personal after the very constructive and interesting post you made, but if your main reason for being in a league like this is that you enjoy breaking games and engines and want to do this here as well, then you can fuck off. We don't want that here, the league is better off without that kind of mindset. Maybe it's too late already because pandoras box has already been opened, but I hope that with enough effort we can still contain this kind of mindset and channel it into areas where it doesn't ruin the fun for everyone. Quote:Anyone can sim test FHM (when it’s not banned) I think I touched on all that in my previous points. It's just not true in my opinion that the fact that everyone could theoretically test sim created are more level playing field. Some people are just way more hardcore about this, have more knowledge, more time or more interest, and that shouldn't be the sole deciding factor that determines a teams success, while the players who the league is supposed to be all about are just passengers that are expected to grind away to 2000 TPE to provide their GMs with the tools they need in their personal battle royale, but who can contribute little beyond that.
ACapitalChicago
Registered :boblincoolright: 07-15-2022, 07:04 PMRomanesEuntDomus Wrote: Nice read, I think it's important for these points to be heard so that we can get a complete picture and look at this issue from all sides. However, I still largely disagree and think that the benefits of the new rules largely outweigh the risks. Sure, there probably are loopholes in there already and there will be unforeseen circumstances, but the arms race that is test simming has become such a bane on the health of this league and the enjoyment of it's users, that it's still worth it to take these drastic measures despite the possible drawbacks. As usual, I think RED nails it. But, I just want to especially repeat: Quote:Sure, there probably are loopholes in there already and there will be unforeseen circumstances, but the arms race that is test simming has become such a bane on the health of this league and the enjoyment of it's users, that it's still worth it to take these drastic measures despite the possible drawbacks.
Crunk
Registered Senior Member 07-15-2022, 07:04 PMRomanesEuntDomus Wrote: Nice read, I think it's important for these points to be heard... Now this is a response. Thank you. Obviously some of this will come down to opinion on what is healthy for the league, which I completely respect. But I will take you up on a few of your points. Code: We already are in a situation where some teams are seen with so much suspicion that no matter if they actually do something bad or not, every good/surprising result from them leads to accusations and basically witch hunts because everyone assumes test-simming shenanigans at play. We would likely get much less of these witch hunts with test-simming banned for everyone, not more. The concept of a witch hunt is a baying mob demanding severe justice based on unprovable accusations. Teams that are known for sim testing being accused of sim testing in a league that allows sim testing isn't a witch hunt. It's a few snarky comments based on sound logic. I believe this ban has the potential to result in actual witch hunts, with real potential punishments.... if results fall a certain way. Quote: The choices we make in regards to our players only have meaning when they actually have consequences Quote:to give more agency back to the players so that their decisions matter again You talk about players making "choices" and "decisions". Both words imply a level of knowledge surrounding the decision at hand, and a lack of sim knowledge in the community means that just isn't possible here. These are now guesses, or arbitrary decisions - is handing agency to the players to make consequential guesses really a satisfying user experience? Quote:the arms race that is test simming has become such a bane on the health of this league Right, and this is where I think you have strayed from the point I was making slightly. I have done the sim testing grind (mostly in other leagues) and I am fine with it going. Take away the capability for us to sim through the league file, and ideally take away any possibility of us being able to recreate a league file. That can all go, along with any culture of obligatory test simming in the name of optimisation. But without the capability to explore the sim engine even slightly (without any league file - or recreation thereof - involved) we are in a position where anyone who offers any build advice to others who request it are under immediate suspicion. Every keen rookie who wants to earn, get involved more, and try to make a player who succeeds in the league has to be met with "idk, just guess" when asking for advice. I don't think that will be healthy for the league in the long term.
PremierBromanov
Registered Cool guy
it seems like you're saying in comments is that the language of the rules isn't quite right, but what you've written about is a broader argument for the concept of simming the way we used to.
Ragnar
Registered The Gnometorious
Acap said I could test sim if I venmoed him $20
Sigs by Me, Merica, High Stick King, Rum_Ham, Jess, vulfzilla, enigmatic, and Carpy
❤!! RIP to the big homies 701 and Mac !!❤
spooked
Registered Posting Freak
The pure idea that you would want to decompile or identify what is/isn't the most profitable use of TPE or what is good/bad by definition is exactly the attitude that test sim banning was trying to remove. The whole spirit behind this post is the point of the ban in the first place.
ACapitalChicago
Registered :boblincoolright:
goldenglutes
SHL GM binko
07-16-2022, 02:05 AM
(This post was last modified: 07-16-2022, 02:07 AM by goldenglutes. Edited 2 times in total.)
07-15-2022, 08:09 PMCrunk Wrote: Right, and this is where I think you have strayed from the point I was making slightly. I have done the sim testing grind (mostly in other leagues) and I am fine with it going. Take away the capability for us to sim through the league file, and ideally take away any possibility of us being able to recreate a league file. That can all go, along with any culture of obligatory test simming in the name of optimisation. I think this is the most important point. It feels like there should be a discussion for a middle ground where GMs aren't spending all their energy finding ways to perfect their team, but can still learn about the engine. Right now it feels like it won't be possible to learn anything about the engine unless you spend the next 10 seasons GMing to see a decent sample size of what works and what doesn't, or you play NHL saves in FHM 8 to familiarize yourself with builds/tactics/power levels that are probably not applicable to the SHL. I don't have a perfect answer for how to reach that middle ground. Maybe there could be an unbiased sim testing committee (with people from multiple teams) that can do some general tests for builds/tactics and publish their findings for everyone to see? This committee can also play a large role in steering the conversation around builds to ensure there's healthy variation. For example, instead of trying to find the one best build for all situations, they could try to answer questions like: What are the attributes that contribute to playmaking? How do you build a defensively responsible center? Is there a viable way to build a speedy player that largely ignores defense? Can you feasibly build a defenseman that specializes in puck possession and controlled zone entries? What is the in-sim difference between a goalie focused on positioning and one that is more unorthodox? Although the answers to the first two questions seem obvious, that's only with the context of how hockey works in real life. We all know that FHM did not make a perfect engine, and there are definitely going to be counter intuitive findings. Back in the STHS days (before 40 passing), I remember there used to be build guides about common pitfalls to avoid and how to build viable players in each type of style. That's all I really want for the new sim engine.
Memento Mori
Registered Senior Member 07-16-2022, 02:05 AMgoldenglutes Wrote:Exactly. Just to draw attention to one of RED's points:07-15-2022, 08:09 PMCrunk Wrote: Right, and this is where I think you have strayed from the point I was making slightly. I have done the sim testing grind (mostly in other leagues) and I am fine with it going. Take away the capability for us to sim through the league file, and ideally take away any possibility of us being able to recreate a league file. That can all go, along with any culture of obligatory test simming in the name of optimisation. 07-15-2022, 07:04 PMRomanesEuntDomus Wrote: That's a legitimate concern that I'll concede, but for other reasons than the ones you've mentioned. I see the risk here more in the fact that there clearly is a knowledge gap between teams/GMs at this point even without test simming, and it will be harder for the inexperienced GMs to catch up without test simming as one of their tools. That's why we need publicly available resources and essentially databases where people share their sim knowledge that are available to everyone, and I think it's fair to doubt that we'll get that anytime soon. People sharing useful sim knowledge isn't doubtful, it's impossible to do so in a (legally) provable way. I will continue to ask my GMs for build advice - they know more about the sim than me, spent draft capital to acquire my player, I want the team to do well, etc. - and unless the SHL introduces a new rule saying its members are supposed to be deliberately unhelpful when other members ask for build advice, there are two potential (legal) strategies to follow: give build advice based on previous sim knowledge, or guess blindly given that the sim has changed. I imagine most users/GMs will opt for the first option, and as series-based sports games rarely overhaul their engine in such a way that a large number of attributes go from good to bad or vice versa, this advice will probably still be largely good. Teams with a lot of sim knowledge will likely therefore continue to build according to the same logic - which is the actual reason teams like Hamilton were consistently good anyway, not test simming.
RomanesEuntDomus
Appeals Committee S10 Challenge Cup Champion
07-16-2022, 07:44 AM
(This post was last modified: 07-16-2022, 07:45 AM by RomanesEuntDomus. Edited 1 time in total.)
07-15-2022, 08:09 PMCrunk Wrote: The concept of a witch hunt is a baying mob demanding severe justice based on unprovable accusations. Teams that are known for sim testing being accused of sim testing in a league that allows sim testing isn't a witch hunt. It's a few snarky comments based on sound logic. I believe this ban has the potential to result in actual witch hunts, with real potential punishments.... if results fall a certain way. You mean you foresee teams/people being punished for "test simming" without any hard evidence, just because the mob demands it? I have a hard time believing that and it would of course be absolutely wrong. And even if there weren't any punishments for it, I do still believe that we already have that right now when teams like HAM can't win a series without everyone suspecting some sort of foul play. If we'll able to get rid of that I don't know, but I doubt it can get any worse. I see the paranoia actually going down with this, not up. Quote:You talk about players making "choices" and "decisions". Both words imply a level of knowledge surrounding the decision at hand, and a lack of sim knowledge in the community means that just isn't possible here. These are now guesses, or arbitrary decisions - is handing agency to the players to make consequential guesses really a satisfying user experience? The options aren't just "players knowing nothing" and "players knowing everything", there is a biiiiiig middle ground here that we are looking to occupy. And it's absolutely possible to give players some guidelines and information on the attributes available without doing what we've been doing in recent years, which was brute force testing individual attributes into oblivion to determine the optional marginal gains for each attribute at each point of the scale to the point where everyone more or less feels compelled to build the same way. Quote:Right, and this is where I think you have strayed from the point I was making slightly. I have done the sim testing grind (mostly in other leagues) and I am fine with it going. Take away the capability for us to sim through the league file, and ideally take away any possibility of us being able to recreate a league file. That can all go, along with any culture of obligatory test simming in the name of optimisation. I just don't think that's the case. People can still just play FHM regularly or even test stuff in there on the side as long as they don't use the SHL file, so there are still plenty of ways to play around with the engine and try to understand and learn it. Also I don't see people coming under immediate suspicion for merely offering build advice. But I do admit that this is a tricky point, I for one think that it would be good for the league if there was a less build advice going around in general, fewer templates, fewer cases where GMs essentially create their players builds for them. It's a big part of what has been making the player building process boring despite theoretically having more options than ever. But I also acknowledge that the players have an inherit desire to spend their TPE as efficiently as possible and to do everything they can to help their team, so this is not a case of GMs or the league forcing it on them, but many specifically seek it out on their own volition. I'm not quite sure how to tackle that either, but I think one tool to combat that at least a little bit is less clarity about what is optimal and what isn't, If the GMs aren't sure what constitutes an ideal build then it'll become less likely that everyone around the league tells their players to build the same way. 07-15-2022, 10:51 PMspooked Wrote: The pure idea that you would want to decompile or identify what is/isn't the most profitable use of TPE or what is good/bad by definition is exactly the attitude that test sim banning was trying to remove. The whole spirit behind this post is the point of the ban in the first place. Strongly agree with that.
Crunk
Registered Senior Member 07-16-2022, 07:44 AMRomanesEuntDomus Wrote: People can still just play FHM regularly or even test stuff in there on the side as long as they don't use the SHL file, so there are still plenty of ways to play around with the engine Right, here is where we are getting our wires crossed, I think. At the time of the ban, I asked a HO member specifically about running the kind of tests you are talking about, ones that do not include the league file. I was told this was not legal. The entire OP is based on this belief - that playing around with the engine to find things out constitutes sim testing and as such is a bannable offence.
RomanesEuntDomus
Appeals Committee S10 Challenge Cup Champion 07-16-2022, 09:00 AMCrunk Wrote:07-16-2022, 07:44 AMRomanesEuntDomus Wrote: People can still just play FHM regularly or even test stuff in there on the side as long as they don't use the SHL file, so there are still plenty of ways to play around with the engine It depends on the specifics and where we draw the line between looking for good tactics (which you can do in every regular singleplayer NHL season) and actually trying to break the game by creating your own kinds of files, decompiling or bulk testing specific tactics/builds. There obviously should be a place for the former but not for the latter in my opinion. You are right though that it is tough to enforce either way which is why I'd be hoping that we as a community can be better than that and maybe just... stop looking for exploits for ones and stop trying to break the game that this league relies on? Is that really too much to ask? There are likely gonna be grey areas between what is banned and what isn't and the best course of action for all of us would be if people just didn't try to abuse those grey areas and try to skirt the rules constantly. It's probably a naive thought but that's why I'm so adamant here not just in defending the test simming ban, but in pushing back against the general mindset behind it that is all about min-maxing, breaking things and maximizing your own selfish gains over the common good.
Memento Mori
Registered Senior Member 07-16-2022, 09:43 AMRomanesEuntDomus Wrote:I think this is a hopeless pursuit, you're relying on the idea that competitiveness = bad. The most effective tactics/strategy in every game (and fundamentally, SHL is a game with strings attached) is to stay just within the rules. A really obvious example of this is the salary cap and minimum contracts. Paying players less money means you can afford a better roster, etc. and so most teams will spend close to the salary cap and will pay their players as little as possible. You're essentially advocating for people to not try and be good within a competitive game, which is fine if you're not invested or you're not a GM, but it just doesn't make sense for someone to spend hours trying to optimally manage everything else that goes into GMing and then intentionally submit suboptimal strats. If a similar ban was instituted in the league where I GM, I would do whatever form of testing/research into the game they considered legal.07-16-2022, 09:00 AMCrunk Wrote: Right, here is where we are getting our wires crossed, I think.
Muerto
Registered S15, S16, S24, S34, S38 Challenge Cup Champion
I'm on board with the test simming ban. During the covid days test simming was a sort of time-filling blessing since there was fuck all else to do, but personally getting back to work and having less time to devote to hobbies, I would rather use that time doing other things than sitting at the computer running dozens of tests trying to figure something out. I still maintain the biggest predictor of team success is more about having a high TPE roster (F>D>G) with a lot of players who stick together over time to build chemistry, and coaching/strats didn't much matter if you didn't have that - whether that is something that will change in FHM8 ... I don't know because I can't test any more lol.
S76 SMJHL DRAFT 3RD OVERALL PICK S77 SHL DRAFT 4TH OVERALL PICK IIHF TEAM NORWAY |
« Next Oldest | Next Newest »
|
Users browsing this thread: |
2 Guest(s) |