I agree with a lot of what you are saying and I do my best in my tests to limit human interaction with the players and tactic as much as I possible do in a variety of ways as follows:Here is my opinion You can have a great tactic, great players, follow the instructions down to a T. However if you draw a game, or morale slips or if you mismanage a player grievance, it can all fall to ****.
Hence why in tactic testing leagues teams go on a "bad run". Any human player would be having team meetings, chats with layers and squad rotation etc to rectify.
As TTF also says, players not being picked in right positions either can be a ****. The palace save I am testing in the now will have the ***.Man pick Zaha as my inside forward every single game if I let him over Puncheon who is clearly the better not just for the role, but the specific instructions I have set.
The problem isn't with the testing leagues but actually with the human element involved. As you can have all the variables perfectly tee'd up but make bad decisions, a poor choice of team talk or no remedial action to rectify matters when they go south.
Plug and Play is dead. I say this as an author of tactics over 10 years who tries to plug and play. These tests rely on plug and play conditions, all of them do. The game has evolved since then massively to SI's credit.
No point hating the testers. Not one of them is crooked, its just that NO MATTER what they do, as TTF indicates, there are variables that massively influence performance that can make things go **** up.
Want proof. Look at all teams tested, the vast majority go through those "dips" in forms I referenced above. Be it two/three games or six. I know, I've looked already.
I think what tactic creators need to do is up their game. Don't just release a tactic but release a guide or a "how to" for different scenarios. Not just fav, underdog and balanced but how to cope with all the scenarios the game throws up. It's not the testers fault, more the creators for being half arsed and lazy. I know because i'm guilty as charged. I know **** right folks won't mirror my results unless they play a similar way.
I'll release a tactic tonight giving what i perceive to be the best possible chance for success. It will be a mammoth opening post but maybe that's what us creators need to do now, instead of ******** that folk "don't get it". Ideally every post from a creator on his/her thread should be "refer to OP", if not, they themselves have ****** up.
My two cents for what it was worth.
I always use the same exact save when I test tactics so teams are always played in the exact same order.
I always use created teams as existing teams compete in european competitions which alter the fixture list.
I never test in cup competitions as these are down to random luck of the draw.
I never use FMRTE (I dont own it) to raise morale after a defeat as I feel one of the biggest factors that makes a good tactic is how quickly it recovers after a bad run of defeats.
I always use the same assistant manager (200 CA) to do team talks, set training and do the team selection so that all tactics are treated in exactly the same way.
I have found a way to stop players from ever moaning about 1st team football so never have to deal with that problem.
I have found a way to almost (99.9%) eradicate all injuries from FM15.