Guys, I'll put it here...
I think it will be useful to read to anyone who test stuff and want that the results of his testing were somehow useful in the real game…
How to pick the players for the testing team? This is most important question and the result of the testing fully depends on this.
For example, If we see that some striker has 140 CA then it doesn't mean anything and we can't tell is he good or bad because during the match players don’t use their "CA" to play the game... they use their "Attributes" and even 140 CA striker can have "Finishing = 5" and it makes him misses all his scoring chances.
That’s why we can't say that all midfielders, defenders and strikers in the testing team are equally good only because they have the same CA level...
It's extremely important that testing team consists of Attackers, Midfielders and Defenders which have the same quality level in order to don't give advantage to any specific tactical approach/formation. I'll explain more what I mean...
For example, let's say we create a testing team and we want it be such strong as mid table team in English Premier League and let’s say we need to choose the level for Technique attribute of our AMCs...
There are 39 players in EPL who have "Natural” rating for AMC position and about 90%(31 players) of them have Technique “15” and higher… as you can see 90% of all natural AMCs in EPL has Technique 15 and higher.
This mean if we pick AMC for our testing team and he has Technique less than 15 then this guys will be Sky Bet Championship quality and won’t be English Premier League quality level.
Now let's look at "Decisions" attribute of AMCs... as I said there are 39 players in EPL who have "Natural" rating for AMC position and about 90%(30 players) have "Decisions" 12 and higher... as you can see 90% of all natural AMCs in EPL have attribute "Decisions" 12 and higher...
So if we want that out testing team consists of AMCs EPL quality they should have Technique no less than 15 and Decisions no less than 12 other way they all will be Sky Bet Championship quality players…
Let's say we finished picking the AMCs for our testing team and now we need to pick the Strikers... so we should do the same for the strikers as what we did for the midfielders… so we just can’t take their attributes' level out of nowhere and we should stick to EPL level because we did the same for the AMCs.
I think now it should be obvious to anyone that just picking 120CA, 130, 140CA, 150CA won't work... because 120CA player easily can be much better than 130CA player because his CA could be spent much better and on such attributes which have importance for his position and role.
What would happen if we screw up something and let's say make striker in our testing team much stronger than midfielders? The answer at this question is obvious... tactics who uses strikes will receives advantage in testing and the result of such test will be wrong.
Heh
as you can see it's really not easy to build testing system and if you screw up something then the result of such testing won't have any meaning for the "real" game.