I change their settings to ease off the tackles the moment they get a yellow. Creates a few more nervy moments, but doesn't help my players stay on the pitch. As it is, I've already made my mind up. I'm guessing you're using a big team and not building one from lower in the chain like I am, so you most likely already have the players that fit the requirements.
I had a look at my players and I've got a feeling I don't have a group of sportsmen, which is why they go in hard regardless of adjustments. No settings will fix that, so it's just a matter of accepting it and looking elsewhere for something that will fill my criteria for success.
Enclosed in the spoiler space is our shockingly awful discipline record. Also note that I did not raise concerns about the results, I'm extremely happy with these. It's the lack of discipline that had me disappointed. Finding that perfect balance between success and discipline is not as easy as you're making it out to be. I will also add that our inconsistency earlier in the season stopped, leading to this run of form, by using the attacking tweak posted by galego25, except that I changed the mentality to counter.