I used to deal with all that and found it simply wasn't worth it. What was happening is that, over time, I was removing many of the weeds that were highly beneficial to and preferred by deer, and advantaging the noxious weeds that were more tolerant to the herbicides. I've now become very weed tolerant, especially when it comes to perennial clover.
First, I choose a clover that is persistent like Durana which is well suited for my climate. Next, I get a good herbicide burn down and only plant perennial clover in the fall with a heavy Winter Rye nurse crop. Then, the first spring, each time the Winter Rye hits 12"-18", I mow it back to 6"-8". This releases the clover to the sun. It does not kill the winter rye so it continues to take up space and other resources that would be used by summer weeds. The winter rye eventually dies on its own, but by then, the clover has established in its place.
After that, weed tolerance is my friend. Only mow clover once a year in the fall, just before our archery season. After just a couple years, my clover plots look so weedy and ugly in the summer, that unless you get down on your hands an knees and brush the weeds aside, you won't not even know it was a clover field. However, when I mow right before the season, our fall rain and cool nights favor the clover over the summer weeds which are naturally senescing at this point any way. The clover rebounds and takes over the field again.
Yes, over time, the clover fixes N into the soil and more and more grasses invade the field. After 7-10 years, with Durana, weeds dominate, I will usually rotate into an N seeking crop for a season and then start over and replant in clover.
I find this is far less work than trying to make a clover field look like a magazine cover with herbicides. Deer use my fields even more now. Weeds add "structure" to the field. Less effort, lower cost, improved results. What is not to like? People, by nature want things to look neat. Deer like things that look ugly!