100% this. I sorta skimmed this whole thread, so forgive me if I missed a point or two.
I didn't catch if you stay near that barn when you're there, but I'd make a camp there and put a big fish pond in there. The hardest part of a fish pond is having a place that will hold water, and something to do with all the dirt. You could perhaps kill 7 birds with one stone here:
*Fishing activity in the pond on a regular basis conditions the deer to stay away, or at least learn to live with human presence.
*You remove the food source near your access point.
*The dirt berm gives you absolute cover to sneak past whatever is on the other side of the berm.
*Having this in the NE corner of your property gives you a great place to enter with prevailing winds.
*Fishing gives you a whole lot more utility to the same property, and you can manage a pond to whatever fishing you want to have. Just make sure to understand the need to harvest and keep your fish growing, and how to adjust your management to fix crowding problems.
*All the topsoil could be stacked up to be kept in reserve for projects.
*Who doesn't love having a sustainable source of fish on their own property?