So...I have fruit and mast trees in my perennial food plots. It is nice to get some "double duty" from the space, but it comes with it's challenges. #1 - my plots have at least a 30' wide buffer around them from the timber to ensure they get full sun (I have a few small kill plots that are the exception). So if your current plots don't get a lot of sun light the trees will struggle. #2 - mowing and spraying around them is a PITA as your catching cages, running over them and the like.....so spacing and the like has to be considered well in advance. #3 - eventually those trees will fill out and create their own shade and maybe further limit the plots production. #4 - Many of us (me included) put plots where it is easy for us to do so and in my case 1 of mine is in a low area where frost can be an issue (low areas called frost pockets allow the cooler air to settle first and can harm the flowers of the trees and thus wipe out a fruit crop).
So you either simply expand your current plots and try to make it work for you....and it can...it just comes with some frustrations. Or, you put together are real plan for a real orchard in my opinion.... That includes finding the proper site - not a low area, hopefully where you have some poor producing oaks, that is where YOU can take advantage for hunting and then properly set up the row spacing and the like for optimal success of the trees.
We don't always have a lot of choices, but sometimes we take the easy way out far too soon as well....and keep in mind you will need multiple trees and once you start you tend to try to get more and more.....