Oh yeah. the dreaded bush honeysuckle. hard to kill. it's everywhere. not beneficial at all. shallow rooted. best medicine toothed bucket on a front loader. or yank it out. takes some nasty hi dollar herbacides
There are two or three possibilities, but without more information I think Carolina Buckthorn. If that is right, your berries will start turning a deep blue/black color soon. The ones in my fence row are beginning to turn right now.
Look at the pictures of the second plant at this link:
This is Carolina Buckthorn in the fence row behind my house this morning. This plant has "thorn" in its name but has no thorns.... As you can see, the berries on the ones here are just beginning to change from red to black.
If the berries on your plant start to turn, I think that is what you have too. If not, back to the drawing board.