Neighbors driveway goes through my property without right of way! Not disclosed, not in deed!

I recently purchased a property in Vermont. There is a driveway that I didn’t know cuts through a corner of my property. The seller’s disclosure did not say that there were any rights of way. My deed does not mention a right of way and I got the neighbors deed from town hall and they do not have a right of way either. The neighbor uses the driveway which cuts across a corner of my property to tow a pop up camper. I want to be careful about this, have a conversation with this person and try to figure something out. But I feel like I should do my homework first. Any advice about how I should deal with this problem would be appreciated. I will definitely speak with a real estate attorney. Beyond that I’m looking for people’s thoughts on what I should do. Also, do you feel that I should be considering legal action against someone for not catching this problem? The realtor, the seller, title company, the attorney I used for the closing, the neighbor? Thanks in advance for pointing me in the right direction!

Edit: Thanks for all the feedback; much appreciated. My goal is to find a peaceful resolution with my new neighbor but to come up with a more formalized agreement.