Quoting EpicThunderCat!:" How can I stop seeing him ever when he is literally around all my friend and my neighbor is one of those ... [snip!] ... friends!... D: I mean I can stop texting him for sure. I am fine with that... but its a little hard not to ever see him... "
You're making excuses about why you can't stop seeing him. If you are serious about wanting to work on your relationship, you have to put some conscious effort into not being around this other guy. If it means you don't go to your neighbor's when he's there, do that. When making plans with your friends, you ask who's going to be there, and if he is one of those going, you skip out on those plans.
Seek couples counseling. As far as sex goes, the less you have it, the less you will actually want it, and the reverse is also true. The MORE sex you have, the more you will want. You have to put effort into it, and you can't go off into lala land while doing it.