Quoting RebeccaCampbell:" Well i Told Him That He Could Come Over And See His Son. But No Taking Him Anywhere Unless Im There..At ... [snip!] ... And I Know If it Was Up To My Family There Would Be No Relationship Between My Son And His Father. So Im Not Sure What To Do.."
Let him be upset! How old is your son? If he is really young even a court might have it so he can visit him only when you are there to help. Either way, unless he takes you to court you are in control so don't let that go since you can't trust him!