What should I do to make this work ?

Maybe you need to tell your Mom that you are as much if not more at fault as he is. I hope you don't get caught up in some mess with his girlfriend what you're doing is dangerous, I hope you're using protection, with all the various diseases that are out there. Good Luck