I'd make it clear to your Mum & Step-Dad that you're not fond of him, and maybe just make a point of leaving the room when he's there?