I really need opinion/advice on what has happened to me.?

You need to leave him. If you dont have trust then you dont really have a relationship at all. If hes saying those things about you behind your back and when you confront him he says those things then he obviously doesnt care about you.