Help what to do about my ex?

Ok so I have had an 3 year on and off again relationship with my boyfriend and and at this moment we aren't together we talk everyday say I love you everyday but we fight a lot and I feel like he has no respect for me lately he has been hanging up the phone on me not listening to what I have to say yelling at me calling me annoying cursing at me and he has called me a ***** 3 times already. I want to work on it with him but his disrespectful ways haven't changed they have been getting worse I cant even defend myself cause he won't let me what should I do work on it or leave him for good.