I feel you have every reason to feel this way.
There should be no females calling or texting his phones at all. It sounds like he is playing this same game my husband played with me like it's me. I know you love him but you have to love yourself first. And it seems like your wearing yourself down. Stress can lead to serious problems. I am a witness to it. If your loved you, he will give up all the things your not happy with. Life is too short to be miserable.