Thank you for writing!
From previous posts, I can see that you do use emergency contraception (EC) instead of convention methods. You are correct - EC is not to be used like this.
However, it cannot cause infertility. There is no need to go to a gynecologist. Stop using it and always have a condom with you. If a man won't wear one, then don't have sex with him.
Your cycle should return to normal within a month.