I feel like it comes from within mymyself primarily, but there are a few people who also seem to have that idea of me built up in their minds... so, I suppose it's a bit of both. And the reasons, I don't remember all of. My brain has a bad habit of hiding memories it doesn't like (That started when my dad died when I was 12. It seems it decided the best way to cope would be to forget what it was I'd lost.) Sometimes it'll be that I'm just generally under stress, and then somebody says something in a way that I take, at first, as mean or accusatory, or something like that.
You do seem as if you are writing while stressed. Very eager to get something out. May I recommend a youtube channel for you? It's a guy called Noah Elkrief who is a best-selling author. He makes videos on how to deal with all kinds of emotional trouble that burden you. You instantly made me think of him.
He talks very very calmly and repeats himself to the point where he may sound a bit unintelligent, but really he has some important things to say that he just outlines so that even a child could understand it.
My girlfriend lost her father when she was 17 and even years after she could still feel guilt because of all the things she never told him or did with him. She could for instance feel bad for not being there when he died and torment herself for being such a terrible daughter. Most days, luckily, she knows she isn't a bad daughter, but in weak moments that shame and anger still boils in her, tampering with her mind. Today she has almost let go completely, but such events can stay for a long, long time if the pain isn't properly dealt with.
Of course quite often the pain can be so excruciating that you just cannot deal with it and have to forget it. It should, however, be focused on at some point.
If you feel you have a whole pile of trouble on you, I'd recommend taking it all one step at a time. Accept how your life is right now and pick one problem to solve at a time. That way you can focus your strength instead of having it be scattered and never have an effect. You could for instance find someone with whom you could talk out about your father complexes, but if it's too painful, you can start somewhere else.