I often wondered if type figured in this. Wondered in my case if it might be Trickster Se or something, but I have not yet seen any consistent pattern regarding how other types take them.
With me, it's just the shape, for some reason. Almost all legs, can easily "get" you.
Probably started when young from witnessing others' (most likely my mother) reaction to them, and probably during camping trips (we also had a ot of daddy longlegs (harvestmen, and actually a different species of arachnid) under rocks in the back yard).
Never liked webs either.
I can look at them, but hate finding one loose, nearby, or especially, being called to get rid of one (and these are wispy house spidesrs, mind you; not the truly horrible bigger ones). Again, the shape and the way they move is hideous.
I always did like the tiny pinhead sized jumping spiders, that appear to fly when you put your finger near them. They are small and compact enough not to look so hideous.