I feel you 100%..
It's the habit factor- my brain is fine with me not working out at all, and fine with me working out every day.. but alternating days confuses it. It's like going to work on mondays- the irony is mondays wouldn't be so bad if you actually worked 7 days a week (assuming you aren't burnt out as a result).
I actually did workout everyday when doing my cut. I did upper body one day, deadlifts next, then squats next, and 20mins cardio each day just to fill each day out. It was actually great, but I suspect the combination of a caloric deficit and not having a rest day is why I picked up an injury, so I stopped doing it. I'm tempted to go back to it though, maybe when I start properly bulking, purely because I enjoyed it, even though it's actually inefficient.