Finally solved it: Ctrl + left Shift = Left justify. Ctrl + right Shift = Right justify.
I don't really understand this even existing as an option, but I also seem to remember reading about it, thinking it was a good idea and turning it on. Now I can't remember how to turn it off, but as soon as I find out I'll post it here! Grrr.