With a Black Mage as my first serious character, the only realistic option to me was a keyboard. In a party, I simply could not get by without my macros available to me.
Even as a simple warrior, I can't realistically expect to pull and fight efficiently with the limited buttons on a controller, so again, the choice is clear.
Don't get me wrong, having a controller/joystick in my hands has always made me enjoy my games more. As a Atari/Nintendo child, it simply feels more natural and I'm usually willing to accept poorer performance for the tactile pleasure of a good controller in my hands. But whenever someone in my party mentions they're using a controller, I don't expect much out of them.