Check your terminal with
Mine shows up as 'xterm' from Ubuntu connection to mac. Mac did not recognize this kernel as color-capable.
to .bashrc or .profile gives color with 'ls -G' and didn't break the terminal behavior.
Other possible terminals are found in /usr/X11R6/lib/X11/etc/xterm.termcap.