I've been following the installation directions from the wiki, Getting Started. After generating the arm-none-eabi toolchain, I proceeded with make.
My guess is you first tried compiling without an arm toolchain installed and then installed the arm toolchain and didn't do a 'make clean' when retrying.
Cheers,
Sylvain