Are you plugging it into Line In?

This might happen if you were plugging it into the Mic slot by mistake.