Yeah, you need to be careful playing with levels. If it sounds o.k. dont worry.

If you want to alter the levels because you didnt pay attention during the mix, and the change in levels is so drastic that its noticeable, then start again.

You need to subscribe to the "do a good take" rather than "fix in the mix"