Aren't Pitch shifters CPU hogs? Reverbs can be too, Use them on sends if it suits. What compressors? filters etc? Could be a Denormals issue or something?

I get similar problems.