ive had the same problem.

i just automate the track to mute wherever i want it to shut up.