yeah those abbey road limiters are a little touchy!!
another thing im just noticing is the release on the limiter is set way too long. i understand the style you're going for when the kick isnt in the track. i love that myself where the music lifts up and then gets sucked back down when the kick comes back but your limiter release is set way to high and the music slowly lifts in volume which sounds odd.
also on your sub groups try minimal compression. remember that a lot of small amounts of compression thru-out the chain is much better than fewer heavy compressions.