It sounds to me like you are placing your groove emphasis in a place where your 1st kick no longer feels like the start of the bar.
It`s a nice trick to play sometimes to throw people off.
If it`s a good beat, just shift the whole pattern until the 1st beat is emphasised again.