What o/s are you using and what plugins are doing this? Some plugins work on the latency settings so you'll need your asio drivers installed to get the latency down.