Sure it's a more complex beast than simple explanation, but from what Henry was saying it was just sheer time.

Apparently they were making enough money to keep the label going, but having trouble finding time for the basics (e.g. sleeping).

It's a shame, as it was a genuinely innovative and visionary label.