Vinyl costs lots of money.

If you want cheap vinyl try ebay or gemm, but for new releases you are just going to have to bite the bullet.
Or switch to mp3