Can't change audio spectrum colour

I'm having a simple (I think) problem with After Effects CC. When I put an adjustment layer with curves fx on top of my audio spectrum, it won't change colour. In audio spectrum fx settings when I change inside/outside colour, it does work, but I want to use my adjustment layer. Any suggestions would be appreciated, I'm working on my uni project and the deadline is tomorrow morning!