Blond/Blonde

I've always used blond/blonde as male/female specific adjectives and I assume I picked it up from various books I've read over the years. Thinking about it, I always write a blond beer but blonde brownies: how subconsciously misogynistic am I?