I'm not sure if I want to quit this band, what do you think?

If I were you, I would talk to my good friends in the band about either playing different music or quitting and starting a new band with just the three of you. I think it's better to be in a garage band with good friends than playing a big gig with somebody you hate. I guess that would only work if you guys all have the same taste in music. If they don't want to quit, then just try to make the best of it. If you really hate it, then quit.