The founder of the U.K. Conservative (Tory) Party's gay group, Anastasia Beaumont-Bott, says she'll be voting for the opposition this May after a party official's antigay sentiments went unaddressed by leader David Cameron.

Chris Grayling, the Tory's home secretary, said hotel and bed and breakfast managers should have the right to turn away LGBT customers. It is in fact against the law for such establishments to discriminate against gay customers.

Beaumont-Bott, who is the LGBTory chairwoman, said she was discouraged by Grayling's words and Cameron's inaction.

“I feel guilty because as a gay woman affected by LGBT rights I am on record saying you should vote Conservative, and I want to reverse that," she said according to the U.K. Digital Journal. "I want to go on record to say don’t vote Conservative. I’d go as far to say that I’ll vote Labour at this general election.”

This move comes after the Tories made a big push to tout their 20 openly gay candidates, as well as its female and non-white candidates.