Annise Parker was sworn in as mayor of Houston at a private ceremony Sunday afternoon, the Houston Chronicle reports. Parker used her grandparents’ Bible and had her partner, Kathy Hubbard, at her side as she took the oath of office.

Houston is now officially the largest U.S. city with an openly gay mayor.

According to a press release issued by the city, the swearing-in was private to avoid overtime for costs for police and other city employees that would have otherwise been needed for the ceremony. “At a time when the city is facing budget shortfalls, we will be continually looking for ways to cut expenses,” Parker said in the statement.

The new mayor will take the oath again — more publicly — during inaugural festivities planned for Monday morning at the city’s Wortham Theater Center.

Read the full Chronicle story here.