The certificates don't confer all the rights of marriage but represent a step forward, activists say.
Tokyo has proposed offering certificates to same-sex couples that would give them access to privileges now denied them.
Japan is the only G7 country that does not recognize same-sex marriages.
Activists and community members rallied in Tokyo as the world's eyes turn to Japan.
The Summer Olympics are set to begin July 23 in Tokyo.