The wooden church dedicated to the holy apostles Peter and Paul was founded in 1690 by Saint Pitirim. Initially, it was located on the outskirts of the city, where the A.S. Pushkin Regional Library now stands. Over time, as the area grew, the church became cramped, and in 1770 it was decided to move it to a new cemetery, named Petropavlovsk in honor of the church. In 1820, a stone church was built in place of the old wooden one with funds from merchant I.V. Shikhaev, which was destroyed in 1938. The last church building was erected in 1946-1947 by the community of the Pokrovsky parish for conducting funerals, and until the late 1980s, there were several attempts to close and demolish it.

Today, the Peter and Paul Church is operational. It features a square base with a low tent roof and an onion-shaped dome on a decorative drum. To the east, there is a five-sided altar apse, and to the west, a small narthex and a separate two-tiered stone bell tower with an onion-shaped top, built in 2005.