The Church of the Apostles Peter and Paul, built in 1770 on the site of an ancient women's monastery, is a vivid example of provincial architecture from the second half of the 18th century. Its appearance eclectically combines Baroque elements and forms borrowed from the 17th century, which is particularly noticeable in the volumetric-spatial solution of the central part with its traditional five domes and its decor. The influence of modern architecture is manifested in the finishes of the square base and the bell tower, high roofs, and elegant bulbous domes.

The brick church is located to the east of the Kremlin, in the city center, within a residential area. The building's plan is a rectangle elongated along the east-west axis, with a five-sided apse to the east, which is slightly narrower than the square base, and a rectangular dining room with rounded eastern corners to the west. The central symmetry of the plan is disrupted due to the displacement of the bell tower's volume to the north, so that the northern walls of the dining room and the bell tower are aligned. The second tier of the bell tower, where the chapel is located, has a rectangular shape with beveled northwest corners and is elongated along the north-south axis, with an adjoining five-sided apse to the east.

The original appearance of the church has not survived to this day. In the mid-20th century, the upper part of the main volume was dismantled, the second tier of the bell tower was demolished, and a wooden extension was added from the west. Until the summer of 2012, there was a museum of local history here.

In 2012, the church underwent restoration. Works were carried out to strengthen the rubble masonry of the foundations, waterproof the walls, restore the masonry, repair the roof, replace the windows, paint the facades, improve the territory, create a foundation, and clad the porch in white stone. The restoration was completed in September 2012.

Since October 2016, the church has been transferred to the Cherepovets Diocese, and a parish of the Church of the Holy Apostles Peter and Paul has been established here.