At the southern wall of the Protection Convent stands the Church of Peter and Paul, built in 1694. It is one of the most significant structures of late Suzdal architecture, possibly influenced by the ensemble of the neighboring Protection Convent, from where the patrons of the construction originated.

The building resembles a cathedral more than an ordinary parish church. The temple has a wide and powerful volume, covered by a vaulted ceiling, and topped with five domes. The facades are adorned with a belt of horseshoe-shaped kokoshniks and divided by narrow pilasters, between which are windows with ornate frames. On the western side, a single-story porch with a western portal adjoined the church, and on the northern side, a chapel. At the northwestern corner of the church stood a now-lost tent-shaped bell tower of strict and monumental forms. Two sides of its square base adjoined the porch, while the two outer sides, north and west, opened with arches supported by a round and short corner column. This motif was borrowed from the ancient cathedral of the Protection Convent.

The picturesque and emphasized asymmetry of the composition of the Peter and Paul Church may have inspired the creation of the Kozmodemyansk Church on Kamyanka. The neighboring 'warm' church was built in 1712. One of its altars, the Alexey altar, was established by Yevdokiya Lopukhina, the exiled wife of Peter I, in memory of her son, Tsarevich Alexey, an opponent of Peter's reforms.