By the end of the 19th century, the village of Ustye and the settlement of Petrovka had five stone churches and one chapel, some of which were built on the site of old wooden ones. The residents of Ustye and the surrounding villages actively participated in their construction and improvement. The architectural ensemble of the Resurrection cemetery gave the village a special beauty, which can be called an open-air museum. The oldest structure here is the Resurrection Church, the construction of which began in 1763 and was completed in 1773. In 1784, a porch with a bell tower was added to its western wall.

Next to the Resurrection Church is the Nikolayevsky temple, built between 1820 and 1836. Its plan and facade were borrowed from the warm cathedral of the Vologda Cathedral. During the Soviet era, the temple was abandoned and fell into disrepair. In 1999, the Resurrection parish was re-registered, and restoration work began in the Church of St. Nicholas the Wonderworker. The church is now operational, and the first floor is accessible.

In 1841, a stone church fence was built around these temples. The fence posts and grilles were adorned with green clay vases. On the eastern side, instead of a fence, small stone benches were arranged, to the south was a watchman's hut with two windows, and to the north, a room for church utensils. In 1875, the northeast tower of the fence was directed towards the part of the fence with the holy gates, where a chapel was built in honor of St. Joasaph and Blessed Vasily, the Kamensky saints. In 2008, work began on the construction of the western part of the fence.