In 1711, by the order of Archbishop Joseph of Veliky Ustyug, a small church was built over the grave of St. Cyprian of Ustyug, dedicated to the Half of Pentecost. Although the decorative design of the facades of this church was less ornate compared to other Ustyug churches of the early 18th century, it still had its own features. The pilasters between the windows and at the corners of the facade were complemented by two horizontal rolls running along the entire facade above and below the windows, as well as vertical rolls on both sides and a third roll under the cornice of the square. For the first time in Ustyug architecture, window frames in the form of drawn eyebrows were used to decorate the square, giving the building a festive appearance. In the mid-18th century, a stone porch was added to the church from the west, the decor of which repeated the design of the square. In 1809, two small stone extensions were added to the north side, one of which became an altar in the name of St. Cyprian in 1848. From 1842, a refectory was added to the west side of the church, to which a timber porch was added in 1845, and a brick porch in 1910. By the early 20th century, due to numerous extensions, the originally small church of the Half of Pentecost had increased threefold.

In the monastery, St. Cyprian was venerated, whose relics by 2004 were buried in the church of the Half of Pentecost. In the 19th century, a stone tomb with an image of the saint on canvas was erected over his burial site, and a stone was placed, one of those with which, according to tradition, St. Cyprian marked the boundaries of the monastery. At the gates of the monastery, at the site of the death of Blessed Procopius of Ustyug, a wooden cross was erected in the 14th century, which was replaced by a white stone one in the 17th century. In 1707, the cross was framed with an icon frame depicting the Passion of Christ, and in 1737, during the construction of a stone fence, it was moved to the refectory of the Introduction Church. It is now in the collection of the Veliky Ustyug Museum-Reserve. In the early 19th century, a stone chapel was built at the site of the ascetic's death. The icon 'Assembly of Archangel Michael' from the late 13th century, which was in the Archangel Church of the monastery, is now kept in the State Russian Museum.