The church was built in the classical style. Its lower part is a square base, while the upper part is an octagonal drum with a round dome. On the sides, there are entrance porticos with triangular cornices and pilasters, between which are three round windows. On the western side, a three-tiered bell tower with a clock and a low spire adjoins the refectory. Inside, the church is bright and airy due to numerous windows and soft tones of the decor. The high vault creates a sense of spaciousness, especially on sunny days. The church houses relics: a casket with the relics of the apostle Paul and two icons with particles of the relics of Saint Matrona of Moscow and Saint Luke Voyno-Yasenetsky. The cathedral was established thanks to Catherine the Great.

In 1877, the iconostasis was gilded with the support of Petersburg merchants Abaturov, Korovin, Zapevalov, and Baranov. The four-tiered iconostasis, covered in red gold and adorned with columns featuring grape clusters and leaves, long amazed with its beauty. The icons of the lower tier were created by court painters of Catherine the Great and were distinguished by high craftsmanship. The walls and vaults of the cathedral are decorated with sacred images by local artist P. A. Yurov. In the altar, above the holy table, a canopy was arranged on four gilded pillars with an image of the Holy Spirit on the vault. Of the three windows in the altar, two were closed with images of apostles Peter and Paul, made of foreign glass and purchased by merchant L. F. Abaturov at the Vienna exhibition. They were inserted into gilded frames and placed in the church. The church utensils also held great value. In 1870, a railway passed through Petrovsk, and a station was built. Visitors were transported by carriages to the city center to the Peter and Paul Cathedral and the Holy Trinity Church for 50-80 kopecks. In 1807, northeast of the Peter and Paul Cathedral, a single-domed warm Trinity Church was built with the funds of parishioners. The head of the cathedral, Fyodor Yakhontov, erected a stone fence around the churches with four iron gates, two chapels, and towers.

After the Bolsheviks came to power, the Trinity Church was closed, the stone fence was dismantled for bricks, and the crosses from the dome were removed. The church stood for a long time without a dome until it was dismantled for bricks. The Peter and Paul Cathedral was closed in 1938. The crosses were removed from the domes, and the bells from the bell tower. The priest Father Gennady Letyuk was arrested and died in prison. The building of the cathedral was converted into a repair and tractor workshop, and later a warehouse for the Household Service Combine.

On January 29, 1991, a decision was made to transfer the church to the community. The building was found to be severely damaged and cluttered with scrap metal and debris; it took an entire season to clear it all. Outside, the church was covered with more than one and a half meters of soil. The entire warm season of 1992 was spent excavating and cleaning the walls. On July 12, 1993, on the feast of Peter and Paul, the first service was held after many years.