The church dedicated to the Apostles Peter and Paul is located in the center of the city of Klintsy, in a park. Its construction was financed by merchant and local factory owner P. Isaev in 1847, and the consecration took place on February 3, 1849. The building's design was developed by K. A. Ton, and it is one of the first examples of the Russian-Byzantine style in the Bryansk region.

In 1898-1899, the church was expanded: new walls were added on three sides, and two additional altars were arranged. The main altar was relocated and consecrated on July 8, 1898, in honor of the Holy Apostles Peter and Paul. The left altar was consecrated on July 20, 1898, in honor of Saint Nicholas of Myra, and the right altar on August 16, 1900, in honor of Saint Theodosius of Chernihiv.

In 1936, the church was closed, and during the Soviet regime, silver coverings from the icons were removed. Architectural elements such as the spire and the bell tower drum were destroyed. In 1943, during World War II, the church was returned to the faithful, which allowed the occupiers to gain the favor of the people. Regular services were held here, and assistance was provided to those in need. Due to the lack of blueprints, the outlines of the domes changed during restoration.

The church was closed again in 1964. The interior was distorted, frescoes and altar partitions were destroyed, and the space was divided. The alley connecting the church to the main street was eliminated, and the building was handed over to the sports society 'Spartak.' On December 19, 1988, the City Council of People's Deputies decided to restore the church, which began in 1991. The exterior of the church was brought closer to the original design, the iconostasis was rebuilt, and the interior was fully restored. The main altar was consecrated by Archbishop Melchisedek of Bryansk and Sevsk in June 1994.

In 1995, a Sunday church school was opened at the church, and in 2003, the blessing of Bishop Theophilakt of Bryansk and Sevsk was received for the establishment of a library.

A chapel in honor of the Resurrection of the Lord is attached to the church, located at the Orthodox cemetery. The construction of the church of the Blessed Prince Alexander Nevsky has been completed.