In 1895, a new stone Friday church with three altars was built in the village of Kuvshinnoye. According to data from the "Reference Book on Churches, Parishes, and Clergy of the Kursk Diocese," by 1908, the parish included not only the village of Kuvshinnoye but also the villages of Alyabyeva, Belomestnoye, Chuykova, Khvostova, Yeremina, and Maykova, with a population of 1166 people. Since 1883, the priest of the church was Vasily Mikhailovich Khoroshilov, with Dmitry Grigorievich Popov serving as deacon since 1894, and Ivan Georgievich Shafranov as psalmist since 1854.

Two zemstvo schools operated in the parish: in the villages of Alyabyeva and Khvostova. The patron of both schools was the nobleman Alexander Sergeyevich Perfilyev from Karasyovka, and the law teacher was priest Alexey Khoroshilov. The teacher in the Alyabyeva school was the noblewoman Lydia Vasilyevna Tolmacheva, and in the Khvostova school, Olympiada Ivanovna Novoselskaya.

The external appearance and interior decoration of the church can be judged by the insurance card dated July 5, 1910, stored in the Russian State Historical Archive in St. Petersburg. According to the card, the Spaso-Pyatnitskaya church was stone, unplastered on the outside but painted with oil paint. The roof was covered with iron painted green. The length of the church, including the bell tower, was 15 sazhen (32 meters), the width was 10 2/3 sazhen (about 23 meters), and the height to the cornice was 3 ½ sazhen (7.5 meters). The church had one large dome and 26 large windows, as well as three external double-leaf doors. Inside, it was plastered and had six internal double-leaf doors. The iconostasis, 30 arshin long (over 21 meters) and 15 arshin high (10.5 meters), was valued at 2000 rubles. The church was not heated.

The bell tower of the church was two-tiered, with a height to the cornice of 4 ½ sazhen (9.6 meters). The nearest building to the church was the priest's house, located to the southeast about 100 sazhen (just over 200 meters) away.

By 1910, the church remained in good condition and, along with the iconostasis and bell tower, was valued at 10000 rubles.

A watchman's lodge was built next to the church, measuring 20 arshin (14 meters) long, 10 arshin (7 meters) wide, and 4 arshin (2.8 meters) high. Its wooden walls were covered with iron. The lodge had 12 windows and 4 doors. It was planned to complete the construction by the end of 1910, and its insurance valuation was 1000 rubles.

After the decree of the SNK of the RSFSR on January 23, 1918, "On the Separation of Church from State and School from Church," the Friday church continued to operate based on an agreement between the residents of Kuvshinnoye and the Council of Workers', Peasants', and Red Army Deputies of the Kursk District.

Despite protests, particularly active in 1930, the Friday church in the village of Kuvshinnoye was closed by the decision of the presidium of the Kursk Oblast Executive Committee on June 23, 1939. For some time, the building was used as a grain storage facility, and then it was abandoned.

Since the church was located near the cemetery, local residents did not forget about it. In the early 1950s, the church was demolished by the authorities.