In 1899, a stone church with three altars was built with the funds of parishioners, consecrated in honor of St. Nicholas the Wonderworker. The church also had chapels dedicated to the Kazan Mother of God and St. John of Rila. A stone bell tower with an iron roof adjoined the church.

A church-parish school operated at the church, and the parish supported several district schools. In the villages of Shcherbachevka, Bardakovka, and Nizhnyaya Parovaya, there were two-class schools, and in Krasny Klyn, a one-class district school. Since 1900, priest Gavriil Alekseevich Vishnevsky served as the law teacher in these schools.

Since 1937, the Nicholas Church in the village of Rzhava ceased to function due to the "refusal of the clergy to work." On September 2, 1940, the parish was abolished. As of January 1, 1953, a registered religious community was listed in the village of Rzhava. Services in the church were periodically interrupted due to the absence of a priest. In 1975, the church closed again, but in the 1990s, the parish was revived and continues to operate to this day.