The church in the village of Novoselki has been known since ancient times. Among the churches of the Bryansk district destroyed during the Time of Troubles (1604-1613), a wooden church in Novoselki is mentioned. By 1760, it had fallen into disrepair, and the local landowner Vasily Alexandrovich Nebol'sin built a new stone church, which has survived to this day. The church, consecrated in honor of the Kazan Icon of the Mother of God, had three chapels: in honor of the Vladimir Icon of the Mother of God, in the name of Saint Nicholas, and in the name of Saints Athanasius and Cyril, Archbishops of Alexandria. In the 19th century, a three-tiered bell tower was added to the church, and in 1885, a church-parish school was opened.

In 1851, near the Church of the Kazan Icon of the Mother of God, a stone church was built in the name of the Chief Apostles Peter and Paul, funded by the landowner Pyotr Pavlovich Nebol'sin, which housed the family burial vault in its basement. This church was completely destroyed in the 1920s.

In 1937, the church was closed. Its summer part was used as a grain storage, and the winter part became a stable.

In 1998, the parish community was revived. Currently, the winter chapel of the church, consecrated in the name of Saint Nicholas, has been restored, where services are held.