The wooden Church of St. John the Baptist in Olkhovka was built in 1870. In 1929, it was closed and converted into a grain storage facility.

The church was fully reopened in 1989 after restoration and consecrated by Archbishop Juvenaly (Tarasov) of Kursk and Rylsk. At the end of October 1998, a fire occurred in the church, after which services were temporarily held in a kindergarten building. In 2010, a reconstruction project for the damaged church was developed.