In the center of the village of Antonovka, on a hill by the road, stands a church with pink walls that stand out against the backdrop of evergreen pines, attracting the attention of passersby and travelers. In 1709, a wealthy resident of Graivoron, Vasily Antonov, acquired a small village called Ivanevo, now known as Antonovka, and built a small church there from seasoned oak in honor of St. Anthony of the Caves, using his own funds and donations from the villagers.

Initially, the Antonov church was located on the Cliff, where the Vorskla River makes a sharp bend. Now, trees grow in that place, and closer to the road, a medical point has been built. Due to the annual erosion of the Cliff's foundation during the river's flooding, the church had to be moved to a safer location in the second half of the 19th century. The relocated church was surrounded by a stone and iron fence with two gates. Ten meters from it stood a watchman's hut, a small house with an iron roof, which had two rooms and a small kitchen. The hut served as a resting place for clergy, especially in winter, a rehearsal space for singers, and a school for children, but it was not a residential building. Services were conducted by Priest Nikolai Orlov and Deacon Alexey Nikodimovich Bogatinsky. After Bogatinsky's death in 1930, Orlov continued the services, living with his family in his house.

In 1938, the church was closed and converted into a club, and the watchman's hut was destroyed. The main initiator of the reconstruction was a local resident, I.R. Kulinich. The club operated until the 1990s.

At the numerous requests of the residents, the church was restored. A significant amount of work on the restoration was carried out by Archpriest Ioan (Cherkashin) along with his family. The residents of Antonovka and soldiers from the military unit in Belgorod-22 also contributed to the restoration of the church. The walls were plastered, and the windows and doors were painted. Now, the restoration of the icon of St. Anthony of Kyiv-Pechersk, the patron saint of the village, which is visible on the eastern facade of the church, is required. Neither time nor human actions, such as painting the facade or the barbaric actions of the German occupiers, could destroy the holy icon.

On July 23, 1998, the Antonov church was consecrated by a council of clergy on the feast day, and since then, parish life has resumed. In 1999, the Church of St. Anthony of the Caves celebrated its 290th anniversary.