The stone church in Alexeyevka was built in 1813 and consecrated by Bishop Antoniy in honor of St. Dimitri of Rostov, the miracle worker, with an altar dedicated to the Kazan Icon of the Mother of God.

The church is designed in the neoclassical style characteristic of that time. Massive pilasters adorn all the porches and the altar projection. Under the triangular pediment are arched frames of semi-circular windows, while the other windows are rectangular. The light cylindrical drum above the central part of the church is topped with a hemisphere, crowned with an exquisite dome with a finial. The bell tower of the church is single-tiered and is topped with a unique funnel-shaped spire.

By 1886, the church had two clerical staff and owned 39 desyatinas of land. The parish included not only the sloboda but also the hamlets of Grechanikov, Ignatov, Novaya Melnitsa, and Sidorikin. The church had 1,120 parishioners.

In the early 20th century, the rector of the church became Dionysiy (Denis) Petrovich Kurbatov. He built a two-story stone house on the site of a former wasteland and dump on Shirokaya Street (now Komsomolskaya St., 75). The house had a homestead with outbuildings: barns for livestock, granaries, a bee house, and a garden. At that time, the sloboda Dmitrievka was not part of Alexeyevka.

The Kurbatov family lived here until 1919, after which they left to avoid persecution from the authorities. However, Denis Petrovich did not escape his fate and, like many priests, perished during the repressions of the 1930s.

In 1997, the church was renovated. The gilded crosses, dome, and spire were consecrated by Bishop Ioann of Belgorod and Stary Oskol. In 2006, a new fence made of red brick pillars and wrought iron was installed around the church. The church is recognized as a monument of history and culture and is under state protection.