The Church of the Epiphany of the Lord, also known as Kukshinskaya, was built in the first half of the 18th century, with the last architectural changes occurring in 1875. The main building is a square structure with semi-domes, topped by an octagon. In 1875, a refectory was added with chapels dedicated to Kuksha of the Caves and Saints Peter and Onuphrius the Great, as well as a bell tower in the classical style.

The first mention of the church is found in the Census Book of 1625-1626, compiled by scribe Vasily Vasilyevich Chernyshov and clerk Osip Bogdanov. It mentions two wooden churches that stood on this site: the Church of the Epiphany of the Lord and the Church of St. Paraskeva Friday. Both churches were located in the territory of the Mtsensk settlement, the Plaited City, and the gates nearby were called the Epiphany Gates. One of the churches was cold and spacious, while the other was warm, meaning heated in winter. The churchyards housed the clergy's yards and several peasant yards. The consecration of one of the churches in the name of St. Paraskeva Friday indicates the presence of a city market, which is not surprising, as the road to Oryol ran from the Epiphany Gates. Later documents from the second half of the 17th century mention only one wooden Epiphany church.

In the 18th century, the wooden church was replaced by a brick one, built by merchant Borovitino and the servant Anofriy Khodanov. In 1915, A.I. Firsov described the church as standing on the outskirts of the city, on a rampart rising above the railway tracks, at an old cemetery. The stone church, dedicated to the Epiphany of the Lord, was the oldest in the city. For a long time, it remained without a parish and gradually fell into disrepair, with its bell tower leaning and threatening to collapse. In 1875, a brotherhood was established in the church in the name of the Holy Martyr Kuksha, which restored the old church and added a new bell tower and refectory with chapels. The church was small and dark, and its relic was a part of the relics of St. Kuksha. In the right part of the iconostasis was a cypress wood reliquary with an icon of the holy martyr, depicted in full vestments. The relics of the holy martyr rest in the Antoniev Caves of the Kyiv Pechersk Lavra, and part of them was solemnly brought to the city on August 26, 1895.

The Church of the Epiphany was closed in the 1930s. It suffered greatly during the Great Patriotic War, and soon after its end, the ruins of the church were demolished.