The Church of the Holy Trinity, located on the grounds of the Holy Assumption Men's Monastery, was built between 1843 and 1845 as a family burial vault for the Kochubeys. The funds for its construction were provided by Senator Arkady Vasilyevich Kochubey, who also served as the governor of Oryol Province from 1830 to 1837.

The church was designed by Nikolai Yefimovich Yefimov. The mother, wife, and two sons of A.V. Kochubey were buried in the church, but their graves have not survived to this day.

In 1923, the Trinity Church was closed. In the 1980s, it was used as an art workshop. In 1992, the building was returned to the community of believers and underwent restoration. On January 22, 1993, the renovated church was consecrated by Bishop Paisiy of Oryol and Bryansk. Since 1998, it has served as the chapel of the Orthodox Gymnasium named after the Holy Martyr Kuksha.