The chapel dedicated to All Saints was consecrated on August 9, 1998, by Archbishop Paisiy of Oryol and Livny, with the participation of the rector, Archpriest Vladimir (Dorosh V. V.), and benefactor Joseph Nikolaevich Kalashnikov. The chapel is located above a well from which water rises from a depth of 140 meters and flows down the Cross inside the chapel.

On this site, a wooden church was built between 1641 and 1646, serving as the temple of the Epiphany Men's Monastery, which existed until 1680. After a fire that year, the monastery was moved to Vzvozna Gora, and a stone building was erected for the church. In 1822, a large bell weighing 568 poods (about 9 tons) was installed in the bell tower with chimes, and until 1830, its ringing marked the beginning of the church bells for all churches in Oryol.

In 1837-1838, the church was significantly rebuilt and expanded, the refectory was connected to the bell tower, and a stone fence with main gates was erected. In 1900, the dilapidated bell tower was dismantled, and in 1908, a gate bell tower was built, which was destroyed in 1930. From 1901, the priest, and from 1903, the rector of the church was Ilya Vasilyevich Livansky (1854-1920), a well-known spiritual writer, local historian, and bibliophile, who taught the Law of God in various educational institutions in the city. From 1921-1922, the Oryol fool for Christ, Athanasius Andreevich Saiko (1887-1967), lived in the bell tower.

The church was closed in 1938, and a year later, the bell tower was demolished, and the fence was destroyed. From 1939 to 1941, the building housed an anti-religious museum. Worship services resumed in December 1941. After the liberation of Oryol from the German-fascist invaders, the church remained a cathedral, but it was closed again in 1960. From 1962 to 1993, the building housed a puppet theater. In 1993, the church was handed over to the community of believers, and after renovation and restoration work, it was consecrated in 1996. In 1997-1998, a chapel dedicated to All Saints was built and consecrated next to the church.