The historic temple in the caves was consecrated in 1903 in honor of the icon, which became known in 1888 in St. Petersburg. When lightning struck the chapel at the glass factory, the interior of the building was damaged by fire, but the image of the Mother of God remained unharmed. Coins from a broken donation cup stuck to the icon. Soon people began to receive healings from illnesses. In 1897, Archimandrite Mikhail, the abbot of the Buzuluk Monastery, ordered a copy of this icon. The image was met by a large crowd and also became known for miracles, receiving the name of the icon of the Mother of God 'Joy of All Who Sorrow' with coins. The church in honor of this icon was established in the caves, which were dug in the 1820s.

After the opening of the monastery in the caves, which represent underground corridors and earthen cells, elders lived there. Leo Tolstoy specifically traveled from his estate in Buzuluk to meet one of them. This visit is reflected in his correspondence with his wife and the memories of his children. After the monastery was closed, the church was destroyed, and the caves were likely blown up, as confirmed by the nature of the destruction. The revival of monastic traditions today occurs at the Spaso-Transfiguration parish in Buzuluk, where the clergy consists of monks. Under the guidance of Archpriest Leonid Antipov, now the bishop of the Buzuluk diocese, His Grace Alexius, and Igumen Vitaly Klimov, work began in the late 1990s to clear the caves. In 2001, a new church was laid, and its construction was completed in 2007. The consecration of the church of the icon of the Mother of God 'Joy of All Who Sorrow' took place on August 5, 2012. The Spaso-Transfiguration church was restored at the walls of the ancient monastery, which is now a women's colony. Today, weekly services are held in the church.