The only church that has survived in Buzuluk since pre-revolutionary times is the temple in the name of All Saints. This is a basilica structure with a wooden bell tower above the narthex, which is popularly called All Saints, Cemetery, or Kiselevskaya. The church was built on the city cemetery, located on the southeastern outskirts of the city.

The church was constructed by merchants, the Kiselev brothers, in memory of their father, Gerasim Mikheevich Kiselev, who passed away in 1897. He was a first-guild merchant and an honorary citizen of the Samara province. Gerasim Mikheevich was a deeply religious man and served for a long time as the church elder of the Buzuluk Trinity Cathedral. The temple was small, and beneath it was the family burial vault of the Kiselevs.

The consecration of the temple took place on April 21, 1901. Regular services were not held in the church, only funerals. Later, the church was expanded by adding left and right chapels.

The fate of the All Saints Church, like many other temples, was dramatic. In 1937, it was closed, and the building was used as a city archive, then as a grain storage facility, and later as an arms depot. In 1947, the church was returned to the faithful after extensive work on its expansion and improvement, and on July 8, the temple was consecrated again.

In 2000, the Holy Tikhvin Mother of God Buzuluk Women's Monastery was opened near the cemetery church of All Saints, located two hundred meters from the old buildings of the monastery.