The city of Zheleznogorsk, founded in 1957, was built by the efforts of Komsomol members. Until 1990, there was not a single Orthodox church here. The first Orthodox parish appeared in 1989. On January 25, 1990, with the blessing of Archbishop Juvenal, an Orthodox community was registered and the construction of a church in honor of All Saints who shone in the Russian land began.

The construction of the church lasted seven years and was funded by donations from parishioners. The first rector and head of the church was Priest Sergey Frolov, who since 1994 has also been the dean of the Zheleznogorsk district of the Kursk diocese. While the church was being built, Father Sergey held services in a construction trailer.

The church building is two stories high, with basements, constructed from standard panels and metal structures used in the construction of multi-story buildings, while the bell tower is made of brick. The dome, arches, and columns, as well as the vaults inside the church, were manually cast from expanded clay concrete. The church stands on a monolithic reinforced concrete slab without a foundation.

The main altar of the church is consecrated in honor of All Saints who shone in the Russian land. The church's feast day is celebrated two weeks after Pentecost. On the first floor, there is an altar in honor of the Pochaev Icon of the Mother of God, where daily services are held, and an altar in honor of Andrew the First-Called, where the sacrament of baptism is performed. The Pochaev Icon of the Mother of God, one of the most revered relics of the Russian church, is known throughout the Slavic world. It is honored in Russia, Bosnia, Serbia, Bulgaria, and other countries. The icon is considered a protector for those born from September 24 to October 23. The Holy Apostle Andrew the First-Called was the first of the apostles to follow Christ and suffered a martyr's death on the cross, which has since been called the Andrew Cross.

The All Saints church has a Sunday Orthodox school attended by children's groups of various ages. Weekly classes for adult parishioners are also held, and a library operates.

On the church grounds, the schemamonk- hieromonk Philaret is buried. At Father Sergey’s initiative, a resident of the city who actively participated in the construction is also buried in the churchyard. Here rests Gennady Vekhlov, known as a benefactor and patron.

Since the completion of construction, daily services have been held in the church. On Sundays and holidays, two Divine Liturgies are served.

Next to the All Saints church is an ancient shrine, the spring of St. Tikhon of Amathus. More than 400 years ago, a miraculous icon of St. Tikhon appeared here. In 2001, the spring was improved through the efforts of the parish and the city administration. An annual procession is held from the church to the spring.

In 1996, a miraculous icon of St. Nicholas of Myra was brought to the church, which participated in a procession from Odessa to Moscow. In 2005, a reliquary with the relics of saints from Mount Athos was delivered to the church.