The church dedicated to Saint George the Victorious was built outside the city rampart in the Forshtadt on June 25, 1756. By decree on July 2 of the same year, it was consecrated with the blessing of Archbishop Gabriel of Kazan and Sviyazhsk. The construction was carried out by the Orenburg Cossacks, who used part of their monetary salary at the order of the then-governor Neplyuev and under the guidance of Cossack Ataman Vasily Mogutov. The church was made of stone, with stone vaults and a bell tower, had one altar, and was furnished with expensive utensils. All sacred items on the holy altar and the sacrificial table were made of silver.

Church parades were initially held in the cathedral square, but from 1891 they began to take place in the square by the chapel, located between Forshtadt and the city, near the city fire tower. In 1889, among the officers and Cossacks, the idea arose to commemorate the miraculous rescue of the royal family during the train crash on the Kursk-Kharkov route by building a chapel with an icon of the saints honored on October 17, the day of the crash. Due to a lack of space in the cathedral square, it was decided to erect the chapel in the Forshtadt square by the fire tower.

The construction of the chapel was completed by July 26, 1891, in time for the arrival of Tsarevich Nicholas Alexandrovich, who was the august ataman of the Cossack troops of Russia. The heir to the throne attended a service in the new chapel. In 1913, near the chapel, the Cossacks of the Orenburg Cossack army built the Znamennaya Izba, a museum of the military glory of the Orenburg Cossacks.

The cathedral, chapel, and Znamennaya Izba existed until the 1930s, after which they were completely destroyed. Now, on the site of the cathedral, there are private residential houses on Pugachevskaya Street, and on the site of the chapel is the gym of the Orenburg State Agrarian University.