The men's ministerial gymnasium, whose history begins with a folk school founded by G.R. Derzhavin, acquired a new building in 1866.

A city estate with a stone house was purchased for the gymnasium from Boris Dmitrievich Khvoshchinsky. It was located at the corner of Dvortsovaya Street (now Sovetskaya) and Penza Street (now Gymnaziyskaya or Kommunalnaya). In pre-revolutionary sources, the house is described as follows: "Khvoshchinsky's house is two-storied, with a similar wing, under which exits are made; service buildings, barns, stables are stone, all covered with iron; a wooden bathhouse, covered with shingles; the estate is divided into two courtyards and a garden; on two sides a square, on the third a street, on the fourth the house of the local authorities... In 1827, the post office was located in Khvoshchinsky's house, and Tsertelyov began to seek its eviction, which turned out to be not easy. Only in November 1827 did the gymnasium manage to occupy the new premises, which had been previously renovated: "the floors painted, the doors finished with varnish with brass locks and bolts, the walls in one room finished to look like marble, in others painted by master Pavel Lemberkh, who decorated the rooms with picturesque flowers and ornaments," for which he received gratitude.

On the plans of 1834 and 1836, three buildings are indicated in the "quarter occupied by the gymnasium": "The main two-story stone house with a balcony on six stone columns, with two wooden entrances... A two-story stone wing with two entrances, one of which is ceremonial with four stone columns, the other wooden... On both sides of the wing, there are two exits with brick staircases. Stone one-story service buildings connected at a right angle."

The further history of the Tambov gymnasium and its buildings in the 19th century is as follows:

In 1839, the gymnasium became one of the institutions preparing young people for admission to universities.

"In October 1843, the Ministry allowed the opening of a boarding house and the reconstruction of the building, which was immediately started." Architect Shustov remodeled the wing into a boarding house.

In 1863, the question of constructing a new building for the gymnasium arose. Inspections showed: "...both houses are dilapidated, damp, cold, cramped, and inconvenient, therefore their reconstruction is necessary." In 1864, the construction of new buildings began, completed in August 1866. In 1877, extensions were made to the main gymnasium building, which has survived to this day. On November 23, 1869, Bishop Theodosius (Shapovalенко) consecrated a church there in the name of Saint Alexander Nevsky, the iconostasis for which was made at the expense of the city mayor Nikolai Mikhailovich Nosov.

Today, one of the faculties of Tambov State Technical University is located in the buildings of the former men's gymnasium.