In the early 19th century in Kaluga, against the backdrop of active public life development, the need arose for the construction of a building for the Noble Assembly. The initial projects created by the chief architect of the Kaluga province, Nikolai Fedorovich Sokolov, were not realized.

Major construction work was carried out in 1848 and the 1850s under the guidance of architect Pyotr Ivanovich Gusev, a former serf, under the supervision of the chief architect of the Kaluga province Ivan Ivanovich Tamansky and engineer Alexander Dmitrievich Kavelin.

The two-story building with a three-story central block and a balcony on four massive columns became one of the symbols of the city, often depicted on postcards.

The facade of the mansion, made of red brick in the classical style, is adorned with white pilasters with capitals decorated with volutes and acanthus leaves, while inside, an impressive cast-iron staircase captivates with its artistic design.

The main event regularly held in the building was the meetings of the noble assembly, which took place every three years in the ceremonial hall on the second floor.

Over time, the Noble Assembly House became an important center of public and cultural life in the city and province. Charitable concerts and balls were organized here, and in honor of the arrival of the heir to the throne Alexander Nikolaevich (the future Alexander II), art exhibitions, literary and musical evenings were held. Pianist Nikolai Grigorievich Rubinstein and composer Sergey Ivanovich Taneyev performed here, and it was visited by Alexei Konstantinovich Tolstoy and the Zhemchuzhnikov brothers.

In 1899, the halls of the house hosted an exhibition of paintings by the Wanderers, featuring works by Abram Efimovich Arkhipov, Nikolai Nikanorovich Dubovsky, Nikolai Alexeevich Kasatkin, Isaac Ilyich Levitan, Mikhail Vasilyevich Nesterov, Vasily Dmitrievich Polenov, Ilya Efimovich Repin, Ivan Ivanovich Shishkin, and the native of Kaluga province, Illarion Mikhailovich Pryanishnikov.

Many significant events for the Kaluga province are associated with this building. For example, on August 26, 1866, in the large hall of the Noble Assembly, the Imam of Chechnya and Dagestan, Shamil, along with his sons, took an oath of loyalty to the Russian Tsar.

During World War I, the Noble Assembly became a center for collecting charitable funds and organizing events to aid the front and treat the wounded.

After 1917, the former residence of the noble assembly became the House of Labor, also known as the Workers' House, and was transferred to trade unions. In 1936, it housed the Palace of Pioneers with numerous clubs. In the 1990s, the building was renamed the House of Creativity for Youth, and it is now the Regional Center for Additional Education of Children named after Gagarin.