The House of the Palace Department was built in 1817 and reconstructed in 1837. The building is designed in the Empire style and has two floors. The facade features a five-axis mezzanine and a portico decorated with stucco in the Doric style, supported by six columns on the first floor. The walls of the lower floor are adorned with rustication.

From 1820 to 1830, this house was home to Prince and Senator I. A. Gagarin, known in literary circles, and his beloved, later wife, actress Ekaterina Semyonovna Semyonova, who performed at the Alexandrinsky Theatre. In the 1860s, the Decembrist A. N. Muravyov, who returned from exile after a conflict with Sheremetev, lived here.