In the mid-18th century, the property at the current Smolensky Boulevard, 30, belonged to N.M. Zhelyabuzhsky, under whom the main house was built. This house can be seen on the map of Moscow from 1775. By the end of that century, the property changed owners, and in 1794 it was acquired by N.I. Nesvitskaya. She remodeled the old building, changing the facade decor from Baroque to Neoclassical style. A portico with four pairs of Corinthian columns and a luxurious pediment appeared in the center of the main facade. The project is attributed to Matvey Fyodorovich Kazakov, as the drawings of the 'Nesvitskaya house' are found in his well-known albums.

By the beginning of the 19th century, Nesvitskaya's estate had become a typical urban manor. The main house, facing Smolensk-Sennaya Square, was located at a considerable distance from the road, to which two wooden service wings closed off the fence.

The building was damaged in the fire of 1812 but was restored. In the second half of the 19th century, the estate underwent significant changes. In 1864, with funds from merchant Nikolai Vasilyevich Rukavishnikov, the first juvenile delinquent shelter in Moscow was opened here. Nine years later, by the decree of Emperor Alexander II, the shelter was named after its founder.

In 1879, the estate was significantly rebuilt according to the project of architect Alexander Lavrentyevich Ober. A chapel in the Russian-Byzantine style was added to the shelter building from the garden side, consecrated in the name of St. Nicholas the Wonderworker. Later, the entire composition of the architectural ensemble changed: from the side of Smolensky Boulevard, a new building appeared in place of the parade yard, obscuring part of the main house.

In 1920, the shelter was closed, and the building was converted into communal apartments, with additional windows punched into the main facade, distorting its appearance. In the post-war years, the building was restored.

Currently, various commercial organizations are located in the building.