In the late 17th century, a large estate belonging to Peter I's grandfather, Kirill Poluektovich Naryshkin, was located here. It passed to his son Lev Kirillovich and then to his children. In the mid-18th century, after marrying E.I. Naryshkina, the owner became Kirill Grigorievich Razumovsky. In 1800, their children divided the estate into several parts. Plans show that at that time the estate was developing: huts were being built, greenhouses for growing rare vegetables and fruits appeared. After marrying Razumovskaya, the estate was owned by Sergey Semenovich Uvarov, president of the Academy of Sciences and minister of public education.

In the 1860s, the owner became Alexey Sergeevich Uvarov, founder of the Moscow Archaeological Society and one of the founders of the Historical Museum. In 1874, he sold the estate in parts. Part of the land was acquired by the Ivanenko family, who divided the territory into nine plots and put them up for sale. In 1887, architect Roman Ivanovich Klein bought six plots, three of which he sold to former peasant A.A. Panteleev from Vladimir province, a contractor for stone and construction works. For him, Klein built two apartment buildings in 1896 and 1897, and combined the three plots into a single estate. In 1889, Roman Ivanovich built a wooden house on a stone foundation with a mezzanine and a semi-basement for a water heating boiler. In 1896, the house was raised by a second floor, which housed an architectural workshop and library. The house belonged to Klein until 1918.

In 1900, along the red line of Olsufyevsky Lane, R.I. Klein built a three-story apartment building and two service buildings. A large part of the territory was occupied by a garden leading to the owner's mansion. The layout and construction remained unchanged until the 1950s, when the apartment building was raised by another floor.

In the 1990s, the architect's house was restored, although it resembled more of a reconstruction with adaptations. The original volumes were altered: a basement with significant depth appeared under the house, the single-story part of the building with the main entrance became two stories, some windows were bricked up, and the roof was raised. Additionally, the house received an attic that it previously did not have.

Currently, the house houses the museum "Our Era."