In 1803, Dmitry and Alexander Grachev acquired the estates of Mikhneva and Karnaukhov for the creation of a calico manufactory. A. D. Grachev built a residential estate complex, which included the house that has survived to this day and two wings.

In 1812, the Grachev house was not damaged by fire. The residential part of the estate was separated from the factory. It consisted of a two-story main house with a mezzanine and two identical single-story wings, symmetrically located on either side of the main courtyard and facing the street. The wings were built in 1816 and 1817. In 1834, 1843, 1849, and 1850, the residential part was expanded: extensions were added to the house, the western wing was enlarged, and a stone fence was erected along the street. In 1846, the property passed to merchant S. Shusharin, who converted the buildings into a chemical plant with dyeing and drying workshops. The factory part was purchased in 1847 by the Ganeshin brothers, who registered the establishment in 1871 as the Partnership of Wool and Spinning Factories of Brothers V. and N. Ganeshin and Co. Four years later, they acquired the residential part of the estate, restoring its former boundaries. Under the Ganeshins, the residential buildings began to be used for economic purposes: in 1875, both wings were renovated, the eastern became an office, and the main house housed a wool warehouse.

In 1879 and 1880, the main house was redesigned into apartments for factory workers, and a third floor was added. At the end of the 19th century, the property was acquired by a lace factory, which was nationalized after 1917. Based on the old production, the Livers Lace Factory of the Trust 'Mostrikotazh' first appeared, and then, from 1940, the Curtain-Lace and Tulle Factory named after E. Telman. Initially, the main house housed dormitories for workers, then a kindergarten and factory office.

In 2003 and 2007, the foundation of the eastern wing was reinforced, brick and white stone masonry was repaired, as well as the vaults of the basement, the roof was replaced, and the facades were restored. Interiors were restored: parquet, cornices, and doors were recreated.