The noble family of Sumarokovs traces its origins to Levis, who arrived from Sweden to Grand Duke Vasily Dmitrievich and was baptized under the name of Judah. Mentions of the Sumarokovs appear in the spiritual testament of 1498 by Prince Ivan Yurievich Patrikeev, a descendant of Gediminas, the chief voivode of the Moscow princes Vasily II the Dark and Ivan III.

The estate in Sivcevo was arranged by Pyotr Pankratevich Sumarokov, an actual secret councilor. Behind the main house of the estate, a regular park with straight linden alleys was laid out, and two ponds were created. The peasants from Sivcevo, like the estate owners, attended church services in the neighboring village of Voznesenskoe on Orthodox holidays.

According to family legend, Pyotr Pankratevich was a godson of Peter I. He was a wealthy and influential man; according to the Senate archive, in 1737, his six estates had 1,670 serfs, supposedly gifted to him by Peter the Great.

Before his death, Pyotr Pankratevich divided all his property between his wife Praskovya Ivanovna and his children. Sivcevo went to his middle son Alexander. Alexander Petrovich was an outstanding personality: after a successful career in government service, he dedicated himself to writing. By the decree of the Empress dated August 28, 1762, his debts were paid off at the state’s expense, and he received the right to publish his new works at the expense of Her Imperial Majesty's Cabinet.

In 1769, the writer settled in the ancestral estate of Sivcevo and took care of its management. After his death in the autumn of 1777, the estate passed to his daughter Praskovya, who married Count Anton Petrovich Golovin. In the early 19th century, the main mistress of the estate and neighboring villages became the poet's granddaughter, the daughter of the Golovins, Elizabeth Antonovna.

It is believed that the stone one-story estate house with a mezzanine, executed in simple architecture, was built in the 1830s when the Kaluga estate was acquired by Tatiana Lvovna Miller, née Tolstaya. The Miller family finally settled in Sivcevo after the retirement of the estate mistress's husband, former Moscow police chief, Colonel Fyodor Ivanovich Miller.

Since the 1890s, the estate was owned by their grandson, retired Guard lieutenant Fyodor Vladimirovich. After the 1917 revolution, the descendants of the Millers were evicted from the estate, and a shelter for children with mental illnesses was opened in the former estate house.

Currently, the house built by the Millers in the style of late classicism and the park with a pond have been preserved.