It is believed that the three-story house in the classical style was built a few years before the start of the Pugachev uprising. According to legend, during the capture of the village, in a room on the upper floor, the rebels strangled the elderly hostess who refused to hide in the forest with her children. Upon returning, her sons decided to dismantle the upper floor to rid themselves of the memories of the tragedy.

There are no documentary confirmations of these events, except for a list of nobles executed by Pugachev's men, compiled by Alexander Pushkin, which mentions the Dubensky spouses, who were killed in the Penza province. However, the location of their death is not specified.

In reality, the house was laid in the 1820s-30s, half a century after the Pugachev events. Memories of Nikolai Dubensky, the leader of the Penza nobility and a senator, have survived, who during this period complained about the lack of a suitable house for receiving high-ranking guests. It is likely that he began the construction of the house and the arrangement of the estate with a pond and park.

The construction was delayed due to a lack of funds, as the senator's affairs were not going well. Later, new owners added brick extensions to the house, which is noticeable due to the difference in architectural styles.

Meanwhile, the estate fell into decline. The mystical reputation of the house scared away many inhabitants. Mysterious glowing orbs and the spontaneous movement of objects were associated with the execution of the landlady by Pugachev's men, believing that her restless soul became a bad omen. The owners of the estate often changed.

The house experienced a brief flourishing before the revolution. The last hostess, Sofia Ladyzhenskaya, who did not believe in omens, put the park, flower beds, and pine alley in order, deepened the pond, and raised trout in it. Under her, a horse farm, mill, apiary, and greenhouse were built. A local resident of Zagoskino, Viktor Neklyudov, recalled that his mother worked as a waitress for Ladyzhenskaya and loved the hostess very much, who generously shared excess produce.

According to Viktor Nikolaevich, there was a large cellar in the house, and there was a space in the ceilings between the floors where a person could fit. The purpose of this opening remains a mystery.

While clearing the park, many old buttons, broken porcelain dishes, figurines, and coins were found, many of which dated back to the 18th century.