The oldest of the surviving civil buildings in Totma is the house of merchant Fyodor Kholodilov, a renowned navigator and industrialist. In 1747, he, along with merchant Trapeznikov, founded a fishing company that sent the ship 'Ioann' to the shores of Bering Island. This ship made three voyages to the Commander and Near Aleutian Islands.

For nearly 40 years, Fyodor Kholodilov and his nephew Alexei engaged in entrepreneurship. During this time, they organized seven fishing expeditions. Having become wealthy from fur trade, Kholodilov built a magnificent urban estate on the high bank of the Sukhona River. Built in the late 18th century, this building became the central element of a large urban estate. Subsequently, it passed into the ownership of the treasury and police department and underwent reconstructions in the 19th century. As a result of these changes, a boundary wall and several new extensions appeared, including the Church of All Who Sorrow and the apartment of the prison overseer.

The two-story building, executed in the style of mature classicism, has a unique composition. Its main facade is adorned with two triangular pediments and large pilasters with rich capitals. The varied window frames add decorative richness to the facade. Because of this, Kholodilov's house stands out significantly among the civil buildings not only in Totma but also in Veliky Ustyug. It was likely created by capital craftsmen or according to their design.