The first archival image of house No. 3/5 on Spiridonovka dates back to 1764, but archaeological studies from the 1970s showed that stone palaces were built here as early as the late 17th century. It is believed that workshops for producing explosive artillery shells, which were subordinate to the Puskarsky Order (from 1701, the Artillery Order), were located on this site. There was also an ammunition depot here, which explains the name 'Granatny Courtyard'. The memory of these workshops is preserved in the name of Granatny Lane, which adjoins Spiridonovka next to the palaces.

There are reports that the courtyard was planned to be moved further from the city, but for some reason, this was not done. In 1712, a major fire occurred in Moscow, which severely damaged Granatny Courtyard. The gunpowder depots exploded, and the building was almost reduced to ruins. However, part of the walls remained and was used in the construction of the new building.

There is another version suggesting that the palaces had an administrative purpose and served as housing for officials of the military department on the territory of 'Granatny Courtyard', which was probably located further down the lane.

In any case, the building needed reconstruction, and the new structure bore little resemblance to the former palaces. The only reminders were the brick vaults on the ground floor, some preserved window openings, and fragments of decor. According to archival data, in the mid-18th century, the house belonged to Prince M.S. Dolgoruky, later merchants lived here, and then the building became the residence of the clergy of the 'Great Ascension' church.

In the 1930s, the building was repeatedly remodeled, mainly for communal housing. In 1973, during preliminary restoration work, evidence was discovered that allowed for the dating of the building. It was decided to return the palaces to their original appearance of the late 17th and early 18th centuries. Restoration was carried out in the 1970s and 1990s.

Restorers recreated the layout of the building from that time, the vaulted ceilings of the floors, and the high hipped roof. On the eastern facade, a stone porch with a tent roof was restored, and along the western facade, a two-story gallery with an arcade on the first floor.

The facades of the palaces are adorned with restrained white stone decor, confirming their industrial purpose: the building is surrounded by a three-part cornice, window and door openings are framed by wide profiled lintels, and the vertical rhythm is supported by flat pilasters.

The cultural layer of the palaces from the 16th-17th centuries is a monument of archaeological heritage of federal significance and is protected by the state.