In the mid-18th century, the estate of the famous industrialist Prokopy Demidov was located here, who built a palace and laid out a luxurious terraced garden. Later, under the new owner, Count Orlov-Chesmensky, pavilions appeared. Then the estate and the neighboring estates of the Golitsyns and Trubetskoy-Shakhovskys were acquired by Emperor Nicholas I, merging them into one large estate called Neskuchny Garden, just like the estate of Prince N.Yu. Trubetskoy.

In the second half of the 18th century, under Count Orlov-Chesmensky, one of the service buildings was constructed as a riding hall with a stable, which later became a reception hall at the Alexandrine Palace. During the Soviet era, the Mineralogical Museum moved here from Leningrad, named after Academician Alexander Evgenievich Fersman. Founded in 1726 in St. Petersburg as the mineralogical cabinet of the Kunstkamera, the museum has been managed by the Russian Academy of Sciences since 1725. Its collections contain over 135,000 exhibits.

The architecture and interior of the buildings were updated in 1833-1834 according to the design of architect Yevgraf Dmitrievich Tyurin in the Empire style, popular in Moscow at that time. Four two-story buildings are located with their end facades facing the Moscow River, between which an alley leads to the gates of Neskuchny Garden. The fence and gates were erected in 1935 according to the design of architect V.A. Domanov.

The facades of the buildings are designed in a unified style: a risalit with a grand entrance and a semicircular arch, symmetrically arranged windows with wedge-shaped tops, rusticated stones, and an antique entablature with triglyphs and a pediment. The interior of the Mineralogical Museum is also executed in a strict style: a large hall with arched windows, an antique ceiling, and columns, where tables and stands with exhibits are located. The light and Empire decor emphasize the value of the collection.

Other buildings are also designed in the Empire style, but with slight differences. Their side facades are less ornate than the end ones, but the overall grandeur is well visible from the depths of the garden, especially due to the slope towards the Moscow River, creating the effect of an ancient acropolis. The buildings are connected by walls with arched passages, and various organizations of the Russian Academy of Sciences are located within them. A restoration was carried out a few years ago.