The history of the estate begins with Fyodor Grigorievich Orlov, who acquired two large plots of land here. After his death, they were inherited by his niece, eleven-year-old Anna Orlova-Chesmensky. However, the actual owner became Fyodor's brother, Anna's father, Count Alexei Grigorievich Orlov-Chesmensky.

At this time, significant changes occurred at the estate, related to the Count's passion for horses. Two breeds of horses, the trotter and the riding horse, known as Orlov horses, were bred at his stud farm. Before gaining worldwide fame at racetracks, these horses demonstrated their qualities on the Orlov meadow, which was located where Lenin Avenue now runs.

A long stone building of the Manege and adjacent stables was constructed along the northeastern boundary of the service yard. The manege hosted carousel events, equestrian competitions, and processions in which the Count's daughter Anna participated.

In 1844, architect E.D. Tyurin reconstructed the manege and stables to accommodate a cavalry squadron. These buildings were used for their intended purpose until the revolution. Orlov's manege remained the largest until the construction of the manege at the Kremlin walls.

In 1918, all properties were nationalized and placed under state protection. Various museums were located here. In 1934, the Museum of Mineralogy moved here when it was decided to transfer institutions of the Academy of Sciences from Leningrad to Moscow. The relocation of the museum required 30 train cars. The collection included about 60,000 exhibits and 20,000 duplicates. Despite the difficulties, the move took place, and since 1936, the museum has been in Moscow, welcoming visitors in the building of the former Orlov manege.