The Musical Pavilion of the Horse Yard in Kuzminki is the most recognizable structure of the estate and a symbol of the suburban estates of its time. It is located opposite the main house, on the other side of the pond, and occupies an important place in the landscape of the estate, shaping views from different points: from the main house, from the entrance area, and from the park. The pavilion was built between 1819 and 1823 at the request of Sergey Mikhailovich Golitsyn, who became the sole owner of the estate in 1821. During this time, Kuzminki became one of the most famous suburban estates, alongside Ostankino, Arkhangelsk, and Kuskovo.

The reconstruction of the estate ensemble at Golitsyn's request was carried out by the outstanding architect Domenico Giliardi, who began working in Kuzminki in 1811 with his father, Ivan Giliardi. He dedicated twenty years to the estate, and Kuzminki became his most famous estate construction.

From 1819, Giliardi reconstructed the complex of the old stone Horse Yard, creating a new ensemble in the shape of a quadrangle, facing the estate house. The center became the Musical Pavilion, where during holidays and boat rides, a famous orchestra of horn players performed, one of the Moscow attractions of that time.

The pavilion was built as a light wooden structure with good acoustic properties. Its facade was almost entirely occupied by an orchestral niche-exedra with a double Tuscan colonnade, decorated with a sculptural group of muses and Apollo with a lyre. The facade wall up to the level of the colonnade cornice was designed with rustication, and above were medallions with reliefs of playing cherubs.

Sculptural groups were installed on either side of the arch. Initially, these were plaster copies of Roman statues, which were replaced in 1846 with castings of two of the four horse statues by P.K. Klodt, created for the Anichkov Bridge in St. Petersburg. These statues were popular in estate construction and were installed in Peterhof, Strelna, and also gifted to the Prussian and Sicilian kings. In Moscow, copies of the sculptures adorned the Running Alley near the racetrack.

Unlike the bronze originals, the sculptures from Kuzminki were cast from iron at Golitsyn's factories, just like all the cast iron decoration of the estate.

In 1978, the Musical Pavilion burned down but was later restored.