At the site of the modern Krestovsky Bridge in Moscow, at Rizhskaya Square, there once stood two twin towers built in the late 19th century to support the Mytishchi water supply. Their construction was financed by merchant and mayor of Moscow Nikolai Alexandrovich Alekseev, who actively invested his funds in public projects and was respected among Muscovites.

The towers were 40 meters tall and about 20 meters in diameter. Water flowed into the pressure tanks of the towers from the pumping station and was stored there before being directed to the city center. The upper floors housed water basins, while below were living and service quarters for the water supply workers. On the first floor was the Museum of Moscow City Economy, now known as the Museum of Moscow.

The towers were connected by a delicate bridge adorned with icons of St. George the Victorious and the Mother of God "Life-Giving Spring." The architect of these structures was Maxim Karlovich Geppener, known for his heavy and grim projects. Although the towers were functional, many found their appearance unattractive and reminiscent of Butyrka Prison. However, this was not the main reason for their demolition. The towers were located on a busy highway, and the bridge between them, only about 12 meters high, obstructed traffic. In 1939, the towers were demolished, and the Yaroslavl Highway was reconstructed.

With the emergence of the Moscow-Volga Canal in the 1930s, the city's water supply problem was resolved, and the opening of the Eastern Water Station made the Krestovsky Towers unnecessary. There were attempts at their reconstruction, and many architects proposed projects for their preservation, but none were realized.