In 1890, a two-story brick building was erected on the hospital complex, now located on Moscow Street and facing south. The central part of the building, topped with a wide dome, was connected to two large two-story wings. This was a hospice for terminally ill patients suffering from cancer and sarcoma.

The hospice was built with funds from L.V. Vysheslavtsev, who headed the provincial zemstvo administration for a long time. Of his donations, 80 thousand rubles were spent on the construction of the hospice for one hundred people, and 120 thousand rubles for its maintenance. The city provided the land for construction. The lower floor of the building was designated for the men's ward, while the upper floor was for women. The left wing was used for paying patients, and the right for all elderly patients. Spacious and comfortable wards were located on the sunny side, while the corridors were on the northern side. Each person had at least 6 cubic meters of air.

The hospice carefully considered the conditions for living, treatment, and spiritual care. A library was organized for the patients, as well as two gardens for walks. To maintain mental balance, A.V. Vysheslavtsev founded the Elizabethan Church.

In honor of L.V. Vysheslavtsev, the hospice's benefactor, and A.V. Vysheslavtsev, the church's founder, two "eternal beds" were opened in the chambers. The renowned doctor S.K. Olenin spent his last years at the Elizabethan hospice.