A two-story stone building was added to the craft school located on Dvoryanskaya Street, designed by provincial engineer Kolodko. This building housed a chapel in the name of Nicholas the Wonderworker, consecrated on May 9, 1895. The church was considered one of the best in the city. It was built with funds from V. Ya. Shvetsova and was located on the second floor. A grand cast-iron staircase led to it from Dvoryanskaya Street, presumably made at the factory of I. M. Lobanov, although there are reports that the casting was done at Ural factories. The parquet floor and the altar made of cypress in the church were crafted by the students of the craft school.

On January 1, 1892, an art gallery was opened in the building of the craft school, bequeathed to Penza by former governor N. D. Seliverstov. The gallery remained there until 1897, when it was moved to the building of the art school.