In 1870, the diocese acquired a house on Bogoyavlenskaya Street for the winter residence of Kaluga archbishops. This house was built by the Torubayev family in the mid-18th century. In 1875, a school for singers with a church dedicated to the Kaluga Icon of the Mother of God was erected near the archbishop's house. The iconostasis for the church was created by Kaluga icon painter N. L. Panov. Since 1918, the first floor of the archbishop's house housed the Diocesan Council, which replaced the abolished spiritual consistory.

In 1922, Bishop Theophan (Tulyakov), who lived here, was relocated to the wing where the singing school had previously been located. The archbishop's house became home to Children's Home No. 4. A proposal from the provincial education department regarding the eviction of the archbishop and the church council from the wing of Children's Home No. 4 was discussed at a meeting of the presidium of the Kaluga regional executive committee. This was due to the fact that the church and the wing shared an entrance with the children's home, which created inconveniences and had an undesirable influence on the children. As a result, a decision was made to evict the archbishop and the church council from the wing and to close the house church. From 1925 to 1955, the archbishop's house housed an eye clinic. After the war, the Kaluga Regional Medical School was also located here. On September 1, 1944, the Kaluga Music School opened in the building of the singing school and the church. Both schools continue to occupy these buildings to this day. The church in honor of the Kaluga Icon of the Mother of God at the archbishop's house is also still in operation.