A two-story brick building from the second half of the 19th century, previously owned by merchant Avraamov, is located on a steep slope of Pokrovskaya Hill, next to the Gorne-Nikolskaya Church. It was built in 1870 and represents a typical eclectic two-story mansion in the pseudo-Gothic style. This is expressed in the pointed windows of the second floor and two hexagonal towers with tent roofs. The first floor has a vaulted structure and includes two large reception rooms along the street facade. The interior has been remodeled multiple times. During the Great Patriotic War, the building was partially destroyed but was restored in 1948. In the 1960s, the shape of the roof changed, and metal railings, gates, and a wicket were removed. Since 1994, it has housed the Bryansk Diocesan Administration, and since 2004, the bishop's house, which contained the personal quarters of the first two bishops of the restored Bryansk Diocese. In 2008, the building underwent a major renovation. The house church in honor of St. Sergius of Radonezh was consecrated on December 17, 2010.