The millionaire merchant von Filimonov built several large buildings in Rylsk. One of his first projects was a residential house on Lenin Street. At the end of the 18th century, he began constructing a three-story building with columns on high pilasters, a cornice with teeth, and a pediment. Later, this house was converted into a spiritual school. In the early 20th century, a large wing in a different architectural style was added, and now the old part of the building is noticeably different from the new. Currently, this building houses the Rylsk Agricultural College.

The Church of Cyril and Methodius, which was associated with the seminary (until 1906, the spiritual school), was located on the third floor of the western wing of the building constructed in 1876. Its area was 205 square meters, and it was distinguished by its dome. The walls and ceilings of the church were adorned with magnificent frescoes by the artist Izhakevich. Above the roof rose a dome with an onion-shaped top and a cross. The church was closed shortly after the revolution.