In Penza, a memorial complex was created in 1980, representing the historical composition "Defensive Rampart of Penza of the 17th Century." The complex includes a bell tower, at the base of which is a real cast-iron mortar, a short-barreled artillery piece resembling a cannon. Here, one can also see a memorial plaque with the year of Penza's founding and a partially restored fortress palisade. All of this is located on the remnants of the earthen defensive rampart of the fortress, preserved since the city's founding.

In the 17th century, there was a wooden city fortress at this site, protecting the borders of the Russian state from attacks by steppe nomads. The rampart was part of the defensive structures. A wall made of sharply pointed logs ran along the top of the earthen rampart, and watchtowers were located at the corners. The rampart served to protect the fortress until the first third of the 18th century. In front of the rampart, a moat was dug, filled with water and lined with sharp stakes, with iron spikes scattered on the bottom, injuring the legs of enemy horses.

During the Kuban massacre, all the fortresses in Penza land were destroyed, and their defenders were slaughtered. However, the fortress of Penza withstood due to its location and the courage of the garrison, armed with cannons and muskets.

The defenders of the fortress hoped for help from above. In the center of the fortress, in the temple, they prayed before the icon of the Mother of God. The face of the icon had darkened, but in the morning, when the priests carried the icon to the city's defensive rampart, it brightened, instilling faith and hope in the hearts of the defenders. Captured Kuban soldiers reported seeing a fiery maiden on the rampart, surrounded by shining rays like fiery swords. Blinded, the Kuban soldiers fought among themselves and retreated from the city.