According to a widespread version, including in pre-revolutionary sources, the village of Kozlovka was founded in 1854. However, this is incorrect, as a temporary Orthodox church in the name of Nicholas the Wonderworker was built by parishioners in Kozlovka in 1845, where there were 120 households and 601 men and 518 women living. The church was wooden, cold, and without a bell tower. Its clergy included a priest, a deacon, and a sexton. It is likely that Kozlovka was founded in the early 19th century on the postal route between Novo-Uzen and Saratov. On the eve of the abolition of serfdom, there were 170 households in the village, with 530 men and 560 women.

In 1860, a new church of Nicholas the Wonderworker was consecrated with funds from the parishioners, built according to a design from 1857. The wooden building with a bell tower and an iron roof accommodated up to 450 people and was surrounded by a wooden fence, behind which was a watchman's hut. In 1868, a mixed zemstvo school opened in Kozlovka, for which a separate spacious building was constructed in 1869-1870.

In 1891, a mixed literacy school was opened, later transformed into a single-class women's church school with its own building. By the end of the 19th century, Kozlovka had 329 households, 874 men, and 926 women. Near the pond was the settlement of Kozlovochka with 4 households, 27 men, and 18 women. The land was collectively owned by the residents of the village and the settlement. In addition to the church and two schools, there were six windmills, a volost administration, and a military-horse section in the village. In 1901, it was decided to build a new church to replace the dilapidated one. The construction was led by the famous Samara architect T. S. Khilinsky. The building was laid in 1902, and in 1903 the facade was completed and the bell tower was covered with iron. In the same year, houses for the priest and the psalmist were built, and a free public library-reading room was opened, established by the Novo-Uzen district zemstvo.

The construction of the church was completed in 1904. The parish school closed in August 1907. On September 26, 1909, the solemn consecration of the church in the name of Nicholas the Wonderworker took place. The new wooden building for 1500 people was a single-altar structure, with a bell tower and iron roof and fence. In 1910, Kozlovka had 377 households, 1069 men, and 1063 women. The church, zemstvo school, five windmills, volost administration, and military-horse section continued to operate.

With the arrival of Soviet power, Kozlovka became the center of the eponymous village council of the Peter volost. During the period of collectivization, a collective farm was created, and the church of Nicholas the Wonderworker was closed and subsequently destroyed.