The Holy Elijah Church in Crimea is the oldest active church in the region, with its construction dating back to the 9th-12th centuries. It is located on a hill in the center of the village, not far from the bus stop. This church stands out among modern churches not only for its architecture but also for its unique altar, which consists of three stone slabs and is adjacent to the eastern wall, making it impossible to walk around. The entrance to the church is through a low door in the southern wall, which requires visitors to bend down, and the locals call it the 'door of humility.' Above the entrance is a large stone with five rosettes decorated with Greek crosses, which are now barely discernible. Light enters the church through two small windows resembling vents, located on the eastern and western walls. Excavations near the church have uncovered fragments of herringbone masonry, suggesting the existence of an older church on this site before the 10th century.

Originally, the church belonged to the Greek community. According to Suvorov's documents, on September 18, 1778, 38 men and 36 women moved from the village of Kozy, now Sunny Valley. For such a number of parishioners, a small church was quite sufficient. Several years ago, Father Peter served as the priest in the church, who was killed by the Turks in 1771. His body was buried at the entrance to the church, and a smooth stone slab and bench were placed over his grave. Father Peter was revered as a martyr and miracle worker, respected not only by Christians but also by Muslims. The sick were brought to his grave for healing, and soil from the grave was taken as a relic. The main shrine of the church was a marble baptismal font from the 4th-5th centuries, brought from Constantinople and made from the capital of an ancient column.

After the Greeks resettled in 1778, the local residents took care of the church. In 1904, it was renovated and repainted, and services resumed. At that time, the church was on a well-kept hill, surrounded by a stone fence. To the north was a lake, over which an old mulberry tree towered.

With the advent of Soviet power, the church was soon closed in 1939, and a diesel engine was installed in the altar to generate electricity, later moved outside the fence. Inside the church, a grain storage facility was arranged. During the war, the church was temporarily opened for Romanian troops, but after the war, it fell into disrepair again. In the 1960s, the lake was drained, the hill was leveled, and the church was planned for demolition. However, archaeologists intervened, studied the church, and established a plaque for its protection as a monument of architecture from the 10th-11th centuries. At that time, the church was in an emergency state, and it was reinforced with lime slabs. Around the same time, the ancient marble baptismal font disappeared.

In 1998, the Orthodox community was revived in Sunny Valley, and restoration work began in the church. By 2000, the baptismal font was returned to its place. In 2001, a looted grave of Father Peter was found, and a stone slab with an inscription about the priest was reinstalled in its place. Restoration work continues: a new wooden floor has been laid, doors have been replaced, a choir for singers has been built, and a stand has been made under the baptismal font.