Prior to the Civil War, the area in which Rynex Park and Dora Kelley Park now reside was called Lebanon, named after the Lebanon Union Church previously on site. The church was burned to the ground in retaliation for the Union Army's loses at the Battle of Bull Run. Today, the cemetery, which is maintained by the Parks Division, is all that remains of where the Lebanon Union church once stood.