Wayne County, NC Historic Districts Mount Olive Historic DistrictMount Olive was formed as a village before the Civil War and was occupied by Union soldiers in Foster's Raid on December 16, 1862. Incorporated in 1870