Born in Oklahoma in 1945, Dougherty was raised in North Carolina. He earned a B.A. in English from the University of North Carolina in 1967 and an M.A. in Hospital and Health Administration from the University of Iowa in 1969. Later, he returned to the University of North Carolina to study art history and sculpture.