Although he briefly considered becoming a professional artist, he finally settled on acting as a profession, inspired by his mother's participation as an actress in community theater. From 1963 to 1965, Dourif attended Aiken Preparatory School in Aiken, South Carolina, where he pursued his interests in art and acting.
His father died when Dourif was three years old, after which his mother married Bill Campbell, a champion golfer, who helped raise Brad, his brother, and his four sisters. He is the son of Joan Mavis Felton (Bradford) and Jean Henri Dourif, a French-born art collector who owned and operated a dye factory. Gaunt character actor Brad Dourif was born Bradford Claude Dourif on Main Huntington, West Virginia.