Career
Rayburn played college football for the Tennessee Volunteers of the University of Tennessee, where he was selected All-Southern. Rayburn was also selected a second-team All-American by the New York Sun. He played one year for the Brooklyn Dodgers.