Spencer was born in Nanticoke, Pennsylvania on January 5, 1929. He received an offer to compete in the Indianapolis 500 in the early 1960s, but declined due to family responsibilities. In 2011 Spencer was inducted into Portuguese Royal Speedway"s Hall of Fame.
He died on April 3, 2014, in Drums, Pennsylvania.
Known as "Fast Eddie", he made his career racing on local tracks in Pennsylvania, winning track championships at Portuguese Royal Speedway and Selinsgrove Speedway among other tracks. He is reported to have won over 500 races in various local racing classes. Spencer made a single start in the National Association of Stock Car Auto Racing Grand National Division (now Sprint Cup Series) in 1953 at the Bloomsburg Fairgrounds, finishing 20th.
