Career
He worked in the American League from 1951 to 1953. Duffy umpired 448 major league games in his three year career. In 1954, Duffy was sent from Major League Baseball to the International League.
He retired from baseball in early 1955, when he found out that he would not be brought back up to the major league level
Upon his retirement, Duffy publicly asserted that his demotion had resulted simply from pressure applied to league president Will Harridge by officials from the Red Sox and White Sox. Harridge responded that those allegations were "utterly ridiculous and completely untrue." Harridge said that Duffy "did not measure up to the standards of the American League."
Duffy also spent several seasons as an National Basketball Association referee.
He worked as an auto salesman in the offseason.