Peltz first played with the Indianapolis Hoosiers, in 1884 at the age of 23. He batted.219 and surrendered 38 errors in the outfield. Peltz did not appear in major league baseball until 1890, except for a brief one-game appearance in 1888 with the Baltimore Orioles.
In 1890, his last year in the major leagues, he played with three teams, the Brooklyn Gladiators, Syracuse Stars, and the Toledo Maumees.
He would continue to play with various minor league clubs until 1893, retiring with the Montgomery Colts. Peltz had a career batting average of.224.
He died in New Orleans on February 27, 1906, at the age of 44.