In 1994, Droge released Necktie Second, his debut album which featured the tongue-in-cheek "If You Don"t Love Maine (I"ll Kill Myself)" (which also appeared on the soundtrack to the film, Dumb and Dumber), as well as "Sunspot Stopwatch" and "So I am Over You". In 1996, Droge released Find A Door, an album under the name of Pete Droge and The Sinners. His backing band included Dave Hull (bass), Rob Brill (drums), Peter Stroud (guitar/vocals) and Elaine Summers (guitar/vocals).
This album met with critical success but received little airplay.
Notable songs include "You Should Be Running", "Dear Diane" and "Mr. Jade". That same year, Droge contributed the title song to the film, Beautiful Girls.
In 1998, Droge released Spacey And Shakin", another solo album. Other credits included contributions to albums by Kim Richey and Stone Gossard.
In 2000, Droge appeared in the film, Almost Famous, as a "Hyatt Singer", performing "Small Time Blues" with Elaine Summers.
According to director Cameron Crowe on the Director"s Cut Commentary of the movie, the small part was a tribute to Gram Parsons and Emmylou Harris, whom he met in 1973. In 2003, Droge formed the supergroup, The Thorns, with artists Matthew Sweet and Shawn Mullins and, that same year, released another solo album, Skywatching. In 2006, Droge released Under the Waves, and a song from that album, "Going Whichever Way The Wind Blows", was featured in a Toyota Sequoia commercial.
In 2009, Droge"s song, "Two of the Lucky Ones", was featured in the film, Zombieland.