Background
A Methodist merchant from Salem, Massachusetts, he was the second son of Colonel Epes Sargent, by his second wife, the widow Katharine Browne (a granddaughter of Governor John Winthrop and governor"s Thomas Dudley and Joseph Dudley), brother to one distinguished Revolutionary war soldier, Paul Dudley Sargent, and uncle to another, Winthrop Sargent.