Career
Madison was from Morgan County, Georgia. He started in business in Madison, Georgia, forming the firm of High & Berney. He later moved to Atlanta for greater opportunity, where he partnered with East. Doctorate. Herring to open up a dry goods store at 40 Whitehall Street (now Peachtree Street Southeast).
A new store opened at 50 Whitehall in 1882.
In 1884 High bought out Herring and renamed the firm J. M. High & Company
In 1882 High married Harriet Harwell Wilson. In 1887 High"s department store opened a new location on the west side of Whitehall.
By 1889 High was able to buy the southwest corner of Whitehall and Hunter (now King boulevard) and erect a four story brick building with ornate interior for his department store. In 1906 High died. but the store continued doing business.