Career
He purchased the Bridehead estate near Dorchester, Dorset around 1797. lieutenant comprised the manor of Littlebredy, Bridehead being a name fabricated by Williams, and in later years became the main family residence. On 17 March 1808 he was elected Member of Parliament for Grampound after the previous election had been declared void on 7 March 1808.
However he and John Teed were unseated on petition on 10 May 1808 in favour of George Augustus Frederick Cochrane the previous member and William Holmes.
Williams was then elected Member of Parliament for Kilkenny City from 1809 to 1812, and for Dorchester from 1812 to 1835
He was elected an alderman (1796–1801) and sheriff of London for 1797-1798. He was prime warden of the Goldsmiths’ Company in 1810-1811, director of the Hope Assurance Company in 1820 and chairman of the company from 1826 to 1841.