He was educated at Harrow School and at Trinity College, Cambridge.
He was a Justice of the Peace for Dorset, and a captain in the Dorset Yeomanry Cavalry. He was patron of the rectories of Charlton Mackrell, Somerset, and Child Okeford, Dorset, and the vicarage of Puddletown, Dorset. He was High Sheriff of Dorset in 1887.
Brymer lived at Ilsington House in Puddletown, Dorset.
He died at Jerez, Spain, at the age of 69.
21st United Kingdom Parliament. 22nd United Kingdom Parliament. 24th United Kingdom Parliament.
25th United Kingdom Parliament.
26th United Kingdom Parliament. 27th United Kingdom Parliament]
In the 1874 general election Brymer was elected Member of Parliament for Dorchester and held the seat until it was replaced under the Redistribution of Seats Acting 1885.
In 1891, Brymer was elected Member of Parliament for South Dorset and held the seat until 1906.