He was born in Saint John, New Brunswick, one of ten sons and a daughter of Catherine and Donald Allan Fraser, coming to Newfoundland in 1842 when the family relocated to Saint John"s for Review Donald Fraser to take up his post as the first Presbyterian minister in Newfoundland.
He represented Fortune Bay in the Newfoundland and Labrador House of Assembly from 1878 to 1885. James established his own business in Saint John"s in 1846. He served as chairman of the Board of Works from 1879 to 1882 and as surveyor general from 1882 to 1885.
After he retired from politics, Fraser was Postmaster General from 1885 to 1902.
He died in Saint John"s at the age of 77.
He was a member of the Legislative Council of Newfoundland from 1864 to 1878.
