He moved to Fort King, Florida in 1844 which was then a United States Government post, near the present city of Ocala, Florida. He taught in the first school in Sumter County, Florida. He served as clerk of the circuit court of Marion County, Florida from November 13, 1849, to November 11, 1855.
Bullock was commissioned by the Governor of Florida in 1856 as a captain to raise a mounted company of volunteers for the suppression of the Seminole uprising.
The company was mustered into the service of the United States and served eighteen months, until the cessation of hostilities. Bullock entered the Confederate Army as captain in the 7th Florida Infantry in 1861 and served until the close of the War.
He was promoted to lieutenant colonel in 1863 and to brigadier general in 1865 to date from November 29, 1864. Bullock took part in the Battle of Chickamauga, the Atlanta Campaign, and the Franklin-Nashville Campaign, where he was severely wounded.
After the war, Bullock studied law, was admitted to the bar in 1866, and began practice in Marion County.
He was again clerk of the circuit court of Marion County from 1881 to 1889 before being elected as a Democrat to the Fifty-first and Fifty-second Congresses (March 4, 1889 – March 3, 1893). Bullock was not a candidate for renomination in 1892. After leaving Congress, he engaged in agricultural pursuits.
He was elected judge of Marion County in 1903 and served until his death in Ocala, Florida in 1905.
He was buried in Evergreen Cemetery.
He served as judge of probate court 1866-1868 and was a member of the Florida House of Representatives in 1879.