In 1784, he went to Saint St. Petersburg to his uncle James Walker, engraver to the empress Catherine the Great There he studied in the picture galleries, encouraged by Catherine and her son Paul I and was commissioned by Paul to paint large pictures of Russian history.
In 1801, Atkinson returned to England, and in 1803 published A Picturesque Representation of the Manners, Customs, and Amusements of the Russians, in 100 plates, drawn and etched by himself. He also painted in watercolours and in 1808 was elected to the Society of Painters in Water Colours. He painted many battle scenes including a Battle of Waterloo, which was engraved by John Burnet.
His last contribution to the Royal Academy exhibition was in 1829.
The date of his death is not recorded but his will was dated 1830 and he was still alive in 1831.