Career
On June 14, 1960, Lemay was appointed bishop of the Vicariate Apostolic of Northern Solomon Islands, Papua New Guinea, and titular bishop of Agbia. He was ordained bishop on September 21, 1960. On November 15, 1966, Lemay was appointed first bishop of the Roman Catholic Diocese of Bougainville.
On July 1, 1963, Lemay resigned.