While he was serving in the OgimachiSanjo family, Cour t nobles in Kyoto , he became acquainted with Shikibu Takeno-uchi, a loyalist, and narrowly escaped involvement in the Horeki Incident. (This incident centers about Shikibu Takenouchi, a scholar, who advocates the destruction of the Tokugawa Shogunate. Courtiers convey this plot to Emperor Momozono, but it is discovered by the Shogunate and Takenouchi is sentenced to death). Hiding from the Shogunate authorities, he roamed in many provinces until he camc to Edo with the name of Umon in 1764.