Yorinaga was a dogmatic activist who displayed a great deal of courage in his actions. Consequently, he made many enemies who resented his disapproval of the current Emperor Konoe and his cloistered puppet master Toba. In 1155, Konoe died and a succession dispute arose for the imperial throne. After much quarrel, the former emperor Toba’s son became Emperor Go-Shirakawa. This was the worst result in Yorinaga’s view. On top of this, Yorinaga was refused the position of “tutor to the Heir Apparent” despite his qualifications.
Within Japanese history, Yorinaga is remembered for his courage and determination for what most recall as a lost cause. Since his struggle was a political failure, history rarely pays detailed attention to his part in the bigger political evolution that was taking place in the mid-12th century. Instead of restoring the aristocracy, he became the last champion. His death symbolized the beginning of the growth of the warrior class and a war-like state that would exist within Japan until the unification under Tokugawa Ieyasu around 1600.