Gingrich's presumed replacement, Majority Leader Dick Armey, failed to get support for his race the speakership. This itself was noteworthy and the start of a trend for the GOP.
In 13 consecutive leadership changes after Gingrich, the speaker had held the position of either majority or minority leader (or when the minority leader title was retired, minority Whip).
The Republicans first seemed to choose the Appropriations Chairman Robert Linvingston, who almost immediately step down due to a sex scandal, and then settled on a more junior deputy whip, the since disgraced Dennis Hastert. Hastert managed to stay as speaker for eight years, but once the party lost the majority, he was out as leader.
It's not clear why the presumably more conservative Republicans have such a taste for change in their leadership. During their long night in the minority, they were also willing to switch leaders. Joe Martin, the last Republican Speaker before Gingrich, was ousted as minority leader by Charles Halleck, who was himself removed by Gerald Ford.
Ford's successor, John Rhodes, was threatened with a challenge before he stepped down, as did his successor, Robert Michel, who was facing a Newt Gingrich-led revolt if he tried to stay in the position.
In all of those fights, the Republicans were at least struggling to find a way back into power. They have now had the majority for 20 of the last 24 years, but still have been willing to cycle through numerous leadership changes.
This behavior truly stands out when compared to the other side of the aisle. The Democrats have had a relatively smooth ride. Despite their long stretch out of power, they have had only two leaders over the last 24 years.
Nancy Pelosi has managed to keep her job despite losing the majority in 2010. There is discussion of replacing Pelosi, but that appears to be more focused on Pelosi's role as a lightning rod for Republican attacks and a concern from Democratic candidates that Pelosi could cost votes and potentially seats in battleground districts.
It could be that the Democrats are not helped by their stability. After all, the Republicans' constantly changing leadership has not cost them control over the House. But it is difficult to say that the leadership, rather than other factors are what have kept the Republicans in power.
What is clear is that whoever succeeds Ryan as Republican leader should not get to comfortable in their seat. The Republicans in the House have shown that their conservatism in policy does not extend to their practical choice of keeping a leader.
Commentary by Joshua Spivak, a senior fellow at the Hugh L. Carey Institute for Government Reform at Wagner College in New York. He blogs at The Recall Elections Blog. Follow him on Twitter @recallelections.
For more insight from CNBC contributors, follow @CNBCopinion on Twitter.