An Alabama congressman reportedly expressed his frustration with fellow Republicans who aren’t supporting Rep. Kevin McCarthy for Speaker of the House.

According to Politico, Rep. Mike Rogers (R-Saks), the top Republican on the House Armed Services Committee, suggested during a closed door meeting with the conference that any Republican who opposes McCarthy should be removed from their committee assignments.

On Tuesday, the U.S. House of Representatives went to a third round of voting for Speaker of the House. It was the first time since 1923 a speaker was not chosen on the first ballot.

McCarthy (R-Calif.) failed to get the needed 218 votes to become the next speaker in the three rounds of balloting. The House voted to adjourn until noon EST Wednesday.

NBC News also confirmed that Rogers had “promised” those planning to vote against McCarthy would lose their committee seats.

Rogers, Reps. Robert Aderholt (R-Haleyville), Gary Palmer (R-Hoover) and Dale Strong (R-Huntsville) publicly supported McCarthy before the vote. Rep. Barry Moore (R-Enterprise) originally didn’t rule out backing someone else for the position, but ended up voting for McCarthy.

Yaffee is a contributing writer to Yellowhammer News and hosts “The Yaffee Program” weekdays 9-11 a.m. on WVNN. You can follow him on Twitter @Yaffee