Dennis Hastert refused to let now defeated Rep. Phil Crane, R-IL, chair a committee that was by rights his. So there is precedent for denying Specter the chairmanship. Will it happen? NOT A CHANCE!!!!
Hastert's choice not to give Crane a committee chair is that of the discretion of the Speaker of the House. That's the way the House operates.
The Senate GOP is different. They place a high emphasis on seniority. They place such a high emphasis on seniority that if two freshmen senators come in at the same time and one of them is a former governor, that senator will get a leg-up on seniority.
I am fine with allowing Specter to remain as committee chair...as long as there are a sufficient numbers of GOP senators to over-ride him if he tries to obstruct a vote.