The Tea Baggers are furious with him. Will he fall into line?