Gingrich assailed on Freddie Mac work, fights back