You know who loved Stephen Colbert’s infamous 2006 speech skewering George W. Bush? Antonin Scalia.

Colbert paid tribute to the late justice on Monday night, describing how “no one was even making eye contact with me” at the White House Correspondents Dinner in 2006 after he lampooned Bush to his face. No one, that is, except Scalia, who apparently found Colbert hilarious and told him so. Colbert said he thought to himself, “Don’t make me love you, old man.” Watch the tribute here: