On The Late Show With Stephen Colbert, Canadian-American actor Matthew Perry shared a story about a rumour that he may have beaten up Prime Minister Justin Trudeau in grade school. He was on the show to promote his new memoir, Friends, Lovers and the Big Terrible Thing.

When Colbert asked him if he did, Perry responded “I don’t think so.”

Perry recalled the story after Colbert asked him who is more recognizable in Canada: him or Justin Trudeau. Though he conceded and said Trudeau is more easily recognizable, he then told the story about how his friends Chris and Brian Murray alleged that they had beaten up Justin Trudeau in elementary school. Without any evidence or recollection of that moment, Perry said he “just believed them.”

According to Perry, Trudeau eventually got word of the story and reached out to him on Twitter and asked Perry if he wanted to have a fight.

 “You have your own army. No thanks,” Perry said, who added that their online scuffle ended there.

That’s not Perry’s only brush with a Canadian celeb on his current book tour. He apologized for writing in the memoir: “Why is it that the original thinkers like River Phoenix and Heath Ledger die, but Keanu Reeves still walks among us?”