Watch Nirvana Perform With Lorde, Joan Jett, St. Vincent, and Kim Gordon at Rock & Roll Hall of Fame Induction

Last night was the Rock & Roll Hall of Fame Ceremony, which honored Nirvana, Kiss, Peter Gabriel, Hall and Oates, Cat Stevens and Linda Ronstadt, who were all inducted this year. Towards the end of the show, the remaining members of Nirvana surprised the audience by performing four of their biggest songs, featuring a different female vocalist for each. Joan Jett fronted “Smells Like Teen Spirit,” Lorde took on “All Apologies,” St. Vincent did her rendition of “Lithium,” and Kim Gordon helmed “Aneurysm.”

Afterwards, the group headed to Brooklyn where they put on a secret show that included another performance by St. Vincent, this time of “Heart Shaped Box.” Watch clips of all below.

“Smells Like Teen Spirit” (With Joan Jett)

“All Apologies” (With Lorde)

“Lithium” (With St. Vincent)

“Aneurysm” (With Kim Gordon)

“Heart Shaped Box” (With St. Vincent)

(Stereogum, Billboard)