Katie Gavin and Hayley Williams perform with Rilo Kiley for their song "Let Me Back In"