why did Rory go to the apartment by himself