Ranking in photolibrary

While I’m trying to rank my photos with the associated Stars in photo library I will use the shortcut of control plus the number, this adds the associated ranking I’d like, but then moves that photo to that order and I’m no longer viewing the next photo I’d like to rank is there a solution for this issue?

Change the sorting order on the filmstrip?