Incorrect Looping

Hello,

I am creating an interactive situation where a person needs to plan out their escape from a home. Currently, I have a series of different layers/markers to correspond to the movement throughout the home (floor plan). Unfortunately, SL is forcing me to back track (selecting the wrong button on room 3, sends you back to 2. Wrong answer on 4 sends you back to 2 as well.  I am not trying to create this mechanic.

 

Can anyone advise?