Toggle Video Callouts

I am including multiple callouts at different points in a video where people can click to pause the video and read additional information for the segment of the video. However, I want to include a toggle to turn on and off the callouts for users to have an option.

Creating a toggle is straightforward, but when I use the toggle to change the state of callouts from "hidden" to "normal" while playing the video, all callouts, including those that are supposed to show later in the timeline (e.g., starting at cue point of 30 sec in the timeline), are displayed on the screen. What did I miss here? Is there any workaround?

Thanks for any help.