User Completion issue on LMS (Docebo)

Hi Tony, further on this:

"There are maybe a dozen users out of hundreds that managed to bypass this, and received a completion but have no recorded score of having taken the final assessment."

This could indicate that the LMS is incorrectly setting a completion status of completed under unusual circumstances, for example the content/system crashes, of the way the user exits the content or it times-out.

It's unfortunate, but I have seen some behaviour like this with LMS before, and it can be very difficult to determine the root cause of the issue, or even implement code to fix it.

It sounds to me like your course is set-up correctly in terms of tracking.

The only other thing I would check is "mastery_score". If there is a mastery_score entry in the imsmanifest.xml document, it can sometimes cause unexpected completion of modules. When a mastery_score is defined in the manifest file, this is an indication to the LMS that it should determine completion (passed/failed) based on the mastery_score and any score sent to the LMS. If a score is sent to the LMS, and a mastery_score has been set in the manifest, the LMS will then automatically evaluate the user score against the master_score to determine pass/fail. I don't think this is the case in your situation, but worth a mention.

Do you have enough data to determine the percent of users with unusual completion statuses? If it is under 0.5% of users (5 in every 1000), you are likely seeing something that will be very difficult to replicate and may not be fixable.

You could also look at the users and see if their is any commonality with their location or how they are accessing the LMS. This may give clues such as an unstable network, poor bandwidth etc.

Some things to consider anyway.