89 - Quiz Time a tool to help analysts increase their knowledge of human research protections, regulations, and policies, as well as, foster engagement within a Human Research Protections Program (HRPP).

Background:  As a new manager, I was tasked with creating new tools and opportunities for analysts to increase their knowledge of human research protections, regulations, and departmental policies, as well as encourage engagement among analysts to foster professional growth. Tools created would be engaging, increase knowledge, be enjoyable, and not time-consuming.

Program

Description:  Quiz Time is a learning tool that was developed to help increase engagement and learning opportunities for analysts within the department by providing short quizzes, created and delivered through Microsoft Forms, which includes questions geared towards increasing knowledge about departmental policies, DHHS/FDA regulations, human research protections, and regulatory resources. Analysts anonymously complete quizzes designed to evaluate knowledge, increase engagement, and enhance professional development. The quizzes also function as an educational resource that can be fun to complete. Quiz Time also helps to inform the department where learning and development opportunities may be more beneficial by looking at respondent feedback. To assess if Quiz Time helps to increase engagement and learning activities for analysts within our Human Research Protections Program (HRPP), I looked at the return rate of surveys, overall scores per question category groups, and departmental feedback.

Program

Assessment:  Analysts received quizzes approximately 24 times in the past year, totaling 49 questions that were asked across all quizzes. Each quiz consisted of at least 2 questions, resulting in 316 total responses across all quizzes. On average about 15 quizzes were returned each time that a quiz was released. The success rate for answering questions correctly under each of the categorized topics was over 50%, with most topics achieving rates higher than 70% on a 100-point scale. On average, quizzes took 2 to 5 minutes to complete. Based on the response feedback, notable areas of improvement are those topic categories where the success rate is below 90%. Topics covered in the questions include IRB administration, review determinations, vulnerable populations, devices and drugs, informed consent, and ethics. Quiz Time received positive feedback from departmental analysts, who reported enjoying the scenario-based questions that required applying regulations. They also appreciated learning about the historical events introduced in the quizzes. Analysts mentioned that the quizzes were fun and provided a welcome break after long periods of reviewing studies.

Limitations: Limitations of the Quiz Time tool are related to the duration of its use. Conclusions are based on 1 years’ worth of data, so there is no comparison to assess growth longitudinally; this could be accomplished in year 2. The experience level of analysts is a limitation. If new to an HRPP program, knowledge of the regulations and policies grows over time. Experience applying policies and regulations will strengthen the knowledge when taking the quizzes.

Discussion:  The Quiz Time feedback for the department could pinpoint educational needs where question responses fall below 90%, enhancing staff learning. Utilizing prior question banks and developing annual training tools like flashcards could assist in certifications (CIP, CIM, RAC) and new analyst onboarding. Monthly inclusion of most missed questions and answers the departmental TEAMS page could foster ongoing engagement. Extending Quiz Time to the research community expands learning opportunities. Implementing Quiz Time for any HRPP program via any survey platform could bolster understanding of human subjects’ protections, federal regulations, and departmental policies.