89 - Quiz Time a tool to help analysts increase their knowledge of human research protections, regulations, and policies, as well as, foster engagement within a Human Research Protections Program (HRPP).

Background:  As a new manager, I was tasked with creating new tools and opportunities for analysts to increase their knowledge of human research protections, regulations, and departmental policies, as well as encourage engagement among analysts to foster professional growth. Tools created would be engaging, increase knowledge, be enjoyable, and not time-consuming.

Program

Description:  Quiz Time is a learning tool that was developed to help increase engagement and learning opportunities for analysts within the department by providing short quizzes, created and delivered through Microsoft Forms, which includes questions geared towards increasing knowledge about departmental policies, DHHS/FDA regulations, human research protections, and regulatory resources. Analysts anonymously complete quizzes designed to evaluate knowledge, increase engagement, and enhance professional development. The quizzes also function as an educational resource that can be fun to complete. Quiz Time also helps to inform the department where learning and development opportunities may be more beneficial by looking at respondent feedback. To assess if Quiz Time helps to increase engagement and learning activities for analysts within our Human Research Protections Program (HRPP), I looked at the return rate of surveys, overall scores per question category groups, and departmental feedback.

Program

Assessment:  Analysts received quizzes approximately 24 times in the past year, totaling 49 questions. Each quiz contained an average of 2 questions, with 316 responses averaging 15 per quiz. Categories grouped by focus had correctness rates over 50%, with most exceeding 70% on a 100-point scale. Response rate did not vary with question quantity. Areas for development, would be in topics where correctness ratings are below 90%. Topics included IRB administration, review levels, vulnerable populations, devices and drugs, informed consent, and ethics. Quizzes took 2-5 minutes to complete. Quiz Time received positive feedback from departmental analysts who stated that they loved scenario questions where the regulations had to be applied, there were historical events that were introduced through the quizzes that some analysts wanted to learn more about, and the quizzes were fun and added a break after reviewing studies for an extended time.

Limitations: Limitations of the Quiz Time tool are related to the duration of its use. Conclusions are based on 1 years’ worth of data, so there is no comparison to assess growth longitudinally; this could be accomplished in year 2. The experience level of analysts is a limitation. If new to an HRPP program, knowledge of the regulations and policies grows over time. Experience applying policies and regulations will strengthen the knowledge when taking the quizzes.

Discussion:  The Quiz Time feedback for the department could pinpoint educational needs where question responses fall below 90%, enhancing staff learning. Utilizing prior question banks and developing annual training tools like flashcards could assist in certifications (CIP, CIM, RAC) and new analyst onboarding. Monthly inclusion of most missed questions and answers the departmental TEAMS page could foster ongoing engagement. Extending Quiz Time to the research community expands learning opportunities. Implementing Quiz Time for any HRPP program via any survey platform could bolster understanding of human subjects’ protections, federal regulations, and departmental policies.