This evaluation plan will use the Kirkpatrick model, a globally recognized tool that assesses training programs at four levels:
- Reaction: Evaluates learners’ impressions of the training and their patterns of usage
- Learning: Determines if participants learned something new
- Behavior: Looks for evidence of changes in participants' behavior in the workplace
- Results: Determines if the training had a significant impact on the business
Level 1 - Reaction
This level assesses participants’ immediate reactions to the course, focusing on engagement, user experience, and accessibility.
Metrics & Data Collection Methods
- Engagement will be measured through course completion rates, time spent per module, discussion participation, and quiz attempt rates.
- User experience will be assessed through post-module surveys on ease of navigation, clarity of instructions, and relevance of content.
Evaluation Activities
- End-of-module surveys will collect feedback on course content, interactivity, AI case study effectiveness, and accessibility features.
- Focus group interviews with a sample of learners will provide qualitative insights on usability and engagement.
- Canvas analytics reports will track participation rates and time spent in key course components.
Key Targets
- Our initial target course completion rate will be 75% for the first year of offering.
- In year 2, our target course completion rate will increase to 85% and additional targets will be set for reaction metrics.
Level 2 - Learning
This level assesses knowledge acquisition, skill development, and expertise gained throughout the course.
Metrics & Data Collection Methods