UN CC : Learn -
Human Health & Climate Change
Course Evaluation
External evaluation for UN CC: Learn's Human Health and Climate Change eLearn short course and its supporting materials to better understand the effectiveness and in identifying other methods or improvements that can be made to ensure positive, medium-term and long-term outcomes of our digital learning initiatives.
PROJECT: External Evaluation | ROLE: Project Manager | TIME: 6 Weeks
PROJECT: External Evaluation
ROLE: Project Manager
DURATION: 6 Weeks
Evaluation Scope
UN CC:Learn has designed a series of eLearning courses which was evaluation for its overall efficiency. When used in conjunction with The Resource Guides for Advanced Learning on Climate Change, and the Library of UN Materials Relevant for Climate Change Learning, the courses can be used in multiple contexts. Summative and formative evaluation has been conducted to better understand the course's effectiveness and make suggestions for improvements based on findings.
Focus Areas
Evaluation Questions
The main focus of this evaluation has been based on assessing the learning outcome, course effectiveness, student engagement, and overall user experience with the course content by recording responses with Likert scale survey and Zoom interviews from current and past e-course participants.
The evaluation instruments have been designer designed to answer the following questions:
1. In what way does the course need to be modified to improve the student learning experience?
2. To what extent does the layout and materials support the course and instructions?
3. To what extent does the course assessment measure the learning outcomes?
4. To what extent does the course take into consideration learner characteristics (i.e. learning disabilities, accessibility, language)?
5. To what extent does the course change attitudes of participants toward the influence of climate change on human health?
Data Sources & Analysis
To ensure a variety of data sources, data from multiple sources were collected and analyzed in order to triangulate the data to increase validity. Data from the following data sources has been collected:
1. Current participants in the e-course
2. Past participants in the e-course
3. Instructors of K-12 students
Evaluation Procedures
To limit a single view of the evaluation, we conducted a team-based approach, mixed methods, which consisted of evaluation using both quantitative and qualitative orientation and expertise.
The post-test survey included a survey on the usability of the e-course with questions created by e-learning professionals and content knowledge professionals. The survey determined the ease of use, intuitive use, technical support, hypermediality, accessibility, and functionality.
Interviews were conducted over the application Zoom and were recorded for transcription through the use of Otter.ai. NVivo was used to analyze the transcribed interview through created coding categories that included an analysis of findings based on the proposal to determine the effectiveness of the e-course and the users’ attitude toward content.
The coding included learning outcomes, effectiveness of instruction, student experience, technical functionality, design and delivery of the course, and evaluation of the materials.
Analysis of the codes consisted of the recognition of the themes and patterns that were noticed.
Evaluation Report
Based on data gathered in this evaluation, from the survey and interview results, we have identified the reflection for current practices is great that most of the participants have responded with positive feedback, and we can conclude that overall, the course is valuable for improving knowledge of participants on climate change and human health.
The program also excelled at keeping the e-course length appropriate and engaging. Although this program did address the purpose and objectives that were stated above, the suggestions after receiving the data results suggests:
1. Include additional information and resources that incorporate variety for activities.
2. Include more precise knowledge geared towards combating climate change for participants that were interested in that.
3. Focus more on why participants neither agree nor disagree with the questions provided.
4. Include more information that intrigues participants to understand the e-course and the initial reasoning behind the program.
Thank you for previewing the UN CC: E-Learn Course Evaluation.
Let's Connect!
Searching for a designer that shows passion in their work? Interested in working together? I'd love to hear from you!
