null

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

Overview:

IntelliBoard uses a persona-based approach to deliver customized data analytics solutions tailored to the unique needs of instructors. By focusing on the specific responsibilities and challenges that instructors face, IntelliBoard ensures that the most relevant data is available, helping instructors make informed decisions to enhance learner engagement and performance.

Role Summary:

Instructional Designers are key players in educational institutions and organizations, responsible for creating effective, engaging, and learner-centered educational experiences. They collaborate with faculty, subject matter experts, and other stakeholders to design, develop, and evaluate instructional materials, courses, and strategies that enhance learning outcomes.

Key Responsibilities:

  • Design and Develop Courses

    • Create learner-centered instructional materials, courses, and learning modules aligned with institutional best practice and organizational goals

    • Develop engaging course content using multimedia tools and interactive and diverse activities

  • Analyze Learner Engagement and Course Effectiveness

    • Use LMS analytic data and learner performance data to evaluate the effectiveness of instructional materials and course designs.

    • Identify patterns in learner engagement to optimize instructional strategies

    • Track learner outcomes to determine which activities, tools, and strategies yield the highest levels of success.

  • Maintain and Improve Instructional Materials

    • Analyze course and program feedback and analytics to make improvements to instructional content and strategy.

    • Ensure all materials meet accessibility standards and align with organizational standards

  • Identify and Support At-Risk Learners

    • Analyze courses with high concentrations of at-risk learners to pinpoint areas where course design improvements or additional interventions may be needed.

  • Enhance Technology Integration

    • Implement e-learning tools and technologies to create innovated and accessible learning environments

    • Stay current with advancement in educational technology to recommend and integrate effective tools and platforms.

  • Communicate and Collaborate

    • Collaborate with faculty, subject matter experts, and other stakeholders to design, develop, and evaluate instructional materials, courses, and strategies that enhance learning outcomes.

    • Communicate with instructors and academic leadership regarding instructional best practices and ensure access to resources.

Challenges

  • Access to Data

    • Limited or inconsistent access to LMS, learner engagement, and learner performance data

    • Data privacy regulations limit access to learner data

  • Interpreting Data

    • Converting complex data into actionable insights for course adjustments.

    • Evaluating the impact of improvements on learner outcomes and satisfaction.

  • Balancing Creativity and Structure

    • Struggling to create engaging content while adhering to institutional standards and frameworks.

    • Navigating conflicting priorities between innovation and consistency.

    • Accessing which adjustments improve learner outcomes

  • Facilitating Communication and Collaboration

    • Managing feedback from multiple stakeholders

    • Aligning goals among instructors, administrators, and other stakeholders.

    • Communicating data driven insights regarding course design to instructors, administrators, and other stakeholders

Common Questions

  • Which courses have the highest proportion of at-risk learners?

  • Which course activities and tools are most engaging to learners?

  • Are certain assessment or activities consistently challenging for learners?

  • What course designs correlate with higher levels of learner success?

  • How do courses I designed compare to other courses?

  • Are my course adjustments improving outcomes compared to previous terms?

Datasets:

These datasets are identified by IntelliBoard as providing critical information to Instructors. The Instructional Designer Org Role Template includes these datasets. Organization Administrators my provide additional datasets or may not include all the datasets below. Contact your administrator for questions regarding dataset availability.

Instructional Designer Dashboard

Intended to be used by instructional design teams to monitor course set up and delivery. The first report, Course Summary Overview, provides course-level set up, course indicators, actvity counts, corresponding average grades and enrollments. The second report allows the review of one particular course, with aggregate activity details. Click the Details button of both reports to drill down further into the activity-level details.

Course Summary Overview: This report provides an overview of data about courses and course design, including course creation, start and end date (as available per platform), assigned instructors, the number of activities, counts of common types of activities, and total access to courses.

  • Purpose: Offers a comprehensive snapshot of course data, focusing on key metrics such as course creation details, instructor assignments, activity counts, and access trends. A quick way to compare courses.

  • Use: Instructional designers can leverage this report to evaluate and compare course structures, monitor the distribution and variety of activities, and identify areas to enhance learner engagement and accessibility.

Course Content Statistics by Module: This multilevel report displays summary statistics for each activity in a course, organized by Module/Topic/Week. A course must be selected to display results. For each activity, the activity name, type, number of students who have viewed and participated in the activity, average views, participations, and time spent, average grade, and activity status are displayed. The report can be filtered by activity status.

  • Purpose: Provides detailed insights into student engagement and performance with course activities, organized by Module/Topic/Week, highlighting key metrics like views, participation, time spent, and average grades

  • Use: Analyze the effectiveness of specific activities, identify underperforming or underutilized content, and make data-driven decisions to optimize course design and improve student engagement.

Learning Outcomes Dashboard

The Learning Outcomes Dashboard integrates key insights from three datasets—Mastery Level by Course, Outcome Completion by Course, and Grade Mastery Gradebook Report—offering a comprehensive view of student progress. Users can analyze mastery levels by course outcomes, track outcome completion rates by users, and review detailed gradebook reports with individual scores, mastery requirements, and outcome averages, all filterable by course name for targeted monitoring and instructional improvements.

Mastery Level by Course Pie Chart: The Mastery Level by Course pie chart displays students' mastery of course outcomes—also known as competencies or goals—organized by outcome scale, points possible, passing points, and users, with filters for course and outcome name, providing insight into student progress as rated on quantitative or qualitative scales for each course assessment.

  • Purpose: Visualizes student achievement of course outcomes, categorized by outcome scales, points possible, passing thresholds, and user counts, offering a clear overview of progress toward defined competencies or goals.

  • Use: To assess how well course outcomes are being met, identify gaps in student mastery, and refine assessments or instructional strategies to support learner success.

Outcome Completion by Course Bar Chart: The Outcome Completion by Course bar chart illustrates the number of users who have completed specific learning outcomes, sortable by learning outcomes or users, and filterable by course name, providing a clear view of student achievement across different courses and competencies.

  • Purpose: To highlight the number of learners who have completed specific learning outcomes to provide a comprehensive view of student achievement across courses.

  • Use: To track progress toward learning outcomes, identify courses or competencies needing improvement, and determine if there is alignment between instructional content and student achievement goals.

Grade Mastery Gradebook Report: The Grade Mastery Gradebook Report provides a detailed breakdown of each student's progress, with columns for user name, user email, course name, average outcome score for each competency, individual user scores, and the mastery level required score, allowing filtering by course name to track mastery levels and performance across courses.

  • Purpose: To provide a detailed view of student progress and mastery levels

  • Use: To monitor individual and overall student performance, identify gaps in mastery, and adjust course materials or assessments to better support student learning outcomes.

Page Views and Time Spent by Tools Dashboard

The Page Views by Tools Dashboard combines the Page Views By Tools vertical bar chart, Time Spent by Course Tools with the Course Content Utilization report. Clicking a bar in the chart to select an activity (tool) type filters the report to only activities of that type.

Page Views by Tools Chart: The chart displays the number of views of pages in the selected course by Activity Type. It can be filtered by Course and Category and by Activity Type.

  • Purpose: To visualize the number of page views for each activity type allowing for deeper analysis of student interaction with different course tools and resources.

  • Use: To assess which activity types are receiving the most engagement, identify potential areas for improvement, and optimize course structure to enhance student interaction and learning.

Time Spent on Course Tools: Shows the amount of time spent per Activity Type.

  • Purpose: To track the amount of time students spend on each activity type within a course, offering insights into student engagement and interaction.

  • Use: To evaluate how much time students are dedicating to different activities, helping them identify potential issues with engagement or balance and refine course design accordingly.

Course Content Utilization: The Course Content Utilization report provides a detailed log of users' overall access to content/events/activities. Critical data includes users' activity-level time spent, first access and last access.

  • Purpose: To track users' engagement with course content, providing detailed data on time spent, first access, and last access.

  • Use: To assess which content or activities are being accessed most frequently, identify engagement trends, and optimize course materials based on when and how students interact with them.

Projected DFW Risk Dashboard

Intended for Registrars and Deans to monitor course progress, this Dashboard seeks to quickly identify courses with high D/F rates. This Dashboard includes a bar chart which visualizes courses with learner course grades separated by 3 values: grades 0-59 (red), 60-69 (yellow), 70-100 (green). Two table charts are also included; 1 showing the same courses, with a count of course grades in the corresponding thresholds. The last table displays individual student information for a deeper review.

DFW Rate by Category: This bar chart displays count of active learners by course category or Sub-Account with current course grades of D and F. This bar chart is intended to quickly identify course categories or Sub-Account that may have high D/F/W rates.

  • Purpose: To provide a visualization of DFW percentage of each course category or Sub-Account.

  • Use: To pinpoint categories with high failure or withdrawal rates, enabling targeted interventions to improve student retention and success.

DFW by Courses: This bar chart displays count of active learners by course with current course grades of D and F. This bar chart is intended to quickly identify courses that may have a high D/F/W rate.

  • Purpose: To visually represent the DFW percentage of each course to quickly identify courses with high failure or withdrawal rates.

  • Use: To identify individual courses with high D/F/W rates, allowing them to make targeted adjustments to course content, structure, or support to improve student outcomes.

Projected DFW Risk: This table chart displays a count of learners course grades separated by 3 values: grades 0-59 (red), 60-69 (yellow), 70-100 (green). This intends to be paired with the corresponding DFW by Course bar chart, allowing you to quickly identify courses that may have a high D/F/W rate. Additional information about course, including category, term, course codes, total enrollments, is included for additional detail.

  • Purpose: To see a breakdown of learners' course grades by risk categories (0-59, 60-69, 70-100), providing a detailed view of potential D/F/W risks across courses, with additional course information for context.

  • Use: To pinpoint at-risk courses, enabling proactive course adjustments and targeted interventions to reduce failure and withdrawal rates.

Course Learner Risk Summary Dashboard

Combines Weekly Learners At Risk Per Course line chart and Course Risk Points Summary detail tabular report. Can be filtered by Course Category, Course, Term, and Course Start Date.

Weekly Learners At Risk: Weekly count of the number of Learners At Risk Per Course. May be filtered by course category and name and by snapshot date. Learners are considered "at risk" if the number of risk points per learner on that date is greater than 0.

  • Purpose: To visualize a weekly snapshot of total number of at-risk learners in each course

  • Use: To track at-risk learners over time and identify trends in each course.

Course Learner Risk Points Summary: Provides snapshots of daily summaries of risk to learners in courses. Can be filtered by courses and categories, date range, and the number of learners at risk per course on a given day.

  • Purpose: To show daily snapshots of learners in courses, displaying the number of learners at risk and course averages.

  • Use: To view fluctuations in learner risk in specific courses, helping them identify critical periods for intervention and adjust course strategies to support at-risk students.

Needs Grading Dashboard

Needs Grading Chart

  • Purpose:

  • Use:

Needs Grading Report

  • Purpose:

  • Use:

Learner Success Dashboard

Learners Average Course Grade

  • Purpose:

  • Use:

Learner Course Progress Monitoring

  • Purpose:

  • Use:

Learner Activity Submission Progress

  • Purpose:

  • Use:

Instructor Behavior Dashboard

Needs Grading Chart

  • Purpose:

  • Use:

Instructor Daily Presence

  • Purpose:

  • Use:

Instructor Course Engagement Summary

  • Purpose:

  • Use:

Instructor Course Activity Engagement Detail

  • Purpose:

  • Use:

Activity Grade Overview Dashboard

Activity Grade Distribution

  • Purpose:

  • Use:

Activity Time Spent Grade Correlation

  • Purpose:

  • Use:

Activity Grade Summary

  • Purpose:

  • Use:

Learner Activity Detail

  • Purpose:

  • Use:

Activity Performance Summary

  • Purpose:

  • Use:

Course Verification

  • Purpose:

  • Use:

RSI by Instructor

  • Purpose:

  • Use:

Course Stats

  • Purpose:

  • Use:

Course Readiness Report

  • Purpose:

  • Use:

Learner Statistics by Module and Activity

  • Purpose:

  • Use:

Suggested Notifications

Weekly Update of Number of Activities Need Grading

This automated notification will send you a list of activities that still need to be graded to help keep up to date grading practices.

Steps to Set Up Your Notification

  1. Notification Details:

    • Notification Name: Weekly Update of Number of Activities Need Grading

    • Notification Description: This notification automatically emails a list to me of items that need grading using the Needs Grading Report.

  2. Send to: Select “Enter Recipients” from the drop down menu.

  3. Email: Enter your email and/or the email(s) of those who will receive the notification.

  4. Subject: "Weekly Report: Items that Need Grading" (Example)

  5. Message: "Attached is the list activities that still need grading in order to support best practices. Log in to your IntelliBoard account to see more information and access activities directly from the dataset." (Example)

  6. Attachment:

    • Dataset: Select "Needs Grading Report" from the dropdown menu.
      *Datasets must be linked or cloned to “My Datasets” to use as an attachment.

    • Set Appropriate Filters:

      • This report can be sent as is without any filters in place to see a list of all items that need grading.

      • You can set the “Course” filter to filter report to specific courses and repeat these instructions to set up reports of Needs Grading items for each of your courses.

      • You can set the “Submission Date” filter to show only items that need grading submitted on a specific date.

      • You can set the “Activity” filter to show only specific activities by name that have items that need grading. To use this filter, you must select a course or courses in the Course filter.

      • If applicable, set the “Terms” filter to filter report to only the current term.

      • Set the “Enrollment Status” filter to filter report to only actively enrolled students, if desired.

      • Save the filters.

    • File Type: Choose your preferred format for the dataset attachment using the drop down menu (CSV, XLSX, or PDF).

    • You can also check the box next to “Do Not Send Empty Report” so the report is not sent if empty.

  7. Select Date Range:

    • Start Date: Select the beginning of term or choose the date that fits your needs.

    • End Date: Select the end of term or choose your preferred end date to receive this report.

  8. Notification Schedule:

    • Frequency: Weekly

    • Time: Select the preferred time for the report to be sent (24-hour format).

    • Additional Fields: You may need to select additional information dependent upon the frequency, such as the day of the week you wish to receive the report.

  9. Final Steps:

    • Click Save to schedule your notification, or Save and Send Now to receive the first report immediately.

image-20241114-215917.png

Weekly Summary of Students with No Course Activity in the Past 7 Days

This automated notification will send you a list of student who have not logged in to their course in the past 7 days to promote intervention efforts.

Steps to Set Up Your Notification

  1. Notification Details:

    • Notification Name: Weekly Summary of Students with No Course Activity in the Past 7 Days

    • Notification Description: This notification automatically emails a list to me of my students that have not logged in to the course in the past 7 days.

  2. Send to: Select “Enter Recipients” from the drop down menu.

  3. Email: Enter your email and/or the email(s) of those who will receive the notification.

  4. Subject: "Weekly Report: Students with No Course Activity for 7 Days” (Example)

  5. Message: "Attached is the list of students that have not logged in to the course within the last 7 days. Log into IntelliBoard for more information and send notifications directly from the dataset." (Example)

  6. Attachment:

    • Dataset: Select "Inactive Learners in Courses" from the dropdown menu.
      *Datasets must be linked or cloned to “My Datasets” to use as an attachment.

    • Set Appropriate Filters:

      • You can set “Course” filter to filter report to show only students in specific courses and repeat these instructions to set up reports for each of your courses.

      • Set the “No Course Access Within” filter to “Past 7 Days”

      • If applicable, set the “Terms” filter to filter report to only the current term.

      • Save the filters.

    • File Type: Choose your preferred format for the dataset attachment using the drop down menu (CSV, XLSX, or PDF).

    • You can also check the box next to “Do Not Send Empty Report” so the report is not sent if empty.

  7. Select Date Range:

    • Start Date: Choose the term start date or a date that fits your needs.

    • End Date: Choose the term end date or your preferred end date to receive this report.

  8. Notification Schedule:

    • Frequency: Set for Weekly.

    • Time: Select the preferred time for the report to be sent (24-hour format).

    • Additional Fields: You may need to select additional information dependent upon the frequency, including the day you want the notification sent.

  9. Final Steps:

    • Click Save to schedule your notification, or Save and Send Now to receive the first report immediately.

image-20241114-220753.png

Weekly Summary of Students with Course Grade Below 60

This automated notification will send you a list of students that have below 60 in the course to allow for interventions.

Steps to Set Up Your Notification

  1. Notification Details:

    • Notification Name: Weekly Summary of Students with Course Grade Below 60

    • Notification Description: This notification automatically emails a list to me of my students that have below 60 in the course using the At-Risk Learners with Course Grade Below 60 report to encourage interventions for these students.

  2. Send to: Select “Enter Recipients” from the drop down menu.

  3. Email: Enter your email and/or the email(s) of those who will receive the notification.

  4. Subject: "Weekly Report: Students with Course Grade Below 60” (Example)

  5. Message: "Attached is the list of students that currently have a course grade below 60. Log in to your IntelliBoard account to see more information and send notifications to students directly from the dataset." (Example)

  6. Attachment:

    • Dataset: Select "At-Risk Learners with Course Grade Below 60" from the dropdown menu.
      *Datasets must be linked or cloned to “My Datasets” to use as an attachment.

    • Set Appropriate Filters:

      • You can set “Course” filter to filter report to show only students in specific courses and repeat these instructions to set up reports for each of your courses.

      • Set the “At-Risk” filter to show only learners with “At-Risk” status which is defined as course grade below 60 in this report.

      • If applicable, set the “Terms” filter to filter report to only the current term.

      • You can also set filter to show only specific students using the “Full Name” filter.

      • Save the filters.

    • File Type: Choose your preferred format for the dataset attachment using the drop down menu (CSV, XLSX, or PDF).

    • You can also check the box next to “Do Not Send Empty Report” so the report is not sent if empty.

  7. Select Date Range:

    • Start Date: Choose the term start date or a date that fits your needs.

    • End Date: Choose the term end date or your preferred end date to receive this report.

  8. Notification Schedule:

    • Frequency: Set for Weekly.

    • Time: Select the preferred time for the report to be sent (24-hour format).

    • Additional Fields: You may need to select additional information dependent upon the frequency, including the day you want the notification sent.

  9. Final Steps:

    • Click Save to schedule your notification, or Save and Send Now to receive the first report immediately.

image-20241115-163638.png

  • No labels