How do I create Flexible Assessments in Insights (Passive data collection based on ILOs or PLOs)?

Flexible Assessment planning: this feature is a new way to passively collect ILO and PLO results across Canvas offerings and display them on your coordinator dashboard.

Flexible Assessment Planning

This feature is a new way to passively collect ILO and PLO results across Canvas offerings and show the results in the user interface. Rather than pushing a specific assignment and rubric into a course, this feature allows Insights to listen for outcomes assessment results from designated courses and show the results in the Assessment Plan results page. This allows coordinators to visualize the targeted criteria in narrative reports without having to push assignments to Canvas.

Creating a Flexible Assessment Plan

PREREQUISITE: Course-embedded assessments must be connected to a Cycle—so a prerequisite to creating an Assessment Plan is to ensure a Cycle has been created in Insights before proceeding with the creation of a plan.

See article: How do I create Cycles and Goals for Assessment Plan creation? 

To create a course-embedded assessment plan in Insights, go to Plan and select
+ Create Assessment Plan
. (If there are existing Assessment Plans in progress, they will be listed on screen.)

On the Plan Assessments page, click the dropdown in the Cycle field to select a cycle for this assessment plan (reminder: cycles are created in Setup > Assessment > Cycles & Goals--article link referenced above).

NOTE: Only cycles that are not yet associated with an assessment plan will be listed in the Cycle dropdown.

To create an additional assessment within a cycle where an assessment plan already exists, locate the planned assessment from the list on screen and click the pencil icon to Edit. Then locate the section where you want to add the assessment and click + Add Measure. Select Canvas Assessment from the drop-down menu and click Build.

Once you have selected the assessment Cycle, you can choose to include a mission statement and to include the Goal & Objectives from the Cycles & Goals. This is also the opportunity to add an Approver (Someone who will sign off on the plan) and Reviewers (Someone who will add information in the Section Findings and Section Recommendations for the plan).

Now you can you can create a new section to your plan. You will need at least one section for your Assessment Plan. To add a section, begin by clicking on + Add Section.

Fill in the details for the section and click + Add Measure

From the drop-down menu, select Canvas Assessment and then Build.

In the modal window Add Canvas Assessment, complete the fields according to the steps listed below:

  1. Collect Results By: Chose the method you would like to collect data
    1. Pushing Course Assessments: Will allow you to collect data by pusing assessments to selected course codes.
      For more information on this visit: How do I plan course-embedded assessments in Insights?
    2. Listening for Outcome Results: Insights will listen for assessment data based on the criteria entered in to the this modal window. 
  2. Collect results for: Check the button if this assessment is for Program or Institutional Assessment. 
  3. Program: if Program Assessment was selected in Step 3, click the Programs dropdown to choose the Program (more than one program may be selected); and choose the Learning Outcome Type: ILO or PLO.
  4. Learning Outcome Type: if Institutional Assessment was selected in Step 3 (Program is not applicable) and ILO (for Institutional Learning Outcome) auto populates in the Learning Outcome Type dropdown.
  5. For Mastery of: Here you will select the options to find the specific learning outcomes you wnat the system to listen for. 
  6. Learning Outcome Variety: Select from Learning Outcome or Standard.
  7. Category: This will narrow the options for the SLOs to slect to the selected categories.
  8. Learning Outcomes: Here you will select the spcific SLOs that you are having insights listen for on this plan.
  9. During: Here you will determine the time frame you want to collect data from.
    1. Academic Year: Select the Academic year as managed under Term Management in Settings.
    2. Collection Terms: Click the dropdown to select the desired Insights term(s) for collection of data. These are also managed in Term Management under settings. 
    3. Canvas Terms: Shows the canvas terms associated with the Insights terms.
  10. Goal: select a goal to be assessed (these were added to the cycle when it was created from Setup > Assessment > Cycles & Goals).
  11. Objective: select an objective from the dropdown (optional).
  12. Departments: select the department codes which contain courses that you would like to target with this assessment; more than one code can be added here.

When done, click Add Measure.

On the Create Plan pagethe Plan details will be displayed. Click the blue button Create Plan and the plan will then be listed on screen under Plan Assessments.

You MUST click Create Plan in order for your assessments to be retained. Subsequent editing of the plan will not require recreating the plan.

Additional Assessments can be created for this same cycle at any point, and existing assessments can be updated holistically prior to their deployment to Canvas, and with updated terms after their deployment to Canvas (in order to target newly created course offerings in Canvas).

Choose + Add Measure and complete the modal with the desired assessment criteria.

Review Flexible Assessment Settings

To review the setting for your Flexible Assessment to ensure you know what Insights is checking to collect your data, go to Plan, and click on on the chevron to the left of the plan you want to review:

The Departments, Course Levels, Collection Terms, and SLOs are listed for review. 

View Flexible Assessment Results

Dashboard View

To view your results as a coordinator, select the dashboard option from the left-hand navigation in Insights. Then select the Cycle related to the data you wanted to view. 

The Dashboard will now display the data for the Programs, Specific SLOS, and Terms you requested.

View Cycle Results

To view the results from the Assessment Plan view, scroll down to the bottom of the dashboard and make sure you have the Assessment Plan view selected.

You can then select the "View Cycle Results" to see the results of the Programs, Specific SLOS, and Terms you requested.

The results for a specific assessment will show in the assigned section of the Assessment Plan you created. If you selected data across multiple departments, you can choose those departments from the drop-down menu accessible from the results page.