Flipped Learning Transparent1

Most of the higher education in the world is moving toward a latest trend called flipped learning. Flipped learning enables us to move away from lecture-centered education model to learner-centered education model. You can move away from group based learning toward individual focused learning. Educators can spread their course curriculum across the classroom, offline content, reviews, and online discussions enabling them to understand the students performance better. When the course is not confined to classroom alone, the educators can get more space and spend time effectively to review, discuss, and train students face-to-face catering to individual student needs.

Students can also grasp the concepts better as they can fall back on the offline course content whenever they are stuck while doing their offline exercises. They can practise skills, receive feedback on their progress and engage with courses better. 

Create your teaching content as modules/courses using Adobe Presenter and publish as online videos tagged with analytics support. Analytics enable the educators to view reports related to comparative students performance, and students participation through discussions. Using this dashboard, students can also collaborate with their classmates through discussions.

Overview of Course, Concept, Modules, and Learner analytics

Modules6

A Module is a single project created in Microsoft PowerPoint and published using Adobe Presenter after enabling it for tracking. Tracking is enabled when you visit the Analytics & Colloboration screen, enable analytics, collaboration, or both, and sign-in using your Adobe ID credentials.

A module can contain slides, slides with or without videos, or slides with or without quiz. Such modules are referred to as slide-based modules. A video module contains a video or a video with a quiz.

Teachers can add a module with questions pertaining to all concepts of a course. This type of module is referred to as a quiz module. A Quiz module is a unique module including one or more quizzes in it. Instructions and result slides can be included in this module but non-quiz slides cannot be used.  

In Adobe Presenter 9 and above versions, video analytics (segment-wise breakup of usage) is available for a video module only if the module contains a single video with or without a quiz. If the module contains multiple videos, Adobe Presenter considers the module as a slide-based module and provides the corresponding analytics. 

A Course includes one or more concepts. 

A Concept is a course topic that includes one or more modules.

It can also contain a mix of slide-based and video modules.

To view the analytics for a module, you need to add the module to a course on the Learning Dashboard.

Module contains Video Analytics Slide-based Analytics
Slides with video/quiz   X
Single video with or without quiz X  
Multiple videos with or without quiz   X

As an author, you can view all the published courses, group modules into a course, and track learners progress through the Learner analytics dashboard. In Adobe Presenter 10, new features such as Concept, Discussions, and quiz have been added to the dashboard. 

In Adobe Presenter 10 and above versions, Concept feature is introduced enabling authors to create multiple small modules for each concept, also known as a course topic. You can tag each module to a particular concept. In the following snapshot, C1 and C2 are two concepts for which different modules have been assigned. 

concepts

Authors can analyze learners performance in quiz and peer to peer discussions. Based on learners' participation levels in discussions, authors can design the activities categorizing them according to learners' abilities. Teachers can perform standards based grading as per Common Core Standards. 

Learner analytics dashboard

Analytics provides deep insights into how your course is being used by learners. For example, how many learners have completed the course, level of completion, comparative scores, and user engagement with each module/concept/discussion forum.

Learner analytics enables teachers to evaluate the performance of students in the following ways: 

  • Analyze module level data
    • Pass/fail percentage of students
    • Overall participation score with low, medium, and high performers data
    • Number of visits per slide/module
    • Time spent per slide/module
    • Access quiz questions
  • Analyze concept level data
    • Overall participation score with low, medium, and high performers data for all modules within a concept
    • Quiz data categorized by each concept
  • Moderate students discussion
    • Access all questions/responses in discussion board
    • Sort the questions based on date or popularity (number of students following a question) 
    • Post a question to students or answer any question
    • Delete irrelevant or unrelated questions
    • Provide additional points to best answers
presenter-to-learningdboard

The getting started screen appears. Click Get Started and log in with Adobe ID. Use the same ID you used to enable Collaboration and Analytics while registering the course using Presenter.

getting-started

The following Learner analytics dashboard appears after login. 

learner-dashboard-home

Create a course

You can combine modules to create a course list.  

You can add new courses by clicking the 'New Course' tab:

  1. Enter the name, start and end date, and number of students to take up the course. 
  2. Provide the scoring elements for learner actions based on given parameters by editing the default values.
  3. Click Next.
new-course-entry
New Course entry screen

    4.  Choose the modules to be included for your course, from the list of your analytics-based          registered modules.  

create-course-modules

    5.  Assign each module to the corresponding concept of your choice by including it. Start typing
         the concept name in the Concept field and select the concept of your choice from the drop-                down list.

    6.  Click Create. 

         The course is created. You can view the course from the drop-down list in the left pane of
         learner analytics dashboard home page. 

Add Quiz to courses

By default, the dashboard does not have any information about quiz questions. To include quiz questions to each module, you can click Upload XML during course creation and upload the questionnaire xml file (viewer.xml). Viewer.xml file can be found in the published output of your module. 

Note:

A typical quiz module consists of only quiz questions. It does not have any other content. 

upload-xml

Browse through your local computer and select the viewer.xml file from your quiz module output > data folder. 

Ensure that the viewer.xml file belong to a quiz-only module. After uploading the file, the questions appear in the course module. Mapping each question of the quiz module to concepts enables the users to evaluate the results better. You can map the questions against each concept by following the steps below: 

  1. Click the Settings icon at the upper-right corner of the window and choose Course settings. 

    edit-quiz-course-settings
  2. Choose your course from the list of available courses and click Edit. 

  3. In the Course details window, you can make any changes required and click Next. 

    A Course outline window appears with a list of all the modules in the course. 

  4. Click the highlighted area adjacent to quiz only module, as shown in the snapshot below. 

    course-outline

    Note:

    You can click Upload XML if the quiz module is not uploaded yet. 

  5. You can map each question to the concepts by mentioning the name of concept against each question as shown in the snapshot below. 

    map-quiz-questions

Change settings

Click the Settings icon to view and manage your personal settings.

You can use the Course Settings drop-down option to add, modify, or delete the courses.

course-settings
Course Settings

Status bar view

Status bar dynamically displays the status based on the dashboard selection. You can view Overview, Students, and Modules statuses and also the statuses from various micro level dashboard views displayed based on your graph view selection.

If you are in the Module dashboard view, Click the module name on the left pane, to select a different module. 

status-bar
Status bar

Analyze courses

Students tab

Click the Students tab. You can view the progress of all the students with their quiz, participation scores, and time spent at course level. Now, we have Concept tags for modules in the course enabling us to provide analytics based on this new dimension of concepts. This provision is in addition to modules we had earlier. To enable analytics along this concept dimension, we now evaluate performance for each student based on their participation score and quiz results. Click here to see how the performance is evaluated. 

Class summary graph

Select any module from the course view at the left pane. 

A 3x3 matrix graph with students' participation scores on the x-axis and the students' quiz scores on y-axis is displayed. The graph shows the overall class performance in the selected module. Each circle represents the state of students based on their quiz score and participation score.

For any student, the quiz score may be low (<30%), medium(between 30% and 70%)
or high(>70%). 

Similarly, participation score may be low (<30%), medium(between 30% and 70%) or
high(>70%).

On X-axis, the value close to the origin corresponds to a state of low participation score and low quiz score. The size of the circle in the graph corresponds to the value displayed in it. For example, in the below graph, the biggest circle corresponds to 4 which is the highest value. The value 4 here represents that there are four number of students at this state. 

Meaning of each value in the graph: 

  • There are 4 students who are at the state of low quiz and low participation scores. 
  • Value 1 corresponds to the number of students with medium participation score and medium quiz score. 
  • Value 2 corresponds to the number of students with high quiz score but low participation score. 
class-summary
Class summary graph

Click each circle in the graph to view the list of students corresponding to the circled value. In the above graph, the selected circle is highlighted in red color and the corresponding student name is displayed below.  

Students progress 

You can click each student name to view progress status concept wise or module wise as shown in the snapshot below.  

student-activity-screen
A sample student activity screen for concepts

A student's progress in a concept or module is displayed as graphs based on:

  • The number of days spent in the concept/module
  • General progress across the concepts/modules
  • Completion of quiz or other knowledge activities in the concept/module
  • Participation score measured as the student's individual score against the class median score

The activity chart portrays the time spent (in minutes) by a learner on the module/day since the start date. You can hover over any of the visual element to view specific data. 

Knowledge Check graph

A student's progress over the modules based on score in each module is displayed. The value of student score and median score are also displayed when you hover over corresponding graph component. 

The status is also displayed as legend below the graph.

knowledge-check
Knowledge Check graph

Click anywhere on the graph component to view the detailed quiz results for a particular student. The below graph depicts eight questions in the Quiz module M5.

  • The length of each bar indicates the number of students who answered correctly. 
  • The first, third, and fifth questions are answered by only 1 student each. The second question is answered by 7 students and so on. 
  • The color of the bar graph element indicates the response of the selected student. Green color corresponds to the correct answer and the red indicates the incorrect answer. 
  • To view these results for another student, click the drop-down adjacent to the student name, alpi as shown in the below snapshot and choose another student name. 
knowledge-check-drilldown

Participation Score Graph

Participation score is obtained based on the student's queries and responses in discussion board. Marks are also awarded to students based on usefulness of their responses, and teacher's feedback for overall participation in the discussion board. 

You can view the student's score and the class median graphically. Hover over the graph to view Median, Pass Score, and Active Students data (module wise). 

The participation graph components are shown only for participation scores greater than 30%. 

participation-score
Participation Score graph

Modules tab

Click the Modules tab. You can graphically view the module-wise progress of the students.

You can view the module wise information by clicking each of the module tabs displayed under each module number. Click All Modules to display student progress information pertaining to all the modules. 

Information is displayed based on:

  • Time spent per slide by the students. You can view either the Top five slides on which the students spent maximum time or the Bottom 5 by selecting the drop-down value.
  • The Top 5 or the Bottom 5 slides that attracted the maximum students. Select the appropriate value from the drop-down list.
  • Time spent in each segment of the video*. 30 seconds of a video is defined as one segment.
  • Total number of visits to each segment of the video*.
  • Knowledge level check for all students based on passed, failed, or not attempted parameters.
  • Participation Score segregated based on the high, medium, and low participation percentage.
*Applicable only for a video module.
modules-tab
Modules tab sample content

Discussions tab

Using discussions tab teachers (authors) can monitor, assess and moderate the collaboration activities in the course. You may not find discussions for all courses. If you create a course with modules where collaboration is enabled, you are able to view all the discussions among students.

The screenshot below illustrates the various features available in the Discussion tab.

SampleCourseDiscussions
A. Use these filters to sort the discussions based on date, popularity, and module. You can change the course name from the drop-down list.  B. Reply to the question, delete inappropriate questions, and rate the questions.  C. View the number of responses to each question. Click here to view the responses. D. Start a new discussion thread by adding a question. 

The screenshot below demonstrates how a single discussion thread appears. 

SampleCourseDiscussion1

Computation of PS, PI, and quiz normalized scores

Normalized Performance score

The author sets the minimum target value for the participation score a user has to earn to pass the module. This setting can be configured in the Analytics & Collaboration window from Presenter. The score can range from 0 to 100. 

Let us consider that the author has set x points as minimum pass value. Assuming that 30% is the pass score, let a student score y points. In this case, x points are required to get 30%. 

So, the normalized Performance score is equivalent to (y/x)*30. 

Ensure that the maximum participation score does not exceed 100. Any score>100 is rounded off to 100. 

Normalized PI and Quiz scores

Let us consider the following example of a typical course. Assume that we have a course X with five modules covering two concepts, as shown in the following table. 

Module Concept Max Quiz score PI score
M11 C1 50 20
M12 C1 30 30
M13 C1 20 10
M21 C2 25 20
M22 C2 25 30

Now assume that we have some learners of this course with the following scores in the quiz and collaboration:

Learner

Module

Quiz Score

PI Score

Jack

M11

30

20

Jack

M12

30

0

Jack

M13

0

20

Jack

M21

15

50

Jack

M22

20

10

Jill

M11

10

10

Jill

M12

10

5

Jill

M13

0

10

Jill

M21

25

60

Jill

M22

20

40

Since each module has a different max quiz score and a Performance Index (PI) score, we normalize it to a scale of 0-100. The normalized module scores for a student are computed as follows:

Normalized Quiz Score = (Student’s Quiz Score / Max Quiz Score for the Module) * 100

Normalized PI Score = (Student’s PI Score * 30/ PI score for Module) capped to 100

Now we compute the normalized scores of the concept as the average normalized scores for that concept. 

And we classify students’ performance as High, Medium or Low based on PI and quiz scores. 

If we apply these computations for two students, say, Jack and Jill, then we can illustrate it as per the following table: 

Learner

Module/Concept

Quiz Score

PI Score

Normalized Quiz Score

Normalized PI Score

Jack

M11

30

20

60

30

Jack

M12

30

0

100

0

Jack

M13

0

20

0

60

Jack

C1

 

 

160/3 = 53.3

90/3 = 30

Jack

M21

15

50

60

75

Jack

M22

20

10

80

10

Jack

C2

 

 

140/2 = 70

85/2 = 42.5

Jill

M11

10

10

20

15

Jill

M12

10

5

33.3

7.5

Jill

M13

0

10

0

30

Jill

C1

 

 

53.3/3 = 17.8

52.5/3=17.5

Jill

M21

25

60

100

90

Jill

M22

20

40

80

40

Jill

C2

 

 

180/2 = 90

130/2=65

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License  Twitter™ and Facebook posts are not covered under the terms of Creative Commons.

Legal Notices   |   Online Privacy Policy