Page tree
Skip to end of metadata
Go to start of metadata

The learning platform includes several assessable course elements to test the learners' knowledge, track their progress, and provide feedback to them.

As course author, you determine the assessment criteria that are necessary for the individual course elements in the course editor. With the Assessment tool, you can view or edit existing assessments and perform new assessments manually. Moreover, you can enable Performance results for your course and configure the content and format of Certificates.

Depending on the configuration, learners will be able to view their assessments in the course element itself, in assessment overviews and in the Performance results to the course.

Performance results in the course view

Assessable content

The following content / course elements can be assessed:

 Task (manual assessment)

 Assessment (manual assessment)

In the course element Structure and the Main course node, assessments of other course elements can be summarised. This includes an automatic calculation of the score, mark and passed status for structural segments or courses. Moreover, it is also possible to provide an assessment overview of these course elements, which shows the individual course elements' values in the overall assessment.

Assessment configuration

To assess course content, you must first configure the appropriate settings for the respective assessable course element in the course editor. These settings can be found in the tab Assessment of the course element.

 Configure assessment form ...
 Assessment form for the course elements task, assessment, portfolio task, and topic assignment ...

The tab Assessment allows you to configure basic settings including the view of the assessment form in the assessment tool and the assessment information available for users in the course view.

 

Configuration view in the course editorResulting view of an assessment form in the assessment toolAssessment from the user's perspective
Configuration of the assessment form in the course editorAssessment form in the assessment toolAssessment in the course view from the user's perspective

 

You can set the following options:

Score granted

If you select this checkbox, you can assign points to any assessable user in the assessment form. Set a range of points:

  • Minimum score: Enter the minimum number of points course participants can reach. You cannot make this entry if you have not selected the checkbox Score granted.
  • Maximum score: Enter the maximum number of points course participants can reach. You cannot make this entry if you have not selected the checkbox Score granted.

If you do not select the checkbox, this field will not be displayed in the assessment form.

Course editor - Tab assessment - Configuration options
Mark assignedSelect the entry Yes from the list if you want to assign marks in the assessment form. If you select No, the assessment form cannot be used for grading.
Display passed/failedIf this checkbox is selected, it is possible to assign the status Passed or Failed in the assessment form.
Type of display

This choice is only available if you have selected the checkbox Display passed/failed.

Determine whether the status passed or failed will be automatically assigned when reaching a certain threshold score, or whether the tutor can manually assign points to each assessable user.

  • Automatic (using cut value): Enter a score as a cut value for passing in this field. As soon as an assessor assigns a score to a user equal to or higher than this value, the system will automatically mark the user's status as passed upon saving the assessment. If the assigned score is below the given threshold value, the system will automatically mark the status as failed.
  • Manually by tutor: If you select this option, the assessor can manually mark the status of each assessment as passed.
Individual commentIf you mark this checkbox, you can leave a comment or note on the assessment for each user. This text is displayed to the user in the right assessment box in the course view.
Notice for all users

Enter a text, which will be displayed to all users in the course view of the course element. This field is, for example, suitable for describing assessment criteria. 

The entered text will be displayed in a separate box with the title Information about assessment, regardless of whether or not an assessment already exists.

Notice for tutors

Enter a text, which will be displayed to the assessor when conducting the assessment of a course participant. This text will be displayed in a separate box with the title Information on assessment, which can be found directly above the assessment form in the assessment tool. 

Use certificatesDepending on the system and course configuration, it is possible to create a certificate for a course element Assessment, provided that the user has been assigned the status Passed for this course element. For more detailed information, refer to the section Assessment>Certificates.Course editor - Tab assessment - Configure certificates
Peer ReviewFor a course element Task, the option Activate Peer Review is additionally available. The peer review enables participants to anonymously review each other. An overall rating is created based on those reviews. For more detailed information on the peer review process and the configuration options, refer to the section Assessment>Peer review.Course editor - Tab assessment - Configure peer review

 Assessment form for the course element scorm ...

Transfer score from SCORM

If this option is enabled, the score achieved in the SCORM learning content will be transferred to the learning platform, and the user will see the assessment information area in the course view.

If the option is disabled, no assessment information will be transmitted. The user can only see the number of their attempts in the course view but no further assessment information. Hence, the assessment information for this SCORM element is also not available in the assessment tool for this user.

Available assessment options for a course element SCORM

Score needed to passThis function allows you to specify the score which is needed to pass the learning content.
User can only advance scoreIf this option is enabled, the score of your second attempt will only be applied if  it is higher than the score of your first attempt. If this option is disabled, the score of your second attempt will be applied in any case (regardless of your previous score).
Count attempts only if score is transferredIf you deactivate this function, every start of the SCORM is counted as an attempt.
Maximal attemptsUse this option to define how often the user is allowed to start a SCORM.
Show average assessment

This function allows the user to see the average score among all users after completing the SCORM. The average is calculated when there are at least five completed attempts.

Use certificatesEnable this option if the user is to receive a PDF document as evidence for a passed SCORM.
Template for certificatesHere you can select the desired template for the certificate. Apart from the example template, you can also use an individually created template.
Display certificates only for tutors (assessment tool)If this option is enabled, the PDF files of the certificates can only be accessed via the assessment tool. In all other places, the user can no longer access, view, or download their own certificate.

 Assessment form for the course element test ...

Determine which test result is adopted for a course element Test and which assessment information is shared with the user.

Assessment tab

Passing score

Configure the points necessary to pass a test. 

If you use an ONYX resource, the threshold score set for the test will be automatically displayed. If necessary, please change this score directly in the Onyx resource. Changes made in the Assessment tab may lead to conflict and undesirable behaviour.

ResultDecide whether the last attempt will be counted or whether the user can improve on their test result, which means that the best score will be used.
Score info

If this checkbox is enabled, the user will see a box displaying their central results on the test home page after submitting the test. These include the passed status, the points achieved, and the mark in numbers and words. In addition, the passed status will also be shown in the course navigation.

The grading can be done manually or automatically. Manual grading is completed by means of the assessment form, bulk assessment function, or clef. Automatic grading, in contrast, is completed via expert rules configured specifically for the assessment.

If this checkbox is not enabled, the passed status will not be visible in the course navigation.

Detailed test overview

Select which assessment information is shared with the user:

  • Show on test homepage: The user can view each task of the test and their saved answers. Feedback information about the tasks is also displayed.
  • Show all assessment information: The user can also see the assessment of their answers.
  • Show all results: The user is shown both the results from the current test attempt and all previous attempts.

The visibility of the assessment information configured here also depends on the settings in the Visibility tab. For example, you may control when users get access to assessment information.

 Assessment form for the main course node and the course element structure ...

In the course, as in the course element Structure, you can collect assessment information of selected elements, resulting in an overall assessment.

To do this, mark the desired assessment criterion (score, mark, passed) in the tab Assessment and select the course elements to be summarised in the overall assessment.

Course editor - Assessment tab

Calculate scoreSelect the desired assessment criterion (score, mark) and the course elements to be summarised.
Calculate mark
Calculate passing score

If you select this assessment criterion, you have the following options:

Show assessment overviewThis option shows the user a tabular overview of the content relevant for passing the course or course section. The table contains information about the title of the course element, the assessment, the passed status and the number of attempts.
As of minimum score

This option allows you to enter a passing score in the input field Minimum score. The minimum score refers to the course elements selected under Calculate score. A "passed note" will be displayed in the course / course element Structure if the overall score of these course elements is greater than or equal to the minimum score you selected.

Adopt from course element

If you enable this option, you can select the content to be included in the overall assessment. The course or structural element will be considered as passed if all selected content has been passed.

Expert mode

More complex calculations can be configured in the expert mode. Click on the button Expert mode to open the input fields of the assessment criteria. Here you can enter the desired calculation syntax.

The following syntax is available:

 Display expert syntax

Expert syntax

TypeSyntaxDescription

Constants

TRUE or 1

True


FALSE or 0

False

Variable

now

Current server system time

Functions

date("[date]")

Query date


inLearningGroup("[string]")

Returns TRUE for all members of the learning group with the title [string] of the current course.


inLearningGroup("[string1]","[string2]")

Returns TRUE for all members of the specified learning group [string1] of the course with the specified course ID=[string2].


inLearningGroupWaitingList("[string]")

Returns TRUE for all users on the waiting list of the learning group [string] of the current course.


inLearningGroupWaitingList("[string1]","[string2]" )

Returns TRUE for all users on the waiting list of the learning group [string1] of the course with the specified course ID=[string2].


inRightGroup("[string]")

Returns TRUE for all members of the right group [string].


isLearningGroupFull("[string]")

Returns the Boolean TRUE (=full) or FALSE (=not full) for the specified learning group in the current course.


isLearningGroupFull("[string1]","[string2]")

Returns the Boolean TRUE (=full) or FALSE (=not full) for the specified learning group=[string1] of the course with the course ID=[string2].


isUser("[string]")

Returns TRUE for the user with the user name [string].


inLearningArea("[string]")

Returns TRUE for all members of the groups in the learning area [string] of the current course.


inLearningArea("[string1]","[string2]")

Returns TRUE for all members of the groups in the specified learning area [string1] of the course with the specified course ID=[string2].


getNumberOfEnrollments("[string1]*")

Returns TRUE, when the configured number of learning group members is reached in the learning area (string1).


isGlobalAuthor(0)

Returns TRUE for all members of the OPAL author group.


isCourseAdministrator(0)

Returns TRUE for all owners of your course (learning resource).


isCourseCoach(0)

Returns TRUE for all users who supervise a learning group.


isGuest(0)

Returns TRUE for all users who visit OPAL as guests.


isExternalUser(0)

Returns TRUE for everyone who uses OPAL as an external user.


hasAttribute("[AttrName]","[string]")

Returns TRUE if [string] matches the value of the AAI attribute [AttrName] of the respective user.


isInAttribute("[AttrName]","[substring]")

Returns TRUE if [substring] matches a portion of the value of the AAI attribute [AttrName] of the respective user.


getUserProperty("[string]")

Returns the specified user property of the executing user.


getPassed("[integer]")

Returns the Boolean TRUE (=passed) or FALSE (=not passed) from the course element with the specified ID.


getScore("[integer]")

Returns the number of points from the course element with the specified ID.


getAttempts("[integer]")

Returns the number of completed attempts from the course element with the specified ID. Can be applied to course elements of the type Test, Self-test, Survey (possible return values 0 or 1), and Task (return value = number of submitted files).


getInitialEnrollmentDate("[integer]")

Returns the date of the respective course participant's first-time enrolment from the course element Enrolment with the specified ID.


getRecentEnrollmentDate("[integer]")

Returns the date of the respective course participant's last enrolment from the course element Enrolment with the specified ID.


getInitialCourseLaunchDate(0)

Returns the date of the first course visit of the respective course participant.


getRecentCourseLaunchDate(0)

Returns the date of the last course visit of the respective course participant.


getRecentCourseLaunchDate(0)

Returns the date of the last course visit of the respective course participant.


getPassedWithCourseId("[integer-1]","[integer- 2]")

Returns the Boolean TRUE (=passed) or FALSE (=not passed) from the course element with the ID=[integer-2] of the course with the ID=[integer-1].


getScoreWithCourseId("[integer-1]","[integer-2]")

Returns the number of points from the course element with the ID=[integer-2] of the course with the ID=[integer-1].


getMarkWithCourseId(" [integer-1]","[integer-2]")

Returns the grade from the course element with the with the ID=[integer-1].


hasEvaluationCompleted("KB-ID")

Returns TRUE for all users who have successfully completed the specified course element.


getNumberOfEnrollments("[string1]*")

Returns TRUE, when the configured number of learning group members is reached in the learning area (string1).


getOnyxTestOutcome("[string1]","[string2]")

Returns the value of the output variable from the ONYX test course element with the specified ID (string1) and the specified output variable (string2). The return value is a number.


getOnyxTestOutcomeZK("[string1]","[string2]")

Returns the value of the output variable from the ONYX test course element with the specified ID (string1) and the specified output variable (string2). The return value is a string.


getProgress("[integer]")

Returns the progress from the course element with the specified ID as a numerical value between 0 and 100 (percent).


isPasswordConfirmed("[string]")

Returns TRUE after entering the correct password (string1).

Can only be used with course elements which offer a password restriction even in simple mode.


comesFrom("[string]")

Returns TRUE if the user has a linked account to OLAT with the specified system ID.

Units

min

Minutes


h

h


w

Weeks


m

Months

Operators

=

equal to


>

greater than


<

less than


>=

greater than or equal to


<=

less than or equal to


*

Multiplication


/

Division


+

Addition


-

Subtraction

Booleans

&

Logical AND


|

Logical OR


!

Logical NOT

 Application examples of the expert syntax

Application examples

In the following section, you will find examples on how to use the expert syntax.

In addition to these institution-independent examples, there are also institution-dependent rules that restrict and transmit data according to the user's institution (DFN-AAI attributes).

For OPAL users, the page Overview of OPAL Shibboleth attributes contains all currently usable institution-specific attributes of Saxon institutions.

Examples of rules in the tabs «Visibility», «Access», and «Points» (structure element)Effects

isGuest(0) or isGuest(0)=1 or isGuest(0)=TRUE

Only guests have access to the course element.

inLearningGroup("Beginners") = 0

With the exception of the group «Beginners», the course element is visible to all course participants.

(now >= date("22.03.2017 12:00")) & (now <= date("23.08.2017 18:00")) | inLearningGroup("Supervisors")

The course element will be visible to all course participants from 22.03.2017 to 23.08.2017. For the members of the learning group «Supervisors», in contrast, it will be visible at any time.

(now >= date("03.09.2017 00:00")) & (now <= date("13.10.2017 00:00")) & inRightGroup("Assessors")| isUser("Author")

The course element will be visible to all course participants of the right group «Assessors» from 03.09.2017 to 13.10.2017. For the person with the user name «Author», in contrast, it will be visible at any time.

isInAttribute("surname","Mue")

Returns TRUE for all persons whose attribute surname contains the letter sequence "Mue". It returns TRUE e.g. for the value "Mueller" or "Muehlebacher".

(getUserProperty("orgUnit") = "Marketing")

Checks whether a person is in the organisation unit "Marketing". This is for example useful if the data are automatically transferred from LDAP.

(getPassed("69742969114730") | getPassed("69742969115733") | getPassed("69742969118009")) * 10

This rule is set in the tab «Points» -> «Process points» of the course element Structure. The course element Structure shows 10 points if any of the tests (course element IDs "69742969114730", "69742969115733", or "69742969118009") has been passed, otherwise it will show 0 points.

(getScore("69742969114730") + getScore("69742969115733") + getScore("69742969118009")) >= 140 | getPassed("69978845384688")

This rule is set in the tab «Points» ->

«Passed if» of the course element Structure. The course element Structure shows a "passed" if a minimum of 140 points is achieved in all tests together or if a «passed» is set manually (course element Assessment with the ID "69978845384688").

getAttempts("70323786958847") > 0

Returns TRUE as soon as the course participant has completed the test with the specified ID for the first time.

getAttempts("70323524635734") <= 3

Returns FALSE as soon as the course participant has saved more than 3 files in the drop box of the course element Task.

getInitialEnrollmentDate("70323786958847") <= date("26.5.2017 18:00")

Returns TRUE for those course participants who have enrolled in one of the available groups before 6 p.m. on May 26, 2017 via the course element Enrolment with a specified ID.

getInitialEnrollmentDate("70323786958847") + 2h > now

Returns TRUE within two hours from the time of enrolment for those course participants who have enrolled in one of the available groups via the course element Enrolment with a specified ID. In this way, it can be ensured that each course participant can only e.g. process a script during a certain period of time.

(getInitialCourseLaunchDate(0) >= never) | (getInitialCourseLaunchDate(0) + 2h > now)

Returns TRUE if the course participant has not yet visited the course, or during the first two hours of the first course visit. In this way, it can be ensured that each course participant can only see the course for a certain period of time.

(getRecentCourseLaunchDate(0) + 10min) > now

Returns TRUE if the user has been active in the course for more than 10 minutes.

getOnyxTestOutcome("84692289655276","SCORE") >= 10

Returns TRUE if the user has reached at least 10 points.

getOnyxTestOutcomeZK("84389429397045","PASS") ="true"

Returns TRUE if the user has passed the test.

getMark("84692289655276") > 4

Returns TRUE if the user's grade for the specified course element is better than 4.

Attention!

Please note that the above-mentioned course element IDs are just examples. When you create a course, you need to reference the ID of your own course.

Once a learner has been assessed, the configuration should not be changed.

More detailed information on how to design special assessment scenarios with ONYX resources or perform examination scenarios using a safe exam browser (SEB) can be found on the help page for the Course element test and in the ONYX manual on the page Testing in OPAL.

Perform an assessment

Depending on the course element, the actual assessment is done automatically by system evaluations (e.g. course element Test with corresponding test questions) or manually (e.g. course element Assessment) by a tutor. In the Assessment tool, all users with appropriate rights can view, monitor and edit these assessments. The (manual) assessment of a course element is carried out in the assessment tool. An exception is the course element Task, which can also be assessed by Peer review.

Performance results and certificates

The performance results provide users with an overview of all assessable elements of the course and their personal accomplishments. Through the table view, they can see at a glance in which elements they still have open assignments. For further information, please refer to the help page Performance results.

In addition to the Performance results, certificates can be generated for the entire course or even for individual assessable course elements. Using a link in the performance results section of the course, users can then download and print these certificates as a PDF file. Various configuration options allow you to influence the design and content of the certificate and limit the view or print. For further information, please refer to the help page Certificates.