Open response assessments allow instructors to assign questions that may not have definite answers. Students submit a response to the question, and then that student and the student's peers compare the response to a rubric that you create.
Open response assessments allow instructors to assign questions that may not have definite answers. Students submit a response to the question, and then that student and the student's peers compare the response to a rubric that you create. Usually students will submit text responses. You can also allow your students to upload an image to accompany the text.
Open response assessments include peer assessments and self assessments. In peer assessments, students compare their peers' responses to a rubric that you create. In self assessments, students compare their own responses to the rubric.
...
...
@@ -16,7 +16,7 @@ For more information, see the following sections:
* :ref:`PA Elements`
* :ref:`PA Scoring`
* :ref:`PA Create a PA Problem`
* :ref:`PA Create a PA Assignment`
* :ref:`PA Accessing Assignment Information`
.. _PA Elements:
...
...
@@ -25,7 +25,7 @@ For more information, see the following sections:
Elements of an Open Response Assessment
*****************************************
When you create an open response assessment problem, you include several elements:
When you create an open response assessment assignment, you include several elements:
* The number of responses and assessments.
* One or more assessment types. Assessment types include **student training**, **peer**, and **self**.
...
...
@@ -33,13 +33,13 @@ When you create an open response assessment problem, you include several element
* The question.
* The rubric.
For step-by-step instructions, see :ref:`PA Create a PA Problem`.
For step-by-step instructions, see :ref:`PA Create a PA Assignment`.
=======================================
Number of Responses and Assessments
=======================================
In the problem code, you'll indicate the **number of responses** each student has to assess and the **number of peer assessments** each response has to receive.
In the assignment code, you'll indicate the **number of responses** each student has to assess and the **number of peer assessments** each response has to receive.
.. note:: Because some students may submit a response but not complete peer assessments, some responses may not receive the required number of assessments. To increase the chance that all responses will receive enough assessments, you must set the number of responses that students have to assess to be higher than the number of assessments that each response must undergo. For example, if you require each response to receive three assessments, you could require each student to assess five responses.
...
...
@@ -51,7 +51,7 @@ For more information, see :ref:`PA Specify Name and Assessment Types`.
Assessment Type
=====================
In your problem, you'll also specify the **assessment type or types**. You can see the type and order of the assessments when you look at the problem. In the following example, after students submit a response, they complete peer assessments on other students' responses ("Assess Peers") and then complete self assessments ("Assess Your Response").
In your assignment, you'll also specify the **assessment type or types**. You can see the type and order of the assessments when you look at the assignment. In the following example, after students submit a response, they complete peer assessments on other students' responses ("Assess Peers") and then complete self assessments ("Assess Your Response").
.. image:: /Images/PA_AsmtWithResponse.png
:alt: Image of peer assessment with assessment steps and status labeled
...
...
@@ -79,7 +79,7 @@ For more information, see :ref:`PA Add Due Dates`.
Question
==============
You'll also specify the **question** that you want your students to answer. This appears near the top of the component, followed by a field where the student enters a response.
You'll also specify the **question** that you want your students to answer. This appears near the top of the component, followed by a field where the student enters a response. You can require your students to enter text as a response, or you can require your students to both enter text and upload an image. (All student responses must include text. You cannot require students to only upload an image.)
When you write your question, you can include helpful information for your students, such as what students can expect after they submit responses and the approximate number of words or sentences that a student's response should have. (A response cannot have more than 10,000 words.)
...
...
@@ -91,7 +91,7 @@ For more information, see :ref:`PA Add Question`.
Rubric
=======
Your problem must include a **rubric** that you design. The same rubric is used for peer and self assessments, and the rubric appears when students begin grading. Students compare their peers' responses to the rubric.
Your assignment must include a **rubric** that you design. The same rubric is used for peer and self assessments, and the rubric appears when students begin grading. Students compare their peers' responses to the rubric.
Rubrics are made of *criteria* and *options*.
...
...
@@ -114,7 +114,7 @@ You can see both criterion and option names when you access assignment informati
.. image:: /Images/PA_Crit_Option_Names.png
:width: 600
:alt: Student-specific problem information with call-outs for criterion and option names
:alt: Student-specific assignment information with call-outs for criterion and option names
When you create your rubric, decide how many points each option will receive, and make sure that the explanation for each option is as specific as possible. For example, one criterion and set of options may resemble the following.
...
...
@@ -244,13 +244,13 @@ To calculate the final score, add the median scores for each criterion:
Note, again, that final scores are calculated by criteria, not by individual assessor. Thus the response's score is not the median of the scores that each individual peer assessor gave the response.
.. _PA Create a PA Problem:
.. _PA Create a PA Assignment:
********************************
Create a Peer Assessment Problem
********************************
************************************
Create a Peer Assessment Assignment
************************************
To create a peer assessment problem, you'll edit XML code in a Problem component, similar to the way you create other problems. The following image shows what a peer assessment component looks like when you edit it in Studio, as well as the way that students see that peer assessment in the courseware.
To create a peer assessment assignment, you'll edit XML code in a Problem component, similar to the way you create other assignments. The following image shows what a peer assessment component looks like when you edit it in Studio, as well as the way that students see that peer assessment in the courseware.
.. image:: /Images/PA_XML_LMS_All.png
:alt: Image of a peer assessment in Studio and LMS views
...
...
@@ -265,7 +265,7 @@ Creating a peer assessment is a multi-step process:
* :ref:`PA Add Question`
* :ref:`PA Add Rubric`
* :ref:`PA Provide Comment Options`
* :ref:`PA Test Problem`
* :ref:`PA Test Assignment`
Each of these steps is covered in detail below.
...
...
@@ -280,7 +280,7 @@ Step 1. Create the Component
#. Under **Add New Component**, click **Problem**, click the **Advanced** tab, and then click **Peer Assessment**.
#. In the Problem component that appears, click **Edit**.
When the component editor opens, you can see sample code that includes the following. You'll replace this sample content with the content for your problem:
When the component editor opens, you can see sample code that includes the following. You'll replace this sample content with the content for your assignment:
* The assignment's title.
* The training responses for the assignment.
...
...
@@ -294,10 +294,10 @@ Note that you won't use the **Settings** tab in the component editor when you cr
To specify the name and assessment types for the problem, you'll work with the XML near the top of the problem.
To specify the name and assessment types for the assignment, you'll work with the XML near the top of the component editor.
In the component editor, locate the following XML:
...
...
@@ -337,7 +337,7 @@ This code includes several elements:
To specify the name and assessment types, follow these steps.
#. Between the ``<title>`` tags, add a name for the problem.
#. Between the ``<title>`` tags, add a name for the assignment.
#. Specify the type of assessments you want students to complete. Assessments run in the order in which they're listed.
...
...
@@ -405,11 +405,11 @@ Step 4. Add Start and Due Dates (optional)
Setting start and due dates is optional. If you don't specify dates, the deadline for all student responses and assessments is the due date that you set for the subsection that contains the peer assessment. If you do specify dates, those dates take precedence over the subsection due date.
To specify due dates and times, you'll add code that includes the date and time inside the XML tags for the problem and for each specific assessment. The date and time must be formatted as ``YYYY-MM-DDTHH:MM:SS``.
To specify due dates and times, you'll add code that includes the date and time inside the XML tags for the assignment and for each specific assessment. The date and time must be formatted as ``YYYY-MM-DDTHH:MM:SS``.
.. note:: You must include the "T" between the date and the time, with no spaces. All times are in universal coordinated time (UTC).
* To specify a due date for response submissions, add the ``submission_due`` attribute with the date and time to the ``<openassessment>`` tag (this is the first tag in your problem).
* To specify a due date for response submissions, add the ``submission_due`` attribute with the date and time to the ``<openassessment>`` tag (this is the first tag in your assignment).
In this example, the problem is set at the subsection level to open on February 24, 2014 at midnight UTC. (This information does not appear in the code.) Additionally, the code specifies the following:
In this example, the assignment is set at the subsection level to open on February 24, 2014 at midnight UTC. (This information does not appear in the code.) Additionally, the code specifies the following:
* Students can begin submitting responses on February 24, 2014 at midnight UTC, and must submit all responses before March 1, 2014 at midnight UTC:
...
...
@@ -464,6 +464,16 @@ To add the question:
#. Replace the sample text between the ``<prompt>`` tags with the text of your question. Note that the component editor respects paragraph breaks and new lines inside the ``<prompt>`` tags. You don't have to add ``<p>`` tags to create individual paragraphs.
Require Students to Upload an Image
****************************************
If you want your students to upload an image as a part of their response, change the very first tag in the assignment from ``<openassessment allow_file_upload="False">`` to ``<openassessment allow_file_upload="True">``. This action adds the **Choose File** and **Upload Your Image** buttons below the student response field.
.. image:: /Images/PA_Upload_ChooseFile.png
:alt: Open response assessment example with Choose File and Upload Your Image buttons circled
:width: 500
Add Formatting or Images to the Question
****************************************
...
...
@@ -473,7 +483,7 @@ In this initial release, you cannot add text formatting or images in the Peer As
:alt: A peer assessment that has an image in an HTML component
:width: 500
To remove the prompt from the Peer Assessment component, open the component editor, and then delete the first set of ``<prompt>`` tags together with all the text between the tags. The first few lines of XML for the problem will then resemble the following.
To remove the prompt from the Peer Assessment component, open the component editor, and then delete the first set of ``<prompt>`` tags together with all the text between the tags. The first few lines of XML for the assignment will then resemble the following.
.. code-block:: xml
...
...
@@ -590,7 +600,7 @@ You can replace this default text with your own text.
To change this text:
#. Locate the ``<feedbackprompt>`` tags between the last closing ``</criterion>`` tag for the rubric and the closing ``</rubric>`` tag for the problem:
#. Locate the ``<feedbackprompt>`` tags between the last closing ``</criterion>`` tag for the rubric and the closing ``</rubric>`` tag for the assignment:
By default, students see only a single comment field below the entire rubric. However, you can add a comment field to an individual criterion or to several individual criteria. The comment field can contain up to 300 characters.
In the following image, the first criterion has a comment field, but the second does not.
The comment field appears below the options for the criterion. In the following image, the first criterion has a comment field, but the second does not.
.. image:: /Images/PA_Comments_Criterion.png
:alt: Comment box under an individual criterion
...
...
@@ -622,9 +632,15 @@ To add a comment field:
#. Locate the opening ``<criterion>`` tag for the criterion that you want to change.
#. Add the ``feedback="optional"`` attribute to this tag:
#. Add the ``feedback`` attribute to this tag. Make sure to set a value for this attribute:
.. code-block:: xml
* If you want to make comments optional for students, use ``feedback="optional"``.
* If you want to require students to provide comments, use ``feedback="required"``.
The XML for a criterion that has a comment field as well as options resembles the following.
.. code-block:: xml
<criterion feedback="optional">
<name>NAME</name>
...
...
@@ -639,13 +655,46 @@ To add a comment field:
</option>
</criterion>
If you want to provide comment fields below additional criteria, add the ``feedback="optional"`` attribute to the opening tag for each criterion.
If you want to provide a comment field below any additional criteria, add the ``feedback="optional"`` or ``feedback="required"`` attribute to the opening tag for each criterion.
.. _PA Zero Option Criteria:
Provide Only Comment Fields for Individual Criteria
When you add a comment field to a criterion, the comment field appears below the options for the criterion. You can also provide a comment field, but no options.
In the following image, the first criterion has a comment field but no options. The second includes options, but does not have a comment field.
.. image:: /Images/PA_0_Option_Criteria.png
To provide a comment field without options:
#. Locate the opening ``<criterion>`` tag for the criterion that you want to change.
#. Add the ``feedback="required"`` attribute to this tag.
.. note:: If you don't include options for the criterion, you must include the ``feedback="required"`` attribute. Don't use the ``feedback="optional"`` attribute.
#. If the criterion has options, delete the options.
The XML for a criterion that has a comment field but no options resembles the following.
.. code-block:: xml
<criterion feedback="required">
<name>NAME</name>
<prompt>PROMPT TEXT</prompt>
</criterion>
.. _PA Test Problem:
.. _PA Test Assignment:
============================
Step 8. Test the Problem
Step 8. Test the Assignment
============================
To test your assignment, set up the assignment in a test course, and ask a group of beta users to submit responses and grade each other. The beta testers can then let you know if they found the question and the rubric easy to understand or if they found any problems with the assignment.
To test your assignment, set up the assignment in a test course, and ask a group of beta users to submit responses and grade each other. The beta testers can then let you know if they found the question and the rubric easy to understand or if they had any problems with the assignment.
@@ -74,6 +74,29 @@ Note that you can view your response at any time after you submit it. To do this
:alt: Image of the Response field collapsed and then expanded
:width: 550
Submit an Image with Your Response
***********************************
Some assignments require you to submit an image with your text response. If you have to submit an image, you'll see buttons that you'll use to upload your image.
.. image:: /Images/PA_Upload_ChooseFile.png
:alt: Open response assessment example with Choose File and Upload Your Image buttons circled
:width: 500
To upload your image:
#. Click **Choose File**.
#. In the dialog box that opens, select the file that you want, and then click **Open**.
#. When the dialog box closes, click **Upload Your Image**.
Your image appears below the response field, and the name of the image file appears next to the **Choose File** button. If you want to change the image, follow steps 1-3 again.
.. image:: /Images/PA_Upload_WithImage.png
:alt: Example response with an image of Paris
:width: 500
.. note:: You must submit text as well as your image in your response. You can't submit a response that doesn't contain text.
