@@ -17,7 +17,9 @@ toward a student's grade. If you want the problems to count toward the
student's grade, change the assignment type of the subsection that contains the
problems.
This section covers the basics of Problem components--what they look like to you and your students, and the options that every problem component has. For more information about individual problem types, see :ref:`Create Exercises`.
This section covers the basics of Problem components: what they look like to
you and your students, and the options that every problem component has. For
more information about individual problem types, see :ref:`Create Exercises`.
For more information, see the following topics.
...
...
@@ -29,7 +31,6 @@ For more information, see the following topics.
* :ref:`Multiple Problems in One Component`
* :ref:`Problem Randomization`
.. _Problem Student View:
************************************
...
...
@@ -39,7 +40,8 @@ The Student View of a Problem
All problems on the edX platform have several component parts.
.. image:: ../Images/AnatomyOfExercise1.png
:alt: Image of a problem from a student's point of view, with callouts for elements of the problem
:alt: Image of a problem from a student's point of view, with callouts for
elements of the problem
#. **Problem text.** The problem text can contain any standard HTML formatting.
...
...
@@ -69,7 +71,8 @@ All problems on the edX platform have several component parts.
allow unlimited attempts.
.. image:: ../Images//AnatomyOfExercise2.png
:alt: Image of a problem from a student's point of view, with callouts for attempts and showing the answer
:alt: Image of a problem from a student's point of view, with callouts for
attempts and showing the answer
#. **Feedback.** After a student clicks **Check**, all problems return a
green check mark or a red X.
...
...
@@ -109,12 +112,18 @@ All problems on the edX platform have several component parts.
There are also some attributes of problems that are not immediately
visible. You can set these attributes in Studio.
- **Randomization.** For some problems, the instructor can specify
* **Randomization.** For some problems, the instructor can specify
whether a problem will use randomly generated numbers that vary from
student to student.
- **Weight.** Different problems in a particular problem set may be
* **Weight.** Different problems in a particular problem set may be
given different weights.
- **Label.** To improve accessibility for students who have disabilities, each problem needs a descriptive label. The label typically contains part or all of the text of the question in the problem. Most templates include a space for a label. You can find example labels in the documentation for each problem or tool type.
* **Label.** To improve accessibility for students who have disabilities, each
problem needs a descriptive label. The label typically contains part or all
of the text of the question in the problem. Most templates include a space
for a label. You can find example labels in the documentation for each
problem or tool type.
.. _Problem Studio View:
...
...
@@ -122,14 +131,19 @@ visible. You can set these attributes in Studio.
The Studio View of a Problem
************************************
All problems are written in XML. However, Studio offers two interfaces for editing problem components: the Simple Editor and the Advanced Editor.
All problems are written in XML. However, Studio offers two interfaces for
editing problem components: the Simple Editor and the Advanced Editor.
- The **Simple Editor** allows you to edit problems visually, without
* The **Simple Editor** allows you to edit problems visually, without
having to work with XML.
- The **Advanced Editor** converts the problem to edX’s XML standard
and allows you to edit that XML directly.
You can switch at any time from the Simple Editor to the Advanced Editor by clicking **Advanced Editor** in the top right corner of the Simple Editor interface. However, it is not possible to switch from the Advanced Editor to the Simple Editor.
* The **Advanced Editor** converts the problem to edX’s XML standard and
allows you to edit that XML directly.
You can switch at any time from the Simple Editor to the Advanced Editor by
clicking **Advanced Editor** in the top right corner of the Simple Editor
interface. However, it is not possible to switch from the Advanced Editor to
the Simple Editor.
.. _Simple Editor:
...
...
@@ -137,14 +151,17 @@ You can switch at any time from the Simple Editor to the Advanced Editor by clic
The Simple Editor
=================
Several problem templates, including multiple choice and text input problem templates, open in the Simple Editor. The following image shows a multiple choice problem in the Simple Editor.
Several problem templates, including multiple choice and text input problem
templates, open in the Simple Editor. The following image shows a multiple
The following problem templates open in the Advanced Editor.
- :ref:`Circuit Schematic Builder` In circuit schematic problems, students
create and modify circuits on an interactive grid and submit
computer-generated analyses of the circuits for grading.
- :ref:`Custom JavaScript` With custom JavaScript display
and grading problems, you can incorporate problem types that you've created
in HTML into Studio via an IFrame.
- :ref:`Drag and Drop` Drag and drop problems require students to drag text
or objects to a specific location on an image.
- :ref:`Image Mapped Input` Image mapped input problems require students to
* :ref:`Circuit Schematic Builder` In circuit schematic problems, students
create and modify circuits on an interactive grid and submit computer-
generated analyses of the circuits for grading.
* :ref:`Custom JavaScript` With custom JavaScript display and grading problems,
you can incorporate problem types that you've created in HTML into Studio via
an IFrame.
* :ref:`Drag and Drop` Drag and drop problems require students to drag text or
objects to a specific location on an image.
* :ref:`Image Mapped Input` Image mapped input problems require students to
click a specific location on an image.
- :ref:`Math Expression Input` Math expression input problems require
students to enter a mathematical expression as text, such as
e=m\*c^2.
- :ref:`Problem with Adaptive Hint` These problems can give students
feedback or hints based on their responses. Problems with adaptive
hints can be text input or multiple choice problems.
- :ref:`Problem Written in LaTeX` This problem type allows you to convert problems that you’ve already written in LaTeX into the edX format. Note that this problem type is still a prototype, however, and may not be supported in the future.
- :ref:`Write Your Own Grader` Custom Python-evaluated input (also called "write-your-own-grader" problems evaluate students' responses using an embedded Python script that you create. These problems can be any type.
* :ref:`Math Expression Input` Math expression input problems require students
to enter a mathematical expression as text, such as e=m\*c^2.
* :ref:`Problem with Adaptive Hint` These problems can give students feedback
or hints based on their responses. Problems with adaptive hints can be text
input or multiple choice problems.
* :ref:`Problem Written in LaTeX` This problem type allows you to convert
problems that you’ve already written in LaTeX into the edX format. Note that
this problem type is still a prototype, however, and may not be supported in
the future.
* :ref:`Write Your Own Grader` Custom Python-evaluated input (also called
"write-your-own-grader" problems evaluate students' responses using an
embedded Python script that you create. These problems can be any type.
.. _Problem Settings:
...
...
@@ -213,13 +246,15 @@ The following problem templates open in the Advanced Editor.
Problem Settings
******************
In addition to the text of the problem, problems that you create using a Problem component have the following settings. These settings appear on the **Settings** tab in the component editor.
In addition to the text of the problem, problems that you create using a
Problem component have the following settings. These settings appear on the
**Settings** tab in the component editor.
- **Display Name**
- **Maximum Attempts**
- **Problem Weight**
- **Randomization**
- **Show Answer**
* **Display Name**
* **Maximum Attempts**
* **Problem Weight**
* **Randomization**
* **Show Answer**
.. image:: ../Images/ProbComponent_Attributes.png
:alt: Image of the Settings tab in a Problem component
...
...
@@ -242,7 +277,9 @@ Maximum Attempts
This setting specifies the number of times a student can try to answer
the problem. By default, a student has an unlimited number of attempts.
.. note:: Only questions that have a **Maximum Attempts** setting of 1 or higher are included on the Student Answer Distribution report that you can download during your course.
.. note:: Only questions that have a **Maximum Attempts** setting of 1 or
higher are included on the Student Answer Distribution report that you can
download during your course.
.. _Problem Weight:
...
...
@@ -258,7 +295,8 @@ This setting specifies the maximum number of points possible for the
problem. The problem weight appears next to the problem title.
.. image:: ../Images/ProblemWeight_DD.png
:alt: Image of a problem from a student's point of view, with the possible points circled
:alt: Image of a problem from a student's point of view, with the possible
points circled
By default, each response field, or “answer space,” in a Problem
component is worth one point. Any Problem component can have multiple
- **Score** is the point score that the student receives.
- **Weight** is the problem’s maximum possible point score.
- **Correct answers** is the number of response fields that contain
correct answers.
- **Response fields** is the total number of response fields in the
problem.
* **Score** is the point score that the student receives.
* **Weight** is the problem’s maximum possible point score.
* **Correct answers** is the number of response fields that contain correct
answers.
* **Response fields** is the total number of response fields in the problem.
**Examples**
...
...
@@ -319,22 +359,31 @@ answers, the student’s score is 0.5 out of 2 points.
Randomization
===============
This setting specifies whether certain values in your problem change each time a different student accesses the problem, or each time a single student tries to answer the problem. For example, the highlighted values in the problem below change each time a student submits an answer to the problem.
This setting specifies whether certain values in your problem change each time
a different student accesses the problem, or each time a single student tries
to answer the problem. For example, the highlighted values in the problem below
change each time a student submits an answer to the problem.
.. image:: ../Images/Rerandomize.png
:alt: The same problem shown twice, with color highlighting on values that
can change
If you want to change, or "randomize," specific values in your problem, you have to do both the following:
If you want to change, or "randomize," specific values in your problem, you
have to do both the following:
- Make sure that your problem contains a Python script that randomizes the values that you want.
- Enable randomization in the Problem component.
* Make sure that your problem contains a Python script that randomizes the
values that you want.
.. note:: Note that specifying this **Randomization** setting is different from *problem randomization*. The **Randomization** setting randomizes variables within a single problem. Problem randomization offers different problems or problem versions to different students. For more information, see :ref:`Problem Randomization`.
* Enable randomization in the Problem component.
To enable randomization, select an option for the **Randomization** setting. This setting has four options.
.. note:: Note that specifying this **Randomization** setting is different
from *problem randomization*. The **Randomization** setting randomizes
variables within a single problem. Problem randomization offers different
problems or problem versions to different students. For more information, see
:ref:`Problem Randomization`.
To enable randomization, select an option for the **Randomization** setting.
| **Always** | Students see a different version of |
...
...
@@ -404,19 +453,22 @@ This setting has the following options.
Modifying a Released Problem
*********************************
.. warning:: Be careful when you modify problems after they have been released!
.. warning:: Be careful when you modify problems after they have been
released! Changes that you make to published problems can affect the student
experience in the course and analysis of course data.
After a student submits a response to a problem, Studio stores the
student’s response, the score that the student received, and the maximum
score for the problem. Studio updates these values when a student
submits a new response to a problem. However, if an instructor changes a
problem or its attributes, Studio does not automatically update existing
student information for that problem.
After a student submits a response to a problem, the edX Learning Management
System (LMS) stores the student’s response, the score that the student
received, and the maximum score for the problem. For problems with a **Maximum
Attempts** setting greater than 1, the LMS updates these values each time the
student submits a new response to a problem. However, if an instructor changes
a problem or its attributes, existing student information for that problem is
not automatically updated.
For example, you may release a problem and specify that its answer is 3.
After some students have submitted responses, you notice that the answer
should be 2 instead of 3. When you update the problem with the correct
answer, Studio doesn’t update scores for students who answered 2 for the
answer, the LMS doesn’t update scores for students who answered 2 for the
original problem and thus received the wrong score.
For another example, you may change the number of response fields to
...
...
@@ -425,22 +477,30 @@ three. Students who submitted answers before the change have a score of
after the change have scores of 0, 1, 2, or 3 out of 3.0 for the same
problem.
If you change the weight of the problem, however, the existing scores
update when you refresh the **Progress** page.
If you change the weight setting for the problem in Studio, however, existing
student scores update when the student's **Progress** page is refreshed. In a
live section, students will see the effect of these changes.
===============
Workarounds
===============
If you have to modify a released problem in a way that affects grading,
you have two options. Note that both options require you to ask your
students to go back and resubmit a problem.
If you have to modify a released problem in a way that affects grading, you
have two options within Studio to assure that every student has the opportunity
to submit a new response and be regraded. Note that both options require you to
ask your students to go back and resubmit answers to a problem.
- In the Problem component, increase the number of attempts for the
problem. Then ask all your students to redo the problem.
- Delete the entire Problem component in Studio and create a new
Problem component with the content and settings that you want. Then
ask all your students to complete the new problem.
* In the Problem component that you changed, increase the number of attempts
for the problem. Then ask all your students to redo the problem.
* Delete the entire Problem component in Studio and create a new Problem
component with the content and settings that you want. (If the revisions you
must make are minor, duplicate the Problem component before you delete it
and revise the copy.) Then ask all your students to complete the new
problem.
For information about how to review and adjust student grades in the LMS, see
:ref:`Grades`.
.. _Additional Work with Problems:
...
...
@@ -448,7 +508,9 @@ students to go back and resubmit a problem.
Additional Work with Problems
************************************
You have some further options when you work with problems. You can include more than one problem in a single problem component, or you can set up a problem that presents different versions to different students.
You have some further options when you work with problems. You can include more
than one problem in a single problem component, or you can set up a problem
that presents different versions to different students.
.. _Multiple Problems in One Component:
...
...
@@ -456,28 +518,27 @@ You have some further options when you work with problems. You can include more
Multiple Problems in One Component
====================================
You may want to create a problem that has more than one response type.
For example, you may want to create a numerical input problem, and then
include a multiple choice question about the numerical input problem.
Or, you may want a student to be able to check the answers to
many problems at one time. To do this, you can include multiple problems
inside a single Problem component. The problems can be different types.
To create multiple problems in one component, create a new Blank
Advanced Problem component, and then add the XML for each problem in
the component editor. You only need to include the XML for the problem
and its answers. You don’t have to include the code for other elements,
such as the **Check** button.
Elements such as the **Check**, **Show Answer**, and **Reset** buttons,
as well as the settings that you select for the Problem component, apply
to all of the problems in that component. Thus, if you set the maximum
number of attempts to 3, the student has three attempts to answer
the entire set of problems in the component as a whole rather than three
attempts to answer each problem individually. If a student clicks
**Check**, the LMS scores all of the problems in the component at once.
If a student clicks **Show Answer**, the answers for all the problems in
the component appear.
You may want to create a problem that has more than one response type. For
example, you may want to create a numerical input problem, and then include a
multiple choice question about the numerical input problem. Or, you may want a
student to be able to check the answers to many problems at one time. To do
this, you can include multiple problems inside a single Problem component. The
problems can be different types.
To create multiple problems in one component, create a new Blank Advanced
Problem component, and then add the XML for each problem in the component
editor. You only need to include the XML for the problem and its answers. You
don’t have to include the code for other elements, such as the **Check**
button.
Elements such as the **Check**, **Show Answer**, and **Reset** buttons, as well
as the settings that you select for the Problem component, apply to all of the
problems in that component. Thus, if you set the maximum number of attempts to
3, the student has three attempts to answer the entire set of problems in the
component as a whole rather than three attempts to answer each problem
individually. If a student clicks **Check**, the LMS scores all of the problems
in the component at once. If a student clicks **Show Answer**, the answers for
all the problems in the component appear.
.. _Problem Randomization:
...
...
@@ -485,16 +546,30 @@ the component appear.
Problem Randomization
===========================
You may want to present different students with different problems, or different versions of the same problem. To do this, you'll create a Problem component for each problem or version in Studio, and then edit your course outside of Studio to randomize the problem that students see.
You may want to present different students with different problems, or
different versions of the same problem. To do this, you'll create a Problem
component for each problem or version in Studio, and then edit your course
outside of Studio to randomize the problem that students see.
Note that *problem randomization* is different from the **Randomization** setting in Studio. The **Randomization** setting randomizes variables within a single problem. Problem randomization offers different problems or problem versions to different students.
Note that *problem randomization* is different from the **Randomization**
setting in Studio. The **Randomization** setting randomizes variables within a
single problem. Problem randomization offers different problems or problem
versions to different students.
.. note:: Creating problems with versions that can be randomized requires you to export your course, edit some of your course's XML files in a text editor, and then re-import your course. We recommend that you create a backup copy of your course before you do this. We also recommend that you only edit your course files in the text editor if you're very familiar with editing XML.
.. note:: Creating problems with versions that can be randomized requires you
to export your course, edit some of your course's XML files in a text editor,
and then re-import your course. We recommend that you create a backup copy of
your course before you do this. We also recommend that you only edit your
course files in the text editor if you're very familiar with editing XML.
Terminology
************
Sections, subsections, units, and components have different names in the **Course Outline** view and in the list of files that you'll see after you export your course and open the .xml files for editing. The following table lists the names of these elements in the **Course Outline** view and in a list of files.
Sections, subsections, units, and components have different names in the
**Course Outline** view and in the list of files that you'll see after you
export your course and open the .xml files for editing. The following table
lists the names of these elements in the **Course Outline** view and in a list
of files.
.. list-table::
:widths: 15 15
...
...
@@ -511,30 +586,57 @@ Sections, subsections, units, and components have different names in the **Cours
* - Component
- Discussion, HTML, problem, or video
For example, when you want to find a specific section in your course, you'll look in the **Chapter** folder when you open the list of files that your course contains. To find a unit, you'll look in the **Vertical** folder.
For example, when you want to find a specific section in your course, you'll
look in the **Chapter** folder when you open the list of files that your course
contains. To find a unit, you'll look in the **Vertical** folder.
.. _Create Randomized Problems:
Create Randomized Problems
****************************
#. In the unit where you want to create a randomized problem, create a separate Problem component for each version or problem that you want to randomize. For example, if you want to offer four versions or problems, you'll create four separate Problem components. Make a note of the 32-digit unit ID that appears in the **Unit Identifier** field under **Unit Location**.
#. Export your course. For information about how to do this, see :ref:`Exporting and Importing a Course`. Save the .tar.gz file that contains your course in a memorable location so that you can find it easily.
#. Locate the .tar.gz file that contains your course, and then unpack the .tar.gz file so that you can see its contents in a list of folders and files.
- To do this on a Windows computer, you'll need to download a third-party program. For more information, see `How to Unpack a tar File in Windows <http://www.haskell.org/haskellwiki/How_to_unpack_a_tar_file_in_Windows>`_, `How to Extract a Gz File <http://www.wikihow.com/Extract-a-Gz-File>`_, `The gzip Home Page <http://www.gzip.org/>`_, or the `Windows <http://www.ofzenandcomputing.com/how-to-open-tar-gz-files/#windows>`_ section of the `How to Open .tar.gz Files <http://www.ofzenandcomputing.com/how-to-open-tar-gz-files/>`_ page.
- For information about how to do this on a Mac, see the `Mac OS X <http://www.ofzenandcomputing.com/how-to-open-tar-gz-files/#mac-os-x>`_ section of the `How to Open .tar.gz Files <http://www.ofzenandcomputing.com/how-to-open-tar-gz-files/>`_ page.
#. In the unit where you want to create a randomized problem, create a separate
Problem component for each version or problem that you want to randomize.
For example, if you want to offer four versions or problems, you'll create
four separate Problem components. Make a note of the 32-digit unit ID that
appears in the **Unit Identifier** field under **Unit Location**.
#. Export your course. For information about how to do this, see
:ref:`Exporting and Importing a Course`. Save the .tar.gz file that contains
your course in a memorable location so that you can find it easily.
#. Locate the .tar.gz file that contains your course, and then unpack the
.tar.gz file so that you can see its contents in a list of folders and
files.
To do this on a Windows computer, you'll need to download a third-party
program. For more information, see `How to Unpack a tar File in Windows
section of the `How to Open .tar.gz Files <http://www.ofzenandcomputing.com
/how-to-open-tar-gz-files/>`_ page.
#. In the list of folders and files, open the **Vertical** folder.
.. note:: If your unit is not published, open the **Drafts** folder, and then open the **Vertical** folder in the **Drafts** folder.
.. note:: If your unit is not published, open the **Drafts** folder, and
then open the **Vertical** folder in the **Drafts** folder.
#. In the **Vertical** folder, locate the .xml file that has the same name as the unit ID that you noted in step 1, and then open the file in a text editor such as Sublime 2. For example, if the unit ID is e461de7fe2b84ebeabe1a97683360d31, you'll open the e461de7fe2b84ebeabe1a97683360d31.xml file.
#. In the **Vertical** folder, locate the .xml file that has the same name as
the unit ID that you noted in step 1, and then open the file in a text
editor such as Sublime 2. For example, if the unit ID is
e461de7fe2b84ebeabe1a97683360d31, you'll open the
e461de7fe2b84ebeabe1a97683360d31.xml file.
The file contains a list of all the components in the unit, together with the URL names of the components. For example, the following file contains four Problem components.
The file contains a list of all the components in the unit, together with
the URL names of the components. For example, the following file contains
#. Add ``<randomize> </randomize>`` tags around the components for the problems that you want to randomize.
#. Add ``<randomize> </randomize>`` tags around the components for the problems
that you want to randomize.
.. code-block:: xml
...
...
@@ -558,18 +661,28 @@ Create Randomized Problems
</randomize>
</vertical>
#. After you add the ``<randomize> </randomize>`` tags, save and close the .xml file.
#. After you add the ``<randomize> </randomize>`` tags, save and close the .xml
file.
#. Re-package your course as a .tar.gz file.
* For information about how to do this on a Mac, see `How to Create a Tar GZip File from the Command Line <http://osxdaily.com/2012/04/05/create-tar-gzip/>`_.
For information about how to do this on a Mac, see `How to Create a Tar GZip
File from the Command Line <http://osxdaily.com/2012/04/05/create- tar-
gzip/>`_.
* For information about how to do this on a Windows computer, see `How to Make a .tar.gz on Windows <http://stackoverflow.com/questions/12774707/how-to-make-a-tar-gz-on-windows>`_.
For information about how to do this on a Windows computer, see `How to Make
a .tar.gz on Windows <http://stackoverflow.com/questions/12774707 /how-to-
make-a-tar-gz-on-windows>`_.
#. In Studio, re-import your course.
.. note::
* Once you've implemented randomization, you can only see one of the versions or problems in Studio. You can edit that single problem directly in Studio, but to edit any of the other problems, you'll have to export your course, edit the problems in a text editor, and then re-import the course. This is true for instructors as well as course teams.
* Once you've implemented randomization, you can only see one of the versions
or problems in Studio. You can edit that single problem directly in Studio,
but to edit any of the other problems, you'll have to export your course,
edit the problems in a text editor, and then re-import the course. This is
true for instructors as well as course teams.
* A .csv file for student responses contains the responses to each of the problems in the problem bank.
* A .csv file for student responses contains the responses to each of the
@@ -20,13 +20,14 @@ changes you can make, see the following topics:
* :ref:`Adjust_grades`
To review student answers to the problems in your course, you can check the answer submitted by a specified student for a selected problem, download course-wide answer data, or review a graph of all answer data for a selected problem. See :ref:`Review_Answers`.
To review student answers to the problems in your course, you can check the
answer submitted by a specified student for a selected problem, download
course-wide answer data, or review a graph of all answer data for a selected
problem. See :ref:`Review_Answers`.
.. all answer-related info moved into new course_answers.rst
For information about how you establish a grading policy and work with the Problem components in your course, see :ref:`Establish a Grading Policy` or :ref:`Working with Problem Components`.
.. important:: If you make changes to your grading policy after a course starts, students can see the effect of your changes on their **Progress** pages. Be sure to announce any changes on your **Course Info** page.
For information about how you establish a grading policy and work with the
Problem components in your course, see :ref:`Establish a Grading Policy` or
:ref:`Working with Problem Components`.
.. _Review_grades:
...
...
@@ -34,26 +35,40 @@ For information about how you establish a grading policy and work with the Probl
You can review the assignment types that are graded and their respective weights on the Instructor Dashboard.
You can review the assignment types that are graded and their respective
weights on the Instructor Dashboard.
You establish a grading policy for your course when you create it in Studio. While the course is running, you can view an XML representation of the assignment types in your course and how they are weighted to determine students' grades.
You establish a grading policy for your course when you create it in Studio.
While the course is running, you can view an XML representation of the
assignment types in your course and how they are weighted to determine
students' grades.
.. DOC-290: research this statement before including anything like it: Below the list of graded assignment types and their weights, each *public* subsection and unit that contains an assignment is listed.
#. View the live version of your course.
#. Click **Instructor**, then click **Data Download** > **Grading Configuration**.
#. Click **Instructor**, then click **Data Download** > **Grading
Configuration**.
A list of the assignment types in your course displays. In this example, Homework is weighted as 0.3 (30%) of the grade.
A list of the assignment types in your course displays. In this example,
Homework is weighted as 0.3 (30%) of the grade.
.. image:: ../Images/Grading_Configuration.png
:alt: XML of course assignment types and weights for grading
In Studio, you define this information by selecting **Settings** > **Grading**. For more information, see :ref:`Configure the Assignment Types`.
In Studio, you define this information by selecting **Settings** >
**Grading**. For more information, see :ref:`Configure the Assignment
@@ -72,8 +87,8 @@ file when the grading process is complete.
For courses with fewer than 200 students enrolled, you also have the option to
review student grades on the Instructor Dashboard. See :ref:`gradebook`.
To generate the grade report for the students who are currently enrolled in your
course:
To generate the grade report for the students who are currently enrolled in
your course:
#. View the live version of your course.
...
...
@@ -85,16 +100,23 @@ course:
process can take some time to complete, but you can navigate away from this
page and do other work while it runs.
4. To track the progress of the grading process, reload the page in your browser
and scroll down to the **Pending Instructor Tasks** section.
4. To track the progress of the grading process, reload the page in your
browser and scroll down to the **Pending Instructor Tasks** section.
==========================================
Download Grades for Enrolled Students
==========================================
After you request a grade report for your students, the result is a time-stamped CSV file that includes columns to identify each student: id, email, and username. It also includes a column for every assignment that is included in your grading configuration: each homework, lab, midterm, final, and any other assignment type you added to your course.
After you request a grade report for your students, the result is a time-
stamped CSV file that includes columns to identify each student: id, email, and
username. It also includes a column for every assignment that is included in
your grading configuration: each homework, lab, midterm, final, and any other
assignment type you added to your course.
.. important:: Because this file contains confidential, personally identifiable data which may be subject to the Family Educational Rights and Privacy Act (FERPA), be sure to follow your institution's data stewardship policies when you open or save this file.
.. important:: Because this file contains confidential, personally
identifiable data which may be subject to the Family Educational Rights and
Privacy Act (FERPA), be sure to follow your institution's data stewardship
policies when you open or save this file.
To download a file of student grades:
...
...
@@ -102,9 +124,14 @@ To download a file of student grades:
#. Click **Instructor**, then click **Data Download**.
#. To open or save a grade report file, click the ``{course_id}_grade_report_{date}.csv`` file name at the bottom of the page.
#. To open or save a grade report file, click the
``{course_id}_grade_report_{date}.csv`` file name at the bottom of the page.
.. note:: To prevent the accidental distribution of student data, you can only download these files by clicking the links on this page. Do not copy these links for reuse elsewhere, as they expire within 5 minutes. The links on this page also expire if the page is open for more than 5 minutes: if necessary, refresh the page to generate new links.
.. note:: To prevent the accidental distribution of student data, you can only
download these files by clicking the links on this page. Do not copy these
links for reuse elsewhere, as they expire within 5 minutes. The links on this
page also expire if the page is open for more than 5 minutes: if necessary,
refresh the page to generate new links.
.. _Interpret the Grade Report:
...
...
@@ -112,24 +139,36 @@ To download a file of student grades:
Interpret the Grade Report
=====================================
Grade reports provide a snapshot of cumulative course scores, by assignment, of every currently enrolled student.
Grade reports provide a snapshot of cumulative course scores, by assignment, of
every currently enrolled student.
You can open ``{course_id}_grade_report_{date}.csv`` files in a spreadsheet application to sort, graph, and compare data.
You can open ``{course_id}_grade_report_{date}.csv`` files in a spreadsheet
application to sort, graph, and compare data.
.. image:: ../Images/Grade_Report.png
:alt: A course grade report, opened in Excel, showing the grades acheived by students on several homework assignments and the midterm
:alt: A course grade report, opened in Excel, showing the grades acheived by
students on several homework assignments and the midterm
The CSV file contains one row of data for each student, and columns that provide the following information.
The CSV file contains one row of data for each student, and columns that
provide the following information.
* Student identifiers, including an internal **id**, **email** address, and **username**.
* Student identifiers, including an internal **id**, **email** address, and
**username**.
* The overall **grade**, with the total score a student has currently attained in the course. This value is expressed as a decimal: a student with a grade of 0.65 has earned 65% of the credit in the course, and a student with a grade of 1 has earned 100%.
* The overall **grade**, with the total score a student has currently attained
in the course. This value is expressed as a decimal: a student with a grade
of 0.65 has earned 65% of the credit in the course, and a student with a
grade of 1 has earned 100%.
* Each **{assignment type} {number}** defined in your grading configuration, with the score a student attained for that specific assignment. For example, column HW 03 shows the scores for the third homework assignment.
* Each **{assignment type} {number}** defined in your grading configuration,
with the score a student attained for that specific assignment. For example,
column HW 03 shows the scores for the third homework assignment.
* An **{assignment type} Avg** with each student's current average score for that assignment type: for example, HW Avg.
* An **{assignment type} Avg** with each student's current average score for
that assignment type: for example, HW Avg.
.. note:: The grade reports do not include information about individual questions within the assignments, or include student answer distributions.
.. note:: The grade reports do not include information about individual
questions within the assignments, or include student answer distributions.
.. _gradebook:
...
...
@@ -158,8 +197,8 @@ The gradebook includes the following features.
**Course Progress** page. See :ref:`check_student_progress`.
* There is a column for each **{assignment type} {number}** defined in your
grading configuration, with the scores your student attained for that specific
assignment.
grading configuration, with the scores your student attained for that
specific assignment.
The gradebook does not have a scroll bar, but it is draggable: to see columns
that are hidden at one side of the grade book, click the gradebook and then
...
...
@@ -169,10 +208,10 @@ The gradebook includes the following features.
type} Avg** column displays each student's current average score for that
assignment type.
* The **Total** column presents the total score a student has currently attained
in the course. This value is expressed as a whole number: a student with a
grade of 65 has earned 65% of the credit in the course, and a student with a
grade of 100 has earned 100%.
* The **Total** column presents the total score a student has currently
attained in the course. This value is expressed as a whole number: a student
with a grade of 65 has earned 65% of the credit in the course, and a student
with a grade of 100 has earned 100%.
* To filter the data that displays you can use the **Search students** option.
This option is case-sensitive and limits the rows shown in the gradebook to
...
...
@@ -184,11 +223,18 @@ The gradebook includes the following features.
Check the Progress of a Single Student
****************************************
To check a single student's progress, you can locate the specific row on the grade report or review the student's **Progress** page. The **Progress** page includes a chart that plots the score the student has earned for every graded assignment and the total grade as of the current date. Below the chart, each assignment and the score attained are listed.
To check a single student's progress, you can locate the specific row on the
grade report or review the student's **Progress** page. The **Progress** page
includes a chart that plots the score the student has earned for every graded
assignment and the total grade as of the current date. Below the chart, each
assignment and the score attained are listed.
To review a student's **Progress** page, you supply an email address or username. You can check the progress for students who are either enrolled in, or who have unenrolled from, the course.
To review a student's **Progress** page, you supply an email address or
username. You can check the progress for students who are either enrolled in,
or who have unenrolled from, the course.
Students can view a similar chart and assignment list (of their own progress only) when they are logged in to the course. See :ref:`A Students View`.
Students can view a similar chart and assignment list (of their own progress
only) when they are logged in to the course. See :ref:`A Students View`.
To view the **Progress** page for a student:
...
...
@@ -196,58 +242,84 @@ To view the **Progress** page for a student:
#. Click **Instructor**, then click **Student Admin**.
#. In the Student-Specific Grade Inspection section, enter the student's email address or username.
#. In the Student-Specific Grade Inspection section, enter the student's email
address or username.
#. Click **Student Progress Page**.
The **Progress** page for the student displays a chart with the grade for each homework, lab, midterm, final, and any other assignment types in your course, and the total grade earned for the course to date.
The **Progress** page for the student displays a chart with the grade for
each homework, lab, midterm, final, and any other assignment types in your
course, and the total grade earned for the course to date.
.. image:: ../Images/Student_Progress.png
:alt: Progress page chart for a student: includes a column graph with the score acheived for each assignment
:alt: Progress page chart for a student: includes a column graph with the
score acheived for each assignment
To learn more about a particular assignment, move the cursor onto the value in the chart. A brief description displays.
To learn more about a particular assignment, move the cursor onto the value
:alt: Progress page with a tooltip for the X that was graphed for the last homework assignment, which indicates that the lowest homework score is dropped
:alt: Progress page with a tooltip for the X that was graphed for the last
homework assignment, which indicates that the lowest homework score
is dropped
Below the chart, subsections are listed on the left and the units that contain assignments are listed on the right. The student's individual problem scores display.
Below the chart, subsections are listed on the left and the units that
contain assignments are listed on the right. The student's individual
problem scores display.
.. image:: ../Images/Student_Progress_list.png
:alt: Bottom portion of a Progress page for the same student with the score acheived for each problem in the first course subsection
:alt: Bottom portion of a Progress page for the same student with the
score acheived for each problem in the first course subsection
=============================================
Interpret the Student Progress Page
=============================================
The chart of a student's scores on the **Progress** page and the rows of data on the grade report present assignment scores in a similar order. However, the total, cumulative score earned for the course is placed in a different position on the **Progress** page.
The chart of a student's scores on the **Progress** page and the rows of data
on the grade report present assignment scores in a similar order. However, the
total, cumulative score earned for the course is placed in a different position
on the **Progress** page.
In this example grade report, the indicated student has a current grade of 0.43 (43%).
In this example grade report, the indicated student has a current grade of 0.43
(43%).
.. image:: ../Images/Grade_Report_example.png
:alt: A course grade report with a single student's information indicated by a rectangle
:alt: A course grade report with a single student's information indicated by
a rectangle
* On each of the first four homework assignments the student scored 1 (100%), but currently has a 0 (0%) on each of the remaining three assignments.
* On each of the first four homework assignments the student scored 1 (100%),
but currently has a 0 (0%) on each of the remaining three assignments.
Notice, however, that the student's current average score for homework assignments is listed as 0.666666667 (67%): in this course, the homework assignment with the lowest score is dropped, so this average is over six assignments rather than all seven.
Notice, however, that the student's current average score for homework
assignments is listed as 0.666666667 (67%): in this course, the homework
assignment with the lowest score is dropped, so this average is over six
assignments rather than all seven.
* The student has a score of 0.75 (75%) on the midterm, and a score of 0 (0%) on the final.
* The student has a score of 0.75 (75%) on the midterm, and a score of 0 (0%)
on the final.
On the student's **Progress** page, you see the same information graphically represented; however, the student's "total" of 43% is on the far right.
On the student's **Progress** page, you see the same information graphically
represented; however, the student's "total" of 43% is on the far right.
.. image:: ../Images/Student_Progress.png
:alt: Progress page for a student also included on the grade report: includes a column graph with the grade acheived for each assignment
:alt: Progress page for a student also included on the grade report: includes
a column graph with the grade acheived for each assignment
The chart on the **Progress** page includes y-axis labels for the grade ranges defined for the course. In this example, Pass is set to 60%, so at the end of the course students with a grade of 0.60 or higher can receive certificates.
The chart on the **Progress** page includes y-axis labels for the grade ranges
defined for the course. In this example, Pass is set to 60%, so at the end of
the course students with a grade of 0.60 or higher can receive certificates.
.. note:: Student scores on the **Progress** page are a snapshot of the current state of the problem score database. They can, at times, be out of sync with actual problem scores. For example, asynchronicities can occur if the weight of a live problem was changed during an assignment, and not all students have resubmitted their answers for that problem.
.. note above moved from checking_student_progress.rst
.. note:: Student scores on the **Progress** page are a snapshot of the
current state of the problem score database. They can, at times, be out of
sync with actual problem scores. For example, asynchronicities can occur if
the weight of a live problem was changed during an assignment, and not all
students have resubmitted their answers for that problem.
.. _A Students View:
=============================================
A Student's View of Course Progress
=============================================
.. this section moved from checking_student_progress.rst
Students can check their progress by clicking **Progress** in the course
navigation bar. The student's progress through the graded part of the course
...
...
@@ -257,20 +329,20 @@ earned in the course so far, and percent needed for each grade cutoff. Here is
an example of a student's progress through edX101.
.. image:: ../Images/StudentView_GradeCutoffs.png
:width: 800
:alt: Image of a student's Course Progress page with the grade cutoffs legend highlighted
:alt: Image of a student's Course Progress page with the grade cutoffs legend
highlighted
The student can see from this page that edX101 was graded as a Pass/Fail course
with a cutoff of 34% and that the grading rubric contained one assignment type,
called Learning Sequence, consisting of 11 assignments total. Furthermore, this
particular student has only submitted correct responses to two assignments, and
that her current total percent grade in the course is 6%. By hovering over each
progress bar, the student can get further statistics of how much each assignment
was counted as.
progress bar, the student can get further statistics of how much each
assignment was counted as.
Further down on the **Progress** page is a list of all the subsections in the
course, with the scores recorded for the student for all problems in the course.
Here is the **Progress** page for the student in the example above:
course, with the scores recorded for the student for all problems in the
course. Here is the **Progress** page for the student in the example above:
.. image:: ../Images/StudentView_Problems.png
:width: 800
...
...
@@ -285,29 +357,31 @@ while point scores from ungraded sections are called "Practice Scores".
Adjust Grades
***********************************
You can adjust grades for one student at a time, or for all of the enrolled
students in the course. For example, your course beta testers can evaluate
numerous different correct and incorrect responses to verify that your course is
set up as you intend. Students can also report errors while a course is running.
When an error is discovered or corrected, or if you decide that you must modify
a problem after students or beta testers have attempted to answer it, you can
either:
If you modify a problem or its settings after students have attempted to answer
it, student grades can be affected. For information about making changes to
problems in Studio, see :ref:`Modifying a Released Problem`.
* Rescore the submitted answers to reevaluate the work. See :ref:`rescore`.
To recalculate the grades of affected students when a correction or other
change is unavoidable, you can make the following adjustments.
* Rescore the submitted answer to reevaluate student work on the problem. You
can rescore a problem for a single student or for all of the students
enrolled in the course. See :ref:`rescore`.
* Reset the number of times a student has attempted to answer the problem to
zero so that the student can try again. See :ref:`reset_attempts`.
zero so that the student can try again. You can reset the number of attempts
for a single student or for all of the students enrolled in the course. See
:ref:`reset_attempts`.
You can make these adjustments for a single student or for all of the students
enrolled in your course. To make an adjustment, you need the unique location
identifier of the problem. See :ref:`find_URL`.
* Delete a student's database history, or "state", completely for the problem.
You can only delete student state for one student at a time. For example, you
realize that a problem needs to be rewritten after only a few of your
students have answered it. To resolve this situation, you rewrite the problem
and then delete student state for the affected students only so that they can
try again. See :ref:`delete_state`.
Another grade adjustment technique is to delete a student's database history, or
"state", completely for a problem. You can only delete student state for
one student at a time. For example, you realize that a problem needs to be
rewritten after only a few of your students have answered it. To resolve this
situation, you rewrite the problem and then delete student state for the
affected students only so that they can try again. See :ref:`delete_state`.
To make adjustments to student grades, you need the unique location identifier
of the modified problem. See :ref:`find_URL`.
.. _find_URL:
...
...
@@ -315,9 +389,9 @@ affected students only so that they can try again. See :ref:`delete_state`.
When you create each of the problems for a course, edX assigns a unique location
to it. To make grading adjustments for a problem, or to view data about it, you
need to specify the problem location.
When you create each of the problems for a course, edX assigns a unique
location to it. To make grading adjustments for a problem, or to view data
about it, you need to specify the problem location.
To find the unique location identifier for a problem:
...
...
@@ -330,12 +404,14 @@ To find the unique location identifier for a problem:
Information about the problem displays, including its **location**.
.. image:: ../Images/Problem_URL.png
:alt: The Staff Debug view of a problem with the location identifier indicated
:alt: The Staff Debug view of a problem with the location identifier
indicated
4. To copy the location of the problem, select the entire location, right click,
and choose **Copy**.
4. To copy the location of the problem, select the entire location, right
click, and choose **Copy**.
To close the Staff Debug viewer, click on the browser page outside of the viewer.
To close the Staff Debug viewer, click on the browser page outside of the
viewer.
.. _rescore:
...
...
@@ -349,7 +425,9 @@ change to these values, you can rescore any responses that were already
submitted. For a specified problem, you can rescore the work submitted by a
single student, or rescore the submissions made by every enrolled student.
.. note:: You can only rescore problems that have a correct answer entered in edX Studio. This procedure cannot be used to rescore problems that are scored by an external grader.
.. note:: You can only rescore problems that have a correct answer entered in
edX Studio. This procedure cannot be used to rescore problems that are scored
by an external grader.
Rescore a Submission for an Individual Student
-----------------------------------------------
...
...
@@ -398,7 +476,11 @@ See :ref:`find_URL`. To rescore a problem:
A table displays the status of the rescore process for each student or problem.
.. note:: You can use a similar procedure to rescore the submission for a problem by a single student. You work in the **Student-Specific Grade Adjustment** section of the page to enter both the student’s email address or username and the unique problem identifier, and then click **Rescore Student Submission**.
.. note:: You can use a similar procedure to rescore the submission for a
problem by a single student. You work in the **Student-Specific Grade
Adjustment** section of the page to enter both the student’s email address or
username and the unique problem identifier, and then click **Rescore Student
Submission**.
.. _reset_attempts:
...
...
@@ -406,9 +488,12 @@ See :ref:`find_URL`. To rescore a problem:
When you create a problem, you can limit the number of times that a student can try to answer that problem correctly. If unexpected issues occur for a problem, you can reset the value for one particular student's attempts back to zero so that the student can begin work over again. If the unexpected behavior affects all of the students in your course, you can reset the number of attempts for all students to zero.
For information about modifying a released problem, including other workarounds, see :ref:`Modifying a Released Problem`.
When you create a problem, you can limit the number of times that a student can
try to answer that problem correctly. If unexpected issues occur for a problem,
you can reset the value for one particular student's attempts back to zero so
that the student can begin work over again. If the unexpected behavior affects
all of the students in your course, you can reset the number of attempts for
all students to zero.
Reset Attempts for an Individual Student
---------------------------------------------
...
...
@@ -446,17 +531,23 @@ attempts for all students:
**Course-Specific Grade Adjustment** section of the page. Enter the unique
problem location, then click **Reset ALL students' attempts**.
#. A dialog opens to indicate that the reset process is in progress. Click **OK**.
#. A dialog opens to indicate that the reset process is in progress. Click
**OK**.
This process can take some time to complete. The process runs in the
background, so you can navigate away from this page and do other work while
it runs.
7. To view the results of the reset process, click either **Show Background Task History for Student** or **Show Background Task History for Problem**.
5. To view the results of the reset process, click either **Show Background
Task History for Student** or **Show Background Task History for Problem**.
A table displays the status of the reset process for each student or problem.
A table displays the status of the reset process for each student or
problem.
.. note:: You can use a similar procedure to reset problem attempts for a single student. You work in the **Student-Specific Grade Adjustment** section of the page to enter both the student’s email address or username and the unique problem identifier, and then click **Reset Student Attempts**.
.. note:: You can use a similar procedure to reset problem attempts for a
single student. You work in the **Student-Specific Grade Adjustment** section
of the page to enter both the student’s email address or username and the
unique problem identifier, and then click **Reset Student Attempts**.
.. _delete_state:
...
...
@@ -467,17 +558,18 @@ Delete Student State for a Problem
To delete a student's entire history for a problem from the database, you need
that student's username or email address.
.. important:: Student state is deleted permanently by this process. This action cannot be undone.
.. important:: Student state is deleted permanently by this process. This
action cannot be undone.
You can use either the Staff Debug viewer or the Instructor Dashboard to delete
student state.
.. future example: this is how to help a student who has gotten poor feedback on an ORA problem.
To use the Staff Debug viewer:
#. View the live version of your course.
#. Click **Courseware** and navigate to the component that contains the problem.
#. Click **Courseware** and navigate to the component that contains the
problem.
#. Display the problem, then click **Staff Debug Info**. The Staff Debug viewer
