Commit b99f991f by spearce

ORA-237: Number in "Available for Grading" column drops rapidly

Added the following under "Grade an Open Response Assessment Problem":

After you've graded enough responses for AI assessments to start, the
number of responses in the Available to grade column decreases rapidly
as the algorithm grades responses and returns them to your students in
just a few seconds. No student data is lost.

Also corrected a few minor formatting problems.
parent 5e718f93
...@@ -160,23 +160,23 @@ Step 1. Create the Component ...@@ -160,23 +160,23 @@ Step 1. Create the Component
Step 2. Add the Question Step 2. Add the Question
~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~
- In the component editor, locate the [prompt] tags. #. In the component editor, locate the [prompt] tags.
.. image:: Images/ORA_Prompt.gif .. image:: Images/ORA_Prompt.gif
Replace the sample text between the **[prompt]** tags with the text of #. Replace the sample text between the **[prompt]** tags with the text of
your question. When you replace the sample text, make sure you follow your question. When you replace the sample text, make sure you follow
these guidelines to avoid common formatting mistakes. these guidelines to avoid common formatting mistakes.
- Leave the **[prompt]** tags in place. - Leave the **[prompt]** tags in place.
- Enclose all text in HTML tags. - Enclose all text in HTML tags.
Step 3. Add the Rubric Step 3. Add the Rubric
~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~
**Note** *After you release your problem to students in your live course, make sure .. note:: After you release your problem to students in your live course, make sure
you don't make any changes to the rubric that affect scoring, such as adding or removing an option you don't make any changes to the rubric that affect scoring, such as adding or removing an option
in a category. Changing the rubric can cause errors in live courses.* in a category. Changing the rubric can cause errors in live courses.*
#. In the component editor, locate the [rubric] tags. (The sample rubric #. In the component editor, locate the [rubric] tags. (The sample rubric
is long, so you'll have to scroll down to locate the second tag.) is long, so you'll have to scroll down to locate the second tag.)
...@@ -186,14 +186,12 @@ in a category. Changing the rubric can cause errors in live courses.* ...@@ -186,14 +186,12 @@ in a category. Changing the rubric can cause errors in live courses.*
#. Replace the sample rubric with the text of your rubric. Make sure to #. Replace the sample rubric with the text of your rubric. Make sure to
do the following. do the following.
- Include the beginning and ending [rubric] tags. - Include the beginning and ending [rubric] tags.
- Precede the categories with a plus (+) sign. - Precede the categories with a plus (+) sign.
- Precede the options with a minus (-) sign. - Precede the options with a minus (-) sign.
- List the option that scores zero points first, followed by the option that scores one point, and so on.
- List the option that scores zero points first, followed by the option For example, your rubric might resemble the following rubric.
that scores one point, and so on.
For example, your rubric might resemble the following rubric.
:: ::
...@@ -212,9 +210,9 @@ in a category. Changing the rubric can cause errors in live courses.* ...@@ -212,9 +210,9 @@ in a category. Changing the rubric can cause errors in live courses.*
Step 4. Set the Assessment Type and Scoring Step 4. Set the Assessment Type and Scoring
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Note** *After you release your problem to students in your live course, make sure .. note:: After you release your problem to students in your live course, make sure
you don't make any changes to the code for the assessment type and scoring. Changing you don't make any changes to the code for the assessment type and scoring. Changing
this code can cause errors in live courses.* this code can cause errors in live courses.*
To set the assessment type and scoring for your open response assessment, you'll To set the assessment type and scoring for your open response assessment, you'll
enter code that specifies the type and order of assessments to use along with enter code that specifies the type and order of assessments to use along with
...@@ -267,14 +265,14 @@ Set the Type and Scoring ...@@ -267,14 +265,14 @@ Set the Type and Scoring
Step 5. Set the Problem Name Step 5. Set the Problem Name
~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Note** *After you release your problem to students in your live course, make sure .. note:: After you release your problem to students in your live course, make sure
you don't change the name of the problem. Changing the display name when the problem you don't change the name of the problem. Changing the display name when the problem
is live can cause a loss of student data.* is live can cause a loss of student data.
*You can change the display name of a problem while you're still testing the problem. You can change the display name of a problem while you're still testing the problem.
However, note that all the test responses and scores associated with the problem However, note that all the test responses and scores associated with the problem
will be lost when you change the name. To update the problem name on the will be lost when you change the name. To update the problem name on the
instructor dashboard, submit a new test response to the problem.* instructor dashboard, submit a new test response to the problem.
The name of the problem appears as a heading above the problem in the The name of the problem appears as a heading above the problem in the
courseware. It also appears in the list of problems on the **Staff courseware. It also appears in the list of problems on the **Staff
...@@ -401,7 +399,7 @@ Step 7. Save the Problem ...@@ -401,7 +399,7 @@ Step 7. Save the Problem
The component appears in Studio. In the upper right corner, you can The component appears in Studio. In the upper right corner, you can
see the type of assessments that you have set for this problem. see the type of assessments that you have set for this problem.
.. image:: Images/ORA_Component.gif .. image:: Images/ORA_Component.gif
Step 8. Add the Peer Grading Interface (for peer assessments only) Step 8. Add the Peer Grading Interface (for peer assessments only)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
...@@ -622,25 +620,27 @@ Click **Back to problem list** to return to the list of problems. You ...@@ -622,25 +620,27 @@ Click **Back to problem list** to return to the list of problems. You
can also wait for a few minutes and click **Re-check for submissions** can also wait for a few minutes and click **Re-check for submissions**
to see if any other students have submitted responses. to see if any other students have submitted responses.
**Note** .. note:: After you've graded enough responses for AI assessments to start, the number
of responses in the **Available to grade** column decreases rapidly as
When a response opens for you to grade, it leaves the current "grading pool" the algorithm grades responses and returns them to your students in just
that other instructors or students are grading from, which prevents other a few seconds. No student data is lost.
instructors or students from
grading the response while you are working on it. If you do not submit a score .. note:: When a response opens for you to grade, it leaves the current "grading pool"
for this response within 30 minutes, the response returns to the grading pool that other instructors or students are grading from, which prevents other
(so that it again becomes available for others to grade), even if you still have instructors or students from grading the response while you are working on
the response open on your screen. it. If you do not submit a score for this response within 30 minutes,
the response returns to the grading pool (so that it again becomes available
for others to grade), even if you still have the response open on your screen.
If the response returns to the grading pool (because the 30 minutes have passed), If the response returns to the grading pool (because the 30 minutes have passed),
but the response is still open on your screen, you can still submit feedback for but the response is still open on your screen, you can still submit feedback for
that response. If another instructor or student grades the response after it returns to the that response. If another instructor or student grades the response after it returns to the
grading pool but before you submit your feedback, the response receives two grades. grading pool but before you submit your feedback, the response receives two grades.
If you click your browser's **Back** button to return to the problem list before you If you click your browser's **Back** button to return to the problem list before you
click **Submit** to submit your feedback for a response, the response stays outside click **Submit** to submit your feedback for a response, the response stays outside
the grading pool until 30 minutes have passed. When the response returns to the the grading pool until 30 minutes have passed. When the response returns to the
grading pool, you can grade it. grading pool, you can grade it.
Access Scores and Feedback Access Scores and Feedback
~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment