Login button. Opens the login section of this website with several login options.
Search button. Opens a new page with a search form.

FAQs

Scoring Activities


How do I become a scorer of EQAO’s assessments?
How do I express my interest in performing scoring activities?
  • EQAO selects potential scorers to score the open-response questions completed by students. Potential scorers must
    • create a profile and keep it up to date, and
    • accept a scoring-specific invitation (if you receive one) by the specified deadline to express your interest in participating in that activity.
What is the scoring process?

Once scorers have completed their training and have passed the qualifying test (available in the e-assessment scoring system), they will be able to select batches, which they will have 12 hours to complete. A batch takes approximately one hour to score.

Scorers are not to select any batches unless they are able to score them in the 12-hour period. If a scorer completes the selected batches before the 12-hour period expires, the scorer can select one or more additional batches, for which a new 12 hours is allotted for completion. On the last day of scoring, EQAO may decrease the 12 hours allotted to complete batches to two hours or less, and the number of batches that can be claimed at a time to one (to enable the distribution and availability of batches for everyone). EQAO can also revoke claimed batches at any time to facilitate the completion of scoring.

What are the scoring dates and times?
What happens after I accept an invitation to perform scorer activities?
  • You will be required to register with Quantum, the employment vendor of record, and sign an employment agreement.
  • After the employment agreement is signed,
    • You will receive an e-mail from [email protected] on the first day of your assigned scoring task.
    • The e-mail will contain a link allowing you to register for an account in the e-assessment scoring system.
    • The e-mail will also include important dates by which you must register for your account, complete your training and start scoring.
  • Please refer to your EQAO confirmation letter for more information.
What if the name used in my EQAO profile does not match the name in my Ontario College of Teachers (OCT) profile? What happens if I change my name?
What if I forget my EQAO profile password?
What happens to my chances of receiving a scoring invitation if I make changes to my EQAO profile?
How does EQAO determine how openings to perform scoring activities are filled?
How do I know if I have been invited to score?


Qualified candidates will receive e-mails with offers to score. As e-mails may be stopped by firewalls or sent automatically to junk or spam folders, it is recommended that applicants check their EQAO profiles regularly for scoring offers. Applicants can add the e-mail addresses below to their “safe senders” list to avoid having the e-mail scoring invitations end up in a spam or junk folder. Applicants can also add the following e-mail addresses to their “safe senders” list to ensure they receive EQAO e-mails:

I have received an invitation; however, when I log into my EQAO profile, a message appears stating, “No scoring activities are available that match your profile.” What does this mean?
How can I view the scoring offers that I have accepted?
Why am I seeing more than one scoring opportunity on my EQAO profile dashboard page?
What if I want to change a particular task that I have been offered?
What happens if I am no longer able to score after I have already accepted an invitation to score?
How do I decline (or withdraw from) an invitation to score after I have already accepted it?
What if I am not sure I can participate in scoring this year?
I am a faculty of education student. How can I make sure that I am considered for scoring events or assessment committees?
Why didn’t I get an invitation to perform scorer activities?
How much will I be paid?
What are the commonly used terms for performing scoring activities that I should be familiar with?
  • Scoring Window: a specific period (with predefined start and end dates) during which the e-assessment scoring system is available for training and scoring
  • Item: a question or task that appears on an assessment or test
  • Response: a student’s response to an item on an assessment or test
  • Training Module: material for the training session, which includes an introductory video, a scoring guide, training responses, a practice test and a qualifying test
    • Practice Test: a test that scorers complete as part of the training module, used to prepare scorers for the qualifying test
    • Qualifying Test: a test used to assess a scorer’s ability to accurately score student responses
  • Batch: a predefined number of student responses to a test question (each batch is expected to take an average of one hour to score.)
    • Partial Batch: a batch that is partially scored, or a batch with a partial number of responses to be scored, which was automatically assigned by the system
  • Expert Scorer: an experienced scorer with high validity
  • Validity: the measure of a scorer’s accuracy assessed by examining the agreement between the scores assigned by the scorer and those assigned by expert scorers. The following indices are computed: percentage of exact agreement, percentage of exact-plus-adjacent agreement, percentage of adjacent-low agreement and percentage of adjacent-high agreement.
  • Adjacent: a difference of one score code between the score assigned to a certain response by the scorer and that assigned by the expert scorers
    • Adjacent-Low: the score assigned to a certain response by a scorer is one score code below the score assigned by the expert scorers.
    • Adjacent-High: the score assigned to a certain response by a scorer is one score code above the score given by the expert scorers.
  • Non-Adjacent: the difference between the score assigned to a certain response by a scorer and that assigned by the expert scorers is greater than one score code.
  • Exact Agreement: the score assigned to a certain response by the scorer and the expert scorers is the same.
    • Cumulative Exact Validity Percentage: the total percentage of validity responses scored that match the score preassigned
    • Cumulative Exact + Adjacent Validity Percentage: the percentage of validity responses scored that are either a match with the score given by the expert scorers or are one score code different (higher or lower)
  • Validity Response: a response that matches the anchors in the corresponding scoring guide
  • Minimum Validity Threshold: the minimum average rolling validity required to continue to score without retraining
  • Cumulative Validity Incentive Threshold: the minimum cumulative exact and cumulative exact + adjacent validity percentage required to receive incentive pay

Get technical support

Reach out to our technical support team for assistance in resolving any issues you encounter.

Contact the information center

If you have any questions, please contact our information center for assistance.

Get quick assistance

Get quick assistance without calling or emailing by connecting with our chat bot.

Was this helpful?

Yes
No
Thank you for your feedback!