Opscan Evaluation
You must check all options that apply to your job. The sections describing
the outputs in details also give more information on the test statistics.
- Print Score on each sheet:
- The student’s total score is printed along the edge of the test
sheet.
- Scoring Only:
- Student scores are printed twice, first in order by Social Security number
and again in alphabetical order. The percentage correct, percentile rank,
T-scores, mean, and standard deviation are also printed on the lists of
scores. Use this option if you only want a printout showing students and
scores with no statistical analysis.
- Standard Output:
- In addition to the material printed out with the Scoring Only option,
Standard Output will print a frequency distribution of scores and a histogram
to show the overall class performance.
- Long Form Item Analysis:
- Frequencies for all responses, correct and incorrect, are printed for
each item (i.e., question) as well as difficulty level and validity. In
addition, the class is divided into the top scoring 27% of the class, the
bottom 27%, and the middle 46%. Responses to each item by members of these
three groups are presented in a table. This option also provides frequencies,
difficulty level and validity for each item.
- Short Form Item Analysis:
- Frequencies for all responses, correct and incorrect, are printed for
each item. This option also provides frequencies, point-biserial correlation,
difficulty level and validity for each item.
- Student Test Responses:
- This compact report provides an alphabetical listing of students with
their responses (i.e. answers). Responses are in listed in groups of ten
(i.e., questions 1-10 are shown together, then questions 11-20, etc.) with
correct responses being represented by a dash (-).
- Individual Student Feedback:
- One printout is produced for each student in the class. Students are
given their own responses along with the correct responses for all items.
In essence, it is a graded version of the test for each student. Note: During
finals we will not print individual student feedback at time of scanning
as the large volume of printing significantly slows the entire scanning
process. If you are teaching a large class, carefully consider whether
or not you need this printout. We can always print out individual reports
for students if a grade dispute arises, or export to a Word document, and
you can print reports as needed.
- Grade Book:
- If this option is checked, you receive a printout that shows all the
tests and scores for your students for the entire semester. The student
summary score program, called Grade Book, keeps a running record of all
test results during a semester. In order to be on our list of Grade Book
users, that option must be checked each time that a test is processed.
Information required on the key (not on the sheets) should be entered as
follows:
- Course: first 5 positions in the University ID field (or Social
Security Number field on older forms), e.g., 10100
- Section: positions 6 and 7 in the University ID field, e.g.,
07
- Test number: positions 8 and 9 in the University ID field, e.g.,
02
- Department number: in the DEPT field, e.g., 461
- Weight Factor:
- The weighting option allows instructors to assign different point values
(other than the default value of 1) to groups of questions on the answer
sheet. Heavy black lines divide the groups on most forms. Weights can range
from .01 to 99.9. If the total number of points is not an integer, the
total number of points is rounded. For example, if a test has 39 questions
and each question is worth 2.5 points, the total score of 97.5 points is
rounded to 98. The maximum number of digits that an instructor can provide
for a weight factor is 3, with a maximum of 2 digits to the right or left
of the decimal point, e.g., 9.00, 6.43, 12.1, or 10.9.
- Multiple Correct Responses:
- It is important to check this option on the job request form and indicate
any items with multiple correct answers, in addition to preparing the key
by marking all the correct answers for those items. While faculty may key
more than one correct answer, students may choose only one answer.
Multiple responses by a student will result in the item being counted as
an incorrect answer.
- Number of Forms:
- In this instance a "form" refers to a version of a test. Some
instructors make multiple versions (e.g., an A and B form) of the same
test to discourage cheating. An instructor with an A and B form would mark "2" for
his or her number of forms.
- Number of Keys:
- An instructor teaching two sections of the same class may wish to use
the same key for both classes. In this case, the instructor would mark "2" for "Number
of Forms" and "1" for "Number of Keys". Thus,
one job request form may be filled out for multiple classes, provided the
same analysis is desired for each form.
- Combine Forms:
- This option allows you to get a separate analysis plus one combined
list of scores for multiple sets of tests. For example, this option
could be used for test forms A, B, and C. Please tell us if you also
need separate score listings for each test version.
- Tabulation:
- Tabulation is only marked for non-scoring (no answer key) jobs, such
as surveys. The standard tabulation provides frequencies, means, medians,
and standard deviations.
Back to Questions on Filling
Out the Job Request Form
Yes. Check "Copy file to diskette" on the job request form. The
test data can be copied to a floppy diskette in one of two formats: ASCII
(plain text) and Excel. If you do not choose a format, we will assume an
Excel file is desired.
The ASCII file contains the students’ names, test scores, and also
their answers.
The Excel file is an approximation of the list of scores sorted by last
name that would be printed when choosing the "Scoring Only" or "Standard
Output" options on the job form. You must provide your own diskette.
Back to Questions on Filling
Out the Job Request Form
Yes. Select "E-mail file (Excel only)" and print your email address
on the given line. Selecting this option will give you the Excel file as
an e-mail attachment.
Due to privacy issues involving student information, we are required to
password-encrypt the file. When you drop off your test for scoring, we will
have you select a password, and will keep it on file for future use.
Back to Questions on Filling
Out the Job Request Form
Take another copy of the test sheet. It should be filled out with your last
name in the Name field, the department number in the Dept field, and a correct
answer for each test item. Unless "multiple correct responses" is
checked on the job request form, it is assumed that there is one correct
answer for each item (see above). Do not fill in the "University
ID " (or "Social Security Number") field, unless you are using
Gradebook. When you turn it in, the key should be placed on the top of the
test sheets.
Back to Questions on Filling
Out the Job Request Form
It is virtually impossible to carry out the functions of our operation without
encountering some error. However, if users observe a number of precautions,
the number of errors can be significantly reduced.
- Carefully stack the sheets so that they all face the same direction.
One corner is cut off to make it easier to stack sheets the same way.
- Make sure that the correct answers are marked on the key, including multiple
correct answers.
- Think carefully about how you want to weight the sections of the test.
- Fill the job form out correctly. Opscan staff will be happy to help you.
- Using rubber bands and paper clips on sheets can tear or warp them. Use
envelopes to keep your sheets together.
- Avoid placing random marks or writing on the key.
- If you are using the Grade Book option, double-check the course, section,
and test numbers on the job request form and the answer key. Also, ask
your students to verify their University ID numbers when they enter the
numbers on the sheets.
- Tell your students to use pencil to mark the sheet and to press hard
in order to leave a dark mark in the desired space. If a student needs
to change an answer, the first mark should be erased completely.
Back to Questions on Filling
Out the Job Request Form
Yes. When submitting a job for survey analysis, please check "Tabulation" on
the job request form and indicate the number of questions to be tabulated
in the box marked "Special Instructions." For example, if you have
a 12-question survey, you would write "Q1–Q12" on the job
request form. Choosing the Tabulation option provides a printout with the
frequencies, means, medians, and standard deviations for your data.
Only one bubble should be filled in per question. If multiple bubbles are
filled in, a blank will be recorded for that item.
We can also give you the information from Opscan sheets in an ASCII, SPSS,
or Excel data file for your own analysis. If you wish to receive only the
data file and not receive any of the printed information, please write "Data
Only" in the box marked "Special Instructions." We can give
you the file on diskette (which you must provide) or via e-mail. If there
are University ID numbers in the data and you want the data sent by email,
we must password-protect the data file in an Excel file.
Back to Questions on Filling
Out the Job Request Form
Yes, Opscan also handles the processing of course/instructor evaluations
at the end of each semester. Detailed instructions are sent out to each department
towards the end of each semester.
Back to Questions on Filling
Out the Job Request Form
