Scantron Achievement Series Assessment Software User's Guide
विज्ञापन
विज्ञापन
Achievement
Series
On-line and Paper-Based
Formative Assessment
Assessment Solutions
User's Guide
Teacher's Version
Information in this document is subject to change without notice and does not represent a commitment on the part of Scantron. The software described in this document is subject to the license agreement included with the product which specifies the permitted and prohibited uses of the product. Any unauthorized duplication or use of Achievement Series, in whole or in part, in print or in any other storage and retrieval system, is prohibited. No part of this publication may be reproduced, transmitted, transcribed, stored in a retrieval system, or translated into any language in any form by any means for any purpose other than the purchaser’s use without the express written permission of Scantron Corporation
Performance Series, Achievement Series, Skills Connection Online, and Curriculum Design copyright
Scantron Corporation. ExamView Test Builder copyright FSCreations. netTrekker d.i. copyright
Thinkronize, Inc. All other product names are the copyright of their respective copyright holders.
Copyright 2005-2008 Scantron Corporation. All rights reserved.
Achievement Series User’s Guide, Teacher Version
1st Edition, September, 2005
2nd Edition, January 2006
3rd Edition, April 2006
4th Edition, July 2006
5th Edition, January 2007
6th Edition, July 2007
7th Edition, March 2008
8th Edition, August 2008
T
Table of Contents
Section I:
Introduction
Chapter 1:
Educational Landscape . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2:
Managing Classroom Testing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Scantron Achievement Series User’s Guide i
ii
Section II:
Features & Functions
Chapter 3:
Getting to Know Achievement Series . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Scantron Achievement Series User’s Guide
Chapter 4:
Working with Item Banks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Chapter 5:
Creating and Managing Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
Chapter 6:
Administering and Scoring Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
Teacher Version iii
iv
Chapter 6:
Administering and Scoring Tests, ctd.
Chapter 7:
Viewing Reports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
Setting an Export Request Schedule for One or More Published Tests . . . . . . . . . . . 176
Chapter 8:
Using Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
Scantron Achievement Series User’s Guide
Chapter 8:
Using Resources, ctd.
Using netTrekker d. i. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
Section III:
Additional Information
Appendix A:
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
Appendix B:
Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
Section IV:
Index
Teacher Version v
NOTES
vi Scantron Achievement Series User’s Guide
In this section:
Educational Landscape . . . . . . . . . . . . . . . . . . . . page 3
Managing Classroom Testing. . . . . . . . . . . . . . . . page 7
Section
I
Introduction
NOTES
Chapter 1:
Educational Landscape
With today’s state and national reporting requirements, schools and districts are under pressure to gather timely and accurate student assessment data. Assessment tools from Scantron provide the standards-based data, aggregated in a variety of ways, that districts need to meet the requirements of state and federal agencies.
Assessment has long been an instrument of educational reform. Test-based reforms in the U.S. can be traced back to the 19th century when the Massachusetts state superintendent of instruction used written exams to hold public schools accountable. More recently, the Standards-
Based Reform movement has led to high-stakes accountability and has culminated in the passage of No
Child Left Behind (NCLB), a reauthorization of the
Elementary and Secondary Education Act of 1965
(ESEA), and the first federally mandated legislation for assessment and accountability for all U.S. public schools.
Scantron Achievement Series User’s Guide 3
1
4
Educational Landscape
No Child Left Behind
National Assessment of
Educational Progress
State Standards
Grants and Funding
The No Child Left Behind (NCLB) Act requires thatdistricts report performance data that is standardsbased, reliable, and valid. Research-based assessment tools from Scantron, such as Achievement Series districts meet these requirements.
TM
, help
NCLB calls for the National Assessment of Educational
Progress (NAEP) to be administered to all 4th and 8th grade students in Reading and Math. Although the results from NAEP are not used in determining adequate yearly progress (AYP), schools can use it as an external evaluator of how their students perform versus state assessment.
This may reveal gaps in curriculum and/or state assessment in comparison to national standards (NEA,
2005).
1
In many cases, reporting requirements specify that student performance be measured against state standards. When you use assessment tools from Scantron like Achievement
Series, your state standards are matched to the test items.
Assessment tools from Scantron often meet the guidelines for supportive funding. Funding sources include state and federal grants and appropriations as well as private grants.
Achievement Series
Following the passage of NCLB, schools across the country are struggling to meet AYP requirements. Just as all students are entitled to the resources and support needed to advance in their learning, schools are entitled to the tools and support needed to measure and document yearly progress. As technology marches forward, webbased platforms, such as Scantron’s Achievement Series, provide assessment solutions that help ensure that no school is left behind.
As a leader in K-12 assessment for over thirty years,
Scantron understands the challenges facing educators
1. National Education Association [NEA] (2005). NAEP and NCLB testing:
Confirming state test results. Retrieved March 14, 2005, from http:// www.nea.org/accountability/naep-accountability.html
Scantron Achievement Series User’s Guide
today. One of the most difficult challenges is the balance between maximizing student performance and the need to fulfill state and federal requirements.
Scantron has a solution: a unique combination of online tools for standards-based formative assessment and computer-adaptive diagnostic testing. Scantron’s complete assessment solution helps educators meet NCLB requirements and raise the level of student achievement:
• Standards-based formative assessment at the district and classroom levels monitors student progress and helps guide instruction in preparation for high stakes testing.
• Computer-adaptive diagnostic testing identifies students who would most benefit from corrective instruction or enrichment activities and measures gains over time.
Teacher’s Version
Scantron’s Testing and Assessment Division provides high-quality technology-based assessment solutions for the immediate, accurate and reliable capture of student performance data necessary to impact instruction and inform leadership. With Achievement Series and
Performance Series, Scantron combines traditional formative assessment with computer adaptive testing using one online platform to create a comprehensive assessment program that provides educators with the data necessary to improve student achievement.
5
6
Educational Landscape
Test Development
Test Delivery
Test Management
Reporting Requirements
Achievement Series and Performance Series can be used together in a district as a comprehensive assessment solution:
1. Performance Series tests are given to students at the beginning of each year, or as they enter school, as a diagnostic assessment to accurately measure learning levels and guide student placement.
2. Achievement Series tests are used throughout the year for easy-to-deliver district benchmark tests and skillbased classroom tests.
3. Performance Series tests are administered again at the end of the year to accurately measure year-long gains and growth.
Hosted by Scantron, the entire cost-effective solution provides immediate and clear feedback for improved classroom instruction and insightful program evaluation.
This unique capability - common assessments plus computer-adaptive diagnostic testing - provides you the most comprehensive assessment solution available.
Develop tests at the district or school level individually or collaborate with others in a secure environment. Choose among test format and delivery options, then use your existing test questions, write new questions, or select questions from item banks.
Students can take their tests online or on paper. Choose the most appropriate delivery method for students—even using multiple delivery methods for the same test.
All tests and item banks, test data, and reports are in one location for security and easy access.
Individual teachers, committees, and administrators all get the test results they need immediately online as appropriate. Online reports can be printed to share with individuals and groups other than district and school staff.
Scantron Achievement Series User’s Guide
2
Chapter 2:
Managing Classroom Testing
The Scantron Achievement Series is a powerful, secure web-based assessment platform that you can use to develop and administer tests, capture results, and produce standards-based reports. The online system enables you to collaborate with other teachers and district administrators in item and test development, and its content-neutral structure allows you to use your own questions, Scantron’s standards-based questions, test items from other vendors, or any combination. Tests can be administered online or on paper, and the results can be accessed immediately.
If your district is using Achievement Series’ District
Assessment module, you can create and store your own custom items.
If your district is using only the Classroom Testing module, you can include items from purchased item banks
Scantron Achievement Series User’s Guide 7
Managing Classroom Testing
(such as the Scantron Item Bank) or you can create your own items for each test.
NOTE: Item Bank creation and collaboration is discussed in this chapter; however, you can only create Item Banks if you also have access to District Assessment.
Achievement Series can be part of an effective benchmark assessment strategy to help raise state test scores.With its content-neutral structure and “develop once, deliver any way” capability, Achievement Series system offers the power and flexibility in testing that educators need.
8 Scantron Achievement Series User’s Guide
The basic workflow for setting up and managing classroom testing is simple:
Teacher Version 9
Managing Classroom Testing
10
Building Your Team
Although the saying “it takes a village to raise a child” has become somewhat cliché, there is nevertheless a grain of truth hiding there. Effective assessment and tracking for a district or school cannot be accomplished by one person acting alone. You need a team of people committed to the effort it takes to set up a system that makes the results reports look effortless.
Achievement Series recognizes this and provides several roles that you can assign to staff:
• Location Controllers perform all tasks at a location.
For your security, keep the number of location controllers at your location to a minimum.
• Administrators have full viewing/reporting and item/test creation capabilities at a location, but cannot create/edit students or staff.
• Teachers w/o Student Edit can view just the students and classes they have been assigned. If a teacher needs more access, create a second identity for the staff member using a different position (such as
Administrator or Location Controller) and unique staff ID. Only teachers can be assigned to classes.
• Teachers w/ Student Edit are just like Teachers w/o
Student Edit except this position can also create and edit students.
• Data Entry operators have creating/editing/deleting capabilities to allow most common data entry tasks.
• Test Operators can perform tasks related to the test taking logistics of the system (such as scheduling, scanning, etc.), create items banks and edit item banks they have created, list published district tests, list, schedule and delete scheduled district tests (including all session tabs), list and create students.
• Consultants must be assigned to projects such as tests or item banks to be granted any rights. They then have only the specific rights you grant them.
Scantron Achievement Series User’s Guide
Who else might I need?
What other team features does Achievement Series support?
Consider the following team roles (aside from those you can set up in Achievement Series):
• Site support (whoever performs this task should have
Location Controller rights)
• Trainers
• Test Scanners (can be given Scan Operator rights)
Examine the different roles available in Achievement
Series to determine the rights these additional team roles may have.
If your district has access to District Assessment, you can also create Item Banks and collaborate on item creation.
After your team has created Item Banks and Items (see
“Working with Item Banks” on page 1 if your site includes the item banks feature) and begun to draft tests (see
“Creating and Managing Tests” on page 85), you can share
the banks for collaborative development.
This flexibility allows for a unique online collaboration between educators who can “divide and conquer” the task of creating highly correlated test items, while increasing the validity of tests by allowing peer review for bias or other concerns with the items.
Coordinating time for a large group of teachers to meet can be a real challenge, but because Achievement Series items are stored online, collaboration can be virtual, and teachers can create/review/edit items at any time. The flexibility for peer review aligns with the National Council on Measurement in Education Code of Professional
Responsibilities in Educational Measurement (1995), which requires that test items “are as free as possible from bias due to characteristics irrelevant to the construct being measured, such as gender, ethnicity, race, socioeconomic status, disability, religion, age, or national origin.”
1
Teacher Version
1. National Council on Measurement in Education, “Code of Professional
Responsibilities in Education Measurement”, p3; retrieved December 27,
2005, from http://www.ncme.org/about/docs.cfm
11
Managing Classroom Testing
Remote Sharing and Remote Copying are additional collaborative options that allow schools and/or districts to share or copy non-copyrighted Item Banks from one location to another. Once users certify that the content being shared/copied is original, they can build a comprehensive library of item banks built from a variety of fellow Achievement Series users and locations.
In addition to enhancing the collaborative process of Item
Bank development, the Remote Sharing features also allow for articulation of assessments between schools that teach the same grade levels, and/or vertically from one grade to the next.
For those who prefer to review and evaluate printed details, customized Item Bank Details Reports are automatically generated and can be printed to show any combination of the following:
• the Question Contents
• Correct Answers
• Scoring Information
• Item Properties (name of item, type of item, etc.)
• Explanations
• References
• Hints
• Standards
• Item Statistics
• Item Usage
• Item Versions, Bias Review, and/or Comments.
See “To share tests” on page 124 for details.
12 Scantron Achievement Series User’s Guide
How will I deliver testing?
What are my scoring options?
What other test options are there for online tests?
What about teacher-graded items?
Preparing Your Classroom for Assessment
Achievement Series allows you to deliver tests in the following ways:
• printed on plain paper
• prepared for Optical Mark Reading (OMR) forms
• online
No matter how you choose to deliver tests, your results will be stored and aggregated in Achievement Series.
See “Administering Tests” on page 140 for details.
If a test is administered online, the results are automatically scored and aggregated according to the settings in student records. In addition, Achievement
Series can score and aggregate results from scanned tests
(at both the district and school levels). When you score tests, you can choose how to handle multiple or omitted marks.
As you create tests, you will need to choose from the flexible and customizable test options Achievement Series provides. Online testing options include:
• whether students can review questions they have already answered
• whether and how results are displayed to students
• whether and for how long students may pause a test
• whether students can use a standard browser or must use the Scantron Secure Testing client (which restricts their access to other application features during a test)
See “Creating and Managing Tests” on page 85 for details.
If you are administering plain paper tests, you can include extended and short response items on the test. The teacher then scores these items and adds the score to the student form before scanning.
Teacher Version 13
Managing Classroom Testing
What are my security options?
How can I aggregate results?
You can set up testing security and results security via the
Site Administration tab.
NOTE: You can only aggregate and disaggregate results for any district tests (available only in the District Assessment module) to which you have access.
Under No Child Left Behind (NCLB), every state is required to set standards for grade-level achievement and develop a system to measure the progress of all students and subgroups of students in meeting those statedetermined, grade-level standards. Practically, this means that you need to have reports that aggregate data so you can easily see results sort by subgroups. Achievement
Series includes the following demographic categories:
• gender
• birthdate
• ethnicity
• citizenship
• special status
• Limited English Proficiency (LEP)
• Migratory Child
• Migratory Education Program (MEP)
• Summer Migratory Education Program (SMEP)
• Student with Disability
• Title I
• Meal Assistance
• Individual Education Plan
• accommodations (i.e., can a student take a test from a different grade)
In addition to these demographic groups, Achievement
Series allows you to create groups to aggregate results under unique categories you may want to track.
14 Scantron Achievement Series User’s Guide
I already have items that I want to use—how do I incorporate them?
For example, your district may support an Advancement
Via Individual Determination (AVID) program to help grade 5-12 students in the “academic middle” prepare for higher education more effectively track test results for students in this program, you would create a group and assign the appropriate students to that group.
1
. If you may want to
Assembling Tests
You can easily assemble tests by creating items at the time of test creation or by quickly creating Answer Key Only tests. If you have access to Scantron or other third-party item banks, you can also easily search the item banks for items to add to your test. And if your district also has access to District Assessment, you can search and create
(depending on you access) district Item Banks as well. The item banks you create for yourself will continually evolve and improve, but you don’t have to wait for that to happen to enjoy the benefits.
Because testing accommodations for students with disabilities are legal requirements for instructional assessments, the need for flexibility in test item creation is imperative. Achievement Series offers a variety of item choices including Multiple Choice, Multiple Response,
Extended Response, Short Response, Gridded Response, and True/False Items. This flexibility of item creation allows for:
• content alignment, or the alignment between the test content and the curriculum content
• context (or format) alignment, which aligns the format of test items to the format of the information as it is taught in the curriculum.
Items can be entered into the Item Banks (if your district has access to District Assessment) by
• manual entry and/or cutting and pasting text from existing files
Teacher Version
1. Distilled from http://www.avidcenter.org, “AVID at a Glance”, on December
27, 2005.
15
Managing Classroom Testing
How do I track item use?
What else can I do with items?
• imported from content available from other vendors via XML files.
• publishing question banks or tests from ExamView (if your subscription includes the ExamView integration)
For more information contact your district.
Each time an item is used on a test, Achievement Series automatically generates item statistics. The item statistics are aggregated from every exposure of the item on any assessment, and include the sample size, the P-value
(Probability value), and the choice statistics of the item.
Each time an item is edited, it is assigned a new version, so that changes to the item and the item statistics, by version, can be noted.
The item statistics include item exposure on tests, to ensure that certain items are not over exposed. The ability to edit items allows educators to correct any substantive inaccuracies in assessment items immediately. See
“Understanding Item Statistics Detail” on page 156 for
details on the various item statistics available.
More advanced item entry options are also available, such as:
• attaching Standards to each item, which allows for standards reporting
• connecting Passages/Exhibits to an item
• giving:
• an Explanation of how to correctly solve/answer an item (which can be shown to students during online testing as an instructional feedback tool)
• a Reference (which can be used to cite the source of the item, and can be used as a tool for open book/open notes tests)
• Hints (which can be used to accommodate special learners)
16 Scantron Achievement Series User’s Guide
Great. Now I have a bunch of items—How do I use them in tests?
What if I do not have access to Item Banks?
What types of tests can I create?
• inserting graphics into each question, any answer, and the reading passage/exhibits, allowing for items that give visual cues and require higher-level thinking skills.
If your district has access to District Assessment, you can create Item Banks to use for searching when creating tests.
Once you have collaboratively created, reviewed, and edited Item Banks, you can create tests from one item bank, or pull items from multiple item banks. Using
Achievement Series Quick Pick option, you don’t even have to choose items individually; Achievement Series will select a random sample of relevant questions from the item banks for you. Of course, you can always create test by choosing the specific items you want to include.
You can automatically randomize the order of test item questions and/or answer choices, to reduce the chances of students cheating on the assessment. You can also randomize which online version of a test students see, reducing the possibility that students can look over to the next computer for help.
In addition, district tests may be scheduled and classroom tests may be automatically duplicated for subsequent administrations of the same test.
If you do not have access to purchased item banks or district-created item banks through District Assessment, you can easily create items as you create your test, or you can simply create Answer Key Only tests.
Tests or quizzes can be created by a single teacher to be delivered to one or more of his or her classes online or on paper, where results do not need to be aggregated across classes. Answer Key Only tests can also be created for paper-based delivery.
Teacher Version 17
Managing Classroom Testing
What preparation should I do?
Administering Tests
Achievement Series allows teachers and administrators to choose the test delivery method that works best for their individual needs. District Test Sessions and Classroom
Tests may be administered online, on paper to be scanned using an Optical Mark Reader (OMR) scanner, or on paper to be scanned using an “off the shelf ” plain paper scanner
Scan paper tests using Scantron’s Scan Station software, which you can download from the Achievement Series website onto any Windows 2000 or XP computer. Through
Scan Station, school personnel can print generic forms on plain paper, or custom test forms that have the Student
ID, test ID, and class information pre-printed on each form for every student.
NOTE: While you can print plain-paper forms and copy them, be sure the copies are clean and crisp (consider using an outside copy vendor). Forms that have been repeatedly copied are difficult to scan and can give incorrect testing results.
Consider setting up a dry run of online tests and scanning sessions. Often, you can avoid problems that may delay or invalidate the test by doing so.
Also consider preparing a standard parent letter explaining the testing process and expected results or benefits. You can use this letter at each testing event to help parents understand the goals and purpose of these assessments.
The following are some recommended practices for setting up and administering assessment:
Are there recommended Best
Practices for the assessment process?
Online
• Ensure appropriate software has been downloaded to all computers used for testing (see the online help)
• Schedule computer lab times for various classes’ testing
18 Scantron Achievement Series User’s Guide
Teacher Version
Plain Paper
OMR
• (Optional) Create and distribute proctor instructions:
• Include Site IDs for your school
• Include Test ID(s)
• Include computer lab schedule
• List primary Location Controller to contact if there are questions
• Ensure proctors have Test Operator rights at a minimum in case they need to look up a Student
ID or enroll a new student
• Print paper tests for students to show work (optional)
NOTE:
You can also print these tests for new students not yet enrolled.
• Activate the test
• Install & calibrate Scan Station with scanners
• Print tests
• Print pre-slugged custom forms using laserjet printer
• No page scaling or auto-rotating when printing PDFs
• Scan demo student form to ensure proper printing
• Print extra generic forms for students not yet enrolled online
• Organize forms by class
• Activate the test
• Install Scan Station & scanners
• Calibrate Scan Station & pre-slug OMR forms if scanner has ink read-head
• Print tests
• Activate the test
19
Managing Classroom Testing
How do I want to monitor testing?
What are the different ways I can check results?
What are the common problems, and how can I avoid them?
During the Testing Cycle
Testing can be monitored, from an administering standpoint, by classroom teachers or other proctors. Be sure to provide the proctors with the appropriate test
see the following question.
Achievement Series provides a variety of reports you can use to view student progress after testing and scoring is
completed (see “Viewing Reports” on page 155).
As you administer tests, you might encounter some or all of the following problems:
Problem
I just discovered one of my test items:
• has the wrong correct answer specified
• is biased
• is ambiguous
• simply doesn’t assess the item as well as I’d hoped
Several students can’t log on.
Solution(s)
Achievement Series provides a feature where you can re-score stored
• If you are using student passwords for tests, consider removing the passwords.
• Make sure you (or the test proctor) clearly state the site ID and test number
20 Scantron Achievement Series User’s Guide
Can I adjust the test for the next time I administer it?
Can I export test results to another system for further analysis?
Problem
My testing network is really slow.
Plain paper form scanning problems
Solution(s)
Make sure you have enough network bandwidth for the number of students testing.
Contact your district or school network specialist for help.
TIP: Consider running a practice test before a testing event, where staff members and/or trusted students take a practice test.
Generally scanning problems are caused by improperly printing plain paper tests (generic or custom). See
for proper print settings.
Also see the online help for additional resolution options.
After Testing
Absolutely. Creating tests is an iterative process. These tests are living documents—you will continue changing and revising them during their entire life cycle. You can simply duplicate the test an make the necessary changes before administering it again.
Yes. Anyplace you see “Export to XLS” allows you to save a comma-separated value (CSV) file that can be opened in
Excel or imported into any application that supports CSV files. Most lists and reports allow this exporting, and many
Teacher Version 21
Managing Classroom Testing
How do I read these reports?
What’s the difference between district and classroom tests?
lists and reports allow you to save the information directly
to PDF, if you need a print-ready format. See “Exporting
Data” on page 44 and “Generating PDF Reports” on page 45, respectively, for details.
Assessment Results and Reporting
Achievement Series provides a variety of reports that you can use to view and understand testing results. See
“Viewing Reports” on page 155 for details.
Reading reports is easy. Simply log in and go to the
District Reports or Classroom Gradebook tab. From there, select a test or test aggregate and view the information provided. You can drill down to deeper detail
and print reports from each report screen. See “Viewing
District tests are typically common assessments created by district or school administrators and delivered to the appropriate populations within the district student body, regardless of school affiliation. They are usually administered at specific times during the school year and used as a benchmark to assess district progress. Results from district tests are automatically aggregated and can be disaggregated as desired. They are available only through the District Assessment module.
District Test drafts, which are editable, may be created at the district or school, and may be shared for collaborative review. Test item questions and/or answer choices may be automatically randomized, to reduce the chances of students cheating on the assessment. Once District Tests are finalized and published, sessions may be scheduled for test delivery an unlimited number of times over the course of any length of time.
Classroom tests are typically created by a teacher to be delivered to one or more of his or her classes, where it is not necessary for the results to be aggregated across classes. Teachers can use these tests for traditional progress assessment, and they can use them to assess their
22 Scantron Achievement Series User’s Guide
Can I filter what I see on reports?
own progress against district records. Classroom tests may be created and activated for delivery to any class, and may be automatically duplicated for subsequent administrations of the same test. They are available only through the Classroom Testing module.
You can filter district reports by time frame, demographics, student groups, and score range. See
“District/School Test Reports” on page 160 for details.
You cannot filter classroom reports.
Teacher Version 23
Managing Classroom Testing
NOTES
24 Scantron Achievement Series User’s Guide
In this section:
Getting to Know Achievement Series. . . . . . . . page 27
Working with Item Banks . . . . . . . . . . . . . . . . . page 57
Creating and Managing Tests . . . . . . . . . . . . . . . page 85
Administering and Scoring Tests . . . . . . . . . . . page 139
Viewing Reports . . . . . . . . . . . . . . . . . . . . . . . . page 155
Using Resources . . . . . . . . . . . . . . . . . . . . . . . . page 201
Section
II
Features & Functions
NOTES
3
Chapter 3:
Getting to Know Achievement Series
In this chapter:
Starting Achievement Series . . . . . . . . . . . . . . . . . .page 28
Logging In . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 30
Navigating Pages . . . . . . . . . . . . . . . . . . . . . . . . . . .page 32
Using Lists . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 34
Working with Folders. . . . . . . . . . . . . . . . . . . . . . . .page 35
Exporting Data. . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 44
Generating PDF Reports. . . . . . . . . . . . . . . . . . . . .page 45
Getting Help. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 54
Scantron Achievement Series User’s Guide 27
28
Getting to Know Achievement Series
Starting Achievement Series
Achievement Series is a web-based application. You will need a browser to view and use it. See the System
Administrator’s Guide for details on Achievement Series requirements
To start using Achievement
Series
NOTE: Be sure to turn off all pop-up blockers, including any on browser toolbars (such as Yahoo or Viewpoint) that you may have installed.
1. Open your browser.
2. In the navigation bar, type:
http://www.achievementseries.com/
TIP:
If you or someone else has used this workstation before, you can also just type the first few letters
(e.g. achie), but that may take longer, depending on your browser.
Achievement Series home page opens:
Scantron Achievement Series User’s Guide
Starting Achievement Series
3. Click Staff Members on the left-hand side of the screen to open the login page:
TIP:
If your browser supports “favorites” or bookmarks, consider setting Achievement Series start or login page as a favorite. See your browser’s instructions for more details.
Administrator’sTeacher’s Version 29
Getting to Know Achievement Series
Logging In
To log in
Because Achievement Series is a web-based application, you must log in to preserve the security of the data you access.
Typically, a school network specialist will create your login.
Achievement Series supports a variety of login and security options. Your login allows you to access only features and data appropriate to your job.
Your primary Location Controller or district network specialist will provide your login information.
What if I type the wrong Staff ID or password?
1. Type your site ID.
2. Type your staff ID (your network specialist may also call this your “user ID” or “username”).
3. Type your password. For security purposes, the actual text of your password is replaced by asterisks (*) on-screen.
Depending on how your school network specialist has set up Achievement Series logins, you may be “locked out” of the system after a certain number of unsuccessful attempts to login. This prevents unauthorized users from repeatedly trying to guess your password. If you have been locked out, wait several minutes before trying again, or contact your network specialist to reset your password.
30 Scantron Achievement Series User’s Guide
What if I forget my password?
Logging In
Contact your network specialist or Location Controller and ask him or her to reset it for you. He or she will email you a new password, which you should change as soon as you’ve logged in. See “Changing Your Password” on page 199 for details.
Administrator’sTeacher’s Version 31
Getting to Know Achievement Series
Navigating Pages
Once you have logged in, the following screen appears:
School name
Work tabs
Working area
To work with the page, do one of the following
• Click a work tab to work in a particular area, such as:
• Home, to access the most commonly used features.
• Classroom, to work with classroom features such as classroom tests and gradebooks
• District Reports, to view score and item analysis information aggregated and concatenated at the
district level. See “Viewing Reports” on page 155.
NOTE:
If your login is for a particular school, you will only see data from the district that applies to your school.
• District Tests, to view and work with test drafts,
published tests, and testing sessions.See “Creating and Managing Tests” on page 85.
NOTE:
If your login is for a particular school, you will only see test information that is available to you.
32 Scantron Achievement Series User’s Guide
Navigating Pages
• Item Banks, to view and work with test questions.
See “Working with Item Banks” on page 57.
NOTE:
If your login is for a particular school, you will only see item information that is available to you.
•
Resources, to access any additional resources
(such as Skills Connection your site subscribes
TM
Online) to which
• Site Admin, to set up or change site information, including students, courses, staff, locations, etc., as appropriate to your login level. See the online help.
NOTE:
Only the features to which your site subscribes appear.
Administrator’sTeacher’s Version 33
34
Getting to Know Achievement Series
Using Lists
Achievement Series allows you to list most of the elements it uses (students, standards, classes, etc.). You will use lists extensively. These lists share some common tools:
2. Export
1. Navigation
3. Sorting
4. Record Access
1. Navigation:
• Open the Index list and select an element to jump directly to that element.
• Click << or >> to jump to the previous or next page, respectively.
• Open the Page list and select a specific page number to jump directly to that page.
2. Export:
See “Exporting Data” on page 44 for details.
3. Sorting:
Click any underlined list heading. Click the heading once to select it for sorting. Click it a second time to reverse the sorting (e.g., from last to first).
4. Record access:
Click any underlined name in the list to access that element’s record. Underlining is a common indication of web-link functionality. Anytime you find underlined text in Achievement Series, you can click through for additional information.
Scantron Achievement Series User’s Guide
Working with Folders
Working with Folders
The following elements can be organized into folders:
• Item Banks
• Test Drafts
• Published Tests
• Scheduled Sessions
You can either assign a folder to these elements when you create them or you can move one or more elements into a folder later.
Some notes about folders
Each element area uses its own structure (i.e., if you create a folder for a test draft, you will not automatically see that same folder in the Published Tests list, unless you create it). This allows you to use different organizing structures for the different elements. For example, you may want to organize your item banks by grade, your tests by subect, and your published tests by course.
• As of the current Achievement Series version, folders created for tests do not carry over to Scan Station or the District Reports area (where you select a test to report on). These areas will continue to be alphabetical lists.
• All users within a site will share one master set of folders. Only Location Controllers can create, rename, move, and delete folders.
• Managers of a particular item bank or test can move that item bank or test to a folder at any time.
• Two levels of folders exist by default in each area: a top-level customer folder (typically the district) and school-level folders. Within those default folders, you can create multiple folders within folders at your location.
• If you are at any level above a school level, your tests, item banks, and folders will be added to the top-level default folder.
Administrator’sTeacher’s Version 35
Getting to Know Achievement Series
• If you are at a school level, your tests, item banks, and folders will be added to the school-level default folder. However, at a school level, you will also see the top-level default folder, any subfolders that have been created within it, and any tests or item banks that have been shared with you.
Default folders will automatically be named using the location names.
• Locations can see their location-specific folders and any folder from any other locations associated with the customer site (i.e., a district, state, region, or school site, depending on how your site tiers are constructed). Only the folders themselves are visible; whether you can view that folder’s contents depends on the access you have been granted by the folder’s owner.
• Tests created at a school level can only be added to school folders, and top-level district tests can only be added to top-level folders.
• There is no limit to the number of levels of embedded folders that you can create.
Organizing and Naming Folders
Folders can be organized however you want in order to meet your particular district needs. There are many possibilities, and some suggestions appear below for each area.
The best idea is to look at your current naming conventions for each element and base your folder structure on the naming conventions.
TIP: Use your folder structure to help shorten the names of item banks and tests, for easier browsing.
36 Scantron Achievement Series User’s Guide
Administrator’sTeacher’s Version
Working with Folders
Some general best practices for creating folders:
• Make folder organization intuitive so staff members can easily locate elements:
• Consider adding only a limited number of levels of embedded folders to prevent elements from becoming “lost” by being buried too deep.
• Think about how many times you want users to drill down in folders (number of clicks) while still maintaining a reasonable number of elements in each folder (to avoid scrolling).
• Think about which elementss you share at the same time with the same people. Elements within a single folder can easily be shared with multiple people at the same time.
• If possible, avoid mixing subfolders and uncategorized item banks at the same folder level. Try to put all item banks in the lowest level folders.
TIP:
If you mix subfolders and uncategorized elements, folders appear first on the page, followed by the uncategorized elements.
Mixing subfolders and uncategorized elements at the same level causes the index to appear out of alphabetical order. For example, the last item banks folder may be named Mathematics. It would then be followed by “Algebra” banks that have not been organized into a lower level folder. The index would then read M – A, B – D, E – G, etc.
• Consider adding an “Archive” folder for elements you no longer use.
37
Getting to Know Achievement Series
Example 1: Folders by Grade
Example Item Bank Organization
Example 2: Folders by Subject
38
Example Test Draft/Published Test/Scheduled Session
Organization
NOTE: Think about whether you use the same test drafts from year to year or whether you create new ones each year.
NOTE: The following examples assume an identical structure for each test element. However, Achievement Series does not enforce this, and you would have to create each structure in each element area. For example, if you create a folder for a test draft, you will not automatically see that same folder in the Published Tests list, unless you create it
Scantron Achievement Series User’s Guide
Working with Folders
Example 1: Folders by Academic
Year
Example 2: Folders by Testing
Period
At the top level
Navigating Folders
The folder bar at the top of the list shows you the currrent folder and provides any folder options:
The folder currently on screen.
Click to create a new subfolder under the current folder.
Administrator’sTeacher’s Version 39
Getting to Know Achievement Series
On subfolders
The folder currently on screen.
Open the list and click a folder to go directly to that folder.
Click to create a new subfolder under the current folder.
Click to move up one folder.
Click to rename the subfolder.
To create a folder
Adding Folders
You can create as many folders and subfolders as you need to organize your item banks and tests.
1. Navigate to the folder where you want to add a new subfolder.
2. Click the icon shown in the margin:
3. Type a name for the folder.
You can use letters, numbers, or special characters
(e.g., !, #, &, etc.).
4. Click Save.
40 Scantron Achievement Series User’s Guide
To edit a folder
Editing Folders
1. Navigate to a folder.
2. Click the icon shown in the margin:
Working with Folders
To move folders or elements
3. Type a new name for the folder.
You can use letters, numbers, or special characters
(e.g., !, #, &, etc.).
4. Click Save.
Moving Existing Folders or Elements to Folders
You can move existing elements between folders. You can also move an entire subfolder to another upper-level folder or to a lower folder level (provided the lower-level folder already exists).
1. Log in to Achievement Series (see Achievement Series
User’s Guide).
2. Click Item Banks or District Tests, depending on what you want to move.
Administrator’sTeacher’s Version 41
Getting to Know Achievement Series
3. Click Organize under the appropriate element:
NOTE.
This screen shows item banks; the other elements use essentially the same screen.
4. Check the box next to each element or folder you want to move.
5. Click Next:
42
NOTE.
This screen shows item banks; the other elements use essentially the same screen.
Scantron Achievement Series User’s Guide
Working with Folders
6. (Optional) Choose a folder for the element(s) and/or folder(s) being moved:
NOTE:
The folder automatically defaults to whatever folder you were viewing when you clicked Create.
a. Click a folder name to select and open it.
b. (Optional) Repeat step a until you are viewing the folder that should contain the element(s) and/or folder(s) being moved.
NOTE:
You can also create a new folder at any level.
Click and follow steps 3 through 4 on page 40.
7. Once the correct folder name appears next to Current
Folder, click Done.
Administrator’sTeacher’s Version 43
44
Getting to Know Achievement Series
Exporting Data
To export data
Most Achievement Series screens allow you to export data to a comma-delimited Excel file (.CSV format). Use this file to prepare printed reports or bring Achievement
Series data into another application for further analysis.
From any screen displaying “Export XLS” (
1. Click Export XLS. Your browser will open another window, then present a download prompt:
):
2. Do one of the following:
• Click Open to open the file on your desktop.
Excel will open and display the report information. From Excel, you may save or print the report. See Excel’s online help for details.
• (Recommended) Click Save to save the file to a location on a local or network drive. You will be prompted, using a standard Save dialog from your operating system, to save the file. See your operating system manual or online help for details.
TIP:
Remember to name the file with the date and the report name. You may want to develop a standard naming convention within your district to help make locating and organizing data files easier.
• Click Cancel to stop downloading the information.
Scantron Achievement Series User’s Guide
Generating PDF Reports
Generating PDF Reports
Any screen that you can export to Excel, you can also save to Adobe’s Portable Document Format (PDF). PDF is an operating-system independent “print” format. It creates an electronic “page” that you can send to a printer or save on a local or network drive.
To create a PDF report
From any screen displaying “PDF” in the upper righthand corner (next to “Preferences”):
1. Click PDF (button shown in the margin).
Achievement Series opens a new browser window with the PDF page(s):
Administrator’sTeacher’s Version 45
Getting to Know Achievement Series
NOTE:
The screen capture on the previous page does not show a full browser window. Your browser settings may vary, but if you have Adobe Reader installed, the Adobe Reader portion will look similar to the example.
From this screen you can:
• View the report
• Save the report to disk
TIP:
Remember to name the file with the date and the report name. You may want to develop a standard naming convention within your district to help make locating and organizing data files easier.
• Print the report
See the Adobe Reader online help for details.
2. Close the browser window when you are done. Your session will still be active (depending on the time-out settings your Location Controller has set up).
46 Scantron Achievement Series User’s Guide
Changing Your Password
Changing Your Password
Your network specialist may ask you to change your password at certain intervals. Or, you may have forgotten your password and had your Location Controller reset it for you. Under either of these circumstances, you should change your password.
Password Requirements
Achievement Series passwords must:
• be at least six characters long
• contain at least one alphabetic or number character
(i.e., if your password is all letters, you must add a number and vice versa)
To change your password
In addition, we recommend that passwords:
• contain both upper and lowercase letters
• be something easily remembered, but not easily guessed (i.e., avoid your social security number, your birthdate, etc.)
• be changed occasionally for increased data security
1. Click Your Password from the Site Admin menu.
This opens the Change Your Password screen:
Administrator’sTeacher’s Version
2. Type your old password.
3. Type a new password, then type it again to confirm it.
47
Getting to Know Achievement Series
4. Click OK to save your new password. Use this password the next time you log in to Achievement
Series.
OR
Click Cancel to exit the Change Your Password screen without changing your password.
48 Scantron Achievement Series User’s Guide
Setting Up Personal Preferences
Setting Up Personal Preferences
Achievement Series allows you to set up several preferences. Any changes you make to these preferences affect only your login—anyone else will see their settings.
To set personal preferences
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Preferences at the top of the page:
This opens the My Preferences screen:
Administrator’sTeacher’s Version
NOTE:
Although three tabs appear, you may only work with the Preferences tab.
From here you can:
• Change how names and dates appear
• Indicate whether you want to or have been appointed to serve as a resource for other
Achievement Series users at your site
49
Getting to Know Achievement Series
To change appearance
• Indicate whether you want Scantron technical support to be able to access your account
• Set up your netTrekker d.i. login (if you are subscribed to this instructional resource and have a netTrekker d.i. account)
• Select which Achievement Series mailing lists you want to receive
NOTE:
Subscriptions allow you to get Achievement
Series information quickly and easily. We recommend everyone subscribe to System
Downtime.
From the Preferences screen (shown on page page 49):
1. Click Edit Appearance:
50 Scantron Achievement Series User’s Guide
Setting Up Personal Preferences
To display your contact info as a resource for internal support
To set up account access
2. Open the drop-down list and set how many items should appear on a page.
TIP:
The more items appear on a page, the fewer pages you may need to browse for long lists (like students). However, showing more items means you have to scroll up and down more. In addition, showing more items can cause page display to take longer.
3. Select a date format.
4. Select a name format.
5. Click OK to save your changes and return to the
Preferences screen.
OR
Click Cancel to return to the Preferences screen without saving your changes.
Change this setting if you are willing or have been designated to serve as a support resource for other
Achievement Series users at your site.
From the Preferences screen (shown on page page 49), click Toggle Internal Support or Click here to change
to “Yes”. Your name and email address will appear at the bottom of your district or school’s Achievement Series
Home page when this feature is implemented.
Change this setting if you are willing to allow Scantron technical support to access your account for troubleshooting purposes. Typically, you will only need to do this if requested to do so by Scantron technical support.
From the Preferences screen (shown on page page 49), click Set Up Account Access or Click here to change
to “Yes”. Scantron technical support will have access to your account for one calendar week, after which this setting will automatically revert to “No”.
Administrator’sTeacher’s Version 51
Getting to Know Achievement Series
To set up subscriptions
Change this setting if you want to receive information from Scantron about various Achievement Series events.
From the Preferences screen (shown on page page 49):
1. Click Manage Subscriptions:
2. Check the box next to the event(s) about which you want to receive information.
3. Specify the email address you want to use to receive these announcements. The email address from your staff account record (if you entered one) appears by default.
NOTE:
If you change your email address here, it will be changed in your staff account record as well.
4. Click OK to save your changes and return to the
Preferences screen.
OR
Click Cancel to return to the Preferences screen without saving your changes.
52 Scantron Achievement Series User’s Guide
To provide your netTrekker d.i. login
Setting Up Personal Preferences
Provide your login here, if your site subscribes to
Scantron’s Resources links and you have a netTrekker d.i. account. Providing your login enables you to access netTrekker d.i. resources from the Resources tab (see
“Using Resources” on page 201) and from a variety of
reports.
NOTE:Whether you need to supply login information depends on how your netTrekker d.i. account is set up.
Some netTrekker d.i. accounts require password login, and others are configured to automatically log you in based on your network address. Contact your site’s
Information Services group or Thinkronize, Inc. account representative for more information if you are not sure.
From the Preferences screen (shown on page page 49):
1. Click Edit NetTrekker login:
Administrator’sTeacher’s Version
2. Provide your netTrekker d.i. username and password.
CAUTION:
This setting passes existing account information only. If you do not already have a netTrekker d.i. account, please contact your site’s Information
Services group or Thinkronize, Inc. directly for assistance.
3. Confirm your password.
4. Click Save.
53
54
Getting to Know Achievement Series
Getting Help
To use online help
To access or upgrade this document
Software Training Classes
Achievement Series includes a help button on each screen. To access help, simply click the button and choose an item from the page that appears.
In addition, you can access the page to download this document by clicking the Documents button on any screen. Be sure to download a new version of this guide each time Scantron releases a new Achievement Series update.
Scantron Corporation has a fully staffed Corporate
Training & Professional Development Department that offers a variety of options for Achievement Series software training:
• on-line
• on-site at your location
• through public sessions held at the Scantron Training
Center in Irvine, CA
Some form of yearly training is recommended to account for both staff turnover and new product updates.
Scantron’s training team is dedicated to building capacity for change within an organization or institution through comprehensive end-user software training programs.
You may easily schedule training sessions through members of our Training Coordination team. Staff members may be reached by calling (800) 722-6876 extensions 7498 or 7531.
Scantron Achievement Series User’s Guide
Getting Help
Technical Support
Center
Call
FAX
Website/Email
Live CHAT
The Scantron Technical Support Department can provide product support in a variety of ways.
(800) 445-3141 between 5:30 A.M. and 4:30 P.M., Pacific Time,
Monday through Friday.
(949) 639-7710
Before contacting Technical Support, gather the following information:
• Scanner model number (if you are using a Scantron scanner)
• Scanner serial number (located on the back of the scanner)
• Type of computer you are using with the scanner (PC, PCcompatible, Macintosh, etc.)
• Computer operating system (Windows, UNIX, etc.)
• Steps required to reproduce the problem.
www.scantron.com
.
You can also choose GoToAssist Live CHAT, an instant messaging solution, for Technical Support. Live CHAT is available during Technical Support’s normal business hours from our website.
Go to www.scantron.com, click Support, then click CHAT
online with Technical Support.
Administrator’sTeacher’s Version 55
Getting to Know Achievement Series
NOTES
56 Scantron Achievement Series User’s Guide
4
Chapter 4:
Working with Item Banks
In this chapter:
Working with Item Banks . . . . . . . . . . . . . . . . . . . .page 58
Working with Items . . . . . . . . . . . . . . . . . . . . . . . . .page 59
Sharing Item Banks . . . . . . . . . . . . . . . . . . . . . . . . .page 60
Scantron Achievement Series User’s Guide 57
Working with Item Banks
Working with Item Banks
Item Banks are electronic filing cabinets for organizing test items. See Working with Items for details.
NOTE: Creating and editing item banks is available only if your district is using the District Assessment module.
If you are using the Classroom Testing module only, you may purchase item banks, but not edit them or create stored items for repeated use.
58 Scantron Achievement Series User’s Guide
Working with Items
Working with Items
Test items are the individual questions, answers, and reading passages students view and complete. See Working
with Items for details.
Teacher Version 59
60
Working with Item Banks
Sharing Item Banks
The creator of an item bank can share it with internal
District or School Staff to collaborate on the creation, editing, and review of items. You can also share item banks with other districts or classrooms (or other types of extra-district resources) to promote consistency within a state, for example.
NOTE: When item banks are ready to be used to create tests, you must share them with the appropriate locations.
Any teacher, administrator, or other role who may serve as test creators must be given at least Reviewer access to the item banks. Some of these roles may have access by default. See Understanding User Access
Rights on the Documents page for more information.
NOTE: You cannot set a user’s access rights lower than their default. For example, Location Controllers have Manager rights by default to any item banks created at that location. You cannot change any Location Controller’s access rights to Author or Reviewer.
Sharing within a District or School
Sharing within a district or school enables you and other users to collaborate with other district or school resources to review and validate items, or to collect additional items from other resources.
Project Idea: Create District
Item Banks for Teacher
Utilization District-wide
Solicit teachers (district-wide) to help in the creation of items to assess standards for a specific subject and grade.
After an open period in which teachers can submit items for consideration, the Item Banks will be ‘locked’ while the items are analyzed by a Curriculum Assessment team.
Best items will be retained, while other items will be modified as needed or deleted if deemed unacceptable.
Finally, the Item Banks will be made available to any in the
District to use in the creation of classroom assessments.
Scantron Achievement Series User’s Guide
To create item banks for the project idea
Sharing Item Banks
1. Create an item bank at the District level for a single subject/grade.
Example: Math Grade 2 Number Sense
2. Share the item bank with curriculum leaders as
Assigned Staff.
For example, share an item bank named “Math 2
Number Sense” with the Elementary Math Curriculum
Directors. Give these people Author access.
3. Share the item bank globally with teachers. Select
Location Access: Author.
This option actually gives all teachers in the District unlimited access to the item bank in order to add, modify and delete items. You should only notify the appropriate subject/grade level teachers to contribute to specific item banks.
4. Provide guidelines to teachers for creating items:
• Provide specific naming conventions for Item
IDs, Item Names, Keywords.
• Specify the item properties to select or set up.
• Specify any special formatting conditions.
5. After a designated cutoff date, modify access level to
Assigned Staff Only.
Now the Assigned Staff (Elementary Math Curriculum Directors, for example) will review all items and will determine the final set of items.
6. When the Item Bank is ready to release to globally to teachers to use in creating classroom tests, then share as follows: Location Access: Author.
Teacher Version 61
Working with Item Banks
To view sharing
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Item Banks.
3. Click the name of the item bank to be shared.
4. Click Share:
From here you can:
•
Edit the item bank sharing options (see “To edit an item bank’s sharing options”, below)
• Edit the list of staff allowed to access the item
bank (see “To edit an item bank’s access list” on page 63)
• Export the list of staff who may access the item
bank (see “Exporting Data” on page 44)
62 Scantron Achievement Series User’s Guide
To edit an item bank’s sharing options
Sharing Item Banks
From the Item Bank Share screen (shown above):
1. Click Edit Sharing Option:
To edit an item bank’s access list
2. Choose a sharing option. See the online help for details on the sharing options.
3. Click OK to save your changes and return to the Item
Share screen.
OR
Click Cancel to return to the Item Share screen without saving your changes.
From the Item Bank Share screen (shown on page 62):
1. Click Edit Access List:
Teacher Version
2. (Optional) Export the list (see “Exporting Data” on page 44).
63
Working with Item Banks
3. Click Edit Staff:
4. Type the first few characters of a staff member’s first or last name, or select a different search criterion.
5. Click Search. Achievement Series searches the staff records for this location and any subordinate locations and displays any matching the characters you typed
64
6. (Optional) Export your search results (see “Exporting
7. Choose a new access level for the user. See the online help for details on the access levels.
Scantron Achievement Series User’s Guide
Distribution agreement
Sharing Item Banks
8. Check Assign New Access Level to assign the access level you select to the user(s).
TIP:
If the users all appear on the same search results page, simply check each user; the access level you
chose in step 7 on page 64 is applied to each of
them.
9. (Optional) Repeat steps 5 through 8 for any other staff
who should be able to access this item bank.
10. Click Close when you are finished.
Sharing with Remote Users
Item banks can be shared for collaborative purposes or for the recipient to use in the creation of tests. There are two ways to share with remote users:
• Remote Share allows users from other districts or schools to use and collaborate on your item bank. The item bank is still hosted at your site, and you retain control over its development.
• Remote Copy sends an independent copy of the item bank to the specified recipient. Your copy of the item bank remains at your site and you retain control. However, the copy of the bank you send becomes independent. The copy will not contain any changes you make to the bank unless you send a new copy. Any new items added by the recipient to the copy will not appear in the original bank. The recipient may or may not be able to share the Item Bank Copy with other remote users, based on the level of access that you assign to the shared copy.
You may only share with other Achievement Series users.
Whichever option you choose above, you must agree to the following to remotely share an item bank:
• I own the material, or I have written permission from the authors to freely distribute it.
• The material, or any subset of the material, is not copyrighted by any party.
Teacher Version 65
Working with Item Banks
To view remote share settings
• I have the right to distribute the material without restriction to a third party.
• I agree with the terms listed in my Achievement Series
User Agreement and the online Terms of Use.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Item Banks.
3. Click the name of the item bank to be shared.
4. Click Remote Share:
66
Before you share
From here you can:
•
Share the item bank with remote users (see “To share an item bank with remote users” on page 67)
• Send a copy of the item bank to remote users (see
“To send a copy of an item bank to remote users” on page 68)
•
Edit the share options (see step 6 on page 67 for
share options)
• Drop the share
• Export the list existing remote shares may access
the item bank (see “Exporting Data” on page 44)
You must have the following information for the recipient:
• Site ID
• Staff ID
Scantron Achievement Series User’s Guide
To share an item bank with remote users
Sharing Item Banks
From the Remote Share screen (shown on page 66):
1. Click Create Remote Share:
2. Read and agree to the distribution agreement.
CAUTION:
Do not agree if you cannot certify ownership or permission to distribute the items in the item bank. You will not be able to share copyrighted item banks your site has purchased.
3. Click Next:
Teacher Version
4. Type the site ID of the location with which you would like to share this item bank.
5. Type the staff ID of a contact user.
NOTE:
This user must have a valid login at the site you entered in the previous step.
6. Choose a share type. See the online help for details on the share types.
67
Working with Item Banks
7. Click Next. Achievement Series validates the site and contact IDs. If they are correct, Achievement Series displays the following screen:
To send a copy of an item bank to remote users
If they are not correct, Achievement Series prompts you to change the incorrect values.
8. Click Done.
From the Remote Share screen (shown on page 66):
1. Click Create Remote Copy:
2. Read and agree to the distribution agreement.
CAUTION:
Do not agree if you cannot certify ownership or permission to distribute the items in the item bank. You will not be able to share copyrighted item banks your site has purchased.
68 Scantron Achievement Series User’s Guide
Sharing Item Banks
3. Click Next:
4. Enter a new name for the item bank.
5. Type the location ID of the location to which you would like to copy this item bank.
6. Type the staff ID of a contact user.
NOTE:
This user must have a valid login at the site you entered in the previous step.
7. Choose a copy type. See the online help for details on the copy types.
8. Click Next. Achievement Series validates the site and contact IDs. If they are correct, Achievement Series displays the following screen:
Teacher Version
If they are not correct, Achievement Series prompts you to change the incorrect values.
9. Click Done.
69
Working with Item Banks
To share several item banks at once within your site
Sharing Several Item Banks at the Same Time
Achievement Series also allows you to share multiple items banks with multiple users at the same time, making it faster and easier than ever to work collaboratively. You can share several individual item banks simultaneously, or you can put all your sharable item banks in a folder and share all the item banks in folder (see Working with Items for more information on organizing your item banks into folders).
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Item Banks.
3. Click Share in the Item Banks menu on the left-hand side of the screen (shown in the margin):
70
From here you can:
•
Edit the item banks’ sharing options (see “To edit multiple item banks’ sharing options” on page 71)
• Add to the list of staff allowed to access the item
banks (see “To add to the list of staff allowed to access multiple item banks” on page 73)
• Remove staff from the list of those allowed to
Scantron Achievement Series User’s Guide
Sharing Item Banks
To edit multiple item banks’ sharing options
From the Share Item Banks screen (shown on page 70):
1. Click Select Sharing Option:
Teacher Version
2. Navigate to the folder containing the item banks you want to share.
See “Working with Folders” on page 35 for more
information on navigating through folders.
NOTE:
You can only share item banks from one folder at a time.
3. Using the list, select item bank(s) you want to share.
TIP:
if you want to share item banks that have been remotely shared with you by another site, select
Remote Locations in the List Filter. Your default rights may differ depending on whether the item bank is local to your district/school or has been shared with you from another district/school.
NOTE:
If the item bank does not display a check box, you do not have rights to share that item bank.
71
Working with Item Banks
4. Click Next:
5. Choose a sharing option. See the online help for details on the sharing options.
6. Click Next:
72
7. Review the sharing changes.
8. Click OK.
Scantron Achievement Series User’s Guide
To add to the list of staff allowed to access multiple item banks
Sharing Item Banks
From the Share Item Banks screen (shown on page 70):
1. Click Select Sharing Option:
Teacher Version
2. Navigate to the folder containing the item banks you want to share.
See “Working with Folders” on page 35 for more
information on navigating through folders.
NOTE:
You can only share item banks from one folder at a time.
3. Using the list, select item bank(s) you want to share.
TIP:
if you want to share item banks that have been remotely shared with you by another site, select
Remote Locations in the List Filter. Your default rights may differ depending on whether the item bank is local to your district/school or has been shared with you from another district/school.
NOTE:
If the item bank does not display a check box, you do not have rights to share that item bank.
73
Working with Item Banks
4. Click Next:
5. Type the first few characters of a staff member’s first or last name, or select a different search option. See the online help for details on these options.
6. Click Next. Achievement Series searches the staff records for this location and any subordinate locations and displays any matching the search you specified
74
7. Using the list, select the specific users whose access level should be changed.
NOTE:
If the user does not display a check box, you cannot change their rights.
Scantron Achievement Series User’s Guide
Sharing Item Banks
8. Choose a new access level for the users. See the online help for details on the access levels.
9. Click Next:
To remove staff from the list of those allowed to access the item banks
10. Review the sharing changes.
11. Click OK.
From the Share Item Banks screen (shown on page 70):
1. Click Remove Staff from Access Lists:
Teacher Version 75
Working with Item Banks
2. Navigate to the folder containing the item banks you want to restrict sharing.
See “Working with Folders” on page 35 for more
information on navigating through folders.
NOTE:
You can only share item banks from one folder at a time.
3. Select the item banks to be restricted.
NOTE:
If the item bank does not display a check box, you do not have rights to share that item bank.
4. Click Next:
76
NOTE:
This list presents all the individual users who have rights to the selected item banks. The list may be lengthy; this example shows a partial list.
5. Select the users whose access to this item bank should be removed.
NOTE:
If the user does not display a check box, you cannot change their rights.
Scantron Achievement Series User’s Guide
6. Click Next:
Sharing Item Banks
To share several item banks at once with other sites
(remote share)
7. Review the sharing changes.
8. Click OK.
NOTE: See the notes regarding remote sharing on page 65.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Item Banks.
3. Click Share in the Item Banks menu on the left-hand side of the screen (shown in the margin).
4. Click Remote Share:
Teacher Version 77
Working with Item Banks
To share multiple item banks with remote users
From here you can:
•
•
• Send a copy of the item bank to remote users (see
“To create and send a copy of multiple item banks to remote users” on page 82)
From the Share Item Banks Remotely screen (shown on
1. Click Create Remote Shares:
78
2. Read and agree to the distribution agreement.
CAUTION:
Do not agree if you cannot certify ownership or permission to distribute the items in the item bank. You will not be able to share copyrighted item banks your site has purchased.
Scantron Achievement Series User’s Guide
Sharing Item Banks
3. Click Next:
4. Navigate to the folder containing the item banks you want to share.
See “Working with Folders” on page 35 for more
information on navigating through folders.
NOTE:
You can only share item banks from one folder at a time.
5. Using the list, select item bank(s) you want to share.
NOTE:
If the item bank does not display a check box, you do not have rights to share that item bank.
6. Click Next:
Teacher Version
7. Type the site ID of the location with which you would like to share this item bank.
79
Working with Item Banks
8. Type the staff ID of a contact user.
NOTE:
This user must have a valid login at the site you entered in the previous step.
9. Choose a share type. See the online help for details on the share types.
10. Click Next. Achievement Series validates the site and contact IDs. If they are correct, Achievement Series displays the following screen:
If they are not correct, Achievement Series prompts you to change the incorrect values.
11. Review the list of item banks.
12. Click OK.
80 Scantron Achievement Series User’s Guide
Sharing Item Banks
To remove sharing from multiple item banks you have remotely shared with another site
From the Share Item Banks Remotely screen (shown on
1. Click Drop Remote Item Banks:
2. Navigate to the folder containing the item banks you want to drop.
See “Working with Folders” on page 35 for more
information on navigating through folders.
NOTE:
You can only drop item banks from one folder at a time.
3. Using the list, select item bank(s) you want to drop.
NOTE:
If the item bank does not display a check box, you do not have rights to drop that item bank.
4. Click Next:
Teacher Version
5. Review the item banks to be dropped.
CAUTION:
Once you click OK, the selected item banks are no longer available to the site(s) with whom you
81
Working with Item Banks
To create and send a copy of multiple item banks to remote users previously shared them. Any tests they have created still contain the items, but they can no longer add items from that bank to new tests.
6. Click OK.
From the Share Item Banks Remotely screen (shown on
1. Click Create Remote Copies:
2. Read and agree to the distribution agreement.
CAUTION:
Do not agree if you cannot certify ownership or permission to distribute the items in the item bank. You will not be able to share copyrighted item banks your site has purchased.
3. Click Next:
82 Scantron Achievement Series User’s Guide
Sharing Item Banks
4. Navigate to the folder containing the item banks you want to share.
See “Working with Folders” on page 35 for more
information on navigating through folders.
NOTE:
You can only share item banks from one folder at a time.
5. Using the list, select item bank(s) you want to share.
NOTE:
If the item bank does not display a check box, you do not have rights to share that item bank.
6. Click Next:
Teacher Version
7. Type the site ID of the location with which you would like to share this item bank.
8. Type the staff ID of a contact user.
NOTE:
This user must have a valid login at the site you entered in the previous step.
9. (Optional) Provide text to be added to the end of the name of the shared copy.
TIP:
If you are creating remote copies of item banks to be shared within your location as a workaround for duplicating item banks, add a suffix to prevent the item banks from having the same names as the existing item banks.
83
Working with Item Banks
10. Choose a share type. See the online help for details on the share types.
11. Click Next. Achievement Series validates the site and contact IDs. If they are correct, Achievement Series displays the following screen:
If they are not correct, Achievement Series prompts you to change the incorrect values.
12. Review the list of item banks.
13. Click OK.
84 Scantron Achievement Series User’s Guide
5
Chapter 5:
Creating and Managing Tests
In this chapter:
Working with Classroom Tests . . . . . . . . . . . . . . . .page 86
Working with ExamView Tests . . . . . . . . . . . . . . .page 134
Scantron Achievement Series User’s Guide 85
86
Creating and Managing Tests
Working with Classroom Tests
NOTE: This feature is only available if your school or district has the Classroom Testing module. You must have at least one course/class set up to create tests.
According to a national study by the Boston College
Center for the Study of Testing, Evaluation, and
Educational Policy:
1
• 4th grade teachers spend, on average, 2.2 hours a week preparing student tests or exams.
• 8th grade teachers spend an average 2.7 hours per week preparing student tests or exams.
With the District Assessment module’s ability to collaborate on the development of and store digital, editable test items, and with the availability of any copyrighted item banks (such as Scantron) your school or district has licensed, you will be able to reduce the amount of time spent preparing student tests by streamlining the test creation/delivery process.
In traditional test delivery, a test is only administered as a single form pencil-and-paper test. If you wanted to create multiple versions of a test, either to randomize questions/ answers to reduce cheating, or to modify questions for students with special needs, you used to have to do so manually, which is tedious and inefficient enough to discourage most teachers from doing so at all.
By using an online test management system like
Achievement Series with the District Assessment module,
Classroom Testing module, and/or licensed item banks, those time consuming and inefficient tasks become automated and efficient.
NOTE: If you are a classroom teacher, but have access to the
District Tests tab, download the Administrator Version of the User’s Guide from Achievement Series web site for detailed information about how to work with District Tests.
1. Retrieved December 28, 2005, from http://www.bc.edu/research/csteep
Scantron Achievement Series User’s Guide
To list classroom tests
Working with Classroom Tests
Listing Classroom Tests
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Classroom:
Teacher Version
From here you can:
• Create, edit, and delete tests
• View tests you have created and tests other teachers have shared with you
• Activate tests you have created and tests other
teachers have shared with you (see “Activating
•
View classroom reports (see “Viewing Reports” on page 155)
•
Sort the list (see “Using Lists” on page 34).
•
Export the list (see “Exporting Data” on page 44).
NOTE:
Tests archived as part of the year-end rollover process do not appear on this screen. If you need to re-use a test from a previous year, copy the test
first (see “To copy a shared test” on page 130).
Creating Tests
Achievement Series provides five ways to create tests:
• Quick Pick, which allows you to create tests by having Achievement Series randomly select items based on criteria you choose. This test creation option can only be used if you have access to the Scantron item banks or other purchased item banks.
87
Creating and Managing Tests
88
• Normal, which allows you to individually choose each question from one or more item banks or by searching based on specific standards or keywords. You can also use this method to create a test from scratch without using item banks.
• Answer Key Only (AKO), which allows you to create tests by setting up an answer key to match an external test. Achievement Series item banks are not used.
AKO tests have a couple of caveats:
• You may include multiple choice, short response, extended response, and true/false items only (you may not include multiple response or gridded response items).
• You must create scanner forms tests (AKO does not support online testing).
• Duplicate Tests, which allows you to create a new test based on an existing one. Use this option if you want to create variations on a test and add or remove items (as opposed to versions of a test, which contain the same items, but in a different order, to prevent cheating).
• ExamView, which allows you to create tests using
ExamView’s test creation engine and import them into
Achievement Series. See “Working with ExamView
Tests” on page 134 for details.
Using Quick Pick
Quick Pick allows you to create tests quickly, using a random selection of items by searching specific item banks. Quick Pick automatically specifies the default
values for test options (see “Using Normal” on page 94
for details).
NOTE: You should only use this option if you have access to district item banks.
After you have created and saved a quick pick test, you may add additional items, change test properties, or simply schedule the test.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
To create a test with Quick
Pick
From the Classroom screen (shown on page 87):
1. Click Create from the Tests menu:
This opens the first Create a Test Draft screen:
2. Click Quick Pick:
Teacher Version
3. Enter the necessary information. See the online help for details.
89
Creating and Managing Tests
4. Click Next:
5. Choose a class to take the test. You will only see the classes to which you are assigned. Click Next:
90
6. Check or clear which types of items you want included.
CAUTION:
Extended Response items cannot be automatically scored. Do not include them for online tests.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
7. Specify a grade level or grade range.
TIP:
To specify a single grade level, select the same value from both grade lists.
TIP:
If you plan to search Scantron item banks by standard, consider leaving the grade range open. Scantron items have grade levels attached based on national averages, which may be slightly different that the grade for your state. Searching by standard will automatically filter the items to those that match the grade levels for standards you select.
8. Specify a subject area.
9. Check the box next to the name(s) of the item bank(s) you want to search.
10. Click Next:
Teacher Version
11. Select the number of items per standard you would like Achievement Series to find and select.
12. Select a standards document to search.
13. Specify any terms or phrases for which you want to search in the standards document.
CAUTION:
If you choose to search standards documents for terms or phrases, you must type the complete keyword exactly as it appears in the standard. Do not use wildcards (*, ?), partial words, or variants
91
Creating and Managing Tests on the word. For example, searching for “paragraphs” may not include any specific results, but searching for “paragraph” (the exact term used in the standard) will.
14. Click Search.
Achievement Series scans the standards document you selected in step 12 for any standards including the specified terms or phrases. Only standards matching your criteria appear:
92
NOTE:
Standards results can be lengthy; this screen shows a partial list.
15. Check the box(es) next to the specific standard(s) attached to items you want to include on the test.
NOTE:
Boxes appear only for matching standards with available items. If a standard matches your criteria but is not associated with any items, the checkbox does not appear.
TIP:
Drill down through the standards by clicking + to open a standard or - to close a standard.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
16. (Optional) Repeat steps 12 through 15 for any additional standards you want to include. The standards from your previous search remain selected.
17. Click Next. Achievement Series searches the selected item bank(s) for items attached to the selected standards and displays a list of matching items:
Teacher Version
NOTE:
Item results can be lengthy; this screen shows a partial list.
18. (Optional) Click Get Alternate if you want to include a different variation on the item displayed.
19. Check the box(es) next to the item(s) you want to include in your test.
CAUTION:
Extended Response items cannot be automatically scored. Do not include them for online tests.
20. Complete the test draft:
• Click Previous as many times as necessary to change any information you entered in previous steps.
• Click Cancel to scrap your work and start over.
93
Creating and Managing Tests
• Click Save to save the test:
To create a test with Normal
21. Select your next activity:
• Click Manually Edit… to add additional items to
your test draft. See “Editing Tests” on page 109.
• Click Create another test to begin again and create a new test.
• Click Close to return to the Tests screen.
Using Normal
Normal tests take longer to create than Quick Pick, but allow you to specify testing options and items individually.
Use this option if you plan to manually create items instead of searching district item banks.
From the Classroom screen (shown on page 87):
1. Click Create from the Tests menu:
This opens the first Create a Test Draft screen:
94 Scantron Achievement Series User’s Guide
2. Click Normal:
Working with Classroom Tests
Teacher Version
3. Enter the necessary information. See the online help for details.
4. Click Next:
95
Creating and Managing Tests
5. Choose a class to take the test. You will only see the classes to which you are assigned. Click Next:
96
6. Enter the necessary information. See the online help for details.
7. Complete the test draft:
• Click Previous as many times as necessary to change any information you entered in previous steps.
• Click Cancel to scrap your work and start over.
Scantron Achievement Series User’s Guide
• Click Save to save the test draft:
Working with Classroom Tests
To automatically find content
8. Select your next activity:
• Click Automatically Find Content… to browse items banks for content that specifically relates to
your test draft. See “To automatically find content” on page 97.
• Click Manually Edit… to create items to add to the test or to add additional items to your test
draft. See “Editing Tests” on page 109.
• Click Close to return to the Test Drafts screen.
From the last test creation screen (shown above):
1. laClick Automatically Find Content…:
Skip to step 2 on page 99 if you do not want to search
available standards to find items for this test.
OR
Teacher Version 97
Creating and Managing Tests
Click Search Standards to choose items based on standards:
a. Select a standards document to search.
b. (Optional) Specify any terms or phrases for which you want to search in the standards document.
CAUTION:
If you choose to search standards documents for terms or phrases, you must type the complete keyword exactly as it appears in the standard. Do not use wildcards (*, ?), partial words, or variants on the word. For example, searching for “paragraphs” may not include any specific results, but searching for “paragraph”
(the exact term used in the standard) will.
c. Specify the grade range to search.
d. Click Search.
Achievement Series scans the standards document
you selected in step a for any standards including
the specified terms. Only standards matching your search criteria appear:
98
NOTE:
Standards results can be lengthy; this screen shows a partial list.
Scantron Achievement Series User’s Guide
Teacher Version
Working with Classroom Tests
e. Check the box(es) next to the specific standard(s) attached to items you want to include on the test.
NOTE:
Boxes appear only for matching standards with available items. If a standard matches your criteria but is not associated with any items, the checkbox does not appear.
TIP:
Drill down through the standards by clicking
+ to open a standard or - to close a standard.
f. Click OK. The standards you selected appear in the list.
g. If the list of standards is complete, click Close.
OR
Click Add Standards and repeat steps a through e
for any additional standards you want to include.
The standards from your previous search remain selected.
2. Click Next:
99
Creating and Managing Tests
100
3. Check or clear which types of items you want included.
CAUTION:
Extended Response items cannot be automatically scored. Do not include them in your online tests.
4. (Optional) Enter keywords that have been attached to the items.
TIP:
Go to the Documents page to access keyword indexes for the Scantron Item Bank. These lists specify which keywords have been attached to the items. Multiple keywords must be from the same hierarchy and should be separated by a comma (no spaces).
TIP:
When searching Scantron Item Banks, you can search by Bloom’s cognitive level. Use CAT 1 for
Knowledge/Comprehension/Remember/Understand, CAT 2 for Application/Analysis/Apply/
Analyze, and CAT 3 for Synthesis/Evaluation/
Evaluate/Create.
TIP:
If you are using the Scantron Item Bank or another item bank where the item names represent the skill or concept for each item, you can leave the keyword field blank. When you get to the results page, use the Index dropdown menu to locate items that cover a particular skill.
NOTE:
If you do not see an Index, cancel and go to
Preferences. Verify that you have not chosen to display “unlimited” items per page.
5. Specify a grade level or grade range.
TIP:
To specify a single grade level, select the same value from both grade lists. If searching Scantron Item
Banks, keep the grade range somewhat open since grade levels assigned to items may not match grade levels for your state.
6. Specify a subject area.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
7. Check the box next to the name(s) of the item bank(s) you want to search.
NOTE:
You do not need to search through your folders to locate specific item banks. When you chose
standards in step on page 97, you automatically
filtered this list of item banks to include only those banks including items related to the standards.
8. Click Next:
Teacher Version
9. Check the boxes next to items to include on the test.
NOTE:
If you selected standards in step 1, only items
matching the standards you select will be listed. If you did not select standards, all items in the item bank will be listed.
10. Complete the item selection:
• Click Preview to view the item content (see “To preview items” on page 112).
• Click Previous as many times as necessary to change any information you entered in previous steps.
• Click Cancel to scrap your work and start over.
• Click Save to save the test draft.
11. Click Close.
101
Creating and Managing Tests
To create an Answer Key Only test
Creating an Answer Key Only
The Answer Key Only (AKO) test option allows you to create tests by setting up an Answer Key to match an external test. Achievement Series Item Banks are not used.
NOTES:
• AKO can include multiple choice, short response, extended response, and true/false items only. You may not include multiple response or gridded response items.
• You can only create scanner forms tests using this option. AKO does not support online testing.
From the Classroom screen (shown on page 87):
1. Click Create from the Tests menu:
This opens the first Create a Test Draft screen:
2. Click Answer Key and set your test options:
102 Scantron Achievement Series User’s Guide
Teacher Version
Working with Classroom Tests
a. Type a test name.
TIP:
Consider including grade/subject information in the test name.
b. To restrict who may edit the test, check Check
here for private mode. You will be the only user able to view or edit this test.
CAUTION:
Once you check this box, only you will be able to view, publish, or schedule the answer key test. There is no way to change this status; if you save an answer key as Private and later want to allow others to work with it you must recreate the test and leave this box unchecked.
c. Choose whether the test form uses A-E as answer choices for odd-numbered questions and F-K as answer choices for even-numbered questions.
d. laChoose whether the test uses standard sequential numbering or custom numbering that you provide.
e. Specify a date for the test.
3. Click Next:
103
Creating and Managing Tests
4. Choose a class to take the test. You will only see the classes to which you are assigned. Click Next:
5. (Optional) Attach standards to your answer key:
a. Select a standards document to search. This list contains any standards associated with the location.
b. (Optional) Specify any terms or phrases for which you want to search in the standards documents.
c. Specify a grade range.
d. Click Search.
Achievement Series scans the standards including the specified terms. Only standards matching your criteria appear:
104
NOTE:
Standards results can be lengthy; this screen shows a partial list.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
e. Check the box(es) next to the specific standard(s) attached to items you want to include on the test.
NOTE:
Boxes appear only for matching standards with available items. If a standard matches your criteria but is not associated with any items, the checkbox does not appear.
TIP:
Drill down through the standards by clicking
+ to open a standard or - to close a standard.
f. Repeat steps a through e for any additional stan-
dards you want to include. The standards from your previous search remain selected.
6. Click Next:
Teacher Version
7. Set up the first item in your answer key:
a. (Optional, if you chose Custom Numbering at
step d) Provide a custom number for the item.
Achievement Series labels the questions internally with sequential numbers, but displays the numbering you provide here.
TIP:
Print a Test Details Report (see “To print a
Test Details report” on page 119) when using
custom numbering to use as a reference for which sequential numbers in the reports relate to the custom labels on the actual test.
105
Creating and Managing Tests
106
b. Look at your copy of the external test. Select the type of answer a student should provide. Choose from:
• Multiple Choice
• Extended Response
• Short Response
• True/False
See Working with Items or the online help for details on these answer types.
c. Choose the appropriate item elements.
Which elements are required differs for each item type. See the online help for details.
d. Select the number of points this item is worth.
e. Select one or more standards from the lists. You can choose up to three standards for each item.
NOTE:
If you did not select a standards document in the previous screen, this list will not display standards.
f. Click to add the item:
8. Repeat the previous step for each item on the external test.
For items after the first one, you can specify the order by choosing an insert type. For items after the second item, you can also specify a position number. For example, if you need to insert an item in front of the third item, you would select Position Number 3 and
Insert Type Before. The default is to add the new item to the end of the list.
9. Click Done.
Scantron Achievement Series User’s Guide
To create a duplicate test
Working with Classroom Tests
Creating a Duplicate Test
Creating duplicate tests allows you to leverage the work you’ve done previously to create a test. Create duplicate tests when you want to give a test similar to a test you’ve already created, but with some differences.
For example, you could create a unit pretest, then make a duplicate to create a unit post-test. Or, if you teach several classes of the same subject, you could create a test for your first period class, and make a duplicate with changes for your second period class.
Once the test is duplicated, you can list, edit or delete it like any other test.
From the Classroom screen (shown on page 87):
1. Click Create from the Tests menu:
This opens the first Create a Test Draft screen:
2. Click Duplicate Test:
Teacher Version 107
Creating and Managing Tests
3. Choose a test to duplicate and click Next:
108
4. Choose a class to take the test. You will only see the classes to which you are assigned. Click Next:
5. Type a test name.
6. Specify the date you will administer the test to the class.
7. Click OK.
Scantron Achievement Series User’s Guide
To view a test
Working with Classroom Tests
Editing Tests
You can add items or change test properties on inactive tests that have not been administered.
From the Classroom screen (shown on page 87), click a
test name:
Which options and tabs appear depends on your access rights.
These items have associated standards.
From here you can:
• Work with the test items
• Create or delete test sections
• Preview the test content
• Edit various test properties
Teacher Version 109
Creating and Managing Tests
To work with test content
From the Test screen (shown on page 109), click Content
(if necessary). Each test item and test section shows a
Quick Menu icon. Hover your mouse over that icon to view the menu:
• Test Item Quick Menu
• Test Section Quick Menu:
110
To add items
From the Test Content screen (shown on page 109):
1. Click one of the following:
• Insert from Item Bank
• Create Item
OR
Hover your mouse over an item or section quick menu and click:
• Create an item at the top/bottom of this section
• Create an item above/below this item
• Duplicate this item and insert it above/below this item
Scantron Achievement Series User’s Guide
To edit items
To move items
Working with Classroom Tests
2. Follow the instructions in Working with Items.
NOTES:
• Some item creation options are not available when you create items within a test.
• The item will appear on this test only; it is not added to the item bank.
From the Test Content screen (shown on page 109):
1. Click the edit item icon (shown in the margin).
2. Follow the instructions in Working with Items.
NOTE:
If you make changes to an item in the test editor, that change is reflected only for the test draft. No other test drafts are affected, nor is the original item in the item bank changed.
CAUTION:
If you change an item’s passage, the test editor will assign that item and passage to a new section.
If you want to change the passage for an entire section of items, you must make the same change to the passage for each item.
From the Test Content screen (shown on page 109):
1. Click Move Items:
Teacher Version
2. Scroll up or down in the window until the item you want to move appears.
111
Creating and Managing Tests
To preview items
3. Type a number for the item’s position in the test, the click Update.
OR
Click a move button:
This button Moves the item
To the top of the test draft
Above the previous item
Below the following item
To the end of the test
Repeat until the item is in the position you want.
4. Click Close.
From the Test Content screen (shown on page 109), open
the item quick menu and click Preview this item:
112
Click Close when you are finished.
Scantron Achievement Series User’s Guide
To delete items from a test
Working with Classroom Tests
From the Test Content screen (shown on page 109):
1. Click Delete Items:
Teacher Version
TIP:
You can also click Delete this item from the item quick menu.
2. Check the box next to the name of the item(s) you want to delete from the test and click Next.
3. Review the item(s) set for deletion:
• If the list is correct, click OK.
CAUTION:
Once you click OK, the items are permanently removed from the test. If you deleted an item in error, you will need to re-create it
(see “To add items” on page 110).
• If it is incorrect, click Previous and adjust your selection(s).
• If you decide to keep the item(s), click Cancel.
113
Creating and Managing Tests
To add item sections
At least one item section is created by default for each test.
to group similar types of questions (e.g., all True/False questions, or all questions that relate to a particular passage or exhibit). That way, you can include special instructions for each section.
From the Test Content screen (shown on page 109):
1. Click one of the following:
• On the Content tab: Create Section
• From the test section quick menu:
• Insert a new section at the top/bottom of the test
• Insert a new section above/below this section
Any of these actions opens the Create Section screen:
114
2. Enter the necessary information. See the online help for details.
3. Click OK to save the section and return to the Test screen.
OR
Click Cancel to return to the Test screen without saving the section.
Scantron Achievement Series User’s Guide
To edit item sections
Working with Classroom Tests
From the Test Content screen (shown on page 109):
1. Click the edit section icon (shown in the margin):
To duplicate a section
TIP:
You can also click Edit Section Properties from the section quick menu.
2. Edit the section properties as described on page 114.
3. Click OK to save the section and return to the Test screen.
OR
Click Cancel to return to the Test screen without saving the section.
From the Test Content screen (shown on page 109):
1. Click Duplicate this section and insert it above/
below the current section from the section quick menu.
2. Adjust the items in the section as necessary. See “To edit items” on page 111.
Teacher Version 115
Creating and Managing Tests
To move sections
From the Test Content screen (shown on page 109):
1. Click Move Sections:
116
2. Scroll up or down in the window until the section you want to move appears.
3. Click a move button:
This button Moves the section this way
To the top of the test draft
Above the previous section
Below the following section
To the end of the test
Repeat until the section is in the position you want.
4. Click Close.
Scantron Achievement Series User’s Guide
To delete a section
Working with Classroom Tests
From the Test Content screen (shown on page 109):
1. Click Delete Sections:
Teacher Version
TIP:
You can also click Delete this section from the section quick menu.
2. Check the box next to the name of the section(s) you want to delete from the test and click Next.
3. Review the section(s) set for deletion:
• If the list is correct, click OK.
CAUTION:
Once you click OK, the section and all the
items in it are permanently removed from the test. If you deleted a section in error, you will
need to re-create it (see “To add item sections”
on page 114) and add items to it (see “To add items” on page 110).
• If it is incorrect, click Previous and adjust your selection(s).
• If you decide to keep the section(s), click Cancel.
117
Creating and Managing Tests
To preview a paper test form
Often you can catch typos and other errors better on paper than you can online.
TIP: Scantron recommends that a Staff member take the test to confirm that appropriate items have been selected and that the correct answers have been accurately marked. Based on a careful review, the Test can be edited as needed before being activated for administration to the students.
From the Test Content screen (shown on page 109):
1. Click Paper Test Form:
118
2. Set the print options. See the online help for details.
NOTE:
If you added items that were created using a custom font, those items will keep the font selected during item entry instead of the global font chosen here.
3. Click Next:
4. Click one of the following options:
• View Paper Test form next to PDF Link to open
Adobe Reader and view, save, or print the form.
See the Adobe Reader documentation or online help for details.
Scantron Achievement Series User’s Guide
To print a Test Details report
Working with Classroom Tests
• View Paper Test form next to Word Link to open Microsoft Word (or any application capable of reading an RTF file) and view, edit, save, or print the form. See your word processor’s documentation or online help for details.
5. Click Close.
6. Review the printed draft.
The Test Details report presents detailed statistics on the results of the test (such as P-Value, discrimination index, etc.). For details on interpreting these results, see
“Understanding Item Statistics Detail” on page 156.
From the Test Content screen (shown on page 109):
1. Click Test Details:
Teacher Version
2. Check the elements you want to include in the report.
119
Creating and Managing Tests
3. Click Next:
To view test properties
4. Click View PDF for Items… to open Adobe Reader and view, save, or print the report. See the Adobe
Reader documentation or online help for details.
NOTE:
All answer choices are mapped to A-E. If you chose alternating answer choices for the test, you will still see answers A-E on this report.
5. Click Close.
From the Test screen (shown on page 109) click
Properties:
120
From here you can:
• Edit draft properties
• Delete the test draft
Scantron Achievement Series User’s Guide
To edit test properties
Working with Classroom Tests
From the Test Properties screen (shown on page 120):
1. Click Edit Draft Properties:
To delete a test
2. Edit the properties as described in the online help.
NOTE:
You cannot edit the test delivery method.
3. Click OK to save your changes and return to the Test
Properties screen.
OR
Click Cancel to return to the Test Properties screen without saving your changes.
From the Test Properties screen (shown on page 120):
1. Click Delete Test:
Teacher Version
2. Review the test set for deletion:
• If you want to delete this test, click OK.
121
Creating and Managing Tests
To view test options
CAUTION:
Once you click OK, the test is permanently removed. If you deleted a test in error,
you will need to re-create it (see “Creating
• If you decide to keep the test, click Cancel.
From the Test screen (shown on page 109) click Options:
122
From here you can edit test options.
Scantron Achievement Series User’s Guide
To edit test options
Working with Classroom Tests
From the Test Options screen (shown page 122):
1. Click Edit Test Options:
Teacher Version
2. Edit the options as described in the online help.
3. Click OK to save your changes and return to the Test
Options screen.
OR
Click Cancel to return to the Test Options screen without saving your changes.
123
Creating and Managing Tests
To share tests
To view sharing
Share classroom tests to validate them and allow other school users to copy your tests for use in their classrooms
(see “Working with Shared Tests” on page 128).
From the Test screen (shown on page 109) click Share:
124
To edit the sharing options
From here you can:
•
Edit the test draft sharing options (see “To edit the sharing options” on page 124)
• Edit the list of staff allowed to access the test draft
(see “To edit the access list” on page 125)
• Export the list of staff who may access the test draft
(see “Exporting Data” on page 44)
From the Test Share screen (shown on page 124):
1. Click Edit Sharing Option:
2. Choose a sharing option. See the online help for details.
Scantron Achievement Series User’s Guide
To edit the access list
Working with Classroom Tests
3. Click OK to save your changes and return to the Test
Share screen.
OR
Click Cancel to return to the Test Share screen without saving your changes.
From the Test Share screen (shown on page 124):
1. Click Edit Access List:
2. (Optional) Export the list (see “Exporting Data” on page 44).
3. Click Edit Staff:
4. Type the first few characters of a staff member’s first or last name.
Teacher Version 125
Creating and Managing Tests
5. Click Search. Achievement Series searches the staff records for this location and displays any matching the characters you typed
To review standards covered by test content
6. (Optional) Export your search results (see “Exporting
7. Assign a new access level to the user. See the online help for details.
8. (Optional) Repeat steps 4 through 7 for any other staff
who should be able to access this test.
9. Click Close when you are finished.
From the Test screen (shown on page 109) click
Standards:
126 Scantron Achievement Series User’s Guide
To view test status
Working with Classroom Tests
From here you can:
• Choose standards documents from the list to view which specific standards from those documents are covered by items on the test.
•
Export the list of applicable standards (see “Exporting
From the Test screen (shown on page 109):
1. Click the test session icon (shown in the margin) in the test status column:
Teacher Version
To spoil a test
2. Click a tab to view student tests in that category:
• Completed means that the students listed have finished and turned in their tests.
• Started/Incomplete means that the students listed have started the test but either paused or did not complete it.
• Not Started means that the students listed are eligible to take the test, but have not started the test.
If you want to remove a student’s test results (for example, they were caught cheating and need to retake a different version of the test, or if they had to stop taking a test set to disallow retakes, but you wish to allow them to retake it), you can spoil the test results.
From the Test screen (shown on page 109):
1. Click a test session (screen shown above).
127
Creating and Managing Tests
2. Click Spoil in a student’s test record:
128
To list shared tests
3. Check the confirmation box, then click OK to spoil the test. The student will now appear on the Not
Started list and can retake the test.
OR
Click Cancel to return to the session screen without spoiling the test.
Working with Shared Tests
Other teachers in your school may have created and shared tests with you.
From the Classroom screen (shown on page 87), click
Shared Tests:
From here you can:
• View test properties
• Copy a shared test to edit or administer it
NOTE: Shared tests are read-only; you must copy them to edit or administer them.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
To view shared test properties
From the Shared Test screen (shown on page 128):
1. Click the test name:
Teacher Version
2. Click the item icon next to each item or section to view item or section properties.
You may not edit these properties unless you copy the shared test. You may, however, add Bias Reviews or
Comments. See Working with Items.
3. Click the tabs at the top of the screen to view test properties. You may not edit these properties unless you copy the shared test.
4. Click Close when you are done.
129
Creating and Managing Tests
To copy a shared test
If you would like to use a shared test in your classroom, you must copy it to your main classroom tests area first.
From the Shared Test screen (shown on page 128):
1. Click the copy button (shown in the margin):
130
2. Specify a name for the copy of the test.
3. Specify a date by which to track the test.
4. Select the class to whom you will administer the test.
Only your classes are listed.
5. Click OK to copy the test and return to the Shared
Test screen.
OR
Click Cancel to return to the Shared Test screen without copying the test.
6. Edit the test as described in “Editing Tests” on page 109.
Scantron Achievement Series User’s Guide
To activate a test
Working with Classroom Tests
Activating Tests
Before you can deliver a classroom test you have created, you must activate it.
1. View the test list (see “Listing Classroom Tests” on page 87).
2. Click
next to the test you want to activate:
If the test is an online test, the following screen appears:
Teacher Version
NOTE:
This screen does not appear if the test is a scan-
ner forms test. Skip to step 4.
3. (Optional) Check Require a Secure Test Client if you want to require students to take the test via the
Secure Test Client. The Secure Test Client prevents students from:
• Right-clicking
• Printing the screen
131
Creating and Managing Tests
• Using the following Windows command keys (or their Macintosh equivalents):
• ALT+TAB
• ALT+SHIFT+TAB
• ALT+ESC
• CTRL+ESC
• ALT+F4
• Viewing the Start menu or lower toolbar
• Using the Windows or Application keys
NOTE:
If you set a test to require the Secure Test Client, students who try to take the test via a browser will see an error message.
Clear this box if you want to allow students to take the test using the standard browser client.
4. Click Activate. The following screen appears:
132
NOTE:
This screen appears immediately after you click
if you are activating a scanner forms test.
5. If there were any activation errors (e.g., some items on the test did not have a correct answer specified, etc.), this screen will provide instructions for fixing them.
Click Close, then see “Editing Tests” on page 109 for
information on editing the test.
If there were no activation errors, proceed to step 6.
Scantron Achievement Series User’s Guide
Working with Classroom Tests
6. Click Close. The test list refreshes with the new activation status:
You may now administer the test. See “Administering
Tests” on page 140 for details.
Teacher Version 133
Creating and Managing Tests
Working with ExamView Tests
Achievement Series offers an additional way to bring highquality, tested and validated assessment items into district and school tests: ExamView
®
Test Builder.
Permissions and ExamView
Test Import
NOTE: ExamView tests are imported into the top level folder for the site. You can move them to the appropriate
storage folder after import. See “Moving Existing
Folders or Elements to Folders” on page 41 for
details.
Whether your tests are imported as district or classroom tests depends on:
• Which site you log in to
• Your level of permission at that site:
• Only Teachers (either with or without edit) may import classroom tests.
• Only Location Controllers and Administrators (and
Consultants, depending on the permissions given by the Location Controller) may import district tests, either at the District or at the school level
• Data Entry and Test Operators may not import tests
To bring an ExamView test into
Achievement Series as a
Classroom Test
If you are a Teacher and need to import an ExamView test as a district test at your site, contact your Location
Controller for assistance.
1. Log out of Achievement Series (you can leave the browser window open).
2. Open ExamView Test Generator and create or open a test.
NOTE:
See the ExamView online help for more information on using ExamView Test Generator.
CAUTION:
Some types of ExamView items are not supported in Achievement Series (such as items including tables, matching items, and items with
134 Scantron Achievement Series User’s Guide
Working with ExamView Tests large graphics). You may include those items in tests you create, but they will not be imported into
Achievement Series tests.
3. From the ExamView File menu, select Publish
ToÆScantron Achievement Series:
Teacher Version
4. Type a title for the test. This title appears in the classroom gradebook in Achievement Series (see
“Listing Classroom Tests” on page 87 for details).
5. Provide your Achievement Series login information.
6. Click OK.
ExamView validates your Achievement Series login, then transfers the test to the site. When the transfer is complete, ExamView displays the following prompt:
NOTE:
If the site already contains a test with the name you chose, ExamView displays an error message.
Click OK at that message and change the test title, then repeat this step.
135
Creating and Managing Tests
7. Click OK.
ExamView opens a browser window, logs you into
Achievement Series, and displays a page showing the results of the import:
136
Imported items show one of the following status icons:
This icon… Means this…
The test item imported successfully. Any necessary formatting changes will be noted in the description.
The test item could not be imported for the specified reason. See the online help for details about what item types are supported.
Scantron Achievement Series User’s Guide
Teacher Version
Working with ExamView Tests
8. Assign the test to a class.
NOTE:
You can only assign a test to one class at a time. If you want more than one class to take the same test, do one of the following:
• import the test as a district test (with the help of an Administrator or Location Controller)
• import the test once for each class
• import the test once, then duplicate it (see
“Creating a Duplicate Test” on page 107)
9. Specify a delivery method for the test.
10. If necessary, fix any errors in the ExamView Test
Generator:
a. Print a copy of the results report (see “Generating
b. Click the Classroom tab at the top of the window to access the classroom test list.
c. Delete the test you just imported (see “To delete a test” on page 121).
d. Log out of Achievement Series.
e. Make any changes to the test in ExamView.
f. Re-import the test.
11. Once the test is imported to your satisfaction, click
Save.
Now you can click the Classroom tests tab and work with it like any other Achievement Series classroom test. See
“Working with Classroom Tests” on page 86 for details.
137
Creating and Managing Tests
NOTES
138 Scantron Achievement Series User’s Guide
6
Chapter 6:
Administering and Scoring Tests
In this chapter:
Administering Tests . . . . . . . . . . . . . . . . . . . . . . . .page 140
Scoring Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 150
Rescoring Tests. . . . . . . . . . . . . . . . . . . . . . . . . . . .page 151
Scantron Achievement Series User’s Guide 139
Administering and Scoring Tests
Administering Tests
You must prepare tests before you can administer them to students. The preparation process is a little different for each type of test:
• District Tests:
a. Draft/Review
b. Publish
c. Schedule
NOTE:
If you are a classroom teacher, these steps have already been performed for you at the district level. You only need to administer district tests.
• Classroom Tests:
a. Draft/Review
b. Activate
How you administer the test depends on the delivery method:
• Online
• Scanner:
• Plain Paper
• OMR Forms
NOTE: For scanner-based district tests, the school may choose whether to administer the test via plain paper or OMR forms, depending on the scanner available.
The results will be stored and correlated correctly regardless of which scanner form option is used.
140 Scantron Achievement Series User’s Guide
Teacher Version
Teachers
Proctors
Administering Tests
Administering an Online Test
Online tests are administered to students via computer. Your school may have a computer lab that is used for testing, or you may use classroom computers.
Before the test
• Have students bring:
• calculators if permitted for math tests.
• paper and pencils for the math tests.
• a book to read in the event they finish the test early.
• Verify that all students have student IDs and are set up in
Achievement Series
TIP:
Verify enrollment by checking your class roster in
Achievement Series. See the online help.
• Secure required IDs for each Test Session:
• Site ID
• Student IDs
• Test IDs
• (Optional) Student/Site passwords
• Verify with the School Location Controller that all student names and IDs, including any new students, have been entered into Achievement Series.
• Enter any new students that are not currently set up in
Achievement Series (see the online help).
• Schedule the computer lab for the testing dates and times
• Allow at least 1 hour for a test with 20 – 30 multiple choice items
• Allow at least 10 minutes between test sessions to allow for change of classes.
141
Administering and Scoring Tests
142
• Prepare the computers for testing
• Turn screen savers off & clear the cache on each computer
• Clean the mouse and display/monitor on each computer
• Download Test Loader (applies only to Macintosh computers for non-secure Flash Test Client)
• (Optional) Download the Secure Test Client (Windows or Macintosh)
NOTE:
You only need to download the Secure Test
Client if the scheduled session or activated classroom test requires it and you have not downloaded it earlier. Download the Secure
Test Client from www.achievementseries.com.
• If you are not using the Secure Test Client, prevent unnecessary security interruptions:
a. Open the Internet browser.
b. Go to Tools and select Internet Options.
c. Go to the Security tab and click Custom Level.
d. Scroll down to Miscellaneous and locate Display
Mixed Content.
e. Under Display Mixed Content, select Enable.
f. Click OK to save.
• Ask teachers for assistance in preparing students for the online tests.
• Verify that students know their IDs and can use a mouse, including scrolling.
• Have a supply of pencils and paper for students to use during math tests.
• Verify if calculators are required/permitted for math testing and if so verify provisions.
• Ask teachers to have students bring books to read if the test is completed early.
Scantron Achievement Series User’s Guide
Teacher Version
Administering Tests
On Testing Day
When you administer or proctor an online test, perform the following actions:
Your Actions
Browser Test Client
Instruct students to open an Internet browser
OR
Come in before the test and open a browser on all testing computers.
Secure Test Client
Instruct students to open the Secure Test
Client
OR
Come in before the test and open the Secure
Test Client on all testing computers.
Browser Test Client
Instruct students to point the browser to http://www.achievementseries.com.
OR
Come in before the test and point the browser to this site on all testing computers.
Secure Test Client
Skip this step.
Student Actions
Browser Test Client
Open the browser
OR
Come in and sit in front of a testing computer.
Secure Test Client
Open the Secure
Test Client
OR
Come in and sit in front of a testing computer.
Browser Test Client
Navigate to the provided site.
OR
Come in and sit in front of a testing computer.
Secure Test Client
Skip this step.
143
Administering and Scoring Tests
Your Actions
Browser Test Client
Instruct students to click Students.
Secure Test Client
Skip this step.
Provide students with the
Site ID, Test ID, and each student’s Student ID. If your site uses student and/or site passwords, instruct the students to enter them
Instruct the students to click
Begin Test if the test does not automatically appear.
Student Actions
Browser Test Client
Click Students.
Secure Test Client
Skip this step.
1. Type the Site ID,
Test ID, and Student
ID in the appropriate areas.
2. (If required) Type the student password and/or the site password in the appropriate areas.
3. Click Next.
Click Begin Test, if instructed.
144 Scantron Achievement Series User’s Guide
Teacher Version
Administering Tests
Your Actions
Read the test instructions out loud to the students.
Explain the test format:
• Number of Questions
• Types of Questions
• Answering ALL Questions (No penalty for incorrect responses, unless set up specifically that way in the item)
• Scrolling to view all answer choices or a Passage
• Selecting Correct
Responses using the
Mouse and Keyboard
• Erasing Responses
• Changing Answers
• Moving between test items
• Test-taking strategies
(Red X, Marking for
Review; see the student column in the next row)
• Any additional instructions provided by the test creator
Student Actions
Read the test instructions silently while the proctor reads them out loud.
145
Administering and Scoring Tests
146
Your Actions
Wander through the testing area to ensure no one is cheating.
If this is the first
Achievement Series Online
Test, have students do the following:
• Have students write tests answers on paper as they enter the answers online.
• Ask students to raise their hands before clicking
Turn in Test so you can verify that they understand how to review answers and turn in the test.
Document irregular student behaviors to aid in interpreting scores.
Keep track of any student who does not finish the test or is absent.
Student Actions
Take the test:
1. Click 1 or Forward at the bottom of the test.
2. For each question:
• Read the question
• Click to select an answer.
• Click to eliminate answer(s) you know are not correct or to remove your answer selection. Click it again if you change your mind.
• Check Mark
answer for
review (if available) if you are not sure of your answer and want to review it before turning in the test.
3. When you finish the questions, review your answers (if available), then click
Turn in Test.
Scantron Achievement Series User’s Guide
Teacher Version
Administering Tests
Administering a Plain Paper Test
Plain paper tests are Achievement Series test answer forms printed using Scan Station that can be scanned using a plain paper scanner. You must have downloaded and configured Scan Station on at least one school computer connected to a supported scanner to use this option. See Working with Scan Station for details on setting up Scan Station for plain paper tests, and for a list of supported plain paper scanners.
Before the Test
Before you can administer a test, you must print sufficient test forms for the students taking the test. You can print:
• generic forms, which do not contain student or test information, but do contain 80-item answer bubbles with answers A through E.
• custom forms, which contain student information and exactly the number of items and answer choices from the test.
See Working with Scan Station for details on printing these test forms.
On Testing Day
Before administering a Scanner Forms test, review these instructions carefully with students:
• Use a pencil or a blue or black pen.
• Make heavy, dark marks that completely fill the bubbles.
• Erase any unwanted marks very thoroughly.
• Do not make any notes or stray marks in the corners of the form where the special markings are printed.
• Do not fold, staple, or mutilate the form.
• Handle carefully to insure proper scanning.
147
Administering and Scoring Tests
148
Provide a copy of the test and answer form to each student.
• If the test is on the Generic Plain Paper Test Form, tell students to print the Test ID and Student ID in the boxes provided, and then fill in the corresponding bubbles.
• If the test is on a Custom Plain Paper Test Form
(printed for each student, with test IDs and student IDs pre-bubbled), give each student his or her form, then ask students to verify that the information on the form is correct.
Administering an OMR Test
OMR tests are pre-printed answer forms you can purchase from Scantron that can be scanned using an optical mark reader (OMR) scanner. You must have downloaded and configured Scan Station on at least one school computer connected to a supported scanner to use this option. See
Working with Scan Station for details on setting up Scan
Station for OMR tests, and for a list of supported OMR scanners and forms.
Before the Test
If you want, pre-slug the test form to contain selected information. This helps ensure accuracy, as you do not have to count on students to fill out test information accurately.
See Working with Scan Station for details on preslugging
OMR test forms.
On Testing Day
Before administering a Scanner Forms test, review these instructions carefully with students:
• Use Soft # 2 Lead Pencils only.
• Make heavy, dark marks that completely fill the bubbles.
• Erase any unwanted marks very thoroughly.
Scantron Achievement Series User’s Guide
Teacher Version
Administering Tests
• Do not make any notes or stray marks on the test form, particularly in the corners of the form where the special markings are printed.
• Do not fold, staple, or mutilate the form.
• Handle carefully to insure proper scanning.
Provide a copy of the test and answer form to each student.
• If the test is not pre-slugged, tell students to print the
Test ID and Student ID in the boxes provided, and then fill in the corresponding bubbles.
• If the test is pre-slugged (printed for each student, with Test IDs and Student IDs pre-bubbled), give each student his or her form, then ask students to verify that the information on the form is correct.
149
Administering and Scoring Tests
Scoring Tests
Scoring Online Tests
Online tests are scored automatically by Achievement
Series at the time the test is taken. These results are immediately available in test reports at both the classroom and district levels. Depending on how you set up the test, these scores may also be presented to students after they
turn in their tests. See page 122 for details.
Scanning Tests
Scanning tests is the means by which you get student test results from scanner forms into Achievement Series.
Results from different scheduled sessions and test versions will be aggregated under the Published Test in reports for district tests.
See Working with Scan Station for details on scanning and correcting forms.
150 Scantron Achievement Series User’s Guide
Rescoring Tests
Rescoring Tests
To rescore a classroom test
There may be occasions, after a test has been administered to the students, that an item is identified as being ineffective or bad due to its a) having the wrong correct answer, b) being ambiguous, or c) just not effectively measuring the skill represented by the item.
In these situations, the item can have a negative impact on students’ test scores. It may need to be modified and the test subsequently rescored. Achievement Series includes a rescoring feature that can be used as needed for District and Classroom assessments.
Rescoring Classroom Tests
CAUTION: If the test is currently active, read the following before proceeding.
Once a test has results, it can be deactivated and reactivated and the original Test ID will never change.
1. Log in to Achievement Series, (see “Logging In” on page 30).
2. Click Classroom Area.
3. Choose the class for whom the test to be rescored was developed.
4. Verify that the test is not active. If the test is active, you must first deactivate it by clicking the green checkmark before proceeding.
TIP:
If there is no green checkmark in the box next to the test name, the test is inactive, and thus eligible for rescoring.
Teacher Version 151
Administering and Scoring Tests
5. Locate and select a test (see “Navigating Folders” on page 39):
6. Click Rescore Test:
7. Click Add Item to Rescore:
152
Note the following:
• Version A test format is listed when multiple test versions exist.
• Partial Credit, Gridded Response, Short Response, and Extended Response questions cannot be rescored. N/A appears by these items.
• Test does not display any passage contents here.
Scantron Achievement Series User’s Guide
8. Select an item, then click Next:
Rescoring Tests
Teacher Version
9. Choose a rescoring option:
• Click Give full credit… to mark all answers to this item as correct. Every student who took the test will get this item “right”.
• Click Eliminate… to remove this item’s points from the total points for the test. This item becomes worth 0 (zero) points, no matter what the students answered. The scoring option is changed to Pilot scoring where you can track statistics but the item will not count towards the score.
• Click Change… and pick the correct answer from the ones displayed.
NOTE:
If the reason the test is being rescored is that none of the displayed answers are truly correct, do not choose this option. Choose one of the other rescoring options, then, if you want to administer the test again, edit the test to contain the correct answer choice.
Note the following:
• If the item is Multiple Response, check boxes are available for selection.
• If the item is Multiple Choice or T/F, radio buttons are available.
• When a question is scheduled for rescoring, it cannot be selected for a different session.
153
Administering and Scoring Tests
10. Click Next:
154
11. After reading the warning:
• Click OK to rescore the test for all students who have taken it (regardless of how long ago) and return to the Test screen.
• Click Cancel to return to the Test screen without rescoring the test.
• Click Previous as many times as necessary to change your choices.
The Rescoring List appears with the status of any items being rescored:
Status will be listed as Completed or In-Progress. Rescoring is typically processed overnight unless there are less than 50 results to rescore. If a rescoring session is in progress, you cannot set up another rescoring session until it is complete. Add Items To Rescore is hidden.
• Select Refresh to get a current status of each rescoring session.
• Click Delete to remove a Scheduled Rescoring Session.
Scantron Achievement Series User’s Guide
7
Chapter 7:
Viewing Reports
In this chapter:
Understanding Item Statistics Detail. . . . . . . . . . .page 156
District/School Test Reports . . . . . . . . . . . . . . . .page 160
Exporting Results. . . . . . . . . . . . . . . . . . . . . . . . . .page 176
Working with Gradebooks. . . . . . . . . . . . . . . . . . .page 186
Classroom Reports. . . . . . . . . . . . . . . . . . . . . . . . .page 190
Scantron Achievement Series User’s Guide 155
Viewing Reports
Understanding Item Statistics Detail
The following statistics appear in a variety of the available reports. Use this section to help you understand what the reports are saying and how the statistics were compiled.
P-Value
The P-Value, or item difficulty, is the percentage of the total group that got the item correct. This value is an indicator of whether an item is too easy or too hard. The optimal difficulty level for an item depends on the type of question and the number of distractors. The calculation for the P-Value is shown below.
=
TotalResponsesforItem
Many test experts believe that for a maximum discrimination between high and low achievers, the optimal level is 50%. However, because of the guessing factor, it is advisable to make a test somewhat easier. This reduces the guessing factor and increases test reliability.
For true-false items, a 75% difficulty level is recommended. In other words, an average of 75% of students should get the item correct. For a four response multiple-choice test, about 63% is the optimal level. The formula for developing the optimum level of items is shown below:
=
⎛ ⎞
a
Where a = the number of alternatives.
Optimal P-Values are ideal, but not always practical. Items that have P-Values less than 30% or more than 90% definitely need attention. These items need to be replaced or revised. The only exception to this standard occurs with items that appear at the beginning of a test. The first few items should be easy (difficulty level = 90% or higher) to put students at ease.
156 Scantron Achievement Series User’s Guide
Upper 27%
Lower 27%
Discrimination Index
Understanding Item Statistics Detail
When ranking those students who took the test, the upper
27% represents those students who scored highest in terms of their total score on the test. The percentage listed in the report is the percentage of the upper 27% that answered the item correctly.
When ranking those students who took the test, the lower
27% represents those students who scored lowest in terms of their total score on the test. This is the percentage of the lower 27% of the group that answered the item correctly.
The best measure of effectiveness of an item is its ability to discriminate between students who have mastered the material and those who have not. The Discrimination
Index is calculated as follows: n Index = % of upper 27% correct % of lower 27%
Teacher Version
The maximum item discrimination ratio for an item occurs if the discrimination ratio is 100%. This would occur if all those in the upper group got the item right and none of those in the lower group got it correct. Zero discrimination occurs when equal numbers in both groups get the item correct. Negative discrimination occurs when more students in the lower group get the item correct. In both cases of zero or negative discrimination, the item should be discarded or vastly improved before the item is used again.
A discrimination index of 25% or above is typically considered acceptable. An item having an index below
25% would be considered a poorly discriminating item.
That is, it would not discriminate between those who really knew the material and those who were less
157
Viewing Reports
Point Biserial
knowledgeable. Items with a discrimination index above
40% are typically considered to be excellent items.
The point biserial correlation coefficient (PBCC) measures the correlation between the correct answer on an item and the total test score of a student. The point biserial identifies items that correctly discriminate between high and low groups, as defined by the test as a whole (as opposed to only the upper and lower 27% of a group).
The point biserial generated is calculated as follows:
PBCC
=
(
N
) Np Nq
× σ
Where:
Mp = Mean total score of the group of students that got the item correct.
Mq = Mean total score of the group of students that got the item incorrect.
N = Total number of students.
Np = Total number of students who got the item correct.
Nq = Total number of students who got the item incorrect.
σ = Standard deviation of scores on the whole test.
Generally, the higher the point biserial the better the item discrimination, and thus, the better the item. The following general criteria may be used to evaluate test items.
General Point Biserial Interpretation
.30 and above
.20 to .29
Very good item
Reasonably good item
158 Scantron Achievement Series User’s Guide
Teacher Version
Understanding Item Statistics Detail
Choice Frequency
General Point Biserial Interpretation
.09 to .19 below .09
Marginal item; needs improvement
Poor item; reject or improve
By looking at the pattern of responses to alternatives for multiple-choice items, you can often determine why items operate as they do, and how to improve the test.
Basically, you can see whether the distractors in multiplechoice items are, in fact, “distracting” or not. A multiplechoice question is only as good as its distractors. If two distractors in a four-choice item are completely implausible, the question is, therefore, a two-choice item and easier to answer. That is why it is important to know if the distractors are “distracting.”
The response frequency represents the percentage of students who selected a particular choice and helps identify distractors that need improving. Those listed with a frequency of 0 may need to be replaced with a more plausible distractor.
159
Viewing Reports
District/School Test Reports
School test reports (available from the school site, District
Reports tab) include data aggregated from:
• District tests for all classes in the school
• All scheduled district test sessions in which the school participated (all versions are aggregated into a master report for a published test)
NOTE: Depending on your login, you will only see tests in which students from the class(es) to which you are assigned participated.
Understanding District Current Scores Reports
Each district current scores report can be aggregated by the following initial categories:
• District, which aggregates initially by all students in the district. Subsequent aggregations drill through lower location levels.
• Grade Levels, which aggregates initially by each grade across the schools in the district.
• Staff Members, which aggregates initially by the students assigned to each staff member’s classes. Note that the same student’s results may correlate to more than one staff member.
• Student Groups, which aggregates initially by any tracking groups you have defined (see the online help). Note that the same student’s results may appear in more than one group.
160 Scantron Achievement Series User’s Guide
Teacher Version
District/School Test Reports
• Courses, which aggregates initially by the courses in which students who have taken the test are enrolled. Note that the same student’s results may appear in more than one course.
• Classes, which aggregates initially by the specific classes in which students who have taken the test are enrolled. Note that the same student’s results may appear in more than one class.
• Students, which shows each individual student’s performance on the test
• Standards, which aggregates initially by any standards associated with the items on the test. Select the specific standards document to see these results.
NOTE: Whether you click Scores or Item Analysis, you will reach the same report for standards.
Drilling down within each report disaggregates the overall results by the option you choose (e.g., location, group, etc.).
These different initial aggregation aggregates support both Scores and Item Analysis reports. Each report type presents different information.
Scores
The scores report presents results for the selected test aggregated according to the aggregate you choose. It lists the following information:
• The district name
• The number of students who have taken the selected test
• The highest and lowest scores student achieved on the test.
161
Viewing Reports
162
Item Analysis
The item analysis report presents results for items on the selected test aggregated by the aggregate you choose. It lists the following information:
• The district name
• The number of students who have taken the selected test
• The number of items on the test
• The percentage of those items that were:
• answered correctly
• answered incorrectly
• skipped
You can also view details, broken out by item, such as:
• Item type
• The number of students who answered the item:
• correctly
• incorrectly
• The number of students who skipped the item
• The item’s Point Biserial Correlation Coefficient (see
“Understanding Item Statistics Detail” on page 156
for information on this statistic)
• The item’s correct answer
• The number of students who selected each possible answer for the item
If you view Item Analysis by standard, you can access
Resources for each standard. For more information, see
Each report represents a different way of looking at the data. The basic process to view each report is identical, and is presented below.
Scantron Achievement Series User’s Guide
To view a student report
District/School Test Reports
Understanding Student Reports
Achievement Series also presents a student details report that allows you to select one or more students or classes from a particular school, and groups that information into a single report.
Viewing Reports
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click District Reports.
3. Click Print Student Reports from the Reports menu:
Teacher Version
4. Decide how to group the information:
• Class allows to you group all the students from a specific class in one report
• Student allows you to group one or more selected students in one report
163
Viewing Reports
5. Locate and select a test (see “Navigating Folders” on page 39), then click Next:
NOTE:
If you selected to group by student in step 4, you
will see a list of available students. This sample screen shows classes.
6. Select one or more classes or students (depending on how you chose to group the report), then click Next:
164
To view a district or school scores report
7. Click View PDF… to open the report.
8. Save or print the report. See the Adobe Reader manual or online help for details. Close Adobe Reader when you are done.
9. When you’re finished, click Close.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click District Reports.
Scantron Achievement Series User’s Guide
Teacher Version
District/School Test Reports
3. Click Scores in the Scores column next to the report aggregate (Students, Standards, etc.) you want:
NOTE:
The aggregate you choose determines your starting point. You can drill down to additional detail or aggregate the data differently by choosing options within the report.
NOTE:
If you choose Standards, note that any standards added to items or the test draft after the test was published will not appear on the report.
From here you can:
• Choose a test to view.
•
Sort the list (see “Using Lists” on page 34)
•
Export the list (see “Exporting Data” on page 44)
165
Viewing Reports
4. Locate and select a test (see “Navigating Folders” on page 39):
The first level of detail that displays is the report aggregated by the aggregate you chose in step 3. For details on this level, see the appropriate report in
“Understanding District Current Scores Reports” on page 160.
5. (Optional) Change a data filter (see “To filter district reports” on page 171).
6. Click the detail icon (shown in the margin) to view a bar chart showing score details for the drill-down level you are currently viewing:
166
Click anywhere on the chart to close it and return to the report.
Scantron Achievement Series User’s Guide
Teacher Version
District/School Test Reports
7. Drill down a level by clicking on an item in the aggregate report. You can continue drilling down through the levels of detail and narrowing the results displayed by clicking underlined options on the report details screen. Each time you drill down a level, you may choose from the available types of details:
At each level of drill-down, you can:
• Change the filters (see “To filter district reports” on page 171).
•
Print the report (see “Generating PDF Reports” on page 45)
•
Sort the list (see “Using Lists” on page 34)
•
Export the list (“Exporting Data” on page 44)
8. When you are finished viewing the report, click Close.
167
Viewing Reports
To view a district item analysis report
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Item Analysis in the Item Analysis column next to the report aggregate you want:
NOTE:
The aggregate you choose determines your starting point. You can drill down to additional detail or aggregate the data differently by choosing options within the report.
From here you can:
• Choose a test to view.
•
Sort the list (see “Using Lists” on page 34)
•
Export the list (see “Exporting Data” on page 44)
168 Scantron Achievement Series User’s Guide
District/School Test Reports
3. Locate and select a test (see “Navigating Folders” on page 39):
Teacher Version
The first level of detail that displays is the report aggregated by the aggregate you chose in step 3. For details on this level, see the appropriate report in
“Understanding District Current Scores Reports” on page 160.
4. (Optional) Click Print Consolidated Test Details to see details about all the items on the test.
NOTE:
You will only see this option if you have access to the published test. See the Administrator’s version of this guide for details.
5. (Optional) Change a data filter (see “To filter district reports” on page 171).
6. Drill down a level by clicking on an item in the aggregate report.
You can continue drilling down through the levels of detail and narrowing the results displayed by clicking underlined options on the report details screen. Each
169
Viewing Reports time you drill down a level, you may choose from the available types of details:
170
At each level of drill-down, you can:
• Change the filters (see “To filter district reports” on page 171).
•
Print the report (see “Generating PDF Reports” on page 45)
• (If you choose Standards as the filter) Access
additional resources for each standard (see “To access resources for item standards” on page 174)
NOTE:
Your site must subscribe to the Resources feature. If you do not see a link to resources, contact your Scantron Account representative for more information.
•
Sort the list (see “Using Lists” on page 34)
•
Export the list (“Exporting Data” on page 44)
7. Click Item Details to see item analysis details for each item on the test:
Scantron Achievement Series User’s Guide
District/School Test Reports
8. Click the detail icon (shown in the margin) to view a bar chart showing score details for the drill-down level you are currently viewing:
To filter district reports
To change the time frame filter
Click anywhere on the chart to close it and return to the report.
9. When you are finished viewing the report, click Close.
You can filter each report and each drill-down level of each report by several criteria.
From the report screen:
1. Click Change in the Time Frame bar:
Teacher Version
2. Set a time frame.
3. Click OK.
Clear the time frame by clicking Clear in the Time Frame bar.
171
Viewing Reports
To change the demographics filter
From the report screen:
1. Click Change in the Student Filtering: Demographics bar:
172
2. Select values for one or more demographics. See the student fields listed in the online help for details on these demographics.
3. Click OK.
Clear the demographics you set by clicking Clear in the
Demographics bar.
Scantron Achievement Series User’s Guide
To change the groups filter
District/School Test Reports
From the report screen:
1. Click Change in the Student Filtering: Groups bar:
You can choose to include or exclude scores from students who are enrolled in particular groups. This allows you to disaggregate your data according to the groups you determined.
2. Click Select next to either Include or Exclude:
Teacher Version
3. Check the box next to the name of each group you want to include or exclude (depending on your choice in the previous step).
4. Click OK.
Clear the groups you set by clicking Clear in the
Groups bar.
173
Viewing Reports
To change the score range filter
From the report screen:
1. Click Change in the Student Filtering: Score Range bar:
To access resources for item standards
2. Set a score range.
3. Click OK.
Clear the range you set by clicking Clear in the Score Range bar.
NOTE: Your site must subscribe to the Resources feature to access these resources. If you do not see a link to resources, contact your Scantron Account representative for more information.
1. Access a standards-based report, such as one of the following:
• District/School Standards Report
• Classroom Standards Report
• Classroom Item Analysis Report.
2. Click the resources icon (shown in the margin):
174 Scantron Achievement Series User’s Guide
District/School Test Reports
3. Click a standard under any of the available resources to access the resource.
See “Using Resources” on page 201 for details on
these resources.
4. Click Close.
Teacher Version 175
Viewing Reports
Exporting Results
To view a list of scheduled exports
Achievement Series enables you to export test results in two ways:
• By setting up a schedule to export the results from one or more published district tests
• By requesting results from specific published district tests one at a time
Setting an Export Request Schedule for One or More
Published Tests
You may need to export published test results for comparison in a tool outside of Achievement Series. You can schedule an export request for one or more published tests from the District Tests tab at either the district or the school level.
You can schedule the downloads:
• daily
• weekly
• monthly
• once
• several times in a day
You can also export individual test results directly from
the Published Test tab. See “Exporting Results” on page 176.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click District Tests.
176 Scantron Achievement Series User’s Guide
Exporting Results
3. Click List on the left-hand menu under Export Test
Results:
To schedule an export
From here you can:
• Schedule exports
• Edit, and delete scheduled exports
• View export session history
•
Sort the list (see “Using Lists” on page 34).
•
Export the list (see “Exporting Data” on page 44).
From the Export Test Results list (shown on page 177):
1. Click Create under Export Test Results:
Teacher Version
NOTES:
• The list of published tests can be lengthy; this screen shows a partial list.
• The list includes only published tests with student results.
• Because the list is pre-filtered to only include tests with results, you do not need to navigate folders.
177
Viewing Reports
2. Select the published test(s) to be included in the export data set.
3. Click Next:
178
4. Specify the elements you want to include in the export.
5. Choose the frequency that best matches when you want an export to be generated:
• daily
• weekly
• monthly
• once
• several times in a day
6. Click Next:
NOTE:
The settings shown here are for daily exports.
Which settings appear depends on the frequency
you chose in step 5. See the online help for details
on the settings for each frequency.
Scantron Achievement Series User’s Guide
7. Specify the schedule settings.
8. Click Next:
Exporting Results
Teacher Version
9. Click Save.
Achievement Series saves the schedule information and sets up the network requests to proccess at the specified times. Each test is exported to a separate
CSV file, with the test name as the default file name.
You can edit the scheduled export and change this file name if necessary.
NOTE:
If a file with the same name as the default name already exists (e.g., and earlier instance of the export), Achievement Series appends a number to the end of the file name.
179
Viewing Reports
To edit a scheduled export
From the Export Test Results list (shown on page 177):
1. Click a published test name:
180
To delete a scheduled export
2. Edit the settings as necessary. See the online help for details.
3. Click Save.
NOTE: Deleting a scheduled export takes effect at the next
available export time. If an export is already in progress, that export will complete. Student results data is
not deleted. Already completed exports are not deleted; you will still have access to them.
From the Export Test Results list (shown on page 177):
1. Click Delete under Export Test Results:
NOTE:
The list of scheduled exports can be lengthy; this screen shows a partial list.
Scantron Achievement Series User’s Guide
2. Select the scheduled export (s) to be deleted.
3. Click Next:
Exporting Results
To view a scheduled export’s history
4. Review the list.
5. Click Previous to change your selection.
OR
Click Delete to confirm your selection(s) and delete the scheduled exports.
OR
Click Cancel to stop deleting and retain the scheduled exports.
From the Export Test Results list (shown on page 177):
1. Click History on the right-hand side of a published test’s row:
2. Click Close.
Teacher Version 181
Viewing Reports
To access your exported data
1. Click Preferences in the upper right-hand corner of the screen.
2. Click Files:
182
3. Choose an action:
• Click Download to open a copy of the exported data. From there, you can open the file or save it to your computer.
• Right-click and choose Save Target As… to save a copy of the exported data to your computer without opening it.
• Click Delete, then OK at the confirmation dialog to delete the exported data set.
TIP:
Scantron recommends deleting files periodically to clean up your Files tab and make locating specific files easier.
4. Click Close.
Requesting Results for a Specific Published Test
You can export results and other information from a specific published test to a comma-separated value (CSV) file for analysis in tools other than Achievement Series.
You can export:
• Score information
• Item standards information
• Item properties
Scantron Achievement Series User’s Guide
Exporting Results
To export data for a specific published test
You can choose to:
• Download the data locally
• View the data on-screen
• Have the export file emailed to you (student score information only)
NOTE: Scantron recommends having the CSV file emailed to you for student score information. Large reports such as a student score export can cause your browser to time out.
NOTE: Depending on your login, you may see only those district tests for which you have access.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click District Tests:
Teacher Version 183
Viewing Reports
3. Locate and select a test (see “Navigating Folders” on page 39):
184
4. Click Export Test Results:
NOTE:
Click Download under Specification (PDF) to see a detailed list of what is included in each export type.
5. Choose an export data type.
If you choose to export item standards or item properties, skip to step 8 on page 185.
Scantron Achievement Series User’s Guide
Teacher Version
Exporting Results
6. Specify the elements you want to include in the export:
7. Click Next.
8. Choose an export option.
9. At the prompt, choose to open or save the downloaded file.
10. Click Close and:
• Choose another export type.
• Click Cancel.
185
Viewing Reports
Working with Gradebooks
Gradebooks are available in the Classroom Area.
To view a classroom gradebook
The district gradebook contains district test scores and cumulative averages. Students’ test scores for district tests will display immediately in the district gradebook after students submit online tests or as soon as their tests are scanned. You may only see the results for students assigned to your classes, depending on your login.
The classroom gradebook contains classroom test scores and cumulative averages. Students’ test scores for classroom tests will display immediately in the classroom gradebook after students submit online tests or as soon as their tests are scanned. You may only see the results for students assigned to your classes, depending on your login.
NOTE: The procedure to use the gradebook is identical, no matter whether you choose classroom or district; only which tests appear differs.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click Classroom Area.
186 Scantron Achievement Series User’s Guide
Working with Gradebooks
3. Click District or Classroom Gradebook:
Teacher Version
4. Select a class.
From here you can:
• Filter the gradebook by subject
• View up to 10 tests per page. Click << (previous) or >> (next) to view additional pages.
• View the class profile.
• Access student test details.
• Access the student record (see the online help for details).
• Sort the student list.
•
Access Classroom Reports (see “Classroom
• Change gradebook display options.
•
Export the gradebook (see “Exporting Data” on page 44).
NOTE:
Depending on your login, you may only see the classes to which you are assigned in this list.
187
Viewing Reports
To view the class profile
From the Gradebook screen (shown on page 187), click the class profile icon (shown in the margin).
See the online help for details.
To access student test details
From the Gradebook screen (shown on page 187), click the student test score:
188
To sort the list
From here you can view the student test details or export various segments of the student test information (see
“Exporting Data” on page 44). The test results are groups
by test item and by standard (where applicable).
Click Close when you are finished.
From the Gradebook screen (shown on page 187), click the up or down arrow next to Student Names, Test Scores, or Cumulative Averages. This sorts the gradebook in alphabetical/ascending numerical order (S) or reverse alphabetical/descending numerical order (T).
Scantron Achievement Series User’s Guide
To change gradebook display options
Working with Gradebooks
From the Gradebook screen (shown on page 187):
1. Click Change:
To access Classroom Reports
2. Choose a column order.
3. Check the box next to Include district tests… to include district tests in the classroom gradebook display.
NOTE:
This option appears only if you click Change at the classroom gradebook.
4. Check the box next to Include archived tests… to include tests from previous years that were archived during year-end rollover.
See “Classroom Reports” on page 190.
Teacher Version 189
Viewing Reports
Classroom Reports
Classroom reports offer a way for you to see aggregate and detail data for the reports you create and deliver within your own classroom. Classroom reports are available for district or classroom tests.
To view classroom reports
NOTE: Depending on your login, you will only see tests from the class(es) to which you are assigned.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Use one of the following methods to select a report:
• From the classroom area gradebook tab:
a. Click Classroom Area:
b. Select a class from the list.
c. Click A+ (shown in the margin) in the Results column or on the Classroom or District
Gradebook tabs.
NOTE:
This button appears only if test results have been recorded for this test.
190 Scantron Achievement Series User’s Guide
Teacher Version
Classroom Reports
• From the district reports tab:
a. Click District Reports.
b. Click Current Scores under Classroom on the
Reports menu:
c. Click a test name:
d. Click a class name.
Either process opens the test results screen:
191
Viewing Reports
From the graph view you can print the report (see
“Generating PDF Reports” on page 45)
Scores are color-coded by performance level where green represents scores over 80%, yellow represents scores between 60% and 79%, and red represents scores below 60%. Sorting by score helps group the students by their level of understanding to know which students need remediation. The District,
School, and Class Averages are listed at the bottom of the screen, which help show how the students are performing in relation to the rest of the student population.
a. Sort the student data on the chart in alphabetical order or by score by choosing an option from the drop-down list on the right-hand side of the screen.
b. Change the sort direction (S to sort in ascending order, T to sort in descending order).
Click Print Student Reports:
192
c. Check the box next to the name of each student you want to include in the report.
NOTE:
Student scores will appear in this report in the order they appear here.
Scantron Achievement Series User’s Guide
Classroom Reports
d. Click Next:
e. Click the icon (shown in the margin) to view or print the report.
f. Click Close to return to the Test Scores screen.
Click Switch to table if you prefer to see this data in a table rather than a bar chart:
Teacher Version
The table view displays more detailed information, including student ID, number of correct/incorrect/ partial/omitted answers, time elapsed for online tests, version, and test method.
From the table view you can:
•
Export the data (see “Exporting Data” on page 44)
•
Print the report (see “Generating PDF Reports” on page 45)
193
Viewing Reports
• Click a student’s name to view student test details:
194
The Student Details report shows detailed results for a particular student, such as what they answered on every question, the number of points received, and any standards attached to the items.
This report also shows how the student performed overall on each standard included on the test, which will help you know where to focus instruction for the student. This report is useful for parent-teacher conferences.
NOTE:
You can also access additional resources from this report, if your site has subscribed to this
feature. See step 5 on page 195 for details.
Contact your Scantron account representative if you do not see the resources icon.
Scantron Achievement Series User’s Guide
5. Click Standards:
Classroom Reports
Teacher Version
The standards are again sorted by performance level and can be grouped to know which skills need to be focused on in order to appropriately adjust instruction for the class.
From the graph view you can:
•
Print the report (see “Generating PDF Reports” on page 45)
• Click the resources icon to access additional resources for the standard (see below)
NOTE:
The labels for the bar graph (Standard 1, 2, 3, etc.) do not refer to the actual state standard referencing. They are simply references to the standard text listed below the graph.
NOTE:
You must select the appropriate standards document from the list. If the document is currently displayed, you must “refresh” it by selecting another one then selecting the original document again.
195
Viewing Reports
a. Sort the standards data on the chart by choosing an option from the drop-down list on the righthand side of the screen.
b. Change the sort direction (S to sort in ascending order, T to sort in descending order).
c. Click a resources icon to access additional resources for a standard:
NOTE:
Your site must subscribe to the Resources feature. If you do not see a link to resources, contact your Scantron Account representative for more information.
196
Click a standard under any of the available resources to access the resource.
See “Using Resources” on page 201 for details
on these resources.
f. Click Close.
Scantron Achievement Series User’s Guide
Classroom Reports
Click Switch to table if you prefer to see this data in a table rather than a bar chart:
From the table view you can:
•
Export the data (see “Exporting Data” on page 44)
•
Print the report (see “Generating PDF Reports” on page 45)
• Click the resources icon to access additional resources for the standard (see above)
• Click a standard to view details about the students’ performance for that specific standard:
Teacher Version
Student scores can be sorted in this report to put students in special groups for further instruction on this particular standard. The Item Analysis bar graph is again color coded by performance level. The graph can be sorted by score to group the items that were missed the most in order to cover them again in class.
197
Viewing Reports
7. Click Item Analysis:
From the graph view you can print the report (see
“Generating PDF Reports” on page 45)
a. Sort the item data on the chart by choosing an option from the drop-down list on the right-hand side of the screen.
b. Change the sort direction (S to sort in ascending order, T to sort in descending order).
Click Switch to table if you prefer to see this data in a table rather than a bar chart:
198
The Item Analysis table includes detailed information such as % correct, point biserial, response frequencies,
Scantron Achievement Series User’s Guide
Classroom Reports
and standards attached. See “Understanding Item Statistics Detail” on page 156 for more details.
From the table view you can:
•
Export the data (see “Exporting Data” on page 44)
•
Print the report (see “Generating PDF Reports” on page 45)
• Click an item number to view and export item results details.
Teacher Version
From the item results detail view you can:
• View and edit student records (depending on your login rights).
• View the item itself (click )
•
Sort the list (see “Using Lists” on page 34)
•
Export the list (see “Exporting Data” on page 44)
199
Viewing Reports
8. Click Responses:
This report displays what each student answered on every question. Red boxes indicate incorrect answers and yellow boxes indicate partial credit. This allows you to see at a glance which students need further instruction (by the amount of red in the rows) and which items need to be covered again in class (by the amount of red in the columns).
From here you can:
•
Export the data (see “Exporting Data” on page 44)
• Click a student’s name to view and export student
test details (screen shown on page 194).
• Click an Item number to view content for that item:
200
9. Click Close when you are done.
s
Scantron Achievement Series User’s Guide
8
Chapter 8:
Using Resources
In this chapter:
Using Skills Connection™ Online . . . . . . . . . . . .page 202
Using netTrekker d. i.. . . . . . . . . . . . . . . . . . . . . . .page 214
Scantron Achievement Series User’s Guide 201
Using Resources
Using Skills Connection™ Online
1
Skills Connection Online integration provides you with a link from Achievement Series data to resources you can use immediately from Skills Connection Online.
Benefits to school and district administration
Benefits to teachers
Benefits to parents
Benefits to students
This integration provides a variety of benefits:
Administrators are assured that teachers are aware of test objectives and have an easy method of tracking their students’ progress. Skills Connection Online enhances parental involvement with an easy-to-use at-home study guide. Administrators can feel comfortable that they are using products that are designed to work with the common goal of improving student achievement.
Skills Connection Online provides teachers with convenient lists of each objective being tested at the end of their grade. Criterion-referenced study guides, aligned to the high stakes tests, can be prepared throughout the school year to help guide students to mastery. Teachers can easily create study guides and self-tests that address the standards identified as areas of weakness identified by
Achievement Series.
Many parents have forgotten the discrete skills they learned so long ago and find it hard to assist their children.
Skills Connection Online tutorials make it easy for the parents to keep their children “on track” throughout the school year. These reports help students answer “what did you learn today?” with a better answer than “nothing!”
Skills Connection Online study guides give students a different method of studying, and self-tests give students the confidence to know that they have mastered the material. Students can feel confident knowing that the self-tests created using Skills Connection Online will help them master the Suggested Learning Objectives from
Achievement Series.
202
1. If your district subscribes to this service.
Scantron Achievement Series User’s Guide
Teacher’s Version
Using Skills Connection™ Online
Understanding Skills Connection Online
Skills Connection Online™ brings teachers, parents, and students together to advance student progress. Skills
Connection Online is an easy-to-use tool that helps support students in attaining necessary skills, especially those skills that are critical for success on the high-stakes state and/or standardized tests. More than just another technological teacher’s aid, Skills Connection Online provides an easy alternative for meeting the Title 1 and
Title 4 requirements for assessment, tracking, and parental communication.
A curriculum containing objectives that are written, taught, and tested consistently will achieve maximum results. Skills Connection Online ensures integration of necessary objectives into lesson plans without requiring teachers to change their instructional and assessment methods.
Students are empowered to perform to their fullest potential when the skills are taught, assessed, remediated
(if necessary), communicated to parents, and reinforced at home. Skills Connection Online provides students with a means to meet and exceed their academic goals.
Skills Connection Online helps you create useful study sets. A study set consists of the following:
• Study Guide
• Test Form
• Answer Key
Use the three together to create an effective connection between student, parent, and classroom material.
NOTE: Create or save all three elements at the same time. Skills
Connection Online creates a unique version of the set each time you run it, so self-tests created for one set will not match answer keys created at a different time.
203
Using Resources
Home Study Guide
Automated Student Self-Test
Design
Item Bank Development
Customizing Study Guides
Skills Connection Online contains specific, comprehensive skill descriptions and Study Guides that function as tutorials designed for parents who may have forgotten the foundation skills or need help in assisting their son/daughter at home. You can produce a home study guide that communicates the classroom subject matter using easy-to-understand terminology and descriptions. You can also add your own comments or assignments using the text editor.
The Home Study Guide is an efficient way of giving parents the vital information needed to keep their children
“on track” throughout the school year. This information can also be used for remediation and/or acceleration.
Skills Connection Online saves you time by simplifying the tedious work of test design. This software pinpoints assessment on a per-skill basis (based on the results obtained from Achievement Series) and generates a copyready paper-and-pencil test and corresponding answer key.
Questions are in a multiple-choice format, using pictures and graphics when appropriate. Instructions are automatically linked to the specific skills and can be modified using the text editor.
Skills Connection Online software contains over 14,500 validated questions measuring more than 1000 skills in math, language arts, reading and life science. A team of credentialed teachers, each with significant classroom experience, developed the database. Advanced training in item writing was required for all teams and was conducted on contract by faculty from several universities.
You can customize computer-generated study guides and student self-tests using any word processor that can import Microsoft Rich Text Format (RTF) files. By customizing, you can:
• create additional questions in a different format (e.g., constructed response or open-ended)
• copy, cut, and paste items or instructions
• import additional graphics or pictures
204 Scantron Achievement Series User’s Guide
Creative Classroom Uses
Review units of study
Peer graders
Remediation
Challenge their minds
Test their logic
Using Skills Connection™ Online
• rearrange order in which questions are to be printed
• adjust font type and size
• renumber test items
• designate each test item to start on a new page
In addition to the obvious benefit of using Skills
Connection Online to assess students, teachers have found innovative ways of integrating Skills Connection
Online into their classrooms. We’ve compiled these into some Teacher Tips:
Your students may say they remember last week’s lesson on decimals. Give them a short quiz created with Skills
Connection Online to see if they really do remember.
Designate students to be peer graders. Pass out the
Answer Key for your students to grade tests.
The Study Guide, complete with tutorials, is an effective tool for remediation. Send it home to parents or let the students work through the tutorials in study groups.
Some students just grasp the concepts more quickly than others. For those students, create a test using higher level skills and challenge their minds.
Give students the Answer Key and let them think up their own test questions.
Generating Skills Connection Online Study Materials
Achievement Series provides several levels of access to resources in Skills Connection Online. You can generate:
• Study sets for a custom set of skills and objectives
• A targeted study guide based on objectives and standards identified in Achievement Series reports
Teacher’s Version 205
Using Resources
To generate general materials from the Resources tab
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Do one of the following to access Skills Connection
Online:
• Click the Resources icon (shown in the margin):
Click Generate Test with Skills Connection
Online.
• If you are not already there, click the Home icon
(shown in the margin) to access the Achievement
Series home page for the school site, then click
:
206
Choose Create a Paper-Based Test to create a printable study set that students can take home or work on in class.
Scantron Achievement Series User’s Guide
Using Skills Connection™ Online
This opens the Skills Connection Online wizard:
Teacher’s Version
3. Choose a template.
The template field displays All Skills when you first access Skills Connection Online. When you specify a different template, Skills Connection Online displays only those skills associated with that template for your selection. Skills Connection Online includes the following template types:
207
Using Resources
208
• All Skills
The All Skills selection allows you to view all the units and skills available within a specific subject area.
Through the All Skills view, you can target specific skills you are addressing in your classroom today.
• National templates
Skills Connection Online includes national templates from which you may design your study guides. These templates are comprehensive and challenging collections of skills found in major textbooks and standardized tests currently being used by schools throughout the country.
• Standardized and state tests templates
How are your students’ punctuation skills? Find out before you administer that standardized test.
Select the template for the standardized test (or state test, if appropriate).
4. Select a subject area.
5. Select a grade level.
6. Check the box(es) for the unit(s) you want to target.
Skills Connection Online will automatically select all of the skills associated with that unit.
You may uncheck any specific skills you do not want included.
OR
Check the box(es) for specific skills without selecting the entire unit.
TIP:
Click the name of a unit to see the list of skills associated with that unit. Then click the name of the skill, and its description will appear below.
Clicking the names of the units or skills will not automatically select them.
Scantron Achievement Series User’s Guide
Teacher’s Version
Using Skills Connection™ Online
TIP:
Notice that some skills are listed as “Antonyms -
A” or “Antonyms - B.” Some standardized test companies assess skills at multiple levels within the same grade level to ensure complete assessment.
For this reason, you may notice the same skill represented at multiple levels on a single test template.
7. (Optional) Click Test Options:
a. Select the number of questions per skill.
b. Check the box to add “I don’t know” as one of the answer choices.
c. Choose an answer key option:
• Include both question and answers
• Include only answers
d. Click OK.
8. Choose Paper-Based Test to create a printable study set that students can take home or work on in class.
209
Using Resources
9. Click Next:
10. Provide a title for the study set.
TIP:
Consider adding the student’s name to the study set name if you are creating a study set for a specific student. Consider adding the class name and/ or period to the study set if you are creating a study set for an entire class. Always consider including the objective name in the study set name.
11. (Optional) Adjust the instructions that appear at the top of the self-test.
12. Click Save:
210
Skills Connection Online creates each element of the study set and displays them for your use.
Scantron Achievement Series User’s Guide
Teacher’s Version
Using Skills Connection™ Online
13. Depending on your operating system, do one of the following:
• Windows:
Click an element name to open it directly in Word
(or any word processor that supports RTF files).
OR
(Recommended) Right-click the element name and choose Save Target As… to save the element to your desktop or a folder.
• Macintosh:
a. Click an element name to save that file to your desktop.
The file is titled preview#.asp (e.g., if you click the self-test first, that will be preview1.asp, if you click the answer key second, that will be preview2.asp, etc.).
b. Open the appropriate asp file in any word processor that supports RTF.
NOTE:
We recommend saving the files from your desktop to another folder. Although Skills Connection
Online will continue to increment the file numbers
(thus creating unique files), leaving the files on your desktop can create clutter and confusion.
You may now work with each element. Using your word processor, adjust the questions or study material as necessary, then print and deliver or email copies to students and parents.
211
Using Resources
To generate general materials from a report
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Run a report that provides access to resources (see
“Viewing Reports” on page 155 for details) and click
the icon shown in the margin:
3. Click Generate Test with Skills Connection
Online:
212
Scantron Achievement Series User’s Guide
Using Skills Connection™ Online
To generate targeted study guides
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Run a report that provides access to resources (see
“Viewing Reports” on page 155 for details) and click
the icon shown in the margin:
3. Click a listed objective or standard:
Teacher’s Version
4. Click Save and choose a location for the materials.
You may now work with the study guide. Using your word processor, adjust the study material as necessary, then print and deliver or email copies to students and parents.
213
Using Resources
Using netTrekker d. i.
1
The award-winning netTrekker d.i., from Thinkronize®, is integrated into Scantron’s assessment solution. Reports link to the netTrekker site, directly connecting material aligned to the specific standard. Educators can rest assured that the learning materials are aligned to the students’ needs and they will save time over endlessly searching online for resources.
General-education
ELL/ESL
Understanding netTrekker d.i.
netTrekker d.i. is an academic search engine that’s fast and easy to use for teachers, school librarians, students and parents. The resource pool contains more than 180,000 educator-selected online resources organized by readability level and aligned with all state standards. The sites are regularly reviewed and updated so users can feel confident that they are accessing the most up-to-date information.
Now, educators can quickly and easily find resources for all students or groups based on current subject-level ability.
Differentiated instruction helps all students improve. The combination of Achievement Series, Performance Series and netTrekker d.i. allows users to target the class ability level or student ability level and deliver material on target.
The English Learners Channel within netTrekker d.i., designed for English language learners and teachers, offers content specifically for students for whom English is not a first language.
The channel splits in two paths:
• ELL Skill Development
• Multicultural Pavilion
214
1. If your district subscribes to this service.
Scantron Achievement Series User’s Guide
Using netTrekker d. i.
Below or above grade level
Reading challenges or Special needs
To generate a general list of materials from the Resources tab
By linking to netTrekker d.i. from Performance Series’
Suggested Learning Objectives report, which targets the student's ability level instead of the grade level, students with abilities above or below their grade level will have resources specifically for them.
The Read Aloud feature in netTrekker d.i. provides textto-speech support for students who need audio reinforcement. All sites also have readability indices clearly marked and sortable from 1–5.
Accessing netTrekker d.i. Materials
Scantron provides several ways to access netTrekker d.i. materials. If you have provided your netTrekker d.i account information (seethe System Administrator’s Guide) or if your site accesses netTrekker d.i. through a network address login, Scantron automatically logs you on.
If you do not have a netTrekker d.i. account or do not know your login, contact your site’s Information Services group or Thinkronize, Inc.
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Click the Resources icon (shown in the margin):
Teacher’s Version
3. Click Find a Resource with netTrekker d.i.
A new browser window opens showing resources available through your netTrekker d.i. account.
NOTE:
Once you are on the netTrekker d.i. site, contact netTrekker d.i. for assistance if necessary.
215
Using Resources
To generate a general list of materials from a report
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Run a report that provides access to resources (see
“Viewing Reports” on page 155 for details) and click
the icon shown in the margin:
3. Click Find another resource with netTrekker d.i.
A new browser window opens showing resources available through your netTrekker d.i. account.
NOTE:
Once you are on the netTrekker d.i. site, contact netTrekker d.i. for assistance if necessary.
216 Scantron Achievement Series User’s Guide
Using netTrekker d. i.
To generate a targeted list of materials
1. Log in to Achievement Series (see “Logging In” on page 30).
2. Run a report that provides access to resources (see
“Viewing Reports” on page 155 for details) and click
the icon shown in the margin:
Teacher’s Version
3. Click a listed objective.
A new browser window opens showing specific resources available through your netTrekker d.i. account for that objective or standard.
NOTE:
Once you are on the netTrekker d.i. site, contact netTrekker d.i. for assistance if necessary.
217
Using Resources
NOTES
218 Scantron Achievement Series User’s Guide
In this section:
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . page 221
Frequently Asked Questions . . . . . . . . . . . . . . page 233
Section
III
Additional Information
NOTES
A
Appendix A:
Glossary
Administrators
AKO
Ancestry
Archive
See “Permissions” on page 227.
Answer Key Only; a variety of Achievement Series test that you can use to incorporate assessment results from assessments created outside of Achievement Series. These tests do not use item banks.
In the Achievement Series Equation Editor, the markup that defines the current equation. Since all MathML equations consist of templates nested inside a <math> element, the ancestry always shows the <math> element on the left. Intermediate MathML templates are listed in order of nesting, with the innermost MathML template at the cursor location indicated on the far right. See the Item
Editor online help for details.
See “Rollover” on page 230.
Scantron Achievement Series User’s Guide 221
Glossary
Bloom’s taxonomy
Choice Frequency
Class
CSV
CAT
Consultants
Content-Neutral
Course
A theory of understanding that divides the cognitive domain into 6 sections:
• knowledge
• comprehension
• application
• analysis
• synthesis
• evaluation
The choice frequency represents the percentage of students who selected a particular choice and helps identify distractors that need improving. Those listed with a frequency of 0 may need to be replaced with a more
plausible distractor. See “Understanding Item Statistics
Detail” on page 156 for details.
A specific combination of teacher, student(s), period, and course.
Comma-Separated Value; a text-only export format where each row from a table appears in its own line and each value from the row is separated by a comma.
Computer-Adaptive Testing; testing that matches each test taker’s ability level. As a test taker answers each question, the test adapts according to his or her response.
Question difficulty decreases with incorrect responses and increases with correct responses. No test should be too easy or too difficult for any student.
See “Permissions” on page 227.
The type of application architecture Achievement Series uses, ensuring that you can import, create, and use content from a variety of sources (including but not limited to
Scantron’s Item Banks).
A specific grouping within an area which contains curriculum content; typically equivalent to grade level and subject area (e.g., Grade 5 Math, Algebra I)
222 Scantron Achievement Series User’s Guide
Course Category
Data Entry
Default Gateway
Difficulty
See “P-Value” on page 227.
Discrimination Index
The best measure of effectiveness of an item is its ability to discriminate between students who have mastered the
material and those who have not. See “Understanding
Item Statistics Detail” on page 156 for details.
Distractor
The incorrect answer(s) in a multiple choice or multiple response item. Well-crafted distractors help to prevent students from simply using logic or luck to “guess” the correct answer.
Exhibit
Exposures
Extended Response
See “Passage” on page 227.
The number of times this item has appeared in a published test (i.e., been seen by students). Use it to decide whether to retire an item for overexposure.
GIF
1
A specific grouping within an area which contains curriculum content; course categories organize the courses. Course categories may be as broad (mathematics) or as narrow (algebra) as you wish.
See “Permissions” on page 227.
A node on a network that serves as an entrance to another network (generally your main network router) and is identified by a standard, formatted number.
Graphics Interchange Format; a bitmap image format for pictures with up to 256 distinct colors. GIFs are compressed files, and were adopted to reduce the amount of time it takes to transfer images over a network connection. A GIF file employs lossless data compression so that the file size of an image may be reduced without degrading the visual quality, provided the image fits into
256 colors.
See also “Graphic Formats” on page 224
1. Definition taken from Wikipedia on 5/18/06
Teacher’s Version 223
Glossary
Graphic Formats
Gridded Response
Group
IP Address
Item
JPG, GIF, PNG are examples of formats for graphic files supported by Achievement Series.
A customized designation for students defined by the district, such as After School Reading Program or
Student-Athletes, that is used for disaggregation in
District Reports.
A 32-bit number that identifies each sender or receiver of information sent across a network.
A test question and any supporting material. It may include simply a question, set of answer choices, and correct answer designation, or it may include passages or graphics. The available item types are:
• Multiple choice, where you create a question and supply two or more answer choices, only one of which is correct. When you create multiple choice answer choices, take care to present reasonable “distractors”.
If the correct answer is too easily guessed, it can invalidate the hoped-for results.
• Multiple Response, where you create a question and supply two or more answer choices, several of which may be correct. When you create multiple response answer choices, take care to present reasonable “distractors”. If the correct answers are too easily guessed, it can invalidate the hoped-for results.
• True/False, where you create a statement that is either true or false, and indicate which is correct.
• Extended Response, where you create a question or statement that requires an essay, extended mathematical proof, or other answer that does not translate well to test form bubbles. Extended response items are graded by a teacher or proctor, before the form scanning process, who fills in a bubble in a special section of the test form corresponding to the points awarded.
224 Scantron Achievement Series User’s Guide
Item bank
Item Difficulty
JPG
1
Location Controllers
Locations
Multiple Choice
Multiple Response
• Short Response, where you create a question or statement that requires a short text answer or a calculated mathematical answer. Use short response items when the answer is brief, but you do not want to students to guess from a list of choices. Short response items are graded by a teacher or proctor, before the form scanning process, who fills in a bubble in a special section of the test form corresponding to whether the answer is correct or incorrect.
• Gridded Response, where you create a question or equation that requires students to calculate and enter a mathematical answer. Each gridded response answer area contains a set of bubbles for as many numerals, decimal point, fraction indicators, etc. as you deem necessary to the answer. Students fill in the bubbles corresponding to the answer they calculate.
Any of these item types support passages or exhibits.
A collection of categorized items (questions) compiled by teams of teachers and specialists
See “P-Value” on page 227.
Joint Photographic Experts Group; a commonly-used method of lossy compression for photographic images. A lossy data compression method is one where compressing data and then decompressing it retrieves data that may well be different from the original, but is “close enough” to be useful in some way.
See “Permissions” on page 227.
The schools and district or other offices that make up your school system.
1. Definition taken from Wikipedia on 5/18/06
Teacher’s Version 225
Glossary
NAEP
1
Network ID
NA
NCLB
2
NM (Reading)
NPR
National Assessment of Educational Progress; the
National Assessment of Educational Progress (NAEP) is the only nationally representative and continuing assessment of what America’s students know and can do in various subject areas. Assessments are conducted periodically in mathematics, reading, science, writing, the arts, civics, economics, geography, and U.S. history.
See “Default Gateway” on page 223.
Not Applicable; if any student scores show as Not
Applicable (NA) for a unit, it means that either the student did not reach a level of questions that could measure these concepts or the unit is not adequately represented in the state or national standards for the student’s grade level.
No Child Left Behind; the No Child Left Behind Act of
2001 (NCLB) reauthorized the Elementary and Secondary
Education Act (ESEA)—the main federal law affecting education from kindergarten through high school...NCLB is built on four principles: accountability for results, more choices for parents, greater local control and flexibility, and an emphasis on doing what works based on scientific research.
Not measured; if NM is shown for Reading Rate, the student has clicked “I have read this story” in less than 5 seconds, making Reading Rate a measure that cannot be calculated.
National Percentile Ranking; the NPR illustrates the percentage of students that would score below the scaled score for the given student. The NPR compares student scaled scores against the scaled scores of members of the norm group within the same grade level. Different values
226
1. Definition taken from Institute of Education Sciences, US Dept of Education National Center for Education
Statistics webpage; http://nces.ed.gov/nationsreportcard/about/ on 1/25/08
2. Definition taken from US Dept of Education website; http://answers.ed.gov/cgi-bin/education.cfg/php/ enduser/std_adp.php?p_faqid=4 on 1/25/08
Scantron Achievement Series User’s Guide
OMR
P-Value
Passage
Percentile Ranking
Performance Series
Permissions
At the top levels (e.g., district, state, etc.): appear for Fall, Winter, and Spring administrations to reflect the comparison with each respective norm group:
• Fall = August 20 through November 22
• Winter = January 1 through February 22
• Spring = March 22 through June 15
Any students tested outside of these windows, such as summer school students, will not have norm scores.
Optical Mark Recognition; the process by which a specially-configured scanner interprets pen or pencil marks on a form and associates them with a particular question (for example, on a test or survey). Other elements on the form (such as pre-printed background text) are ignored.
The P-Value, or item difficulty, is the percentage of the total group that got the item correct. This value is an indicator of whether an item is too easy or too hard. The optimal difficulty level for an item depends on the type of question and the number of distractors. See
“Understanding Item Statistics Detail” on page 156 for
details.
(Also called exhibit) A graphic or section of text that students must study before answering one or more questions linked to the passage.
See “NPR” on page 226.
A web-based computer adaptive diagnostic test created by
Scantron, aligned to state and national standards.
A designated role that defines what features a particular
Achievement Series user may do. Districts and schools have different types of permissions:
• Location Controllers perform all tasks at a location and any subordinate locations. For your security, keep the number of location controllers at the top level to a minimum.
Teacher’s Version 227
Glossary
At the school level:
• Administrators have full viewing/reporting and test control capabilities (such as spoiling) at a location, but cannot create or edit student or staff records.
• Data Entry operators have creating/editing/deleting capabilities to allow most common data entry tasks.
• Consultants is a position reserved for customers using Achievement Series who would like to only share specific areas of the site with an outside consultant.
• Location Controllers perform all tasks at a location.
For your security, keep the number of location controllers at each location to a minimum.
• Administrators have full viewing/reporting and test creation capabilities at a location, but cannot create or edit student or staff records.
• Teachers w/o Student Edit can view just the students and classes they have been assigned. If a teacher needs more access, create a second identity for the staff member using a different position (such as
Administrator or Location Controller) and unique staff ID. Only teachers can be assigned to classes.
TIP:
We recommend starting all teachers at this level and adding edit permissions only as necessary.
• Teachers w/ Student Edit are just like Teachers w/o
Student Edit except this position can also create and edit student records.
• Data Entry operators have creating/editing/deleting capabilities to allow most common data entry tasks.
• Test Operators can perform tasks related to the testtaking logistics of the system (such as scheduling), list and create student records.
• Consultants is a position reserved for customers using Achievement Series who would like to only share specific areas of the site with an outside consultant.
228 Scantron Achievement Series User’s Guide
PNG
1
Point Biserial
Proxy Server
1
Portable Network Graphics; a losslessly compressed bitmap image format. Lossless data compression allows the exact original data to be reconstructed from the compressed data.
The point biserial correlation coefficient (PBCC) measures the correlation between the correct answer on an item and the total test score of a student. The point biserial identifies items that correctly discriminate between high and low groups, as defined by the test as a whole (as opposed to only the upper and lower 27% of a group). See
“Understanding Item Statistics Detail” on page 156 for
details.
A server that sits between a client application, such as a
Web browser, and a real server. It intercepts all requests to the real server to see if it can fulfill the requests itself. If not, it forwards the request to the real server.
Proxy servers have two main purposes:
• Improve Performance: Proxy servers can dramatically improve performance for groups of users. This is because it saves the results of all requests for a certain amount of time. Consider the case where both user X and user Y access the World Wide Web through a proxy server. First user X requests a certain Web page, which we'll call Page 1. Sometime later, user Y requests the same page. Instead of forwarding the request to the Web server where Page 1 resides, which can be a time-consuming operation, the proxy server simply returns the Page 1 that it already fetched for user X. Since the proxy server is often on the same network as the user, this is a much faster operation.
Real proxy servers support hundreds or thousands of users. The major online services such as Compuserve and America Online, for example, employ an array of proxy servers.
1. Definition taken from Wikipedia on 5/18/06
Teacher’s Version 229
Glossary
230
Rollover
Section
Scanner
Session
Site
Sharing
Short Response
Spoiling
Standards
Student Profile
• Filter Requests: Proxy servers can also be used to filter requests. For example, a company might use a proxy server to prevent its employees from accessing a specific set of Web sites.
A process typically performed during summer break that archives last year’s data and advances students in preparation for the upcoming school year.
A group of related items. Typically, a passage or image is stored in the section, with items that are not attached to the passage grouped in one or more additional sections that do not contain content.
A device that optically detects marks or images by measuring the amount of light reflected from the surface of a form as it passes under a read mechanism.
Achievement Series supports both plain paper and OMR scanners (see “OMR” on page 227).
A particular application of an Achievement Series test during a specified period of time.
The ability to make item banks, tests, test drafts, and test results available to other Achievement Series users within your location.
The act of deleting student results for a particular test, generally used when the student has cheated or other testing irregularities have occurred.
Documents (generally state-sponsored) that identify when a particular skill or objective should be mastered on a grade-level basis. You can associate items in Achievement
Series with a particular standard and search items by standard when creating tests.
Also called “Student Record”. The complete record containing all student demographic and testing data.
Scantron Achievement Series User’s Guide
Teacher’s Version
Subnet Mask
Teachers
Test
Test Draft
Test Operators
Tolerance
True/False
A formatted number that represents all the machines on the same local area network (LAN) and is identified by a standard, formatted number (usually 255.255.255.0).
With and without edit; see “Permissions” on page 227.
A collection of items (see “Item” on page 224), generally
on the same or similar subject matter, designed to assess a student’s mastery of the skills and objectives identified by the items. In Achievement Series, this term refers to a classroom test.
In Achievement Series, a test at the district level that is currently under development, but which has not yet been approved for administration to students. Once a test draft is approved, it is “published”, or made available to staff for administration to students.
See “Permissions” on page 227.
In Achievement Series, for Short and Gridded response items, the online grading system will compare the decimal values of the correct answer and the given answer
(converting them to decimal if they are fractions). If the difference between the two answers is less than or equal to the tolerance you specified when you created the item, the given answer is marked correct.
231
Glossary
NOTES
232 Scantron Achievement Series User’s Guide
B
Appendix B:
Frequently Asked Questions
In this appendix:
General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 234
Setup and Site Administration. . . . . . . . . . . . . . . .page 234
Item Banks and Item Entry. . . . . . . . . . . . . . . . . .page 235
Assessment Concepts . . . . . . . . . . . . . . . . . . . . . .page 237
District Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 237
District Reports . . . . . . . . . . . . . . . . . . . . . . . . . . .page 239
Classroom Tests . . . . . . . . . . . . . . . . . . . . . . . . . . .page 240
Classroom Reports. . . . . . . . . . . . . . . . . . . . . . . . .page 240
Online Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 242
Rollover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .page 244
Scantron Achievement Series User’s Guide 233
Frequently Asked Questions
Is customer support available?
Is training on Achievement
Series available?
What if I lose my site ID number?
How can I change my password?
How can data be imported from another database, such as a
Student Information System?
General
Yes, customer support is available from 5:30am-4:30pm
PST at 1-800-445-3141. Customer support is also available by email at [email protected] and via LiveChat at www.scantron.com.
Yes. Contact your Scantron Account Manager or sales representative for additional information.
Setup and Site Administration
If you lose your site ID number, contact your district or school representative, or call customer support at
800-445-3141.
You can change your password using the Site Admin tab
(unless you are a consultant, in which case this tab reads
“Change Password”). See the online help for details.
You will be required to enter your old password to change your password. If you have forgotten your password, go to your Location Controller, who can give you a new password. Scantron is only able to reset passwords for the primary contact for the district (typically the person listed on the initial order).
As long as the enrollment data from another application can be exported into a CSV (comma-delimited) format, it can be imported into Achievement Series through the
Import Manager. Imports can only be completed at the top level (usually the district) site. When logged into the top level site as the Location Controller, you should be able to see the “Import Manager” option on the menu under Site Administration, where you will also find the
Import Specifications and sample spreadsheets to use as a model.
234 Scantron Achievement Series User’s Guide
What does it mean to have the
Student-Class Enrollments file date overwrite existing data?
Why do my consultants see a
Change Password tab?
I have a multiple-level site
(state, district, and school) and
I am using folders? Why do all my district folders appear under the top-level folder?
I am using foldering. Why can all locations on my site see all my folders, even if the folder was not intended for that location?
Does the Math Type program work with Achievement Series?
Administrator’sTeacher’s Version
If a district chooses this option, student enrollments on the system are added or removed as necessary for classes contained in the Class file to make them exactly match the enrollments in the Student-Class Enrollments file when an import is performed. Classes that are not included in the
Class file for a particular import will not be altered.
This tab is provided so that consultants can change their passwords, if necessary. The consultant permission set does not include any access to the Site Administration tab, or to the Staff Member page under preferences, where passwords are usually accessed.
Achievement Series provides two default levels of folder: customer (top-level location) and school (lowest level).
Within those default folders, you can create multiple folders within folders at your location. If you are at any level above a school level, your tests, item banks, and folders will be added to the top-level default folder. If you are at a school level, your tests, item banks, and folders will be added to the school-level default folder. However, at a school level, you will also see the top-level default folder, any subfolders that have been created within it, and any tests or item banks that have been shared with you.
Locations can see their location-specific folders and any folder from any other locations associated with the customer site (i.e., a district, state, region, or school site, depending on how your site tiers are constructed). Only the folders themselves are visible; whether you can view that folder’s contents depends on the access you have been granted by the folder’s owner.
Having all folders visible at all locations within a customer makes it easier to share folders and their contents across locations and enables more efficient collaboration.
Item Banks and Item Entry
Achievement Series has its own item editor that includes special characters in the pull down menu at the bottom left side of the content box for either an item question or an item answer. Math Type or other proprietary program text can be copied and pasted as a graphic.
235
Frequently Asked Questions
What is a Multiple Response item?
What is the maximum number of Items that can be held in a single Item Bank?
Can items be moved or copied from one Item Bank to another?
Can items in the Scantron Item
Banks be copied or edited?
How can I share my Item
Bank?
Multiple response refers to a type of item that has more than one correct answer. Item type is one of the item properties that cannot be edited after you create the item, so be certain of the item type before you save. The answer bubbles for Multiple Response items on an online test are squares, rather than circles. If an item type is identified as a
Multiple Response Item, it will not be counted as having an incorrect Multiple Mark when it is scanned. It is important to place Multiple Response items in their own section on a test, with section instructions that indicate to students that they may choose more than one valid response.
An item bank can hold an unlimited number of items. An index is available at the top right corner of the Item Bank screen to help users navigate between pages of items, or
Unlimited items may be viewed, per page, by changing the user Preferences. See “Setting Up Personal Preferences” on page 201.
All the items from two or more Item Banks can be merged into a single Item Bank, but items cannot be moved or copied between Item Banks. See Working with
Items.
Since users are assigned Reviewer/Assigner access to the
Scantron Item Banks, the items may be used on tests, but they may not be edited or duplicated in item banks.
However, these items can be edited in a Test Draft or
Classroom Test.
Item Banks can be shared within a single site using the
Share option to sites below that site (if it is not a school level site). Using the Remote Share option, Item Banks can be shared laterally (from one building in a district to another) or with other sites outside of the district if only non-copyrighted items are contained in the item bank.
236 Scantron Achievement Series User’s Guide
How can I view all of the comments for the items in an
Item Bank?
What type of research does
Scantron have that discusses the difference between paperand-pencil tests and online testing?
How many questions may be on a single test?
Only a manager of an Item Bank can share it with others.
To share, click on the name of the Item Bank, and select either the Share or the Remote Share tab. Sharing access can be given globally, or the item bank can be shared with individuals by editing the access list. Sharing access can be
edited at any time See “Sharing Item Banks” on page 60.
The Manager(s)/Reviewer(s) of an Item Bank can view/ print a Bank Details Report that can include all of the items and the comments/bias reviews for an Item Bank.
See Working with Items.
Assessment Concepts
Scantron has not conducted any internal research to examine differences between administration of paper-andpencil tests and online testing, since so much independent research has already been conducted in this area. A quick search of any educational research database should return many articles focusing on this topic. One such study, as well as a brief summary of its findings, is provided below:
Mead, A. D. and F. Drasgow (1993). Equivalence of computerized and paper-and-pencil cognitive ability tests: a meta-analysis. Psychological Bulletin, 144 (3), 449-358.
A meta-analysis was conducted to examine the effects of medium of test administration (paper-and-pencil vs. computerized) for tests of cognitive abilities for populations of young adults and adults. No difference in equivalence was observed between the two types of administration.
District Tests
The total number of items for “Normal” or “Quick Pick”
Tests is limited by the number of questions that can be held on a single form (if the test is to be scanned).
Achievement Series OMR forms may hold up to 50 or 200 questions. Plain Paper Test forms may hold up to 80 questions per page and up to 200 questions or 4 pages per test form.
Administrator’sTeacher’s Version 237
Frequently Asked Questions
How can I share a test?
What is Test Validation?
How can I see all of the test items and the standards they are linked to?
Only a Manager of a test can share it with others. Tests can be shared within/below a site at three different stages:
• Test Draft
• Published Test
You can further specify Published Tests by sharing some or all of the following privileges:
• scheduling
• results
• the test itself
• Scheduled Session
In order for a user to have a test available in Scan Station, the Scheduled Session must be shared with that person as a Manager or Scan Operator. To share a test at any one of the stages above, click on the underlined name of the test in the appropriate list (the list of Test Drafts, Published
Tests, or Scheduled Sessions), then click on the appropriate Share tab. Global sharing rights can be assigned through the Edit Sharing Option, and/or tests can be shared with individuals through the Edit Access
List. Sharing access can be edited at any time.
Test Validation is required before a Test Draft can be published. The test publishing process can do it automatically, or you can click on the name of the Test
Draft and select the Test Validation option in the left menu. Test Validation checks for items that don't have a correct answer, so that a published test includes only items that have a correct answer selected.
On a test, items with standards attached have a green check mark to the left of the item name/ID. By clicking on the green check mark, the standards for the item can be viewed. To view all of the items/standards for a given test, choose the name of the test from the Test Draft menu, and select Test Draft Details.
238 Scantron Achievement Series User’s Guide
If I realize, after I've given a test, that the answer key was wrong, or I want to “throw out” a question, how can I rescore tests that have already been delivered?
How can I view item analysis for the District Tests?
How can I view scores for a particular Quarter or
Semester?
Why do some tests have Grade
Level Reports for several grades, while other tests have
Grade Level Reports for only one grade?
How can district data be exported into a district data warehouse solution?
Administrator’sTeacher’s Version
The Manager of the test can rescore the test by selecting the name of the test in the Published Test menu and choosing Rescore the test. Answers may be changed and/ or credit for the item may be adjusted, and all of the results for the given test will be rescored, automatically.
See “Rescoring Tests” on page 151.
District Reports
Basic item analysis is available in the District Reports section and in the Test Details Report for any given test.
Users who have the Classroom Module add-on can view additional Item Analysis features, such Scores, Standards
Reports, Item Analysis, and Responses, by clicking in the District Gradebook section of the Classroom Area.
Any underlined piece of data in the Reports is linked to additional information, which can be viewed by clicking on the underlined data/phrase.
To change the time frame of the reports for a particular test, click Change next to Time Frame at the bottom of the District Report screen for any District test. By changing the time frame, you can filter the scores by a particular period of time. Only the tests scores that fall in the selected time frame will appear in the District Report.
Especially at the secondary level, many subject area tests are administered to students in several grade levels. However, if a test is only given to a single grade level, the Grade
Level Report will only show the scores of students in that grade level. Grade Level Reports, like every report, can also be sorted by the demographic filter of student date of birth, to break grade levels down by specific age ranges.
Each District Report table has an Export XLS option in the top left-hand corner of the table that will generate a
.csv file with the information listed in the table.
Alternatively, the entire set of data (in test student, score, and response data; test item standards data; test item properties data) for a single test may be exported into.csv files by:
• Choose the test name in the Published Test menu, then select Export Test Results.
239
Frequently Asked Questions
What's the difference between a Classroom Test and a District
Test?
Can I edit a Classroom Test?
How can I view Item Analysis for the Classroom Tests?
How can I show students their individual score on a test?
Once the data is exported into a spreadsheet, you should be able to follow the specifications given by the other data solution for importing the data into another database. See
Classroom Tests
Classroom tests are tests that are typically administered to a single class at a time, where results do not need to be aggregated across classes. District, common, or benchmark, tests can be created at a district and shared with schools, or can be created at the school level, and are delivered to large groups of students. Results from district tests are automatically aggregated and can be disaggregated as desired. District Tests may be scanned as batches, by test, regardless of class, but Classroom Tests must be scanned one classroom at a time, for each test.
A classroom test may be edited if it has not yet been administered, by deactivating it and making changes. However, editing a classroom test before it has generated results changes its Test
ID, so make sure that no changes are made to a test if the test forms have already been printed, or be sure to print new forms that have the new Test ID. Once a classroom test has been delivered online/scanned and has results, deactivating and reactivating a test does not affect the Test ID. If you need to edit an active classroom test, consider duplicating the test instead and making your changes to the copy.
Classroom Reports
Click in the Classroom Gradebook to view additional
Classroom Report features, such as Test Scores, Standards
Reports, Item Analysis, and Responses. Any underlined piece of data in the Reports is linked to additional information, which can be viewed by clicking on the underlined data/phrase.
If the test was given online, you have the option during the test creation process of letting them see their score immediately following the test. If you scan the tests using
240 Scantron Achievement Series User’s Guide
I am the Department Chair, but
I can only view the scores for the classes I teach. How can I access the other data?
How can I export my classroom test data into other gradebook software?
What is “Plain Paper” scanning?
How can I pre-slug forms before giving a test, so that the
Student ID, Test ID, and other information are printed on each test form?
Can the scanners read both Ink and Pencil marks?
Administrator’sTeacher’s Version an OMR scanner, and your scanner has a print head, you can choose to have the score printed on the OMR form.
You can also print a test score Student Details report for an individual student from the Classroom Gradebook and/or District Gradebook by clicking on the student’s score in the gradebook for any test.
In order to view other class data, location controllers can edit a class and assign multiple teachers to any class, so that teachers other than the primary teacher can also view class data. See “Creating or Editing Classes” on page 165.
Each table view of data allows an export into a spreadsheet by clicking on “Export.xls”. Follow the gradebook software specifications to import the data from
the spreadsheet. See “Exporting Data” on page 44.
Scan Station
Plain Paper scanning is a method of digital scanning that uses plain paper (rather than printed scan forms) and an
“off the shelf ” imaging scanner (rather than an Optical
Mark Reader scanner). Generic and Custom plain paper forms may be printed through Scan Station using a laserjet printer.
After a scanner has been calibrated, a user should log in to
Scan Station and highlight the test for which he/she wants to create the forms. Then forms may be printed by selecting the “forms” button.
Forms may be printed that include the student ID, test ID, class/period, and date. Plain Paper forms may also have the school’s name, the test name, and the teacher’s name printed on the form. OMR forms can also have the
Subject area printed on the test form. Once the print option is selected, a PDF is generated. To print the PDF, choose Print from the Adobe menu (under Print Options, be sure that Page Scaling, Auto Rotate, and Center are set to “none” or “off ”, or the forms will not print correctly).
Plain Paper scanners can read both ink and pencil marks, as long as the marks are dark enough. Whether OMR scanners can read both ink and pencil depends on the type
241
Frequently Asked Questions
Which Scantron OMR scanners work with Achievement Series?
of scanner. Whether or not a scanner has an Ink Read
Filter Option is indicated on the label on the back of the
Scanner with an “I” under the scanner’s serial number.
Scan Station, which is the program used with
Achievement Series to scan, requires either a 48-channel scanner or the Classroom Wizard/1212 Scanner. See
“Supported Scanners” on page 15.
See “Supported Scanners” on page 15.
Which Plain Paper scanners are supported by Scantron?
Which OMR forms can be used with Achievement Series?
How can I make the forms scan faster?
How can online testing security be maintained?
242
Contact a Scantron representative for more information on supported forms for these scanners.
Custom OMR forms for Achievement Series can also be ordered from Scantron. Contact your Sales Representative for information and pricing.
The scanning speed depends on the type of scanner used, the type of form used, the processing speed of the computer connected to the scanner, and the speed of the Internet connection. With optimal conditions, up to 1200 forms can be scanned per hour using a plain paper/imaging scanner (a classroom set of 30 forms, for example, will scan in approximately 1 ½ minutes). OMR scanners can be used in either Standard or Express mode, with the scanning speed ranging from 1900 to 5100 sheets per hour depending on the scanner and mode. See Working with Scan Station for details.
Online Testing
In the Testing Security menu under Site Administration within a school site, Location Controllers can control online testing by limiting the allowed login days/times and the allowed network addresses from which any test can be taken at the site. Allowed login days/times/networks can also be edited for each test session, by selecting the name of the session and clicking on the Devices tab. A school location password can also be required, and can be edited under the Login Settings under the school Testing Security menu. Some schools change their school location password daily, for example, to increase testing security.
Scantron Achievement Series User’s Guide
Can students see their scores on the screen after they take an online test?
Is a test saved after each answer?
Are students allowed to pause an online test?
Can online tests be timed?
What can I do to return to an online test if the
“Connecting…one moment” message with the hourglass is on the screen?
Under the Edit Student menu, Location Controllers/
Teachers w/ editing rights can also assign students a student password that is required for them to log on to take an online test. See “Creating and Editing Student
Records” on page 181.
When a test is scheduled, the Manager of the test can edit the Allowed Student option to limit which students are able to take the test, by assigning students by grade level or class, or by assigning individual students.
There are online options, when a test draft is created, to allow students to view their test scores and/or review all/ the incorrect questions after the test in turned in. If test retakes are allowed when the test draft is created, students will also be able to immediately log on and take the test again, unless Testing Security options are edited.
The test answers are saved frequently during testing, and the entire test is saved when a test is turned in. So, if a computer is turned off in the middle of a test or Internet connection is lost, the student will have to start the test again, but they will only lose a few answers, at most.
The decision to allow students to pause an online test is made in Online Options during the creation of a Test
Draft. There is also the option to determine the window of time students have to finish the test.
The selection to make a test timed is made when choosing the Test Properties in the creation of a Test Draft. If a test is timed, the test duration may be up to 6 hours and 59 minutes.
Press F5 on a PC or to the test.
a
+3 on a Mac to refresh and return
Administrator’sTeacher’s Version 243
Frequently Asked Questions
Who can perform a rollover?
Do I have to rollover?
What happens if I don’t roll over?
When should I roll over?
What should I do if the school year has already started?
Rollover
Only a Location Controller at the top level location (which for most customers is a district) can perform a rollover.
Technically, you don’t have to roll over, but there are negative consequences if you don’t. See “What happens if
I don’t roll over?”, below, for more details.
Rolling over enforces a clear separation of school years that is necessary to help maintain the meaningfulness of reports. If you don’t roll over, your data from the two years will begin to mix together in an undesirable way.
For example:
• Last year’s classes and this year’s classes will be mixed together on class reports, and the same would be true for courses and staff reports.
• Students who are promoted to a new school before a rollover will not have their scores from last year properly tied to their former school.
• If students’ grades are increased but no rollover takes place, then grade level reports will begin to have students who are in two grades in the “current year”.
In order to get the information you want, you will want to roll over before each new school year and start fresh.
The best time to roll over is in between school years, before you begin changing any information in
Performance to prepare for the new school year.
If possible, roll over before you begin making any changes in Achievement Series to prepare for the new school year.
For example, don’t:
• increase student grades by one
• add students or classes or perform any imports
• transfer students to new school years
• have students begin testing
244 Scantron Achievement Series User’s Guide
I have already started to make changes in the system to prepare for the new school year. What should I do?
Can I choose a date in the past to roll over?
Can each school roll over separately from each other?
Should I do an import before or after the rollover?
What should I do with students who no longer attend the school?
Administrator’sTeacher’s Version
If you haven’t done so already, do each of these kinds of things only after you have rolled over.
If you roll over after you have already started to make changes for the new year, these changes will be reflected in the “snapshot” of last year that is taken during the rollover process. This is true to a certain extent even if you choose a rollover date that is in the past.
For example, if you have created classes for the new year and have assigned students to them and then roll over, it will look like students were in these classes last year when looking at archive reports. If this is a concern, you may consider putting all the students back to how they were and the end of the last year, rolling over, and then starting fresh in the new year. If you have already started testing, you will want to choose a rollover date that is in the past, which will only archive tests before that date.
Also, when you do roll over, be careful that the options you select make sense for your situation. For example, you may not want to select the recommended option of removing students from classes if the classes are really this year’s classes.
Yes, but there are limitations and this should only be done as a last resort. Rolling over in the past only affects which tests are archived and which are not; other information, like what classes or groups a student belongs in or what grade a student is in, will be archived based on the most current information, not based on a past rollover date. See the previous question for more details.
No, all the schools in your system must be rolled over together.
Assuming your import is for the new year, then do it after the rollover. Only Location Controllers and Data Entry positions at the top level Location can perform imports.
If they are still somewhere in your school system, you can either transfer them on the web site (at a school level select Students Æ Student Transfer) or perform an import (from the top level location, select Locations Æ
Import Manager). The import will transfer students to
245
Frequently Asked Questions
Can I compare students’ scores from last year and this year?
How can I access student scores after doing a rollover?
Will I still be able to see my scores when I roll over?
Where did my classroom tests go?
Where did my sessions go?
the school indicated on the import if you use numeric IDs of at least 5 digits.
If the students are not still in your school system, like those who graduated high school, you may delete these students after the rollover takes place. Doing so will delete the student only in the current year; all their information and test scores will still exist in the archive year and will be available to you through archive reports.
There is no report to compare scores between two years.
By selecting a published test from a previous year (the year appears in the right-most column on the screen.
Yes.
After a rollover, classroom test scores (non-Performance
Series scores) will not be available for past years. If a teacher wants to copy the content of a previous year’s classroom test, they can do so by clicking on the Shared
Tests tab and clicking the Copy button for the desired test.
After a rollover, sessions (for non-Performance Series testing) that were set up in past years will not be available in the current year. New sessions must be created for students to test in the new year.
Note that even if the date range of a past year sessions would have included the current year, the session will still not be available. The one exception is if no students took the published test in the past year, then sessions associated with that published test will still be available in the current year.
246 Scantron Achievement Series User’s Guide
Section
IV
Index
Index
A
access granting
classroom tests . . . . . . . . . . . . . . . . . .125
item banks . . . . . . . . . . . . . . . . . . . . . . .63
multiple item banks . . . . . . . . . . . . . . .70
to Scantron support . . . . . . . . . . . . . . .51
revoking for multiple item banks . . . . . . . . .75
accessing
classroom reports . . . . . . . . . . . . . . . . . . . .189
help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .241
student scores after rollover . . . . . . . . . . . .246
student test details . . . . . . . . . . . . . . . . . . . .188
account access, setting up . . . . . . . . . . . . . . . . . . . 51
Achievement Series
NCLB and . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
activating tests . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
adding
item sections . . . . . . . . . . . . . . . . . . . . . . . .114
items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .110
staff, access to multiple item banks . . . . . . .73
adequate yearly progress . . . . . . . . . . . . . . . . . . . . . 4
NCLB and . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
adjusting tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
administering
OMR tests . . . . . . . . . . . . . . . . . . . . . . . . . .148
online tests . . . . . . . . . . . . . . . . . . . . . . . . . .141
plain paper tests . . . . . . . . . . . . . . . . . . . . .147
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . .18, 140
administrators, login rights . . . . . . . . . . . . . . 10, 228
Adobe Reader, generating reports in . . . . . . . . . . 45
Scantron Achievement Series User’s Guide
aggregating results . . . . . . . . . . . . . . . . . . . . . . . . . 14
answer key only tests, creating . . . . . . . . . . . . . . 102
appearance, changing . . . . . . . . . . . . . . . . . . . . . . 50
articulation of assessments . . . . . . . . . . . . . . . . . . 12
assembling tests . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
assessment
best practices . . . . . . . . . . . . . . . . . . . . . . . . .18
preparing classrooms for . . . . . . . . . . . . . . .13
results and reporting . . . . . . . . . . . . . . . . . . .22
AYP, SEE adequate yearly progress
B
before you share . . . . . . . . . . . . . . . . . . . . . . . . . . 66
best practices, team-building
at the school level . . . . . . . . . . . . . . . . . . . .228
at the top levels . . . . . . . . . . . . . . . . . . . . . .227
Bloom’s taxonomy . . . . . . . . . . . . . . . . . . . . . . . 222
building your team . . . . . . . . . . . . . . . . . . . . . . . . . 10
C
changing
appearance . . . . . . . . . . . . . . . . . . . . . . . . . . .50
demographics filters . . . . . . . . . . . . . . . . . .172
gradebook display options . . . . . . . . . . . . .189
group filters . . . . . . . . . . . . . . . . . . . . . . . . .173
passwords . . . . . . . . . . . . . . . . . . .47, 234–235
score range filters . . . . . . . . . . . . . . . . . . . .174
time frame filters . . . . . . . . . . . . . . . . . . . . .171
changing passwords
consultants and . . . . . . . . . . . . . . . . . . . . . .235
checking results . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
249
I
profiles, viewing . . . . . . . . . . . . . . . . . . . . .188
classroom
data, exporting . . . . . . . . . . . . . . . . . . . . . . .241
gradebooks, viewing . . . . . . . . . . . . . . . . . .186
preparing for assessment . . . . . . . . . . . . . . .13
reports . . . . . . . . . . . . . . . . . . . . . . . . .190, 240
accessing . . . . . . . . . . . . . . . . . . . . . . .189
viewing . . . . . . . . . . . . . . . . . . . . . . . .190
tests . . . . . . . . . . . . . . . . . . . . . . .130–131, 240
access list, editing . . . . . . . . . . . . . . . .125
activating . . . . . . . . . . . . . . . . . . . . . . .131
editing . . . . . . . . . . . . . . . . . . . . . . . . .240
importing errors . . . . . . . . . . . . . . . . .136
importing from ExamView . . . . . . . .134
listing . . . . . . . . . . . . . . . . . . . . . . . . . . .87
listing shared . . . . . . . . . . . . . . . . . . . .128
rescoring . . . . . . . . . . . . . . . . . . . . . . .151
rollover and . . . . . . . . . . . . . . . . . . . . .246
Secure Test Client and . . . . . . . . . . . .131
sharing options, editing . . . . . . . . . . .124
viewing properties . . . . . . . . . . . . . . .129
vs district tests . . . . . . . . . . . . . . .22, 240
uses for Skills Connection Online . . . . . . .205
viewing student reports . . . . . . . . . . . . . . .192
comma-separated value . . . . . . . . . . . . . . . . . . . . 222
comparing scores . . . . . . . . . . . . . . . . . . . . . . . . . 246
consolidated student details report . . . . . . . . . . . 192
consolidated test details report . . . . . . . . . . . . . . 169
consultants . . . . . . . . . . . . . . . . . . . . . . . . . . . 10, 228
permissions and . . . . . . . . . . . . . . . . . . . . . .235
copying
item banks for remote users . . . . . . . . . . . . .68
items between item banks . . . . . . . . . . . . . .236
multiple item banks for remote users . . . . .82
shared classroom tests . . . . . . . . . . . . . . . .130
shared tests . . . . . . . . . . . . . . . . . . . . . . . . .130
course categories . . . . . . . . . . . . . . . . . . . . . . . . . 223
courses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
creating
answer key only tests . . . . . . . . . . . . . . . . . .102
duplicate tests . . . . . . . . . . . . . . . . . . . . . . .107
item banks items
normal tests . . . . . . . . . . . . . . . . . . . . . . . . . .94
Quick Pick tests . . . . . . . . . . . . . . . . . . . . . .89
study sets . . . . . . . . . . . . . . . . . . . . . . . . . . .205
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .87
CSV . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
current scores reports, district . . . . . . . . . . . . . . 160
Customer Assistance Center . . . . . . . . . . . . . . . . . 54
account access, setting up . . . . . . . . . . . . . . .51
customer support . . . . . . . . . . . . . . . . . . . . . . . . 234
customizing, study guides . . . . . . . . . . . . . . . . . . 204
D
data
entry . . . . . . . . . . . . . . . . . . . . . . . . . . . .10, 228
exporting . . . . . . . . . . . . . . . . . . . . . . . .44, 239
importing . . . . . . . . . . . . . . . . . . . . . . . . . . .234
date, rollover and . . . . . . . . . . . . . . . . . . . . . . . . . 245
deleting
duplicate tests . . . . . . . . . . . . . . . . . . . . . . .107
item banks
items
items from a test . . . . . . . . . . . . . . . . . . . . .113
sections . . . . . . . . . . . . . . . . . . . . . . . . . . . .117
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .121
delivering testing . . . . . . . . . . . . . . . . . . . . . . . . . . 13
demographics . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
filters, changing . . . . . . . . . . . . . . . . . . . . . .172
distribution agreement . . . . . . . . . . . . . . . . . . . . . 65
district
best assessment practices . . . . . . . . . . . . . .227
current scores reports . . . . . . . . . . . . . . . . .160
item analysis reports . . . . . . . . . . . . . . . . . .162
viewing . . . . . . . . . . . . . . . . . . . . . . . .168
item analysis reports, viewing . . . . . . .235, 239
login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .227
rights . . . . . . . . . . . . . . . . . . . . . . . . . .227
reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . .239
scores reports . . . . . . . . . . . . . . . . . . . . . . .161
viewing . . . . . . . . . . . . . . . . . . . . . . . .164
student reports . . . . . . . . . . . . . . . . . . . . . .163
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .237
reports . . . . . . . . . . . . . . . . . . . . . . . . .160
vs classroom tests . . . . . . . . . . . . . . . . .22
tests vs classroom tests . . . . . . . . . . . . . . . .240
viewing student reports . . . . . . . . . . . . . . .163
downloading
results . . . . . . . . . . . . . . . . . . . . . . . . . . . . .176
duplicate tests
creating . . . . . . . . . . . . . . . . . . . . . . . . . . . .107
deleting . . . . . . . . . . . . . . . . . . . . . . . . . . . .107
editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .107
viewing . . . . . . . . . . . . . . . . . . . . . . . . . . . .107
duplicating sections of a test . . . . . . . . . . . . . . . . 115
250 Scantron Achievement Series User’s Guide
E
editing
classroom tests . . . . . . . . . . . . . . . . . . . . . .240
access list . . . . . . . . . . . . . . . . . . . . . . .125
sharing options . . . . . . . . . . . . . . . . . .124
duplicate tests . . . . . . . . . . . . . . . . . . . . . . .107
item banks
access list . . . . . . . . . . . . . . . . . . . . . . . .63
multiple sharing options . . . . . . . . . . . .71
SEE Working with Items sharing options . . . . . . . . . . . . . . . . . . .63
item sections . . . . . . . . . . . . . . . . . . . . . . . .115
items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .111
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .109
options . . . . . . . . . . . . . . . . . . . . . . . .123
properties . . . . . . . . . . . . . . . . . . . . . .121
educational reform . . . . . . . . . . . . . . . . . . . . . . . . . 3
email, technical support . . . . . . . . . . . . . . . . . . . . . 55
errors on imported tests . . . . . . . . . . . . . . . . . . . 136
ExamView Test Generator importing
classroom tests . . . . . . . . . . . . . . . . . .134
tests from . . . . . . . . . . . . . . . . . . . . . .134
existing items, importing . . . . . . . . . . . . . . . . . . . . 15
exporting
classroom data . . . . . . . . . . . . . . . . . . . . . . .241
data . . . . . . . . . . . . . . . . . . . . . . . . . . . .44, 239
results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .176
test results . . . . . . . . . . . . . . . . . . . . . . . . . . .21
extended response . . . . . . . . . . . . . . . . . . . . . . . . 224
items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
external assistance . . . . . . . . . . . . . . . . . . . . . . . . . 51
F
favorites, setting Achievement Series as . . . . . . . . 29
filters changing
demographic . . . . . . . . . . . . . . . . . . . .172
group . . . . . . . . . . . . . . . . . . . . . . . . . .173
score range . . . . . . . . . . . . . . . . . . . . .174
time frame . . . . . . . . . . . . . . . . . . . . . .171
district reports and . . . . . . . . . . . . . . . . . . .171
reports and . . . . . . . . . . . . . . . . . . . . . . . . . .23
finding test content . . . . . . . . . . . . . . . . . . . . . . . . 97
forgotten password . . . . . . . . . . . . . . . . . . . . . . . . 31
forms, OMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
Teacher Version
G
generating
PDF reports . . . . . . . . . . . . . . . . . . . . . . . . .45
targeted
netTrekker d.i. materials . . . . . .174, 196
Skills Connection Online materials . . . . . . . . . . . . . . . . .174, 196
GIF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
grade levels
reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . .239
gradebook display options, changing . . . . . . . . . 189
granting
classroom tests access . . . . . . . . . . . . . . . . .125
item banks access . . . . . . . . . . . . . . . . . . . . .63
grants and funding . . . . . . . . . . . . . . . . . . . . . . . . . . 4
groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
filters, changing . . . . . . . . . . . . . . . . . . . . . .173
No Child Left Behind and . . . . . . . . . . . . . .14
tracking demographics and . . . . . . . . . . . . . .14
H
help
accessing online . . . . . . . . . . . . . . . . . . . . . .54
Customer Assistance Center . . . . . . . . . . . .55
home study guide . . . . . . . . . . . . . . . . . . . . . . . . 204
I
importing
data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .234
errors on tests from ExamView . . . . . . . . .136
ExamView tests . . . . . . . . . . . . . . . . . . . . .134
permissions . . . . . . . . . . . . . . . . . . . . .134
existing items . . . . . . . . . . . . . . . . . . . . . . . . .15
from ExamView . . . . . . . . . . . . . . . . . . . . .134
rollover and . . . . . . . . . . . . . . . . . . . . . . . . .245
tests from ExamView . . . . . . . . . . . . . . . . .134
ink marks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
internal support, toggling . . . . . . . . . . . . . . . . . . . 51
IP addresses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
item banks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
access list, editing . . . . . . . . . . . . . . . . . . . . .63
adding multiple staff to share list . . . . . . . . .73
copying items between . . . . . . . . . . . . . . . .236
details reports . . . . . . . . . . . . . . . . . . . . . . . .12
development . . . . . . . . . . . . . . . . . . . . . . . .204
editing access list . . . . . . . . . . . . . . . . . . . . . .63
editing sharing options . . . . . . . . . . . . . . . . .63
for multiple . . . . . . . . . . . . . . . . . . . . . .71
item entry and . . . . . . . . . . . . . . . . . . . . . . .235
maximum items . . . . . . . . . . . . . . . . . . . . . .236
moving items between . . . . . . . . . . . . . . . .236
Scantron . . . . . . . . . . . . . . . . . . . . . . . . . . .236
sending multiple to remote users . . . . . . . . .82
251
item banks, ctd.
sending to remote users . . . . . . . . . . . . . . . .68
sharing . . . . . . . . . . . . . . . . . . . . . . . . . .60, 236
with remote users . . . . . . . . . . . . . . . . .67
within a district or school . . . . . . . . . . .60
sharing multiple
remotely . . . . . . . . . . . . . . . . . . . . .77, 81
within a district or school . . . . . . . . . . .70
using Scantron . . . . . . . . . . . . . . . . . . . . . . . .91
viewing
remote share settings . . . . . . . . . . . . . .66
sharing . . . . . . . . . . . . . . . . . . . . . . . . . .62
item detail reports . . . . . . . . . . . . . . . . . . . . . . . . 238
item sections
adding . . . . . . . . . . . . . . . . . . . . . . . . . . . . .114
editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .115
item statistics detail . . . . . . . . . . . . . . . . . . . . . . . 156
items
adding . . . . . . . . . . . . . . . . . . . . . . . . . . . . .110
analysis of . . . . . . . . . . . . . . . . . . . . . . . . . .162
analysis reports
classroom tests . . . . . . . . . . . . . . . . . .240
viewing . . . . . . . . . . . . . . . .168, 235, 239
copying between item banks . . . . . . . . . . .236
deleting from a test . . . . . . . . . . . . . . . . . . .113
editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .111
entry in item banks . . . . . . . . . . . . . . . . . . .235
ExamView tests and supported types
features of . . . . . . . . . . . . . . . . . . . . . . . . . . .16
maximum in bank . . . . . . . . . . . . . . . . . . . .236
moving . . . . . . . . . . . . . . . . . . . . . . . . . . . . .111
moving between item banks . . . . . . . . . . . .236
multiple response . . . . . . . . . . . . . . . . . . . .236
previewing . . . . . . . . . . . . . . . . . . . . . . . . . .112
tracking usage . . . . . . . . . . . . . . . . . . . . . . . .16
using in tests . . . . . . . . . . . . . . . . . . . . . . . . .17
viewing comments . . . . . . . . . . . . . . . . . . .237
J
JPG . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
L
listing
classroom tests . . . . . . . . . . . . . . . . . . . . . . .87
shared tests . . . . . . . . . . . . . . . . . . . . . . . . .128
lists
sorting . . . . . . . . . . . . . . . . . . . . . . . . . . . . .188
using . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
location controllers . . . . . . . . . . . . . . . . 10, 227–228
locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
netTrekker d.i . . . . . . . . . . . . . . . . . . . . . . . .53
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
login
retrying . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
rights
administrators . . . . . . . . . . . . . . . .10, 228
district . . . . . . . . . . . . . . . . . . . . . . . . .227
school . . . . . . . . . . . . . . . . . . . . . .10, 228
lower 27% . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
M
Math Type . . . . . . . . . . . . . . . . . . . . . . . . . . 235–237
maximum items, item banks . . . . . . . . . . . . . . . . 236
monitoring testing . . . . . . . . . . . . . . . . . . . . . . . . . 20
moving
items in a test . . . . . . . . . . . . . . . . . . . . . . .111
sections of a test . . . . . . . . . . . . . . . . . . . . .116
moving items between item banks . . . . . . . . . . . 236
items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .236
multiple share
adding to staff list . . . . . . . . . . . . . . . . . . . . .73
item banks
changing staff access to . . . . . . . . . . . .73
copies . . . . . . . . . . . . . . . . . . . . . . . . . .82
editing sharing options . . . . . . . . . . . . .71
remote . . . . . . . . . . . . . . . . . . . . . . . . . .77
revoking remote access . . . . . . . . . . . .81
within district or school . . . . . . . . . . . .70
N
NAEP, SEE National Assessment of
Educational Progress
National Assessment of Educational Progress . . . 4
navigating pages . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
NCLB, SEE No Child Left Behind . . . . . . . . . . . . 4
netTrekker d.i.
generating targeted materials . . . . . . .174, 196
providing login . . . . . . . . . . . . . . . . . . . . . . .53
network ID
networks testing is slow . . . . . . . . . . . . . . . . . . . . 21
No Child Left Behind . . . . . . . . . . . . . . . . . . . . . . . 4
aggregated results and . . . . . . . . . . . . . . . . . .14
groups and . . . . . . . . . . . . . . . . . . . . . . . . . . .14
normal tests
creating . . . . . . . . . . . . . . . . . . . . . . . . . . . . .94
252 Scantron Achievement Series User’s Guide
O
OMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
scanners . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
tests, administering . . . . . . . . . . . . . . . . . . .148
online collaboration . . . . . . . . . . . . . . . . . . . . . . . . 11
online tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
administering . . . . . . . . . . . . . . . . . . . . . . . .141
dry runs and . . . . . . . . . . . . . . . . . . . . . . . . . .18
pausing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .243
saving . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .243
scoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . .150
security . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
slow response . . . . . . . . . . . . . . . . . . . . . . . .21
timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .243
options
changing gradebook . . . . . . . . . . . . . . . . . .189
scoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
overwriting import data . . . . . . . . . . . . . . . . . . . . 235
P
pages, navigating . . . . . . . . . . . . . . . . . . . . . . . . . . 32
paper test forms, previewing . . . . . . . . . . . . . . . . 118
parents, communicating with . . . . . . . . . . . . . . . . 18
passages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
password
changing as a consultant . . . . . . . . . . . . . . .235
passwords
changing . . . . . . . . . . . . . . . . . . . .47, 234–235
forgetting . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
typing incorrectly . . . . . . . . . . . . . . . . . . . . .30
pausing online tests . . . . . . . . . . . . . . . . . . . . . . . 243
PDF reports, generating . . . . . . . . . . . . . . . . . . . . 45
peer graders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
peer review . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
pencil marks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
percentile ranking . . . . . . . . . . . . . . . . . . . . . . . . 227
Performance Series . . . . . . . . . . . . . . . . . . . . . . . 227
permissions, importing ExamView tests and . . . 134
personal preferences, setting . . . . . . . . . . . . . . . . . 49
plain paper
scanners . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
scanning . . . . . . . . . . . . . . . . . . . . . . . . . . . .241
copying and . . . . . . . . . . . . . . . . . . . . . .18
tests, administering . . . . . . . . . . . . . . . . . . .147
practice tests, when to run . . . . . . . . . . . . . . . . . . 21
preferences
account access . . . . . . . . . . . . . . . . . . . . . . . .51
changing apperance . . . . . . . . . . . . . . . . . . . .50
providing netTrekker d.i. login . . . . . . . . . . .53
toggling internal support . . . . . . . . . . . . . . . .51
Teacher Version
preparing classrooms for assessment . . . . . . . . . . 13
presenting scores . . . . . . . . . . . . . . . . . . . . . . . . . 240
to students . . . . . . . . . . . . . . . . . . . . . . . . . .243
pre-slugging test forms . . . . . . . . . . . . . . . . . . . . 241
previewing
items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .112
paper test forms . . . . . . . . . . . . . . . . . . . . .118
printing
consolidated test details reports . . . . . . . . .169
test details reports . . . . . . . . . . . . . . . . . . . .119
problems, scanning . . . . . . . . . . . . . . . . . . . . . . . . 20
proctors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
profiles, student
providing netTrekker d.i. login . . . . . . . . . . . . . . . 53
proxy servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
p-value . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156, 227
Q
Quick Pick tests, creating . . . . . . . . . . . . . . . . . . . 89
R
remediation, Skills Connection Online and . . . . 205
remote
copying . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
share settings, viewing . . . . . . . . . . . . . . . . .66
sharing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
users
revoking sharing for multiple item banks . . . . . . . . . . . . . . . . . . . . . . . .81
sending item bank copies to . . . . . . . .68
sharing item banks with . . . . . . . . . . . .67
sharing multiple item banks with . . . . .77
removing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
reporting requirements . . . . . . . . . . . . . . . . . . . . . . 6
reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
classroom . . . . . . . . . . . . . . . . . . . . . .190, 240
consolidated student details . . . . . . . . . . . .192
consolidated test details . . . . . . . . . . . . . . .169
district current scores . . . . . . . . . . . . . . . . .160
district item analysis . . . . . . . . . . . . . . . . . .162
district scores . . . . . . . . . . . . . . . . . . . . . . .161
district students . . . . . . . . . . . . . . . . . . . . . .163
filtering . . . . . . . . . . . . . . . . . . . . . . . . .23, 171
generating PDF . . . . . . . . . . . . . . . . . . . . . . .45
grade level . . . . . . . . . . . . . . . . . . . . . . . . . .239
item analysis . . . . . . . . . . . . . . . .168, 235, 239
item bank details . . . . . . . . . . . . . . . . . . . . . .12
printing consolidated test details . . . . . . . .169
school . . . . . . . . . . . . . . . . . . . . . . . . . . . . .160
school or district scores . . . . . . . . . . . . . . .164
253
reports, ctd.
targeted materials
netTrekker d.i. . . . . . . . . . . . . . .174, 196
Skills Connection Online . . . . . .174, 196
viewing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .163
classroom student . . . . . . . . . . . . . . . .192
district student . . . . . . . . . . . . . . . . . .163
require Secure Test Client . . . . . . . . . . . . . . . . . . 131
rescoring
classroom tests . . . . . . . . . . . . . . . . . . . . . .151
tests . . . . . . . . . . . . . . . . . . . . . . . . . . .151, 239
resources
providing netTrekker d.i. login . . . . . . . . . . .53
results
accessing . . . . . . . . . . . . . . . . . . . . . . . . . . .241
aggregating . . . . . . . . . . . . . . . . . . . . . . . . . . .14
checking . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
exporting . . . . . . . . . . . . . . . . . . . . . . . . . . .176
review units of study . . . . . . . . . . . . . . . . . . . . . . 205
reviewing standards covered by test content . . . 126
revoking access
to item banks . . . . . . . . . . . . . . . . . . . .63
to multiple item banks . . . . . . . . . . . . .75
classroom tests access . . . . . . . . . . . . . . . . .125
remote access from multiple item banks . . .81
rights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
school login . . . . . . . . . . . . . . . . . . . . . .10, 228
rollover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230, 244
accessing student scores . . . . . . . . . . . . . . .246
affect on classroom tests . . . . . . . . . . . . . .246
dates and . . . . . . . . . . . . . . . . . . . . . . . . . . .245
importing and . . . . . . . . . . . . . . . . . . . . . . .245
schools and . . . . . . . . . . . . . . . . . . . . . . . . .245
scores and . . . . . . . . . . . . . . . . . . . . . . . . . .246
test sessions and . . . . . . . . . . . . . . . . . . . . .246
tests and . . . . . . . . . . . . . . . . . . . . . . . . . . . . .87
S
saving
online tests . . . . . . . . . . . . . . . . . . . . . . . . . .243
Scan Station . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
scanners
OMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
plain paper . . . . . . . . . . . . . . . . . . . . . . . . . .242
scanning
plain paper . . . . . . . . . . . . . . . . . . . . . . . . . .241
problems . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
sessions
dry runs and . . . . . . . . . . . . . . . . . . . . .18
speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .150
Scantron
item banks . . . . . . . . . . . . . . . . . . . . . . . . . .236
254
searching by standards . . . . . . . . . . . . . . . . .91
support account access . . . . . . . . . . . . . . . . .51
school
best assessment practices . . . . . . . . . . . . . .228
login rights . . . . . . . . . . . . . . . . . . . . . .10, 228
rollover and . . . . . . . . . . . . . . . . . . . . . . . . .245
scores reports, viewing . . . . . . . . . . . . . . . .164
test reports . . . . . . . . . . . . . . . . . . . . . . . . .160
score range filters, changing . . . . . . . . . . . . . . . . 174
scores . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
comparing with previous years . . . . . . . . . .246
presenting to students . . . . . . . . . . . . .240, 243
reports, viewing . . . . . . . . . . . . . . . . . . . . . .164
rollover and . . . . . . . . . . . . . . . . . . . . . . . . .246
viewing . . . . . . . . . . . . . . . . . . . . . . . . . . . .239
scoring
online tests . . . . . . . . . . . . . . . . . . . . . . . . .150
options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .150
searching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
sections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
adding . . . . . . . . . . . . . . . . . . . . . . . . . . . . .114
deleting . . . . . . . . . . . . . . . . . . . . . . . . . . . .117
duplicating . . . . . . . . . . . . . . . . . . . . . . . . . .115
editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .115
moving . . . . . . . . . . . . . . . . . . . . . . . . . . . . .116
tests and . . . . . . . . . . . . . . . . . . . . . . . . . . . .131
security options . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
sending
item bank copies to remote users . . . . . . . .68
multiple item bank copies to remote users .82
sessions
rollover and . . . . . . . . . . . . . . . . . . . . . . . . .246
setting up
account access . . . . . . . . . . . . . . . . . . . . . . . .51
personal preferences . . . . . . . . . . . . . . . . . . .49
subscriptions . . . . . . . . . . . . . . . . . . . . . . . . .52
shared tests
copying . . . . . . . . . . . . . . . . . . . . . . . . . . . .130
listing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .128
properties, viewing . . . . . . . . . . . . . . . . . . .129
sharing
item banks . . . . . . . . . . . . . . . . . . . . . . .60, 236
several at same time . . . . . . . . . . . . . . .70
with remote users . . . . . . . . . . . . . . . . .67
within a district or school . . . . . . . . . .60
multiple item banks
remotely . . . . . . . . . . . . . . . . . . . . .77, 81
within a district or school . . . . . . . . . .70
tests . . . . . . . . . . . . . . . . . . . . . . . . . . .124, 238
viewing
classroom tests . . . . . . . . . . . . . . . . . .124
item bank . . . . . . . . . . . . . . . . . . . . . . .62
short response items . . . . . . . . . . . . . . . . . . . . . . . 13
Scantron Achievement Series User’s Guide
Skills Connection Online . . . . . . . . . . . . . . 203–204
creating study sets . . . . . . . . . . . . . . . . . . . .205
customizing study guides . . . . . . . . . . . . . .204
generating targeted materials . . . . . . .174, 196
home study guide . . . . . . . . . . . . . . . . . . . .204
peer graders and . . . . . . . . . . . . . . . . . . . . .205
using
for remediation . . . . . . . . . . . . . . . . . .205
in classroom . . . . . . . . . . . . . . . . . . . .205
to review . . . . . . . . . . . . . . . . . . . . . . .205
Software Training Classes . . . . . . . . . . . . . . . . . . . 54
sorting lists . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
speed, scanning . . . . . . . . . . . . . . . . . . . . . . . . . . 242
spoiling tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
staff
access to multiple item banks . . . . . . . . . . . .75
adding access to multiple item banks . . . . . .73
standard parent letter . . . . . . . . . . . . . . . . . . . . . . . 18
standards
covered in test content . . . . . . . . . . . . . . . .126
applying to items, SEE Working with Items searching in Scantron item banks, SEE Working
with Items
starting Achievement Series . . . . . . . . . . . . . . . . . 28
state standards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
statistics, item . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
student records . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
accessing scores after rollover . . . . . . . . . .246
presenting scores . . . . . . . . . . . . . . . . .240, 243
test details, accessing . . . . . . . . . . . . . . . . . .188
transferring . . . . . . . . . . . . . . . . . . . . . . . . .245
Student-Class, overwriting enrollments . . . . . . . 235
students
consolidated details report . . . . . . . . . . . . .192
district reports . . . . . . . . . . . . . . . . . . . . . . .163
viewing student (classroom) . . . . . . . . . . . .192
viewing student (district) . . . . . . . . . . . . . .163
students, profile . . . . . . . . . . . . . . . . . . . . . . . . . . 230
study guides
customizing . . . . . . . . . . . . . . . . . . . . . . . . .204
study sets
creating . . . . . . . . . . . . . . . . . . . . . . . . . . . .205
subnet mask . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
subscriptions, setting up . . . . . . . . . . . . . . . . . . . . 52
support account access . . . . . . . . . . . . . . . . . . . . . 51
T
teacher-graded tests . . . . . . . . . . . . . . . . . . . . . . . . 13
teachers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
SEE ALSO staff member records
team features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
articulation of assessment . . . . . . . . . . . . . . .12
item bank details reports . . . . . . . . . . . . . . .12
online collaboration . . . . . . . . . . . . . . . . . . .11
peer review . . . . . . . . . . . . . . . . . . . . . . . . . .11
remote sharing and copying . . . . . . . . . . . . .12
team-building
district/top-level . . . . . . . . . . . . . . . . . . . . .227
school . . . . . . . . . . . . . . . . . . . . . . . . . . . . .228
technical support
email . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
website . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
Test Builder, import errors on classroom tests . 136
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134
activating . . . . . . . . . . . . . . . . . . . . . . . . . . .131
adjusting . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
administering . . . . . . . . . . . . . . . . . . . . .18, 140
OMR . . . . . . . . . . . . . . . . . . . . . . . . . .148
online . . . . . . . . . . . . . . . . . . . . . . . . .141
plain paper . . . . . . . . . . . . . . . . . . . . .147
assembling . . . . . . . . . . . . . . . . . . . . . . . . . . .15
classroom . . . . . . . . . . . . . . . . . . . . . . . . . .240
vs district . . . . . . . . . . . . . . . . . . . . . . .240
classroom vs district . . . . . . . . . . . . . . . . . . .22
consolidated details report . . . . . . . . . . . . .169
creating . . . . . . . . . . . . . . . . . . . . . . . . . . . . .87
answer key only . . . . . . . . . . . . . . . . .102
duplicate . . . . . . . . . . . . . . . . . . . . . . .107
using Normal . . . . . . . . . . . . . . . . . . . .94
with Quick Pick . . . . . . . . . . . . . . . . . .89
deleting . . . . . . . . . . . . . . . . . . . . . . . . . . . .121
sections from . . . . . . . . . . . . . . . . . . .117
delivery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6
details reports, printing . . . . . . . . . . . . . . . .119
development . . . . . . . . . . . . . . . . . . . . . . . . . .6
dry run
online . . . . . . . . . . . . . . . . . . . . . . . . . .18
scanning sessions . . . . . . . . . . . . . . . . .18
duplicate
deleting . . . . . . . . . . . . . . . . . . . . . . . .107
editing . . . . . . . . . . . . . . . . . . . . . . . . .107
viewing . . . . . . . . . . . . . . . . . . . . . . . .107
duplicating, sections of . . . . . . . . . . . . . . . .115
editing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .109
classroom . . . . . . . . . . . . . . . . . . . . . .240
classroom access . . . . . . . . . . . . . . . . .125
classroom sharing . . . . . . . . . . . . . . . .124
item sections . . . . . . . . . . . . . . . . . . . .115
options . . . . . . . . . . . . . . . . . . . . . . . .123
properties . . . . . . . . . . . . . . . . . . . . . .121
effect of rollover on classroom . . . . . . . . .246
finding content . . . . . . . . . . . . . . . . . . . . . . .97
importing from ExamView . . . . . . . . . . . .134
listing, classroom . . . . . . . . . . . . . . . . . . . . . .87
logging in . . . . . . . . . . . . . . . . . . . . . . . . . . .234
logging on . . . . . . . . . . . . . . . . . . . . . . . . . . .20
management . . . . . . . . . . . . . . . . . . . . . . . . . .6
Teacher Version 255
tests, ctd.
moving
items . . . . . . . . . . . . . . . . . . . . . . . . . .111
sections of . . . . . . . . . . . . . . . . . . . . . .116
network is slow . . . . . . . . . . . . . . . . . . . . . . .21
online test options . . . . . . . . . . . . . . . . . . . . .13
operators . . . . . . . . . . . . . . . . . . . . . . . .10, 228
permissions and importing . . . . . . . . . . . . .134
pre-slugging forms . . . . . . . . . . . . . . . . . . .241
previewing . . . . . . . . . . . . . . . . . . . . . . . . . .118
printing
consolidated details report . . . . . . . . .169
details reports . . . . . . . . . . . . . . . . . . .119
rescoring . . . . . . . . . . . . . . . . . . . . . . .151, 239
classroom . . . . . . . . . . . . . . . . . . . . . .151
results, exporting . . . . . . . . . . . . . . . . . . . . . .21
reviewing covered standards . . . . . . . . . . . .126
rollover and . . . . . . . . . . . . . . . . . . . . . . . . . .87
rollover and sessions . . . . . . . . . . . . . . . . . .246
running practice . . . . . . . . . . . . . . . . . . . . . .21
scanning . . . . . . . . . . . . . . . . . . . . . . . . . . . .150
school reports . . . . . . . . . . . . . . . . . . . . . . .160
scoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . .150
sharing . . . . . . . . . . . . . . . . . . . . . . . . .124, 238
spoiling . . . . . . . . . . . . . . . . . . . . . . . . . . . .127
teacher-graded items . . . . . . . . . . . . . . . . . . .13
time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .237
timing online . . . . . . . . . . . . . . . . . . . . . . . .243
types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
using items in . . . . . . . . . . . . . . . . . . . . . . . .17
viewing . . . . . . . . . . . . . . . . . . . . . . . . . . . . .109
classroom item analysis . . . . . . . . . . .240
classroom sharing . . . . . . . . . . . . . . . .124
options . . . . . . . . . . . . . . . . . . . . . . . .122
properties . . . . . . . . . . . . . . . . . . . . . .120
scores . . . . . . . . . . . . . . . . . . . . . . . . .239
status . . . . . . . . . . . . . . . . . . . . . . . . . .127
time frame filters, changing . . . . . . . . . . . . . . . . . 171
timed online tests . . . . . . . . . . . . . . . . . . . . . . . . . 243
timing, tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
toggling internal support . . . . . . . . . . . . . . . . . . . . 51
tracking
demographics . . . . . . . . . . . . . . . . . . . . . . . .14
item use . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
transferring
results to a different application . . . . . . . . .176
students . . . . . . . . . . . . . . . . . . . . . . . . . . . .245
true/false . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
types of tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
U
upper 27% . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
using
items in tests . . . . . . . . . . . . . . . . . . . . . . . . .17
lists . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
targeted instruction . . . . . . . . . . . . . . . . . . .202
V
viewing
class profiles . . . . . . . . . . . . . . . . . . . . . . . .188
classroom
gradebooks . . . . . . . . . . . . . . . . . . . . .186
reports . . . . . . . . . . . . . . . . . . . . . . . . .190
student reports . . . . . . . . . . . . . . . . . .192
test sharing . . . . . . . . . . . . . . . . . . . . .124
district
student reports . . . . . . . . . . . . . . . . . .163
duplicate tests . . . . . . . . . . . . . . . . . . . . . . .107
item
item analysis reports . . . . . .168, 235, 239
scores reports . . . . . . . . . . . . . . . . . . .164
analysis for classroom tests . . . . . . . .240
comments . . . . . . . . . . . . . . . . . . . . . .237
item banks, sharing . . . . . . . . . . . . . . . . . . . .62
remote share settings . . . . . . . . . . . . . . . . . .66
reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . .163
school scores reports . . . . . . . . . . . . . . . . .164
scores . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .239
shared test properties . . . . . . . . . . . . . . . . .129
tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .109
options . . . . . . . . . . . . . . . . . . . . . . . .122
properties . . . . . . . . . . . . . . . . . . . . . .120
status . . . . . . . . . . . . . . . . . . . . . . . . . .127
W
website, technical support . . . . . . . . . . . . . . . . . . . 55
wildcards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
working with ExamView tests . . . . . . . . . . . . . . 134
256 Scantron Achievement Series User’s Guide
NOTES
Achievement Series User’s Guide
Teacher’s Version
Part No: AS-UG-TCH
डाउनलोड
सार्वजनिक लिंक अपडेट किया गया
आपकी चैट का सार्वजनिक लिंक अपडेट कर दिया गया है. You may view and manage your chat links after registration here.
दस्तावेज़ सार्वजनिक लिंक
विज्ञापन
