ACSI Scoring Preparation Webinar 4_10_18 for handouts
HMH Scoring Services Preparation
Wendy Freyschlag, Houghton Mifflin Harcourt, Assessment Consultant Denise Piatt, Houghton Mifflin Harcourt, Assessments Consultant
Agenda Outline Preparation for HMH Scoring Services HMH Scoring Services Folder Scoring Deadline and Test Coordinator Letter Post Testing Checklist from DAs Coding of Answer Documents Class ID Sheet Building ID Sheet Order Form for Scoring Services Optional Printed Reports Packaging and UPS Directions
Scoring Services Folder • Sent to Test Coordinator at school • Sent after Online Enrollment completed
Folder not received and OE completed? Contact Ryan Cartwright [email protected]
630.467.6103
Scoring Deadline and Scoring Info Letter • Scoring Receipt Date: by May 31 • Letter specifies: – Scoring pricing – General coding info – Building & Class ID sheet completion – OSS completion • Order for Scoring Service – Shipping instructions
Directions for Administration
• Teachers used to administer the assessments, specific to level and assessment
• Three parts: 1. Info to prepare for testing 2. Instructions for test administration 3. Instructions for scoring preparation
Posttesting Checklist • Ask your teachers to reference Part 3 in their Directions for Administration to organize and scan their students’ answer documents • Follow steps for verifying that each student has an answer folder or test book that is ready for scoring services – Look over for damage • tears, creases, or water damage – If extensive, transfer student info and answers to a new document or book • Destroy all scratch paper
Posttesting Checklist, cont. • Scan for proper marking
•
– No. 2 pencil used – Dark response marks made in answer circles – Changed answers are completely erased Erase stray marks – marks on answer circles that aren’t answers – marks along the edges and top of page(s)
Student Barcode Labels
• If used, confirm that student barcode labels were applied correctly – Secure – Aligned in proper space on back of test book or on answer document
If Student Barcode Labels are Used • Embedded Fields (no bubbling) – Name – Gender
• New student, no label? - Must bubble in information
• Accurately write in or use label Teacher Name Grade School System – write “ACSI” City/State of School
Barcode Label
– Birth Date
No Barcode Label? Coding – Required Information • Accurately Write and Bubble – Student Name – Birth Date (Month, Day, Year) – Gender – Write in: • Teacher Name • Grade • School • System/District – write “ACSI” • City/State – for school’s location
Form Coding • Accurately Bubble – Iowa Assessment Form • Form “G” for Grades K-8 • Form “E” for Grades 9-12 – CogAT Level Bubbled Inside answer folder – Bubble “7”
Optional Coding - Programs This coding should be done after testing, by a teacher or administrator only. Programs (if qualified): – IEP = Special Needs (or 504 plan) – F/RL = Free or Reduced Lunch – ELL = English Lang. Learner – T1 L = Title 1 Reading/Language – T1 M = Title 1 Math
Optional Coding - Omit from Group Averages OFFICE USE ONLY: Z – Approval needed from the Test Coordinator
• This is where you will mark for any students who are going to be excluded from averages due to a pre-approved situation.
• Student tests will still be scored, but you may use the “Z” code to include or exclude from group reports in DM.
• Degree symbol (°) on reports
Optional Coding – Years in Current School • How many full years in current school – Test Administrator Use Only – Column A 0 = less than 1 full year 1 = 1 year 2 = 2 years 3 = 3 years 4 = 4 years 5 = 5 years 6 = 6 years 7 = 7 years, etc. up to 9
Optional Coding – Home Reporting Home Reporting:
• If student lives in a home where Spanish is the primary spoken language
• Profile Narrative reports can be generated in Spanish for those students who are coded with a ‘2’
Optional Coding – Ethnicity / Race Please note that Hispanic/Latino is considered an ethnicity, not a race.
• For Ethnicity – mark only 1 answer – Hispanic or Latino (A person who is Cuban, Mexican, Puerto Rican, Spanish, South or Central American or other Spanish culture or origin, regardless of race.) – Not Hispanic or Latino
.
Optional Coding – Ethnicity / Race
Class Identification Sheet - Blue • Information box
• • • • •
– April 15, 2018 for Test Date – School name for Building name – ACSI for System Name – City where your school resides Teacher’s name under Class Name Leave Class Code blank Grade should reflect same grade as the students’ answer document Indicate correct Form of the Iowa • Form “G” for Grades K-8 • Form “E” for Grades 9-12 Answer Document Count for the grade
Stacking Test Books • For each classroom, stack completed
• • •
•
test books so that the name grids on the back covers are facing up NO need to alphabetize Keep Iowa and CogAT separate To prevent test book spines from bending, stack as follows: – Stack books in groups of 5 – Alternate the direction the spines face for each stack of 5 books, keeping name grid facing up Place one Grade/Class ID sheet of top of stack
Stacking Answer Documents • For each classroom, stack completed • • •
•
answer documents NO need to alphabetize Place one Grade/Class ID sheet of top of stack Preferable to place one classes’ answer documents and Grade ID Sheet in an envelope Use a separate envelope for each class
Building Identification Sheet - Purple • Use only one • Included in HMH Scoring Folder • Place on top of box #1. • Premarked for your convenience • Your school code number •
appears on this sheet Please write this number in your files (needed for box labels)
Order Form for HMH Scoring Services • Dataset ID Number is
• • • •
upper right corner, assigned to your school and used to track your documents Critical that you use this OSS form – HMH Folder Fill in document counts Place on top of box #1 with the purple Building ID Sheet Replacement needed? Call Ryan Cartwright 630.467.6103
HMH Scoring Services Pricing Per Student • Pricing in your letter in the HMH Scoring Folder • ACSI Schools receive student data online via DataManager for dynamic web-based reporting • Next week, HMH will host a webinar on DataManager reports creation • In early-May, HMH will host webinars to provide insight into score interpretation • Register at www.purposefuldesign.com under Assessment Support / Professional Development
Reverse Side of OSS • Order optional printed reports – Some not available in DataManager • Self-Stick Student Folder Score Labels • Iowa Class Diagnostic Report • Iowa Class Response Record • Iowa/CogAT Combined List of Student Scores
• Report samples are available at www.purposefuldesign.com under Assessment Support/HMH Iowa Assessment or CogAT
Optional Reports – Not Avail. in DM
25
Optional Reports – Not Avail. in DM
26
Optional Reports – Not Avail. in DM
27
Optional Reports – Not Avail. in DM
28
Optional Reports – Not Avail. in DM
29
Optional Reports – Avail. in May 2018
30
Optional Reports – Not Avail. in DM
31
Optional Reports – Avail. in DataManager
32
Optional Reports – Avail. in DataManager
Sample Reported Scores
Sample Reported Scores
Domains/Cognitive Levels
Sample Reported Scores
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Shipping Answer Documents • Stack all answer docs/test books for each • • • • • •
teacher by grade (no need to alphabetize) Keep all docs for class in same box, if not able then continue in next consecutive box Place one Grade/Class ID Sheet (blue) on top of each group Place each teachers’ answer documents in envelopes with Grade/Class ID Sheet on top Top of box #1 - pink OSS & purple Building ID Package in sturdy boxes – pack securely to avoid shifting during transit Label each box 1 of ____, 2 of ____, etc. _____ being total # boxes
UPS Return Service Label Instructions • Documents returned via UPS • 3 white UPS/RS Labels in packet
•
– Place 1 label on each box – Second portion is your Return Service receipt, w tracking info • Keep this receipt Also place 1 of the green “Special Processing” labels on the outside of each box – Fill in School name and code – Fill in Package ___ of ___ on each green label – Check if the OSS is in this box
UPS Pickup • Regular/Daily Pickup Service •
- Send boxes with regular driver No regular pick up? Follow steps: - Have preprinted label in hand - Call 1.800.742.5877 on or before May 22nd (for May 31st deadline) - Follow prompts: - Select voice option “Send a package” - Select voice option “Schedule a pickup” - When asked if want info on nearest location, indicate “No” - When asked if have tracking #, indicate “Yes” - Provide required info and # of boxes to be picked up - Select date, time, and location for pickup - Verify the details of your request - You will receive a pickup confirmation and a Pickup Request number (write this down)
Important Note about DataManager • If administering the Iowa and CogAT using test books and •
answer documents, there is no reason to access the Assessments portion of DataManager. Please do not access this area as it is only used for online testing. Making changes in this area could negatively impact every school in the ACSI testing program, not just your building.
DataManager Reporting Webinar Tuesday, April 17th from 11:00AM – 12:00 noon (MST)
www.purposefuldesign.com under Assessment Support / Professional Development
Contact Information Need additional scoring forms or labels? Ryan Cartwright, HMH Project Manager [email protected] 630.467.6103 Questions about Iowa Assessments or the CogAT Test? Wendy Freyschlag, HMH Assessments Consultant [email protected] 303.517.3579 Questions for Association of Christian Schools International? Lisa Chubbic, ACSI Assessment Program Coordinator [email protected] 719.867.0139
Looking For More Information? For more information about Iowa Assessments and CogAT, go to www.purposefuldesign.com Select Assessment Support, then HMH Iowa Assessments • Materials Pricing Tool • Scoring Cost Estimation Tool • Quick Facts • Product Information Request Form • Talk to an Expert Request Form • Program Details For additional assistance, contact ACSI Member Care [email protected] 800-367-0798
Questions?
Wendy Freyschlag, Houghton Mifflin Harcourt, Assessment Consultant Denise Piatt, Houghton Mifflin Harcourt, Assessments Consultant
Agenda Outline Preparation for HMH Scoring Services HMH Scoring Services Folder Scoring Deadline and Test Coordinator Letter Post Testing Checklist from DAs Coding of Answer Documents Class ID Sheet Building ID Sheet Order Form for Scoring Services Optional Printed Reports Packaging and UPS Directions
Scoring Services Folder • Sent to Test Coordinator at school • Sent after Online Enrollment completed
Folder not received and OE completed? Contact Ryan Cartwright [email protected]
630.467.6103
Scoring Deadline and Scoring Info Letter • Scoring Receipt Date: by May 31 • Letter specifies: – Scoring pricing – General coding info – Building & Class ID sheet completion – OSS completion • Order for Scoring Service – Shipping instructions
Directions for Administration
• Teachers used to administer the assessments, specific to level and assessment
• Three parts: 1. Info to prepare for testing 2. Instructions for test administration 3. Instructions for scoring preparation
Posttesting Checklist • Ask your teachers to reference Part 3 in their Directions for Administration to organize and scan their students’ answer documents • Follow steps for verifying that each student has an answer folder or test book that is ready for scoring services – Look over for damage • tears, creases, or water damage – If extensive, transfer student info and answers to a new document or book • Destroy all scratch paper
Posttesting Checklist, cont. • Scan for proper marking
•
– No. 2 pencil used – Dark response marks made in answer circles – Changed answers are completely erased Erase stray marks – marks on answer circles that aren’t answers – marks along the edges and top of page(s)
Student Barcode Labels
• If used, confirm that student barcode labels were applied correctly – Secure – Aligned in proper space on back of test book or on answer document
If Student Barcode Labels are Used • Embedded Fields (no bubbling) – Name – Gender
• New student, no label? - Must bubble in information
• Accurately write in or use label Teacher Name Grade School System – write “ACSI” City/State of School
Barcode Label
– Birth Date
No Barcode Label? Coding – Required Information • Accurately Write and Bubble – Student Name – Birth Date (Month, Day, Year) – Gender – Write in: • Teacher Name • Grade • School • System/District – write “ACSI” • City/State – for school’s location
Form Coding • Accurately Bubble – Iowa Assessment Form • Form “G” for Grades K-8 • Form “E” for Grades 9-12 – CogAT Level Bubbled Inside answer folder – Bubble “7”
Optional Coding - Programs This coding should be done after testing, by a teacher or administrator only. Programs (if qualified): – IEP = Special Needs (or 504 plan) – F/RL = Free or Reduced Lunch – ELL = English Lang. Learner – T1 L = Title 1 Reading/Language – T1 M = Title 1 Math
Optional Coding - Omit from Group Averages OFFICE USE ONLY: Z – Approval needed from the Test Coordinator
• This is where you will mark for any students who are going to be excluded from averages due to a pre-approved situation.
• Student tests will still be scored, but you may use the “Z” code to include or exclude from group reports in DM.
• Degree symbol (°) on reports
Optional Coding – Years in Current School • How many full years in current school – Test Administrator Use Only – Column A 0 = less than 1 full year 1 = 1 year 2 = 2 years 3 = 3 years 4 = 4 years 5 = 5 years 6 = 6 years 7 = 7 years, etc. up to 9
Optional Coding – Home Reporting Home Reporting:
• If student lives in a home where Spanish is the primary spoken language
• Profile Narrative reports can be generated in Spanish for those students who are coded with a ‘2’
Optional Coding – Ethnicity / Race Please note that Hispanic/Latino is considered an ethnicity, not a race.
• For Ethnicity – mark only 1 answer – Hispanic or Latino (A person who is Cuban, Mexican, Puerto Rican, Spanish, South or Central American or other Spanish culture or origin, regardless of race.) – Not Hispanic or Latino
.
Optional Coding – Ethnicity / Race
Class Identification Sheet - Blue • Information box
• • • • •
– April 15, 2018 for Test Date – School name for Building name – ACSI for System Name – City where your school resides Teacher’s name under Class Name Leave Class Code blank Grade should reflect same grade as the students’ answer document Indicate correct Form of the Iowa • Form “G” for Grades K-8 • Form “E” for Grades 9-12 Answer Document Count for the grade
Stacking Test Books • For each classroom, stack completed
• • •
•
test books so that the name grids on the back covers are facing up NO need to alphabetize Keep Iowa and CogAT separate To prevent test book spines from bending, stack as follows: – Stack books in groups of 5 – Alternate the direction the spines face for each stack of 5 books, keeping name grid facing up Place one Grade/Class ID sheet of top of stack
Stacking Answer Documents • For each classroom, stack completed • • •
•
answer documents NO need to alphabetize Place one Grade/Class ID sheet of top of stack Preferable to place one classes’ answer documents and Grade ID Sheet in an envelope Use a separate envelope for each class
Building Identification Sheet - Purple • Use only one • Included in HMH Scoring Folder • Place on top of box #1. • Premarked for your convenience • Your school code number •
appears on this sheet Please write this number in your files (needed for box labels)
Order Form for HMH Scoring Services • Dataset ID Number is
• • • •
upper right corner, assigned to your school and used to track your documents Critical that you use this OSS form – HMH Folder Fill in document counts Place on top of box #1 with the purple Building ID Sheet Replacement needed? Call Ryan Cartwright 630.467.6103
HMH Scoring Services Pricing Per Student • Pricing in your letter in the HMH Scoring Folder • ACSI Schools receive student data online via DataManager for dynamic web-based reporting • Next week, HMH will host a webinar on DataManager reports creation • In early-May, HMH will host webinars to provide insight into score interpretation • Register at www.purposefuldesign.com under Assessment Support / Professional Development
Reverse Side of OSS • Order optional printed reports – Some not available in DataManager • Self-Stick Student Folder Score Labels • Iowa Class Diagnostic Report • Iowa Class Response Record • Iowa/CogAT Combined List of Student Scores
• Report samples are available at www.purposefuldesign.com under Assessment Support/HMH Iowa Assessment or CogAT
Optional Reports – Not Avail. in DM
25
Optional Reports – Not Avail. in DM
26
Optional Reports – Not Avail. in DM
27
Optional Reports – Not Avail. in DM
28
Optional Reports – Not Avail. in DM
29
Optional Reports – Avail. in May 2018
30
Optional Reports – Not Avail. in DM
31
Optional Reports – Avail. in DataManager
32
Optional Reports – Avail. in DataManager
Sample Reported Scores
Sample Reported Scores
Domains/Cognitive Levels
Sample Reported Scores
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Sample DataManager Reports
Shipping Answer Documents • Stack all answer docs/test books for each • • • • • •
teacher by grade (no need to alphabetize) Keep all docs for class in same box, if not able then continue in next consecutive box Place one Grade/Class ID Sheet (blue) on top of each group Place each teachers’ answer documents in envelopes with Grade/Class ID Sheet on top Top of box #1 - pink OSS & purple Building ID Package in sturdy boxes – pack securely to avoid shifting during transit Label each box 1 of ____, 2 of ____, etc. _____ being total # boxes
UPS Return Service Label Instructions • Documents returned via UPS • 3 white UPS/RS Labels in packet
•
– Place 1 label on each box – Second portion is your Return Service receipt, w tracking info • Keep this receipt Also place 1 of the green “Special Processing” labels on the outside of each box – Fill in School name and code – Fill in Package ___ of ___ on each green label – Check if the OSS is in this box
UPS Pickup • Regular/Daily Pickup Service •
- Send boxes with regular driver No regular pick up? Follow steps: - Have preprinted label in hand - Call 1.800.742.5877 on or before May 22nd (for May 31st deadline) - Follow prompts: - Select voice option “Send a package” - Select voice option “Schedule a pickup” - When asked if want info on nearest location, indicate “No” - When asked if have tracking #, indicate “Yes” - Provide required info and # of boxes to be picked up - Select date, time, and location for pickup - Verify the details of your request - You will receive a pickup confirmation and a Pickup Request number (write this down)
Important Note about DataManager • If administering the Iowa and CogAT using test books and •
answer documents, there is no reason to access the Assessments portion of DataManager. Please do not access this area as it is only used for online testing. Making changes in this area could negatively impact every school in the ACSI testing program, not just your building.
DataManager Reporting Webinar Tuesday, April 17th from 11:00AM – 12:00 noon (MST)
www.purposefuldesign.com under Assessment Support / Professional Development
Contact Information Need additional scoring forms or labels? Ryan Cartwright, HMH Project Manager [email protected] 630.467.6103 Questions about Iowa Assessments or the CogAT Test? Wendy Freyschlag, HMH Assessments Consultant [email protected] 303.517.3579 Questions for Association of Christian Schools International? Lisa Chubbic, ACSI Assessment Program Coordinator [email protected] 719.867.0139
Looking For More Information? For more information about Iowa Assessments and CogAT, go to www.purposefuldesign.com Select Assessment Support, then HMH Iowa Assessments • Materials Pricing Tool • Scoring Cost Estimation Tool • Quick Facts • Product Information Request Form • Talk to an Expert Request Form • Program Details For additional assistance, contact ACSI Member Care [email protected] 800-367-0798
Questions?
