Home

TOMS Reporting Suite User Manual and Interpretive Guide

1. The online reporting suite presents school level data on the aggregated performance of students as assessments are completed and scored Please note the aggregate data at the school level is generated as students tests are submitted and scored School level data should not be considered final until the state data press release Q School Performance Report Clicking on the Performance navigation button generates the School level Performance Report Below the dashboard information the School level Performance Report lists student level data for all students in the selected grade level and content area Figure 18 displays this report with each student s scale score performance level categorization and claim score information Clicking on the student s name or the graphical representation of the student s scale score will direct users to individual student s score results See Section VI for additional information on interpreting student level results TOMS Reporting Suite User Manual 2 May 2015 WISCONSIN _ es INSTRUCTION O gt CA amp L Figure 18 School Performance Reports i Performance Reports Back to TOMS D gt Online Results gt State Report gt District Report gt School Report Preliminary Badger Exam 2015 MyTestSchool Report MyTestSchool Grade 6 ELA Fite v Avg Scale Score Performance Completed 2456 29 1631 Advanced Proficient Enter Student s Name or ID School s Student coma n
2. inthe status column indicates that the school is in the process of testing 2 Avg Scale Score This is the overall school average scale score for the specified grade level and content area Every score is the best estimate of a student s true ability on an assessment The number in the parentheses next to the scale score accounts for the score range For example if the average scale score is 2455 2 4 we can say that we are 95 confident that the school s true average score is in the 2453 to 2457 range 2455 2 4 2452 6 rounded to 2453 and 2455 2 4 2457 4 rounded to 2457 The scale score average for each school will continue to update until 100 of all students in a school have submitted their tests and all scoring is completed 3 Students Complete This is the number of students in the school for whom a Badger Exam has been submitted and scored 4 Performance Level This is a graphical representation of each school s overall performance The shaded areas represent the four areas of performance below basic red basic yellow proficient green and advanced blue The black dot represents the average scale score for the school The extended lines from the black dot represent the score range associated with the scale score TOMS Reporting Suite User Manual 25 May 2015 WISCONSIN Eg mete ey PUBLIC o CARL INSTRUCTION Using the District level Scale Score Report to Improve Learning This report pro
3. 2 3 5 Student Score Performance Level Claim 4 Claim 2 Claim 3 Claim 4 Aaliyah Aiden Edison 259 D A aA Co 2 Aaliyah Micah Jonathan 2155 o P A A 3 Aaliyah Sanford Rexx tt H 5 A A A semen 2 SENN o a o 1 Score This is the scale score that the student received for the specified content area 2 Performance Level This is a graphical representation of a student s performance The shaded areas represent the four areas of performance below basic red basic yellow proficient green and advanced blue The black dot represents the scale score for the student The extended lines from the black dot represent the score range associated with the score This range indicates the range of scores that the student would be likely to achieve even if he or she took the test multiple times 3 Claim Performance The icons represent the student s performance on each of the claims within the content area A D indicates that the student s performance exceeds the standard A gt indicates that the student s performance meets the standard A A does not meet the standard indicates that the student s performance Using the School level Performance Report to Improve Learning This report provides information about the scale score performance and topic performance for all individual students in the select grade level and content area This report can be used to sort by student name This allows users to quic
4. e Safari 3 0 and above e iPad Safari all Q System functionality and screen displays may operate or appear differently due to different browser and operating system capabilities The TOMS website is optimally viewed using a screen resolution of 1280 x 1024 TOMS Troubleshooting If you need assistance using TOMS please contact the Badger Exam customer service team by phone at 1 844 711 6493 or by e mail at badgerexamhelpdesk ets org TOMS Reporting Suite User Manual T May 2015 eeranrnant er Powered by ETS ustening tearing Leading PUBLIC amp O GR NS RCTIA P gt CA amp L Section Il Badger Exam Score Interpretation The Badger Exam yields criterion referenced scores to convey information about student performance in relation to the Wisconsin State Standards Criterion referenced information in Badger Exam reporting includes scale scores performance levels and topic performance indicators Badger Exam Scale Scores A student s overall performance on the ELA and mathematics portions of the Badger Exam is reported as a scale score A scale score is on a numeric scale with intervals of equal size The scale is applied to all students taking the Badger Exam in a particular subject at a particular grade level making it possible to compare scores from different groups of students or individuals Each content area is scaled separately therefore the scale scores for one content area cannot be compared to another cont
5. button displays the percentage of students that performed at or above proficiency for the selected district or school grade level and content area If selected filters will also be applied Selecting this button will generate district or school level performance reports which are described in Subsequent sections of this manual TOMS Reporting Suite User Manual 17 May 2015 DEPARTMENT OF Powered in s ETS sening taming Leading PUBLIC amp O CASI INSTRUCTION Figure 7 displays the navigation buttons used to switch between scale score and performance reports Figure 7 Dashboard Navigation Buttons Avg Scale Score 2454 27 1635 Performance 2454 27 1635 Advanced Proficient 4 Completed This button displays the number of tests that have been submitted and scored within the selected district or school grade level and content area If selected filters will also be applied 5 Search Functionality Type in the search box to quickly locate and navigate to a specific district school or student based on user role permissions As users type within the search box the system will begin to populate a list of available options To ensure proper use of the search option select the name of the district school or student from the populated list Simply hitting enter will result in an error 6 Return to TOMS Click on this button to exit the TOMS Reporting Suite and return to TOMS Students with disabilitie
6. in the English Language Arts and Mathernatcs tests Indnidual test questions are aligned to these topics See www SmarterBakanced org for a more detailed description of the individual topics and sample questions Your Performance The number of stars shown provides an indicator of your chiki s performance on the various topics within a coment area These provide insight into your child s strengths and weaknesses demonstrated during the Badger Exam State Percentile A percemtic table wil be made available in the Badger Exam webpage afer all the students in the state complete testing The State Percentile is a ranking of an individual student s resus relative to the results of other test takers im the Slate For example a shident who scored af the B2nd percentile had a score that was equal to or better than amp 2 of the scores of al students in Viisconmsin who took the same test A lower percentile might stil indicate proficiency if the majority of students in that grade level are proficient Accommodations and designated supports if a testing accommodation or designated support was off a Studer it is noted on the front side of this report These accessibility features support students in demonstrating ley know and are able to do wihout altering what the test s miended to measure For additonal information on accessibility features offered for the Badger Exam see hite oea dpi wi gov assessment Smarter accommodations For Mor
7. per topic which derived from the same scale as the overall content area scale score The standard error of measurement SEM for this individual score is used to derive the three performance categories As a result the width of Meets Standard for each Topic will be based on the same amount of standard error of measurement SEM The widths for the Meets Standard TOMS Reporting Suite User Manual 43 May 2015 WISCONSIN DEPARTMENT OF pe anpas INSTRUCTION O gt CA amp L across different claims will vary as the SEMs of the claims vary Figure 1 is a graphical representation of claim performance determinations e Any claim score lower than the bottom end of the error band around the Basic Proficient cut score will be considered Does Not Meet Standard claim score e Any claim score above the upper end of the error band around the Basic Proficient cut score will be considered an Exceeds Standard claim score Figure 1 Claim Category Determination Overall Scale Score and Performance Levels Claim X Does Not Meet Meets Standard Staridard Exceeds Standard Does Not Meet Meets Standard Standard Exceeds Standard TOMS Reporting Suite User Manual 44 May 2015
8. 2 lists abbreviations and icons you may see in this manual and in the TOMS system Table 1 Acronyms in TOMS Reporting Suite User Manual DAC DPI Department of Public Instruction _ _ DTC IPR____ Individual Profile Reports o Table 2 Icons Used in TOMS Reporting Suite User Manual Icon Description Notes This symbol appears next to text that indicates important information related to a task or TOMS feature O Step number These circled numbers appear on screenshots of the TOMS Reporting Suite website and correspond to descriptions or step by step instructions in the manual TEXT Bold text indicates the name of a link or clickable button in the TOMS Reporting Suite TOMS Reporting Suite User Manual 4 May 2015 SerAnrment oF a Te ETS Listening Learning Leading PI JBI IC O 3 INSTRUCTION gt CA amp L Section I The Badger Exam and TOMS Reporting Suite About the Badger Exam 3 8 A Smarter Balanced Assessment The Badger Exam is Wisconsin s customized version of the Smarter Balanced Assessment The Badger Exam is a large scale criterion referenced standardized achievement test Standardized tests are administered using carefully defined directions materials and scoring procedures for all test takers to ensure uniform testing conditions As a criterion referenced assessment the Badger Exam is designed to compare a student s strengths and needs to clearly defined standards skill levels or areas of know
9. 6 Accessing The TOMS Reporting Suite ecccsccsutascrecnsecntnudanstinntsdinodesiens cuaieedinssacsctscaneliundnabaweceauceadtiieracedsateuedexetieeanets T TOMO SCN Sc rca cea ee sre E E S T TOMS ROU DC ST CONG sarees e EAE AEE A AEA REEE rRe T Section Il Badger Exam Score Interpretation nnnnnnnnsnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 8 Badger Exam Performance Levels and Performance Rangess ccccsscccsssececeeseeceeseeeeaueeesaseeeseaeeessueeeeeaeeeesaeeeess 8 Bad or NS ea E E E aap este acoceneivedenecebees 10 Norm Referenced Score Interpretation ccccccccssssccesccecccseescnesusenceucueusuueaueueueceueuseuusauuseueassaessauesaeeeneussuausas 11 Section lll Accessing Online Reports and Using the TOMS Reporting Suite Dashboard 12 Role Permissions in the Reporting Suite cccccccssssescseeeecenececeneesscaneesensesecanececansesscansecensesecanesecnnesseneessens 12 To access Reports in the TOMS Reporting Suite ssesssnsesseunnnaossnnsenseunnnassnannnnesunnnanssnnnnnssnnennnnennnnnennannnnneannnn 13 STV MeD NO AU ee E E E E E 15 QUST YEN CON aiaa aE E EE E 19 Section IV District Aggregate ReporftS s nsnununununururnrnrnrnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnne 21 District level Performance Report ccccccscsseccecccecuccsscueseneuencneecusecuseneueueusucseueuenscenusecusaueseusessauseaussaueeneusseaseas 22 Using the District level Performance Report to Improve Learning ss snss
10. ENT OF PUBLIC INSTRUCTION O gt CA amp L Section VIII Export of Reports District and School reports can be exported using two methods PDF or CSV file format The lower right hand corner of an online reports screen contains icons for each format PDFs are designed for small data sets recommendation is less than 100 results CSVs should be used for larger data sets Clicking on lt will create a PDF report that captures the information presented on the screen Clicking on will export the data displayed on the screen to a CSV file format Figure 29 displays how users can download a PDF or export a CSV file in the TOMS Reporting Suite Figure 27 PDF or CSV Export from a Reporting Suite Screen Aisley Middle Schoo Akerondo Middle Schoo Allido Middle School Amerlia Middle School Amora Middle School Anaton Middle School Aprilla East Middle School TOMS Reporting Suite User Manual a 4 8 O 8 Below Basic 500 659 5 592 698 4 597 5 Basic 560 42 308 of 308 486 of 486 24 of 520 841 of 841 483 of 483 128 of 128 102 of 102 Proficient 590 Advanced 620 650 May 2015 WISCONSIN TS ten PUBLIC Powered by pe es INSTRUCTION O gt CA amp Appendix A Claim Performance Determination Claims are major areas or standards included in English language arts and mathematics tests Individual test questions are aligned to these c
11. IPR For example if a student s test was invalidated the IPR will not have a score The IPR will indicate that the test was invalidated See section VII for additional information Students participating in the alternate assessment or no longer enrolled in a Wisconsin Public School will not have a Badger Exam IPR As with the user and student management and test delivery portions of TOMS the reporting features are role based allowing access to and creation of reports based on log in credentials and permissions Users with a district level role can access TOMS data for any school in their district Users assigned a school level role can use TOMS to access data for their school s Users can only see student level data for schools for which they are assigned Distribution of private reports within your school district must be in accordance with state and federal privacy laws and local school board policy Q TOMS Reporting Suite User Manual 6 May 2015 ETS umotana INSTRUCTION CA amp L Accessing the TOMS Reporting Suite Users can access TOMS through the following link https wdpibadger toms caltesting org For information on establishing a user account reference the TOMS User and Student Management Manual located at http oea dpi wi gov assessment Smarter resources TOMS Requirements TOMS supports the following Web browsers e Mozilla Firefox 2 0 and above e Internet Explorer 9 0 and above e Google Chrome 4 0 and above
12. WISCONSIN DEPARTMENT OF PUBLICA INSTRUCTION TOMS Reporting Suite User Manual and Interpretive Guide Badger Exam 3 8 A Smarter Balanced Assessment May 13 2015 WISCONSIN DEPARTHENT OF Ts tening Learn 9 PUBLIC i Powered b pe apenes INSTRUCTION O gt CA amp L TOMS Reporting User Manual and Interpretive Guide This publication is available from Office of Student Assessment Wisconsin Department of Public Instruction 125 South Webster Street P O Box 7841 Madison WI 53707 7841 http oea dpi wi gov assessment Smarter Prepared by Computerized Assessments and Learning LLC CA amp L The Wisconsin Department of Public Instruction does not discriminate on the basis of sex race color religion creed age national origin ancestry pregnancy marital status or parental status sexual orientation or disability TOMS Reporting Suite User Manual 2 May 2015 WISCONSIN DEPARTMENT oF N Tel f ETG ustening Learning teoding PUBLIC amp ONS ETS enero INSTRUCTION CA amp L Table of Contents ADOUT TAIS Wan UG cacuesubra gene E EEE E SE 4 Section The Badger Exam and TOMS Reporting Suite cc ccc cccee eens ee eeeeneeeeeeenneeseeennees 5 About the Badger Exam 3 8 A Smarter Balanced Assessment cccseccseseeceseecsseeceseecaseseeeeseaeesaaseseeeeeaseessas 5 About the Test Operations Management System TOMS Reporting Suite cccccscecseeseeseeeeseeeeseeeeseeeeseeeses
13. ability to apply the knowledge and skills for his or her grade level that are associated with college content readiness Below Basic Student demonstrates minimal understanding of and ability to apply the knowledge and skills for his or her grade level that are associated with college content readiness TOMS Reporting Suite User Manual 8 May 2015 WISCONSIN TS ten a PUBLIC Powered by a ens INSTRUCTION O gt CA amp L Tables 4 and 5 provide performance categories and the cut score ranges for each performance level for each content area Table 4 English Language Arts Performance Ranges and Scale Scores Below Basic i Proficient Advanced SLALA a mel om me High Low High From and Above rE 2415 2416 2472 24 3 2532 2533 L 2441 2442 2501 2502 2581 2582 2456 2457 2530 2531 2617 2618 2478 2479 2551 2552 2648 2649 so 2486 2487 2566 2567 2667 2668 Table 5 Mathematics Performance Ranges and Scale Scores Below Basic i Proficient Advanced orade Below and up to High High From and above so 2380 2381 2435 2436 2500 2501 2410 2411 2484 2485 2548 2549 o pe e e e a e e ee ee res mes aso 200 TOMS Reporting Suite User Manual 9 May 2015 Ts Listening Learning Leading Badger Exam Claims WISCONSIN DEPARTMENT OF PUBLIC nasaan INSTRUCTION D CA amp L In addition to an overall scale score and performance level description the Badger Exam also provides information on content specific c
14. ach subject area test and can help students parents and educators identify specific strengths and areas of need 3 Scale Score Performance Information The graphic on the left side of the report provides information about student achievement in terms of performance levels For each subject a scale score range and the cut scores for each performance level are shown along with a dot indicating the performance TOMS Reporting Suite User Manual 38 May 2015 WISCONSIN DEPARTHENT OF Powered by ETs tenting PUBLIC S ETS i INSTRUCTION 0 gt CA amp L level the student achieved in each content area 4 Claim Performance Information The graphic on the right side of the report provides information on the student s performance on specific claims within the content area The number of filled in stars represents whether the student performance met the standard The key for interpreting the star icons is located at the bottom of the report To aid in parent interpretation claims are referred to as Tested Topics on the IPR 5 Accessibly Information If accommodations or designated supports were enabled in TOMS for a student it will be noted at the bottom of the IPR using one of the following statements e This test was offered with accommodations e This test was offered with designated supports e This test was offered with accommodations and or designated supports Back of Individual Profile Reports Figure 27 displays the back
15. am 2015 Badger High Report Badger High Grade 6 ELA Filters w 2 Avg Scale Score 2454 Completed 1635 Performance 27 Advanced Proficient A 7 WV Enter Student s Name or ID School s Student Performance Levels 7 Student Score Performance Level Claim 1 Claim2 Claim3 Claim4 1 Aaliyah Skyler Rylee a 2 a 2 Aaron Jayce Edie ait 5 a S A 3 Abigail Abigail Makayla GTS o 1 System Dashboard Icon Click on the dashboard icon to return to the report selection page from any page in the reporting suite 2 Filters Select student demographic filters to view reports based on student group The list of filters and available selections are listed in table 9 TOMS Reporting Suite User Manual 15 May 2015 WISCONSIN DEPARTHENT OF iistening Leoning Leading PUBLIC rae ETS mee te ane INSTRUCTION CA amp L Table 9 Student Subgroups Demographic Available Selections ALL American Indian Asian Black Pacific Islander White Two or more races Hispanic Ethnicity ALL Students with a Disability Students without a Disability Disability Status Gender ALL ELL Status ELL English Proficient ALL Migrant Status Migrant Non Migrant ALL Economic Status Economically Disadvantaged Not Economically Disadvantaged Full Academic Year FAY School Full Academic Year FAY District After clicking on filters user will be p
16. areas represent the four areas of performance below basic red basic yellow proficient green and advanced blue The numbers in the shaded areas represent the percentage of students that performed at each level for the selected grade level and content area Using the District level Performance Report to Improve Learning This report allows users to compare the percentage of students who are performing at each performance level within a school Comparing the Proficient and Advanced levels in each school and filtering the data by full academic year provides one indicator of school and or district Success in a specific grade and prior grades up to the time of testing Similarly using the filters users can compare the percentage of students in a specific demographic group who are performing at the Proficient or Advanced levels in each school within the district If for any group the percentage of students tested is low users should not use the proficiency level percentages to reach conclusions about the performance of that group Note that no single test can tell us whether students have learned everything that is important for students to learn Additional local evidence should be reviewed for a more complete picture of student learning TOMS Reporting Suite User Manual 23 May 2015 ETS Listening Learning Leading District level Scale Score Report WISCONSIN DEPARTMENT OF PUBLIC INSTRUCTION O gt CA amp L Clicking on
17. ask 2457 2530 MEE Proficient 2531 2617 Advanced 2618 2724 i aa en 1 Status This column conveys if the school has completed testing meaning 100 of students tests have been submitted and scored A in the status column indicates that the school has completed testing A inthe status column indicates that the school is in the process of testing A in the status column indicates that the school has not begun testing 2 Avg Scale Score This is the overall school average scale score for the specified grade level and content area Every score is the best estimate of a student s true ability on an assessment The number in the parentheses next to the scale score accounts for the score range For example if the average scale score is 2455 2 4 we can say that we are 95 confident that the school s true average score is in the 2453 to 2457 range 2455 2 4 2452 6 rounded to 2453 and 2455 2 4 2457 4 rounded to 2457 The scale score average will continue to update until 100 of students in school have completed testing and all scoring is completed TOMS Reporting Suite User Manual 22 May 2015 D B SKi ETS ienne Leeming tasane INSTRUCTION CA amp L 3 Students Complete This is the number of students in the school for whom a Badger Exam has been submitted and scored 4 Performance level This is a graphical representation of each school s overall performance The shaded
18. cking on the bar within the distribution you will be taken to a report that focuses on the selected range Each bar in the histogram represents the scale score for one or more students within the school Figure 20 displays a detailed view of the School level Scale Score Report Figure 20 Deeper Detail of a School level Scale Score Report i Performance Reports Back to TOMS Online Results gt State Report gt ODistrictReport gt School Report Preliminary Badger Exam 2015 MyTestSchool Report MyTestSchool Grades ELA Filem v Avg Scale Score Performance Completed 2456 29 1631 Advanced Proficient nn Student Scale Scores hm hm hm N wi wi wi wi ul ui oO o h i i i AJ AJ AJ AJ bo in wn wn wn wn wi wi wi uw wi So AJ pzs o Score range E of Students in hm wi wi PJ gt Sz Sz t L t hm hm wi wi wn vi 9 D 7 LO nw h W wi yw wi J J J i i B Below Sasic 2210 2456 B Sasic 2457 2530 B Proficient 2531 2617 D Advanced 2613 2724 BOS D 99 ogsz 95 p9Sz g96z g9sz Scale Score Ranges Enter Student s Name or ID ye By clicking on the bar within the distribution you will be taken to a report that focuses on the selected range The subset of students displayed in the distribution are listed with the student s completion status scale score a graphical representation of the scale score a
19. clicks on this icon report specific text will display on screen Figure 9 displays the pop up window when users select the question mark icon Figure 9 Question icon This report provides summary statistics of performance levels for the content area atthe school level This report can be usedto evaluate student level information including the student s scale score proficiency and claim level cate gorization tatu 9 TOMS Reporting Suite User Manual 19 May 2015 WISCONSIN ETS vs PUBLIC ae a INSTRUCTION O gt CA amp L Breadcrumbs Figure 10 displays that breadcrumbs are located at the top of each screen and help the user understand their current location in the TOMS Reporting Suite and navigate between levels of the organization Figure 10 Breadcrumbs i Performance Reports Back to TOMS 7 OnlineResults gt StateReport gt ODistrictReport gt School Report eee Preliminary Badger Exam 2015 MyTestingSchool Report My TestinnSchool Gracie fi FIA Filters O Performance Level Icons To navigate back up a level use the breadcrumbs at the top of the page do not use the back button Figure 11 displays the legend located at the bottom of each school and district report Each performance level is represented by a color below basic corresponds to red basic corresponds to yellow proficient corresponds to green and advanced corresponds to blue The numbers in the parenthetical are designated scale s
20. core ranges for the content area and grade level of the selected report Figure 11 Performance Level Legend B Below Basic 2219 2454 B Basic 2455 2527 B Proficient 2528 2578 Advanced 2579 2700 TOMS Reporting Suite User Manual 20 May 2015 ETS Listening Learning Leading PUBLIC O CARL INSTRUCTION Section IV District Aggregate Reports There are two district level aggregate reports available for permissioned users the District level Scale Score Report and the District level Performance Reports Permissioned users may access both of these reports using the navigation buttons on the TOMS Reporting Suite Dashboard Figure 12 displays the dashboard at the district level that displays the following information for the selected grade level and content area the overall district average scale score percentage of students at or above proficiency within the district and the number of submitted and scored tests Figure 12 Dashboard Navigation Buttons District At Least 90 Complete Avg Scale Score 2454 27 1635 The online reporting suite presents data on the aggregated performance of students as assessments are completed and scored Please note the aggregate data at the district level is Suppressed until the district reaches 90 of students tests submitted and scored within grade and content District level data should not be considered final until the state data press release D Figure 13 displays the das
21. d short answer Approximately 94 to 98 of ELA test questions are machine scored Professional staff experienced in providing reliable and accurate hand scoring services scores the remainder Constructed response items allow partial credit for partially answered questions TOMS Reporting Suite User Manual 5 May 2015 ETS ienne Leeming tasane INSTRUCTION CA amp L Mathematics The mathematics portion of the Badger Exam uses a variety of real world topics and scenarios to assess students in the following areas ability to explain and apply concepts and procedures problem solving ability to use models and data analysis to solve real world problems and ability to construct and critique mathematical reasoning The Mathematics test draws approximately 25 to 50 of total score points from selected response SR items SR items have three to six machine scored answer choices for multiple choice and multiple selection The remainder of the test is drawn from technology enhanced items and short answer Approximately 89 to 97 of test questions are machine scored Professional staff experienced in providing reliable and accurate hand scoring services scores the remainder Constructed response items allow partial credit for partially answered questions When used in conjunction with multiple measures of achievement such as classroom observations and teacher developed tests the Badger Exam provides information about the progress of groups of students a
22. e Information Badger Exam General information Wisconsin State Standards itp ela dpi wi Goviengisn NqQuage arls stancarc http imath dpi wi gov imathematics standards page TOMS Reporting Suite User Manual 39 May 2015 WISCONSIN SLFARTMENT OF r INSTRUCTION O gt CA amp L The back page of the IPR provides additional interpretative information about the Badger Exam including the following 1 Overview This section provides a general overview of the Badger Exam 2 Badger Exam Performance Levels This section provides definitions of the Badger Exam performance levels 3 Term Definitions This section provides definitions for scale score and topic information 4 Accessibly Information This section provides an explanation in the event that accommodations or designated supports were indicated on the bottom of the front page of the IPR 5 Contact Information This section provides web links for additional information on the Badger Exam and the Wisconsin State Standards in ELA and mathematics Exceptions In the event that a student does not complete an assessment the IPR will indicate one of the following in place of an overall score invalid not tested or no score available Figure 28 displays a sample IPR without a valid score Figure 28 IPR with No Valid Score ENGLISH LANGUAGE ARTS TESTED YOUR Your Score TOPICS PERFORMANCE No Score Available Reading Writing Sas Listening Below Basic Basic Proficien
23. e SEARCH button If you find that your search results are limited remove some criteria and search again Depending on your permissions you may use the action icons below to view or edit the student record transfer the student or delete the student record View amp Edit If you wish to download the results of your search you must first select a school You may also select additional filters as desired Click the SEARCH button to view your search results Then click the DOWNLOAD SEARCH RESULTS button to export your results Add Upload Demographics Upload Accessibility Search for Students Online Testing First Name Last Name State Student ID Reports Grade Organization Select Grade Select Organization 9 x Student enrolled in School FAY Student enrolled in District FAY Student enrolled in State FAY O ee TOMS Reporting Suite User Manual 39 May 2015 WISCONSIN DEPARTMENT OF ETS ue PUBLIC powered t _ yes INSTRUCTION O gt CA amp L 4 Click on the Scores tab This tab is only visible for students with scores and for users who have permission to view it Once a student s tests have been scored the scale score and performance level will display 5 When the IPR is available a PDF icon will display on the Scores tab Click on PDF link to download the student s IPR Figure 24 displays the Scores tab in TOMS Figure 24 Scores in TOMS Student Information Accessibility Resources Scores Scores for comple
24. ent area Similarly scale scores in ELA and mathematics on the Badger Exam cannot be compared to scale scores from the previously administered Wisconsin Knowledge and Concepts Exam Badger Exam Performance Levels and Performance Ranges Student performance on the Badger Exam is reported in terms of four performance levels Advanced Proficient Basic and Below Basic In November 2014 the Smarter Balanced Assessment Consortium reviewed the recommendations from thousands of k 12 educators higher education faculty parents and other interested parties and unanimously endorsed the proposed performance standards in English language arts and mathematics For additional information about this process reference www smarterbalanced org achievementlevels Performance categories and their corresponding scale score ranges reflect student mastery of the Common Core State Standards CCSS Table 3 provides general performance level descriptions of the Badger Exam Table 3 Performance Level Descriptions Performance Level Advanced Student demonstrates thorough understanding of and ability to apply the knowledge and skills for his or her grade level that are associated with college content readiness Proficient Student demonstrates adequate understanding of and ability to apply the knowledge and skills for his or her grade level that are associated with college content readiness Description Basic Student demonstrates partial understanding of and
25. esigned for parents guardians The student reports in the TOMS Reporting Suite are available by subject and display individual student s scale score and topic performance Student level reports display the following components as outlined in figure 22 Figure 22 Student level Score Reports i Performance Reports Back to TOMS i gt OnlineResults gt State Report gt DistrictReport gt School Report gt Student Report Preliminary ELA Assessment Levi Matthew Jonathan s Report 4780 0012345678 Report for Levi Matthew Jonathan 4780 0012345678 4 Below Basic 2210 Basic 2457 P 31 Advanced 2618 2724 Student Score State Score Avg 2455 Score Range m i District Score Avg 2456 Score Average School Score Avg 2456 Proficient Student demonstrates adequate understanding of and ability to apply the knowledge and skills for this grade level that sre associsted with college content readiness Student Claim Performance Claim 1 Claim 2 Claim 3 Claim 4 Reading Writing Listening Researchvingulry Exceeds Standard Exceeds Standard Does not meet standard Does not meet standard Demonstrating Demonstrates composition Demonstrating effective investigating analyzing and understanding of literary and convention skilts communication skills presenting information and non fiction texts WME Selow Saske 2210 2456 Basic 2457 2530 J Proficient 2531 2617 NN Advances 2613 2724 i T 1 Scale score This is the sca
26. ess Reports in the TOMS Reporting Suite 1 Click on the Reports tab in the left navigation menu of TOMS 2 Then click on the Online Results tab and click on View Online Reports Figure 2 displays the screen users will see in TOMS to access the TOMS Reporting Suite Figure 2 Online Report Tab ETS TOMS Badger Exam 3 8 Dashboard Profle Hep J Logout Organizations i Online Reports Users Students Click on the link below to view the Online reports View Onli orts Online Testing Reports Report Types Online Reports 3 The TOMS Reporting Suite will launch and you will be presented with the Report Selection Page If you have multiple user roles assigned to you you will need to select the Organization you want to view and click on its name in the pull down menu For traditional single role users the organization drop down menu will not appear on screen 4 Select the Subject you want to view and click on its name in the pull down menu 5 Select the Grade you want to view and click on its name in the pull down menu Figure 3 displays the screen users will see to select as specific report in TOMS Reporting Suite Figure 3 Report Selection il Performance Reports gt Online Results Find Reports Organization Viewing Select an Organization TOMS Reporting Suite User Manual 13 May 2015 WISCONSIN DEPARTMENT OF ET E ER PUBLIC O CARI INSTRUCTION Figure 4 displays the information that
27. est State percentile scores will be available about two months after the testing window has closed at the following link at http oea dpi wi gov assessment Smarter TOMS Reporting Suite User Manual 11 May 2015 WISCONSIN DEPARTMENT OF P Avera by ETS anini PUBLIC amp O E INSTRUCTION CA amp L Section Ill Accessing Online Reports and Using the TOMS Reporting Suite Dashboard Role Permissions in the Reporting Suite User roles will determine the data to which users are directed All reports within the reporting suite have drill down capabilities For example a district user can view data for his or her district and specific schools within that district By then selecting a school the user will see the student scores within that school Table 8 contains a matrix of permissions for each user Table 8 Role Permissions for Organizations School level Reports in District level Reports in TOMS Reporting Suite Individual Profile User Role and Access TOMS Reporting Suite Reports and Student school and student Scores in TOMS district school and level data student level data District Assessment Coordinator DAC District Technology Coordinator DTC District Report Users DRU School Assessment Coordinator SAC School Technology Coordinator STC School Report User SRU TOMS Reporting Suite User Manual 12 May 2015 ETS ses PUBLIC Qi AN ETS ene ene stn INSTRUCTION O gt CA amp L To acc
28. f aach Gxaminaion ENGLISH LANGUAGE ARTS TESTED YOUR Your Score TOPICS PERFORMANCE Advanced 2684 Reaang Writing x Listening x Below Basic Basic Proficient Advanced 2201 2441 2442 2501 2502 2561 2682 2707 Research inquiry MATHEMATICS TESTED YOUR Your Score TOPICS PERFORMANCE Advanced 3 2600 Concepts and Procedures Problem Solving and r a Modeling Data Analysis x n Below Basic Basic Proficiemt Advanced 2219 2454 2455 2527 2528 2578 2579 2700 Communicating Reasoning WW i Star Doss not meet standard WW We Stars Meets standard w WS Stars Exceeds standard A student s score fats wifun a band repvesenting He range of es 3 student might receive N He fest were eben move fhan ance For more nformaton about the sssessmenl see bitp cea dpi wi gowassessment Smarter The front page of the IPR provides the following information 1 Identifying Information The student s name birth date and grade are shown in the top left of the report The student s school and district are shown on the top left of the report If accessibly tools were provided during the testing it will be noted at the bottom of the report 2 Purpose This report presents information about student achievement on the Badger Exam 3 8 Performance levels and scale scores describe the student s performance on subject area tests A graphic representation indicates how the student performed on tested topics within e
29. hboard users will see until the district reaches 90 of students tests submitted and scored The average scale score and performance navigation buttons will display gray in color Figure 13 Dashboard Navigation Buttons District Not 90 Complete Performance wan Ae 3258 TOMS Reporting Suite User Manual 21 May 2015 ETS sanoisin INSTRUCTION CA amp L District level Performance Report Clicking on the Performance navigation button generates the District level Performance Report Below the dashboard information the District level Performance Report provides a listing of all schools within the district and each school s test completion status average scale score and the percentage of students performing within each performance level Figure 14 displays the District level Performance Report Figure 14 District Performance Reports i Performance Reports Back to TOMS gt OnlineResults gt StateReport gt District Report Preliminary Badger Exam 2015 WI District 1 Report WA Distict1 Grade6 ELA Filter w Avg Scale Score Performance Completed 0 2456 29 3314 Advanced Proficient District s School Performance Levels Enter School s Name Or Code Organization Status Avg Score ae Performance Level Jackson Public School 0 Accessibilty Testing School 82 o i a a MyTestSchoo oO 2456 22 4 1631 Showing 1 3 of 3 Totale may not equal 100 because of rounding MMM Seiow Sasic 2210 2456 B S
30. ike v Avg Scale Score Peformance 2456 29 1631 D gt Online Results gt StateReport gt ODistrictReport gt School Report Advanced Proficient N LaS LaS hm hm hm N tlw lw tlw yi Un vw wi NJ uw J NJ uw J wi OO wi n a uw J J oe LJ lu N an J W J w N w k ge E Jal d Ja Ea W gt Tal J Student Scale Scores a hh ha rh gt gt gt gt AJ vi ui O uw j r 5 Score of Students in Ot 0 D pzSz 0 LSS g O O hm g A Coz Scale Score Ranges Enter Student s Name or ID i MEME Below Sasic 2210 2456 B Sask 2457 2530 B Proficient 2531 2617 B Advanced 2613 2724 aa When interpreting the histogram note that the scale score ranges on the X axis are the same for all school scale score reports This means that the X axis is the same for all grade levels and both content areas Itis possible that the pre established ranges represent two performance levels For example in figure 18 the range from 2525 2549 is yellow to represent the basic performance level Since the cut score between basic and proficient is 2531 it is possible that a student in this bar performed at the proficient range To view this data users should click on the yellow bar representing the range of scale score averages from 2525 2574 TOMS Reporting Suite User Manual 29 May 2015 WISCONSIN DEPARTMENT OF POWwWEreci by GO PUBLIC b gt CARL By cli
31. is 2531 it is possible that a at the proficient range To view this data users should click on the yellow bar representing the range of scale score averages from 2510 to 2534 Clicking on a specific bar of the histogram generates a report displaying a distribution of schools restricted to that range Below this graphic you will see a listing of the represented organizations as well as an icon indicating the test completion status th performance level information Figure 1 e average scale scores number of students completed and 6 displays the District level Scale Score Report in greater detail to include a distribution of schools for a specific scale score range TOMS Reporting Suite User Manual 24 May 2015 WISCONSIN TS isen PUBLIC ANC ETS ne ne enans uta O gt CA amp L Figure 16 Deeper Detail of a District level Scale Score Report Ml Performance Reports Back to TOMS gt Online Results State Report Preliminary Badger Exam 2015 Wisconsin Report Avg Scale Score 2455 29 8735 Organizations in Score Range 2510 2534 Organization Status 7 Avg Score Students Complete Performance Level 2510 1852 Mydistrict WDPIBadger District 1 WI District 1 2100 1 Status This column conveys if the school has completed testing meaning 100 of students tests have been submitted and scored A in the status column indicates that the school has completed testing A V
32. kly locate students and individual performance level information This report can also be used to identify commonalities or trends in student topic performance Both of these features can be used in TOMS Reporting Suite User Manual 28 May 2015 WISCONSIN DEPARTHENT OF ETS rg teaming ieoano PUBLIC mee _ anrs INSTRUCTION O gt CA amp L conjunction with other forms of educational data to develop instructional interventions or extensions Note that no single test can tell us whether students have learned everything that is important for students to learn Additional local evidence should be reviewed for a more complete picture of student learning School level Scale Score Report Clicking on the Avg Scale Score navigation button generates the School level Scale Score Report Below the dashboard information the School level Scale Score Report displays a graphical representation of the distribution of student scale scores for the selected grade level and content area Each bar in the histogram represents the scale score for one or more students within the school The colors of the bars within the histogram correspond to the following performance levels red below basic yellow basic green proficient blue advanced Figure 19 displays the School level Scale Score Report Figure 19 School level Scale Score Report l Performance Reports Back to TOMS Preliminary Badger Exam 2015 MyTestSchool Report MyTestSchool Grade 6 ELA F
33. laims Claims are major areas or standards included in English language arts and mathematics tests Individual test questions are aligned to these claims See Table 6 for complete list of claims within each content area The term claim is used throughout the TOMS Reporting Suite and is present on all reports intended for a school staff To assist in communicating achievement information to parents guardians the term tested topics is used in place of claims on the Individual Profile Report IPR See section VII for additional information on the IPR Table 6 contains a complete list of claims within each content area Table 6 Content Area Claims English Language Arts ELA Mathematics Reading Writing Listening Concepts and Procedures Problem Solving and Modeling and Data Analysis Research and Inquiry Communicating Reasoning A student s claim performance is described as one of the following exceeds standard meets standard and does not meet standard These performance indicators are represented using the icons listed in Table 7 Table 7 Claim Reporting Icon on Individual Profile Reports Claim Icon on Performance online Category reports Exceeds Standard Does Not Meet Standard TOMS Reporting Suite User Manual No Score Available Meets Two stars Standard Description The assessment results indicate that the student clearly understands and can successfully apply his or her knowledge to the s
34. laims Table 1 lists the claims for each content area Table 1 Claims English Language Arts ELA Mathematics Claims e Reading e Concepts and Procedures e Writing e Problem Solving and Modeling and e Listening Data Analysis e Research and Inquiry e Communicating Reasoning Each student s claim performance is described in one of three categories exceeds standard meets standard or does not meet standard Table 2 lists the claim performance icons and claim descriptions Table 2 Claim Performance Claim Icon on Icon on Individual Performance online Profile Reports Description Category reports Eocene Three stars The assessment results indicate that the student Canara clearly understands and can successfully apply his or her knowledge to the standards tested in this subject area for his or her grade Does not meet Standard One star The assessment results indicate that the student has limited understanding and difficulty applying his or her knowledge of the standard tested in this subject area for his or her grade Results cannot be reported due to a student providing only a limited number of responses Topic Calculation Details and Category Determinations No Score Available Meets Two stars The assessment results indicate that the student Standard shows understanding and can apply his or her knowledge to the standards tested in this subject area for his or her grade At each grade level there is a single score
35. le score that the student received for the specified content area 2 Scale score band This is a graphical representation of a student s performance The shaded areas represent the four areas of performance below basic red basic yellow proficient green and advanced blue The black dot represents the scale score for the student The extended lines from the black dot represent the score range This range indicates the range of scores that the student would be likely to achieve even if he or she took the test multiple times 3 Dotted Line The dotted line represents the average scale score for the selected grade level and content area at the school district and state level This allows users to compare the student s performance to the performance of grade level peers Hovering the cursor over the dotted line will TOMS Reporting Suite User Manual 33 May 2015 WISCONSIN DEPARTHENT OF _ aes INSTRUCTION O gt CA amp L display the state district or school average scale score Comparisons will not be available until at least 90 of the student assessments have been submitted and scored 4 Claim level information The icons represent the student s performance on each of the claims within the content area A O indicates that the student s performance exceeds the standard A indicates that the student s performance meets the standard A A indicates that the student s performance does not meet the sta
36. ledge The Badger Exam is aligned with the Wisconsin State Standards and as a criterion referenced test measures how students perform in relation to the Wisconsin State Standards The Badger Exam assesses English language arts ELA and mathematics for each grade level The mathematics assessment is comprised of three components Section 1 includes a variety of selected response constructed response and technology enhanced items a brief Classroom Activity CA and Section 2 a performance task PT The ELA assessment is comprised of one section which includes a variety of selected response constructed response and technology enhanced items Figure 1 illustrates the structure of the Badger Exam Figure 1 Badger Exam Badger Exam Badger Exam in Badger Exam in Mathematics English language t J arts ELA classroom Section 1 Section 1 ELA _ Mathematics English Language Arts ELA The ELA portion of the Badger Exam uses a variety of reading passages and resources to assess students in the following areas reading of both literary and informational text writing listening skills and researching topics to investigate integrate and present information The ELA test draws approximately 60 to 70 of total score points from selected response SR items SR items have four to six machine scored answer choices for multiple choice and multiple selection The remainder of the test is drawn from technology enhanced items an
37. nd claim performance information This is the same format as the student level information in the School level Scale Score report Reference Figure 17 and the corresponding interpretation guidance for additional information Figure 21 displays the School level Scale Score Report in greater detail to include a distribution of students in a specific scale score range TOMS Reporting Suite User Manual 30 May 2015 WISCONSIN DEPARTHENT OF Powered by on PUBLIC Es 9 INSTRUCTION O gt CA amp L Figure 21 Student Data on the School level Scale Score Report af Performance Reports gt Uniire Mewuks gt Stute lepot gt Oatrect Meport Schoo Mepoart Preliminary Badger Exam 2016 MyTect8ohool Report My Tesrec toc Ouds ELi Fhan 2456 29 1631 Avg Some Score Perormence Competec Students in Score Renge 2556 2556 Students Erter Students Name or ID Shan score Tertonmnanc Level Clem 1 Cumn2 Clas 3 Chern 4 omen i EEN o a o 2 Findey Wer Jecos am aa a 3 canne S M A A O0 s memene E I A 0O 86 i E sios basic 22410 A D Beie K57 2552 BN Profclers 02534 267 UNE Sdvences D618 273 7 s Clicking on the student s name or the graphical representation of the student s scale score will direct users to individual student s score results See Section VI for additional information on interpreting student level results Using the School level Scale Score Repor
38. ndard Please note the student score information will not be present until after scoring has been completed Additionally this report is a student level report is not intended to be as comprehensive as the Individual Profile Report IPR TOMS Reporting Suite User Manual 34 May 2015 WISCONSIN DEPARTHENT OF Powered by ji PUBLIC Es 9 INSTRUCTION O CA amp L Section VII Student Scores and Individual Profile Reports Student scores and Individual Profile Reports IPRs are available in TOMS under the student tab IPRs are not accessed through the TOMS Reporting Suite IPRs are downloadable and printable PDF score reports for each student that include ELA and mathematics scale scores performance level descriptors and claim level results When available IPRs should be downloaded printed and distributed to the student s parent s guardians Accessing Individual Student Scores and IPRs in TOMS 1 In TOMS click on the Student tab and click on the View Edit icon 2 Enter the search fields to locate an individual student 3 Click Search Then click on the edit icon pencil next to the student s name Figure 23 displays the Student Tab in TOMS Figure 23 Student Tab in TOMS ETS TOMS Badger Exam 3 8 Dashboard Profle Hep Logout Organizations 22 View amp Edit Students Users gt Students gt View amp Edit Students Students To view and edit students complete the search criteria below and click th
39. resented with the Change Criteria Selection panel 1 Select the criteria to filter on using the pull down menus 2 Press SAVE to generate the filtered report TOMS Reporting Suite User Manual 16 May 2015 WISCONSIN DEPARTHENT OF Powerest i ts Listening Learning Leading PUBLIC O C A amp I INSTRUCTION Figure 6 displays the Change Criteria Selection panel Figure 6 Change Criteria Selection Panel J Change Criteria Selection Change the results data for this report by selecting the student demographics SCHOOL Grade Subject Test Administration Badger High Grade 6 ELA Badger Exam 2015 Student Demographics Race Ethnicity Disability Status Gender ELL Status Migrant Status Economic Status School FAY District FAY CLEAR ALL 3 Navigation Buttons Users can switch between the scale score and performance reports by selecting the appropriate navigation buttons The button for the report that is onscreen will appear white in color while the report that can be moved to appears gray in color Clicking on the button for the report data that you want will change the on screen report Avg Scale Score The button displays the overall average scale score for the selected district or school grade level and content area If selected filters will also be applied Selecting this button will generate district or school level scale score reports which are described in subsequent sections of this manual Performance This
40. s well as the effectiveness of educational programs No single test can tell us whether students have learned everything that is important to learn About the Test Operations Management System TOMS Reporting Suite The Test Operations Management System TOMS is a secure website designed to manage the Badger Exam The TOMS Reporting Suite is an online reporting system within the TOMS system that provides permissioned users with interactive and cumulative online reports for mathematics and English language arts ELA at the state district school and student level Reports in the TOMS Reporting Suite are cumulative and updated nightly Reports in the TOMS Reporting Suite incorporate text and graphic presentation to assist in the understanding of the information presented The system is designed to allow users to generate customized reports using a range of data filters Race Ethnicity Disability Status Gender English Language Learner Status Migrant Status Economic Status and Full Academic Year Status Customized reports can be viewed onscreen or downloaded as CSV files or PDFs in TOMS When available Individual Profile Reports IPR can be downloaded as PDF files and printed for distribution to parents guardians Only students with valid test scores will appear in the district and school level reports If a student does not have a valid score or has a non tested code in TOMS a note will be included on the students Individual Profile Report
41. s who reside in one district but who attend a school in another district due to an IEP placement are reported with results for the district of accountability Students attending a school under Open Enrollment or Chapter 220 are included with results for the school and district of attendance TOMS Reporting Suite User Manual 18 May 2015 WISCONSIN DEPARTHENT OF Powered by 75 O gt EP mes INSTRUCTION CA amp L Other System Icons Each report also contains the features described below Information Icon The information icon is located at the bottom of all reports within the reporting suite When a user clicks this icon a pop up window appears outlining the report purpose common legend and onscreen icon descriptions o Figure 8 displays the pop up window when users select the information icon Figure 8 Report information icon Report Information This report displays a list of students their performance level scale score and performance on each claim Achievement Categories HMMM Below Basic J Basic GE Proficient I Advanced 2210 2456 2457 2530 2531 2617 2618 2724 Score Score Range m Icon Descriptions f Completed Exceeds Standard O In progress Meets standard Not started Does not meet standard No score available CLOSE Question Mark Icon To further assist users in interpreting the information presented within the reports there are tool tips throughout the reporting suite When the user
42. side of the IPR Figure 27 Student level Reports Exam provides helptul fee rough a wider variety of questions tasks and problems than traditional multiple choice tests Students can demonstrate ly thew knowledge of facts but also their analytical writing critical thenieng and problem solving skits The Badger Exam Orn to measure student leaning against the Wisconsin State Standards The Badger Badger Exam Performance Levels Ad adi Studem demonstrates thorough understanding of and ability to apply the knowledge and skills for this grade level that are associated with college conient readiness Proficient Student demonstrates adequate understanding of and ability to apply the knowledge and skills for this grade level that are associated with college coment readiness Basic Student demonstrates partial understanding of and ability to apply the knowledge and skills for this grade level that are associated with college content readiness Below Basic Student demonstrates minimal understanding of and ability to apply the knowledge and skills for this grade level that are assocated with college content readiness Individual Profile Report IPR information e Your Score These scores are on a scale used to compare your childs achievement within a subject area from year to year The lowest and highest scale score for each performance level is included under each level Tested Topics These highlight the major topics or standards included
43. snnsnnnsnnrnsnnrnnnnnrnnnnrnnnnnnnrnnnnnnnnnennnne 23 District level Scale Score Report watidecneiincvnawincaceanccasetassevavensccandeaosbeunvnisatoncnuusuamsiauadausandedsdued Seinessnaasiniauatecsivecaseeadute 24 Using the District level Scale Score Report to Improve LEAMMNING ccccscccccssceeceseeeceeeeeeseeeeeeeeesesseeesaeesssaes 26 Section V School Aggregate REPOrts cccccccceeceeeeceeeeeeeeeenneeeeeeeneeeeeeaneeeseeaneeeseeaaneesonanes 27 SCHOO Performance REPOlt cssecseccccesccescceeseuueeunescseucececucucuesaueseueuauaueeauesuueeneuucucucuasaueceueseueassaussaussaseuseeusaeusas 2 Using the School level Performance Report to Improve LEAMMNING cccccccsseeeeesseeeeeseecseseeeeeeeeeseeseeesaeeessees 28 School level Scale Score REPOMt c ccescsescceesccesccneccseececucucucsseueseueuacaueeuueeaueececucueusasaueueueuaueussaussaussaueuseausaeusas 29 Using the School level Scale Score Report to Improve Learning cccesseeceeeecseeeceeeecaeeceeseesaseeeaeeeseeeesaeeees 31 Section VI Student level REPOrts ccccccceccceceneeeceneeeceneeeeuneeeneneeeeuaueenunueseuueesuuueeseauessuags 33 Section VII Student Scores and Individual Profile REpoOrts ccccceceeeeeeeneeeeeneeseeneesuaes 35 To accessing multiple IPRS in TOMS svsisevinwossicasecencteadieetascilehsseidehsnwpeuvancesedescadsnestagncebsndicensenetawunwesieetmecennteaablacas 36 ROSCO RCOUCSTS mesinde ee ecaa eE a a ee ee ee ee O AAA 37 Fron
44. t Advanced 2201 2441 2442 2501 2502 2581 2582 2701 Research Inquiry Your child did not attempt enough items to generate a score TOMS Reporting Suite User Manual 40 May 2015 DEPARTHENT OF Powered by ETS Listening Learning Leading PUBLIC O CARI INSTRUCTION Table 10 contains a list of exception scenarios and the corresponding note printed on the IPR Table 10 Exemptions Score Scenario Reported As Printed Note on IPR Test Invalidated through appeal or as a Invalid Scores were invalidated or a score result of a test security incident was unable to be reported Student did not complete enough items No Score Your child did not attempt enough to generate a score Available items to generate a score Parent Opt Out non participation code Not Tested Your child was not tested per parent s entered in TOMS request Recently arrived ELL non participation Not Tested Your child was exempt from taking the code entered in TOMS English Language Arts exam Absent for entire 8 week testing window Not Tested Your child was absent for entire testing non participation code entered in TOMS window Significant medical emergency non Not Tested Your child was not able to take the test participation code entered in TOMS due to significant medical emergency TOMS Reporting Suite User Manual 41 May 2015 Ets Listening Learning Leading PDF or CSV Export from a Reporting Suite Screen WISCONSIN DEPARTM
45. t of Individ al Profile REDOING vis coscicivncincaviarnnadetasucsincennncundewabewiuncakeacauedeuasiatuadawjensededued aiaa aia aasian 38 Back of Individual Profile Reports ccccsccssccesccecuceeseeueneuencnesauseuusenceueuausaaseueueueueueusscusaueseueassuussaussaseeneusseeseas 39 PROCODER EE EEEE EEE AE EERE E 40 Section VIIEL Export f Reports wcsvcsecincseivatestacecstnwustcenes tea nesvenzvsndvesessaceesaes focaewiecesendeeiavers 42 PDF or CSV Export from a Reporting Suite SCKEON ccccccssscsescccesecceeuccssecesesecseuccsesecseususescueasecsensususeneassueens 42 Appendix A Claim Performance Determination ccccccccecceceeeeeceeeceeuneeeeuneeseuneueuanuesuauees 43 TOMS Reporting Suite User Manual 3 May 2015 WISCONSIN DEPARTMENT OF ETO iistening Leoning Leading PUBLIC NS ETS aro ete iman INSTRUCTION CA amp L About this Manual The TOMS Reporting Suite User Manual and Interpretive Guide provides instructions on how to use the Test Operations Management System TOMS Reporting Suite and how to understand explain and interpret the results of the Badger Exam 3 8 A Smarter Balanced Assessment Badger Exam You may notice differences in what is displayed on the TOMS website and what is shown in this manual Data displayed on website pages shown in this manual are for demonstration purposes only and may not reflect valid data Website pages may appear differently in Mac or Windows browsers Table 1 and
46. t to Improve Learning This report provides information about the distribution of scale scores within and across student groups By using the filters educators can compare the range of scale scores for student groups within a school or specific grade level Users can also use this report to quickly identify students performing in a specific range within a school or grade level Along with additional sources of information from classroom assessments this information may be used to identify students in need of additional instructional Supports or interventions This report also allows users to view the topic performance for students performing in a similar scale score range Users can then identify trends or commonalities in student s topic performance This information TOMS Reporting Suite User Manual 31 May 2015 WISCONSIN INSTRUCTION along with additional sources of information from classroom assessments may be used to tailor instructional supports for individuals or groups of students Note that no single test can tell us whether students have learned everything that is important for students to learn Additional local evidence should be reviewed for a more complete picture of student learning TOMS Reporting Suite User Manual 32 May 2015 WISCONSIN an i CARL Section VI Student level Reports Student level reports are separate from the Individual Profile Report IPR which are available in a PDF format in TOMS and have been d
47. tandards tested in this subject area for his or her grade The assessment results indicate that the student shows understanding and can apply his or her knowledge to the standards tested in this subject area for his or her grade The assessment results indicate that the student has limited understanding and difficulty applying his or her knowledge of the standard tested in this subject area for his or her grade Results cannot be reported due to a student providing only a limited number of responses 10 May 2015 ETS umotana INSTRUCTION CA amp L The statistical procedure used to determine students claim performance is based on student performance on Badger Exam test items measuring each claim and related performance on other Badger Exam test items See Appendix A for additional information on claim performance category determinations Norm Referenced Score Interpretation Norm referenced score interpretations provide information that compares the students achievement with that of a larger reference group all students tested in the state After the testing window has closed state percentiles will be provided for the Badger Exam The state percentile is a ranking of an individual student s results relative to the results of other test takers in the state For example a student who scored at the 82nd percentile had a score that was equal to or better than 82 of the scores of all students in Wisconsin who took the same t
48. ted tests are available as indicated below p Click to download IPR PDF Subject Status Status Date Scale Score Performance Level Actions Sent for ELA Reporting May 12 2015 2684 Advanced ad Sent for Math Reporting May 12 2015 2600 Advanced e Accessing Multiple IPRS IPRs can be downloaded for a grade level or all grade levels The download will generate a zip file with the individual PDFs for that school To accessing multiple IPRs in TOMS 1 In TOMS click on the Download IPR PDFs located under the Reports tab Select a school Select a grade Enter a name for the report i e Pleasant Valley Elementary Grade 5 IPRs a SS Click Download TOMS Reporting Suite User Manual 36 May 2015 WISCONSIN DEPARTHENT OF Listening Learnt r PUBLIC Pome ee INSTRUCTION O gt CA amp L Figure 25 displays the Download IPR PDFs tab in TOMS Figure 25 Download IPRs PDFs il Reports Test Forms gt Reports gt Download IPR PDFs Organizations i A Users IPR PDFs Students Test Admins Oniine Testing Reports miry Kep wis 1 Download IPR PDFs Scoring Rescore Requests Requests to rescore a content area can submitted by clicking on inthe Scores tab see Figure 24 Requests may only be submitted by DACs and must be requested within 14 days of the IPR posting Districts will endure a fee to have test rescored Once requested the student s test status in the Score tab will change to re score un
49. the Avg Scale Score navigation button generates the District level Scale Score Summary Report Below the dashboard information the District level Scale Score Report displays a graphical representation of the distribution of schools by average scale score Figure 14 Each bar in the histogram represents the average scale score for one or more schools within the district The colors of the bars within the histogram correspond to the following performance levels red below basic yellow basic green proficient blue advanced Figure 15 displays the Distr ict level Scale Score Report Figure 15 District level Scale Score Report Ml Performance Reports D gt OnineR suits gt Back to TOMS State Report Preliminary Badger Exam 2015 Wisconsin Report Aug Scale Score 2455 Orgs inScore rar d A S When interpreting the histog m m dim 29 8735 Organization Scale Scores i D A A 234 5 y 7 ram note that the scale score ranges on the X axis are the same for all district scale score reports This means that the X axis is the same for all grade levels and levels For example in figur school in this bar performed both content areas It is possible that the pre established ranges represent two performance e 14 the range from 2510 to 2534 is yellow to represent the basic performance level Since the cut score between basic and proficient
50. til the rescore process has been completed Sample IPR The sample 5th grade Individual Profile Report IPR indicates a 5th grade student s performance levels in ELA and mathematics The report provides general information about achievement in these content areas as well as specific information about the student s levels of performance This information along with other data sources i e student formative and interim assessments can provide a basis for planning an educational program to meet specific academic needs TOMS Reporting Suite User Manual 37 May 2015 WISCONSIN DEIPARTHENT OF Powered by ren r PUBLIC EF oe nt PUL By D gt CARL Front of Individual Profile Reports Figure 26 displays the front side of the IPR Figure 26 Front Side of IPR s Badger BADGER 3 8 EXAMINATION Individual Profile Report EVA AUSTINA Report Date Spring 2015 Studem ID 1005460000 School Name OT Elementary School Date of Brih 08 21 2004 School Code 5952200000 Grade 5 District Mame Liz OT Testing Schoo District 2 Test Date 04 76 2015 Cestrict Code 5952000000 Purpose This report presents information about your chid s achievement dger 3 6 Examinations in terms of four perlormance categories Bolow Basic Basic Proficient and Advanced A score is prov ow how close your chiki is to achieving fhe next performance category The Tested Topics charts provide more detaied information about you chikfs performance on specific parts o
51. vides information about the distribution of average scale scores within and across student groups By using the filters educators can compare the average scale scores for student groups between schools Wide score distributions or low scores provide evidence of wide achievement gaps and or low achievement If for any group the percentage of students tested is low users should not use the average scale score to reach conclusions about the performance of that group Note that no single test can tell us whether students have learned everything that is important for students to learn Additional local evidence should be reviewed for a more complete picture of student learning TOMS Reporting Suite User Manual 26 May 2015 D B SKi ETS ienne Leeming tasane INSTRUCTION CA amp L Section V School Aggregate Reports There are two school level aggregate reports available for permissioned users the School level Scale Score Report and the School level Performance Report Permissioned users may access both of these reports using the navigation buttons on the TOMS Reporting Suite Dashboard Figure 17 displays the dashboard at the school level that includes the following information for the selected grade level and content area overall school average scale score percentage of students at or above proficiency within the school and the number of submitted and scored tests Figure 17 Dashboard Navigation Buttons Avg Scale Score 2456 29 1631
52. will be presented once you have selected the organization subject and grade Select the administration you are interested in from the list If you select an organization subject and grade level for which a report is not yet available you will receive a message indicating the report is currently unavailable Figure 4 Report Selection List of Administrations Ml Performance Reports gt Online Results Select which reports to view by selecting what data you are looking for in the below form Find Reports Summative Organization Subject Grade Viewing Gutmann School District Mathematics z Grade 6 z Available Reports Test Name Subject Grade 1 WI Badger Spring 2015 Administration Mathematics grade_6 TOMS Reporting Suite User Manual 14 May 2015 WISCONSIN DEPARTMENT OF PUBLIC INSTRUCTION Using the Dashboard O gt CARL The top portion of each report is known as the report dashboard From this dashboard users can quickly identify their location in the reporting suite including aggregation level administration grade content area and any selected student filters Figure 5 displays the report dashboard screen that users can use to access various reports Each component identified by number is outlined in detail below Figure 5 Working in the Dashboard l Performance Reports 6 Back to TOMS 4 gt Online Results gt State Report District Report School Report Preliminary Badger Ex

TOMS Reporting Suite User Manual and Interpretive Guide

Contents

Download Pdf Manuals

Related Search

Related Contents