ASSIST - California State University, East Bay
Contents
1. oh THE CORRECT RESPONSE 15 MITI TOTAL 2 100 5 100 100 l 10 E FK AKKLEELEKLEELEEEEEETEEELEEKLEEEELELEELELEKLETLETEELELEEKTETTI Pe MMS E ETHSTIOH GROUP AHD PERCENTAGE URFFER 27 HIDDLE 46 LOWER 27 TOTAL THE CORRECT IS D there PRSPO 8 ss eee AIT BIF a 0 1004 0 8 Ei Dw 2 0 190 9 0 LL 3 20 AIT Bir 0 0 0 h mn 0 0 0 0 0 0 h 1 17 i 19 o a 190 5 83 a 100 0 0 0 h 0 0 nw COMET 6 OF TOTAL a 100 5 190 3 100 Lo 100 INDEX OF DEFFICULTY 16 INDEX OF MAXIMUM DIBCHIMIWATIONH Bo DISCRIMINATING EFFICIEBUY CORR 3 0097 STUDENT T TEST FOR POINT i CORRELATION 2 D165 MEAN SCORR RIOHTH 13 88 SCORE WRONGS 14 02 LLID 1397771771717 17171 1 OF DEFFICHLTY 16 DISCHRIEIMATIOH DIECRIMINATIDMN mn OTSCRIEIKATTEG EFFICIENCY POINT BIEERIAL CORR 0 1029 ETUNEFT T TEST FOR POINT BIBERIAL CORRELATION 0 2926 HEARN SCORE HIGHTE 13 77 SCORE WRONGU 15 08 16 ASSIST Automated Test Scoring Service Authorization for Pick Up of Test Results If you inten2. 09 90 000 3 TOTAL 15 4 0 52 53 15 ETEUDEHT D 202 920 000 TUTAL 0 100 0 51 58 Li ETUDENT E 00 00 03005 TOTAL 15 4 0 78 5 52 93 15 ETUDEHT F TOTAL 14 4 1 TA 20 2 14 609 000 0007 TOTAL 14 5 0 73 8 50 46 14 ETUDEHT 02 20 0010 TUTAL 15 a i 78 9 52 53 15 909 90 09 TOTAL 11 41 5 28 95 5 Sample Descriptive Item Analysis it tetera ETA UALIFORHIA ETATE UHIVEREITT HAYWAEHD HATE HEFTEEHEEX OH 1996 ITEM ANALYSIS FAGE NUMBER 1 1001 81 tis te ce A Peete p A TRUE E FALEE OMITTED HUMBER HO HG 7 7 1 90 06 0 6 00 1 15 00 0 0 00 0 2 00 8 80 a 6 08 6 06 1 19 00 10 00 0 5 00 0 2 00 3 80 06 1 10 00 1 10 00 mu Wl DH 0 8 00 0 9 09 QUESTION GRADED BY THE REQUEST OF 5 0 1 10 00 5 0 00 0 00 6 06 oO 2 00 0 1 00 8 90 002 1 10 00 0 00 0 00 1 10 00 1 1 00 0 0 00 10 100 00 8 20 0 60 0 00 1 10 00 0 00 1 10 00 0 00 0 60 0 0 00 HO 1 10 00 0 0 00 g 0 00 0 0 80 1 10 00 10 6 00 0 1 10 00 10 00 0 0 00 0 0 00 11 0 8 09 1 16 09 66 00 0 0 09 8 04 3 36 00 12 6 06 0 6 0 0 0 09 D 09 8 30 00 13 0 00 6 60 00 2 20 05 0 0 05 2 6 00 2 29 00 14 1 00 5 00 a 0 06
3. 8 02 35 0 15 1 10 00 E 650 00 0 20 a 5 00 0 00 1 13 00 16 7 70 00 i 10 00 0 0 00 a 0 00 a 0 86 20 00 17 0 0 00 20 BD a 0 60 0 00 2 20 00 n 9 00 0 20 30 00 60 009 0 0 60 2 20 00 1 12 00 0 3 00 10 00 50 00 2 0 00 a 20 00 20 4 40 00 4 49 00 0 2 09 0 0 00 0 0 00 2 20 00 INDICATES THE CORRECT RESPONSE 15 Sample Discriminative Item Analysis PRSP SCPE PPP ek RW THRO Ni FH UPEIVERSITY HAYWRRRD DATE SEPTHMBER DT a THE LOWER GROUT MARKING RIGHT AMHWHE GOOF AND PERCENT AOE TPFER 27 HIPOLE ift LOHE 27 TOTAL LEHMI BTATEH DIBCEIMIHATIYWE ITEM ABALYSIO FOR 3003 tt rr rrr 4 THE OF DIFFICULTY 10 THE PERCENTAGE UF THE TOTAL ORDUT WRONG AHHWER OR ITE THE INDEX OF IS THE DIFFERENCE BETEREN THE THE UPPER GERDLF MARKING THE RIGHT ANEWER AND THE PERCENTAGE OF 1 JORRA OPPER AND LOWER GROUPE EACH CONTAIN 27 OF THE TOTAL GROUP DD DD FY FT TT TT TT TWTTTTTTYTWTTTT YTT Y Titi iT 20 WeRRaRRRRURU HEROES fee estes eed 1 17 1 10 a a g pi 0 0 0 0 is DIEET G
4. A daa AA E e ee d a i 5 4 ad ALAMA AK gt HB PERSE FT Y TT ae LLU b HEETE a ra EE Bw za TEETE Mdr Elyn me a us Se Aj a we ey rre a ai ae Ro Be uH T agen ag ain Instruction For Coding Answer Key Sheet A blank answer sheet is used to make the answer key sheet use only a No 2 pencil The following information must be completed in the sections indicated Your gt Boxes 1 4 Write and bubble abbreviated department name Boxes 5 14 Write and bubble instructor name Social Security Write and bubble 999999999 Number ABC In boxes A and B write and bubble the two digit course section number e g 01 Number of Write and bubble the number of the last test item to be scored Guestions even if that does not represent the total number of items Leave blank items not to be scored ASSIST will not score items that have two or more correct answers Code No Write and bubble the four digit course number e g 3003 Complete the Instructor Course Section and Date blanks located in the upper right corner Optional features of ASSIST can be marked on the answer key sheet as follows Form For multiple versions of an examination
5. Sample Answer Sheet TENT 1 MOH T roe IH GRUG BET isse Be Bie Elm Dm El im Elm Ein Elm El Elyn Lm i ml E Min S232 FS FE SF Se Hom Elm Boe Bye Ela 80 Em El a ey ey Be Be Be Be i Be jm Be Ta Aa a pe hin 9 BOE Om lm Gih la Re oe is LEN HB 8 4 04 8 56 8 8 4 a i Dn s Op Oomi Ge UADD O UDD Daj me TEKI g hm i j ee mn don GL LLU ODD Llb ns u LLEDU IS 2 A i fp ED corga Pa a E ga aH a amdo dd dd i UL AU LU
6. STANDARD SOORE MEAN OF 50 STANDARD DEVIATION OF 10 MUMEER OF GUETTIOHZE NUMBER OMISSIONS KEY MUHDER OF KEYED 20 1 1 ETMBER OF EUH gm SHUARED 10 13 3073 A WARTAECE STANDARD DEVIATIOH 13 30 15 14 88 1 15 EDDER RELIABILITY STAHDAFD ERROR HEAJUREHEHT 0 78 1 20 ABD E E M ARE BASED THE MERGER RIGET EYED GOUERFTIOHH 11 Summary Statistics following summary statistics are provided in the section after the raw score distribution Student Score Roster An alphabetical roster providing the student s name social security number sex and class level number of right wrong and omitted answers percent score standard score and raw score adjusted for weighting and scoring formula if used See Page 14 for a sample of the Summary Satistics Score Roster Descriptive Analysis This item analysis option is only generated if the Item Analysis area of the key sheet is marked with a 1 or 2 For each item the number NO and percent of students responding to or omitting each answer alternative are given The correct alternative is marked with an asterisk Items left blank on the answer key sheet are marked Question not graded by the request of the instructor See Page 15 for a sample of the Descriptive Item Analysis Discriminative Item This item
7. you may assign a form letter designation of A J and mark it here Each version will need a separate answer key sheet Item Analysis Blank You will receive simple statistics that include a score distribution summary statistics and student score roster 1 You will receive a basic descriptive item analysis in addition to the above statistics 2 You will receive an extensive discriminative item analysis in addition to both of the above statistical options Formula Score Blank Student s score will egual the number of correct responses or 1 2 5 lt may sometimes be appropriate to subtract a fraction of the number wrong from the number right as a correction for guessing The correction factor depends the number of alternative choices for the test items and assumes that all items have the same number of alternatives This option is invoked for the total test score by bubbling the number of alternative choices per item Correction for guessing can be a complicated matter and is difficult to explain to students Users unfamiliar with this procedure are urged to consult Assessment amp Testing before using this option Weighting Part Scores Marking Answers It is possible to weight or assign more than one point to the test items Blank or1 Assigns 1 point to each item 2 Assigns 2 points to each item 3 Assigns 3 points to each item 4 Assigns 4 points to each item On side 2 of the key sheet you may organize
8. Bo Be SS oh Ma Be au aw a a 5 8 8 md my MU TN m Ge El a El Bie Bi Be yw 4 ia ae MI o GA IK EE KEE a ee EL KL Y ETES CEET EE a a TE E a m os vl sR 2 HA SEGA kl kal GU EDDU Y FT 5 LE EOE TE E 4 p md ion Oe Oa Lee GFE lt lt ddym drn ED Bej ey 4 EEE EEE oS 1 1 Be Ss el as a ajal t 1 T mi ur Test Score Analysis Student Responses ASSIST provides a listing of the answer key sheet and an Score Distribution alphabetical listing of each student s
9. analysis option is only generated if the Item Analysis area of the key sheet is marked with a 2 This option is useful for evaluating individual test items in greater detail than is possible with the descriptive item analysis Instructors who need an overview of the use of these statistics may contact Assessment amp Testing The discriminative item analysis consists of two categories of information for each item High Middle Low Group Comparison Students are separated into the following three groups Upper top 27 of the score distribution Middle middle 46 of the score distribution Low bottom 27 of the score distribution 12 Item Statistics Indices Index of Difficulty This is the percentage of the total group that has responded incorrectly to the item including omissions Index of Discrimination This is the difference between the percent of correct responses in the upper group and the percent of correct responses in the lower group Maximum Discrimination This is the sum of the percent in the upper and lower groups marking the item correctly If this sum is greater than 100 it is subtracted from 200 This index indicates the maximum ndex of Discrimination possible for the item given the obtained response distribution This maximum would be attained if the entire percentage of correct responses came from the upper group with none coming from the lower Discriminating Efficiency This is a ratio calculated by dividi
10. responses showing the response used to score each item This listing is important in insuring that items were scored correctly since the student markings on the answer sheet can be compared to the response record This listing begins with the answer key sheet the first line says Key Record followed by the department instructor and course number section The second line contains the correct answers coded 1 2 b 3 c 4 5 e for items 1 80 the third line lists correct answers for items 81 160 Items that are not to be scored are blank Following the answer key sheet listing is a record of each student s responses The first line contains the student s name and social security number The second and third lines contain the student s responses as interpreted by the scanner Items left blank by the student are blank on the listing a multiple response is indicated by an asterisk See Page 10 for a sample of the print out listing key and student responses This section presents a freguency distribution and summary statistics for the total test and for each subtest if part scores have been reguested Raw Score number correct adjusted by weighting scoring formula if used Freguency number of students obtaining that raw score Cumulative number of students obtaining that raw score or Freguency lower Percentile Rank percent correct corresponding to that raw score Standard Score a linear transformation of that raw score to
11. ASSIST Automated Test Scoring Service User s Manual Prepared by Assessment amp Testing Warren Hall 438 510 885 3661 510 885 4242 FAX Reprinted May 15 2002 TABLE OF CONTENTS AS II OVER CIE Y O Y O 3 Instructions For Completing The Answer 4 Sample Answer 00 4000 5 Instruction For Coding The Answer Key 6 Sample eu a aa 8 Test Score Analysi8 ded dedd dd rn 9 Student Responses uk ate renin ann aa 9 aasia 9 Sample Student Responses 24 10 Sample Score 11 Summary Statistics nce ctl 12 Student Score lt lt lt lt lt lt NET vk 12 GG kaua wg kli 12 Discriminative ltem Anal 12 Sample Summary Statistics 2 2 0000 14 Sample Descriptive Item 15 Sample Discriminative Item 16 Authorization for Pick Up of Test 1 17 ASSIST OVERVIEW ASSIST is a computerized syste
12. a distribution with a mean of 50 and a standard deviation of 10 This scale is useful if you wish to combine two or more tests that are unegual in difficulty Consult Assessment amp Testing for a fuller explanation before using this procedure See Page 11 for a sample of a score distribution print out Sample Student Responses PROGRAM NUMBER 108 BATCH ID 900 RUN NUMBER 1 OPTIONS 1 KEYRECORD ENGL JONES 8003 01 141 1234143324213441 STUDENT 000 00 0008 14111234142 24213341 STUDENTA 000 00 0001 1414123414 324213411 STUDENTB 000 00 0002 1414133414 STUDENT C 000 00 0003 14241234143334223442 STUDENT D 000 00 0004 14141234143324213441 STUDENTE 000 00 0005 131412331433241 13442 STUDENT F 14341 34243324213331 STUDENT G 000 00 0007 34121231143334213432 Sample Score Distribution Bi kb CALIFORNIA STATE THITERSITW HATWARD DATE 5EFIEMDER 09 1996 RAN SCORE DISTRSIRDTIDOHS FOR HUMBER 1 2093 01 J HEH FORM THUEDD UDDUDD 5 DISTRIBUTIOM FOR TOTAL BCORTEG FORMULA 1 ITEM WEIGHT 1 RAW CUMULATIUE PERCENTILE STANDARD SCORE FREQUENCY FREGUNNCF RAHE SCORE 19 1 19 a0 100 0 63 58 17 1 3 58 25 15 1 a 84 3 55 58 15 3 T 40 78 8 52 93 14 2 4 30 71 6 50 25 A 1 15 42 1 34 28 1 0 31 5 38 95
13. d to use ASSIST during the current academic year you must complete and forward this form to Assessment amp Testing either before or when you bring your first test for scoring To ensure the security of your test and the confidentiality of your students scores your results should be picked up either by you or an authorized individual listed below It is extremely important that this form includes your signature and the signature s of all other authorized individuals including the department secretary I authorize the following individuals to pick up my test results from Assessment amp Testing NAME Print SIGNATURE POSITION Instructor Name Print Instructor Signature Department This authorization will remain in effect until June 30 of the current academic year If you wish to delete an authorized individual from this list please inform Assessment amp Testing in writing Return to Assessment 8 Testing California State University Hayward Warren Hall Room 438
14. erstands how to mark them accurately Prepare a scoring key indicating the scoring options you prefer Bring scoring key and answer sheets to Assessment amp Testing Within 24 hours Assessment amp Testing will call indicating that your test results are ready to pick up You must arrange to have your exams picked up in person See Page 17 Test results cannot be returned via fax phone e mail inter campus or regular mail Instructions For Completing The Answer Sheet Successful and accurate computerized test scoring depends on properly completed answer sheets Your students must Read Important Directions for Marking Answers on page 2 of the answer sheet Use only a No 2 pencil Make marks very dark so that the letter underneath mark cannot be seen Erase unintended marks completely The following information must be completed on the student s answer sheet Your Last Name FI MI Students must enter their name in blocks at the top of this section then blacken the circle correspondent to each letter Social Security Number Students must enter their social security or student ID number Sex Class Level Optional Instructor Course Students must complete this information located on Section Date right corner of answer sheet Answers Students mark their responses to guestions 1 100 on page 1 of the answer sheet and guestions 101 160 on page 2 See page 5 for a completed sample answer sheet
15. m for scoring multiple choice examinations with these specifications ASSIST generates Using ASSIST is e exam may have a maximum of 160 items items may have a maximum of five answer choices exam can be subdivided into a maximum of six subtests raw scores can be weighted and corrected for guessing individual student responses to each guestion score distribution including raw score freguency cumulative freguency percentile rank percent score and standard score summary statistics including mean median variance standard deviation etc alphabetized student score roster that includes number of items right wrong and omitted percent score standard score and raw score descriptive item analysis optional that includes the number and percent of students responding to each answer alternative discriminative item analysis optional that includes high middle low group comparison individual item indices and statistics point biserial correlation and right wrong group means asy Complete the authorization form and submit to Assessment amp Testing Students mark their answers on 5 Trans Optic 05 7338 23 answer sheets You may obtain them from your department or have students purchase them at the Pioneer Bookstore Before beginning the test read instructions for completing the answer sheet Most students are familiar with these answer sheets but please be certain that everyone und
16. ng the Index of Discrimination by the Maximum Discrimination This ratio thus obtained indicates how well the item actually did discriminate as compared to how well it possibly could have discriminated Point Biserial Correlation This is a correlation between examinees performance on the item right or wrong and total test score The value calculated by the Student T test for Point Biserial Correlation can be used to determine if the Point Biserial Correlation obtained is statistically significant To make this determination compare the value given by the t test with the value given for N 2 degrees of freedom in a table of t distribution values where N the number of examinees Right Wrong Group Means Examinees are categorized into those correctly answering the item and those incorrectly answering the item The mean total score for the two groups is given See Page 16 for a sample of the Discriminative Item Analysis 13 Sample Summary Statistics eT EI FR CALIFORHIA TATE UMIVERDITT SATR ART BATE 09 1556 RESULTS FOR PAGE OMANE I 100 81 JOWES FORE SPS PSPS SSS SSS SSS SSSR 9 2 1 GOCIAL EHEER HUMRER BREA FERCENT SECURITY C L RIGHT WROHU BOE SCORE SOOKE ETUDEHT 000 008 0008 TOTAL 16 1 0 2 55 59 16 009 06 0061 TOTAL 17 1 1 BS 4 58 25 17 00 00 0068 TOTAL 1 1n 42 1 34 28 STELEWNT
17. the total test into subtests and get scores for each one as well as for the total test The subtest items must be contiguous with the maximum of 99 items in any subtest up to six subtests may be defined Mark the number of items in the first subtest in Part 1 the number it items in the second subtest in Part 2 etc Additionally each subtest may have a distinct scoring formula and item weight These options are marked in the grid below the Part Score areas In the item response area of side 1 mark the correct answers to test items 1 100 mark the correct answers to items 101 160 on Side 2 Items that are not to be scored or that have more than one correct answer must be left blank Upon completing the answer key sheet place it on top of the student answer sheets Please be certain that the Key and answer sheets are organized with side 1 facing front and the notched edges in the lower right corner Bring key and answer sheet packet to Assessment amp Testing Warren Hall 438 for scoring See Page 8 for a completed answer key sheet Sample Key Sheet GL Ed a Be ee oe oe beg nhu Be Be ae es i dl ry d r Se as mg dd mn
Download Pdf Manuals
Related Search