User Manual DoneIT
Contents
1. O Figure 19 The application now displaying the assessment code encircled in this image The students now can log into the session at the following address Notice At the moment the student http aft test hist no srs assessment plugins a interface has problems with Android phones We are working on the The students respond with a web browser using a cellphone iPhone iPod iPad problem works at the moment or with a Webkit browser like Google Chrome or Sarafi P BD BD BD FB BD A Student interface on login When the students follow the link to the web interface they get a login window PeLe 1 0 41 Peer Learning Assessment System Enter login data Session DILCI User studento1 Password eeeeeeee All fields are required Server 1 0 3 232 Figure 20 The student interface on login When they have logged in a welcome page will appear Here you will find you metadata such as the course name and the message that you inserted in the metadata of the assessment Welcome Session DILCl Course DEMONSTRATION Welcome and good luck Please press the start button Start Figure 21 Start page of the student interface Now the students just press Start and can start responding The students then will get an interface with a quick navigation bar at the top showing the question number and an area with all the alternatives GEeEceacugog 2 a0GecEencgl Question 1 1 answer 0 1 Question 2 1 answer2. Figure 32 The In Class mode with question 4 selected and the activity menu selected Now if you press on selected question number four you get a quick menu up where you can chose the following e Present the percentage correct wrong answers e Present the histogram of what they voted e Send the question out to the devices so that they can vote again Figure 31 A typical percentage correct wrong visualization Test Li a b E d e 0 1 2 3 4 5 6 7 y Figure 33 The interactive histogram showing what the students have responded to the question The histogram displayed is interactive That means that you can select an alternative and it will shift to green color so you as a teacher can highlight one response If no one has selected that alternative you can still do this If you want to remove the green color click again and it will be removed Percentage Histogram send to re Figure 35 The activity menu focusing on question four but no looking at the second chance SRS data Test Ladi hz Ee 0 1 2 3 4 5 6 T Figure 34 Histogram with one alternative highlighted If you click on the SRS button you will send the students out to the second chase loop The alternatives on that selected question will appear on the voting device and the students can submit again As a teacher you will now get a new dialog showing the question number number of responses as they appear and the time
3. The first user manual for prototype Version 1 1 688 ea Education and Culture 0G Lifelong Learning Programme Contract 511485 LLP 1 2010 NO KA3 KA3MP TRONDHEIM Table of Contents Tete OT COM CIES sora a conto E A 0 DisckiMe stricta stcorenscastvanadixe T O E O 2 WO ea E E A A T 3 OUE ON erpa aA ANE NOATE E ENE AR OE 3 User ACCOM arr aa a AA ETETEA 3 UIA A AA TE E E TOE E A E EE T E E E E 4 The Meni Syste Meaca ee tee A 4 Net workstation EE A EOE NEIE A EAN E OA 5 Creatine an ASSSSSINGIME cerisenera ia 5 Step one MEIO aie eniasedeat errat ranar EA ETTA AEO 5 Edit assessment setup TIN axa wsicuneansncsievvartiteeemaventicnar ein ieioniarseememnes 8 Simulation The MONKEY CAGE cccccccccccesssssesssssssssssseseeececeeceeeeeeeeeeeseessaeeaeeesgseensees 11 St o o aac EE A A EE ENE EE E ETE EE EE 11 LES SEAN E aeaa E E eee ec T anion nies 11 Student interface on login sss ssessesssssseeresssssesrrrreesssssrerressssssrrereessssssreressssseseeeeree 12 Monit ring an assessmMENtairerensnsrin T nn a E NEEN 14 e E nce cccccccecccccccaccceeenceesnccenscsnesenscneeessensnsseeenssenenne 16 WOME IA GUESS en A E E eat eee 17 SS ENEE EA ENA AET E IAE AE A AE T 20 Disclaimer Version 1 1 688 is a prototype We know that there still are errors to fix but the application should run and be able to use for simple assessments with an SRS activity after the assessment Any bugs can be reported to Trond M Thorseth hist no and
4. Question 10 Figure 27 The End interface with the results In the end interface you can get an overview of the results for each question You get a bar showing the percentage correct answers percentage wrong answers the number of marks and a spread factor The spread factor is an index ranging from 0 to 100 This is a factor that give you a measure of how the spread of the responses are If all have given one alternative you get 0 if the responses are equally distributed over all alternatives you get a complete spread of 100 You can press the expand button to see more details of what responses has actually been given Here you will get a histogram showing the distribution of alternatives chosen and the table showing counts of each alternative The correct alternatives are marked in both the table and the histogram You can press the Contract button to remove the additional data Questiono7 xX 6 3 a Yo e Option Selected Percentad C Question 08 Lx 2 4 0 Figure 28 The table row when the expand button has been pressed Expand When you find questions shows somehow that the students have problems with the question you can select it You select by pressing the Select button This pulls the question up to the bin of selected questions These questions you can select to bring into class Here you can select one question or all if you want to A Done IT EN 2a Login Edi
5. black background with white characters Students still working appear with blue characters on white background The symbols used in the monitoring interface and the meaning of each symbol is given in Table 2 below Notice Students has given us feedback on this monitoring interface where they ask a relevant n question Why should the teacher Symbol Meaning see who marked the question This No response given to question Both neutral and detail mode we might remove such that marking m Response given Neutral mode of questions only appear in the im Response given question marked by student Neutral mode question oriented list in future o Correct response given versions g PII D2 DD A oe Vi im Correct response given question marked by student Table 2 Symbols used in the student oriented monitor view The question oriented view displays the questions and how the students are performing on each question You switch to the question oriented list using the Show Results Summary button Show Show marks Show monitoring matrix Notice The question oriented list Question no Correct Correct Wrong Wrong Marks cardinality interface we are planning to change Question 01 0 0 0 o 5 3 The plan is to have a tree state bar Question 02 O pos 0 mooo 3 2 showing percentage correct SORS sa i 8 z percentage wrong and percentage nani at s i Question 05 2 7 718 2 1 unanswered in one bar The
6. spent When you feel that enough time has been given you can stop and the student interface will present a please wait interface Question Received responses 0 Time Elapsed 00 10 4 Figure 36 She control interface for the second chance appearing when the students can deliver a new response Now when the Second chance is stopped the data appear together with the selected alternatives Figure 37 The selected questions with two runs of question 4 using a second chance loop The SRS buttons a behave like the selected question buttons When you press the button you get the activity menu up again and can show results or enter a new second chance loop Results In the Admin interface you can now look at the results Here you get a list of all students and what they have responded and the final score according to the rules that you have set If no data appear in the Admin interface go to End and press Get Results button You will get a message that the latest data has been loaded Message The latest status ofthe deliveries is loaded o Figure 38 DonelTC confirming that the latest data has been loaded _ o Done IT T r Ae Edit Start Monitor in ed FT at Export To XLS student01 j a c b b a bd ce ac D one student01 1 0 1 0 0 2 2 2 1 student02 b c c d e ad bd ac ace b student02 0 0 1 1 1 1 2 1 3 1 student03 a b c d e c bd ac bde a student03 4 1 1 1 1 1 2 1 1 0 student04 a b
7. 14 Question one where alternative a has been selected as correct You simply click on the alternative In Figure 14 a has been selected as correct Since Use standard Rules has been set this gives the standard rules to this question The standard rules you can adjust in the right hand part of the interface If you need to add or remove one alternative press to add an alternative and ia to remove an alternative The max and minimum score of that question will change as you select correct alternatives You can however override the standard rules and remove the use standard rules This allows you the see the score and set other values for the score 7 _ Use standard rules Min 0 L Bleed Max 1 No of selectable choices 1 Figure 15 Question setup with use standard rules unselected You can manually enter a number and if you allow the question to bleed the score can range from a negative score to a positive score as shown in Figure 16 Standard rules _ Allow Bleeding Correct 7 alternative SS T Wrong 0 alternative eee No selection 0 es OE ce Minimum Score 0 Maximum Score 10 Figure 12 Standard rules settings Here the general rules can be set for all questions bleeding correct wrong and no selection score and a maximum and minimum calculated score _ Use standard rules Min 2 5 Y Bleed Max 4 No of selectable choices 2 Figure 16 The same questions setup wi
8. e assessment if needed Then when the assessment is ready you Start the frou process by uploading the assessment setup to the server When the assessment is uploaded the program immediately starts Monitoring the assessment Tabe Login Edit Start Monitor End inClass Admin Exit a a l 1a lt B 4 r Done IT goes 2s Figure 3 The menu system in DonelTC with the network stat When students have submitted their results you can End the assessment start considering the results and select questions that you want to take back to the class Then In Class you get a transparent application where you can pick results or send the question back to the students Network status In the upper area of the main application is a visual feedback is given on the network status If you are not online you get a red cross over the internet symbol Figure 4 Network status indicating a lost connection indicator The table below explains the symbols in the network status interface and what they represent Symbol Error message Computer online A Se You are not online The server is not responding Server online and responding Server not online or wrong address i The service is not responding Service responding correctly correctly This number is the HTTP status number from the last interaction with the server Should be a 200 but not lager than 299 Table 1 The symbols used in the network monitoring int
9. e b c oa student04 4 1 0 0 0 0 0 0 0 0 student05 a b c c e a b coe student05 4 1 1 0 1 1 1 0 0 0 student06 a b b d e ad ac student06 1 0 1 1 1 0 0 0 0 student07 a b c d e ac bd ad ace a student07 1 1 1 1 2 2 0 3 0 student08 a b c d e ac bd ce bce a E student08 4 1 1 1 2 2 2 2 0 student09 a b c d e ac bd iaga student09 1 1 1 1 1 2 2 0 0 0 student10 a b c d e ac b b ace b student10 4 1 1 1 1 2 1 0 3 1 teacher oa teacher 0 0 0 0 0 0 0 0 0 0 Figure 39 The final list with results for the students Export To XLS If you press the Export to XLS button you will now be able to export the results as they appear in the list shown above in Figure 39 This gives you a student oriented list with what they voted what score they got and the calculated total score Notice In future versions this loading of all the results for that assessment should happen automatically when you enter Admin However we need to be able to handle several assessments simultaneously and hence this interface will look different in future versions Notice This part of the software is at the moment the weakest and least developed part You get only the assessment results for the assessment that is active and selected In the future you will be able to look at both assessment results different sections if you are using more than one default section and SRS data This data will also be able to export into the Excel spreadsheet Results from the SRS pa
10. e student users Login LJ Use locaihost The first thing you have to do is to login to a server At the moment we only have seve hitpv afi test histno one server online that you can log on to aft test hist no that is the only option you oe Path have in the login interface Sfs assessment hitpv aft test hist no B0 srs assessment If you have a username and password use that otherwise use username teacher and password teacher If you have a localhost installation check the localhost and log on When the server address points to a real server that is online you get a green symbol indicating that the server is alive and responding Click connect and you enter the application and get an overview of all you assessment sessions on the server 4 E N a Done IT 7 Ae T faa i oe Edit Start Monitor Fin Class sill Exit eet DonelTC Ver 1 1 688 Change Serer V Show only my sessions Code Cource DateCreated Owner Open Active Control LPSYJ DEMONSTRATION 2011 11 20718 23 41 teacher we Y view Monitor Results Delete WPJVH Assessment in Physics 2011 11 21711 18 41 teacher ly Ww View Monitor Results Delete SYMWI DEMONSTRATION 2011 11 27 15 47 09 teacher i WW Mew J monitor Resuts Delete BOPOQI DEMONSTRATION 2011 11 23T11 07 01 teacher iw Y Vew Monitor Results Delete SSFYJ DEMONSTRATION 2011 11 23T11 07 01 teache
11. erface Creating an assessment When you want to create a new assessment go to Edit and chose Create In Class Admin Exit Figure 5 The menu system and where you start creating a new assessment This will bring up a create assessment wizard in four steps Step one metadata The first step provides an interface where you as a teacher can fill inn metadata about the assessment Metadata Size Dates Rules 1 Metadata Assessment name Demo Course Used to sort assessment codes in categories DEMONSTRATION Teacher description Not shown to the student This is a remider of why the assessment was runned the idea and what was tested Message to the students on start page Welcome and goad luck Next gt gt Figure 6 The metadata step in the wizard Here you can fill in the assessment name a course name a short description about the assessment This provides only as a reminder for the teacher why this was done Then you can fill inn a message to the students a message that will appear on the student interface when they login to the assessment The second step of the assessment is an interface for creating the main assessment form Number of alternatives 5 2 5 You can later delete or add alternatives for each quest Notice The number of questions is set for the assessment here You can t in the current version add lt lt Previous Next gt gt que
12. ive score for an individual question will influence the overall score Correct choice 41 0 Wrong choice 0 0 No choice lt lt Previous Next gt gt Figure 9 The fourth step of the wizard where you set the rules The default score for correct choice is 1 but you can change this from 0 to 3 You can give the score for a wrong answer from 3 to 1 No choice gives the score if the student is not responding If you Allow bleeding a negative score from one question can be transferred to the total If you do not allow bleeding the minimal score can always be zero This is an option that really matters if you have more than one correct alternative Two alternatives wrong might give a negative score if you allow bleeding Edit assessment setup file When you have finished the first four steps of the assessment setup wizard you get the assessment setup document displayed This contains a list of questions where you have to add information about what alternative is correct or not Edit setup for DEMONSTRATION Demo Show Metadata No Alternatives Standard rules C Use standard rules L Allow Bleeding L Bleed No of selectable Correct choices 1 alternative _ Use standard rules yu _ Bleed No of selectable Wrong choices 1 alternative L Use standard rules L Bleed No of selectable No selection Q choices 1 O _ Use standard rules L Bleed No of selectable choices 1 L Use standard rule
13. m 1 1 Ooo0o000000 e Moooooooo Figure 22 The students interface where they fill in the responses On the left side you see the page before filling inn an alternative To the right you see how the page confirms the selection By pressing on the white area of the alternatives they select an alternative When an alternative is selected the number in the navigation menu is filled Now the student can move to the next question by pressing the next question on the menu or simply drag and slide the page to the left A question where response has been given is changing color of the frame from red to blue At the bottom of the page is a set of buttons the students can use The function of each symbol is given in the table below Symbol Meaning of the symbol Go to home page Mark this question Delete the responses to this question T Filter out the questions have answered and leave only the unanswered ones b Move to next previous question with a flag showing the number of questions still left unanswered i When the students mark a question the border around the alternatives turns yellow and the question is tagged in the top navigation menu The teacher can now see that this question has been marked eese Meeooo 3 28 fv gt Figure 23 An example of a student page where question 3 5 and 7 has been marked by the student Monitoring an assessment Monitoring of the activity is done for two reasons M
14. marks EEE g i Pra m gt will appear in a separate bar P D DO DO D TA Figure 26 The question oriented list with number of correct responses percentage graph number of wrong responses percentage wrong bar number of marks and the cardinality of the question You can switch back to the student oriented list by pressing the Show monitoring matrix button When you want to end monitoring of an assessment you have to go to the step in the main menu End and press the End Monitoring This will bring up a small dialog telling you that monitoring of the assessment has ended You can start the monitoring again by going to Login find the assessment and press the monitoring button This will restart monitoring of the assessment Analyzing the results When your students have responded and submitted you can end the monitoring by moving to End End monitoring Get Results The first button stops the monitoring When you press this monitoring is shut off If you press Get Results the latest results are obtained from the server Now it s time to do a quick analysis of the responses Done IT ies a ie i OS Se DILC Login Edit Start Monitor Pin Class a Admin a a m i 6 li zi 5 l 4 raO Question no Ma Spread Histogram Question 01 Question 02 Question 03 Question 04 Question 05 Question 06 Question 07 Question 08 Question 09 wo Wo amp WwW mM HY U HY HB
15. onitoring of the activity can be done with two main views either as a student oriented list or as a question oriented list The default view is the student oriented list where the teacher can see the students appear on the list as they log in see responses appearing and get a picture of students as they submit their assessment You can see that monitoring is active by looking into the network status area and look for a green led blinking on the service status as shown in Figure 24 Figure 24 When the monitoring is active you will get a blinking green led displayed on the service icon Each time this shows a green dot an update of current status is requested The tree buttons on top control the view of the application Show switch between neutral display of responses and details about correct or wrong Show marks display what questions has been marked and the show results summary displays the question oriented list nme sft 2 ra r studenti a im im E 8 E E 8 studento g mom img ng ja a student03 v CHL CHLEECE Student04 oi E E m m in jigiigi Student05 v iM m 8 E EE Student06 ol 8 E Student07 ae E E E n E Students i E E E E E 8 Student09 A 8 E E E 8 studentit v E E 8 a 8 Figure 25 The student oriented list where every student has submitted their response except the guest user at the beginning of the list Students that have submitted their response appear with an inverted name
16. please give the version number As bugs are fixed new versions will arrive and this is the number used to keep track of bugs and bug fixes Warning Where we see changes coming or problems that might appear this is notified this way You see these bars with a message between This manual describes a prototype in constant change Installation DonelTC is Air application that requires Adobe Air installed on your computer You get adobe air from Adobe for free You can get it from http get adobe com air When Air is installed the air application can be installed by simply double clicking on the air file If you have a previous version installed you have to remove the old version of DonelTC before installing a new one Once installed you will get the DonelTC icon on your desktop Introduction The DonelT assessment system is a general assessment system made for connecting assessments but with an approach where we try to target learning The focus is to provide the teacher with enough information from the assessment part to be able to perform an activity immediately afterwards that targets problems identified from the assessment Can the immediate feedback provided and the way a teacher decides to work with the results provide an arena for learning using the results from the assessment The application mainly does the following e Login to the assessment server and provides an interface where the teacher can get an overvie
17. r DOBNE Demo 2011 11 237102553 aon WULF BA a BA wT A DMPBY DaliaTesing 2011 11 23T14 19 59 teacher Warning The server is still under l VMGWV DEMONSTRATION 2011 11 23T15 03 37 teacher WYLDL Testing 2011 11 24T10 52 44 teacher development and you might find that XEKC Ahursen Lag amp Ratt 2014 11 24711 10 48 teacher your assessment has disappeared If DOIOT DEMONSTRATION 2011 11 24T11 03 52 wach the server has been restarted all WAPU DEMONSTRATION 2011 11 24710 44 27 teacher IDORU Demo 2011 11 23T10 25 53 teacher assessments on the server are APKUK Demo 2011 11 237 10 25 53 teacher perma nently deleted AGESS gabby 2011 11 24T13 17 10 teacher uasa DEMONSTRATION orizeris0ess tears ee a ae A LHBES DEMONSTRATION 2011 11 24T13 08 55 teacher Figure 2 The initial interface where you get all your sessions listed Here you can login and get the results monitor a session or switch session Here you can now go and monitor an existing assessment or go and look at the results of the assessment In the future you will be able to open and close the assessment activate or deactivate the assessment Now you will get only a message that this feature is not implemented The delete assessment is not activated at the moment The menu system The main menu is a simple set of steps that follows a normal procedure After Login you normally have to Edit or create an assessment Here you can also load or save th
18. rt is not exported in this version
19. s C Bleed choices 1 L Use standard rules 0 C Bleed No of selectable Maximum Score choices 1 4 0 L Use standard rules L Bleed No of selectable choices 1 C Use standard rules C Bleed No of selectable Figure 10 The interface where you can edit and set the details in the assessment setup When the assessment setup document is in memory you can see this with the document setup in the upper right corner By clicking on the icon you can edit the document again Figure 11 The document in memory icon showing that the assessment document is created and excist This interface has a button where you can switch between the questions and the metadata view Show questions EE Standard rules Demo L Allow Bleeding teacher 11 56 11 56 Correct 1 ID alternative 56CF19FC 348D A9F3 51E3 59A04DF96522 Course Wrong DEMONSTRATION alternative a Teacher Description This is a remider of why the assessment was runned the idea and what was tested No selection 0 m Message to the student Welcome and good luck Minimum Score 0 Maximum Score 10 Finish Edit setup for DEMONSTRATION Demo lis Figure 13 The metadata displayed in the assessment setup document Now its time to adjust each question and set the correct alternatives V Use standard rules Min 0 Max 1 No of selectable choices 1 Figure
20. stions later This is a missing feature that we are planning to add later Figure 7 Step two with the number of questions and the number of alternatives on each question EP DB BD BF BF Aa Notice Timing of when the assessment starts and for how long the assessment should last is not used in current version The plan is to be able to set a time window for self assessments or similar tasks The number of questions has at the current version been limited to 50 and the number of alternatives has been limited to 10 You can add or delete alternatives later when you After that in step the next interface is the interface where you can set the time and date of the assessment This feature is not used now Create Assessment Wizard Metadata Size Dates 1 Metadata gt 2 Size gt 3 Dates In this step you can set the date and time for opening and deadlines for closing of event C Use start time C Use closing time Hour Minutes Hour Minutes lt lt Previous Next gt gt Figure 8 Setting date and time of the assessment The last step considers the general rules of the assessment This is where you set the score given for selecting a correct or wrong alternative You can also set the score given for not responding to a question Create Assessment Wizard Metadata Size Dates 1 Metadata gt gt 2 Size gt gt 3 Dates gt gt 4 Rules L Allow bleeding If you allow bleeding the negat
21. t Monitor End In Class a Admin Exit 9s aaah a ey End monitoring Get Results Figure 29 The bin of selected questions appearing when you select the question When you have selected those questions that you can possible to something with and can predict some activity in class with the questions you are ready to go into the class with the results and start the fun part Now let the students learn from the assessment and start working In Class Working In Class When you move to In Class the application turns transparent This is done so you as a teacher can present the questions as you work with the questions e 2 ae Done IT sah aa A F 2 E rae _ bs ga E g7 Login Edit ma Start Monitor a End In Class ua Admin m Exit E A mie oe Ae ri y a Teaching b Football c Politician d Music 4 What is the solution to this integral 2 b e dx 0 a e bj gta c e 1 d 2e Figure 30 The DonelTC application on top of a simple assessment Now you can focus on the questions and help the students to understand the problem i a gy all Done IT SP SS DIL we ee ee T Login Edit stan Monitor End ga Class AGMIN aa Exit m A ecg ame na Catatau ia ae a Teaching b Football c Politician d Music 4 What is the solution to this integral a e b e271 c e 1 5 Neumann Janos is known for Test Correct a Physics b Mathematics c Art d Business 70 00
22. th different scores set for the alternatives Simulation The monkey cage When the assessment is setup and you have the rules ready you will in future versions be able to simulate the assessment Assume that you give the assessment to a bunch of monkeys and N monkeys press at random what score will they get The simulation tool will provide some insight into how easy it is to get a score and also possible outcomes of you setup This feature we are testing and tries to make results available for the user to interpret However its disabled from this version Save and load Once you have created an assessment setup you can save this to a file A saved file you can load again co cs coe Figure 17 The create load and save menu under Edit When you load a file You are asked if you want to display the assessment setup document or not If you respond with yes the document is displayed and you can continue edition the assessment If you respond no the application jumps directly to start where you can start the assessment Lets start When the assessment is set up and ready go to Start and you get a big green button When you press the green button the assessment is uploaded to the server Document ready to upload press Start Figure 18 The big green start button The application now immediately starts monitoring the assessment Notice how you assessment now got an assessment code til F In Class Admin Exit
23. w of assessments and to some extent administrate assessments e Aninterface providing tools to create assessments that is interpreted by the server such that the students can respond to the assessment The assessment setup can be saved or loaded from file locally e Aninterface for close to live monitoring of an active assessment and consideration of the results while the students are responding e Provides an interface for considering the results and select what questions to work with in the Post Assessment Activity e Aninterface for performing a post assessment activity displaying partly or completely results or sending the question back for a new second chance response e Anadmin interface where the results are summarized and can be exported to Excel User accounts You can at the moment use the general username teacher with the password teacher You can create your own username We recommend that you do so Using a web browser like Google Chrome and go to the following address You will be required to give a username and password teacher teacher http aft test hist no srs assessment admin accounts Here you can create your own username and give it the role as a teacher If you want to generate student accounts this is temporarily done here or you can allow students to create their individual users at http aft test hist no srs assessment userregistration This link is not password protected but can only be used to generat
Download Pdf Manuals
Related Search