Home

User Guide v5 - Center for Excellence in Learning and Teaching

Contents

1. Figure 426 QM Views Overview In the example the results are for instance shown for the survey of the course Leader ship Development with a quality calculated at 68 0 364 Scantron Corporation Copyright Electric Paper GmbH EN e COURSE EVALUATION FEEDBACK SYSTEM The green red circles each represent a quality guideline in this example teaching subject matter structure practical application interest interaction as well as methodology and sequencing The more red area the more questions in this quality guideline are below the targeted value In order to receive a more precise view click on Details You will then see a detailed list of all the quality guidelines of the questionnaire as well as those questions which did not reach the target value In this case the quality guideline is met in all the dimensions Quality details for survey No 43010 Backtolistview Snore ua ee guideline 3 Questions about the course Question Please grade the course altogether The course focuses on the current professional discussion Question Please grade the instructor for this course The instructor is always well prepared gt 3 4 The instructor is always well prepared 30 gt 60 gt 4 Question It benefits from the technical possibilities internet videotaping blogging etc an gt 34 It ts well structured gt 3 4 it complements the leaming matter gt 3 4 Ques
2. RETINT OEA Edt Start date 05 27 2011 at 10 14 00 Note Please note that due to the execution of additional tasks there could be small delays in processing a Automatic report cl Nek to the instructor s after closing the survey Sender email Sender name training example com Class Climate Admin Reference Result view online survey Mail text This email entitles you to view the results of an online survey Please follow the link and use the PSWD displayed as identification The PSWD reads PSWD Access under SERVER Figure 150 Dispatch Email to Participants via Time controlled Online Surveys Scantron Corporation Copyright Electric Paper GmbH 05 27 2011 AG 1 00 jm 165 a Your Evaluation Process The Phase Model thy AN Class CI imate COURSE ss Cli FEEDBACK SYSTEM After activating the procedure Close survey the option Send result access information to participants appears This way the dispatch of accessibility details is directly linked with the automated closure of the particular survey Upon entering their PSWD the authorized survey participants receive access to the HTML report EE Class Climate BRAU CMG GGT HE POLPREEE ETE Survey Basics of Economics Esmeralda Parker Number of evaluated questionnaires 6 Question i Result What is your gender male M 50 00 imale M 50 00 What is your age 15 23 M 50 00 30
3. i g Course Type 1 Lecture pP 2 Seminar P 3 Proseminar Fj 4 Tutonal F instruments 5 Lab X R Text Templates amp Working Group p 3 Documents T Instructor H 4S Report Settings 6 General Information R Onine Templates 9 Field trip P 10 General Surveys F R seuraan 11 Module General ModSem Course Evaluation J a Class Climate w 12 Module Instructor Modinstr Instructor Evaluation J amp Sure i Types Course Type ap tarona Course Type Module Instructor iA Custom idies E Process Defauts Form Link for Modular Surveys E Web Service Settings Modinstr instructor Evaluation i Language Sets fis l Save F Cancel Figure 438 Form link for modular surveys To create new course types for example a course type Module General for the evalua tion of the module in total enter a new name in the area Course Type and select the corresponding questionnaire from the drop down list underneath Form Link for Modular Surveys Click on New to add the new course type to the list To link a questionnaire to an existing course type click on the green pencil icon You will find the selected course type in the area Course Type at the bottom of the list Select the corresponding module questionnaire for the selected course type and click on Save to apply the selection 372 Scantron Corporation Copyright Electric Paper GmbH Class Cl
4. 0 2000 c eee eae 496 place holders 0 cece eee eee 398 Horizontal matrix question 408 422 Horizontal pole labels 0 000000 427 HIMLT 30S 2 5k oben A gees ee 434 IO eeneehedvenecerndeseeeecenuwees eas 218 415 Image files from Scan Station 35 Image Files of the open questions 35 Implementation of surveys 0000 eee 107 Implementing backups 0 0000 e eee 34 Import ala 4444 peewee ree he ee ee E ees eee 513 HETIACES i2 tca0secedeerseteouee wes so een Ei 76 Participants email addresses 81 Particpant s Data CSV 00 0 eae 73 Questionnaires 0 eee 457 gt 4 Sean ae ee Pn ee E 81 Inclined pole labels 0 0 00 ce eee aes 429 Indicator FIOO es 92 265 WAGICAIOIS eines cam saGiede meee pikken E n iR as 257 Activating the indicators in the configuration 260 Creating the indicators for a questionnaire 262 Free Indicators 0 cee ee eee 265 The principle of the indicator 257 Individually configured letter 252 Individually designed reports 0005 250 Instant feedback 0 0 cee eee 205 The PDF report 0 0 0 0 eee eee 222 Instructor Accounts i os ee Se le ee ee 195 522 Active instructor 0 0 0 0 eee eee 21 195 Active instructors 0 0 0 0 0 es 22 Use of
5. H Question Library Text Templates Horming POF Reports Quality Guideline Report for comparison Jsa Tata export contguration Fitter settings Validation Reporting Options Online Design Required questions le iy Show the header of the survey Cross tabulations __ Mirrored scale values ka Free indicators V Allow Summary Reports C Enable temporary save Languages ie i _ A l Show io Figure 384 Profile Line Comparison Selecting the option Report for Comparison The following window opens automatically in which you can define the number of previ ous periods for the comparison lines Define the number of previous periods in the profile line F Here you can define the number of previous periods that will Number of previous periods in the profile line appear in the PDF report in addition to the profile line of the current survey g Save Define report for comparison f Survey Period Subunit isos o Available reports besgi J Belmore WS 10 11 m WS06 07 S07 ws09 10 Figure 385 Profile Line Comparison Defining Previous Periods and Comparison Reports In the first part you define how many previous periods are to be considered in the profile line Here you can choose between none and five previous periods If for example you wish to include two previous periods for comparison enter the number two here 330 Scantron Corporation
6. Paper survey Hard Copy Procedure Cover Sheet Procedure Web Verification Online Online Survey Use Time Control Generate Surveys T Figure 444 Generate Module Survey The example shows an online survey When the survey was generated Class Climate combined all the sections of the module into a single questionnaire The name of the questionnaire is random alphanumeric and eight characters long in this example STE HETMT amp Computer Sciences Class Climate Basic Training 5 ss10 wre Name a Status k i Processed Form Report Export Actions Class Climate Basic Training In Progress Q STEHETMT Show PSWDs g P 38 Figure 445 Module Survey in the List of Surveys lf you have generated a paperbased survey please check the questionnaire by opening the PDF version before printing it If the layout does not live up to your expectations as for example the page breaks are located badly delete the survey and edit the single questionnaires in the editor After that generate a new survey and check the results The newly generated module questionnaire can now also be displayed in the list of ques tionnaires in the menu Questionnaires when enabling the option Show deactivated questionnaires at the end of the listing including module questionnaires Scantron Corporation 379 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION
7. Screen background color FFFFCC i 49 This color will be used as the screen s background color Logo background color This color will be used as the logo s background color 6699CC is Survey header background color FFFFCC l This color will be used as the survey header s background color Survey header font color 003366 E 9 This color will be used as the survey header s font color Figure 140 Customized Online Survey Template Customize colors e Navigation Different elements such as the page navigation or the progress bar can be shown or hidden here e Question Types Specific settings for different question types can be made here such as for example a remaining characters counter for open questions can be displayed scale questions can be displayed as a slider etc Whilst customizing the template you can change between the different tabs at any time Once you have completed your editing click on the button Accept The template just created now appears in the overview Scantron Corporation 155 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Customized Online Survey Templates i eng lt f i Pasic tem i pga f Ti GE LT i it ee eee p paraa a E S E Class Climate Online Survey Template Class Climate Admin 3 6 High Contrast Class Climate Online Survey Template Class Climate
8. Search Result 4 Hits in this Table Course Search Details Organization and Management Economics Engineering 02 P1236 Seminar Human Resource Management Economics Engineering 02 P1237 Seminar Management Strategies Economics Engineering NA_2 Seminar Human Resource Management Economics Engineering Computer Sciences 02 P1237 Seminar ces Oto gt gt gt Figure 574 Search for Courses In the example a search has been made for the term mathematics The columns of the results table can also be sorted in ascending or descending order By clicking on a course you will be taken directly to the course details Scantron Corporation 463 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Searches are carried out in the databases program of study course name location type and ID The following data fields are displayed e Name of the course at the same time a reference to the course data e Program of study e ID e Type 1 1 3 Search for Surveys This search allows you to find surveys The search takes place in the survey data fields creation data processing date survey name survey ID and number of returns Search Result Table Hits Max Details Surveys 2 Hits in this Table 25 Details Survey Search Details Name SurveylD Status Type Form Created Processed Formcount Eionn into 45676 Data available Quest 0
9. Create profile line report 1 Subunit 2 Survey Penod 3 Type 4 Questionnaire Engineering a 2211 ra Lecture a Quest_01 Professional Development Ls Seminar irain en aa Data Entry Demo Subunit 5510 train_en_1 WS0g 10 S507 WS06 07 5506 WSOS 06 3505 wil A 5 Courses Reports Prof Dr Philipp Belmore Management Strategies NA_2 Managing and maintaining a healthy lifestyle NA_1 J Hemandez Organization and Management 02 P1236 or train_01 train_en train_en train_en train_en_1 train_en Belmore WS 10 11 train_en s ma ih Ri ali Figure 360 Report Creator Profile Line Emails Selection of Criteria You can mark several courses reports in the list of courses Additionally you have the option to select the profile lines that every event should be compared with under First Comparison Line and as required Second Comparison Line 314 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM First Comparison Line Deactivated Please Choose a Selection Deactivated Please Choose a Selection a Second Comparison Line Survey of same course in period SSOS Survey of same course in period WS05 06 Survey of same course in period 5506 Compare selected cc Survey of same course in period WS06 07 ee Survey of same course in period SS07 Comparison optio
10. SO Are you sure you want to convert this survey to a password based survey This command cannot be undone Figure 154 Confirm warning message By default the password is the first PSWD of the original PSWD based survey To change the password click on the option Change password This opens a dialog where you can enter the new password Change password z Change password _ Send password via email ge p Preview online survey Number of participants fol rate 9 Finish Data Collection C amp Delete Survey En Assign survey to substitute instructor Password SCZLJ Figure 155 Change password 168 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 2 Implementation of Surveys Now if desired and as long as the group of participants is known the password can be sent to these Click on the option Send password via email to participants This opens an input window In the field Recipient all email addresses that have been imported for the course are shown If no addresses were imported they can also be deposited manu ally afterwards Click on Submit to start the sending send password by email to respondents Survey Introduction into Sociology Instructor Dr White Note After clicking on send and sending the email please do not use the browser function REFRESH o
11. 524 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM LDAP Login If it s not allowed to search anonymous in the LDAP or Active Directory server you have to enter the login of the search account here LDAP Password If it s not allowed to search anonymously in the LDAP or Active Directory server you have to enter the password of the search account here Maximum document size Maximum size in bytes of an attachment or PDF template document Please note that changing this value requires resetting the database configuration max_allowed_packet Storing the IP address in the session lf enabled the IP address of an Class Climate user is saved in the session at each login With each subsequent action initiated by the user in Class Climate the stored IP address is compared with the transmitted new one If they do not match the session is terminated and the login screen appears The security check prevents a valid session ID being guessed and hinders the associated access to Class Climate by third parties However guessing a valid and usable session ID even with the function deactivated is quite unlikely lf users with the same IP address are accessing Class Climate network related and the storage of the IP address is activated only a limited check can be undertaken If Class Climate is accessed from a network communicating with changing IP a
12. Display Per Chapter Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM Question Library Choose a question from the library Opens the dialog to add questions or question groups to the library Add selected question to library Opens the dialog to add a selected question to the library Delete selected question from library Deletes the selected question from the library Detach library question Detaches the selected question from the library Add selected question group to library Adds the selected question group to the library Delete selected question group from library Deletes the selected question group form the library Detach library group Detaches the selected question group from the library Save form and exit editor Saves changes and exit the VividForms Editor Delete form and exit editor Deletes the questionnaire and exits the VividForms Editor Figure 458 Editor Control Question Library Choose a question from the library Add selected question to library Add selected question group to library Save form and exit editor Delete form and exit editor At the foot of the editor control panel the field meta information provides an overview of the current state of the questionnaire Form Properties f ea B 4 Ad ia A 352 O 1H 1f Figure 459 Editor Control
13. Extended Filter Options Update Course List Scantron Corporation 293 Copyright Electric Paper GmbH Class Climate Your Evaluation Process The Phase Model Class Cl mate With Undo all entries are being deleted from the search mask and the course view is updated likewise Any Compilation Tree Structure When creating an Any Compilation report surveys can also be selected with the help of a tree structure By this the hierarchical order of the different organizational levels e g subunit location program of study instructor etc is better visualized and the desired surveys can be selected more easily Choose the option Any Compilation Tree Structure from the drop down list and click the button Next Create reports Summarized Reports Any compilation Tree structure Comparisons Batch Profile Lines Figure 323 Report Creator Create Any Compilation Tree Structure In the left section of the next window the tree is displayed The single levels of the tree can be opened or closed by clicking the symbols or clicking on the name of the level All levels the administrator has selected for the organizational structure are shown in the predefined order By marking the boxes single levels can be selected For further infor mation on working with the tree structure please see chapter B 3 2 5 Tree Structure Choose the desired elements from the tree
14. Subject Line of email Default Subject line from the setting Text Template Text of email The email text can have placeholders Default Mail text from the setting Text Template Scantron Corporation 139 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Email addresses List of the email addresses of all respondents The number of email recipients is limited by the number of available transaction num bers The time of the email operation can be defined in the field Start Date A click on the button with three points opens the calendar symbol The use of the calendar is explained in the last point of this section All settings can be saved by clicking on Save Before saving check syntax of the email addresses e g Technical limitations mean that the actual existence of the email addresses cannot be checked Undeliv ered mail can be found in the Class Climate logbook The email addresses are saved in the system for reminder emails Scheduled Tasks Newt suey __ 1 to respondent 2 Online survey reminder 3 Finish survey 06 23 2011 at 08 00 00 pm Deactivated Deactivated Edit Ls Edit Edit Deactivate Start date 06 23 2011 at 08 00 00 pm 03 Mote Please note that due to the execution of additional tasks there could be small delays in processing Fes The mg ee 4 PCA ta rac 1 POWD tor nace ce oll PE eS POndens sender email Sender name
15. You explicitly have to decide on an unweighted compilation whilst creating a report It is to be noted that this type of calculation removes the possibility to ade quately undertake further processing in statistics programs Because with weighted compilations each survey counts as 1 regardless of how many questionnaires have been processed for it Mathematically expressed You add the respective averages of the questions and divide these by the number of the surveys reports that you are summarizing in the example above therefore by 2 Since the questionnaire comparison represents a very important option whose possibili ties can facilitate your work this is outlined more precisely in the following Options during Report Creation Questionnaire Comparison There are often cases in which it becomes necessary to modify an existing questionnaire You have been evaluating with one questionnaire for three years The computer center would like to use the general evaluation and to integrate a question to your questionnaire regarding the equipment of the computer rooms Or you have been evaluating with one questionnaire for three years and now the corpo rate identity of your university changes vastly This also affects names such as Technical University of Sample City which is renamed in University of Applied Sciences Sample City Furthermore the subunits and graduation titles now carry other names for exam ple
16. e After conducting the survey open the general PDF Report to initiate the creation of the PDF Reports for the single module courses In the following chapters the conduction of the single steps will be discussed in detail 7 2 Activating module surveys The module evaluation is activated by default You can change the activation of the mod ule evaluation by logging in as administrator and opening the menu System Settings Class Climate Settings Now select the area Central Evaluation and scroll down You 370 Scantron Corporation Copyright Electric Paper GmbH mate C Class Climate cle Evaluation will find the option Module Evaluation Activate or deactivate the Module Evaluation and save the changes by clicking Save at the bottom of the page Module Evaluation Activated Activates the possibility to evaluate modules Figure 436 Activate Module Evaluation 7 3 Creating Module Questionnaires and Linking Them to Course Types Module questionnaires consist of multiple components which are used to display general questions about the module itself or special questions related to single courses or course elements in the module For each of the building bricks of a module survey individual questionnaires need to be created using the VividForms Editor e g one for general questions one for lectures one for seminars etc for further information on creating a questionnaire with th
17. AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 2 The Editor Control You can access all functions pertaining to questionnaire creation in the menu panel on the left The following table gives you an overview of each individual menu and its func tions By clicking on a menu name it can be opened and closed By clicking on the pad lock icon the anchoring of the editor control panel to the top of the page is released so that if required it can scroll down with the questionnaire Add Question group Opens the dialog to create a new question group Question Opens the dialog to create a new question Pole Labels Adds the pole labels defined under form properties Extended Pole Labels Opens the dialog to add vertical pole labels Line Space Adds an empty line Separator Adds a horizontal separator Text Box Opens the dialog to create a text box Picture Opens the dialog to add a picture from the library Page Break Adds a page break Edit Edit Question Group Opens the properties dialog of the selected question group Edit Question Opens the properties dialog of the selected question Edit Pole Labels Opens the properties dialog of the pole labels Extended Pole Labels Opens the properties dialog of the vertical pole labels Edit Text Box Opens the properties dialog of the selected text box Picture Opens the properties dialog of the marked picture Clipboard Undo Ctrl Z
18. COURSE EVALUATION FEEDBACK SYSTEM ticipant data is to be imported into Class Climate it makes sense to create and import the CSV import file for survey participant data and CSV XML files for subunits user accounts and courses simultaneously There is also the possibility for you to import participant data in the details of a course To do this click on the green pencil in the course list P Courses of Philipp Belmore __________ Economics EngineenngiComputer Na 4 continuous Seminar Sem03 7 engish Central Campus Economics Engineering NA 2 continuous Seminar Sem 02 5 EJ Central Campus Economics EngineeringlC hi a Media amp informati ConomicsiEngineeringlComputer 9 54237 continuous Seminar RP 412 20 ah T orman Figure 170 Course List with the Edit Button Column Actions A window with the properties of the course opens automatically Here you can define also afterwards whether this course should be conducted anonymously or non anony mously To do this click in the area Participants data either on Anonymous survey participants for anonymous surveys or Non anonymous survey participant panel for non anonymous surveys Edit course of Philipp Belmore Course name Managing and maintaining a healthy lifestyle Program of study Economics Engineering Computer Sciences Course ID NA 4 Evaluation penod continuous Course T
19. Documentation Manuals Here a listing all Class Climate manuals is shown e You will find the manual again in PDF format in the index of the Apache folder on the Class Climate server Apache htdocs classclimate doc there you will find the doc ument User _Guide_en_CC However you cannot usually access it directly from the file system rather you should type the path into the browser for example http local host classclimate doc User_Guide_en_CC pdf The path component localhost should be replaced by your server name In relation to clients systems please also 12 Scantron Corporation Copyright Electric Paper GmbH Class Climat note that the path component classclimate is to be supplemented or replaced respectively by the name of the client s installation If need be please consult your system administrator 1 1 2 Further Manuals Apart from the User Guide the following manuals are available e the Manual First Steps with Class Climate which provides an overview of the most important features of your work with Class Climate It is designed as a guide for begin ners and helps you off to a quick and easy start e the feature list What s new in Class Climate which briefly sketches all improvements and technical innovations of the latest software version e the Scanstation Manual which describes the scanning process e the VividForms Reader Manual which describes the
20. Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Red limiting value for performance diagram Defines the lower limiting value in seconds for the red zone of the performance diagram The area beneath is displayed in yellow Maintenance mode The maintenance mode allows technical operations to be carried out without endangering the current utilization Apart from the administrator no user or participant of online sur veys can log into the system Users who are already logged into the system are requested to log out Participants of online surveys can finish the current survey Before starting an update please check if there are users still working in the system Once activated a warning message informs the administrator that the maintenance mode is activated and that users already logged into the system can continue operating A Warning Message The maintenance mode is activated Please bear in mind that users who have already logged into the system may continue operating in the system Please click here to deactivate the maintenance mode Figure 613 Maintenance Mode Activated Warning Message for the Administrator Users who are already logged into the system receive a warning message too and are requested to finish their work and log off the system as soon as possible so that mainte nance operations may be carried out amp Warning Message
21. For this purpose activate in the configuration in the VividForms part the option Allow editing HTML source code in VividForms editor The button Source code appears in the dialogue for text entry and formatting in the VividForms Editor This affects for exam ple the assistant for the creation of question groups as well as questions t Text Wizard Edit Text Left Right Center Adjusted BI ules Thanks for attending the survey and helping us improve the course lt br gt lt span style font style italic gt Your Evaluation Commissioner lt span gt Figure 530 Show the Source Code in the VividForms Editor Click on the button Source code to view and change the text s HTML formatting This way you can insert line breaks with the aid of the tag lt br gt list formatting or table for matting All HTML elements inserted here are then available for online surveys 434 Scantron Corporation Copyright Electric Paper GmbH A i a H thy Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 10 Adding Pictures to a Questionnaire 2 10 1 Upload Pictures to the Picture Library To add pictures to a questionnaire you have to first upload them Please note You can integrate pictures in the image formats JPEG and PNG in the Vivid Forms Editor The JPEG format is especially suitable for photographs Because of losses resulting from
22. Parameters Subunit Professional Development 3 Period WS10 11 TlQuestionnaire train_en Report for the President Download report on all subunits Report for the Dean Professional Development F Download Choose a subunit of the dean to display the report for Peter Brown o fa Report for the Dean of Studies Vare Wie e Download Choose a dean to create the report for ay Figure 379 Additional Reports Generating aggregated Reports Report for the President Report for the President A report on all subunits Figure 380 Additional Reports Report for the President Click on Download to create the PDF document You will then be able to download it shortly Scantron Corporation 327 Copyright Electric Paper GmbH a Your Evaluation Process Tne Phase model C Glass Climate Report for the Dean Report for the Dean Professional Development Y e ownload Choose a subunit of the dean to display the report for Figure 381 Additional Reports Report for the Dean Select the subunit For the letter accompanying the report the address in the subunit details will be used The dean will be addressed in neutral terms as he or she is not in the system as user Click on Download in order to create the document Report for the Dean of Studies Courses provided by the subunit Professional Development CO Name Instructor COType COID L PE v Human Resource Management Hernandez Semi
23. Questions of this quality guideline Based on means The instructor handles the technical equipment 20 oi E video projector etc without any problems Delete Figure 408 Definition of a Quality Guideline When the question The course perfectly prepares me for my professional life reaches a mean of 3 53 in a survey a green traffic light symbol indicates that the target value gt 3 22 has been reached 348 Scantron Corporation Copyright Electric Paper GmbH X Class Climate oua The instructor handles the technical equipment video A io ok ad W n projector etc without any problems pl Figure 409 Traffic Light in a PDF Report Lower Threshold Va ue Upper Thresholo Va ue aE ting Mean Quality absolute Quality Ce o o a o a 100 SOOM 0 22 fy OC Oo A rye O E LD J Cy 6 GC CIC nee E aE CIC MD o 5 0 o MD MO PIR ay NIO NALINI OW OW Ol O x olol gt Ol O Ol O D J D J D J D J Table 17 Example Calculation of Quality Guidelines when Higher Values Are Better The values in the top half shaded yellow are the values from the quality guideline that you set individually when creating the guideline For each quality guideline you set the weighting in relation to the overall quality index QG 1 25 You can then assign any number of scaled questions to each quality guideline QG 1 two questions For these questions you also define a lower and upper threshold v
24. Scantron Corporation 405 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Using the arrow symbols e Up and F Down in the menu Move you can move entire chapters up or down To move a chapter one page forwards or backwards use the Copy Ctrl C IB and Paste Ctrl V C2 function in the menu Clipboard 2 6 Adding and Editing Questions Should you wish to add a question to your questionnaire choose the option Add ques tion in the Editor Control Please note You cannot add questions without first having cre ated a question group In a question group single questions can be moved up or down by using either the arrow symbols b and in the menu Move or by drag and drop i e by right clicking on the question and dragging it to the desired position To move a question to another question group you may either use drag and drop or the cut gt and paste C2 function in the menu Move 2 6 1 Overview on the Question Types Scaled Questions Linear scales have up to 11 options In addition to the question text there are two texts at the scale poles Scaled questions can be grouped and averaged to indicators Scaled questions are also available for generating cross tabulations When needed a no opin ion field can be added The instructor explains even complex topics in a i com
25. Sex male or female First name Surname Name of survey Number of returns for survey Name of the Survey Period Name of the questionnaire Name of the dimensions question groups Name of subunit User s address Course name Course identification Course s program of studies Course s room location Number of course participants Course type Course s user defined fields X 1 to 5 Current date Date of survey creation Last capture date paper Scan date Online last return 493 System Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM SEC TITLE_X ISEC_FIRSTNAME_ Xj ISEC_SURNAME_X ENROLLMENT _ RESPONSE RATE ISURVEY_QUALITYINDEX Title first and surname of secondary instructor X must be an integer percental response on the basis of the study course participants Overall quality of a survey as stated in the QM Views e g 77 Special placeholders for online surveys SERVER_DIR SURVEY IPSWD SERVER DIRECT ONLINE_LINK TIMESTAMP PARTICIPANT_EMAIL PSWD_COUNT DISTRIBUTED_PSWD COUNT DISTRIBUTED RESPONSE _ RATE OVERALL _RESPONSE RATE 494 User entry point Example http classclimate university samplecity edu Name of survey Example Introduction to Example Science A PSWD for online survey participants Example X5FU3 URL for online survey participants Example http classclimate university s
26. You can delete the files that you do no longer need via the system cleaning For this pur pose you have to define a period to erase dispensable data You can delete the following elements 1 11 1 PSWDs When you choose a period and click on the button Delete PSWDs you delete all the PSWDs of the chosen period which have not been used by that time Please note You cannot delete PSWDs of open surveys here The deletion will only con cern surveys that have already been closed Delete PSWDs Please select the period WS11 12 0 a 5511 17 WS10 11 0 n S510 0 Delete PSWDs WS09 10 0 Reg a 15507 54 WS06 07 50 In brackets Combined deletable PSWDs 121 Figure 594 System Cleaning 1 11 2 Deliveries As regards the deletion of PSWDs you can delete all deliveries for a chosen period The deliveries you can see in the menu Subunits on the left hand in the menu Central Eval uation 1 11 3 Entries in the Log Book The log book records messages warnings and failures of the system for detailed infor mation see below When choosing a period you can also delete those elements here 1 11 4 Delete Compilations and Subgroup Reports You can delete the compilations and subgroup reports of the chosen periods here i e the data the system uses to create the reports of the report creator When clicking on the button Show reports a new window opens There you can define the reports you do n
27. Your Evaluation Process The Phase Model h Class Climate COURSE EVALUATION FEEDBACK SYSTEM Do you want to move or to copy the course which is linked to the survey Leadership Development E Copy course Move course Assign Cancel Figure 100 Selection Window Copy or Move the Course Click on Assign to complete the procedure If there are several surveys for one course the course will always be automatically cop ied since it has to remain with the original instructor for the assignment to other surveys Editing Displaying Notes The notes function supports the communication between the different user roles in Class Climate A user can link a memo with a survey Notes always refer therefore to a partic ular survey and their history is accessible to all users All notes can be edited or deleted by the authors at any time This function is particularly useful in regard to the QM screens The instructors can thus comment on the determined results Deans or department heads can then inspect these notes as well as add their own To add a note to a survey call up the survey details through a click on the survey name Click on Edit Show notes Actions Show PSWDs in browser 3 Receive PSWDs by email _ Send PSWDs by email to respondents JJ Download PSWDs in CSV File Generate more PSWDs 0 OK Number of participants for calculating response rate Preview online survey Scheduled Tasks
28. after selecting the date and time With a click on a help function for the calendar is displayed Using the arrow you can change the year and month Then select a day and in the line beneath a time The time is increased by 1 hour minute with each mouse click By pressing Shift and making a click the time is decreased by 1 hour minute For a faster selection press and hold the mouse button and move the mouse to the left decreas ing time or to the right increasing time e Overview of Time Scheduled Online Surveys 142 Scantron Corporation Copyright Electric Paper GmbH T Class Climate COURSE EVALUATION FEEDBACK SYSTEM Scheduled Tasks Phase 2 Implementation of Surveys 1 Subunit 2 Survey Period 3 Questionnaire Engineering Sst E Quest 01 A Professional Development WS09 10 Show s507 Survey Instructor Start date Task Status Actions Leadership Development 06 23 2011 at 23 10 00 PSWD to respondents Open 7G G Carlos Hernandez 06 30 2011 at 14 48 00 Online survey reminder Open 7 Q G Quest_01 SS11 07 07 2011 at 14 48 00 Finish survey Open 7G G Human Resource Management PSWD to respondents Deactivated 7 C Philipp Belmore Online survey reminder Deactivated 2 CS C 2 Quest_01 SS11 Finish survey Deactivated GG Management Strategies 06 23 2011 at 23 10 00 PSWD to respondents Open 7 OG Philipp Belmore 06 30 2011 at 14 48 00 Online survey reminder Open JZ OG Quest_01 311 07 07 20
29. at Name co ated Class Climate Admin aje A mame ee aR TEE aera OA Elizabeth Doe Subunit Administrator 03 25 2009 A O a amp Prof Dr Adam Smith 2 10 10 822008 tig a oO Select all L Move selected to Chemistry vw move is Business Stucke cme Create New User 4 reate New User Fhe tan iY Computer Seient om Econoannes A Geoscience 9 TEI PA Linguistics Impor instructors from CSV ON Mathematics File CSV file contains a column with information whether the course has e Ph Musics secondary instructors mm Physis ki Scanstation Dem th Sothware Train hji Subunits Figure 34 Manually Creating User Accounts By clicking on the name of a subunit you reach the list of users All existing users are listed here New users can be added via the Create New User button A three step wizard opens facilitating the creation of a user account In the first step the user type is defined The following user types are available e Instructor e Dean of Studies e Dean Manager e Module e Report Creator e Data Entry Assistant e Verifier e Subunit Administrator In the third and fourth step the user data is deposited as well as the user rights being defined The most important details are shown in the table below 58 Scantron Corporation Copyright Electric Paper GmbH C N Class Climate COURSE 3S all mat SYSTEM Column Title 1 Title 2 First Name Surnam
30. e the English report for the quality of teaching and e the German report for the quality of teaching Below these options you have the possibility to export the raw data into the formats of SPSS and CSV Scantron Corporation 311 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM 7 1 tax Results in HTML format Results in PDF format individual report English Raw data in CSV format Figure 356 Report Creator Detailed View Export Raw Data The option Profile line allows you to have the profile lines of this report displayed sepa rately Maria Report Prof Development W310 11 Profile Compilation Prof Development WS10 11 T l The instructor is always well prepared i av 3 7 The instructor explains even complex topics ina comprehensible way iii H av 3 6 The instructor handles the technical equipment video projector etc ff av 3 7 without any problems Please grade the instructor for this course poor _ __ very good av 3 8 The lead time of the course is adequate Strongly dis strongly agree av 3 4 agree The course focuses on the current professional discussion Strongly dis pt bw ff Strongly agree av n3 6 agree i Figure 357 Report Creator Detailed View Profile Line of the Report Furthermore Class Climate can add a further profile line which you can select
31. i Class Climat Secondly when creating a survey you of course receive a particular questionnaire which you pass on to the respondents As soon as you create a paper survey a copy of the sample questionnaire is created and the variable areas of the questionnaire for this survey are filled hard copy proce dure If you do not wish to receive a new print template for each survey the questionnaire s blank version can also be used cover sheet procedure In this case the personaliz able areas of the questionnaire remain blank only the barcode area contains informa tion on which questionnaire it relates to However in this case you must use a cover sheet which is automatically created for each cover sheet survey when you send out surveys This cover sheet contains all further details of a particular survey course instructor etc and has to be scanned in along with the respective questionnaire batch as the cover sheet functions as a refer ence to the relevant survey during processing In the case of VividForms questionnaires online surveys are only possible as HTML surveys here you do not need a personalized PDF file However you do of course require the sample PDF When creating an online survey the HTML questionnaire is automatically created in accordance with the layout of your questionnaire your PDF template Of course you have the option of changing the layout of the online survey using online survey templates
32. il rs Ahh Ra Phase 1 Preparation of a Survey Period Data Import Administrator SE TEE MEEA Load XML File Browse Ed Overview Note You can find the CSV import for instructors in the appropriate subunit fr Business Studie A Chemistry Hy Computer Scient i Econcmacs l fi Geoscience Number of existing ey Linguists Survey participants in 0 Data sets found ay hiathennatics the system ti Musics Import survey O import courses with multiple course IDs es Dem Export existing e eee survey participants Eon Sotware Traini as a CSW file m sane n ie sai Delete participant data eee me Tree Structure Generate Surveys w Depli Surveys wl Detete Surveys GS instructor s Optional Questions Batch Events GE Display Courses Scheduled Tasks Data import amp Batch Export Figure 60 Menu Data Import The administration of survey participants is in the bottom section of the window The number of participant data sets currently in the system is shown in the top line of the table With the button Browse in the section Import survey participant data an already prepared CSV file can be selected and uploaded with the button Import The partici pants data is now automatically assigned to the course that is linked to the course ID A CSV list of all participant data sets in the system can be opened with the button Export in the section Export existing surv
33. mer 3 Figure 210 Barcode and OMR Recognition Interpretation Rules for Automation In the interest of maximizing automation there are decision rules to handle exceptional cases which would normally require user interaction via VividForms WebVerifier These are lf more than one check has been made where only one is permitted then the check will be interpreted as a NO OPINION lf a check was detected but is under the threshold e g because the box was uninten tionally marked then it is considered a no opinion Even if you were to view questionnaires by sight it would not always be possible to deter mine in every case where two checkmarks were made which was intended as the correct response by the respondent 4 2 2 Processing in VividForms Reader Processing with VividForms Reader is explained in the manual VividForms Reader Scantron Corporation 209 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model 4 3 l m Class Climate COURSE EVALUATION FEEDBACK SYSTEM Correction of Checkboxes Not Clearly Read The Verification The verification is used in order to correct checkboxes that have not been clearly read In order to use the WebVerifier as an administrator or subunit administrator change to the role of Verifier Alternatively a separate user role of the user type Verifier can be created This has the advantage of allowing the task to be delegated to other persons
34. thy Class Climate Subunits Questionnaires SAL CREE CEL PEL SPIRE Online Template Management p Customized Online Survey Templates o Class Climate Admin oD Basic template me Admnstrat at F ejo i 7 Administrator 3 Demo Class Climate Online Survey Template Class Climate Admin 6 High Contrast Class Climate Online Survey Template Class Climate Admin instruments 4 Webinarlest Class Climate Online Survey Template Class Climate Admin Ej Test Templates F Documents Create new customized online survey template w Report Settings E is rycen Tacs i ae Online Survey Templates Figure 135 Menu Online Survey Templates In the properties dialogue of a subunit you can select one of the online survey templates available and thus individually define the layout of this subunit s online surveys Subunit details Subunit Name Business Studies Dept No 2 Logo File system logo Edit Phone Fax Street Address ZIP Code City Email Figure 136 Linking the Online Survey Template with a Subunit Select an option from the list next to Online survey template As well as this an individ ual addition to the online survey s web server address can be defined for the subunit Creating a Customized Online Survey Template To create a so called customized online survey template open the menu Online Tem plates in the main menu System Settings The
35. will be used Figure 72 Define a Password in the System Settings Subunits Select a subunit for which the questionnaire should be available Course Type Select one or more different types of course for which the questionnaire is permitted Period Give the periods for which the questionnaire can be used 2 4 3 Multiple Languages For online surveys you can assign several languages to one form in Class Climate By this means Class Climate allows you to create forms conduct surveys and present results in reports in a number of languages A questionnaire already integrated into Class Climate can be adapted to a new language any time you like The language of the first version is automatically defined as the main language To define a language select the option Languages from the drop down list in the Details view of a questionnaire 98 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Ww PDF Sample Show f In the recognition set of the VividForms Reader Refresh mM Advanced settings Languages Figure 73 Add Languages to a Questionnaire For the main language and any subsequent language you can make the following set tings Properties Language English Here N IZ Current logo na Please choose a flag Language Picture Upload the file Linked System Lanquage Linked language set Enable Language Please no
36. A click on the top option opens the window for the Text templates whose screen resem bles the one for global text templates Editing of email and template texts of questionnaire Quest_01 Action PDF template OTA REMITE UMITE Survey pal mipanr E MAIL Results of a survey EMAIL FornvPSW0Ds to the instructor Instructor s Optional Questions No PDF template defined LETTER Report for the president LETTER Results for instructors LETTER Summarized results for deans LETTER Summarized results for study deans LETTER PDF REPORT Address field Norming PDF renort Intraduction zii Attach Language English Higher Education Sample Letter a OK Figure 239 PDF Letter Modifying Text Templates for a Specific Questionnaire Template View 111 However all templates that you upload here and all texts that you change here are only used for the reports that are associated with this questionnaire s survey This way you can design the letter according to your particular requirements lf you do not need an accompanying letter you can switch it off For this purpose just deactivate the option Generate Letter in the configuration of the corresponding PDF report in the menu System Settings Report Settings Configuration PDF Report Header The evaluation report is introduced by the header of the PDF report The head contains some identification data on the current survey Scan
37. COURSE EVALUATION FEEDBACK SYSTEM 1 Actions Display Surveys Generate Surveys O Delete Surveys tion m A Subunits Engineering E M Professional Development Additional filters v Economics Course Type v Central Campus Philipp Belmore Carlos Hernandez v Media amp information Center Philipp Belmore Carlos Hernandez _ O Engineering _ Computer Sciences Show instructors Social Sciences _ Psychology SERE _ _Data Entry Demo Subunit NEA Managing and maintaining a healthy Kfestyie rr Verifier Demo Subunit 47 Organization and Management 48 Human Resource Management bh Leadership bevewoomeni Paper survey Online Hard Copy Procedure O Online Survey Cover Sheet Procedure __Use Time Control survey Web Verification Figure 117 Tree Structure Generating Surveys The survey is created and you will be automatically redirected to the survey list amp Professional Development Philipp Belmore 2 ssi gt Management Strategies NA_2 in Progress amp Professional Development Carlos Hernandez f 5 ss11 1e ita ESSN a SS SSR ERRAT 2 Leadership Development 02 P1234 In Progress O S train_en Qu EEN aite PER Figure 118 Tree Structure Redirection to the Survey List 134 Scantron Corporation Copyright Electric Paper GmbH oN ao Class Climate Phase 2 Imple
38. Designer wW PDF Sample Show wW PDF paper survey Show 6 In the recognition set of the VividForms Reader Add Preview online survey Advanced settings j m Questionnaire Edit Form Delete Edt ER Ft sa x Text Templates x Figure 566 Exporting a Questionnaire A new dialog containing the settings for the export of forms opens Here you can select which additional properties of the form are to be exported beyond the standard properties questions open text images formats etc Settings for the export of forms E By default the export contains all question types texts and settings made in the VividForms Editor Please select the items to be additionally exported v Quality Guidelines 4 Data export configuration Norming V PDF Reports Y Text Templates v Report for comparison Vv Languages V Filter settings v Validation Free indicators Required questions Cross tabulations Note Information linked to further data in this stem cannot be exported This would be the case for reports for comparison Export Cance Figure 567 Settings for the Export of Forms The following items can be additionally exported e Quality Guidelines e Data export configuration 458 Scantron Corporation Copyright Electric Paper GmbH thy Class Climate Editing and Passing on Questionnaires COURSE EVALUATION FEEDBACK SYSTEM e Norming e PDF Repo
39. Figure 386 Profile Line Comparison Example of a Profile Line Comparison with two Previous Periods Please note that you define these settings per questionnaire as an administrator as well as a subunit administrator Profile Line Comparison in the PDF Report Add Report for Comparison As well as defining previous periods for the profile line comparison you can also define comparative reports Again in the questionnaire details select in the area Advanced Settings the option Report for comparison and click on Edit In the following window under Define report for comparison you can define which report should be used for the comparison Scantron Corporation 331 Copyright Electric Paper GmbH lass Climate Define report for comparison Survey Period Subunit Available reports Belmore WS 10 11 WS06 07 Figure 387 Profile Line Comparison Define Report for Comparison in the Details of a Question naire Administrator Under Available reports you will find all reports which are based on the current ques tionnaire and which you have already created in the report creator window In order to display the profile lines of a comparative report in the standard PDF report you must have previously created reports for this questionnaire in the report creator Let us assume for example you have created period reports of your individual subunits as report creator for example P
40. In this chapter you will find out about the questionnaires purpose in Class Climate and how to administrate them however it does not supply information on how to create them 2 4 1 Essential Information on the Questionnaire Questionnaires are the basis of every survey They contain various types of questions and in turn provide different types of information such as information on the respondent such as age and information on the quality of the object in question Such as the instruc tors expertise Questionnaires can be created by e The administrator He uses questionnaires for central evaluations and makes them available to active instructors If a questionnaire is defined as a template it can addi tionally be modified by active instructors e Subunit administrators They too can use them for surveys and make them available to the instructors of their subunit s Also the subunit administrator can create tem plates e Active instructors Once they have been granted authorization to access the Vivid Forms Editor resp Designer they can create questionnaires however they cannot create templates Such a questionnaire created in Class Climate serves as a template in order to create any survey with it If the utilization has not been restricted it can be used system wide for as long as you wish and for all surveys that you consider necessary A questionnaire Is therefore media independent You can create paper as
41. Prof Development WS10 11 was selected This comparative report is to be used for all surveys in WS10 11 332 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK SYSTEM for the subunit Prof Development both of which were created with the train en ques tionnaire Define report for comparison survey Period Subunit W505 06 a Computer Sciences a A S506 Economics Available reports Wise l Engineering Prof Development WS10 11 SS07 r wsoov10 Scanstation Demo Subunit 510 _Data Entry Demo Subunit WS10 11 _Systemlogins me 20 Figure 388 Profile Line Comparison Definition of the Report for Comparison the Survey Period and the Subunit Save your input by clicking the Add button As you can see in the following graphic your settings are automatically added Define report for comparison survey Period Subunit wsos 08 al Computer Sciences a i 5506 Economics Availalte reports WS06 07 _ Engineering 4 Prof Development WS10 11 5507 Scanstation Demo Subunit 7 wWS09 10 _Data Entry Demo Subunit 5510 _Systemiogins CS verifier Demo Subunit z Back m Prof Development WS10 11 Periods WS10 11 Professional Development Figure 389 Profile Line Comparison Report for Comparison was created successfully If you now access the PDF rep
42. Should the variables not comply with the above mentioned rules an error message will appear After your changes have been successfully adopted click at the end of the window on Close to exit the export configuration The example questionnaire just processed Sampl1 shows for example in the raw data export via CSV the following result SPSS is also possible Sheet Gender Age Age Grade Term 1 1 6 75 2 9 8 2 0 4 88 1 3 4 3 1 1 61 2 2 6 4 1 3 38 2 7 3 Figure 395 CSV Export of the Raw Data with Changed Names of Variables and Export Values The variables changed by you and the export values are displayed In the second col umn instead of the usual variable description V1_A the newly defined variable name 338 Scantron Corporation Copyright Electric Paper GmbH Class Climate oual learned is displayed Also the newly defined export value 0 4 in the area Impact is displayed here instead of the usual export values 1 5 6 Phase 5 Quality Management 6 1 Norms In Class Climate you can add norm values for questionnaires Thus you can more easily compare and interpret results from surveys which are based on this questionnaire If norms have been defined for the corresponding questionnaire and if they have been activated in the PDF report settings menu System Settings Report Settings Configura tion Show norm values an overview over the values of the indicators with the cor
43. The administrator has activated the maintenance mode Please finish your work as soon as possible and log off the system There will be maintenance operations running within a short time Figure 614 Maintenance Mode Activated Warning Message for Active Users Participants of online surveys who are already logged in may finish their questionnaire New participants cannot log in They also receive a warning message 528 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM The system is currently undergoing important maintenance Please be patient You will be able to participate in online surveys shortly Back Figure 615 Maintenance Mode Activated Warning Message for Online Survey Participants With the aid of the user statistics Users logged in Online surveys the administrator can oversee which and how many users are still logged into the system As soon as the last user has logged off maintenance operations can be started On completion the mainte nance mode may be deactivated Note By activating the maintenance mode the VividForms Reader is not automatically stopped Before installing an update please ensure that no forms are being processed and if necessary terminate the VividForms Reader Automatic update check This option determines the interval at which the system searches for automatic updates after the
44. The line space can be selected moved and modified using the clipboard functions Cut Copy and U Paste 2 9 2 Separator The separator allows the optical separation of questionnaire content and can be added freely inside question groups Open the menu Add in the Editor control and select Separator A horizontal line will be added below the active object Please grade the instructor for this course por OO 0 0 OC very good O abst Please give us your feedback about the instructor as well as suggestions for improvement Figure 526 Separator in the Editor Preview The separator can be selected moved and modified using the clipboard functions F Cut Copy and Paste 2 9 3 Text To add a text area open the menu Add and select Text A dialog box appears which contains a text box Type in the desired text or paste content from another text editing tool into this edit box Scantron Corporation 431 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Alignment options are available to align the text box content to the left right center or as justified text Click on Apply to create the text area Please give us your feedback about the instructor as well as suggestions for improvement O Note Please do not write outside of the box Figure 527 Text Area in the Editor Preview As with other objects the text area on the q
45. The selection list Request Type provides you with following options e General question You have a question regarding Class Climate e Support inquiry You have a problem with Class Climate and require assistance e Feature request You have a suggestion for improvement or an idea to develop Class Climate Choose one of these query types and then enter the appropriate category under Mod ule In the fields Subject lines and Your message you can type your message Below the message area you can add up to three attachments Click on Browse select one file and click on Add The attachment should not be larger than 1 MB After another click on Next a summary of your message will appear Some pieces of information about your Class Climate will be included such as the version number Then click on Send email to send the email Scantron Corporation 15 Copyright Electric Paper GmbH Class Climate 2 The Basics For orientation purposes and as a glossary this chapter outlines the most important ter minology and concepts which are used repeatedly throughout the Class Climate Manual Initially you can learn how Class Climate is structured and which components you will be working with Then as central evaluation and the de central evaluation stem from two fundamentally different concepts these concepts are also introduced At the end of the chapter you will be acquainted with some basic term
46. View and Copy k s Edit Delete and Create new Table 4 Question Library Access Rights As seen in the overview an administrator can access and edit public and non public questions of other administrators as well as the public questions of subunit administrators and create new question groups and questions A subunit administrator who has the right to create public questions can edit the public and non public question group s of other subunit administrators and also create new ele ments here however he only has viewing rights for other subunits A subunit administrator who does not have the right to create public questions cannot edit the public or non public questions of other subunit administrators in his subunit he only has viewing rights The right to input public questions in the library can be given in the user properties of the subunit administrator By default subunit administrators do not have the right to create public questions The active user only has viewing rights and cannot input public questions into the library He can however copy question groups and questions from public libraries into his own library and edit them there Import and Export The import into the question library as well as the export from it is achieved via a CSV file An example file for the import is included in the system System Information Sample files Question library Scantron Corporation 105 Copyright Electric Paper GmbH
47. aana aaa 26 System SummMary 0000 cee eee 461 System Security CAPTCHA lt tneya cass tee eee tamed eases Gee euee 28 T Table configurations 00 cee eee 366 Templates Defined by the administrator 452 Defining general templates 452 Online SurveyS 0 0 eee ee eee ee 151 PDF templates 0 000 c eee ee 500 Template for letter in PDF reports 485 489 Templates for email messages 486 TEX 24 sc nchs edte eh ete s 684k eee eee etek 484 Text templates aaa ee 32 Use of templates in instructor accounts 454 Terminology 0 0 ccc eee 24 TOXU Gee eeeh east ease ea seeeee dae k eee ae 431 Text templates 0 0 00 cee ee 32 484 Tree structure 2 1 eee 129 DENNE sca eedan oe OM BOE oe ee e on aso oe oe 129 Delete SurveyS 0 cc eee eee 135 Display SurveyS 0 0 0 eee ee 132 Generate SUrveyS 0 00 cee eee ee 133 U Update Notification 0 0 eee ee 29 536 Class Climate COURSE EVALUATION FEEDBACK SYSTEM User accounts Generating user accounts 00005 50 Managing user accounts 00000 ee 50 User Guide 2444 lt 1465 656 6456 44054045 o bee sews 12 User role The user role of the report creator 268 Utilization statistics 0 0 0 00 eee 469 V Validation 0 0 00 ee eee 91 447 449 Verific
48. mate When importing the question library as a CSV file the following structure must be adhered to Column 1 Column 2 umn olumn olumn 4 olumn olumn ee eLA S Number o oe sxxx ADSten Group Title ype _loptions Question text Left pole Right polen oye Table 5 Structure of Question Library CSV File The question types are assigned numbers the following schema is valid 0 Scaled Question 2 Open Question 4 Grade Value Question 6 Single Choice Question with up to 11 answer options answer options located next to the question text all answer options are displayed in the report 8 Multiple Choice Question 10 Single Choice Question with any number of answer options answer options located beneath the question text only selected answer options are displayed in the report 14 Matrix Field Question Note Please note that for scaled questions neither mirroring nor dual scale functions can be imported or exported Number of options In scaled questions the number of checkboxes is stored here In grade value questions and open questions this field remains empty In single choice and multiple choice questions the number of response options is recorded In matrix field questions the number of groups in the PDF report is recorded here Left pole In scaled questions the left pole description is recorded here In open ques tions you can enter the number of lines available to
49. of course dependent of the content of the letter and the corresponding fields Please see chapter B 4 5 1 Components of the PDF Report for more information about the layout of the PDF template 3 2 Defining Access Rights In addition to access rules which can be set up by your local computing center Class Cli mate allows you to determine access rights for three groups e Administrators e Users activated instructor accounts data entry assistants report creators etc e Participants in online surveys 32 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM You can define valid IP address ranges for each of these user groups under System Set tings Class Climate Settings System Security For this the first and last valid address range is entered respectively Restricted access Activates deactivates the restriction of access When activated the Activated Class Climate server checks the IP address of each inquiring computer for the following IP address domains m Begin IP address domain participant online survey 0 50 0 0 First permitted IP address for participants in an online survey m End IP address domain participants online survey 255 255 1255 255 Last permitted IP address for participants in an online survey m Begin IP address domain user 0 0 0 0 First permitted IP address for users End IP address do
50. Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM reports Activate the control box additional report recipients Secondary instructors in this course in the relevant course at subunits and add the individuals from the list Edit course of Dr Richelle White Course name Introduction into Sociology Program of study Course ID 02 P1246 Evaluation period continuous X Course Type Lecture m Location R P 061 Enrollment 80 Participants data Anonymous survey participants O Non anonymous survey participants panel Language english Ey Further report recipients secondary instructors Vv existing Computer Sciences Donna Harwood Professional Development Donna Harwood 0K Seance Figure 43 Definition of Secondary Instructors A Import instructors from CSV File CSV file contains a column with information whether the course has secondary instructors Figure 44 Activating of Secondary Instructors During the Import Expanding the Course Data with User Specific Fields You can expand the existing course information by a number of fields in order to describe them better These fields can be defined at Class Climate Settings Course User Data Fields Scantron Corporation 67 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Select at number of additional fields how many in
51. Forms Designer manual If interested in acquiring a license please contact your cus tomer service agent To start the VividForms Editor click with the left mouse button on the questionnaire graphic under the heading VividForms Editor The Editor opens directly in the browser window and you can begin creating a questionnaire 386 Scantron Corporation Copyright Electric Paper GmbH Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 Creating a Questionnaire in the VividForms Editor 2 1 Define Form Information After starting the Editor a form creation wizard opens Some fundamental information regarding the questionnaire must be deposited here W Form Wizard Form creation information Abbreviation Sample_01 Title BIU a Sample Questionnaire Paper Letter Template Activate deactivate template mode New items can only be added at the end Max Pages 2 Max Items _Appiy l Cancel Figure 457 Define Form Information e Short Name A five to ten digit short name which may only exist once in the system It must not contain any spaces e Heading A longer text describing the questionnaire This appears in the header of the question naire e Paper Choose between the paper formats A4 letter and legal Click on Apply Now the questionnaire is created It contains a header and the editing bar can be used The preview mode
52. If the administrator has given the authorization a click on the symbol 4 allows the user to begin editing the questionnaire Questions from the administrator s template appear in the Web editor with a T Template and cannot be deleted or edited The user can add as many question groups and questions as needed as long as he does not exceed the maximum number of pages or the maximum number of questions defined by the administrator see form properties of the questionnaire Before adding a question to the questionnaire the user first has to create a new question group Questions cannot be added to groups already created by the administrator When setting the form proper ties the administrator can define that new elements added by users such as question groups questions or design elements may only be inserted at the end of the question naire 24 would recommend this course to my friends Tl StrongyO O OF 0O OStrongly Disagree Agree 3 Individual Questions 3 1 How would you rate the instructor s overall teaching methods ExcellentO 0 OF 0 OPoor Figure 562 Added Question by the Instructor 7 Editing and Passing on Questionnaires To show the content of a questionnaire click Editing in the Drop Down Menu on the right hand in the list of questionnaires Please note You can edit a questionnaire only as long as you have not activated them When surveys are created for a questionnaire the questionnaire is automatically pro
53. In the drop down menu in the area Advanced settings select the option Languages and click on Edit If you have not yet defined a language you first have to define the questionnaire s stan dard language The following figure shows that the language set English is linked with the system lan guage English here the main language and the language set English Properties You have to define the properties of the existing language main language first Language English PS LZ Aus Please choose a flag Choose Current logo Language Picture Upload the file Soka Sy sea English Higher Education w Language Linked language set English Higher Education Enable Language Vv Please note that VividForms only supports multiple languages for online surveys Sae Back Figure 132 Defining the Questionnaire s Main Language Scantron Corporation 149 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Cl imate COURSE ss Cli FEEDBACK SYSTEM After defining the main language you can add a further language Options Current Language Engish v Delete Language Add Language Figure 133 Adding a further Language As you do with the main language you define their properties and can link your language set with the questionnaire here For example it makes sense to use the language
54. N 1 7 Figure 275 Formula Used to Calculate Cronbach s Alpha where N number of items i e ques tions in question group and r ratio of covariance variance average correlation between items 264 Scantron Corporation Copyright Electric Paper GmbH Class Climate In order to determine 7 the covariance for all possible combinations of questions is cal culated as well as the variance for all questions of the question group The resulting val ues are averaged and the ratio between them is determined in order to calculate the average correlation between the questions in the question group In order to calculate the covariance for each question of the question group the differ ence of the given responses to the respective arithmetic mean is calculated These val ues are multiplied for all possible combinations of questions and their sum divided by n 1 n number of responses L De i 0 5 i Sy Figure 276 Formula for the Calculation of the Covariance The variance corresponds to the sum of the squared differences of the response values to their respective arithmetic mean value divided by n 1 n number of responses SES ee E 5 or a pa ea x Figure 277 Formula for the Calculation of the Variance 5 1 5 Free Indicators In general the question groups containing the questions on the questionnaire form the basis for the calculation of the indicators this means that qu
55. Name of the subunit in which the user profile is located e Logins Number of logins since the user account was created e Scans Number of scanned paper survey questionnaires The number of ques tionnaire sets not the number of pages are counted e eForms Number of completed online questionnaires both the HTML and the PDF based online surveys e Surveys Number of surveys which are in the user account at a given time e Studies Number of folders the owner has e User since Date the account was set up e Last online Date of the last login Scantron Corporation 469 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM system Settings and Management AN Class Climate 1 6 Evaluation Statistics You will find the evaluation statistics in the details of a paper survey where you have scanned in data r Survey Details 2 Survey Organization and Management amp Instructor Carlos Hernandez J Course Organization and Management Survey Period 5511 Type Paper survey cover sheet Questionnaire train_en Status Data available report available Survey Created on 05 16 2011 at 10 20 02 Last data collection On 05 18 2011 at 10 31 32 No of collected questionnaires 3 wa a eS eo Rot a A Actions Survey date ee ee E E wi N Show cover sheet form in browser dil Survey evaluation stati English w Results in HTML format 7 g Cone None selected T ___ Num
56. OM Views No QM Views additional subunits for QM views Online Survey Templates Defined by Administrator No access F Defined by Administrator No access Assign additional Templates only subunits Unrestricted access Scanstaton Demo Subunit Data Entry Demo Subunit Public tems disabled The subunit siminsiaio is not able to add public items to the question library Cancel lt lt Back Next gt Figure 147 Creation of Templates by Subunit Administrators Assignment of Rights Viewing of the Results for Online Survey Participants In comparison to paper surveys implementing comprehensive online surveys offers some organizational advantages But the often lower number of returns poses a signifi cant disadvantage which can only be partly compensated for through motivational mea sures aimed at the survey participants Along with the participants obligation possibly entailing queries regarding the regula tory framework or the quality of resulting data quite often rewarding motivational proce dures are also followed These in turn entail organizational effort Class Climate therefore offers the alternative of survey participants accessing the sur vey results Of course access is granted only to those survey participants who have in fact participated in the survey Scantron Corporation 163 Copyright Electric Paper GmbH COURSE S GH mat SYSTEM Your Evaluation Process The
57. Phone Fax Email Information Cueta iin m atinan ba boiei KAP UA E EGA ERA T Search mathon Statistics Sy SUMMA Evaluated 121 621 Data entry 3 33 Simma 140 684 Maintenance Figure 584 System Information At first a Summary list of surveys with the following states will display e In Progress Active surveys for which no results data has yet been registered e Evaluated Active surveys for which returns have already been registered e Data entry Active surveys for which returns have been registered however for which the anonymization of handwritten comments has not yet been carried out This is only an option when the anonymization in the subunit properties has been activated You can now choose multiple selection course type survey period and form Click on Apply Scantron Corporation 471 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Course Type _ Survey Period Form undefined ta ssi A train 01 a Lecture train 02 Seminar ELEIT een ys rosie rrr ttt ror er Terr Working Group Others train_WB Module General train_WB1 J Module Trainer SS06 VF_DemoE F WS05 06 IVF DemoP 1 a ad 5505 ad XL279XWT il _ Show unused course types at subunits and unused questionnaires in periods Apply Figure 585 Filter for System Information Then tables display for each of the individual subunits which
58. Please bear in mind that Class Climate has originally been designed to ensure accessibility Therefore many requirements have been met for example to guarantee the accessibility of the content for people of all abili ties and disabilities mainly blind or poor sight users Consequently specific functions were created that would help you to create code that makes your online surveys available for all people Scantron Corporation 161 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM lt php abstention fehlen this gt getValue Sname this gt getName Slabel Sthis gt getLabel preapare inputfields and abstention SsAbstention SsInputarea SsLefttPoleText Sthis gt getLeftPole SsRightPoleText Sthis gt getRightPole SshbstentionText Sthis gt getAbstention SsQuestionText Sthis gt getLabel Sq asPoleDefExtended array l SaQOptions this gt getMultiOptions foreach Sa0ptions as SoptionValue gt Ss0ptionCaption Schecked if is null value amp amp value fSoptionValue J f L Schecked checked checked a esOptionname Sname So0ptionValue SsiInput lt input type radio id SsOQptionnmame name name ve SsADA0ptiontext Sthis gt getADAOptiontert SoptionValue SsiInput lt label for SsO0ptionname class hidden gt SsADA0ptiontex switch SoptionVa
59. Raw data in SPSS format Q E Raw data in CSV format Q Figure 300 Report Creator Export Options The summary reports give you unlike the usual automatically produced PDF reports an overview of your evaluated data Because depending on your choice a summary report is generated for a subunit for an instructor for a course of studies etc This report looks just like the automatically produced PDF report yet it provides you with information on the corresponding assessment results of entire subunits etc 280 Scantron Corporation Copyright Electric Paper GmbH A Class Climate Summary Reports an Overview There are four different types of summary reports available to you e Subunit reports e Program of study reports e Reports for particular instructors Instructor profile and e Reports that you can put together as you see fit Any Compilation You see these options as soon as you click on the folder and thus open it Create reports Summarized Reports Subunit Comparisons Batch Profile Lines Figure 301 Report Creator Create Reports The upper drop down menu provides a list of all different tyoes of summary reports The lower drop down menu allows to access the batch profile lines which can be used to compare different reports and surveys with each other The batch profile line dispatch is dealt with in the chapter on summary reports It is not a type of report For the creatio
60. Report Creator Any Compilation Overview of the Selection made and the Question naire Click on Create or first assign the questions correctly Also this report then appears in the list i HTML lt Prof Development WS10 11 Data available train_en 05 18 2011 J046 Q8 cncosepdt repot CSV SPSS G Economics WS10 11 Data available train en 05 18 2011 E046 8 choose pdt repot CSV SPSS Belmore WS 10 11 Data available train_en 05 18 2011 067 choose pdf repot CSVSPSS HTML Report of Train en Data available train_en 05 18 2011 2 241 B choose pdtrepot CSV SPSS Figure 320 Report Creator Any Compilation in the Report List In addition to the selection criteria described so far you have the possibility in Any Com pilation to filter according to the courses properties Meaning you could for example have displayed all courses with less than 15 partici pants and draw your selection from that Or you filter according to the room Or according to the Course ID Scantron Corporation 291 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM And something especially useful you can also filter according to criteria defined by you This is possible if you have created user defined course fields A small reminder If the set fields name Course ID room etc do not suffice for the description of your c
61. ReportOfAll is produced which is a summary of all surveys that have been conducted so far The questionnaires Sample and Sampl1 do not differ considerably from one another and are therefore suitable for such a compilation here the manual compilation is activated Scantron Corporation 289 Copyright Electric Paper GmbH lass Climate Create Any Compilation Report 1 Subunit 2 Survey Period 3 Course Type 4 Questionnaire ma fi a Evatt Non_Anonym Lecture Seminar Working Group Engineering Professional Development _Data Entry Demo Subunit Select program of study __ Show extended filter options Description Report of Train_en Question mapping of different questionnaires Automatic with text comparison Manual 5 Course s TTET C F TENDE DAA Human Resource Management 02 P1237 Management Strategies NA 2 Managing and maintaining a heathy lifestyle NA_1 Include answers to open questions Human Resource Management 02 P1237 Leadership Development 02 P1234 Organization and Management 02 P1236 Tg arow me Data Analysis 01 G1234 nite introducton into Sociology 02 P1246 Psychology 02 P1239 Combine surveys unweighted Please note For this combination the mean values of the single surveys are averaged Figure 317 Report Creator Any Compilation Selection of Elements lf you wish to additionally filter the co
62. Title of 1st 2nd 3rd 4th and 5th additional field Enter the title of the corresponding additional field here 514 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Content of the1st 2nd 3rd 4th and 5th additional field Enter the permitted values for the additional custom field here Separate values using the pipe character CTRL ALT gt 2 5 6 Section Functions Period display Displays the current period Minimal survey number report creator Minimum number of surveys with which a report creator can create a subunit report De central Evaluation Permits immediate deletion of data Defines whether the data of processed surveys can be deleted immediately after the reports have been sent by email activated The setting deactivated hides the corre sponding configuration setting Anonymous saving of deleted surveys Deleted surveys are kept anonymously in a wastebasket so that the report creator can generate an accumulated subunit report Hide bar diagram shadow Hides the bar shadow in PDF reports Hide end of document text Hides text end of document Hide page number end of document Hides page number on last page Batch printing Duplex printing The PDF document contains empty pages for duplex printing e g after the cover sheet Batch printing form printing when using the cover sheet pr
63. Undoes the last action up to 20 in a row Cut Ctrl X Cuts the selected object and adds it to the clipboard Copy Ctrl C Copies the selected object and adds it to the clipboard Paste Ctrl V Adds the contents of the clipboard below the marked object Delete Del Deletes the marked object Move Up Moves the marked object one step up Down Moves the marked object one step down Scantron Corporation Copyright Electric Paper GmbH Editor Control 3 it ie amp amp Add Question Group Add Question Pole Labels Extended Pole Labels Line Space Separator Text Box Picture Page Break Edit Edit Question Group Edit Question Clipboard Undo Ctrl Z Cut Ctrl X Copy Ctrl C Delete Del 389 Creating Questionnaires with VividForms Form Properties Paper View Form properties Opens the properties of the questionnaire Layout settings Opens the layout settings for the form Repair form Recreates the questionnaire Enable numbering Toggles the numbering of questions and question groups Edit Pole Template Opens the dialog for the definition of pole labels Filter settings Validation Required questions Cross tabulations Opens the dialog for the definition of filters validation required questions cross tabulations Change color scheme Opens the dialog for adapting the form s color scheme Picture Library Opens the dialog for adding and removing pictures to from the picture librar
64. a m fa fae m ai gi m M M ai it complements the learning matter ooo ooo itis well structured OOododddao dno Figure 521 Inclined Pole Labels in the Preview of the VividForms Editor Independent of the Degree of Inclination In the following three graphics you can see examples of possible inclinations in the PDF preview It complements the learning matter Guo ou It is well structured d att ER EF 4 Figure 522 Inclined Pole Labels 45 in the PDF Preview It complements the learning matter It is well structured Figure 523 Inclined Pole Labels 65 in the PDF Preview rib Q a v w o v O T D o G aU m a gt lt 2 asg od 5 2 amp O 0 m SS 9v E fF O O It complements the learning matter boo ou Oo ou It is well structured U U U U U U Figure 524 Inclined Pole Labels 90 in the PDF Preview 430 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 9 Adding Graphical Elements 2 9 1 Line Space Using the line space gives extra room between single objects Open the menu Add and select Line Space An empty line will be added below the active object What is your age 148 29 030 39 040 49 050 59 Cl60 69 Colder than 69 How many terms have you been studying so far 1 BP Lia LJ 4 U5 g Figure 525 Line Space in the Editor Preview
65. accenn 252 4 5 5 DOWNLOAD AND SENDING OF REPORTS u cccccccecscecceeseeceeeceecseuescueeueseueeuueeaeeuaeeueueaeeueess 253 5 PHASE 4 ADVANCED REPORTING lt cctivecncdsaicecensewbbiedansienunvunnloaanhaabeed ne aaa aa Ta aa Raa a niia 256 or PA 2 67 TORS aaaea E A EAE A EA EEA EE EE A 257 5 1 1 THE PRINCIPLE OF THE INDICATOR ou cccccecccecececeeececeseuueeueceueceeueeaueeueeeueueeaueeeeeeneeenenees 257 5 1 2 ACTIVATING THE INDICATORS IN THE CONFIGURATION ccccccceecceeseecseeseuueeuesueeeeueaeesueeaes 260 5 1 3 CREATING THE INDICATORS FOR A QUESTIONNAIRE ccccccscecceeseecseeseuuseuesueeeueeeeeeeeueueenes 262 5 1 4 INTERNAL CONSISTENCY OF THE QUESTION GROUP CRONBACH S ALPHA 00csseeeeeees 263 5 1 5 FREE INDICATORS acssaacteesatencieitcananadneda AoE A Ea EE AEEA AEAEE RAN 265 5 2 CREATING REPORTS AND COMPARATIVE PROFILE LINES c cccscecceeseecseeseueeeeceeueeueseuseeaueneenes 268 5 2 1 THE USER ROLE OF THE REPORT CREATOR ccccecceccceseeeseeceuuueuceuuceuueeuueeueeueeeaueuaeenanees 268 5 2 2 CREATING SUMMARY REPORTS o cccceccecsceceuececseeusueeeeueeuceueeeuueuueeuuueuueeaeeueeeuueeaeeaeeeaueuaes 279 5 2 3 DISPATCH OF COMPARATIVE PROFILE LINES cccccccccsecseeceeeseuceueceueeueeeeeeueeeaeeeeeenanees 313 5 24 RESULT PRE POE Sooo siesdscoscancemaeeiarnadeanstietasettevnstrwssant iaa AOA ANE EAEN E aaa aeaa 325 5 2 5 INTEGRATING PROFILE COMPARISON LINES IN THE PDF REPORT c ccecceeseeeee
66. details of a questionnaire menu Advanced Settings Text Templates per question naire In case of using online surveys you have the possibility to permit your participants after closing an online survey to look at the results report with their PSWD HTML Report You can decide if you permit the access to open questions too Advanced Configuration Participants of online surveys who submit their survey can be directed to a specific inter net site Here an optional password can be conveyed which ensures that the page to be accessed can only be reached by those people who have actually taken part in an online survey In this way incentives to increase response rates such as raffling prizes or the like can be implemented without the risk of abuse from unauthorized people To activate questionnaire specific forwarding click on the Edit button The window for questionnaire specific forwarding for online surveys opens automatically 96 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 1 Preparation of a Survey Period COURSE EVALUATION FEEDBACK SYSTEM 2 Advanced configuration train_en_2 Online Design Questionnaire specific forwarding is deactivated the Class Climate Settings apply menu System Settings Class Climate Settings Online Survey Alternative web address for forwarding the participants of online surveys Questionnaire specific forwarding is activated After sending the she
67. it still remains ONE log in so that the members of the staff have to cooperate with one another 2 3 2 Active Instructors Accounts In addition to this central control of the evaluation it is possible to authorize particular users to carry out their own processing independently This means that the administrator as the central body can create active users or use those already in place These subsequently require their user name and password and can log on to the system through the usual Class Climate registration screen Via their user accounts these users can then depending on their type of authorization implement all evaluation steps themselves This applies to e creating questionnaires The administrator assigns the right to create questionnaires per user Hence some users can create surveys however they can only use those questionnaires that are preset by the administrator Others can edit these central questionnaires but cannot create new ones etc e the implementation of paper and online surveys With existing questionnaires active interviewers can create new surveys as they see fit 22 Scantron Corporation Copyright Electric Paper GmbH i Class Climat e the processing of a survey After evaluating the data an active instructor automati cally receives the survey s result which can be edited for example by summarizing it with other reports establishing subgroups based on specific criteria Such as
68. mum amount of pages that can be printed through batch printing of forms The batch printing function enables you to create a large number of personalized cover sheets or questionnaires as PDF files Select 1 the subunit 2 the survey period 3 the course type 4 the questionnaire as well as 5 a multiple choice of courses press Ctrl key Then decide if you want to request one copy of each cover sheet questionnaire or if you want to print questionnaires according to enrollment figures i e according to the number of participants assigned to a course Scantron Corporation 173 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM gt Batch Events Print Cover Sheets Forms Print PDF reports Send Cover Sheets Forms send PDF reports Archive PDF reports and CSV raw data Send PDF reports as instructor profiles Send PSW0Ds to Instructors Hide surveys with documents which have already been sent 1 Subunit 2 Survey Period 3 Course Type 4 Questionnaire Ld s Lecture wWS10M1 Seminar Quest 01 train_en Professional Development l Select program of study 5 Course s Management Strategies Ma Managing and mantaning a heabhy lifestyle NA 1 Carlos Hemandez o Print only master versions of cover sheets and questionnaires gt Create complete sets of questionnaires based on number of partic
69. norm basis mean aan standard deviation _ 1o 100 Normed value Figure 398 Formula for Norming when Higher Values Are Better When lower below average values are better the formula is as follows 340 Scantron Corporation Copyright Electric Paper GmbH X Class Climate N 7 f mean normbasismean Normed value 100 norm basis standard deviation 10 Figure 399 Formula for Norming when Lower Values Are Better Example Calculation when Higher Values Are Better Suppose the indicator i e the overall mean of a question group in a questionnaire is 5 9 and the corresponding value of the indicator for the norm basis is 5 388 Further sup pose the standard deviation of the norm basis is 0 9344 The norm value is then given by the following calculation 2 7 5 9 5 388 wan Normed value He 44 1o 100 Normed value 105 5 Figure 400 Example Calculation oo S Scantron Corporation 341 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM The norm values can be interpreted according to the following table For example a value of 105 5 can be considered as slightly above average compare line 6 Norm value 0 ca 0 1 far below average 0 ia a ih alii lt Table 16 Classification of Norms Mean 100 Standard Deviation 10 4 No 5 3 0 1 6 1 2 Definition of Norm Values for Q
70. such as norms quality guidelines The configuration s respective elements and effects are described in the following For further information please read the relevant chapters in this manual 4 5 1 Components of the PDF Report So as to give you an overview of the elements that you can integrate into this report we will describe them here in the order in which they can appear in the report The report can contain the following components e the letter to the instructor e bar diagrams on the indicators of the questionnaire these if desired with overall indi cator and or Cronbach s Alpha e alegend for the analysis of scaled questions e the individual analysis of the questions appearing on the questionnaire with or with out open questions depending on the settings e maxi histograms on scaled questions e cross tabulations e a profile line that also can be displayed as a normed profile line provided that a norm has been defined e apresentation template containing the indicators e responses to open questions handwritten or typed the latter if it is an online survey or if the data entry assistant was used Scantron Corporation 223 Copyright Electric Paper GmbH n Your Evaluation Process The Phase Model Class Climate e notes of a survey You can display the added notes of the different user types in the PDF report See here chapter B 3 2 3 Survey Details editing displaying notes
71. thoroughly inspected This concerns amongst others the following rules there must be at least one character before the sign and after it too this character must be followed by a dot and at least two characters Umlauts as characters are not allowed After checking Class Climate automatically adopts the email address in the area Details of the participants 72 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy gt Class CI mate Phase 1 Preparation of a Survey Period Details of the participants Course Introduction into Sociology Title First Name Last name Email joe doe example com Address Custom 1 Custom 2 Custom 3 Save Cance Figure 50 Entering the Email Address of Anonymous Participants All other existing fields for example first name and last name are deactivated because this survey is anonymous Although you cannot see this in the graphic If in a similar constellation you try to enter something into Class Climate you will realize that this is not possible Editing the email address in the area Details of the participants is no longer possible If you have entered an email address incorrectly you can click Cancel here and delete it After this you can enter it into the system again of course If your entry is correct click on Save to insert this email address into the course Administrate participants Participants o
72. very good av 5 Figure 251 PDF Report Profile Line 236 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 3 Capture and Instant Feedback The profile line is a dashed line along the averages of scaled questions The average will also be displayed as a numerical value At the end of a survey period two further lines can be drawn for comparative purposes e g the average of the program of study and of the department In order to activate the profile line use the function System Settings Report Settings Configuration Create profile line If desired the profile line can be divided corresponding to question groups and thereby can be displayed in separate sections To do this activate the option System Settings Report Settings Profile line Display question groups Detail Norm Profile Line Normed profile Subunit Frofessional Development Name of the instructor Carlos Hernandez Name of the course Graduate Survey 2011 l Name of the survey u 85 100 115 130 Dimension Norm value The instructor is always well prepared HHH The instructor explains even complex topics in a comprehensible way i l 2 Questions about the 106 instructor The instructor handles the technical equipment video projector etc I without any problems Please grade the instructor for this course The lead time of the course is adequate SS Figure 252
73. 16 Batch export 0 0 cee 467 BAGH VIW sages oes ae eeri Gea ee sou oe 210 C Capture feedback 0 cece ee eee 205 Central evaluation 085 21 111 518 Checkboxes 0 00 0 ees 210 Class Climate settings Configuration 0 0 0 cece ee 504 Class Climate system nananana anaana 16 Scantron Corporation Copyright Electric Paper GmbH Cleaning System cleaning 000 cece eee eens 480 Client operations 0 0 0 0 cee eee 530 Color Scheme 0 0 00 cee eee ees 439 Color scheme 0 00 e eee eee eee 439 Color settings 0 0 00 cee eee 521 Combining multiple criteria 085 300 Comparative profile lines 2 0005 313 Comparison of profile lines 05 329 Compilations Delete compilations 0 00000 eee 480 Components of the PDF report 223 Configuration naaa 0c ee ees 30 Activating the indicators 0005 260 Class Climate settings 0000 eee 504 Color settings 0 c eee eee 521 COO seeiis creeps a he bee be wae eee tee tens 30 Course user data fields 000 514 DOCUMGINS co cekoekoeeu eked eeseseaseea as 30 Email functions amp accounts 00 519 FUNCIONS i 544 e oueeguneeeecameee ener ee 515 General 0 0 0 0c ee eee 506 Instructor accounts 0 0 0 0 0 cece eee 522 Network Settin
74. 16 43 34 1 2 0 0 4 3 2 2 B 37 0 2 0 Selection for automatic vernfication Search for new batches Delete all NonForm batches rs NO valid checkbox found invalid One checkmark and correction s found Figure 212 Verification Batch View 4 3 2 Survey View In this view you will see all of the surveys that still need to be verified Because surveys can be scanned in a number of batches and a VividForms batch can have a number of surveys in it the number of surveys is rarely identical with the number of batches The table is made up out of the following columns e Survey Name of the survey e Form Short name of form e Sheets Number of recognized forms e In progress shows whether other users are already processing the batch e To verify Number of corrections e Cover Sheet Display cover sheets e NonForms Delete all NonForms Display NonForms Scantron Corporation 211 Copyright Electric Paper GmbH E Your Evaluation Process The Phase Model th Class Cl imate COURSE 3S UH FEEDBACK SYSTEM e Verification Process batch Verify automatically Delete batch w Current surveys in Verifier Survey Form Sheets progress v ae Casarea NonFonns Verification Technical Skills Tech_01 6 ch EH ia 2 E ry Verifier Sample Survey train 01 7 3 2 Ei 9 2 H x Selection for automatic verification No valid checkbox found invalid One checkmark and correction s found _ Search for new batc
75. 192 Greeting Screen for Mrs Jasmine Sadhi Detail It is important that the instructor changes his access data in the left menu under Own profile Carlos Hernandez Instructor Carlos Hernandez Instructor surveys survey Folders 2 et iz G Folders Carlos Hernandez Instructor Questionnaires P Ss Questionnaires A Questionnarres A Create Questionnaire 2 Questionnaires Surveys Templates 2 Templates VP Verification WP Verification Folders Figure 193 Access Options to the Questionnaire Editor to Templates or No Access Scantron Corporation 197 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy AN Class CI mate COURSE 3S GH mat SYSTEM 3 3 3 Generating and Editing Questionnaires If an instructor wants to create questionnaires he works with the VividForms Editor resp if licensed with the VividForms Designer just as the administrator does For this pur pose he clicks Create Questionnaire in the left context menu and selects the option VividForms Editor or VividForms Designer To become acquainted with the Vivid Forms Editor the corresponding manual Creating Questionnaires with the VividForms Editor is available in the active user s account area Information The VividForms Designer Manual can be accessed via the interface of the VividForms Designer If the active instructor wants to add questions to an existing t
76. 2 Figure 89 Survey Status Online Survey In Progress Survey Status Verification ws10 11 a sete ose iy nel ug el al Web verifier 05 12 2011 train 01 Display survey details auetionhaia Figure 90 Survey Status Verification Web Verifier Survey Status Data Available Data Entry Send email with questionnaire cover Display questionnaire Download Reset Close open sheet to instructor trainer as PDF l export files survey survey Data Entry Sample Survey D 12345 Data entry 003 2 05 12 2011 ay 01 Ae lel IE z Pa FPT os ws10 11 2 Data Entry Sample Survey D 12345 ae ble 1002 06 12 2011 O E train_04_ tat C er OSPR Send analysis to Download Delete answers to Delete instructor trainer HTML PDF report open questions survey Figure 91 Survey Status Data available Data entry 116 Scantron Corporation Copyright Electric Paper GmbH Phase 2 Implementation of Surveys EN H m Class Climate COURSE EVALUATION FEEDBACK SYSTEM Survey Status Data Deleted only when function delete in 2 steps has been activated ws10 11 Type Forms Processed Report Export Actions 2 Human Resource Management 02 P1237 Data deleted 017 05 12 2011 trainen tafe 3 x Display questionnaire Finally delete as PDF survey Figure 92 Survey Status Data Deleted 3 2 3 Survey Details Display of Survey Details In order to display more detailed information about the survey you c
77. 253 Global Index oaa 2 Questions about the instructor a51 3 Questions about the course w 52 dev 0 8 4 Questions about the teaching material ay 5 w 20 8 5 Questions about the studying conditions 7 wia Figure 271 Indicators Display in the PDF Report With Overall Indicator e The options Left pole for indicators and Right pole for indicators define the texts that label the scales left and right margins in the report and in the presentation tem plate Figure 272 Indicators Left Right Pole Scantron Corporation 261 Copyright Electric Paper GmbH y eo a COURSE EVALUATION FEEDBACK SYSTEM 5 1 3 Creating the Indicators for a Questionnaire Since the indicators form the averages of particular question groups they are also acti vated for particular question groups in the relevant questionnaire To do this navigate as usual to your questionnaire and open the editing screen in the main menu System Settings select Questionnaires in the left submenu select in the drop down menu below Action the option Edit Open the editing window of a question group by double clicking on the question group or by clicking on the question group and selecting the option Edit Question group in the menu Edit As described above for the indicator only scaled questions are used meaning that the definition and calculation of an indicator only makes sense for group que
78. 3 TEMPLATES FOR EMAIL MESSAGES ccccccccccseeccueccuceeeceueeuueeuueueueueeeuseueeeuuueeeeueueaeueass 486 2 1 4 TEMPLATE FOR LETTER IN PDF REPORTS ccceccccecceceeeceeeseuuseecsueseueeeausueeuueeeueauesaeueass 489 2 1 5 PLACEHOLDER FOR TEXTS cegeceessiee dnei aaia n a E a a a a aa aieia 492 2 1 6 HTML FORMAT FOR EMAIL TEXTS ccccccccceccecssecceeseuceeeseueeeueueaeeueueueseaueueeeaeeeeeueueaeueass 495 2 1 7 THE PDF REPORT HEADER cccccccceccecsceccueceuceeuseueseeeseeeeueueuusaueeuuauueueeeueueueueueegeusaesuaes 496 27 DOCUMENTS sieri teccetedesdeenaccca seanetente E E E E A 498 2 2 1 EMAIL ATTACHMENTS cccccccceccceceucececeeueeuseeceeueeuuueeueeaueuueuueueeueuuaueueueuueeaueuueeueeeauueass 499 22 2 PDF FEMPLATES mo eera E A e E ueastantendaecote 500 2 3 PROCESS DEFAULTS secsceesootsscatecasvnatnesadenadeasnatiatons lt deatmabansalisenuskandvietatestenematedseptancetectszudetonds 502 ZA WEBSERVICE astsccgetsncsenaastatisunteeaceeicneeoreinteonnaseucie nasec EAE A IEE E E AA E EE 503 2 5 CLASS CLIMATE SETTINGS CONFIGURATION cccccceccecceeceucseecseeceuuseeueuueeuueaeeueeaeeeaueaueeaueuess 504 2 5 1 SECTION GENERAL ooo cccccccceccccececeueceeeeeuceueceeuseeeeueueuueeueeuueeeueaueeueueeeeaeeueueaueeeeaeeuaueuaes 506 2 5 2 SECTION SURVEY acces nce tee R A REEE N E RAER 508 2 5 3 SECTION SURVEY ONLINE o c cccccccceccecscescueeeeeseuceeeeeuuseeseueeeuueeueeueueuuueueeueeeaeueueuaueeaeueass 51
79. 496 Scantron Corporation Copyright Electric Paper GmbH Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Mail text lt center gt lt font size 14 gt TITLE FIRSTNAME SURNAME lt font gt lt font size 8 gt Result of Student Survey lt font gt lt font size 9 gt SURVEY COURSEID No of responses FORMCOUNT lt font gt lt center gt Figure 602 Modifying the Text Template by Inserting a Line After a click on Save you will see upon re opening of the report that the PDF report header has changed as follows Prof Dr Smith Result of student survey aoyo beralism HL 02 AS of responses 9 Figure 603 Result after Modifying the Text Template by Inserting a Line Of course other placeholders can also be used In the following you will find a listing of the available formatting eee a C ae a Undeines f rUndeined gt unden n lt center gt Centered lt Centered lt center gt Centered center gt Viaximum 50 lt font size 14 gt Font l Minimum 1 Font size lt font size xx gt Font size 12 size 14 lt font gt No single or double quotes Tabelle 22 List of the Available Formatting The header of the PDF report generated by the report creator has its own text template PDF REPORT Report Header report creator This makes it possible to display the instructors name in the standard PDF report but at the same time not having to display the name
80. 999 format NNN are divided into the following 10 groups 0 99 100 199 200 299 900 999 It can be individually determined for each segmented ICR question when it should be dis played in the verification In Class Climate the following settings are available e Always The question is always displayed in the verification regardless of the Reader s reading reliability This option should be used when the unread characters should be captured exactly From low to high reading reliability The question is very likely to appear in the verifi cation Only when all entries of the ICR question have been recognized with absolute certainty does it not appear in the verification From low to middle reading reliability Only ICR questions that the Reader has recog nized with low to medium reading reliability are displayed in the verification Only when reading reliability is low Only ICR questions that the Reader has recog nized with low reading reliability are displayed in the verification All other questions medium to high reading reliability are not displayed in the verification This option is Suitable when the verification requirements should be as low as possible and when under certain circumstances incorrectly read values can be accepted 418 Scantron Corporation Copyright Electric Paper GmbH Mi amp S 4 Lae thy Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBAC
81. AND EDITING QUESTIONNAIRES ou ccccceccceseeceeecseeseuceueceueeueeeeeeaueeaueueeennees 198 3 3 4 GENERATING A STUDY FOLDER ou cccceccccccecccesceceeeceueeeeueeuceueceeeuueeuueeeueueeauueaeeeueeneueueenes 201 3 3 5 GENERATING SURVEY cacieseccdedassccinserc cee cccloanccstecenndaceeacauesdaddecke dob tedmeswniasereneussceu a E Ra 202 3 3 6 WORKING WITH THE ACTIVE INSTRUCTOR S DATA oou cccceccecscecceeseceeeseuceueeeueeeueeeaeeuueeaeenes 203 PHASE 3 CAPTURE AND INSTANT FEEDBACK ccccccccccccecseuseuesueseueeeuceeuceaueaueeuueeuueeaeeueueaueeaeeness 205 4 1 SCANNING THE FORMS u cccccccccescceccesceececeecaceeeeeceeaueeuueaeueaueeeueeeeuuaueuegueeeaueeeceueauaueeageesaess 205 4 1 1 SCANNER SETTINGS scasccletuncsnc hectaxanansendatuassleetedunnemsesbonsteanded nad ubtedevunasonsabandtaanieaentoebates ves 206 4 1 2 IMPORTANT RULES FOR SCANNING u ccccccceeccecscecsseseuseeseueseueseeesaueeaeseaueeeueueeuaueaeeeaeanaess 207 4 2 EVALUATION OF SCANNED QUESTIONNAIRES ccccceccecceseeeecceceecceeuueeueeeeaeeaeeeuaueeueaeeaeegeeneaneees 208 4 2 1 RECOGNITION OF THE CHECKED BOXES VIA BARCODE AND OMR nccc 208 4 2 2 PROCESSING IN VIVIDFORMS READER cccceccecseecseeseeceeeeeuceuucseueeueeuaeeaueeaeeueesaeeeueeneess 209 4 3 CORRECTION OF CHECKBOXES NOT CLEARLY READ THE VERIFICATION cc ceccecseeeseeseeeeeees 210 A le BATOH VIEW areare acemnseneene uteve sadeo aceee TA E aes 210 4 3 2 SURVEY VIEW scseccatesenncci
82. Ab oreviation oie Nation Sample 01 Sample Questionnaire 1 NE an Note Please bear in mind that required questions cross tabulations and online survey designs cannot be copied when copying the template into the form management Figure 559 Template in an Instructor Account By clicking on the symbol you can create a copy of the template for editing i Information A form was added to your form management view Form Management Sample Questionnaire 2011 05 24 gg Sample_2 Template 1 16 31 39 Figure 560 Copy of the Template for Editing Next you will see the user s own questionnaire administration with a new entry Name of questionnaire Template The notice Template is automatically added to the heading and shows that the questionnaire is from a template DemoEva4 Sample Evaluation Form Template Class Climate Sample Evaluation Form Template ORGANIZATION AUTHOR SUBUNIT SURVEY Mark a5 shown OMOO OO MARK Correction OBORIO CORRECTION 1 About the Course T 1 1 learned a lot in this course T Agee O OF 0 0 O Disagree 1 1 2 learned more in this course than in others Agee O 0 OF O A Disagree Figure 561 Editing a Template 454 Scantron Corporation Copyright Electric Paper GmbH Class Climate Editing and Passing on Questionnaires COURSE EVALUATION FEEDBACK SYSTEM
83. Admin 4 Webinarlest Class Climate Online Survey Template Class Climate Admin Create new customized online survey template Figure 141 Customized Online Survey Template Overview With a click on the pencil icon the template can be edited at any time or deleted by click ing on the red cross icon Also with the aid of the page icon a copy can be made The copy now appears in the list as a new template and can be edited further Once you have created the template link it as described above with the subunit in which it is to be used In the online survey it is then for example presented as such Example Unwersity csmeralda Parke Economics Basics of Economics V EEe S 14 Dear Participant We are very interested in your opinion about the course as well as about the university in general Therefore we would like to ask you to take the time read the questionnaire thoroughly and complete it Only your own judgement is important you cannot give wrong Of course the data is completely anonymous 1 Questions about you What is your gender female v What is your age 30 39 v How many terms have you been studying so far Please select w Figure 142 Customized Online Survey Template in the Online Survey CSS Editing If you wish to modify other elements of design as for instance the way buttons or drop down menus are displayed and if you have some knowl
84. After login three different views are available which can be changed with a click on the symbol Batch View Survey View and Form View Figure 211 Verifier View Options 4 3 1 All batches needing to be verified are shown in a table Batch View The table is made up of the following columns 210 Batch ID Time Duration NonForms scanstation OMR errors sheets In progress Status Cover Sheet NonForms Serial number of the batch scan time of the batch Processing time of the VividForms Reader in seconds Number of unidentified pages in a batch Name of the scanstation Number of checkboxes not found Number of all pages Shows whether other users are already processing the batch Corrections already processed T otal corrections Display cover sheets Delete all NonForms Display NonForms Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 3 Capture and Instant Feedback e Filling Degrees Display filling degrees in original PDF Export filling degrees as CSV file only when activated in the Class Climate Settings e Verification Process batch Verify automatically Delete batch Jf Current batches in WebVerifier Batch ime Scan OMR o h Cover Filing jae iD Time Duration NonForms sation Errors Sheets regress Status sheet NonForms degrees Verification 64 al pee 2 0 501 0 6 3 gt 2 p we ae 17 15 31 2009 04 24 l sa ae 7
85. Agree O O O UO O Disagree Figure 198 Integrated Question Group and Question in a Template 200 Scantron Corporation Copyright Electric Paper GmbH e C Cla COURSE ss Cli mate SYSTEM Phase 2 Implementation of Surveys How many elements still can be added the active instructor can see when looking at the Form Properties at the bottom of the VividForms Editor menu pom m kroportes Figure 199 Form Properties of a Questionnaire The upper information tells the user that you have a template where two pages are allowed left information and two pages are already created information on the right hand side The line below informs the active instructor about the actual number of questions 13 and the allowed number of questions 24 3 3 4 Generating a Study Folder After having changed the login data and possibly created some questionnaires the active instructor must create a study folder to be able to work reasonably The study folders structure the surveys of an active instructor and shall therefore be created according to the use of the user account In the following there are named some possibilities for structuring a user account e Survey periods e g semester if the surveys of the active instructors are repeated regularly e g Surveys SSO7 Surveys WS07 08 Surveys SS08 etc e Survey types if the surveys are not repeated regularly but can be assigned to specific survey types Survey research pr
86. BI U General Questions Presentation Slide Text Indicator No indicator Font Size 13pt v Text Element Apply j Cancel J Figure 475 Create a Question Group Text entries have the following meaning Title Title of the question group You can highlight the title of the question group as you can with numerous other ele ments with bold or italic fonts or by underlining To do this mark the desired element and click the buttons B I and or U in the bar next to the lettering Headline Above the Arrow back and Arrow forward buttons you can undo editing steps Presentation Slide Text This text appears on the presentation slide in the PDF report in order to explain an indica tor Please note This option is only available when the creation of a presentation template is activated in the PDF report settings System Settings Report Settings Configuration 404 Scantron Corporation Copyright Electric Paper GmbH S m AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM Indicator Select a scale for the questions that are to be combined to an average Indicator No indicator B Font Size No indicator Scaled questions with 2 options Text Element Scaled questions with 3 options Scaled questions with 4 options Scaled questions with 5 options Scaled questions with 6 options Scaled questions with 7 options Sc
87. BIAN O Cimotcewaton A Figure 351 Report Creator Example of a PDF Report Page 1 308 Scantron Corporation Copyright Electric Paper GmbH Class Climate Inthe figure above the first page of the subunit produced report gives you an over view of the appearance of the PDF reports of the report creator As usual the report header shows the title of the report In addition it displays the number of responses 46 According to the setting defined by the administrator the details of the report are then displayed to you here for example an overview over the indicators of the questionnaire Following you will see the legend for the scaled questions as well as three diagrams for the first three questions of the questionnaire e Export Here you can create export files for the subsequent processing in statistics programs Type Name Status Form Created porn Del Report Export LF Data E erie Ange HTML CSV amp Prof Development WS10 11 sae ratan 05 18 2011 J046 E choose pdf report SPSS Figure 352 Report Creator Export Options You always have the option of the CSV and SPSS export Scantron Corporation 309 Copyright Electric Paper GmbH E Your Evaluation Process The Phase Model th Class Cl imate COURSE 3S UH FEEDBACK SYSTEM Information on a Report Detailed View If you click on the name of a report the detailed view is displayed to you Details of report Report Prof Develop
88. Co df Ec if et Li df Mai y Select pogram of study GN Mu QN Physics AM Rhetoric 5 Course s f Scanstatic Esmeralda Parker ih Sofware Eisis of Eecnemcs inireduction nto Econonmcs z Prof Dr Adam Smih Central Evaluation History of iberaksm iniroduction into macroeconomics Proceed mS Tree Structure Carek E Generale Surveys iniroducton into Computer Somnce i Dispi Surveys Delete Surveys JA instructor s Optional i Ques z a a Baten Events Figure 157 Activate Instructor s Optional Questions To use the instructor s optional questions you should activate the template mode in the VividForms questionnaire and set the maximum number of pages and possible ele ments whereby every item that can be selected is an element e g question groups question image and also line spaces or separators You can also set that an instructor is only allowed to add new elements at the end If these options are not activated the instructor can expand the questionnaire of the instructor s optional questions at any place with as many elements as desired Activate Instructor s Optional Questions Administrator Account After the creation of surveys with questionnaires that provide optional questions the administrator can activate the Instructor s Optional Questions Class Climate Settings Survey Instructor s Optional Questions activation status which offers access to a web site On this webpage instructors can enter their questi
89. Copyright Electric Paper GmbH Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK SYSTEM In every PDF report for surveys which were created using this questionnaire here Eval01 as well as the current profile line of the survey you also can see the comparison profile lines of the previous two periods This is however only valid under the premise that data for these two periods is available in Class Climate Then this is valid not only for standard report but also the user defined PDF report In the following graphic the course Organizational Ethics of Carlos Hernandez from the period SSO9 was compared with the results of two previous periods WS08 09 WS05 06 Prof Dr Philipp Belmore Management Strategies Subunit Professional Development Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies a Name of the survey Comparative line WS 10 11 Management Strategies Comparative line 5510 Management Strategies i a d n 13 What is the grade of your last school graduation Grades 1 0 5 RA ai t 5 0 Ei at n 10 N E nat The instructor is always well prepared ii 3 aad Pi ra awt nai J fiat The instructor explains even complex topics in a comprehensible way E _ P E ates vs ava34 na vA n t2 The instructor handles the technical equipment video projector etc ki a ck without any problems amp ay a7
90. Corporation 259 Copyright Electric Paper GmbH a l a Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM In order to really be able to interpret the indicators produced one must know how other surveys turned out For this you can fall back on norming 5 1 2 Activating the Indicators in the Configuration If you wish to utilize the calculation of indicators you must first activate them in the con figuration For this purpose you call up the option Configuration in the menu System Seittings Report Settings Please bear in mind that you have to define the configuration for each of your PDF reports There you find the setting Calculate indicators which you can activate and deactivate If you activate the calculation of the indicators here the indicator and standard deviation are displayed at the beginning of the PDF report as a bar diagram On the margin you can also see both of them as numerical data _ Overall indicators 2 Questions about the instructor was 1 2 3 4 5 6 TONDE ee oe e LLEN ui 0 6 au A 1 2 3 4 5 6 4 Questions about the teaching material i C I I I H t av 5 2 5 Questions about the studyi diti i inl PEG ae Peer ee eee meen a A sits Figure 269 Indicators Display in the PDF Report without overall Indicator The option Calculate indicators from the configuration refers only to this calculation of the
91. Data Entry Assistant Survey Overview After clicking on the corresponding survey ID the first image will be displayed The con tents can be entered into the text window below the picture Picture No 2 of 6 from survey No 45538 Display the entire questionnaire page Question Please give us your feedback about the instructor as well as suggestions for improvement one la POES c iad Cih He cl i Save Accept entered text The image snippet will be replaced by the text An empty text field will delete the image snippet Placeholder Replace Replace automatically This Text is shown when validating handwritten fields f Save L sorted by frequency in the table _ J Cancel P Very nice and friendly Figure 225 Data Entry Assistant Detail View After each text has been entered the next image will appear and a table of comments will be built up Next to each comment there is the response frequency lf a comment is essentially repeated then instead of entering it again it can be high lighted which will increase the response frequency If a text has been entered with a typing error then each line can be corrected by clicking on F With the help of the option Display the entire questionnaire page in the upper right cor ner of the screen the data entry assistant can if necessary display the entire question naire page containing the image In this way
92. E MAIL Cover sheet for instructor E MAIL Data entry for instructor E MAIL Footnote for anonymous online surveys E MAIL Footnote for non anonymous online surveys E MAIL Form for instructor E MAIL Information about result access to participants i Language English Higher Education Figure 191 Editing the Welcome Greeting for Active Instructors 196 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Modify the text as you see fit and then click on Save A subunit administrator has no access to these texts therefore he cannot check this setting Please consult your Class Climate administrator on this As soon as you have secured these details the instructor can log on with the details that you have supplied him with 3 3 2 Login as Active Instructor In order to log in the active instructor calls up the Class Climate Log in window and enters his access data here Subsequently a window appears with the greeting text Welcome to Class Climate the Faculty Evaluation Feedback System First of all please change your user name and password combination Click on My profile in the left navigation menu In order to return to this window click on Folders You can set up your first folder a directory for surveys by clicking on Create new folder For further information please consult the online manual We wish you success Figure
93. Electric Paper GmbH Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK SYSTEM ne Question Operator Value Options Default criteria combination Which gender do you belong to female v e And Main subject 5 Business Studies 2 or_ riteria combination 1 amp What is your age lt 1 18 29 m4 nd Main subject 5 Business Studies ag Figure 344 Report Creator Two Criteria Combinations Imagine you only want to see in your report the results of those interviewees who fulfill the following conditions the interviewee is either female OR between 18 29 and in both cases has the main subject Business Studies For this reason link both criteria combi nations with the Or operator Finally as you are now familiar allocate a descriptive name decide for or against includ ing open questions in the subgroup report and click on the Create button The subgroup report now appears in the list of reports When you have created several criteria combinations using the drop down menu you can select the criteria combination to which the criteria combination of the chosen ques tion is to be added In the following graphic you can see the results of the criteria I learned a lot in this course which is rated with a 1 applies in full and linked with criteria combination 3 In the drop down menu of the criteria combinations select the criteria combination 3 a
94. FEEDBACK SYSTEM Bi Available Questionnaires l Show all questionnaires of the Subunit Administrators Vv Show deactivated questionnaires at the end of the listing including module questionnaires Peter Brown ID Name Description Date Engine Status Action 295 General General Questions 05 23 2011 VF Editor 3 Select v Evaluation in Higher Education 5y l 311 HEsaC self assessment of 05242011 VF Plus o3 Select v competence 18 Non_Anonym Evaluation 05 22 2009 VF Editor 3 Select v Evaluation a ee 259 Quest_01 Shona 05 05 2009 VF Editor 3 Select aea Evaluation ae a 261 Quest_3 Guesticnnaire 05 12 2011 VF Editor 9 Select Sample 307 Sample_01 G cetona 05 24 2011 VF Editor 9 _ Select l Questionnaire on l 293 Tech_01 Technical Skills 05 16 2011 VF Editor 9 Select v Trainer 296 Trainer IETA 05 23 2011 VF Editor 9 Select w Course Evaluation EA TE 243 train_01 Askona 06 04 2009 VF Editor 9 Select v ae Course Evaluation 244 train_02 Gosod 05 05 2009 VF Editor 4 Select v ee Course Evaluation 245 train_en GhicsiGnnais 05 18 2011 VF Editor O 4 Select v Seal leer ea Class Climate Basic pinajn E Citta 313 STEHETMT Training 06 08 2011 VF Editor 3 9 Select v Figure 446 Display Module Questionnaires in the List of Questionnaires By clicking on the name of the questionnaire you can access its details and define further settings for your survey for exam
95. Finish Data Collection Close Survey Restore Survey 2 Delete Survey a Edit answers to open questions f Assign survey to substitute instructor id Edit Show notes Figure 101 Survey Details Add Note 124 Scantron Corporation Copyright Electric Paper GmbH n amp 3 Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM Then click on Add note All notes of the survey Human Resource Management Figure 102 Add Note An input window appears with which text can also be formatted Add Hote Survey Human Resource Management BiIu amp The room was far too small for all particpants Internet was extremely slow Figure 103 Add a Note After a click on Add note the entries are saved In the survey overview the symbol i now appears next to the survey name When the mouse is moved over the symbol the most recently entered note appears in a window next to the cursor Human Resource Management 02 P1237 3 naging ah_ Peter Brown o4 Quest 01 Show Questionnaire g P amp lifestyle NA If 1e room was far too small for all particpants ws10 11 nternet was extremely slow Form Report Export Actions QKtainen OG yr Br SSHR GZ trainen Dee op yxy BS r GI SPR J Quest_01 Showcoversheet PR gt Management 2011 05 12 11 21 52 Figure 104 Course with Note Scantron Corporation 125 Copyright Electric Paper GmbH COURSE 3S
96. Furthermore you can edit copy and delete the existing PDF reports in the menu System Settings Report Settings Please note with regard to the standard default PDF report Class Climate PDF Report present in the system you are only able to change the con figuration see chapter B 4 5 1 Components of the PDF Report section General configuration This PDF report can neither be edited nor deleted You can copy this PDF report so as to create a new PDF report G Report Settings l l Ac dmi linistrator Lone Loopy Class Climate PDF report Class Climate Admin Se Ei Individual report Class Climate Admin Set P E xs Figure 256 Report Settings To copy a PDF report click in the column Copy on the copy icon A new PDF report is created You can recognize the copy of the PDF report by the name extension Copy 246 Scantron Corporation Copyright Electric Paper GmbH lass Climate To edit a PDF report click in the column Edit on the edit icon A window automatically opens in which in the area Description you can enter a new name for the PDF report In the area Questionnaires you can allocate for which questionnaires the PDF report is to be valid A multiple selection can be made by pressing the Ctrl button In the details of each questionnaire you define the PDF report with which the corresponding question naire will be displayed later also see the following paragraphs Sa
97. LETTER Resutts for instructors LETTER Summarized results for deans LETTER Summarized results for study deans LETTER PDF REPORT Address field Norming PDF report introduction Norming PDF report Letter PDF REPORT Format of the instructor name Sample Letter Custom Cover Letter Sample pdf on OW Del ete Please note The PDF A compliance will not be granted when using a PDF template Language English Higher Education w Figure 236 PDF Letter A Letter Linked with a Text Template The results in the defined text elements continuous text address being placed over your desired layout Instead of the standard letter you get a letter which contains the cor responding elements text and layout As an example you can see the PDF letter to Donna Harwood with the Class Climate sample template as layout Scantron Corporation 229 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Evaluation Results TO Belmore as private and confidential Result of a survey Dear Mr Belmore me email contains evaluation results for Human Resource Management rain_en The global indicators are istou first followed by the individual average values consisting of the following scales 2 Questions about the instructor 3 Questions about the course 4 Questions about the teaching material 5 Questions about the studying conditions In the second part of the analysis the
98. Only own surveys Only own subunit Unrestricted access Figure 189 A User s Access to QM Views Once you have assigned these rights please remember to create an appropriate log in name and a password e The instructor must be activated From the user overview you as the Subunit admin istrator can see whether an instructor is activated A yellow padlock added to the icon of a user in front of a user name means this is a passive user no padlock added to the icon signals an active user To switch simply click on the icon es Philipp Belmore D Donna Harwood Figure 190 Passive with Padlock and Active without Padlock Instructors You can switch the instructor between active and passive at any time for example denying access after an activated period e You have to pass on the access data to the instructor log in name password and the link to the Class Climate homepage Otherwise he cannot log on even if you have cre ated and activated him e You as a administrator need to check that you have adapted the greeting in your sys tem that appears automatically when an active instructor logs on You will find the text in the main menu System Settings in the submenu on the left hand side under Text templates It is titled Class Climate Welcome text for the first login of instructor Class Climate Welcome text for the first login of instructors A E MAIL Certificate of participation for online surveys
99. PDF Report Normed Profile Line The detail profile line shows all of the norm values of the questionnaire In addition to the option mentioned above Create profile line you must activate the option System Set tings Report Settings Configuration Show norm values You must also specify the norm values in the questionnaire administration Scantron Corporation 237 Copyright Electric Paper GmbH J gt Presentation Template Caros Hermandez Graduate Survey 2011 Presentation template Graduate Survey 2011 Carlos Hernandez No of responses 6 This question group contains 4 questions pe concerning the Instructor 1 Preparation 2 Explanation 3 Technical Skills 4 Overall Grade This question group contains 4 questions a concerning the course 1 Workload 2 Professional Discussion 3 Professional Preparation 4 Overall Grade Figure 253 PDF Report Presentation Template This part serves to facilitate a discussion with the students about the results of the sur vey All indicators can be shown with an explanatory text This explanatory text has to be activated first In order to activate the presentation tem plate use the function System Settings Report Settings Configuration Create presenta tion template The explanatory texts are defined directly in the questionnaire when creating or editing a question group In the question group wizard a text box with the title Presen
100. Paper GmbH a System Settings and Management Class Climate Authentication Activates the authentication on the mail server In most cases not necessary User name User name with which Class Climate should log in to the mail server if authentication needed Password Password with which Class Climate should log in to the mail server if authentication is needed Server root path This setting defines the root path of the Class Climate web server LDAP LDAP deactivated can be defined individually for each user in the user settings activated for all users If this option is activated the user name and password are compared at the login with LDAP LDAP Registration also for the Administrator Deactivated activated If activated a login for the administrator is also conducted on the LDAP system Please make sure that the login name of the Administrator is a valid LDAP login otherwise a lock out from the System can occur This setting does not apply to sec ondary administrators LDAP host Address of the LDAP server LDAP secure connection Deactivated activated When activated the LDAP connections are encrypted The LDAP server must support encryption LDAP BASE DN Defines the base DN for LDAP or Active Directory LDAP search filter Search filter for searching for users The standard value for the filter is uid USER sAMAccountName USER The placeholder USER is replaced with the username entered
101. Recipient max 25 admin localserver com Class Climate Admin 3 miller example com Reference p brownGexample com p belmoretexample com Online survey a smith Gexample com Mail text r marlow example com This email entitles you to vote in an online survey a p gabriel exampie com Please click on the link below and enter the password to gain access to the survey i The password PSWD survey location SERVER T n Apply to All i Save Run now To survey list Figure 124 Define Scheduled Tasks In general it is possible to assign the date time and status for all selected surveys using the Apply at All button 140 Scantron Corporation Copyright Electric Paper GmbH X Class Climate e Operation Online Survey Reminder The operation Online Survey Reminder is the dispatch of a reminder email to all respondents who have not yet taken part in the survey In the reminder email you can send the login information once again Optionally more than just one reminder email can be sent In this case select the Multiple reminders every x days The system will then keep re sending reminders until the survey is closed After activating this operation the fields sender email sender name subject line and email text can be edited The recipients are automatically read out of the system so that all participants who have not responded receive an email After defining the start dat
102. Sampl1 instead of Sample Besides the Abbreviation and the Title you can see the number of pages here you can see if the questionnaire is already contained in the recognition set of the VividForms Reader and when the questionnaire was copied 198 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Furthermore the active instructor can carry out the following actions e Add filters required questions validation and cross tabulations and define the display mode of the online survey complete per page per chapter Please read the relevant chapters of this manual for this purpose e Copy the questionnaire Clicking the icon in the column Copy inserts a duplicate of the questionnaire in the list and counts up the abbreviation e Delete the questionnaire Clicking the icon in the column Delete deletes the ques tionnaire after an additional request if the questionnaire should really be deleted If the questionnaire is based on the central template the template will not be deleted in this case of course e Edit the questionnaire Template can only be edited within the allowed limits e Preview a PDF template of the questionnaire e Export the questionnaire By clicking on the icon in the column Export active users can save the questionnaire as a vid file in their file system and hand it on e g to their colleagues Those can read the file after importing it into Class Climate again Ac
103. Show the header of the survey Enable temporary save Show print option Reporting Options Mirrored scale values IV Allow Summary Reports After clicking on the button Edit the window for setting the indicators opens automati cally Now question groups can either be converted to indicators and be subsequently processed or the indicators can be defined freely Bi Free indicators Figure 279 Free Indicators Setting By clicking on the button Generate indicators from question groups the indicators are established based on the question groups on the questionnaire and the scaled questions contained therein This compilation can be subsequently edited by using the green pencil icon so that the questions of an indicator can be freely distributed throughout the ques tionnaire By using the green arrows the indicators can be moved up or down The indicators can be deleted at any time by clicking on the red cross 266 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Bi Free indicators Questionnaire indicators Reine Course Evaluation Questionnaire train_en glare 1 2 Questions about the instructor Scale width 6 FJ 2 3B 2 3 Questions about the course Scale width 6 723 3 4 Questions about the teaching material Scale width 6 Y 9 3 amp 4 5 Questions about the studying conditions Scale width 6 J B amp G
104. Since the report is crucial to your evaluation here you will find a detailed description of how to de activate the components The Letter The letter is a regular type of letter and serves as courteous piece of information for the instructor on the subsequent results of the PDF report If you wish to add a letter to the evaluation results please activate it in the settings of the corresponding PDF report in the main menu System Settings Report Settings Please click on the configuration icon in the column Configuration The PDF report configura tion opens automatically The option Generate letter activates deactivates the letter Please note that you have to activate deactivate the letter for each PDF report sepa rately G Report Settings Descri Administrator Configuratio it Class Climate PDF report Class Climate Admin E En Individual report Class Climate Admin E P G9 4 Figure 229 PDF Report Configuration The following figure shows a sample letter The letter consists of various components e the header with the address details of the sender and of the recipient e the actual text of the letter including a subject line and continuous text e the letter s layout for example with the letter head of your corporate design 224 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Example University Washington Sreet 5 Lihi Demarty th toa oes ea
105. The survey data can be deleted manually at any time If however you would like to delete the survey data before it enters the data base you must activate the option After the scanning operation automatically generate email with message or report 2 4 Webservice The configuration area Web Service Settings in the main menu System Settings allows the administration of external web servers that communicate with the Class Cli mate server via the web services Class Climate SOAP API Please note You will see the area Web Service Settings in the menu only after activat ing Activation of Class Climate Web Service XML based SOAP interface in the Class Climate Settings page Functions By the so called web services web servers can communicate with one another and download the other system s functionalities This way it is possible to integrate Class Cli mate into existing web software systems Typical applications are for example the auto mated update of the user accounts and survey procedures the download of evaluation reports or questionnaire supplies Connections with Class Climate via web services can be implemented by the manufac turer and or your vendor Scantron Corporation 503 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 5 Class Climate Settings Configuration At the menu item Class Climate settings Main
106. These can be customized according to your needs One of those is the one used in the letter Letter Results for instructors Editing of text templates Action PDF template LETTER Form count below minimum A Evaluation letter Sample 2 Custom Cover Letter Sample LET TER Regulatory information LETTER Report for the president LETTER Results for instructors LETTER Summarized results for deans LETTER Summarized results for study deans using a PDF template LETTER PDF REPORT Address field Norming PDF report Introduction _ Language English Higher Education Please note The PDOF A compliance will not be granted when lt x Reference Report Course Evaluation to the Teachers Mail text SALUTATION TITLE SURNAME This email contains evaluation results for SURVEY QUESTIONARY The global indicators are listed first followed by the individual average values consisting of the following scales DIMENSIONS In the second part of the analysis the average values of all individual questions are listed Figure 233 PDF Letter Text Template Letter PDF Report Evaluation to Instructor When comparing the sample PDF letter with the text template in the following figure you will notice that the texts are identical apart from those areas written in capitals and set in angular brackets This text template is automatically used as the text in th
107. UH mat SYSTEM a Your Evaluation Process The Phase Model thy AN Class CI mate In the case of the QM screens two types of symbols can appear next to the survey name e symbol Notes exist H symbol Notes do not yet exist Editing notes later is only possible for the respective authors Additionally these notes can be displayed in the PDF report To do this activate the option Show notes in the PDF report under System Settings Report Settings Configu ration All notes of the survey Peter Brown 05 12 2011 at 11 21 52 The room was far too small for all particpants Internet was extremely slow Figure 105 All Notes of the Survey in the PDF Report Show recognized form originals as PDF The option Show recognized form originals as PDF in the survey details allows the orig inally scanned forms to be displayed The forms are displayed as a PDF file and can be opened as a whole or for each single questionnaire Survey data dv Survey evaluation statistics HTM Results in HTML format Results in PDF format 2 Show Email amp Raw data in SPSS format ov Raw data in CSV format 9 m Delete original scanned files of recognized forms Figure 106 Survey Details Show recognized Form Originals as PDF After selecting whether you view the entirely or only one questionnaire simply click on Show The original scanned forms are displayed Green boxes show which checkmarks were recogn
108. User Be extremely careful when using this function Deleting a profile means that all program files and surveys will also be deleted Writing an Email to an User A mouse click on the letter symbol allows you to send an email to that person The Class Climate internal email system will be used LDAP Authentication Class Climate offers an interface to LDAP LDAP Lightweight Directory Access Protocol is a protocol and offers the possibility to access the directory server LDAP is often used to administer the users of a network To be able to use the LDAP connection the function must first be activated in the Class Climate settings System Settings Class Climate Settings Network Settings LDAP There are two possibilities The LDAP connection can be activated individually for each user option 1 or it can be activated for all users simultaneously option 2 LDAP lf this setting is activated the user name and password are compared when logging in using LDAP 0 deactivated 1 can be defined individually for each user in the user settings 2 activated for all users Figure 38 LDAP Activation If option 1 is selected then the menu option LDAP Login is shown in the user settings dialog Now the login via LDAP can be activated or deactivated for each user separately 62 Scantron Corporation Copyright Electric Paper GmbH thy Class Climate Phase 1 Preparation of a Survey Period COURSE EVALUATION F
109. Verification Navigation 214 Scantron Corporation Copyright Electric Paper GmbH Class Climate The verification is however completed when the NonForms in a batch have been deleted You can do this by using the NonForms view or the button Delete NonForms When the NonForms are deleted after completing the manual verification then the verification must be completed by clicking on the button Process batch Now all the results of the batch are submitted to the database and the evaluation can be downloaded from Class Cli mate 4 3 5 Automatic Verification To accelerate the process of verification a number of cases can be verified automatically in the WebVerifier The prerequisite for automatic verification is that the relevant option in the systems settings is activated System Settings Class Climate Settings Functions Automatic Verification In all three display modes batch survey and form view a column with the icon Verify automatically is displayed Beneath the column there is a checkbox to select which event is to be verified automatically Coversheet Verification 2 7 QA 8 2 7 B Selection for automatic verification No valid checkbox found invalid One checkmark and correction s found Figure 218 Verification Selection of Options for Automatic Verification The following options are available e No valid checkbox found invalid All cases in which no valid checkbox i
110. a EOONTE CULLEATIGH PELE OTe Example University John Peter Lesley Linguistics Introduction into Linguistics Dear Participant We are very interested in your opinion about the course as well as about the university in general Therefore we would like to ask you to take the time read the questionnaire thoroughly and complete it Only your own judgement is important you cannot give wrong Of course the data is completely anonymous 1 Questions about you What is your gender Please select ki What is your age Single Choice Please select Figure 69 Online Survey with an Activated Survey Header Should you decide not to display it the dark green header with the information about the course disappears and the survey appears as follows Dear Participant We are very interested in your opinion about the course as well as about the university in general Therefore we would like to ask you to take the time read the questionnaire thoroughly and complete it Only your own judgement is important you cannot give wrong Of course the data is completely anonymous 14 Questions about you What is your gender Please select r Figure 70 Online Survey with a Deactivated Survey Header You can also choose to enable the temporary save and print options Design Here you can define whether the questionnaire is displayed in online surveys as one page i e to scroll do
111. a mean value which is equally influenced by all respondents but a specified frequency of responses within a particular range of response values Setting Frequency Based Quality Guidelines Based on frequencies The course focuses on the current professional t Delete discussion 25 gt 2 80 Figure 410 Frequency Based Quality Guideline In this example there is a scaled question with 6 response options higher values are bet ter in this case The aim of the guideline is to apply a deduction of 25 if 20 or more of the responses are for the negative response options 1 or 2 This means in turn that in order to meet the defined requirements more than 80 of the responses need to be for the remaining options 3 4 5 and 6 Therefore the condition is defined that more than 80 of the respondents need to have chosen an option higher than 2 for the quality guideline to be met Advantages and Drawbacks of Frequency Based Quality Guidelines The advantage of frequency based quality guidelines is that a certain critical mass in this case 20 can have the effect that a quality guideline is not met independent of the opin ion of the remaining respondents As a drawback it has to be noted that contrary to average based quality guidelines there is no tolerance region and therefore when the targeted value is not reached the full deduction comes to effect immediately Example calculation when higher values are better In the
112. a graphic overview on the results of your evaluation You can download these profile lines in the report creator for all surveys and all reports produced by the report creator and lay them over one another This way the report cre ator compares completed surveys with one another and or with the created reports Since this comparison provides at a glance a comfortable and expressive overview of surveys it is conducted often A popular application is the comparison of a survey with the subunit report as well as the total evaluation Before you can create comparison lines the necessary surveys and reports must of course be available Creating and downloading comparative Profile Lines When you have created these select the option Batch Profile Lines from the second drop down list in the study folder and click the button Next Scantron Corporation 313 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Create reports Summarized Next jbunit F Reports Subunit Comparisons Batch Profile Lines Figure 359 Report Options Create Profile Line Emails Then the usual choices are presented to you in a new window Select the desired sub units the survey periods here no multiple selection is possible the course types and the relevant ones comparable questionnaires here As usual the list of courses that meet all criteria is displayed
113. activate this option setting 1 then for every questionnaire where you have defined the possibility of abstentions each abstention is exported as a Missing Value with value o to SPSS SPSS ignores the Missing Value when computing the mean value Raw data export contains only the ID of non anonymous participants If activated the raw data export contains only the ID email address of the participant This option is only available for non anonymous surveys where the participants are known with names in the system If this option is deactivated all available participant data will be exported Char encoding for CSV Export Defines the char encoding for the CSV export Use the option Unicode if non Latin char acters are used Options ISO 8859 1 ISO 8859 2 Unicode ISO 8859 1 is a norm which defines the display of the western European font ISO 8859 2 is a norm defining the east European character set Through ISO 8859 2 a CSV file with east European characters can be directly and correctly opened in Excel Unicode is a comprehensive standard for the presentation of characters through a com puter which makes numerous characters presentable worldwide for example Chinese fonts The Class Climate server displays its web pages in the unicode font UTF 8 2 5 5 Section Course User Data Fields Number of additional fields Sets the number of custom course data fields Zero corresponds to no additional fields
114. activated the Class Climate server checks the IP address of each inquiring computer for the following IP address domains Begin IP address domain participant online survey First permitted IP address for participants in an online survey End IP address domain participant online survey Last permitted IP address for participants in an online survey Begin IP address domain user First permitted IP address for users End IP address domain user Last permitted IP address for users Begin IP address domain for administrator First permitted IP address for the administrator End IP address domain of administrator Last permitted IP address of administrator 2 5 14 Section Maintenance Debug Mode Activate deactivate debug This setting allows you to find defective data and other prob lems If necessary you will be asked by support to activate this Because an activated debug mode can slow your system down the administrator after login is informed of all possible scenarios regarding this 526 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM A Warning Message The debug mode was activated Please note It may reduce the performance of your system significantly Please click here to deactivate the debug mode Figure 611 Warning Message Debug Mode If you click on Please click here to deactivate the debug mode
115. also the manual delivery of reports by the administrator using the survey view Mass Production and Sending of Reports You can use the batch events for the mass production and sending of reports For further information please consult the chapter B 3 2 9 Batch Events Scantron Corporation 255 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy AN Class CI mate COURSE 3S GH mat SYSTEM Types of report dispatch The following table gives an overview on different possibilities of report dispatch in Class Climate together with notes on types of reports and report recipients ype of Dispatc Notes PD p Process Defaults recipients are defined when creating or editing a PDF report definition only paper based If no PDF report definition exists the defined standard report will be sent instead The standard report can be defined in the details of a recipients are defined when creating or editing a PDF report definition P UECOE If no PDF report definition exists the defined standard report will be sent instead The standard report can be defined in the details of a Survey The report recipients are the instructor as well as selected Further Report Recipients Secondary Instructors report is sent to the The standard report can be defined in the details of a questionnaire The report recipients are the instructor as well as selected Further Report Recipients Secondary Instructors Bat
116. and use the additional filters to select the evaluation periods course types and questionnaires Then click the button Show Now in the survey list below the surveys will be displayed which correspond to the filter set tings Choose the desired surveys from the list 294 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM aa ts a Tree Structure m A Subunits _ Engineering m 1 Professional Development v C Economics z Central Campus Prof Dr Philipp Belmore Carlos Hernandez v f Media amp lnformation Center Prof Dr Philipp Belmore Carlos Hernandez _ Engineering _ E Computer Sciences _ Social Sciences v Show instructors _ Psychology Prof Dr Philioo Belmore _Data Entry Demo Subunit j 3 Human Resource Management 63 Management Strategies Additional filters Course Type 62 Managing and maintaining a healthy lifestyle 4c Human Resource hisanaoement 66 Leadership Development 4 7 Organization and Management Description Prof Dev Economics Overallf Question mapping of different questionnaires Include answers to open questions Automatic with Combine surveys unweighted text comparison Please note The mean values of individual surveys are averaged in this type of report Manual Very Figure 324 Report Creator Any Compilation Tree Structure Select S
117. appears but an alpha numerical combina tion for example V2_A for the first variable as question in the second question group You can specify new names for all variables These are then displayed in the CSV file thus in Excel as well as in SPSS instead of the automatically assigned names This function is intended to support you in the evaluation with statistic tools To rename the variables go to the details of a questionnaire and in the area Advanced Settings select the option Data export configuration Click on Edit 336 Scantron Corporation Copyright Electric Paper GmbH CD Class Climate Phase Advanced Repo COURSE EVALUATION FEEDBACK SYSTEM Details for questionnaire train_en P VividForms Editor C Copy and open the questionnaire in the VividForms Designer W PDF Sample Show PDF paper survey Show in the recognition set of the VividForms Reader ee Refresh Q Preview online survey Questionnaire E Delete fal See Beet ee _ Show print option Figure 392 Data Export Configuration in the Details of a Questionnaire In the window which opens afterwards you have the possibility of defining the names of the different variables Data export configuration Form train_en Single Choice male 1 se co you belong to Single Choice Sei et rien os pie ay ets Older than ingle e 2B ae 68AN 30 39 2 40 49 3 50 59 4 60 69 5 69 69 6 W
118. are allowed For example one period could be defined as from 1st of Jan 2010 to 31st of Dec 2010 name Year 2010 e g add 1st of Jan 2010 to 30th of June 2010 First Half of 2010 1st of Jan to 31st of March 2010 Q1 2010 Existing periods can be updated by modifying the entry fields and clicking on the green pencil symbol A modification of the period names is not critical Custom Titles All identities in Class Climate have a title The in built titles are Mr Ms Mrs and neutral The menu Custom Titles allows the definition of additional titles To do this enter a new title and a salutation text An example title could be Provost with the salutation Dear Save changes by clicking on the Save button The newly defined title will be used in the active system language Translations of the new title may be added if additional languages are present in the system CA Custom Titles Title Salutation text Title Language Mir Dear Mir English Create new title Salutation text Title Save Figure 20 Custom Titles You can only edit your entered custom titles By clicking on P you can alter the salutation text and title in question Afterwards save your changes by clicking on the button Save A click on amp deletes the form of address in the respective language The new titles can be linked to the identities in the user profiles The defined titles can be used in the CSV user import The key
119. are considered as positive and bigger values as negative are reversed Thus if smaller values i e values left of the norm are positive the values are reversed All amplitudes of the normed profile line on the right side of the norm can be interpreted as positive evaluation results Accordingly the values left of the center are negative Please note The reversed values are also taken for the calculation of the mean values Detailed Report Includes an analysis of all closed questions e Scaled questions with 2 to 11 options e 1ofn questions with any number of options e m ofn questions with any number of options with e graphic display of histogram arithmetic or trimmed mean am tm and standard devi ation e numeric value of absolute or relative response frequency arithmetic or trimmed mean am tm and or median with 10 or 25 quantile levels s n total e lf the quality guidelines have been defined and the traffic light symbol has been acti vated then next to the evaluation graphic you will see to the right a traffic light symbol The following figure shows you the detailed report in the PDF preview Scantron Corporation 233 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM The meals in the refectory are always tasty strongly disagree i l i srongly agree m2 s dev 0 7 The university is connected to the public strongly disagree E E o st
120. as forename surname address title and user defined options Further information regarding the creation of non anonymous surveys as well as inserting and editing participant data in non anonymous surveys can be found in the paragraph Importing participant data in chapter B 3 2 10 Non anonymous Surveys 70 Scantron Corporation Copyright Electric Paper GmbH limate Specifying Participant Data in Anonymous Surveys lf you wish to evaluate the course anonymously and therefore activated the option Anonymous survey participants in the above graphic you can only insert the email address of the participants This makes sense for example when you want to send the participants of an online survey their PSWDs via email After you have activated the option Anonymous survey participants in the details of a course click on Edit data of participants In the window which opens automatically you have the opportunity to either insert the email addresses of your anonymous participants manually or to import them via CSV import Administrate participants Participants of Introduction into macroeconomics Email Delete ik 3 CSV import of survey participant data import the participant data Browse J meon Figure 48 Adding Anonymous Participants of a Course Overview Further information on CSV importing of email addresses can be found in chapter B 2 3 3 Import of Course Participants
121. average values of all individual questions are listed Note Adobe Acrobat Reader must be installed on your computer in order to view the files Your Administrator Figure 237 PDF Letter Sample with a new Layout lf you do not wish to use this layout system wide but only for surveys that are conducted with a certain questionnaire you can also upload documents for a particular question naire To do this you go to the details of the relevant questionnaire via the menu System Set tings on the left hand side of the menu Questionnaires In the list that appears you select a questionnaire and navigate by clicking on the name of the details of the question naire In the area Advanced Settings you see a drop down list with four options to choose from 230 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM 3 Class Climate Subunits System Settings Syst COURSE COLLOMTION FE TE ee ik Bi Details for questionnaire Demo_01 taining Evaluation wW VividForms Editor PDF Sample Show In the recognition set of the VividForms Reader Refresh Class Climate Admin Administrator Advanced settings Questionnaires a Questionnaire List Text Templates x Z Create Questionnaire E Question Library Figure 238 PDF Letter Modify Text Templates for a Specific Questionnaire Questionnaire Details
122. batch printing function this is considered in the number of copies made The number of copies can be altered retro spectively so that larger or smaller quantities can be printed In the footer the total num ber of pages to be printed is stated whereby the page number of the PDF file can be checked lf necessary each course can also be retrospectively deselected or later reselected by activating or deactivating the checkbox in the first column To start creating a PDF file click on the button Request Depending on the number of questionnaires cover sheets to be created the processing of the request can take up to several minutes If you have selected more pages than allowed for in the system settings cf System Settings Class Climate Settings VividForms Maximum amount of pages that can be printed through batch printing of forms a warning appears requesting that the number of copies to be printed be reduced Scantron Corporation 175 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Questionnaire batch print amp Professional Development Philipp Belmore 5 ss11 Name Form Already printed No of Participants Copies W Managing and maintaining a healthy lifestyle NA_1 Quest_01 0 7 7 Wv Management Strategies NA_2 train_en 0 5 5 amp Professional Development Carlos Hernandez I ss11 Name Form Already printed No of Participants
123. be added as a new group in the library and the highlighted question will be added to this group The administrator also has the possibility of denying subunit administrators this right To do this he activates the option Public items disabled in the user profile of the subunit administrator The subunit administrator can then no longer add public questions to the library All groups and questions are then as with the instructors only visible to him Scantron Corporation 445 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 1 2 3 4 2 Please define the user rights QM Views No QM Views additional subunits for QM views Computer nces A Professional Development anstation De subunit Data Eniry De Subunit eritie Demo Sut Online Survey Defined by Administrator No access v Templates Assign additional Computer Sciences subunits Professional Development E Scanstation Demo Subunit E _Data Entry Demo Subunit _Systemlogins hi Cancel lt lt Back Next gt gt Figure 548 Question Library Definition of the User Rights for Public Items in the User Profile of a Subunit Administrator 4 4 Deleting a Question from the Library With a click on f you can delete the highlighted question from the library 4 5 Adding a Group to the Library With a click on the symbol or the text Add sel
124. board questions and comments Question 3 The instructor knows how to present the topic interestingly You hereby use a scale with six response options with the bad values lying to the left and the best values to the right To question 1 the following five valid responses are given here for clarity reasons also an unusually small number 3 4 2 5 4 Average of this question 3 4 2 5 4 5 3 60 For question 2 a respondent put two crosses this answer is therefore invalid The fol lowing four valid responses remain 1 4 2 4 Average of this question 1 4 2 4 4 2 75 Question 3 was ticked only three times the other two respondents did not give a response These three answers are valid and read 5 6 5 Average of this question 5 6 5 3 5 33 Now an indicator is calculated for this question group Class Climate needs the responses to the corresponding scaled questions for that adds them and divides them by the total number Indicator 3 44 2 5 4 1 4 4 2 4 5 6 5 12 3 75 lf one adds the three averages and divides them by the number of averages which does not correspond to the calculation of the indicator one receives another value 3 60 2 75 5 33 3 3 89 _ SSSSS S _ _ _ _ _ _ _ _L_LL __ 258 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Only through taking into account several indicators you receive an overview of the entire survey The
125. can enter an appropriate name that will be displayed whilst you work in Class Climate with this let ter These PDF templates have to adhere to particular design settings that you will find in chapter D 2 2 2 PDF Templates Here for instance you can deposit your company s letter head as a PDF template After doing this please remember to link this template with the text of the letter To do this you return to the field Text templates where the text of the letter is defined There you add your PDF template by selecting the respective letter on the right hand side and then click ing on OK 228 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Editing of text templates Action PDF template mM ou LETTER Report TOT ine pres LETTER Results for instructors LETTER Summarized results for deans LETTER Summarized results for study deans LETTER PDF REPORT Address field Norming PDF report Introduction Norming PDF report Letter PDF REPORT Format of the instructor name Lone MEO Landar nn frinkt unnar anranri o Attach Language English Higher Education Sample Letter No PDF template defined Figure 235 PDF Letter Selecting the PDF Template in the Field Text templates The selected PDF template is then assigned to the letter text Editing of text templates Action PDF template LEIER REPO tor me presiem
126. citeria combination Add criterion Figure 336 Report Creator Selecting the First Criterion male for the Subgroup Report Finally click on the button Add criterion The criterion then appears in your Default cri teria combination In this case the criterion Gender with the value female was added The condition being that exactly this value must be fulfilled indicated by the ator column Saat Default criteria combination Which gender do you belong to w 2 female v character in the Oper Figure 337 Report Creator Criterion Female was Successfully Selected Depending on which question type the selected question is related to you can select a operator or other operators With regard to scaled questions and matrix questions as well as the operator the lt gt s 2 and lt gt unequal are available In open questions you can filter by strings contained or not contained as long as the data of the open question is not an image This function then applies to online surveys or paper surveys with data collection and ICR Default criteria combination Please give us your feedback about the instructor as well as suggestions for improvement contains good P 4 Figure 338 Report Creator Filter options for open questions 302 Scantron Corporation Copyright Elec
127. click on Export A Save as dialog appears Select a folder and click on Save To integrate question groups and questions from the library into your questionnaire please open the question library in VividForms Editor see also chapter C 4 Use of the Question Library with VividForms 3 Phase 2 Implementation of Surveys 3 1 Survey Procedures Class Climate supports a number of procedures for processing completed paper ques tionnaires as well as online surveys The goal of these procedures is to make processing returns as smooth and anonymous as possible 3 1 1 Cover Sheet Procedure With the cover sheet procedure cost savings can be achieved through the production of larger quantities of questionnaires in printing shops When using blank questionnaires it is not possible to determine which course the responses are intended for and so a cover sheet is necessary This includes information on the course and in the lower area the operation number is printed twice Scantron Corporation 107 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Evaluation Sheet Subunit Business Studies Program of Study Business Studies industrial JEngineanng and Management Instructor iProf Dr Adam Smith pe Ta h Ea haft Poms ati io hep opimo Ba cling rena d Course Introduction into Imi ne I as abou the un
128. columns Apply Cancel Figure 471 Define the Number of Lines in the Questionnaire Header The logo in the questionnaire header can also be replaced by your own logo By default the logo defined as the standard subunit logo is displayed To integrate a custom logo into the questionnaire header click on the existing logo The logo assistant opens auto matically Here you can choose whether to e use the standard logo subunit logo or e use your own logo Under Use own logo you will find the logos and pictures which you have already uploaded into the Picture Library in the menu Form Properties in the Editor Control If you have not yet integrated any pictures e g logos into the Picture Library you cannot select your own logo To upload pictures to the library please see Section C 2 10 1 Upload Pictures to the Picture Library In the area Position in questionnaire header it can be determined whether the selected logo should be displayed on the left or right side of the questionnaire header Further more in the Vertical Alignment the orientation of the logo in the questionnaire header top middle bottom can be defined In the area Scale of the box width in the size of the logo can be adjusted At a size of 100 the logo can occupy the entire outer third of the questionnaire header If the percentage is decreased the logo is scaled down accordingly 402 Scantron Corporat
129. data e Adding a course and editing a course e Raw data export through archiving 68 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 1 Preparation of a Survey Period In the following figure you can see the user specific fields in the details of a course All pre defined contents are shown here in a drop down menu If necessary the content of a field can also be entered here directly Edit course of Dr Richelle White Course name Introduction into Sociology Program of study Course ID 02 P1246 Evaluation period continuous v Course Type Lecture n Location R P 061 Enrollment 80 Participants data Anonymous survey participants O Non anonymous survey participants panel Administrate participants Language english Location Media amp lnformation Center Further report recipients secondary instructors Y existing Computer Sciences Donna Harwood Add Professional Development Donna Harwood A Remove OK cs Cancel Figure 46 Course User Data Fields in the Details of a Course Editing Participant Data In the details of a course you also have the possibility of editing the participant data of a course In this area you can e manually insert participants into a course e delete single participants of the course e process existing participants e delete all existing participants
130. display ok Cancel Figure 589 Restricting User Licenses in the Details of a Subunit 1 9 Performance Considerations The following paragraphs offer several references with regard to optimizing system per formance 1 9 1 Performance Statistic In the menu System Information System status you will find details to the current sys tem utilization The performance statistic shows the time needed to execute an internal function which is called up every minute Thus it represents an indicator for the work load of the system at the respective time of measurement When a series of measure ments are located in the red zone for a longer period of time this indicates a state of overload which can impair system performance for users or participants in online sur veys From these statistics subunit administrators can make decisions regarding opti mization of peak access times 476 Scantron Corporation Copyright Electric Paper GmbH Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM Access peaks can be optimized by the following points For example the access time for online surveys can be optimized by starting the surveys on different days Apart from that the participants of online surveys can receive information on off peak times with the instruction that participation should take place at these times In addition Subunit administrators can move heavy tasks such as verification c
131. eee Nn to create javascript reaction to a value for example bthis gt getMultiOptions returns all options of a question if existing pthis gt ge ass e e whole c multiple classes get separated by space it will also give you some information about where you are in the code even or odd item for example which you might use to create action according to this information pthis gt adc adds an additional class to the current element you might Class sClass decide that you won t display a question in the same way if the label is short or very long so you could define a specific class in your CSS file for long labels and insert this class after having tested for the length of the label pthis gt getTemplatePa returns the URL to the template directory of the current tem a ani iate Useful for routing to images or extra CSS files Is gt placePar N tial sName inserts a partial template a e calling position should not contain a path or an extension This is typically used for mentioning required questions or validation rules specific to some questions pthis gt getErrors returns an array of error objects for the user like this ques tion was required but not filled in or this field should be completed only with numbers rules that are defined through the VividForms Editor Designer Table 8 Functions for Advanced Template Editing The creation of advanced design templates is also offered as a profession
132. ence decent tea S E AE EEE AOE A 4 USE OF THE QUESTION LIBRARY WITH VIVIDFORMS secerneren 4 1 ADDING A QUESTION FROM THE LIBRARY cccccecseeseeeeeesueseeseeeeeuueeeeeaeeeeees 4 2 UNDOING THE CONNECTION BETWEEN A QUESTION AND THE LIBRARY 4 3 ADDING A QUESTION TO THE LIBRARY c cccccccceecsceseeeseeceuueeeeeueeeuuueeseueeuenes Class Climate COURSE EVALUATION FEEDBACK SYSTEM Scantron Corporation Copyright Electric Paper GmbH l m Class Climate COURSE EVALUATION FEEDBACK SYSTEM 4 4 DELETING A QUESTION FROM THE LIBRARY ccccccceccecseeceucsceceeeseuceueceuueeuueeuseuueeaeeueeeueueeeneess 446 4 5 ADDING A GROUP TO THE LIBRARY ccccecccsceceeeceecseeceeeseuceeeueueeaseuuueuueeueeueeeueeuaeeuueaueaeeeaees 446 4 6 DELETING A GROUP FROM THE LIBRARY ccccceccecscecseeceueseeueueeeuceeueeuueeueeueeeuuueaeeueueaueeueeneess 446 5 FILTER SETTINGS VALIDATION REQUIRED QUESTIONS CROSS TABULATIONS accer 447 5 1 GENERAL INFORMATION 0 cccccccccecccecceeccescceseceeeeceeueecueeeceeecesueeaueneeesuceeseneueceeeaeeneeesaeeaeeneeens 447 Zc Wr ETTING S snaa NEE E ces ce nce ee sane ates E tesco ane eae ogee 447 is AIDA TIONG osanaan E A A a a E E 449 5 4 REQUIRED QUESTIONS cccccccccccceccecceceeccecuceeueeeeuseueneseueuseueceneeeusueaaueuseeueeeeusaeeeseusaueeueass 450 ome me CROSS TABULATIONS srncie ean E E EAER 451 6 DEFINING GENERAL TEMPLATES ccccccccceccecsceceeeceuueeuce
133. enter as described above the details of the language and save these entries Afterwards you can translate your questionnaire Translate Questionnaire After a click on Save you will see the complete contents of the questionnaire i e ques tion groups question texts pole labels and answer options On top of the entry boxes the texts of the main language are displayed in the text boxes you can now enter the translations see picture above The translations are saved automatically by Class Climate Under the button Save at the end of the page you can see at any time when your translation was last automatically saved by Class Climate You can also make changes in language texts and in the language attributes at a later point in time by selecting a language in the drop down Current Language editing the text and then saving the changes 100 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Question Text The instructor is always well prepared Left Right Der Die Lehrende ist immer gut vorbereitet The instructor explains even complex topics in a comprehensible way Der Die Lehrende erkl rt auch schwierige sachverhalte verst ndlich The instructor handles the technical equipment video projector etc without any problems Der Die Lehrende bedient die technische Ausstattung Beamer etc ohne Probleme Please grade the instructor for this course poor very good abst Bi
134. extend it as needed A placeholder may not be contained completely by the replacement text or represent an entire word Example Course may not be abbreviated to C but may be abbreviated to CS We recommend using special characters as a prefix for placeholders for example CS Edit Placeholder it is better to use placeholders with special characters as a prefix e g CS as individual letters or letter combinations can also be found in other words and can lead to erroneous replacement Print Version Placeholder Replace by ORG Organization 4 CO Course P 4 Figure 227 Data Entry Assistant Placeholder lf a statement that has already been classified is entered along with a new statement then the existing statement can be marked with a checkmark and only the new statement need be entered Both statements will be registered and counted After the last image has been entered a corresponding note appears and by clicking Survey list the data entry assistant can now change to the tracking information on he surveys that still need to be processed Scantron Corporation 221 Copyright Electric Paper GmbH Class Climate You have processed all images and can now switch to the survey list by clicking the button List of Surveys List of surveys Figure 228 Data Entry Assistant Close a Survey If desired the data entry assistant can send the PDF report to the owner of the survey usuall
135. following figure you can see the display of the name of instructors in an online sur vey as well as on a paperbased questionnaire Questions concerning the Trainer Samantha Miller Advanced Reporting 3 1 How would you rate the trainer s overall teaching Excellent Poor methods 3 2 How would you rate the trainer s ability to set and meet Excellent Poor the objectives for the course Figure 449 Module Evaluation Display of the Instructor Name in Online and Paperbased Survey 3 Questions concerning the Trainer Samantha Miller Advanced Reporting 3 1 How would you rate the trainer s overall teaching Excellent 0 OF 0 0 O Poor methods 3 2 How would you rate the trainer s ability to set and Excellent O OF O O O Poor meet the objectives for the course Figure 450 Module Evaluation Display the Instructor Trainer Name in a Paperbased Survey e You can activate the display of the instructor name on the questionnaire in the Class Climate Settings To activate this option open the menu System Settings Class Cli 382 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM mate Settings and choose the option Survey from the drop down list Scroll down to the option Module Evaluation Display of name of the Secondary instructor in the heading of the question group and activate it Then save your settings by clicking the button Save at the bottom of the list Thus the names
136. for example for typos the write protect mode can be circumnavigated You can alter the write protected mode in the form creation information of a questionnaire as shown in the following graphic W Form Wizard Form creation information Abbreviation train_en Title Paper Ad Template Activate deactivate template mode New items can only be added at the end Max Pages 3 Max Items 47 Apply Cancel Figure 564 Write protect Mode in the Form Information 456 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Editing and Passing on Questionnaires COURSE EVALUATION FEEDBACK SYSTEM Note By editing this form questions can change their position which will make it impossible to evaluate old forms or forms currently in use This warning is to be strictly observed It is generally not recommended to make changes to forms with surveys We recommend that before activating the editing mode you make contact with our support team 7 2 Automatic Recognition Set Management As soon as a survey has been created using a VividForms questionnaire VividForms expands its recognition set to assure recognition In order to ensure that all returning questionnaires can be correctly processed it is only possible to delete a questionnaire when simultaneously deleting all surveys based on that questionnaire This is done automatically when the delete function in the question naire a
137. for open questions When activated the CSV raw data files also receive the responses collected to open questions Placeholder image files Output text for text boxes not yet validated Separators CSV import and export Defines the separators for CSV import and export Permissible semicolon comma tabu lator t and the vertical line Method password creation faculty import Rules for setting up new users through CSV XML import 0 User name password put on email address 1 User name password are generated randomly Activation status faculty import Rules for setting up new users through CSV XML import 0 Instructor account is deactivated after import Central Evaluation 1 Instructor account is activated after import Decentral Evaluation SPSS Missing Values This option defines if the abstentions in the SPSS export are defined as Missing Values 1 Abstentions are defined and exported as Missing Values 0 Abstentions are exported as ordinary values Scantron Corporation 513 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM If abstentions are exported as ordinary values they obtain the value 0 When calculating a mean value of all the results in SPSS the abstentions contribute to the mean value and thus distort the result For that reason you can define the abstentions as Missing Values when being exported to SPSS If you
138. function allows you to save the current search settings under a name you enter or to replace an existing search 366 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 5 Quality Management COURSE EVALUATION FEEDBACK SYSTEM e Delete search This function lets you remove self defined search settings Defining the Display and Search Fields Using Field selection in the option field will display the database fields defined for the current search In this example the fields are from the pre set default search The fields appear twice In the upper area the fields needed for the table view are marked In the lower area those fields appear which are to be searched using the Search field The selection of the search fields should include only those fields to be dis played Filter Selection Standard Field selection 50 Show Field Configuration Select query result fields Survey Course nstructor Questionnaire Survey Description V Course Description Scanned Forms Enrollment F Wi Last name ate Form Description vi Quality Index v Location e i Subunit W First name Wi Form vi Survey ID vi Program of Study Y Scan Date v Period Select search fields Survey Course Instructor Subunit Questionnaire Survey Description Course Description Scanned Forms _ Enrollment Last name Form Description Quality Index Location Subunit _ Fi
139. in relation to the overall quality index The weight defines the maximal possible deduction in percent that this guideline can have on the overall quality index 346 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Phase 5 Quality Management Edit quality guideline Figure 406 Edit Quality Guidelines The quality guideline is saved with Save and subsequently questions can be added to it Usually questions on one topic area are combined in a quality guideline Figure 407 Definition of the Quality Guideline Adding Questions You can set up quality guidelines based on averages or based on frequency Both types of guidelines can even be combined within one quality guideline and for the same ques tion In this case the worst result determines the traffic light color in the PDF report Scantron Corporation 347 Copyright Electric Paper GmbH N 8 In addition to this quality guidelines can be set up without defining them manually by directly converting them from indicators or from existing norm values of the question naire The following subsections explain these options in more detail Note Both the threshold values and the weighting in percent of the individual questions for a quality guideline can be changed anytime after setting it up In order to do this enter the new values and click on Save changes Average Based Quality Guidelines In the above ex
140. in the drop down menu 312 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy gt Class CI mate Phase 4 Advanced Reporting E Raw data in SPSS format 3 Raw data in CSV format Profile Line Profile Line train_en train_en_1 Summary Reports train_01 train_en Summary Reports Economics W S10 11 Summary Reports Belmore WS 10 11 Summary Reports Report of Train_en Summary Reports a Prof Dev Economi Summary Reports Prof Dev Economics Summary Reports Hernandez ws 10 11 Summary Reports _ Hernandez Belmore WS Summary Reports Back Subgroup Male from R Summary Reports Male Business Stud Summary Reports Overall Report weigh Summary Reports Overall Report unwei Summary Reports Figure 358 Report Creator Detailed View Selection of a Comparative Profile Line Via the option Merge reports the report can be combined with further reports and via the option Evaluate subgroup it can be filtered according to a specific aspect You can obtain further information on this topic in the chapter on combinations and subgroups Further possibilities of comparison are described in the following chapter 5 2 3 Dispatch of Comparative Profile Lines You are already familiar with profile lines from the automatically generated PDF reports They give
141. is activated the overall indicator will not be displayed Left Pole for Indicators Text for the left pole of the indicators Default value of the left pole is The pole is also displayed in the presentation template Right Pole for Indicators Text for the right pole of the indicators Default value of the right pole is The pole is also displayed in the presentation template Scantron Corporation Copyright Electric Paper GmbH Class Climate e Display Cronbach s Alpha Activates deactivates the computation of Cronbach s Alpha internal consistency for indicators Please note that Calculate indicators must be activated e Show legend Display legend in PDF report e Values legend Values given in the legend The number of values must match the scale divisions e Divisions legend Scale divisions of the legend e Show bar diagram with histogram Advanced results bar for scaled questions When bar diagram is activated the mini histogram should be deactivated e Separate closed open questions When activated the results for open and closed questions in the PDF reports are dis played separately This results in better readability particularly of those reports cre ated with a mix of open and closed questions e Show text boxes If activated the text fields of VividForms forms will be shown in the PDF Report e Show Quality Indices traffic light view When activated the quality indices of the items w
142. is taking place with non anonymous participants 188 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM Survey Details gt Survey Managing and maintaining a healthy lifestyle amp Instructor Philipp Belmore J Course Managing and maintaining a healthy lifestyle g g Survey Period ssi Type Online survey using PSWDs amp No of PSWDs T of T PSW0Ds are still available Questionnaire train_en Status In progress ready for data Survey Created on 05 12 2011 at 16 42 41 Figure 179 Reference of Non anonymous Participants With non anonymous online surveys you also have the possibility of indicating the status of anonymity in the footnote of the email For this you can use existing standard texts from System Settings Text templates Editing of text templates Action Class Climate Welcome text for the first login of instructors a E MAIL Certificate of participation for online surveys E MAIL Cover sheet for instructor E MAIL Data entry for instructor Footnote for anonymous online surveys E MAIL Footnote for non anonymous online surveys E MAIL Form for instructor E MAIL information about result access to participants a Language English Higher Education w Mail text Note This survey is non anonymous If you take part in this survey with the above named PSWD your giv
143. licenses available can be undertaken directly in the details of a subunit In the area Assign user licenses the administrator can adjust the number of licenses retrospectively or define this directly when creating the subunit The subunit administrator cannot make any of his own settings here He can however see in the subunit details how many licenses are available to him and how many have already been used Once a subunit has reached the established limit of user licenses no new accounts can be created The same is true when moving users into subunits whose contingency is already exhausted When creating a new subunit a warning is shown if all accounts have already been distributed elsewhere Scantron Corporation 475 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 Subunit details Subunit Name Business Studies Dept No 2 Logo File system logo Edit Phone Fax Street Address ZIP Code City Email Online survey template default Server address for online http 192 168 245 129 classclimate online surveys of this subunit Subunit visibility Unrestricted Show the subunit in the context menu Subunits Handling of handwritten texts O Direct display default setting Display after manual collection note customizable threshold System settings Class Climate Settings Surveys lt Never
144. meals in the refectory are always fresh Ce ee eee CJ The meals in the refectory are always tasty El th tl ia oO 0 The university is connected to the public L A U O O L CJ transportation very well Figure 540 Questionnaire with Adjusted Color Scheme 3 Repair Form When editing large questionnaires it may occur in rare cases that the order of the objects gets confused In such a case click on Repair Form in the Form Properties menu of the Editor control The questionnaire will be rebuilt 4 Use of the Question Library with VividForms You can integrate both question groups and questions from not yet implemented ques tionnaires as well as protected questionnaires into the question library In the following the procedure for adding the question groups and questions is described in detail 4 1 Adding a Question from the Library Click on the symbol in order to adopt a question group combination from the question library W Question Library Assistant Question Group Selection Question Group Course Evaluation instructor Evaluation Excellent Very Poor instructor Evaluation Poor Outstanding Instructor Evaluation Strongly Disagree Strongly Agree Back Next Apply Cancel Figure 541 Question Library Selection of a Question Group Scantron Corporation 441 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION
145. next to the question text or beneath the question text For questions with more than 11 answer options only the option beneath the question text can be selected The option Default Questionnaire Layout refers to the settings defined in the menu Form Properties Layout settings Further information can be found in chapter C 2 11 Layout Settings After all options have been entered click on Apply The single choice question will now appear in the preview and will be automatically high lighted 1 Questions about you What is your age 018 29 030 39 140 49 150 59 060 69 LlOlder than 69 Figure 506 Single Choice Question in the Preview The ability to limit the number of possible answers is a specific feature of multiple choice questions The value Max is predefined with zero which allows all options to be selected Enter a number here to limit the available options Question Wizard Define Options Option B I U Add option Option List i t because am interested in the topic a 2 because need to earn the credit hours a because the instructor is really good Lt because is important for my professional life a for the preparation of my exam l Back Next Apply Cancel Figure 507 Multiple Choice Question Enter the Answer Possibilities In the Editor preview multiple choice questions are marked with a red MC This is of course not visible in t
146. no longer appears upon login Mail Service requires at least Version 2 0 of the Net Framework on the server Setup checks at installation and reports if preconditions are not fulfilled In the service adminis tration of Windows the service appears as ESCCMailService 1 12 3 VividForms Log File The VividForms Reader protocols all processed questionnaires in this text file You can find it in the program group in the VividForms Reader If the debug mode in the Vivid Scantron Corporation 483 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Forms Reader has been activated then the protocol will receive very detailed data about the form processing operation 2 Configuration Settings 2 1 Text Templates Provided they have the setting in their configuration Class Climate sends emails to users for a number of reasons The texts for these emails can be edited here Alongside the texts for emails you can also define texts for cover letters which are used in PDF reports By using a placeholder you can personalize these automatically created messages for your recipients If desired emails can be sent in HTML format and be edited with the help of HTML tags You can continue to define attachments for emails and templates for PDF letters These documents must be first uploaded into the system Please note that these settings can be made on two differen
147. of Participation for Online Surveys Confirms the participation in an online survey with date and PSWD Note To enable the creation of this PDF document a PDF template has to be created uploaded and attached to the template Certificate of Participation for Online Surveys see B 2 3 2 2 1 5 Placeholder for Texts Dear Mr Example You will receive as attachment to this email the report to the survey Introduction to Sample Sci ence Your Class Climate Administrator This is a message of the type Survey Report to Instructors Using placeholders defines this message type as follows 492 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Configuration Settings SALUTATION TITLE SURNAME You will receive as attachment to this email the report to the survey SURVEY Your Class Climate Administrator Here is a list of all permitted placeholders for email texts as well as PDF letters SALUTATION TITLE GENDER FIRSTNAME SURNAME SURVEY FORMCOUNT PERIOD_NAME QUESTIONARY DIMENSIONS SUBUNIT ADDRESS COURSENAME COURSEID PROGRAMOFSTUDY COURSEROOM COURSEENROLLMENT COURSETYPE CUSTOMFIELD X CURRENTDATE SURVEYCREATIONDATE LASTCAPTUREDATE Scantron Corporation Copyright Electric Paper GmbH Form of Address Example Dear Mr or Dear Ms Title Example Prof
148. of the course and e import all participant data directly for this course via CSV Import Scantron Corporation 69 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM The participant data differentiates itself depending on whether you are conducting the course anonymously or non anonymously In anonymous surveys the participants data only contains only the participants email address which you require to send PSWDs in online surveys In non anonymous surveys you can specify further details By default courses are evaluated anonymously in Class Climate If you wish to conduct non anonymous surveys specify this in the details of the course Edit course of Dr Richelle White Course name Introduction into Sociology Program of study Course ID 02 P1246 Evaluation period continuous Course Type Lecture Location R P 061 Enrollment 0 Language english Location Media amp information Center v Further report recipients secondary instructors v existing Computer Sciences Donna Harwood Add Pro fessional Development Don na Harwood Remove OK Cance Figure 47 Editing Participants Data in the Details of a Course Specifying Participant Data in Non anonymous Surveys In non anonymous surveys in addition to the email address you can also deposit other information such
149. of the following download methods e Dispatch of the profile lines to the instructors of the marked courses This option ensures that each instructor is only sent the profile line of his or her course if selected with the first and second comparative lines that are inserted into the graphic If you mark the option Additional recipient you are presented in a further field with the possibility to enter further email addresses Separated by a semicolon Request Method Send comparison line to the instructors email account s Additional recipient 5 Send all comparison lines to one email account Single PDF file E Single PDF file as download CB POF files in an archive as ZIP file download Figure 362 Report Creator Profile Line Emails Send a Comparative Profile Line e Dispatch of the profile lines to defined recipients As described above enter the email addresses of the desired recipients In this case however the instructors of the selected courses do not receive your email Scantron Corporation 315 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM e Download of the profile lines If you choose this option you can subsequently open and view the profile line directly or save it Request Method Send comparison line to the instructors email account s V Additional recipient Additional recipient j doe example com F
150. of the report creator in the PDF Report of the report creator Scantron Corporation 497 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 2 Documents Documents can be saved in Class Climate for a number of purposes as documents for attachments to emails created in Class Climate or as documents for PDF letters The administration of documents and files is done centrally in the menu item docu ments The following functions are available e Uploading files to the Class Climate server e Displaying documents e Updating documents e Deleting documents from the Class Climate server System Information 5811 hii be Class Climate Subunits Questionnaires MAUS tonnes TANKENE PENNAC FEEN 2 Documents useable as email attachments Class Climate Admin paini 1 Description File name Browse Instruments Text Templates y L F Documents Gas Report Settings Onine Templates gt PDF templates Configuration i Class Climate Settings File name aS Define Tree Structure Evaluation letter Sample 1 new Custom Cover Letter Sample pdf g Course Types Evaluation letter Sample 2 Custom Cover Letter Sample net 7 Periods pustom Ties E j k IB custom Title Description File name E Process Detauits Browse Ej Web Service Settings iS orci cn Figure 604 Document Administ
151. on reports filtered according to subgroups Because you can save the reports as PDF files at any time and thus keep them available even after an update The dynamic subgroup reports are only available through active instructor accounts meaning that report creators cannot use this function Open the details of a survey and in the area survey data click on Evaluate subgroup Subgroup name Subgroup Female from Graduate Survey 2011 Create Note Data compilation may take a moment Please click the button only once Figure 203 Creating a Dynamic Subgroup Should this option not appear please download the HTML or PDF analysis first and then click on Update Below the name of the subgroup the automated update can be specified by means of the checkbox Automatically recalculate subgroup report Scantron Corporation 203 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Dynamic subgroups are marked with the symbol normal subgroups with the symbol HTML Subgroup Female from Data lt i es 7 CSV al Graduate Survey 2011 agaitaiie train en 05 16 2011 05 16 2011 003 cS BB choose pat report spss ap E a Pp aes Hep Dek P 2 __ 95 16 2011 05 16 2011 002 BB choose ee Graduate Survey 2011 available train_en SPSS Figure 204 Dynamic and Normal Subgroups in the Survey List When new data is collected during the main survey the example showing Demo the s
152. on the button Cre ate new folder a Business Studies COUN CUALOATION FLLDDAEN SYSTEM 811 7 dip y Listing of folders LA AA Maria Report Repon Creator Create new Folder Figure 289 Report Creator Creating a Folder Scantron Corporation 273 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM After clicking on the button a window appears in which you can name your folder New folder Summary Reports 2011 OK Cancel Figure 290 Report Creator Naming the Folder Here a neutral name was chosen General Summaries 2011 However according to the type of your summaries planned you should choose a suitable structure for your fold ers You could for example arrange the reports according to years and choose names such as Surveys 2011 etc y Listing of folders Name Contents creation Rename Delete C Summary Reports 2010 0 Reports 0 evaluated 05 18 2011 Rename x Uv Summary Reports 2011 0 Reports 0 evaluated 05 18 2011 Rename d Figure 291 Report Creator Folders structured According to Years The university s or company s structure also makes for a possible organizational criterion for your folders It suggests names such as Reports Business Studies or something similar y Listing of folders kane c Date of re Name Contents creation Rename Delete Computer Studies 0
153. only released for paper sur veys only the paper view is displayed when opening the sheets If the sheets are only released for online surveys only the online view is displayed The button for switching is then no longer available 2 3 1 Paper View In the paper view the display of the questionnaire is simulated as a paper survey This view can be adjusted by different control elements You can use the symbols and to zoom in the preview window to four different levels Below you can see examples of different zoom levels Select the one best for your screen resolution 392 Scantron Corporation Copyright Electric Paper GmbH LN a thy Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM After zooming to fit the preview to the size of the chosen window click on the icon with four arrows Tech_01 Questionnaire on Technical Skills Editor Control 3 Ca Add Question Group E d J Add Question F Pole Labels GAN JIL z4 Extended Pole Labels wee ee Line Space 1 Questions about you You are DO mate O temae Separator What is your age O18 2 O32039 4049 E Text Box 050 59 Deos C Oker than 85 Your Zipcode 0000000 0000 Picture D0000 00000 z ganung TEE eeeaaaeees Clipboard PC Stilts am abie to create edit a word document Fulyagee O O O OF O Fully disagree Move bh am able to create edit a presentation
154. or if the settings of the scanner have been unintentionally changed then further processing of the survey may be impossible Class Climate is set for maximum automation A number of manual checking and correc tion steps which are crucial for the processing of complex questionnaires like invoices have been automated for the processing of questionnaires used in teaching evaluation surveys which are relatively simple to read Before beginning a capture session we recommend testing that the operation is correct by scanning test questionnaires If everything is ok then provided that the paper and print image quality remain the same you can proceed to large scale capture of forms 4 1 Scanning the Forms The capturing of forms is performed with the help of the software Class Climate Scansta tion The communication with the scanner uses the TWAIN protocol To capture questionnaires put the forms into the feeder of the scanning device and open the Scanstation The scanning process is initialized by clicking the button Scan The fur ther processing is fully automated Via the button Settings the Scanstation can be configured if required Via the button Manual a detailed documentation can be opened For further information on the scanning process as well as on the settings of the scansta tion please see the Scanstation Manual which can be opened via the Scanstation inter face or via the Class Climate menu System Inform
155. order to print the completed questionnaire The ques tionnaire must be saved temporarily before printing Another feature is the filter tool which allows you to define skipping rules in order to avoid showing irrelevant questions Scantron Corporation 109 Copyright Electric Paper GmbH lass Climate The participant has responded to a question whether a presentation program was used with no Any following questions about the quality of the presentation program should not be answered in order to avoid falsifying the data lf an online survey has an insufficient response rate a reminder function can batch email the participants with a reminder to complete the questionnaire The anonymity of the par ticipant remains unaffected Upon submission the system will save a time stamp which is available through the raw data export for each dataset This information can be used to analyze the respondent behavior The option certificate of participation is available to allow the participants to prove their completion of the survey This certificate can either be displayed as a PDF document after submission of the form or provided through an email with a PDF attachment The certificate can only be mailed if the PSWDs were sent out by email in the first place The option of displaying a PDF certificate in the browser requires the creation upload and attachment of a PDF template see B 2 3 2 Online surveys are symbolized w
156. particular instructors and courses Therefore you require the instructor of the course as an element within the Class Climate structure These instructors are managed centrally by the administrator We talk of a passive instructor account when only the administrator can access the instructors for example in order to create surveys centrally for the instructor s course If the instructor himself is additionally authorized to log on to create questionnaires or sur veys we talk of an active instructor account also see chapter A 2 3 2 Active Instructors Accounts Questionnaire In Class Climate the term questionnaire can have two meanings e Firstly in Class Climate it refers to the file which serves as a template for a question naire and determines the layout of a questionnaire that is used for numerous surveys In this case it is a PDF file that contains the questionnaire and determines which options for questions and responses appear in what design on the questionnaire This template can be used for creating both paper and online surveys however in the case of online surveys with VividForms questionnaires the design is not defined through the questionnaire Therefore the footer of a VividForms questionnaire con tains for example the word DRAFT instead of a barcode This is what is usually referred to when a questionnaire is mentioned in the manual 24 Scantron Corporation Copyright Electric Paper GmbH
157. per page can be selected which are also available for the real online survey If for example the display mode per page was selected tabs are then shown by which one can skip between the individual pages of an online questionnaire Qa B standard Editor Control 2 f CD Glass Climate form Pronertiec lt ml el TUDE Tt Beef awe ee res ORGANIZATION Form Properties a SUBUNIT Repair form s 3 Enable numbering 1 Questions about you q Edit Pole Template You are Filter settings male female EE Validation Required questions Cross What is your age tabulation 18 29 30 39 I 60 69 Older than 69 Picture Library Online survey templates Your Zipcode Class Climate Online Survey Te Display PC Skills Per Chapter Per Page am able to create edit a word document Figure 462 Display Modes for Online Questionnaires lf customized online survey templates were created on the basis of the Class Climate standard template cf here chapter B 3 2 7 Effective Management and Conduction of Online Surveys the online questionnaire can also be presented in the design of the customized template To do this select the desired template under Online survey tem plates in the form properties 394 Scantron Corporation Copyright Electric Paper GmbH Piimata Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK S
158. ple a bar diagram for the single choice and multiple choice questions depending on the setting a histogram for the scaled questions the handwritten and or typed com ments on the open questions and so forth e The elements which the administrator has set in the menu System Settings Report Settings Configuration also appear in these reports Exceptions are the letter which Scantron Corporation 279 Copyright Electric Paper GmbH fT Class Climate the report creator does not produce as well as the header area of the report which can be modified in the text templates section under Settings in the Administrator inter face e lf for relevant questionnaires extended PDF report definitions or multilingual question naires exist these settings also apply to the summary reports that are produced for the respective questionnaire This means that you can also download an adjusted and or multilingual report Re gt p i Jort rtc da ta tax Results in HTML format Results in PDF format Class Climate PDF report Standard Class Climate PDF report PDF Report Plugins Class Climate PDF report Class Climate PDF report Copy individual report Figure 298 Report Creator Report Selection Results in PDF format Class Climate PDF report v Spanish m Deutsch ie Figure 299 Repot Creator Multilingual Reports e Also the usual export options are available CSV and SPSS
159. pt size of the answer boxes Spt Font Arial x 5 8 Oe e Figure 529 Accommodate Line Height Font Size and Font With the line height you can change the vertical space needed for a line This could be necessary if for example a questionnaire does not quite fit on two pages Decrease the line height and you will be able to make do with two pages On the other hand a questionnaire that is not quite filled can be made to look better by increasing the line height The font size affects all question objects with the exception of chapter headings These should not be made too large The following font types are available e Arial e Georgia e Tahoma e Times New Roman e Verdana Please examine the PDF sample issue after changing the font type using the PDF pre view to make sure that all texts appear correctly If not you may have to reduce the font size Scantron Corporation 433 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 9 6 Filtering of HTML Tags You should be aware of the implications of your changes and always check them Only then you can ensure that your online surveys appear with the desired layout and func tions With online surveys in addition to highlighting you have other formatting options with bold and italic fonts and underlining You can use HTML tags for the formatting for online sur veys only
160. quality guidelines are only available for scaled questions By using such an overview executives within an organization such as a dean are able to put together and assess a number of evaluated courses and access detailed reports if desired Scantron Corporation 345 Copyright Electric Paper GmbH Class Climate The subunit administrator sets quality guidelines for a questionnaire by allocating a weight and a threshold value to each question or question group that will subsequently be used in the calculation of a quality index For an evaluated topic or course this quality index can be between 0 and 100 6 2 1 Setting Quality Guidelines Quality guidelines are set in the questionnaire details Choose the option Quality Guide lines in the drop down menu Advanced Settings and click on Edit Any quality guidelines or their question groups respectively that have been already defined appear in the list These are one or more questions that have individual weights attached as well as a group weighting for the quality guideline Existing quality guide lines can be edited or deleted One way to set up new quality guidelines is to set them up man ually via the button New Course Evaluation Questionnaire Re calculate all Surveys Figure 405 Button New to Set Up New Quality Guidelines Manually In the view that opens a name and description have to be entered and a weight has to be assigned
161. red arrow eF Dual Scale The combination of quality and importance dual scale is a frequently encountered ques tion type The purpose of the combination is to separate the important cases from the unimportant ones Bad and unimportant as well as good and unimportant cases should be disregarded as negligible The dual scale is helpful in that it separates the relevant and irrelevant areas of a survey therefore aiding target oriented decision making It is also a useful function for testing new items In the following example a scaled question was first inserted on the quality of the techni cal equipment Then a second scaled question was inserted on the importance of the 410 Scantron Corporation Copyright Electric Paper GmbH 7 AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM technical equipment By activating the option Combine to dual scale with previous ques tion both of these scaled questions are linked to each other tW Question Wizard m Define Options Abstention deactivated w Checkboxes opooo0oonoogo w sprains pole labels Right a Inot important P q a mC Type of Diagram Histogram Use these settings as default for scaled questions E a settings to all is scaled en Define settings Figure 487 Combining Scaled Questions with each other Dual Scale In the VividForms Editor the activation of the dual sca
162. report creator only has access subunit wide To change the standard setting choose at this point system level Data access own subunit Assign additional subunits Computer Science Figure 285 Creating a Report Creator Step 3 As soon as you confirm your input by clicking on Save the report creator appears in the user list GR Users in subunit Economics amp Maria Report Report Creator o 070 05 18 2011 ia A ry o Select all Move selected to Computer Sciences Figure 286 Report Creator in the List of all Users Give the login name and password to the person acting as the report creator They can then log in Of course you can also use this account for yourself Scantron Corporation 271 Copyright Electric Paper GmbH mate Login and First Steps In order to be able to log on as report creator open the usual Class Climate start page It looks just like the one shown in the following User name Password OK Figure 287 Class Climate Login Window As soon as you have logged on here the start screen of the report creator appears offer ing you on the left hand side a menu with various options e The option Reports allows you to download reports on indicators which give the uni versity management and or the management of your company an overview of the assessment the courses e By the option My profile you can change the user data of this report c
163. results in teaching are not bad since most courses have been give evalu ated as good on a raw value scale between 1 and 7 at 5 So this is at least a satisfactory score How could you continue to improve the atmosphere as judged by students friendly manner with students cooperative and instructor is open Particularly in courses with interactive teaching is this an important aspect Below average score Comparative norms always place 49 99 of the values under the average and 49 99 above But for norm values below 85 you should definitely take action It is important not to be discouraged or to make those circumstances you can t change responsible The best attitude would be to use this score as an impulse to continue to improve your teach ing How can you continue to improve the atmosphere as judged by students friendly manner with students cooperativeness and instructor is open Particularly in courses with inter active teaching this is an important aspect es As an alternative to manual entry of norm values you can also make use of existing eval uations that you have already created with the user type report creator In the section Edit norming types click on the button Edit 344 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 5 Quality Management COURSE EVALUATION FEEDBACK SYSTEM Norming types Minimum _ Ear Slightly Slightly Far Nea Maximum value Below B
164. scheduled tasks To stop the services the following commands can be used e net stop vfreader e net stop cron 34 Scantron Corporation Copyright Electric Paper GmbH X Class Climate e net stop memcached e net stop esccmailservice To restart the services after the backup use the command net start Please backup this folder too 3 3 2 Backing up the Image Files of the Open Questions The answers to open questions are saved as PNG image files You can find these in the folder C Apache htdocs ClassClimate img Here you will find the images of the open questions as well as the images which are shown in the verifier The folder structure is defined as Survey period subunit user survey Before you backup these files we recommend that you stop the Apache service and then restart after finishing 3 3 3 Backing up the Original Image Files from Scanstation The Class Climate scanstation software can create a backup copy from every batch You can make this backup copy in an archive folder defined in the Scanstation The exact path to the archive directory can be found in the Scanstation settings tab Scan Destina tion For further information please consult the Scanstation Manual Scantron Corporation 35 Copyright Electric Paper GmbH Preparation and General Notes 36 thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM Scantron Corporation Copyright Electric Paper GmbH X Class Clima
165. settings to all other scaled questions _ Define settings Figure 491 Scaled question Apply settings to all other scaled questions m Apply settings to entire questionnaire current question group Apply Cancel To apply the settings close each of the opened windows with the button Apply 2 6 3 Open Question Select the question type open question and click on Next You can now enter the text of the open question tW Question Wizard Question text BIU Y S What did you particularly like about this course Back Next Apply Cancel Figure 492 Open Question Enter the Question Text Now click on Next and choose the size of the comment box depending on the number of lines needed For paper based surveys any number of lines up to the whole remaining page area may be selected Box Size The maximum number of characters allowed for the answer can also be defined for online surveys Maximum number of characters If you enter the value 0 the participants in online surveys can enter text of any length Scantron Corporation 413 Copyright Electric Paper GmbH Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM W Question Wizard Define Options Box Size 5 5 lines left on this page Max number of characters Online 0 Survey Handwriting recognition Characters A
166. show a list of all the surveys and form return numbers for the selected parameters 1 8 License Administration 1 8 1 Overview on the License Administration The license administration gives you an overview of the properties of your Class Climate license Here you can see information about the product version the database and about the activation of the paper and online surveys In case you have licensed the handwriting recognition open questions of VividForms questionnaires can be processed automati cally In addition you can see the number of available scanstation and user licenses and if you have the corresponding licenses the administration of VividForms Designer licenses In the license management the license key which has been entered during installation is saved In case of a system extension by users or software add ons or in case of a change of name you will receive a new license key which contains the old as well as the new scope of services In this case please overwrite the existing license key and or copy the new one to avoid typing errors and click the button Save Should you have entered an invalid key the old key will not be lost Only a new valid license key will overwrite an existing key 472 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM amp License Management Class Climate Product Central Ev
167. summary of several indicators produces an index In Class Climate all indica tors of the questionnaire meaning this index for the total questionnaire are calculated into the so called overall indicator that thus forms a type of grade for the total survey The overall indicator is not formed unlike the individual indicators from the individual results The overall indicator is calculated by adding the individual indicators and dividing them by the number of indicators On your questionnaire there are three question groups which contain scaled questions Question group Instructor Question group Course Question group General assessment The answers show for the first question group an indicator of 3 75 for the second ques tion group one of 3 7 for the third group one of 2 9 The scale consists as mentioned of six response options with the positive values on the right The overall indicator for this questionnaire is made up from the addition of the three indicators mentioned as well as from the division by three number of indicators 3 75 3 7 2 9 3 3 45 The overall indicator is therefore 3 45 It is a reference to the survey s overall result On the basis of your scale a scale with six options and the assessment positives on the right you can now recognize for exam ple that the result sits to the right from the middle therefore it is relatively good SS SSS SS Scantron
168. survey procedures e Integrate individual questions Instructor s Operational Questions through feedback loop to the instructor Phase 2 Implementation e Mass production of individualized questionnaires for hard copy procedure Scantron Corporation 37 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM e Download cover sheets and dispatch envelopes containing pre produced question naires to instructors for cover sheet procedure Evaluation Sheet Program of Study Instructor Philipp Belmore _ Questionnaires om Date 05 11 2011 at 09 50 20 Number of returns Cover Sheet ee ETEF pi eas a at n Co Sa L fF F Figure 15 Cover Sheet e Generate and dispatch PSWDs for online surveys e Implementation of surveys and return of responses to the capture location all proce dures simultaneously Phase 3 Capture and Instant Feedback e Capture of questionnaires all procedures simultaneously e Reminder function for online survey participants e Manual anonymizing of handwritten comments if required e Automated delivery of report documents by email or internal mail OR e Download of the report documents by the instructor 38 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Phase 4 Expanded Reports e Create summary reports e Filter and combine reports e Mass dispatch of compar
169. system logo Phone Fax Street Address ZIP Code City Email Online survey template default Server address for online surveys Of itp 1 192 168 245 129 classclimate online this subunit Subunit visibility Unrestricted V Show the subunit in the context menu Subunits Assign user licenses IV unlimited Handling of handwritten texts Direct display default setting Display after manual collection note customizable threshold System settings Class lite Settings Surveys _ Never display 0K h Cance Figure 223 Activation of Manual Entry of Handwritten Comments The option Display after manual collection will hold back the answers of open questions until the captured images of the open questions have been anonymized Until then the PDF report only contains the answers to closed questions Scantron Corporation 219 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Create a user account of the type Data Entry Assistant and log in with the login data or as an administrator Subunit Administrator change to the role of Data Entry Assistant A list of all surveys containing images is displayed Data collection with anonymous handwriting comments Folder Hernandez WS10 11 Professional Development a shoe eee waiting 45538 Organization and Management 5 0 12 5 2011 11 59 Figure 224
170. texts can be fully acquired even if the participant has written outside of the box If necessary one can even zoom in making hard to read text more legible 220 Scantron Corporation Copyright Electric Paper GmbH COURSE S GH mat SYSTEM thy AN Class CI mate Phase 3 Capture and Instant Feedback Picture No 3 of 6 from survey No 45538 al Display the entire e questionnaire page Question Please give us your feedback about the instructor as well as suggestions for improvement Ne in hike ke hive dt Lench d i sied Ae fe ct yyece hee Figure 226 Data Entry Assistant Display the original scanned Page If you do not want the data entry assistant be able to see the entire page of the form this option can be deactivated in the Class Climate Settings System Settings Class Climate Settings Functions Data entry assistant Verifier View entire original questionnaire page To significantly speed up the data entry process shortcuts are available The following shortcuts can be used Alt S to save Alt C to cancel and Alt R to replace If the data entry assistant has already entered answers to open questions the system will only display those answers again that are relevant to the question currently being dis played For this reason not all of the answers already entered are displayed To avoid having to type often recurring words such as for example course or lab course you can create a list of placeholders and
171. the central system settings is set on the number of course participants System settings Class Climate Settings Survey Method of calculating the response rate Should a different number of participants be noted in a new survey period for a course surveyed several times i e by importing new participant data this number is adopted for surveys of the current and future periods Surveys of this course from past survey periods show the original number of participants in the survey details so that the response rates of past surveys are also calculated correctly In some cases it may be necessary to change the number of participants retrospectively if for example the number of participants needs to be changed for a period that has expired To do this the corrected number of participants can be deposited in the survey details and with a click on Accept saved for the survey The response rate appearing in the survey overview or in the survey details or in the PDF report is now based on this corrected number of participants Scantron Corporation 121 Copyright Electric Paper GmbH i Your Evaluation Process The Phase Model thy Class Cl imate COURSE ss Cli FEEDBACK SYSTEM Show PSWDs in a __ Receive PSWDs by email C Send PSWDs by email to respondents Download PSWDs in CSV File Generate more PSWDs 0 Number of participants for calculating response rate 20 Acce d Preview online survey Scheduled Tasks
172. the debug mode in the configuration is automatically deactivated Class Climate informs you of the deactivation of the debug mode 1 Information The debug mode is deactivated now Figure 612 Debug Mode Deactivated Successfully Changing the survey ID If activated this option allows changing the survey ID You can then change the survey ID in the details of a survey as long as the survey does not have any results questionnaire returns This option is available only for hard copy and for coversheet procedure Logging of system sessions The logging of system sessions provides an overview of the users and participants of online surveys currently logged into the system This function gives an insight into the current level of utilization of the system Display information of system sessions in the menu Display of the information concerning active system sessions in the menu of the Subunit Administrator This setting is only relevant when logging of system sessions is activated Measuring of performance values As a means of measuring performance values a graphic illustration of the system work load of the Class Climate server can be displayed at different times The diagram can also be adjusted for different periods Yellow limiting value for performance diagram Defines the lower limiting value in seconds for the yellow zone of the performance dia gram The area beneath is displayed in green Scantron Corporation 527 Copyright
173. the instructor account Target Address Target email addresses or internal email addresses the reports have been sent to Method Delivery method either email letter symbol or internal email paper symbol Sent Tells whether the report has been sent or printed Delivery date Date of the email delivery or the internal email print download 1 2 Writing Email This function gives you the possibility to send a message to all Class Climate users th iL COUEE COAL CATO PILARA SERIE C lass Climate Admin Administrator EJ j Class Climate Subunits Questionnaires System Settings Search S311 Rb Z3 Send email Recipient Altematwe Email Address John Doe a mn MENON Business Studies Subject Elizabeth Coe Subunit Sdmmnstrata coal Maria Report Report creator 5 Prof Or Adam Smith Utilization Statistics Computer Se Luke Snowden ti System Summa Esmerakia Parker Software Trainings Maintenance Dr John Smith License J Send Email to Support 3 system Cleaning di System Status 2 Class Climate Websae OK Cancel Documentation Figure 576 Writing an Email to Users Scantron Corporation 465 Copyright Electric Paper GmbH system Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM By selecting all users press the left hand button on the mouse and pull to the bottom of the list you can send an email to all users AS soon
174. the logo will appear in the heading of the PDF report document generated by Class Climate We recommend using the JPG format even though GIF is better as a rule for depicting logos The reason is that for legal reasons relating to licenses some printer drivers cannot encrypt the compression of the GIF format In this case the reports could not be printed Changing Subunit Data After a mouse click on the green pencil icon in the column Edit of the subunit window you can edit the configuration data of the subunit Delete Subunit 2E Delete subunit Subunit to delete Engineering Warning Deleting a subunit causes the deletion of all correlative instructors and surveys You re about to delete 14 surveys and 5 users Figure 27 Delete Subunit 2 2 2 Generating and Managing User Accounts As a user you will login to Class Climate with the respective username and password specified by the administrator You can change both your username and your password in your user profile 50 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 1 Preparation of a Survey Period Should a single person wish to login as multiple Class Climate users he can open differ ent browser windows and log himself in at the same time as those users This means you can simultaneously be logged in as Instructor Adam Smith as Report Creator Maria Report and as the administrator Clas
175. the text of this option and or the link you can change them at System Set tings Class Climate Settings on the page Network Settings There you will find the options Display value support link default Class Climate Website and HTTP link on support page default http www scantron com e If you want to change the colors of Class Climate use the page Color Settings Sys tem Settings Class Climate Settings You can choose one of several color schemes or define your own colors 30 Scantron Corporation Copyright Electric Paper GmbH X Class Climate The following settings affect documents that are sent handed out at different occasions PDF report The PDF report you get for your course evaluation can of course be adjusted to your needs in different respects The possibilities are described in detail in chapter B 4 5 Instant Feedback The PDF Report Letter of the PDF report You can automatically create a letter for the PDF report of your course evaluation There you can see a sender whom you can define in the menu System Settings Report Settings Configuration You will find the option Sender part 1 to Sender part 3 as well as Sender above recipient address PSWD cards for online surveys For online surveys you mostly need a number of so called PSWDs transaction authorization code A PSWD is a number character combination that serves for the unique identifi
176. their frequency The effort put into this work allows these texts to be transmitted Central Evaluation in statistics programs which then can carry out a lexical analysis After all image boxes have been entered the instruc tor receives a message that he can now view the responses to the open questions In order to minimize unnecessary costs a threshold value can be defined System settings Class Climate Settings Surveys This anonymization threshold sets a mini mum number of returns under which survey responses are anonymized can be set from 1 to 99 If you enter the value zero the anonymization threshold is deactivated e Never display When this option is activated the handprint fields will not appear in either the HTML or PDF reports This option is only recommended for blocking access Using logo files You can link a graphic file with a subunit This file appears in the Class Climate interface as well as in the PDF report of the subunit You will need a 60x60 pixel size version of the logo in JPG format Note The logo in the 60x60 pixel size will only appear with the correct dimensions on the printed questionnaire when the resolution is 72x72 dpi 48 Scantron Corporation Copyright Electric Paper GmbH limate 2 Subunit details Subunit Name Professional Development Figure 25 Logo File Copy this logo file in the directory C Apache htdocs classclimate data images logos subunit o
177. those aged 18 to 29 for the students aged 30 to 39 those aged 40 to 49 etc If you evaluate reports which are based on this questionnaire according to sub groups this age question is presented to you as a criterion Then you could for example create a subgroup report for all mentioned age brackets and compare the results Follow ing this it would also be possible to combine the reports for the first three groups and for the last three groups and thus compare the age group of 18 to 49 with the age group 50 and over Your questionnaire contains a multiple choice question or a single choice question on the subject with the responses Geology Chemistry Physics History and so forth Then you can create corresponding subgroup reports for all summarized reports based on this questionnaire subgroup report Geology subgroup report Chemistry and so forth This way you can structure courses that are attended by students of various disci plines according to subjects and make the results meaning the subgroup reports avail 298 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM able to those in charge of each discipline It could for example be that the dean of Chemistry is not interested how the course Nuclear Physics was generally assessed as it belongs to the field of Physics How the Chemistry students assess the course could however be of grea
178. to be translated than is possible with linked system languages the language sets enable internationalization beyond integrated system languages The expedient use of language sets requires two steps e Step 1 General definition of a language set Via the language sets you can define text elements for online surveys and thus include them in your Class Climate system e Step 2 Linking a language set with a questionnaire lf you wish to use a particular questionnaire for online surveys and additional lan guages are relevant specify the relevant language sets for this particular question naire Of course you can link a language set with any number of questionnaires 146 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Step 1 General Definition of a Language Set You will find the language sets in the submenu of the main menu System Settings on the left hand side After clicking on the menu point Language sets a list appears with the language sets that are already in place If you haven t yet added any language sets they will correspond with the system languages available 2 Language Sets N pea a iL Ma Li Lt res votum_l s en_edu inc php English Higher Education gt View 10 data online languagesets lang_set_10 inc php Danish 9 data online lanquagesets votum_ s de_edu inc php Deutsch D View amp Delete 3 data online languagesets lang_set_3 inc php Espa ol
179. user profiles Icons with a portrait but no padlock stand for active user profiles amp Philipp Belmore a Donna Harwood Figure 36 Active Belmore and Passive Harwood User Account lf a user account is deactivated then the individual will not be able to login to the Class Climate server If he does try to log in then he will see a message that his account has been blocked by the administrator An exception is the deactivation of the dean s account The dean can log on to the sys tem if the administrator has allowed him access to the QM Views Furthermore it is possible to give all deactivated instructors the right to access their reports from the central evaluation In order to do this the option Configuration Central 60 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Evaluation Passive Instructors Login for Report Request must be activated The instruc tor can now log on with his id and view all the results of his surveys When using the Central Evaluation server type passive user accounts are as a rule used to implement all or a large amount of the surveys from the administrator profile User accounts can be activated at any time This does not have an effect on the licensing i e one active user needs one license as well as one passive user needs one Changing user data Click on the name of a subunit A list of the users in this subunit will appear By clicking on the user n
180. verifies that the PSWD has already been used for this This ensures that nobody can log on who has received a PSWD but has not yet participated in the survey The information on the accessibility of results can be communicated to the participants via email once the survey has been closed It is however not a condition for accessing the results using the PSWD The email on the report accessibility will be sent out either manually or by using the time control of online surveys If you wish to send out the information manually click in the details of a survey on Send result access information to participants Upon confirmation of the recipient list the email is sent Please note that this function is only available after an online survey has been closed 164 Scantron Corporation Copyright Electric Paper GmbH EN COURSE EVALUATION FEEDBACK SYSTEM A Unlock data collection amp Restore Survey a8 Delete Survey _ Edit answers to open questions fa wA Assign survey to substitute instructor F Edit Show notes Figure 149 Manually send an Email on the Accessibility of the Report The automated dispatch of the access information is accomplished through the time con trol The time control can be reached either through the survey details provided that the survey is still running or via the checkbox User Time control straight after the genera tion of online surveys Scheduled Tasks
181. well as that of real only lightly checked check boxes Please make sure that after such an experimen tal scan test the OMR threshold settings where applicable are returned to their original values Fully agree Fully agree Fully agree Fully agree Figure 220 Verification Filling Degrees in PDF View Fully disagree Fully disagree Fully disagree Fully disagree DUO 216 Scantron Corporation Copyright Electric Paper GmbH Class Climate For an empirical analysis of the degrees of shading measured the values can also be recalled from a CSV export This feature is by default disabled and can only be activated by the administrator via the configuration option Maintenance CSV export of filling degrees in the Verifier The CSV file is structured in the following way SHEET FORM PAGE QUESTION TYPE ROWINDEX F1 F2 F3 B L D E F G H l 1 SHEET FORM PAGE QUESTION TYPE ROWINDEX F1 F2 F3 2 2 293 1 3590 Single Choice 0 0 38 3 2 293 1 3591 Single Choice 0 42 72 0 4 2 293 1 3591 Single Choice 1 0 0 0 Figure 221 Verification CSV Export of Blackening Degrees Each line in the CSV file equals one line of the questionnaire The table contains the fol lowing information from left to right SHEET Number of scanned page in the page FORM Internal form ID PAGE Page number of a questionnaire QUESTION Internal question ID TYPE Question type e g Single Choice Matrix Field S
182. which can be activated in the lower part of the window should only be switched on if the questionnaire is to be made available to active users instructors as a template or for the purpose of instructor s optional questions As a rule it should first be activated after completing the sheets Scantron Corporation 387 Copyright Electric Paper GmbH Creating Questionnaires with VividForms Class Climate COURSE EVALUATION FEEDBACK SYSTEM 388 Template Once you place a tick in the area Activate deactivate template mode you have defined your questionnaire as a template With a questionnaire that is defined as a template you can decide whether the new items should only be added at the end of the questionnaire By doing so you can ensure that the existing structure of your questionnaire cannot be changed To do this activate the option New items may only be added at the end Max Pages Defines the maximum number of pages this form can have when being used as a tem plate by other users If the property Template is inactive the number of pages will be limited internally to 99 pages Max Items Defines the maximum number of questions allowed on the questionnaire This enables control over the number of questions which may be added when active users take this template to add personal questions This limitation is inactive when the form is not a template Scantron Corporation Copyright Electric Paper GmbH
183. width of page 100 In this case the alignment is centered and the scaling is 25 When you click on Apply you add the picture to the last place in the questionnaire where the focus was i e where you last clicked on the questionnaire Via clicking on the picture and using the key Delete you can remove the picture from the questionnaire again Alternatively you can set the focus on the picture and choose Delete in the menu Clipboard Scantron Corporation 437 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM The position and selection of pictures can be changed after insertion as long as the questionnaire is not in use Just double click on the picture and the picture assistant will open Alternatively choose Picture in the menu Edit If you look at the PDF preview you can view this via the PDF symbol above the upper left corner of the form you will get a preview of the actual appearance of the questionnaire Here you can see an example Thanks for attending the survey and helping us improve the course Your Evaluation Commissioner Hoa Puc Zrc Figure 535 Picture in the PDF Preview 2 11 Layout Settings Editor Control 3 N Add Edit gt i Form Properties s Layout settings Repair form Enable numbering Figure 536 Menu Layout Settings Via the menu item Layout Setting
184. you can define as many answer options as necessary as long as there is enough room left on the page Nevertheless there are differences within this question type resulting from the number of answer options provided For single choice questions with up to 11 answer options the position of the options next to beneath the question text can be freely defined In the report all answer options will be displayed regardless wether they have been marked on the questionnaires or not When a single choice question has more than 11 answer options the options are always displayed beneath the question text In the report only those options are displayed which have at least been selected once by the participants Which gender do you belong to male 44 4 female 35 6 Figure 481 Illustration of a Single Choice Question Multiple Choice m of n A multiple choice question can have unlimited options unlimited means as many options as fit on one page The options are considered yes no questions i e not marking an option is interpreted as a no The number of selections per response option is for this reason the same as the number of returns Scantron Corporation 407 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM attend the course check as many as apply because am interested in the topic 0 because need to earn the credi
185. 0 2 5 4 SECTION DATA IMPORT AND EXPORT cccccccccceeccueceuceeeseueceuuseueeueseueueaueueeeauueaeeueeaaeueass 513 2 5 5 SECTION COURSE USER DATA FIELDS o ccccecccccceccecseeceeeceueseecsuuseueeeeueueeeaueueueueeeaueeess 514 2 5 0 SECTION FUNCTIONS paseoa A E Ea EAA E 515 2 5 7 SECTION CENTRAL EVALUATION cccccccccscecceeseeccceceueseeseueseuueeaeeueueueseuueueueueueueeueueaesuags 518 2 5 8 SECTION EMAIL FUNCTIONS amp ACCOUNTS o ceccccccecccecccsceceuseeceeuseueeeeuseueeaueeeeeaeeeaeeeaes 519 25 9 SECTION COLOR GETTING tcayaecetcccanesesecsnnctienttncateus cada EE N aa 521 2 5 10 SECTION INSTRUCTOR ACCOUNTS cccccccccecceseeeeceeeeeceueeueeesaueeceueeueeueaueaueaeeaeeneenuaneaess 522 2511s SECTION VIVIDFORINS csesecedediecenecuccasseucoot En Eneee aE EEEE E EE ET EATE EEEE 522 2 5 12 SECTION NETWORK SETTINGS o cccccccceccccseeccueeeeccueseueseeseueeueueaeeaeeeueeauueueeueesaeeeaeenaess 523 2 5 13 SECTION SYSTEM SECURITY cccccccccececcecceseeseecceceeccueeeeeueeeeeeeuseueaaseuseseeuaueeeenusausaueass 525 2 5 14 SECTION MAINTENANCE oo c ccccccccceccccscecseceeeseeesueueeueeuseueeecueeuseuaueueueueeueesaueeeuuaueeaeueass 526 2 6 CLIENT OPERATIONS sscsiccexscsivesutieuuslestanas eustuastetnad ich aGrlvwivewesibiwaianddvaumastebedesmavenecdeduttlewwdsuntseeutes vue 530 INDEX ooe E E seunweasueecaaeeeonvacaeucadcsnens 531 10 Scantron Corporation Copyright Electri
186. 0 00 Frrr s cetpert pen oe in tet te Te Eem ail be eee ey Zommen CODD Resse toss re crass hae g Pe A nyed come je DED SO PE TOIRE FEIE 1 Questions about you You are What is your age Your Zipcode QO00000000 000000000 000000000 po00000000 oooo0000000 PC Skils armi ale bo crealeedit a word document lam abe to creatsiedit a presentation know how to zipfunzip a file iknow hgw to bum a CO or save fies on a USB stick internet Skils Lam contortabke using vanous browsers luse email as a frequent means of comnurecaton know how to search for ivfionnaion on the Web using search engines Technical Trainings have already taken part in a technical O ves training weould like to take part in A bechnical training Fully agree to improve my Pintemet skills Which kind ef technical tainingis wouid you like to viet Figure 466 PDF Preview of Questionnaire In order to display a preview of the future online survey click on the online symbol A new window opens with a preview of the online survey Check to make sure you like your layout Close the window in order to continue editing the questionnaire To finish editing the questionnaire click Save form and exit editor or the symbol with the open door After that you will reach the details of a questionnaire Scantron Corporation 397 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate CO
187. 0 39 40 49 50 59 60 69 Older than 69 Figure 304 Report Creator Subunit Report Final Overview Here you can check once again which subunit you selected what the report will be called and based on which questionnaire it will be created Furthermore the selected survey period appears here again with the precise data defined by the administrator You can see how many surveys meet your selected criteria and to how many return responses it applies meaning completed questionnaires If you would like to test the report creator and have only very few surveys running in your system a warning message may appear here and you do not have the possibility to pro duce a summary report No of Surveys 1 below minimum No of completed questionnaires 9 Figure 305 Report Creator Number of Surveys below the Minimum Number In case the number of surveys is below the minimum number please inform your Class Climate administrator For testing purposes he can change in the configuration under Settings Configuration Functions the option Minimum survey number report creator by setting it to 0 Scantron Corporation 283 Copyright Electric Paper GmbH COURSE S GH mat SYSTEM Your Evaluation Process The Phase Model thy AN Class CI mate m Minimal survey number report creator Minimum number of surveys to allow a report creator to 0 v sae create a subunit report Decentral Evaluation Figure 306 Administra
188. 00 In the example this gives the following calculation 45 25 61 75 100 57 Hence the survey has reached an overall quality of 57 R 350 Scantron Corporation Copyright Electric Paper GmbH lass Climate ous CD Class Climate hace 5 qualiy Managemen Example Calculation of Quality Guidelines when Lower Values Are Better ower Ihreshold Value Upper Inhreshold Value W Question 3 125 25 pon Qindext fT S oo E E E E ooo oo oo ooo y po Table 18 Example Calculation of Quality Guidelines when Lower Values are Better The values in the top half of the table shaded yellow are the values of the quality guide line that you set individually when creating the guideline For each quality guideline you define the weighting in relation to the overall quality index QG 1 25 Any number of scaled questions can then be assigned to this quality guideline QG 1 2 questions For each of these questions you define a lower and upper threshold as well as the percent age it counts towards the quality guideline question 1 lower threshold value 3 upper threshold value 4 proportion of quality guideline 1 of this question 25 In the bottom half of the table shaded green you can see the results of your questions Question 1 for example has a mean value of 1 5 The absolute quality is calculated according to the following formula upper threshold value observed mean upper threshold value lower thr
189. 1 05 13 2011 05 18 2011 20 ociology Introduction into t ro z Sociology 43212 Data available 2 train_en 05 18 2011 05 18 2011 16 0 to 2 Figure 575 Search for Surveys Displayed are e Survey name At the same time a reference to the survey folder e SurveylD This number is identical to the operation number on the questionnaire without the check digit e Status In Progress data existing data entry or deleted e Type Paper survey or online survey e Form Short name of the questionnaire e Creation Date the survey was created e Processed Date of the last time this survey was carried out e Number returns form count Number of scanned questionnaires empty question naires are counted 464 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM 1 1 4 Search for Deliveries The content of the search table for deliveries is identical to the delivery table in the menu System Information Deliveries See Section 5 6 7 The search is conducted in the fields survey ID target address date as well as first and last name of the recipient The table contains the following information Batch Batch ID of the jobs which contains the questionnaires processed for this sur vey Survey Name of the survey the questionnaire module i e of the questionnaire as well as the course type Recipient The recipient is also the owner of
190. 1 10 Deletion Log The deletion log tracks all data deletion events in the system It is not possible to delete from the deletion log The following deletion processes are logged in this protocol e Subunits e Users e Courses e Surveys e PSWDs e Questionnaires e Study Folders Active Accounts Each deletion log record will contain the following information e User Who has deleted the data e Object Type and Description What was deleted e Date When was the data deleted e ID of triggering activity Which deletion event chain has caused the deletion of this element The following figure shows you the deletion log Deletion Log eS There are 1252 Log entries available a Selection of object types Fei Entries per page 40 Reload Course r toI User Object Type Object Description Date EE 1253 Feter S Human Resource Management id 62241 Carlos 05 23 2011 at Brown i Hernandez Sample_01 id 307 5511 16 35 20 1252 Peter ins Organization and Management id 3387 Carlos 05 23 2011 at Brown ial Hemandez Sample_01 id 307 811 16 33 11 Figure 593 Deletion Log Scantron Corporation 479 Copyright Electric Paper GmbH a System Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM The top section allows the selection of object types to be displayed multi selection using the CTRL key It is also possible to define the number of records per page 1 11 System Cleaning
191. 1 4 PASSWORD BASED ONLINE SURVEY cccccccceccecececeueeecueeeceueceuueeaseuueaeeueeueueaeeaueeneueaeeees 110 ENT ele TON cee ceca cae es gets ceeeca ea ance sem eanaseset ARE 111 3 2 1 GENERATING SURVEYS u ccccccccecceccceceeceeeceeuceuueeeueeeseueueaueauseueeeeuueaeeuueeauueueeuaueaueeaeeneueaeeeas 111 3 2 2 DISPLAY SURVEYS peirbis ronn n a a aa a a inertia te atanedeeasaetae 113 3 2 3 SURVEY DETAILS ete tenstecete saeco gate eacasemase else stent OEA Aa AART aA AREKEA 117 3 24 DELETE SURVEY massisrieaseri taaan eii aa detec Ea acts EEA Sessa pe ae NEARER clea ances 128 3 2 9 TREE STRUCTURE eee ee en Se ee a ee 129 3 2 6 CONDUCTING A PAPER SURVEY u ccccccccccccececeeeeeeeeceueseuueeuceueeeeeuueeuuueaueeueeaueeaueeueeneueaeenes 136 3 2 7 EFFECTIVE MANAGEMENT AND CONDUCTION OF ONLINE SURVEYS ceccecseeeeeeseeeeeeeees 136 3 2 8 ADDING QUESTIONS USING THE INSTRUCTOR S OPTIONAL QUESTIONS oasen 169 32 9 BAICH EVENTS eee ee ee ne eee ee ee ee eee 172 3 2 10 NON ANONYMOUS SURVEYS u ccccccccecceccceceueeeeeeeuceueeeeueeeceueueeueueeeuueaueeueeaeeeaueeaeeaeeeaeenes 181 3 3 ACTIVE INSTRUCTOR ACCOUNTS sagisesczcnsetunucdculsettmnntvincctanticanttahaanadsventonataeteemedadddeceenteepdeneences 195 3 3 1 CREATING ACTIVE INSTRUCTORS AS SUBUNIT ADMINISTRATORS cccceesccceeeceseeeeeeeees 195 3 3 2 LOGIN AS ACTIVE INSTRUCTOR o ccccccceccccccecsceseeceeeceueseuueeuceueseeeuueeuuueaueeueeaueeaeueaeeneueneenes 197 3 3 3 GENERATING
192. 1 at 09 14 48 2g configuration of the Mail Semice on the server As soon as the configuration has been corrected this message will not be shown again Figure 595 Log Book There are three types of symbol message symbolized with a blue warning yellow warning triangle error red X and The following messages can occur Error messages e Error when updating the survey table The status of the survey could not be updated Check the status of the survey In Progress processed etc If the status of the survey is shown as processed open the report If this is empty then reset the survey and scan this questionnaire again Scantron Corporation 481 Copyright Electric Paper GmbH system Settings and Management Class Climate a COURSE EVALUATION FEEDBACK SYSTEM If this error reoccurs then your database may be damaged Contact Class Climate Support Interactive cover sheet general DB problem Access to the database could not be provided Interactive cover sheet invalid form type identified Interactive cover sheet general problem An operation number could not be generated The survey could not be set up Data could not be written in the cover sheet table The procedure with the ID SURVEY ID is not open any more The survey for which the data were collected is closed The data were discarded Check whether the batch has already been scanned and the new capture was an error an incomplete scanning oper
193. 11 at 14 48 00 Finish survey Opn 2 0G Action For all with status Task Run Open Proceed PWD to respondents Figure 126 Scheduled Tasks Overview The display of subunits survey periods and questionnaires can be restricted For each survey each of the three tasks are displayed in one line In the column Status the status of the task is evident The following status messages are displayed Open The task is activated and not yet carried out Running The task is now running emails are being sent Deactivated The task is deactivated Finished The task has been successfully completed Finished with error The task was completed with error Completed with warning The task was completed but with a warning e g report could not be created as data was not available Not completed with error The task is not correctly defined and the settings should be checked Scantron Corporation 143 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate You can use these action icons to control the operations you have planned Modify planned task GD Immediate execution of task Cal Deactivate task 3 Delete all planned tasks in survey By clicking on the Edit icon the data of a time controlled task can be retroactively adjusted Here it can be decided whether the changes made should be applied to all sur veys created at the sam
194. 12 2008 Q train 01 jus cist Climate POF erot em 2 Introduction into macroeconomics aay J006 08 12 2008 _ train 01 E a es a Figure 263 PDF Report Plugin Selecting the Adapted Report from the List of Surveys 4 5 4 Designing an Individually Configured Letter for Sending Reports You can add a letter to the automatically generated report either a standard letter or a customized one e g a letter according to your corporate design To change the design you will need a PDF file with the appropriate letter head Then three text fields are applied with Acrobat e address For the name and address of the recipient You can use placeholders from the email texts System Settings Text Templates e subject For the subject line The content of this line is defined in System Settings Text Tem plates e text For the body text of the letter The content of this text as well as the placeholders used in it are defined in System Settings Text Templates 252 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 3 Capture and Instant Feedback COURSE EVALUATION FEEDBACK SYSTEM Evaluation Results Evaluation Results To GENDER TITLE SURNAME Fersonal and connor Tia Prof Or Beimore as Pivaleiconidential Result of a survey Gear Mr Prol Or Belmore This email contains vahuation res
195. 23 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Your Evaluation Process The Phase Model Class Climate Subunit Business Studies Name of the instructor Donna Harwood Name of the course Web Design XHTML 1 Name of the survey There are not enough filled forms for the profile line The minimum level is 30 forms Figure 374 Report Creator Profile Line Emails Options Check if the number of completed forms exceeds the minimum level defined in parameters Excluding Questions from the Presentation When you activate the option Remove certain questions from profile line s and click on Request the questions of the questionnaire are displayed prior to the dispatch or down load so that you can exclude individual questions from the presentation of the profile line Of course only those questions that can also appear in the profile line are presented meaning only questions regarding the standard value and scaled questions Questionnaire Comparison Result Choice train_en 7 What is the grade of your last school graduation The instructor is always well prepared The instructor explains even complex topics in a comprehensible way The instructor handies the technical equipment video projector etc without any problems Please grade the instructor for this course poor very good The lead time of the course is adequate Strongly dis agree Strongly agree Figure 375 Report Cr
196. 39 0 00 0 33 33 50 59 M 16 67 60 69 0 00 Older than 69 000 Figure 151 The HTML Report The text templates main menu System Settings submenu on the left hand side Text Templates contain the text E mail Information about result access to participants Here the standard text that is sent to the participants of a survey can be deposited as soon as the survey has been closed 166 Scantron Corporation Copyright Electric Paper GmbH lass Climate Editing of text templates Action Automatic email attachment list E MAIL Footnote for anonymous online surveys Fj E MAIL Footnote for non anonymous online surveys are Form for instructor pya No email attachment defined E MAIL Information about result access to participants E MAIL Instructor s Optional Questions activated E MAIL Instructor s Optional Questions deactivated E MAIL Instructor s Optional Questions reminder E MAI Heta data Tor archive smal Attach Language English Higher Education w OK Reference Result view online survey Mail text This email entitles you to view the results of an online survey Please follow the a link and use the PSWD displayed as identification The PSWD reads PSWD Access under SERVER Yours sincerely the evaluation office i Save a Figure 152 Editing the Email Text on Information for Online Survey Part
197. 6 Open questions 0 0 eee eee 35 413 Handwriting recognition 218 415 533 Optional questions 0 0 000 cee eee 169 Organization structure INC 5 54 eta 4 hee a E eb Pee ee oe 129 P Page break 0 ccc eee ees 432 Paper Survey 0 00 cece ee eee eee 136 Participant data Ih 3 2 yeh eee oe a ee ee eee eee oe 69 Editing participant data 005 185 Participant number Calculate Response Rate 5 121 Participation Tracking 0 eee eens 145 Passing on questionnaires 0005 455 Password based online survey 110 167 PDF SAMPE ode ceseevudieeedes Seaextaneeceenaest 88 Templates 0 0 cc ee 500 POR TCOON ees cue ERTSE FEEDERS EEEREN 222 Components of the PDF report 223 FEAU seren Hole ws a BG oe ae oh 496 SettingS 0 2 00 0 ees 240 Template for letterin PDF reports 489 PDR A TD 2 cectuees beer gee aceon seen ES 222 Performance Statistics 0000005 476 Phase 1 Preparation of a survey period 39 Phase 2 Implementation of surveys 0000005 107 Phase 3 Capture and instant feedback 205 Phase 4 Advanced reporting 00 cece eee eee 256 Phase 5 Quality management 00000 00 339 Phase Model 0 0 0 cee eee ees 37 Your workflow during evaluation 37 Pol
198. 7 Organization and Management T6x amp P s miller example com Yes amp Organization and Management X6GTX r stevenson example com No 9 Organization and Management HAJ95 t c bowman example com No 10 Organization and Management RVJ5E b smith example com Yes 11 Organization and Management JTZEF s rutherford example com Yes Figure 128 Example CSV File of Participation Tracking As soon as you call up the participation tracking for online surveys for which you distrib uted PSWD cards instead of sending the PSWDs per email the email column remains empty Online Surveys Customization of the Language Used lf additional languages for system messages are to be made available to online survey participants you can integrate them in Class Climate For online surveys this refers to short messages such as Continue Send and Save temporarily but also to longer texts such as The red marked multiple choice questions have more options selected than allowed Please reduce the number of selected options accordingly Please note here we are talking about elements that do not directly originate from the questionnaire because you can directly translate all elements of a questionnaire To do this select the option Languages in the respective questionnaire s details The internationalization of online surveys is achieved by language sets Because for online surveys particularly those with an international approach many more languages need
199. 7 mm Letter 216 x 279 mm Legal 216 x 356 mm Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 5 2 Section Survey Minimum number of returns for PDF report lf the number of returns is under the value n there will be no display of the results Instead there will be a note in the letter the function create letter must be ACTI VATED The note can be edited at Text Templates Warning threshold in for PDF report dispatch by email Defines the threshold percentage of pages not recognized for the automatic dispatch of the PDF report Explicit confirmation is necessary for manual dispatch of the report Warning threshold in percent for recognition problems during the processing of paper forms If this error occurs a serious problem was found in the quality of scanned forms The problem must urgently be analyzed and corrected before scanning the next forms If the threshold defined here is exceeded for a survey this survey will be marked red The PDF report will not be dispatched automatically if this option is activated Furthermore the Class Climate administrator gets a warning notice via email Instructor s Optional Questions activation status Here you can activate or deactivate the Instructor s Optional Questions Instructor s Optional Questions modify course data Permits or prevents instructors from modifying the course data in the
200. About the Course T 1 1 learned a lot in this course 1 2 learned more in this course than in others 1 3 This course was extremely valuable to my education 1 4 would recommend this course to my friends a ee 1 5 This course has had a profound impact on me 1 6 Students who go to the instructor for help get the T assistance they need Figure 197 Template Questionnaire Agree Agree Agree Agree Agree Agree oO OO O Disagree O Disagree O Disagree O Disagree O Disagree O Disagree The new elements must be added to a new question group a sort of chapter of the ques tionnaire as is usual when working with the VividForms Editor That entails that an active instructors must first of all decide where to add a new question group He may add the question group in an arbitrary position not only at the end However it is not possi ble to interleave question groups i e you cannot put a question group in another one You can add any elements within a question group e g questions text boxes line spaces etc The following graphics shows you a questionnaire that has been copied in the form man agement and can thus be modified One question group New question group and one question New question was added the remaining question groups and questions are the ones from the template indicated by the T Your comments T Additional Questions Additional question
201. Cli FEEDBACK SYSTEM Settings for the copied questionnaire The standard copy includes all question types text and the settings set in the VividForms Editor Please select any additional elements to be included in the copy v Quality Guidelines Data export configuration v Norming PDF Reports Text Templates Report for comparison v Languages Filter settings Validation Free indicators Required questions Cross tabulations Note Information which is linked with other data from this system could not be copied This is relevant for example for reports for Figure 62 Copying a Questionnaire After clicking the button Copy the questionnaire list will show a copy of the question naire The description text of this questionnaire is marked by the annotation Copy the abbreviated name is counted up This copy can then be edited in the VividForms Editor as it has not yet been used in a survey The questionnaire along with all the collected survey data can be deleted with the option Delete in the column Action This means that the questionnaire and the survey results will be permanently deleted from the database Before the questionnaire is permanently deleted the delete process must be confirmed by the user again In this case Class Climate informs the user how many surveys will also be deleted The delete procedure can be cancelled at any time by clicking the button Cancel By clicking the butt
202. Combine surveys unweighted Please note For this combination the mean values of the single surveys are averaged Verify Back Figure 293 Report Creator Options During Report Creation The following options are offered to you e Question mapping of different questionnaires Summary of surveys that were carried out with different questionnaires Options Automatically with text comparison and manual assignment Condition the questionnaires are similar and therefore comparable e Include answers to open questions Should all responses to open questions be displayed in the summary The responses to open questions are not always of interest in more extensive sum maries since they do not serve the quick overview but rather they provide details Furthermore they may possibly lead to very long reports Scantron Corporation 275 Copyright Electric Paper GmbH lass Climate e Selection between weighted and unweighted By default the reports are summarized weighted meaning that the calculation is effected according to the number of returns This means for example If you summarize a survey with 100 return questionnaires and one with 10 the survey with 100 questionnaires counts for more than the one with 10 Mathematically expressed All individual results are each summed up for each question each single value that was ticked off and divided by the total number of results in this example 110
203. Copies v Human Resource Management 02 P1237 Quest_01 _ jn a cover sheet 20 Cover sheet only v Leadership Development 02 P 1234 train_en 0 150 150 7 Select all Pages to print 318 Request Back Figure 163 Batch Events Questionnaire Batch Printing As soon as the PDF file is completed a download window appears in your browser Now save the file to your hard disk or open it directly To print further pages for the same course click on the button Refresh The list is refreshed and you can make a new selection Send Cover Sheets Forms This function emails the personalized cover sheets or questionnaires to the people who are linked to the respective surveys Both the text of the email message and that of the attached documents can be configured in Settings Text Templates After selecting the batch event type Send Cover Sheets Forms the option boxes are completed automatically Choose a subunit and the corresponding options In 5 a list of courses which correspond to the selection will be displayed Only those courses which have survey processes without response data linked to them will appear 176 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM thy Class Climate Phase 2 Implementation of Surveys er Batch Events Print Cover Sheets Forms O Print PDF reports Send Cover Sheets Forms Send PDF reports C Archive PDF reports and CSV raw data O Send
204. Creating Editing the User Rights of a Data Entry Assistant Scantron Corporation 53 Copyright Electric Paper GmbH l S Your Evaluation Process The Phase Model Class Climate As an Administrator you set this value when creating the relevant user account As soon as you create a data entry assistant a particular setting in the user rights step three of three allows you to define the data entry assistant as system wide system level sub unit groups own subunit and selection of further subunits or only subunit wide own sub unit Verifier The Verifier can be used as a visual correction for scanned sheets The Verifier controls the VividForms sheets processed by the VividForms reader and can where necessary correct the recognition attributes The verification can be activated or de activated for surveys This can be necessary because ambiguously filled out sheets cannot always be correctly machine read Report Creator A user profile is created with report generation rights This allows the generation of anon ymized summary reports on subunits Further report forms are available when using the server version Central Evaluation The user account of a report creator does need a user license see Section 7 4 The Administrator Account The administrator account is used to create the system wide organizational structure administrate users and integrate questionnaires as well as regulating and supervising process
205. D and submit y aceptar el cuestionario despu s de the questionnaire after completion completarlo Por favor confirme pulsando Please confirm with OK or select Cancel OX o selecciones Cancel para volver al to return to the questionnaire cuestionario Figure 130 Language Set here Spanish in Detail To create a new language set click on New below the list of existing language sets Name the language set and then translate all elements Language set Add language set Italiano Astensione Abstention Save temporarily Figure 131 Defining a Language Set 148 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 2 Implementation of Surveys Once saved the language set appears in the list of existing language sets Unlike lan guage sets linked with system languages here you have the possibility of editing or deleting the language set This option is also recognized by the additional buttons in the list Step 2 Linking a Language Set with a Questionnaire In order to use a language set for online surveys you have to link it with the questionnaire with which you conduct the respective online survey This is possible in a questionnaire s details The details of a questionnaire are available in the menu Questionnaires Ques tionnaire List Click on the name of a questionnaire in the list you will be directed to the details of the questionnaire
206. Department Electrical Engineering instead of Faculty Electrical Engineering Mas ter instead of Diploma and so on These linguistic changes affect of course the questionnaire which must be clearly adjusted PT 276 Scantron Corporation Copyright Electric Paper GmbH Class Climate A questionnaire which has been evaluated can no longer be changed In these cases you have to copy an existing questionnaire and work on the copy For information on copying questionnaires see chapter B 2 4 2 Management of Questionnaires and Detailed View After the evaluation with the new questionnaire consideration has to be given as to how one can compare the results with the old reports and or compile the results of the differ ent reports The solution is the questionnaire comparison via the option Question map ping of different questionnaires in the report creator Question mapping of different questionnaires Automatic with text comparison J Manual Figure 294 Report Creator Question Mapping of Different Questionnaires Whenever you compile reports that are based on different questionnaires here you must select whether to have the questionnaires compared automatically or want to assign them manually In either case it is important that the questionnaires are comparable meaning that they are similar e The automatic assignment is advisable when the questionnaires are nearly identical for exam
207. Detach library question Question Library Choose a question from the library de FA Delete selected question from library _ Detach libra x ry question Delete selected question group from libra J Detach library group Figure 546 Question Library Detach Library Question Library Group Use the option Detach library group to undo the connection between a protected ques tion group and the library 444 Scantron Corporation Copyright Electric Paper GmbH th Class Climate Use of the Question Library with VividForms COURSE EVALUATION FEEDBACK SYSTEM 4 3 Adding a Question to the Library If you would like to add a question you have highlighted click on in the area question library on the edit bar The dialog shown below will appear You have three options tv Question Library Assistant Add question to library Which library question group should the question be added to College Evaluation x Add highlighted question group to library and include this question Make question available to all users Figure 547 Question Library Add a Question to the Library Include in an existing Question Group Select a group from the list and click on Apply Create a new Group Select the second option and enter the name for the new group Click on Apply Add the current highlighted Group Select the third option The current group will
208. EEDBACK SYSTEM 1 2 3 2 Change the attributes of the user Mir F Title First name Philipp Last name Belmore Phone Email belmore training com Address Language Default language Login name belmore New password SOCSSCeCeadeoeeReoeseeeeooeeeeRe Confirm new LEE TTT ETE PTT ETT TPT TT eT Te TTT eT Tf password LDAP registration Deactivated x Activated r Cancel pencil enees lt lt Back Next gt gt Figure 39 Activating LDAP in the User Settings If option 2 is selected in the configuration the LDAP login is automatically enabled for all users Now when a user logs into Class Climate an authentification takes place in the LDAP system In order to prevent accidental lockout from the system administrator access is by default excluded from the LDAP login If desired however the login for this account can also be enabled in the Class Climate settings under System Settings Class Climate Settings Network Settings LDAP Registration also for the Administrator If you activate LDAP in the setting at Configuration Network Settings LDAP Host any time a user logs in to Class Climate authentication will take place The authentication is made only of users of the type Instructor The settings for your LDAP server are at Con figuration Network Settings LDAP Host and for your Basis Distinguished Name at Con figuration Network Settings LDAP Base DN The us
209. Email Addresses To enter email addresses manually click on the button Add in the field Participant of The window shown below will open To enter new participants first enter the email address of the participant in the field Search for participants Subsequently click on Search Scantron Corporation 71 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Search for participants The email address of a participant has to be entered and verified before the data can be completed Email p Search Details of the participants Course Introduction into Sociology Title First Name Last name Email Address Custom 1 Custom 2 Custom 3 Cancel Figure 49 Adding Anonymous Participants of a Course Details In the following search or checking of the email address you supplied Class Climate checks the following e ls there a participant with this email address already existent in the system In anon ymous surveys you see no impact of this should this already be the case In non anonymous surveys data synchronization takes place and the already existent infor mation such as forename last name etc are automatically adopted e ls the email valid meaning valid within the usual rules of an email address At this point as well as in other parts of the system the structure of an email address is
210. FEEDBACK SYSTEM The dialog shown above will open and you can now select a group With the checkbox you can select whether the group will be transferred to the questionnaire the marked checkbox in the screenshot In the next selection the elements of this group will appear You can select one or more questions with the Ctrl key With the checkbox you can determine whether the question will be transferred to the questionnaire In this case they are assigned to a new question group you can recognize that by the green tick mark in the window If the checkbox Create in the window before is not activated you will see a red cross instead of the tick mark In this case no question group will be created You can choose between two possibilities regarding the order of the elements e The order of the elements as it was on the original questionnaire from whence the question group comes from and from that to which it was inserted in the library This is the default sorting order e Alphabetical sorting of the elements if you decide on this sorting order activate the option Alphabetical sorting Furthermore you can sort the questions on the questionnaire alphabetically To do this activate the option Alphabetic Sorting If you don t activate this option the questions on the questionnaire will be sorted in the displayed original order t Question Library Assistant Question Selection Question Course Eval
211. Forms Reader red cross Bi Details for questionnaire Quest_01 Quest_01 Evaluation Questionnaire W VividForms Editor C Copy and open the questionnaire in the VividForms Designer w PDF Sample Show PDF paper survey Show 8 In the recognition set of the VividForms Reader Add Preview online survey Figure 64 Details of a Questionnaire Recognition Set of the VividForms Reader Now if you create a survey with this questionnaire or click on Add the form definition file is created and added to the recognition set of the VividForms reader Bi Details for questionnaire Quest_01 Quest_01 Evaluation Questionnaire WP VividForms Editor Copy and open the questionnaire in the VividForms 7 Designer wW PDF Sample Show W PDF paper survey Show In the recognition set of the ViidForms Reader Preview online surve Refresh i Figure 65 Details of a Questionnaire Questionnaire is in the Recognition Set of the VividForms Reader When moving Class Climate for example to another disc drive or another computer it can become necessary to refresh the recognition set of the VividForms Reader To be precise this becomes a necessity as soon as the directory forms which contains the recognition set is moved By default this directory is in Program Files Scantron Vivid Forms The reason for this is that the XML files contain file paths to servers which after moving may no lo
212. Fulyagee OF OF O O O Fully disagree Form Properties Wo tro to te zeireo 3 ie puysse O OOOD Foly age E Seay T T know how to bum a CD or save fies on a Fulyagee O OOO O O Fully dtsagree AGUL USB stick Tech_01 Questionnaire on Technical Skills Editor Control a 4 Add Question Group J Add Question au Pole Labels ti Extended Pole Labels Class Climate Questionnaire on Te Line Space Separator ORGANIZATION AUTHOR _ ai Text Box F Picture SUBUNIT SURVEY E Page Break r 595959090990 SS e a aaa cL eel Mark as shown OBMOOO MARK Move Form Properties _ Question Library gt 1 Questions about you j kee a Figure 461 a and b Different Zoomed in Views of a Questionnaire If the questionnaire you have created consists of more than one page you can change to the different pages using the arrows as well as the drop down list in the upper right hand corner of the screen Scantron Corporation 393 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 3 2 Online View In the online view the display of the questionnaire is simulated as an online survey This view can be adjusted in different ways In the menu on the left hand side under Form Properties the type of display for the online questionnaire can be adjusted All three display modes complete per chapter and
213. Gabriel Business Studies 6 r fletcher example com Mr Rupert Fletcher Computer Studies Figure 187 CSV Files of a Non anonymous Survey Use the Participant Data for Participation Certificates All above mentioned placeholders PARTICIPANT LASTNAME PARTICIPANT _ FIRSTNAME etc can also be used for the participant certificates for online surveys 194 Scantron Corporation Copyright Electric Paper GmbH Class Climate 3 3 Active Instructor Accounts Instructors can also implement surveys if they are granted authorization The difference compared to central evaluation is that active instructors surveys are linked neither to par ticular courses nor to Survey periods The following provides you as the administrator or subunit administrator with a short overview of the options available to an active instructor As an introduction for active instructors a brief manual is available in PDF format called Active User Manual 3 3 1 Creating Active Instructors as Subunit Administrators To grant an instructor authorization to implement his own surveys you as the Subunit administrator have to ensure three things e The instructor with sensible log in data must exist in the structure which you as the administrator have created By creating instructors you decide on the rights which an active instructor is granted Of course you can change these rights again at any time ls an active instructor authori
214. GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM This view is available to the administrator as well as to the subunit administrator The subunit administrator can use all the functions described in the following sections except for setting up subunits 2 2 1 Setting up the Subunits Choose a reasonable number of subunits These subunits can either be departments or other teaching units Create new Subunits Create subunit Subunit Name Dept No 15 Logo File system logo Edit Phone Fax Street Address ZIP Code City Email Online survey template default Server address for online ai 7 ee surveys of this subunit http 192 166 245 129 classclimate online Subunit visibility Unrestricted lv Show the subunit in the context menu Subunits Assign user licenses IV unlimited Handling of handwriting texts Direct display default setting Display after manual collection note customizable threshold System settings Class Climate Settings Surveys Never display OK Cancel Figure 23 Create Subunit In order to set up a new subunit click on the button Create New Subunit in the menu Subunits This is where the name of the subunit as well as an address data is entered The address data is used in the letter for the summary report and appears in the system info System Information The Subun
215. IMPORT INTERFACES pesineen REA E EANA AKATOA RTA ARENAN 76 2 3 1 CSV IMPORT WITHIN SUBUNITS scicrcsinsunsisumsacsensvsiseennsinvsiien tavateaees onaiaeaua enmndawacananeansance terse TT Scantron Corporation Copyright Electric Paper GmbH l m Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 3 2 XML IMPORT STRUCTURAL DATA SURVEYS AND SCHEDULED ONLINE SURVEYS 81 2 3 3 IMPORT OF COURSE PARTICIPANTS EMAIL ADDRESSES ccccccscecceecsueseeeseeeeeeeeeeeueeenanes 81 2 4 ADMINISTRATION OF QUESTIONNAIRES u ccccccccecscecceceeeccuceueeeeueeueeuueeeusuueeuaueeuseaeeuueeaueaueeaeeeauees 84 2 4 1 ESSENTIAL INFORMATION ON THE QUESTIONNAIRE ccccccccceesseeceecseeceueseeceeeeueeeaeeaeeeaaeaes 84 2 4 2 MANAGEMENT OF QUESTIONNAIRES AND DETAILED VIEW ccccceccecceeceeeseeeeeeseueeeeesueeeneees 85 2 4 3 MULTIPLE LANGUAGES ee ee nnne A re E Een E EREE E EREEREER EEEE AREER Erann nnana 98 2AA QUES TION LIBRARY siaine E ea a Eea 102 PHASE 2 IMPLEMENTATION OF SURVEYS cccccccccccecceeeeeceueceeueeuceueueuueeaseueueeuuaueeueeeuueueeueueuueeaeeaees 107 3 1 SURVEY PROCEDURES aa eee ananin a ee ee 107 3 1 1 COVER SHEET PROCEDURE ccccccccecccccceccceeeeceuececeeeuueeucecueeeueeuesauueueeuaesuueeuueeaeeuueeueenes 107 3 12 HARD COPY PROCEDURE sbiren odao ee me ene a AE Oiar iia 108 3 1 3 PSWD BASED ONLINE SURVEY ssedoceccssns coctcnntansjond snctnacamuseeoaonvacabannanbaadivecsierdSianedocedaaatoas 109 3
216. Instructor s Optional Questions Instructor s Optional Questions question library Defines whether the instructor can use the question library in the Instructor s Optional Questions Default deactivated Instructor s optional questions direct delivery of questionnaire PSWDs If this function is activated then once the instructor s optional questions is complete the email with the questionnaire and the PSWDes is sent directly to the instructors If this func tion is deactivated then all emails are sent to the group address given in the email cate gory Instructor s Optional Questions email for deactivation contains PSWD list Deactivating the Instructor s Optional Questions a PDF with the PSWDs can be added 508 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Instructor s Optional Questions Status changed If activated the status of instructor s optional questions in the survey overview changes to completed as soon as the VividForms Editor is opened If deactivated the status changes when the save and exit button in the instructor s optional questions is clicked Instructor s Optional Questions reasons for not conducting a survey The reasons for when a survey cannot or should not be conducted can be selected in the Instructor s Optional Questions Instructor s Optional Questions Email to the administrator when survey c
217. K SYSTEM The characters that have been securely read in the verification are highlighted in white while those that have been insecurely read are highlighted in yellow speeding up verifi cation date ME MG Bo GI Figure 502 Open Question ICR Fields in the Verification By clicking the button Apply the open question is inserted into the questionnaire 1 Questions about you d a 7 re SS en ee eC E E E E E E EE EEE EEKE E KEE E aE BAE A D TE Figure 503 Open Question Segmented Fields in the Editor Preview If you create a survey with a questionnaire which contains open questions with handwrit ing recognition the verification is automatically activated This can be deactivated if desired To ensure a high reliability of results we also strongly recommend the use of verification when working with open questions and ICR for the use of verification see chapter B 4 3 Correction of Checkboxes Not Clearly Read The Verification Taking into account the additional expenditure of work and time caused by the process of verification you should always check if the data cannot be collected by means of closed question types such as single choice or matrix questions Scantron Corporation 419 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 6 4 Single Choice Multi
218. K SYSTEM 6 2 5 Use of QM Views Displaying Course Lists Individuals with access rights are informed through login details user name password web address To increase security you can restrict the permissible IP address domain Consult the relevant section in the Initial Operations After logging in with the user name and password the user arrives at his or her activated user account This user account is equivalent to an activated instructor account that means it can also be used to implement private surveys With a click on the menu item QM view the quality overview is opened Carlos Hernandez Instructor Surveys g Folders Surveys 2011 Quality Management QM Views Additional Reports Te Reports central evaluation Figure 425 QM Views Open View A new window with a list of evaluated courses appears oromieatin 2011 05 18 Professional Course EEEE R and 3 100 0 47960 10 Economics Engineering 511 Hernandez Carlos Evaluation train_en Management 10 31 32 P 410 Development ay estionnaire i 3 Human Taf Course i b DOOD Resource 20 697 22672 1h 55 20 pgp EconomicsiEngineering SS11 Hemandez Carlos pierre Evaluation trainen Ma Management Questionnaire r Course Leadership 2007 08 24 R Professional details BOA novclopment 25 880 10780 igsiss 507 Eoen Eenden adna WSORO7 Hansarda Cortes Daio prani Sanaan Pa E
219. Menu System Settings in the adminis trator interface you have access to the configuration of the Class Climate server In this manual all references to Class Climate setting options are marked in blue Subunits Questionnaires System Information ETT y Search sit ht AA a TP EL OMT ee TTILE _ Advanced fei Class Climate Admin Survey Online Administrator Ee Title Login Windoy Data Import and Export saa Course User Data Fields Course Evaluation F Functions t of the title line on the start page Central Evaluation Instruments Email Functions amp Accounts Te Color Settings Ej Text Templates System Language instructor Accounts TA Dacumen VividF l i 3 Documents ark eaii ii s the default language of the Class Climate interface as well as all 4s Report Settings English Higher Educati system Security erated report documents Users instructors report creators etc Q Oning Templates Maintenance change the language in their settings Configuration Date Format Here you can define the date format The following characters are recognized notice upper and lower case iS Class Climate Settings Define Tree Structure Figure 607 Class Climate Settings Below the button Class Climate Settings you can select a major heading for the Class Climate settings The following categories e General e Survey e Survey Online e Data Import and Export e C
220. Meta information Individual lines are read from left to right as follows e Line 1 Template mode activated deactivated Maximum number of pages Current page number Edit mode e Line 2 Paper format Numbering on off Information on the active object Scantron Corporation Copyright Electric Paper GmbH 391 Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM e Line 3 Current number of questions on the sheet Maximum number of questions on the sheet PDF version of the form Editor version of the form 2 3 Viewing Options Two different display options for displaying the questionnaire in the VividForms Editor are available the paper view and the online view With the help of an icon PDF and globe with green arrow in the viewing bar above the questionnaire you can switch back and forth between views as long as the system is licensed for both types of surveys If the system is only licensed for paper or online surveys only the licensed type of view is dis played Editor Control 3 Adds Add Question Group Jt Add Question Figure 460 Switching between Paper and Online View In the system settings menu System Settings Class Climate Settings VividForms Stan dard view VividForms Editor the default view when opening the editor paper or online view can be defined If in the properties of a questionnaire it is defined that this is
221. One or more Scan Stations VividForms Document Capture f VividForms Pre processing Raw Data Web Server Interface e Data Processing Online survey Figure 3 Interaction of the Components Data Base Any data generated through the utilization of Class Climate is stored in a data base This means that the entire user structure the questionnaires and the survey data is stored in this data base For this a MySQL database or a MS SQL database is utilized Scanstation Questionnaires are read by means of the scanstation and the image files generated are transmitted to Class Climate for further processing The scanstation can be utilized directly via the Class Climate computer Alternatively one or more scanstations may be linked through de centralized computers For further information please consult the Scanstation Manual Scantron Corporation 17 Copyright Electric Paper GmbH Class Climate VividForms VividForms Reader This is a solution that was developed specifically for Class Climate With VividForms questionnaires can be created directly via the web interface and later automatically be processed via the scanstation It also contains a web based visual correction program WebVerifier After you have created your questionnaires by means of VividForms they are processed by the VividForms Reader The VividForms Reader receives the images transmitted by the scanstation and reads the ques
222. P Finish Data Collection Close Survey amp Restore Survey 2 Delete Survey Edit answers to open questions gA Assign survey to substitute instructor Li Edit Show notes Figure 97 Survey Details Number of Participants to Calculate the Response Rate Delete Function for Responses to Open Questions As Administrator you have the option to delete responses to open questions This is especially helpful when empty images with only the edges visible have been saved or when the empty field has been crossed out In order to use the delete function you must activate it in the settings Configuration Functions Deletion of Responses to Open Questions With a click on the icon you will open the window with all of the RESPONSES to the open questions of this survey The responses are either displayed as image or if they have already been anonymized as text field These have a red background In order to delete all of the selected responses click on the Delete button at the bottom of the window Assign a Survey to a Substitute Instructor lf a course is taken over by a substitute instructor at short notice an evaluated survey can be transferred from the original instructor to the other instructor To do this click within the survey details on Assign survey to substitute 122 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Show PSWDs in browser _ Receive PSWDs by emai
223. PDF reports as instructor profiles C Send PSWDs to Instructors Hide surveys with documents which have already been sent Subunit 2 Survey Period 3 Course Type 4 Questionnaire Professional Development p Lecture Seminar _ Select program of study 5 Course s ape F Management Strategies NA_2 Managing and maintaining a healthy lifestyle N4_1 Human Resource Management 02 Pi23 _ Leadership Development 02 P1234 A E nena rit Request b a Figure 164 Batch Events Send Cover Sheet Forms Click on Request to start batch emailing A progress bar shows the status of the email submission process A The task is in progress Send email to parker example com p 50 Figure 165 Batch Events Email Submission To abort the email submission click on Cancel Scantron Corporation 177 Copyright Electric Paper GmbH After the mailing process is complete the system will show a listing of successful and unsuccessful submissions All outgoing email will be logged under Deliveries in the menu System Settings Archive PDF Reports and CSV Raw Data Your existing PDF reports and CSV raw data can be archived by sending them to the email address defined in the configuration System Settings Class Climate Settings Email Functions amp Accounts Email address of the archive In this way legacy data can be exported with a complete audit trail and subsequently deleted
224. Phase Model th AN Class CI mate Access to survey results is enabled in the questionnaire details so access is individually controlled per questionnaire You will find the area Evaluation for participants in the field Usage details of a questionnaire Usage Form m Reporting Options m Online Design Activated Mirrored scale values Ji Show the header of the survey J Allow Summary Reports a Enable temporary Save p Survey type Eo Show print option ALL d Evaluation for participants Design Complete U l V Allow result access Certificate of None Procedure Display answers to open participation ALL questions Advanced configuration Edit Figure 148 Result for Online Survey Participants Authorization in the Questionnaire There you can authorize the viewing of results As in this case only access to results of closed questions is authorized the option Display responses to open questions can be additionally selected If you authorize the viewing of results the online survey participants have access to the HTML report as soon as the survey has been closed Each participant can use his PSWD to again log on to the same page on which the questionnaire was previously available Instead of the questionnaire now the HTML report is accessible Important Only those participants who were logged in during the survey can now log in again to download the report The system
225. Plugin file In the following example this file is called CTextualReport php Then enter a description text and click on Save In this way several PDF report plugins can be integrated into the Class Climate system In order to change the setting of a PDF Report Plugin click on the symbol for editing Paper and Pencil Icon In the following dialogue the description text can be changed PDF Report Plugin Class Climate PDF report Copy Description Class Climate PDF report Copy Questionnaires ALL Demol DemoEva DemoEvat Demo_01 RTE Eval0 Modinstr ModSem T OK Cancel Figure 262 PDF Report Plugin Dialogue for Editing a Plugin From the selective list next to Questionnaires you can now select the questionnaires for which the PDF Report Plugin should be available Scantron Corporation 251 Copyright Electric Paper GmbH X Class Climate With a click on OK the changes are saved If you go back to the main menu Subunits and access surveys a drop down menu appears in the column Report of the survey overview Through these you can access the available PDF report types and have the respective survey evaluated through the chosen report type ss10 Wee Wamem Status Forms Processed Fom Repor 9 Introduction into macroeconomics availabl a 3004 08 12 2008 C E train_01 i se History of liberalism aata a 1003 12 08
226. Poor methods 2 2 How would you rate the trainer s ability to set and Excellent O Oo OF O Poor meet the objectives for the course Figure 453 Display of the Instructor Name in a Paperbased Survey Scantron Corporation 383 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Samantha Miller Advanced Reporting Please give us a feedback for the trainer of the course shown above Questions concerning the Trainer How would you rate the trainer s overall teaching methods Excellent 2 08 Poor How would you rate the trainer s ability to set and meet the Excellent AHO OOD Poor objectives for the course Figure 454 Display of the Course and Instructor Name in an Empty Question Group 384 Scantron Corporation Copyright Electric Paper GmbH Class Climate Access to the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM C Creating Questionnaires with VividForms With the VividForms Editor Scantron has introduced a form creation tool that is easy and quick to use It allows you to extend or redesign existing questionnaires or design new questionnaires directly via the web interface The content of VividForms questionnaires can be modified as desired Keep in mind that for questionnaires which are already in use for surveys the edition is locked As well as this the administrator can define his questionnaires as templates and make them avail able to active users instructors for fu
227. Reports 0 evaluated 05 18 2011 Rename ag Business Studies 0 Reports 0 evaluated 05 16 2011 Rename D4 Figure 292 Report Creator Folders Structured Example According to Subunits Only in a study folder can you use the possibilities of the report creator for example to summarize reports The report creator can always move existing reports from one folder to another To move a report click on the folder containing the report to be moved Then click on the name of 274 Scantron Corporation Copyright Electric Paper GmbH thy AN Class CI mate Phase 4 Advanced Reporting COURSE 3S oN mat SYSTEM the report to be moved You are automatically switched to the details of your report Here click on Move Compilation Now the report can e either be moved to an existing study folder by selecting the relevant folder in the drop down list in the area Folders e or you create a new folder Enter the name of the folder in the area Create in a new folder In both cases confirm moving the report by clicking on the OK button Options during Report Creation General The options during report creation are presented to you as soon as you wish to create a report You can see them in the figure below the report name which here reads Show_ Options Description Global report Q1 2011 Question mapping of different questionnaires Automatic with text comparison Manual Include answers to open questions
228. STEM lf you reduce the line spacing Class Climate automatically reduces the size of your checkboxes so that as a basic principle a minimal difference in size of 2pt is ensured With a scaled question with 11 response possibilities your checkbox size will be 8pt Now if you increase your checkbox size to 9pt for reasons of available space only 10 checkboxes will be displayed With a checkbox size of 10pt you can only display 9 checkboxes With a checkbox size of 11pt or 12pt only 8 or 7 checkboxes are displayed and so on Before applying the change you will get a warning message If you then click on Cancel your changes will not be applied Decreasing the number of checkboxes follows automatically in the system when increas ing the checkbox size If you decrease the size of the checkboxes afterwards the number of checkboxes displayed will not however be automatically increased by the system This means that when decreasing the size of the checkboxes you have to increase manually the number of checkboxes To do this double click on the corresponding scaled question and select in the area of Define options as in creating a scaled question the number of desired checkboxes With all other question types an increase in the size of the checkboxes has no effect on the question These changes decrease in the number of checkboxes only occur with scaled ques tions other question types are not affected 426 Scantro
229. Strongly dis Strongly agree ay 3 8 agree SL av 3 4 The course focuses on the current professional discussion Strongly dis E Strongly agree 27248 agree Nl The course perfectly prepares me for my professional life Strongly dis e e Strongly agree agree N i Figure 368 Report Creator Profile Line Emails Compare Selected Courses with Each Other pay pgp gos Bs ell lf you do not activate the option Comparison of the selected courses of reports to each other the number of eligible courses is unlimited But then the profile lines will not be shown in one and the same diagram Minimum Maximum Values The worst or the best value within a comparison group determines the margin of the pre sentation area If the option Minimum Maximum Values is activated the space between these worst or best values and the scale edges is grayed in Scantron Corporation 319 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Profile Subunit Professional Development T Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies Name of the survey Comparative line Carlos Hemandez Name of the course Organization and Management Name of the survey Min Max values of Management Strategies Organization and Management SS Strongly agree av 3 5 The lead time of the course is adequate Strongly dis agree av e3 6 The course focuses on the
230. URSE EVALUATION FEEDBACK SYSTEM A Class Climate VividForms Edtor Class Climate online survey E e Class Climate AT DOE OMAR PED Tele Le F EA 1 Questions about you You re O male O female What is your age 18 29 O 30 39 40 49 50 59 60 69 Older than 69 Your Zipcode PC Skills am able to create edit a word document Fully agree Coo0o0od0oO Fully disagree lam able to create edit a presentation Fulby agiee Ooo oo Fully disagree know how to zip unzip a file Fully agree Oo000 Fully disagres know how to burn a CO or save files on a USB stick Fully agree Oooo od Fully disagree lam comfortable using various browsers Fully agree oOoooo Fully disagree Figure 467 Preview of Online Survey 2 4 Editing the Questionnaire Header The header area of a questionnaire contains a number of placeholders which are dynamically filled with the information of the corresponding survey process in the later use of the questionnaire for paper and online surveys You can recognize the placehold ers by their continuous capital letters as well as the angular brackets With online sur veys you can define whether the survey header should be displayed see here chapter B 2 4 2 Management of Questionnaires and Detailed View online surveys These include for example the name of the subunit the name of the course to be evaluated or the name of the instructor 398 Scantron Corp
231. View amp Delete 4 data online languagesets lang_set_4 inc php Frangais D View Delete T data online lanquagesets lang_set_7 inc php Magyar View amp Delete 8 data online languagesets lang_set_8 inc php Nederlands Dview amp amp Delete 5 data online languagesets lang_set_5 inc php svenska View 9 Delete 6 data online languagesets lang_ set_6 inc php pr View amp Delete New Bak Figure 129 Overview of the Language Sets To view an existing language set click in the column Activities in the line of the respec tive language set on View An overview of the language messages with the current translation will be displayed In the following example you can see the translation from the system language English into Spanish The listing contains the text elements that appear in online surveys along with their respective translations Click on the bottom of the screen on Back to return to the start menu Scantron Corporation 147 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Language set View Sere Abstencion Abstention Almacenar temporalmente Save temporarily Next gt gt a gt gt lt lt Previous lt lt Pr vio Aceptar a Los datos introducidos van a ser Your entries are now being saved To almacenados Para recuperarlos debe submit your inputs you will need to log in acceder otra vez con la misma CONTRASENA again with the same PSW
232. Where necessary addi tional subunits can be assigned to their administration which means they can administer subunits outside of the subunit in which they were created With this the following is to be Scantron Corporation 51 Copyright Electric Paper GmbH observed Subunit administrators created within a subunit are considered as a group Therefore they can only administer the same subunits If for example a subunit is detracted from a subunit administrator it is automatically detracted from all other subunit administrators of this group Similar to the administrator the subunit administrator can take on additional roles in his user account report creator data entry assistant and verifier The configuration options available to the subunit administrators are defined by the administrator under Settings Configuration Here specific setting options are marked Make this option available to Subunit Administrators In doing so the subunit administra tor is able to change certain configuration options by which overwriting his subunits set tings as defined by the administrator Instructors e Central Evaluation Mode When using the central evaluation mode instructor accounts are set at passive This shows the organization structure and courses which have surveys registered to them and reports The email addresses given in the profile receive PDF reports as well as other emails As long as the instructor account is set at
233. YSTEM pale D m Standard 4 4 COURSE CTALUATION FEC Sta _ Form Froperties v ORGANIZATION B3 Form Properties SUBUNIT B Repair form gt EE 1 Questions about you ie Edit Pole Template You are Filter settings O male O female By Validation Required questions Cross What is your age tabulation 18 29 30 39 60 69 Older than 69 Picture Library Demo TEE High Contrast WebinarTest Figure 463 Select Online Survey Template Via the drop down list in the viewing bar above the questionnaire you can where required simulate the display of the online questionnaire for mobile devices As well as the standard view which is intended for screen viewing on PC s the view for small medium and large mobile devices can also be selected The following screenshot shows the resolution for mobile devices of a medium size Tech_01 Questionnaire on Mobile Device medium w Technical Skills Editor Control 9 ie medam Motis Davie thy Class fig Mobile Device smal ik j Bii inimi A TE i i ORGANIZATION Ga Form Properties AUTHOR B SUBUNIT SURVEY 4 Repair form l 2 Enable numbering Edit Pole Template 1 Questions about you Filter settings You are By Validation Required male female questions Cross i eines What is your age mic 3 5 18 29 5 30 39 48 Picture Library P 40 49 50 59 Onli
234. YSTEM 5 1 Indicators 5 1 1 The Principle of the Indicator In the automatically generated PDF reports you receive an average value for all your scaled questions as an expression of how the respondents replied to this scaled ques tion In this example you see a question referring to the quality of the course j om o 0 0 86 9 11 1 The instructor is always well prepared ll 7 1 2 A 4 5 fi Figure 267 Evaluation of a Scaled Question with Specification of the Average Diagram Type Histogram With regard to the thematic direction and your own requirements you will have divided the questions on your questionnaire into question groups For example one could assign all questions regarding the quality of the course to the question group About the course You will then receive an average value for each of the scaled questions The instructor is always well prepared ai g 1 J s 5 g The instructor explains even complex topics in a comprehensible way The instructor handles the technical equipment video projector etc without any problems Please grade the instructor for this course very good A Figure 268 Evaluation of a Scaled Questions of an Entire Question Group If you or for example deans department heads etc wish to obtain a quick overview of the results of the survey often not every single question may be of interest One rather needs summary statements If therefore you do not wish
235. You can determine whether or not the answers to open questions are to be included in your instructor profile To do this please activate the option Include answers to open questions If the respective instructor in addition to his profile is to receive a detailed report for each of his courses simply activate the option Also send single PDF reports Furthermore you can determine whether profiles and PDF reports are sent solely to the respective instructor Send to instructors or only to a specified email address Send all to the following email address 180 Scantron Corporation Copyright Electric Paper GmbH Class Climate Include answers to open questions Also send single PDF reports Send to instructors Send all to the following email address Request Figure 167 Batch Events Dispatch PDF Reports as Instructor Profile e The option hide surveys with dispatched documents makes sure that no batch event will be used more than once on the same course 3 2 10 Non anonymous Surveys Surveys in Class Climate run by default assuming and protecting the anonymity of the survey participants Should the identities of the survey participants be required for example for address rea sons as well as later for the processing of survey results relevant participant data can be imported and used Please observe the following legal references when using non anonymous surve
236. a Po e Mignier va Ues are nonor e o lt 2 oe is e e g 4 point scale Distance of three whole units between 1 and 4 Lower threshold e 40 0 4 of the three units 3 0 4 1 2 e Add the value of 1 2 to the starting value of the scale 1 as there has to be ticked at least the value 1 equals 2 2 Upper threshold e 60 0 6 of the three units 3 0 6 1 8 e Add the value of 1 8 to the starting value of the scale 1 equals 2 8 1 2 3 4 Figure 415 Quality Guidelines Three whole Units Beginning at 1 ower Upper l Type of Scale Threshold Threshold Ah a SE 40 60 DOM AE Siege are Dever Table 20 Threshold Values Example of a 4 Point Scale 356 Scantron Corporation Copyright Electric Paper GmbH thy Class Clim ate Phase 5 Quality Management COURSE EVALUATION FEEDBACK SYSTEM After you have chosen all settings click on Convert these indicators in order to create the quality guidelines Afterwards quality indices for all surveys that were conducted with this questionnaire are computed automatically As usual a green circle symbolizes a quality guideline that has been fully met and a red circle one that has not been met with several stages in between White crosses on red background denote that there are no results available for this survey yet Figure 416 Quality Guidelines Re Calculation of Quality Indices In the overview of the quality guidelines y
237. a single system This single system can be configured and divided up into separate areas There are cer tain situations in which it makes sense to completely separate single systems e g e The departments of a university would like to use their own subsystems with their own settings and user space and prevent other departments from accessing their data e A small college or university is considering sharing an existing Class Climate installa tion at a large neighboring university Both situations can be solved by using client operations Clients are subsystems that are completely separate from each other and yet use the same VividForms and computer environment In principle this means a number of Class Climate installations in ONE sys tem scantron offers as a service the setting up of clients Since for each client it is only neces sary to have the necessary number of user licenses especially small colleges and uni versities will find it affordable to participate in teaching evaluations 530 Scantron Corporation Copyright Electric Paper GmbH Class Climate COURSE EVALUATION FEEDBACK SYSTEM Index A Access rights 0 0 ees 32 Authorizing access rights to QM views 362 Accessibility 0 0 0 0 ccc ee es 19 Active instructor Accounts 244 4 dae ca he cba eddee ek Benes 21 22 195 Active instructor s data 0 000000 05 203 Creating active instructors as administrators 195 c
238. about the 107 The instructor handles the technical equipment video projector etc instructor without any problems Please grade the instructor for this course pf __ 4 S The lead time of the course is adequate tH Figure 397 Normed Profile Line for each Scaled Question of a Questionnaire As norm basis you can use averaged data from surveys you conducted in the past with the same questionnaire You can add these norm data mean values and standard devia tions for the individual questions of the questionnaire manually or you can have them converted automatically from a summary report that was created by a report creator This can be e g a summary report for a subunit or similar In addition to norming survey results individual message texts for below average aver age and above average results can be added to the results These texts can be accessed by instructors via a link in the PDF report Text building blocks are used to create individ ual message texts based on the results achieved in a given evaluation The norm profile lines and message text functionality were developed in collaboration with Dr Heiner Rindermann from the University of Magdeburg 6 1 1 Calculation of norms The norming in Class Climate was developed in cooperation with Dr Heiner Rindermann from Magdeburg University and consists of a modified form of the Z transformation The formula for cases where large above average values are better is mean
239. ach s Alpha describes the internal consistency of a question group This value indicates whether the items of a question group are meaningfully related to each other and can thus be seen as capturing the concept the question group is meant to measure Cronbach s Alpha can range between minus infinity and 1 however only positive values have a meaningful interpretation A value of 0 means that the items i e questions are not associated which each other at all A value of 1 would be the strongest relationship between questions that is possible In general with a value of 0 7 or above the scale i e question group can be considered as reliable Scantron Corporation 263 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM The table below gives a guide how different values of Cronbach s Alpha can be inter preted Oe Eee ee a er Table 14 Interpretation of Cronbach s Alpha When activated in the PDF report settings Cronbach s Alpha is given in the PDF report for each indicator menu System Settings Report Settings Configuration Cronbach s Al pha Cronbach s Alpha can only be displayed if the indicators of the corresponding questionnaire have been defined previously 1 2 3 a 5 a 4 Questions about the teaching material a 0 72 i 7 4 wnt 2 Figure 274 Display of Cronbach s Alpha in the PDF Report Class Climate calculates Cronbach s Alpha with the following formula o N 4
240. administrator has logged in When checking for updates data is transferred from the Class Climate system to the update server The following information is included the customer name the license key the current Class Climate version the default system language the current configured language the product derivative the content of the configuration setting server root path the ID of the supplier as well as a unique ID for the update check process itself which is added for reasons of security All this information is SSL encrypted and used solely for technical purposes No personal data or captured data from your system is transmitted If you do not agree to the transfer of the above mentioned information sim ply deactivate this function Independent of this function you will be informed of available updates through other channels O deactivated 1 every 30 days 2 every days 3 after each login CSV export for blackening degrees in the verifier If this function is activated the verifier can export the blackening degrees of all recog nized fields within a batch as a CSV file in the batch view Scantron Corporation 529 Copyright Electric Paper GmbH system Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 6 Client Operations A Class Climate system is made up of VividForms the web server and a database server Together the Class Climate database and the server software make up
241. aenbi sana donenseianaans ema sonnabens 34 3 3 1 BACKING UP THE DATABASE sacasancnsrteniansenvaneataswrantsianswsdaseeneinnsntaniasinaecwisngatiniaanadmercneseanier 34 3 3 2 BACKING UP THE IMAGE FILES OF THE OPEN QUESTIONS ccceccececeeeceeeeeeteeeaeeeeeesaeeaues 35 3 3 3 BACKING UP THE ORIGINAL IMAGE FILES FROM SCANSTATION 2 cceceeceeeeeeeeceeeeeeseeeees 35 B YOUR EVALUATION PROCESS THE PHASE MODEL 2 0 0 ccccsseseeeeeeeeeeeeeeneeeeeeeeeeeeeeseeeeeeenenees 37 1 THE PHASE MODEL YOUR WORKFLOW IN THE PROCESS OF EVALUATION scceccceeeeseeeeeeeeeaeeees 37 2 PHASE 1 PREPARATION OF A SURVEY PERIOD ccsecssecceccosecseccerccereneccurecueseeesarecuteceetarscuesaeetes 39 2 1 PRELIMINARY STEPS tenwusecasaainesericunaiesten s snasneteadeaania EATE EASAN AE SRA SaN NENN 40 2 1 1 DEFINE ORGANIZATIONAL DATA ccccscccsecceecseccsetcetsonccseecarsaeecsetntsenecasecertasecateertanecateas 40 2 1 2 COURSE TYPES PERIODS CUSTOM TITLES sswissssnsascnnninat ennnadebasdevancansvnsinedsansnnavueantnendsionas 40 2 2 SETTING UP THE ORGANIZATIONAL STRUCTURE cceccceccseeesecceceeneceeeteeeseeceeeteeeseeeseeteeeeeeaeees 44 2 2 1 SETTING UP THE SUBUNITS actuscumeasaaninantoecaiacantadcais nanan aiani aiDan dinh addidi kaikiaan 46 2 2 2 GENERATING AND MANAGING USER ACCOUNTS ccccccceeeeeeceeeteeeseceneeseeeeeeeseeeeeeeeeeneees 50 2 2 EATING COURSES ene Sane en ener ee Senne Pee ER ane ee eee 64 2 3
242. age gender etc and so on e the export as CSV file and into statistics tools such as SPSS Also active instructors can of course edit the results of their surveys further in other programs Just like the administrator active instructors access Class Climate via a web browser This means that they can theoretically access the system from any PC that has internet access unless the administrator applies certain restrictions for security reasons As is the case with administrator s access security is accorded through a log in only accessi ble with a password as well as the option to use SSL encryption With paper surveys the questionnaires are collected via de centralized scanstations which are operated by the instructors themselves Carrying out the scanning process is so simple that no training is required The active instructor accounts are useful in the following types of surveys and for the fol lowing users e An instructor of psychology or sociology wishes to collect data during a research proj ect using Class Climate This way you can give the instructor the opportunity to gener ate empirical data e Students postgraduates often base their work on empirical surveys The Class Cli mate administrator can assign an active account in Class Climate to the respective tutor professor In turn the tutor can grant his students postgraduates access to his account e Departments faculties have a requirement for surveys that are c
243. al evaluation Module Evaluation Activates the possibility to evaluate modules Visibility of active instructor surveys in the QM Views Here you can choose if you also want to display the surveys of active instructors in addi tion to the surveys of the central evaluation Display of course ID in the list of surveys Display of the course ID behind the name of the course Here you can choose if you want to display the course ID in the list of the surveys and in the header of the PDF report If activated the name of the survey consists not only of the name of the course but also of the course ID following the name in brackets Additionally the course ID is displayed in the header of the PDF report again after the course name 2 5 8 Section Email Functions amp Accounts Attach PDF report Attach PDF report to the report email Attach CSV file Attach CSV export to the report email Limit for file names in email attachments The amount of maximum characters for the file names in email attachments The value 0 deactivates the cutting of characters Subject Replace special characters If activated in the subject of every email special characters will be replaced to anticipate problems with some email clients Scantron Corporation 519 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Delivery method PSWDs central evaluation 1 PSWDs sent as ba
244. al service so that all our customers can benefit from the advantages of a fully customized online sur vey template For further information please contact your vendor Example of PHTML Editing scala phtml Scaled questions are used a lot in surveys While you cannot choose how you want them to be displayed in paper based surveys in online surveys you can By means of editing the scala phtml file located in the element folder of a template you can define it for your own use 160 Scantron Corporation Copyright Electric Paper GmbH Class Climate As you can see in the following figure lots of information like the label of the question the definition of left pole right pole and abstention or details of options are available through simple functions of the current object getLeftPole getRightPole and so on Code is commented so that you will clearly see what is done at each step You can decide to display the radio buttons in a table or in a div element you can choose to have them to the right of the label or under the label this can also be defined in the CSS file you can add your code for extended validation rules put images instead of poles each time the left pole is defined as do not agree and the right pole as totally agree and other images for other types of poles for example In this example you also see some code resulting from functions as getADAOption Text These functions are very important
245. aled questions with amp options Scaled questions with 9 options Scaled questions with 10 options Scaled questions with 11 options Figure 476 Indicator Selection of a Question Group Font Size Select the font size for the heading text from 7pt up to 20pt default resulting from the chosen default font size in the menu System Settings Class Climate Settings Vivid Forms Default Font Size Text Element If you check this box the question group will be changed into a text element This is only possible when adding a new question group Please Note When changed into a text element the question group loses its original function and becomes mere text You can no longer add items such as questions or design elements to this redefined group Having made your settings and clicking on Apply the chapter title will appear in the pre view You can open the properties of the question group again with a double click in the pre view window or by using the symbol i in the Editor Control menu Edit and the menu Edit Question Group Attention Clicking on the symbol d or on the text Delete Del in the menu Clipboard will delete the entire highlighted chapter as well as all of the questions in it without any warning or confirmation Displaying the background colors can be switched on and off in the menu Form Proper ties with the icon or the text Show Colors Hide Colors
246. aluation Version V5 0 Database My SQL localhost Paper surveys Licensed Online Surveys Licensed Handwriting recognition Licensed VividForms Designer Licenses 5 Version 0 5 7 1 Scanstation licenses 4 unlimited Campustlicense Assign to subunits User licenses License key Customer name License key Save VividForms Designer Licenses 1 Not in use yet 9 Not in use yet 3 Not in use yet 4 Not in use yet 5 Not in use yet Users Please choose License allocation Scanstation licenses _ Name Version IPaddress MAC address 1 01 213 252 154 17 00 00 F0 7F C7 11 3 2 01 213 252 154 17 08 00 46 B6 A5 AC 5 3 501 3 2 0 192 168 245 129 00 0C 29 63 70 3F 3 4 Not in use yet Y Automatically assign a license to next requesting Scanstation Figure 586 License Management Beneath the section License Key you will find the administration of VividForms Designer licenses It will only be displayed if you have purchased the corresponding licenses With the help of the drop down list a license can be assigned to a Class Climate user e g subunit administrator or instructor Select the desired user from the list and click the but Scantron Corporation 473 Copyright Electric Paper GmbH system Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM ton License allocation The user will then be shown in the overview of VividForms Designer
247. alue as well as how much this question contributes to the quality guideline in percent Ques tion 1 lower threshold value 3 upper threshold value 4 a proportion of 25 of quality guideline 1 In the lower half of the table shaded green you see the results of your questions The question 1 for example reached a mean of 3 8 The absolute quality is calculated according to the following formula N _ observed mean lower threshold value upper threshold value lower threshold value In this example for question 1 3 8 3 4 3 0 8 Scantron Corporation 349 Copyright Electric Paper GmbH Class Climate Your Evaluation Process The Phase Model Class Cl mate For the quality in the following applies If the quality is gt 1 then 100 is reached If the absolute quality is lt 0 then 0 is reached For all values between 0 and 1 the quality in absolute quality 100 In this example for question 1 0 8 100 80 The quality index of the whole quality guideline is calculated with the following for mula gt observed quality per question in weight per question 100 In the example this is for quality guideline 1 80 25 33 75 100 44 75 This value is rounded to 45 The following formula is used to calculate the overall quality of this survey gt quality index of whole quality guideline weighting of whole quality guideline in relation to the overall quality index 1
248. amantha Miller Advanced Data maane 144 Tanar ORN amp e Reporting 03 available 2008 05 23 201 O QyTrainer OBD S JSIR Figure 447 Reports on the Module Survey and all of its Components If the automatic report submission is activated all recipients will receive a report by email The person linked to the module account will receive the whole report while those people linked as secondary instructors to single courses will receive their parts of the report only If there is a course which has no report recipient assigned to it then the report will only be sent to the module coordinator when using the Batch Events or sending the report directly from the survey list When sending reports via Process Defaults oder via Scheduled Tasks there are to possibilities to deal with such courses e the report for this part of the module is only sent to the module coordinator e the report for this part of the module is sent to the module coordinator and to all report recipients defined for the different parts of the module The latter option can for example be useful when the course without a defined report recipient corresponds to a general survey part concerning the module in total and when the results are to be communicated to all persons involved The type of dispatch can be defined in the Class Climate Settings menu System Set tings Class Climate Settings Surveys Module e
249. ame time the login screen will be blocked for the IP of the potential assailant for the defined time in minutes This block can be prematurely lifted by enter ing the CAPTCHA correctly 28 Scantron Corporation Copyright Electric Paper GmbH Class Climate Warning Message when using the Standard Password As long as the predefined standard login admin admin has not been changed a warn ing message appears when the administrator logs in with a prompt to change the user name and password Both can be adapted in the menu System Settings My Profile see chapter B 2 2 2 Generating and Managing User Accounts rA Warning Message User name and password have not yet been customized To avoid unauthorized access to the system they should be changed Click here to go directly to your profile Figure 13 Warning Message when Using the Standard Password The use of the predefined login is a security risk for working systems Check for Update Notification Once the administrator has logged in automatic checks for updates are carried out at regular intervals standard value is 30 days When checking for updates data is trans ferred from the Class Climate system to the update server via the administrator s web browser the Class Climate server itself does not connect to the update server The fol lowing information is included e the customer name e the license key e the current Class Climate ver
250. ame you will reach his or her user profile Change profile data by entering new data and save it with OK Addresses and institute numbers play a role only in the self registering procedure If an activated user has forgotten his password it can be overwritten by entering the new password twice The user can then login again and change their password Moving User Accounts In the list of users in a subunit you will see a checkbox on the right hand side You can check any combination of these fields At the bottom of the table you will see the function Move selected to SUBUNITNAME Select the target subunit from the selection list A click on the button move will start the procedure Please note that users with the same name may already be in the target subunit if a number of instructors have the same name In this case you will be notified that you have for each of the affected instructors the following choice e Overwrite The surveys and profiles will be consolidated As a result there is a single user account e Recreate The user profile is moved even though the names are identical and there are two accounts with the same name which only differ in their login names The following users already exist in the targeted subunit Course name Overwrite Create Donna Harwood p OK Cancel Figure 37 Move User Scantron Corporation 61 Copyright Electric Paper GmbH AN Class Climate Delete
251. ample the question The course perfectly prepares me for my professional life was assigned a weight of 25 a lower threshold value of 3 and an upper threshold of 4 It was also determined that higher values are positive In this example we are deal ing with a scaled question with response values ranging from 1 strongly disagree to 5 strongly agree The targeted value in terms of quality is reached when the mean value is 4 or higher If the mean for this question is below 4 a deduction will apply starting with 0 and in creasing linearly depending on the extent the value falls short of the target The full 25 are deducted when the mean is equal to 3 or smaller As soon as the question The course perfectly prepares me for my professional life reaches a mean value of only 3 the full 25 are deducted lf other questions that belong to the guideline get a total weight of 75 it is possible to reach a maximum deduction of 100 This would mean that the deduction from the over all quality index set for this guideline would come to full effect The extent of this deduc tion is determined when the quality guideline is created Example Calculation when Higher Values Are Better In the following example a scaled question with a 5 point scale The course perfectly prepares me for my professional life was assigned a lower threshold value of 2 5 and an upper threshold of 3 22 It was also determined that higher values are better
252. amplecity edu classclimate online Adds a link to the online survey that contains the server address as well as the PSWD password Simply clicking the link therefore shows the online questionnaire Time of submission of an online survey Example 22 15 34 15 09 2005 Email address of an online survey participant Example user_05 example com Number of all PSWDs Number of PSWDS dispatched percental response rate on the basis of the dispatched PSWDs percental response rate on the basis of the total existing PSWDs Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM 2 1 6 HTML Format for Email Texts Emails are sent as pure text messages per default If desired they can be sent in HTML format For this the option Emails in HTML Format in the Email Functions amp Accounts section of the system configuration must be activated Formatting with the help of HTML tags can now be done in the text templates links can also be added The aiai HTML tags are available Underlined lt u gt Underlined lt u gt Centered lt center gt lt center gt Center lt center gt lt a href http www example com gt http www example com lt a gt Table 21 HTML tags for Emails The HTML command lt br gt for the line break does not necessarily have to be used All normal line breaks in the text templates are automatically converted
253. an click on the survey name You also have access here too all the functions of this survey Survey Details EN Managing and maintaining a healthy ld Survey lifestyle amp Instructor Philipp Belmore J Course Managing and maintaining a healthy lifestyle Survey Period 5511 Type Paper survey hard copy S32 Participants Non anonymous participants Questionnaire Quest_01 Status Survey Created on English A as ne nn 4 WOnSs O Survey ID 34492 Show cover sheet form in browser In progress ready for data 05 12 2011 at 09 42 15 ey ie a Maintenance 3P Finish Data Collection Close Survey af Delete Survey F Assign survey to substitute instructor Edit Show notes m Figure 93 Survey Detail Status In progress Scantron Corporation 117 Copyright Electric Paper GmbH COURSE S GH mat SYSTEM Your Evaluation Process The Phase Model thy AN Class CI mate Some functions can only be accessed using this detail window Depending on the status of the survey e g In Progress data available the survey type and further attributes spe cific to the questionnaire or survey e g language PSWD status a variety of survey data and functions will be made available The following table gives you an overview on the actions concerning surveys a Deletes the response data of a survey The sur R vey remains in the status In Progress able 5 nloc qata co e
254. anagement 66 Leadership Development 47 Organization and Management WARNING The surveys will be deleted irrevocably Delete Surveys Figure 119 Tree Structure Deleting Surveys Scantron Corporation 135 Copyright Electric Paper GmbH j Class Climate 3 2 6 Conducting a Paper Survey Production of Questionnaires When using the cover sheet procedure questionnaires are given to a printing company for production and are then used as needed for surveys The cover sheets can be cen trally produced and distributed to the instructors Alternatively the cover sheets can be sent to the instructor by email In the hard copy procedure the questionnaires adapted for specific surveys are either produced centrally or by email delivery to instructors Document Quality The quality of the paper and the print image is critical for the scanning and processing stages We discourage the use of gray recycled paper due to the gray shadows which can appear Note that when producing questionnaires using private printers or copiers the printer driver is set up for A4 size paper and the copies should vary due to tilting or enlarge ment reduction only marginally from the original The tolerance range for such image dis crepancies is about 10 of an edge length The general rule is that clearly visible changes to the original document should be avoided 3 2 7 Effective Management and Conduction of Online Surveys P
255. anceled Send an email to the administrator when the setting in the Instructor s Optional Questions has been activated that the survey has been canceled Default value course participants The default value of course participants is used for batch printing when no such informa tion is given This value can however be changed when batch printing Anonymization threshold The value set defines the limit to the number of questionnaires before the anonymized text of open questions will be shown If the number of questionnaires is above this value the images of the open questions will be used Please note that a value of 0 deactivates this functionality i e all of the questionnaires will be shown for anonymization when the anonymization has been activated for this subunit Module Evaluation Display of name of the Secondary instructor in the heading of the question group If activated the names of the secondary instructors are displayed on the aggregated questionnaire In this case in each first question group heading of a partial questionnaire the name of the relevant instructor is displayed This setting helps you to relate the ques tions to the instructors It only affects new surveys existing surveys are not concerned Module Evaluation Delivery of module sections with no instructor If this function is activated reports from module sections courses which are not assigned to an instructor are sent to all instructors for that mod
256. and after the decimal point The advantage of this method is that the high accuracy of checkboxes makes it unneces sary to use ICR for handprint recognition which would mean a considerable amount of review and correction Please note that only values between 1 0 and 5 0 will be considered 424 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM S m AN Class Climate Creating a Questionnaire in the VividForms Editor What is the grade of your last school graduation 1 2 3 5 0 cI su C1 0 mjnjmjnjminjimjiminj n Figure 514 Grade Value in the PDF Preview 2 Adapting the Size of Answer Boxes You can change the size of your answer boxes in the VividForms Editor under Form properties You have five sizes 8pt 9pt 10pt 11pt and 12pt to choose from Layout settings Repair form Enable numbering Edit Pole Template Filter settings Validation Required questions Cross tabulation l Change color scheme S Picture Library Line Height Font Size t2p 10 pt Size of the answer boxes Figure 515 Adapting the Size of Answer Boxes lf for example you have defined a line spacing of 11pt and then set your checkbox size up to 11pt the system automatically increases the line spacing to 13pt Scantron Corporation 425 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SY
257. andez Name of the course Organization and Management Name of the survey Comparative line Prof Development WS10 11 a The instructor is always well prepared siii av av S The instructor explains even complex topics in a comprehensible way iii av 3 6 av m 3 6 The instructor handles the technical equipment video projector ete ff av ad 4 without any problems Please grade the instructor for this course av 3 5 g if i u poor 3 very good esi The lead time of the course is adequate Strongly dis i Strongly agree amp 3 6 agree z i f av 3 4 Figure 365 Report Creator Comparative Profile Line In the header you first see all of the information on the selected courses and or reports followed by the list of questions on the left which are complemented on the right by the two overlaid profile lines as well as averages As usual with the profile lines only questions regarding the standard value and scaled questions are displayed here In addition to the course Organization and Management by Carlos Hernandez you also mark the course Management Strategies of Prof Dr Philipp Belmore and again choose as comparative profile line Prof Development WS10 11 You leave all other options at their default value Scantron Corporation 317 Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM Your Evaluation Process The Phase Model th f gt Class CI mate 5 courses d Reports Pro
258. ant such as course of study type of degree etc using the three custom fields You can later on use these criteria to filter the CSV raw data Scantron Corporation 187 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model h Class Climate COURSE EVALUATION FEEDBACK SYSTEM Details of the participants 7 Course Managing and maintaining a healthy lifestyle kir ha Title First Name John Last name Doe Email j doe example com Address Custom 1 Engineering Custom 2 Custom 3 Save Cancel Figure 177 Details of a Non anonymous Participant Close the window by clicking on Save Click on the button Back at the bottom of the page to return to the course details Close the window of the course details by clicking on the button OK This course is now saved as non anonymous In the list of the course in the column Participants it is marked as non anonymous by the index card symbol 4p Evaluation Course Managing and p 62 maintaining a ee MA 1 continuous Seminar Sem 03 english Central Campus Sa healthy lifestyle 63 SEE Economics Engineering NA 2 continuous Seminar Sem 02 5 6 Central Campus FR Human T3 Resources ccc hast a 02 P1237 continuous Seminar R P412 20 english ea rite F a Management clences enter Figure 178 Anonymous and Non anonymous Courses If you create a survey for a non anonymous course it will be indicated as such in the sur vey details that this survey
259. antron Corporation 91 Copyright Electric Paper GmbH X Class Climate e Required Questions Those questions of online surveys for which an answer is compulsory can be defined here e Cross Tabulations The cross tabulations shown here will appear in the PDF report e Free Indicators It is possible to define indicators freely so that questions of different question groups can also serve as a basis for calculating an indicator In this way the elements of an indicator can be freely allocated across the questionnaire These so called free indi cators can be stored separately for each questionnaire and later displayed in the PDF report instead of the traditional indicators e Languages Different languages can be stored for questionnaires in online surveys so that online survey participants can select questionnaires in different languages With paper ques tionnaires you must create several questionnaires and surveys whose results you can combine later in the Report Creator In the section Questionnaire the following options are available Edit Form Opens the questionnaire to edit The Editor or the Designer can be opened in this way depending on the Engine Here you can change the wording of the questions and for mats as well as making analysis specifications for indicators Export Creates a file from the questionnaire which can be saved and imported into a different Class Climate system Delete Form Dele
260. aper GmbH Class Climate up when scanning a batch then the unique number on each questionnaire will allow them to be correctly sorted The number of questionnaires for printing is based on the number of participants If this information is missing then a default value can be entered into the entry field You can now use the batch print feature without needing the serial number hard copy procedure if you deactivate the option Add serial number for automatic sorting This is useful in case you are unable to prevent forms being duplicated during the survey process and you need to collect all data despite having multiple identical serial number IDs Print only master versions of cover sheets and questionnaires Create complete sets of questionnaires based on number of participants 25 Default value if enrollment information is missing Figure 162 Batch Events Producing Questionnaires with Page Numbering Click Request to begin the procedure You will now be redirected to a page displaying an overview of the courses you have selected Each of the columns in the table show the name of the course the questionnaire used the number of questionnaires already printed the number of participants of the course and the number of questionnaires still to be printed The number of copies is equal to the number of participants of the course If in an earlier process questionnaires for a course were created using the
261. aper GmbH AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Creating Questionnaires with VividForms 2 8 2 Vertical Pole Labels Vertical pole labels can be defined as an alternative to the horizontal labels Chose the option ii Extended Pole Labels after creating a new question group Now enter the option texts into the dialogue Each text element is limited to 25 charac ters t Extended Pole Labels M Extended Pole Labels Option Strongly Disagree Le Strongly Agree T Agree Rather Agree p Rather Disagree ag Disagree Strongly Disagree OOOO Abstention Degree of inclination a5 y Please notice that the inclination of the answer options will not be shown in the preview of the VividForms Editor due to technical reasons Apply Cancel Figure 518 Enter and Edit of the Vertical Pole Labels Click Apply to close the dialog and create the vertical pole labels on the form Now scaled questions can be added The system will assign the left and right pole labels to each defined scaled question below the vertical pole labels wn r S g 5S ggs 8 5 3 lt c o 909 ry wn w i ESZEBE so 0 80 80 8 O ail m ai gij gi gi it complements the learning matter OW oo oo itis well structured Lo EP ooo ie It benefits from the technical possibilities internet Noha oe videotaping blogging etc Figure 519 Vertical Pole Labels in the Edito
262. aper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Time Format Here you can define the date format The following characters are recognized notice upper and lower case h 12 hour format of an hour with leading zeros H 24 hour format of an hour with leading zeros i Minutes with leading zeros s Seconds with leading zeros a Lowercase Ante meridiem and Post meridiem A Uppercase Ante meridiem and Post meridiem Display of menu images By default this option is active which means that menu images are displayed in the upper left corner throughout the entire system If this option is deactivated menu images are hidden throughout the entire system Number of Images for Menu The number of images that can be displayed alternatively in the screen Please note that the images must be named and in the subfolder Bilder The image name begins with customer and ends with a number The file ending must be jpg The first image is named customer0 jpg and the last image customerxx jpg with xx being the number given in this setting Questionnaire List Display of Questionnaire Status The status column in the questionnaire list can be shown or hidden With a large number of questionnaires it is recommended to hide the status column so as to accelerate page assembly PDF Format selection of the format for the creation of PDF documents DIN A4 210 x 29
263. aper GmbH AN Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM 1 5 Utilization Statistics In the section utilization statistics in the Menu System Information you will receive an overview about the utilization behavior of Class Climate users SUBUNITS Oueshonnaires System Settings Class Climate Admin T o S q se Chemistry amp Eve Bloom Physics 0 0 0 0 0 04 08 2009 amp David Brown Scanstation Demo 0 37 0 3 1 04 09 2009 information amp Ben Carter Rhetoric 0 0 0 0 O 04 08 2009 So Search A amp Henry Darcy Geoscience 3 0 0 0 03 09 2009 Send Emal Stan Data System Logins T 0 0 0 0 08 12 2008 06 08 2011 ae amp Doris Dean Geoscience 0 0 0 0 0 08 12 2008 amp Elizabeth Doe Business Studies 0 0 0 0 03 25 2009 Alice Eddison Chemistry 1 3 0 1 1 04 06 2009 04 21 2011 Figure 581 Utilization Statistics At the top of the screen you will see two graphics At the left is the top 20 instructors according to the number of surveys At the right you will see the top 20 in relation to the number of logins This number is of course interesting only in connection with the decentral model Complete access is only allowed the administrator and the deans Normal user accounts can only see the data of those users who in their configuration have permitted this The following data fields are found in the table e Name Title first and last name of the user Subunit e Subunit
264. are dis played If you deactivate the Comparison lines the graphic only contains the profile line of the selected course report all others are not displayed So that you can use this function meaningfully in its deactivated form you should bear in mind the following two points If this option is deactivated you must select either Minimum Maximum Values or Over all Average instead or of course both Since through the deactivated function you do not display anything but the current course a comparison is otherwise not possible Do not activate any first or second comparative line as then you would restrict yourself to 5 Courses Reports in order to select profile lines If you activate the Minimum Maximum Values and or the Overall Average but deacti vate the Comparison lines only the respective current profile line will be displayed to you the values of further courses reports however flow into the calculation the mini mum maximum values and that of the total average In practice this looks for example as follows Under 5 Courses Reports you select Management Strategies and Organization and Management as well as the report Prof Development WS10 11 The first and second comparative line remain deactivated Now tick Comparison of selected courses of reports with each other no necessity but is advisable In the comparison options the Minimum Ma
265. are summarized as single PDF files in a ZIP file This is advantageous for example when the single PDF files are to be passed on in elec tronic format deposited in a public folder or when one wants to print them individu ally 178 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM Create an entire PDF Create individual PDF reports in ZIP file Request Figure 166 Batch Events Print PDF Report For each of the PDF reports in the ZIP file it is possible where necessary to configure the naming of individual files in advance In the central system settings menu System Settings Class Climate Settings Functions Batch Events Naming conventions for PDF Reports in ZIP files with the aid of placeholders a naming convention can be deposited By default the following placeholders are used SUBUNIT SURNAME FIRSTNAME SURVEYID SURVEY The following placeholders are available Peevey pane urvey Political Economics 1 A JRVEYID urvey ID 496 QU ONARY Name of Questionnaire JVEMOFORWV OUR YP Name of the Type of Course eminar UBUN Name of the Subunit JURER Name of Instructor Prot Dr Jonn Doe URNAW urname of Instructor men Pee MAEN PAE with time in ISO format Q 03 08T 16 19 20 y AME 0910 0918 Date given according to the time format configured in Class Cli mate JRREN IDA Date given accord
266. arried out outside of the centrally managed course evaluation These may for example be surveys carried out in refectories canteens and libraries but may also be surveys carried out among graduates and which can also be managed through active instructor accounts In the following graphic you see at the bottom level the active instructors whose license to evaluate is highlighted by blue colored rings Figure 9 Active Accounts in Addition to Central Evaluation Scantron Corporation 23 Copyright Electric Paper GmbH Class Climate Of course active instructors are not able to access one another s results Only the active instructor himself and the administrator subunit administrator have an insight into the data If you have been using Class Climate for some time it may be noted that this type of evaluation was formerly known as de central evaluation 2 4 Basic Terminology within the Class Climate Administrator Manual Within this manual you will come across some terms repeatedly Due to their impor tance their meaning is outlined in the following Quires Questionnaires may be several pages long The complete copy of a questionnaire including all its pages is called quire AS soon as more than one sheet of paper is needed ONE quire comprises SEVERAL sheets of paper Quires may also be known as booklets in other applications Instructor Accounts Active Passive Surveys are always created for
267. as two or more recipients are selected Class Climate sends the email via the BCC field blind copy so that the addresses of the recipients cannot be seen Please remember that creating hundreds of emails could take depending on the mail server load several minutes Enter a subject line as well as a message and then click on OK to send the email You can see if this action was successful in the display line at the top of the browser window The sender address and the sender name are taken from data in the user profile of the administrator Other email types some of which are created automatically receive sender data from Configuration Email Functions amp Accounts Sender Name for all System Emails 1 3 Delivery Here you will find a table with a list of all report emails that have been sent l Deliveries There are 113 Log entries available chowenes E me of data sets to display Starting from data set TEE SER Bat Survey Type Recipient Address Way Sent Pen Organization and Management Carlos Hernandez Se ae Form train_en Report Profesional Development hernandez example com v available ea Course type Seminar Managing and maintaining a healthy psyyp to lifestyle an e respondents Coure type Seminar See 05 16 2011 j doe example com j doe example com at 10 21 29 m4 Figure 577 Delivery Details You will find the following information in the table Bat Batch ID of the jobs which
268. assign a deviating period to each course How ever please bear in mind that by selecting the comprehensive definition of periods all period settings of individual courses will be overwritten At the bottom of the list click on Continue to complete the import procedure 2 3 2 XML Import Structural Data Surveys and Scheduled Online Surveys Information about the DTDs of the XML import Document Type Definitions and further details can be found in the additional manual about the XML import menu System Infor mation Manuals XML Import Manual 2 3 3 Import of Course Participants Email Addresses In online surveys access codes PSWD are usually sent directly to the respondents by email The import interface menu Subunits Data Import prevents the user from having to copy a new list of email addresses into the entry field for every survey before the PSWDs can be sent The participants addresses for all courses are imported into Class Climate by the import interface before the survey is compiled Scantron Corporation 81 Copyright Electric Paper GmbH Once the PSWDs have been imported the email addresses are available and no longer have to be entered manually This applies to both manual dispatching and email by Scheduled Tasks A CSV file with two columns is created for the import of addresses with the specification of the course id in the first column and the email address of the participant in the secon
269. assistant the verifier etc so as to find them again fast Go to the respective subunit and click on Create New User The input window which opens should be familiar to you from creating instructors and other users In the way you are accustomed enter the data for the person who will act as report creator It is crucial that you choose the user type report creator instead of instructor and the like Scantron Corporation 269 Copyright Electric Paper GmbH COURSE EVALUATION mat SYSTEM Your Evaluation Process The Phase Model th Class Clim ate 2 Change the user type Instructor Dean of Studies Dean See utilization statistics for the subunit Module Report Creator Data Entry Assistant Handwritten comments Verifier Subunit Administrator Figure 283 Creating a Report Creator Step 1 1 2 3 2 Change the attributes of the user Mrs r Title First name Maria Last name Report Phone Email report example com Address Department ID 0 Language Default language v Login name rc New password Seeveeecrosecsoroceooooooscoeere Confirm new paseword PYITItiiiiiiiiiiiiiiiiiti titi lt lt Back C nea Figure 284 Creating a Report Creator Step 2 270 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli FEEDBACK SYSTEM thy Class CI imate Phase 4 Advanced Reporting In the third step you define the data access of your report creator By default the
270. assword LDAP registration Deactivated Cancel lt lt Back Next gt gt Figure 231 PDF Letter Specification of the Recipient s Address e Sender s address The sender s address in the figure shown at the letter s top right is specified by you in the configuration of each corresponding PDF report System Settings Report Set tings Configuration You will find the options Sender part 1 up to Sender part 3 Here you can insert the university s name your company street and city or whatever else you may require Sender part 1 Example University First line of the senders address field on the PDF report file cover letter Sender part 2 Washington Street 5 Second line of the senders address field on the PDF repor file cover letter Sender part 3 12345 Democity Third line of the senders address field on the PDF report file cover letter Figure 232 PDF Letter Sender s Address on the Letter The sender s details to be found above the address field are specified by you right below it Sender above recipient address 226 Scantron Corporation Copyright Electric Paper GmbH lass Climate The Text in the Letter You can edit the text in the letter under the option Text templates main menu System Settings When changing to this page a window appears offering numerous text tem plates for you to choose from
271. at will represent the analysis of this question in the PDF report A group number of 10 corresponds to the value areas of 1 9 10 19 20 29 90 99 If the number of groups is left at the default value of 0 then each value will be displayed individually in the bar chart of the PDF report Furthermore the entry in the matrix field can be read as a natural number or text i e to be read as a string of characters When capturing matrix values as text it is possible that a 422 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM series of numbers with leading zeros i e aS can occur in postal codes can be captured correctly On the questionnaire the question regarding age is shown as a two row matrix Respon dents can mark the 10 s in the top row and the 1 s in the lower row The advantage of this method is that the high accuracy of checkboxes makes it unneces sary to use ICR for handprint recognition which would mean a considerable amount of review and correction 1 Questions about you What is your age oh UL OO Figure 510 Horizontal Matrix Question in the PDF Preview 2 6 6 Vertical Matrix Question With the vertical matrix question up to ten digit numbers can be entered i e student num ber zip codes etc Select the question type matrix field and click Next You can now enter the text of the questio
272. ate COURSE EVALUATION FEEDBACK SYSTEM M Altemative forwarding including authentication Participants of online surveys can be directed to a different intemet site once their survey is submitted The forwarding occurs based upon the forwarding address which is defined in the details of the corresponding questionnaire Each questionnaire can be given an individual forwarding address The following option determines whether the authentication for forwarding requires a value chosen from the properties of a course Use the following field to determine the secret word 0 no course user data fields If no questionnaire specific spare secret password has been defined in the details of the questionnaire no secret password will be requested for the authentication 1 Course user data field 1 2 Course user data field 1 Survey ID 3 Course user data field 2 4 Course user data field 2 SurveyiD 5 Course user data field 3 6 Course user data field 3 Survey ID T Course user data field 4 8 Course user data field 4 SurveyD 9 Course user data field 5 10 Course user data field 5 SurveyID Please note if no questionnaire specific forwarding address was defined in the details of the questionnaire the forwarding occurs based upon the system wide defined forwarding address Menu System Settings Class Climate Settings Survey Online Altemative forwarding for online surveys no secret word
273. ate If you have already uploaded additional online sur vey templates other than the standard template Class Climate Online Survey Template you will be asked on which basis template the new customized template should be based Online Template Management Create new customized online survey template Basic template Class Climate Online Survey Template Basic template Customized Template Figure 138 Customized Online Survey Template Select the basic template Scantron Corporation 153 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Select the desired template and click on Next If you have not yet uploaded any addi tional templates the following screen appears immediately D Online Template Management Example Institute Dr Sima Seeland Purg ASG rhe McimMmoco ACARA E aipa A m A GUSINe SS BCONOGMCS DUSINGESS econmics INLTOOUCION ka Paced ta ae ad ta cat nat he a at ea G The instructor is always well prepared The instructors explains even complex topics in a comprehensible way The instructor handles the technical equipment video projector etc without any problems Please grade the instructor for this course poor very good shat Please give us your feedback about the instructor as well as suggestions for improvement General Settings Colors Navigation Question Types M Online template name New Onlin
274. ation Check Filling Degrees 0 0000 eee 216 Vere eesbaseeeee eae ase tice seer seer ene 210 Vertical matrix question 0 408 423 Vertical pole labels 0 0 00 002 428 VIVIOIPONMNS 2 0 pcan eoeete bik Gaede eee eee eee A 522 Export of questionnaires 00005 457 Import of questionnaires 0005 457 Question library 0 6 ee 441 VividForms Editor 20 0000 c eee eee 387 Adding Pictures 0000 eee ees 435 VividForms Log File 0000 e eau 483 VividForms Reader 00000 eee eee 209 VividForms WebVerifier 005 210 VividForms Reader Recognition Set 0 cee eee 88 W Webservice 1 ees 503 WOCOSIIC 4 ne ececueu oe fee oe E dee sess sees 44 14 WebVerifier 0 0 0 0 ee ee 210 Keyboard control in WebVerifier 218 Workflow 0 0 0 cc ee eee 37 Write protect mode 0 0 0 eee eee 455 Writing email agi a viad a eta de tw ow are Swe cove ba ee 465 X XML import 0 0 0 aa ee 81 Scantron Corporation Copyright Electric Paper GmbH
275. ation 399 Copyright Electric Paper GmbH Creating Questionnaires with VividForms Class Climate COURSE EVALUATION FEEDBACK SYSTEM Following placeholders are available SUBUNIT Name of subunit ORGANIZATION Name of organization AUTHOR Name of instructor SURVEY Name of course or survey PERIOD Name of survey period COURSEID Course ID In addition to these placeholders two text elements can be used to fill the box containing hints on completion MARK Filling instructions part 1 CORRECTION Filling instructions part 2 Apart from the placeholders that are available as buttons almost all further placeholders for use in text templates can be used e g CUSTOMFIELD_X for the user defined course fields PROGRAMOFSTUDY for the program of study course etc A compre hensive list of all placeholders can be found in chapter D 2 1 5 Placeholder for Texts Only the following are excluded from use in questionnaire headers e all placeholders that apply to further report recipients secondary trainers e g SEC SURNAME_X e questionnaires that are used for paper surveys all placeholders that apply to online surveys e g PSWD SERVER etc The placeholders can be manually placed in the entry field of a placeholder assistant Instead of the placeholders you can enter text directly It then becomes a static text which is not adapted to the respective surveys As you know using the cover sheet proced
276. ation Manuals Scantron Corporation 205 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM 4 Class Climate Scanstation 3 2 ee SCANTRON Scanstation ne Status information Settings Manual ready Processed batches 0 Processed pages 0 Stopped batches 0 Job Created Pages Status Figure 207 Scanstation 4 1 1 Scanner Settings To allow for a successful processing of forms with Class Climate the scanner has to be configured in a specific way The following standard settings apply to all models e Image Mode Black and white e Paper Size A4 210 x 297 mm e Resolution 200 DPI e Brightness The threshold value should be slightly darker than average e Skew Correction Deactivated e Scan Type Duplex simultaneous scanning of both sides of the sheet Scanner configuration can differ in detail depending on the model and manufacturer For more information please consult the documentation supplied with your document scan ner 206 Scantron Corporation Copyright Electric Paper GmbH lass Climate 4 1 2 Important Rules for Scanning Before beginning the scanning operation make sure that the following conditions have been fulfilled Make sure that only those questionnaires from a given survey are to be scanned in a scanning operation The returns from one survey are called a batch lf there are mor
277. ation has already taken place In this case the survey must be reset broom symbol a further batch in the survey was scanned and the automatic closure of the survey operation was unintentional In this case set the option close survey after the first scan operation at Settings process defaults to no the settings of the scanner driver may have been changed Open the scanstation software click on Settings and select test scan Compare the settings of the driver with the Class Climate standards Duplex 200 DPI black white image Warning 482 Document FORMABBREV doesn t match survey Questionnaires in the batch which do not match the form type specified in the survey were identified and processed The cover sheet procedure may have been used and a wrong questionnaire form was used In this case a new survey with the questionnaire type that was actually used must be created Scan the batch with the new cover sheet Some questionnaires of the wrong type have gotten into the batch that was scanned SURVEYNAME processed X forms X invalid A batch was processed that contains some invalid questionnaire types The data of the invalid questionnaire types were discarded while the valid questionnaire types were processed Scantron Corporation Copyright Electric Paper GmbH Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM Messages e SURVEYNAME FORMABBREV
278. ative profile lines e Compare various questionnaire versions e Export raw data to Excel and SPSS e Archive raw data Phase 5 Quality Management e possibly definition of norms and or quality guidelines e Enable QM Screens giving deans an insight into the evaluation results of a depart ment e Generate new norm values for the following evaluation period some steps need to be performed only once or at least very rarely for example creat ing questionnaires others must be performed for each period for example the creation and implementation of surveys Some steps may not yet be relevant to you for exam ple the creation of norms for which you should already possess evaluation data Other steps are necessary in each evaluation such as again the creation and implementation of surveys To give you an overview of how Class Climate can support you in your evaluation the individual phases are accurately outlined in the following This way you can best decide which elements you wish to use and how you design them 2 Phase 1 Preparation of a Survey Period The preparation of a survey period includes e The selection of a questionnaire e The selection of a survey procedure e The setting up of subunits e The setting up of user accounts Scantron Corporation 39 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 1 Preliminary Steps Before
279. automatic recognition process e the XML Import Manual which supports you in importing your data into Class Cli mate You will be provided with the XSD for the import via XML XML schema and receive further detailed information All manuals listed here can be accessed by administrators and subunit administrators as PDF files directly in the Class Climate menu System Information Manuals In addition all manuals are by default stored in a directory on the server under C Apache htdocs classclimate doc drive C may need to be replaced with your server name Also here other manuals such as the Installation Manual and the VividForms Reader Manual can be found The Scanstation Guide is available in the dialog of the scanstation the VividForms Reader Manual can be found in the dialog of the Vivid Forms Reader In each active users account the Manual for Active Users is available for guidelines as well as the manual Creating Questionnaires with the VividForms Editor Note All PDF manuals are provided with linked directories so that you can navigate comfort ably Should the linking not work please check that the option View documents in PDF A mode is set to Never in the settings of the Adobe Reader menu Edit Prefer ences Documents PDF A View Mode 1 1 3 Sample Files In the menu System Information Sample Files there are a number of example and sam ple fil
280. ber of participants for calculating response eee Figure 582 Survey Evaluation Statistics Therein the header data of all scanned batches from a survey are displayed in a table This data allows you to see the time and size of the scanning operation Survey evaluation statistics Back Figure 583 Details of Survey Evaluation Statistics The specifications e Name of Scanstation which captured the batch e Number of Pages of the batch For Duplex scanners 1 sheet 2 pages e Number of non recognized pages NonForms these can also be empty pages 470 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM e Number of False Forms forms that recognized as Class Climate forms but did not belong to the scanned survey e Marking whether the batch was part of a Multi batch only with VividForms forms e Scan Date of the batch The following figure shows you the survey evaluation statistics 1 7 System Information This is where you will receive an overview of the number of surveys in the system as well as in the all subunits Click System Information System Summary Class limate Subunits Questionnaires System Settings a 4 th Pithi s5 Cli Pine FERIM y 9 sei 4 l System Summary Class Climate Adrmiin Street addres and house number Washington Street Administrator ZIP City 12346 Damonity
281. beralism train_01 The global indicators are listed first followed by the individual average values consisting of the following se Ouality of The Instructor 3 Quality of The Course 4 Quality of The Teaching Matenal In the second part of the analysis the average values of all individual questions are listed Figure 598 Standard Letter A letter can contain a maximum of one page of text The contents can be personalized with a series of placeholders which are described at the end of this section 490 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Evaluation Results To Belmore as private and confidential Result of a survey Dear Mr Belmore Thee email contains evaluation results for Human Resource Management ain_en The global indicators are istou ce followed by the individual average values consisting of the following scale 2 Questions about the benino 3 Questions about the course 4 Questions about the teaching material 5 Questions about the studying conditions In the second part of the analysis the average values of all individual questions are listed Note Adobe Acrobat Reader must be installed on your computer in order to view the files Your Administrator Figure 599 PDF Template Letter Reports not Created and not Sent to Instructors The minimum number as defined at System Settin
282. bunits in the area Assign additional subunits Thus your report creator accesses several sub units Multiple selections of subunits can be made by pressing and holding down the Ctrl key As an Administrator you set this value when creating the relevant user account As soon as you create a report creator a particular setting in the user rights step three of three allows you to define the report creator as system wide system level subunit groups own subunit and selection of further subunits or only subunit wide own subunit It is crucial to consider what exactly the report creator should be able and allowed to do in order to subsequently know where and how the report creator be created or whether several are required When an administrator or subunit administrator directly adopts the additional role of report creator in his user profile he also automatically receives the same data access rights as the administrator subunit administrator himself Creating a Report Creator Just like any other user a report creator is a user that is created in a subunit lf your report creator is supposed to work only subunit wide you create him in the subunit for which he is to produce summaries If the report creator works globally you can create him in any subunit at all since he has insight into all data anyway For example you can create a subunit System users where you put all users such as the report creator the data entry
283. c Paper GmbH Class Climat A Preparation and General Notes This manual is intended to assist you in your day to day operating of the software Class Climate If you wish to familiarize yourself with particular elements have a question or for example the software has changed due to an update you will require fast and conve nient access to the relevant information Therefore this chapter deals with the most important introductory questions Which Class Climate manuals are available and where do you find which information If these cannot answer all your questions where do you find more help What does the structure of the system look like How do start to work with Class Climate and how can save my data while working 1 Introduction The course evaluation system Class Climate was developed to offer universities and major educational institutions an effective tool for comprehensively implementing and processing surveys for quality assurance purposes Class Climate is suitable for both paper and online surveys This manual introduces the system s possibilities and abilities with a strong emphasis on the administrator s access It addresses users without any Class Climate experience as well as experienced users who wish to reference something specific Hence it provides an introduction into the utilization of the system as well as offering answers to questions related to particular topics Apart from a few exceptions neithe
284. caled Question ROW INDEX Indicates the line of a question normally the row index O each further question will be numerated in ascending order 1 2 Open questions always have a row index 0 even if they have more than one line F1 F2 F3 Indicates the blackening degree within checkboxes in a line from left to right checkboxes without blackening show the value O for boxes with a blackening the percentage blackening degree is shown Consequently the figure above can be interpreted as follows The first single choice question 3590 is a question with two answer options The second box has been checked and shows a blackening degree of 38 The second single choice question is a question whose answer options spread over two lines In the first line the first box was checked with a blackening degree of 42 The following figure shows the corresponding section in the PDF file You are male female What is your age B 18 29 30 39 C 40 49 O 50 59 L_ 60 69 Older than 69 Figure 222 Verification Filling degrees in the PDF file Scantron Corporation 217 Copyright Electric Paper GmbH 4 a For further information concerning the control and adjustment of OMR thresholds please refer to the Scanstation Manual 4 3 7 Responses to Open Questions Responses to open questions are only displayed in the WebVerifier when the option Handwriting recognition was activated on creating the open question for info
285. cation and the login of the students When generating an online survey a PDF file with the necessary number of PSWD is created The PDF contains the PSWDs as cards that can be cut out and distributed to the students On the cards you will find an explanation text that can be changed at System Settings Class Climate Settings page Survey Online There you will find the option Instruction text for PSWD cards The default text is This PSWD allows you to participate in an online survey Please use a web browser to open the following web address PSWD documents can now be generated in four different formats 3x8 PSWDs per page A4 2x PSWDs per page A4 3x7 PSWDs per page A4 3x6 PSWDs per page Letter The standard setting is the original format of 3x8 PSWDs A4 The format of the PSWD document can be selected in the configuration System Set tings Class Climate Settings Survey Online Format PSWD document Cover Sheets When conducting paper cover sheet surveys in addition to the questionnaire a cover sheet is generated It serves for the unique identification of the survey in the scanning process At System Settings Class Climate Settings page VividForms the text of the VividForms cover sheet can be modified default text empty Scantron Corporation 31 Copyright Electric Paper GmbH Class Climate e Certificate of Participation A certificate of participation is availabl
286. ch Events e user can define which report Is to be sent to the defined recipi Details of the Survey ent s Table 13 Types of Report Dispatch 5 Phase 4 Advanced Reporting As soon as you have implemented surveys and scanned data you receive the automati cally generated reports If you wish to process this data further for example to summa rize and or compare it there are extensive and flexible options in Class Climate available to you as well as the export facilities into other programs In the phase model this is the fourth of the five phases In this chapter you initially learn what indicators are and how you can create them in Class Climate since they form the basis for a certain type of summary reports You will then receive a comprehensive introduction to the options in producing summary reports The creation of reports does not occur via the administrator access but rather you must be logged in as a report creator Often this role however is carried out jointly with that of the Class Climate administrator For expanded evaluations you can export the captured data from Class Climate For this purpose the CSV format as well as a specific format for import into the statistics program SPSS are available to you The explanations of these export options bring us to the end of the chapter 256 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK S
287. compression it is not recommended for text and graphics The advantage of the PNG format is the compressed storage without losses which can not be guaranteed with the JPEG format Thus the PNG format is suitable for photo graphs as well as text and graphics However files in the PNG format are considerably bigger than the according JPEG files To upload pictures click on the button Picture Library in the menu Form Properties in the VividForms Editor Add Question Group s Add Question tu Pole Labels tif Extended Pole Labels Line Space Separator Text Box A Page Break Figure 531 Option Picture Library in the Menu Form Properties A new window called Picture Library opens Scantron Corporation 435 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Library Assistant Picture Library Upload pictures Description Edit pictures Smiley Description Figure 532 Picture Library If you click on Browse you can search for the picture in your file system Clicking on Upload pictures integrates it in the picture library Here you can see a picture that was uploaded and integrated in the picture library On the left hand side you can see the name of the added picture on the right hand side the preview Clicking on Delete picture removes the marked picture from the list 2 10 2 Integrati
288. contain the questionnaires processed for this survey Survey The name of the survey the questionnaire module i e the questionnaire as well as the course type The survey name is also a link which provides access to the surveys of the relevant instructor account Type Enter the content of the delivery e g default report activate template or cover sheet Recipient The recipient is also the owner of a instructor account In addition the name of the subunit is given in which the instructor account is located The instructor name is also a link which provides access to his or her user profile 466 Scantron Corporation Copyright Electric Paper GmbH Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM Address The target email address or the internal email address to which the report will be sent When the internal email address is used only in the self registering procedure then reports that are ready for delivery must be accessed through the internal email print ing account Method Symbolizes the method of transmission This is either email letter symbol or internal email paper symbol Sent Tells whether the report has been sent or printed green checkmark A blue I means that the report has neither been sent nor downloaded Delivery on Date of the email delivery or internal email printing download With the red X symbol you can delete individual entries The s
289. creating the organization structure some basic settings should be defined in the system Apart from adapting the organizational data also the evaluation periods course types and forms of addresses if required should be defined 2 1 1 Define Organizational Data The profile data of the organization used by Class Climate for the evaluation can be adapted in the menu System Settings Organization Please enter all required informa tion and click OK to save the settings Class Climate Subunits Questionnaires LL CORREA Oa Ee SILICON Informati 551 r System Information Search S311 Wik pe F D Organization profile m oe eee Class Climate Admin Adm nez ee Mame Example University Logo File system png Insttuments Phone Text Templates a Fax Eii Documents Report Settings Street Address Washington Street 5 Onine Templates ZIP City 12345 Democity Email Configuration w Class Cimate Settings S Define Tree Structure g Course Types 7 Periods QE Custom Titles ic Process Defaults OK Cancel EJ Web Service Settings Language Sets Profiles amp My Profile Ja Administrators Figure 16 Defining Organizational Data 2 1 2 Course Types Periods Custom Titles These menu items enable the creation of settings for course types survey periods and forms of address They are located in the left context menu Co
290. cs x Do you already have a university degree or a degree of another institute in tertiary education 1 yes C 2 Questions about the instructor The instructor is always well prepared Iiii F Figure 332 Report Creator Evaluate Subgroup Selection of a Criterion In order to create a subgroup report here you choose a criterion that is a question for example the indicated main subject and a value for the criterion meaning the corre sponding response option to the question here for example 2 Chemistry Then you assign a relevant name decide for or against the inclusion of the open questions in the Subgroup report and click on the button Create The subgroup report now appears in the list of reports HTML Subgroup Male from Report of Train_en Data available train_en 05 18 2011 111 choose pdt repot CSV SPSS Figure 333 Report Creator Subgroup Report in the Report List Please note Subgroup reports are identified by a logo different from that of the other reports the remaining options are however identical So you could again create for example subgroups from this report for example female male and or merge this report with further evaluations Combining multiple criteria In order to summarize the results of different criteria such as Gender Registered Major Subject and Target Degree in a subgroup report you can use criteria combina tions These offer you the possibi
291. ction Opens or closes a survey If closed no data can vig acne sets Fee ee yy a ing the PSWDs of a survey Receive PSWDs by ends an email with the PDF document contain Online email ing the PSWDs to the owner of the survey cme I end PSWDs to ma Online respondents by email Batch emailing of the PSWDs to the respondents Al Download PSWDs in Allows the download of a text Tile containing a Online All CSV file remaining PSWDs for a survey enerate more Allows the generation of additional PSWDs for an Online All PSWDs existing online survey Number of partici Fiere the number of participants can be adaptec pants to calculate the when required by default from the course All All response rate assumed Preview online survey bey S a window with a preview of the online sur ows the scheduled tasks linked to the survey Scheduled Tasks such as PSWD submission reminder submission Online All or reporting ow cover sheet torm Opens the personalized cover sheet or the ques Paner All in browser tionnaire of the survey as PDF file in the browser p ends the personalized cover sheet and or form pal Peover ENEE LONN to the owner of the survey by email l ows the open ended question answers In a list ea malt answers to open allowing the administrator to select and delete if All me q necessary Assign survey to a Allows a survey to be assigned to a another user All Data exis substitute instructor for example to include a substitute instructor tent rere e
292. current professional discussion Strongly dis Strongly agree av 22 8 agree av 4 5 The course perfectly prepares me for my professional life Strongly dis Strongly agree et agree aves Figure 369 Report Creator Profile Line Emails Options Minimum Maximum Values Overall Average In addition to the profile lines of the courses reports you selected you can have their over all average displayed as a thick black line For this activate the option Overall Aver age in the comparison options Here you see an example Subunit Professional Development T Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies Name of the survey Comparative line Carlos Hernandez Name of the course Organization and Management a Name of the survey Overall average of Management Strategies Organization and Management he course focuses on the current professional discussion Strongly dis Strongly agree av 2 8 he lead time of the course is adequate Strongly dis Strongly agree av 3 5 agree el ay e36 agree v 4 6 course perfectly prepares me for my professional life Strongly dis Strongly agree ay agree ae Figure 370 Report Creator Profile Line Emails Options Overall average 320 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Comparative Lines This option is activated as default Because it ensures that all comparative lines
293. d Please also consider the setting Show notice for suppressed report Scantron Corporation 241 Copyright Electric Paper GmbH S Your Evaluation Process The Phase Model Class Climate 242 Minimum response frequency for display absolute Defines the minimum absolute response frequency to a question required in order to display the question in the PDF report Please also consider the setting Show notice for suppressed report Procedure to calculate the mean value The procedures to compute the mean value for the PDF report are defined here 1 standard procedure 2 trimmed mean Decimal point precision average standard deviation Number of digits after the decimal point for averages and standard deviation Sender part 1 2 and 3 First second and third line of the senders address field on the PDF report file cover letter Sender above recipient address Sender name on cover letter in PDF report Background color report heading Color setting in order to adjust logo background color Color progression in the report header If this function is activated then the background color in the header of the report starts at the set background color and lightens gradually towards the top of the page If this function is deactivated then the background color remains consistent Alignment of subunit logo Defines whether the subunit logo will be at the left or right in the PDF report Hide overall indicator If this option
294. d column lf someone participates in several courses then the email address also has to appear multiple times in the CSV file Example for 2 courses MAO5Wiw2 person01 example com MAO5Wiw2 person02 example com MAO5Wiw2 person03 example com MAO05Con person01 example com MAO5Con person03 example com MAO5Con person04 example com MAO5Con person0D5 example com IE CSV files are independent of the operating system and can be generated in Windows for example with Microsoft Excel The used separator can be adjusted under Configuration Data import and export Separators CSV import and export For the allocation of the course participants email addresses to the respective course it is essential that the course id is unique system wide If several courses were to be found in Class Climate with the same id then the addresses from the CSV file would not be related to any course However with the activation of the option Include multiple course ID this allocation can be forced In this case every course found will have the same email addresses attached to it To perform a CSV import of participant data open the menu Subunit Data Import 82 Scantron Corporation Copyright Electric Paper GmbH Class Climate Admin Central Evaluation Class Climate COURSE EVALUATION FEEDBACK SYSTEM j 7 7 i i lass ima Subunits Questionnaires System Settings System Information Sp s Ai F Cla ss Cli mate
295. d affects the calculation of the lower threshold value negative threshold value The following formula is used for this Lower threshold value norm base mean value avg granularity of the negative threshold norm base standard deviation Hence for the example pictured below the calculation is as follows 1 lower threshold value 5 24 1 1 14 4 1 2 lower threshold value 5 29 1 0 96 4 33 Base norm Generalnorm Cancel Convert this norm Legend Positive threshold 0 avg average dev standard deviation gt high TY CS aa oF imo Jal then necessary TETE and Salen components Calculate threshold values Lower threshold 1 iT Upper thres A got access to the technical resources computer centre etc very quickly avg Li Calculate threshold values Figure 421 Quality Guideslines Example Calculation when Higher Values are Better o S Scantron Corporation 361 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM y eo a Example calculation when Lower Values are Better For a questionnaire where lower values are better the granularity set for the negative threshold negative threshold value affects the calculation of the upper threshold value negative threshold value The following formula is used for this Upper threshold value norm base mean value avg granularity of the negative threshold norm ba
296. d in a corresponding cover sheet sur vey To open the questionnaire click the option Show The preview of the questionnaire in an online survey can be opened with the option Pre view online survey Below the information about the PDF files and the recognition set you can see a drop down list with several options moreover three buttons and the Delete button Questionnaire 2 Delete ama Report for comparison JSaG Data export configuration Figure 67 Advanced Settings in the Questionnaire Details The options in the section Advanced Settings have the following meaning for all options you will first have to select the option from the drop down list and then click the button Edit 90 Scantron Corporation Copyright Electric Paper GmbH X Class Climate e Text Templates You can define custom email texts or texts for PDF reports in order to incorporate ele ments specific to a given questionnaire in reports or emails You can also define email attachments for the questionnaire e Norming This is where the norm data are defined for the questionnaire In addition sub norms can be selected for for example subunit or course type level as well as displaying message boxes for interpretation e PDF Reports Here you can define the default PDF report with which the questionnaire will be evalu ated Furthermore sub variations of the standard report can be created by suppress ing
297. data ok Cancer Figure 349 Report Creator Delete Report e Report Here you can download the HTML and the PDF report Either you only see the lettering PDF for the download of the PDF report or as in the screenshot a drop down list The latter is the case if several PDF report definitions exist Scantron Corporation 307 Copyright Electric Paper GmbH T a COURSE EVALUATION FEEDBACK SYSTEM available train_en Prof Development WS10 11 Figure 350 Report Creator Download Reports The PDF report looks just as you are familiar with it from the automatically gener ated reports for single surveys except for the letter and the PDF report header Report Prol Development WS10 11 Prof Development WS10 11 No of responses 312 th Overall indicators at 3 E i E E E Global Index COLEA deveiT 2 Questions about the instructor a 0 04 beds 3 Questions about the course a 0 09 SSS ae mmis zi 2 Kond amp n 4 Questions about the teaching material a 0 03 e e mads 5 Questions about the studying conditions a weas Survey Results Legend Reiatve Frequerces of answers Question text int poja ghips netic of retponeet omeia Dev Bese 4 Questions about you What is your gender male 46 8 one female 53 2 What is your age Single Choice 120 13 6 fim 15 3030 18 8 40 40 16 7 55g 16 emai 13N Cider than do 16 7
298. ddresses the storing of the IP address must be switched off Otherwise the login screen with the error message will appear continuously whilst working with Class Climate because Class Climate cannot determine whether the session is still with the same user but the IP address has changed or an unauthorized user is attempting to continue working in the session 2 5 13 Section System Security Use CAPTCHAS This function protects Class Climate against automated attacks CAPTCHAs are pictures where characters numbers or letters are displayed in a way only recognizable by humans They are used to distinguish between humans and machines If CAPTCHAs are activated the user will be prompted to type in a CAPTCHA after several failed logins Number of failed logins before a CAPTCHA will be shown Number of failed logins a user can have before a CAPTCHA will be shown to be typed in Scantron Corporation 525 Copyright Electric Paper GmbH a System Settings and Management Class Climate Observed period of time and blocking time If a user has several failed logins during the period of time defined here he she will be prompted to type in a CAPTCHA At the same time the login screen will be blocked for the network address of the potential attacker for the period in minutes defined here The blocking can be unlocked ahead of time by typing in the CAPTCHA correctly Restricted access Activates deactivates the restriction of access When
299. de on the personalized questionnaires or on the cover sheet respectively This distinct mark is read during processing Only the cor rect identification of a survey by means of this number enables the correct assignment of generated data to a particular survey in Class Climate 3 System Start up and Security The initial operation of your Class Climate server was carried out during installation and test runs by our technicians This includes the installation and configuration of the required software programs including the connection and testing of collection devices production level scanners Finally the system is integrated into the local network so that the users have access to the system with their Web browser Such access by users can if required be severely limited The final step is configuring the mail server which sends reports and messages from Class Climate For maintenance purposes we recommend having so called remote maintenance access which allows our technicians to have direct access to your local Class Climate system so that they can quickly and systematically analyze and remedy any problem that might arise The alternative would be a lengthy diagnosis via telephone 3 1 Adjustment to your Organization Class Climate has login screens shows colors when working with the software sends emails documents etc Many of those visible elements contribute to the appearance of your or institution or organization and thus can be ad
300. de of your last school graduation A How many terms have you been studying so far How many terms have you been studying so far 112131415161718 193110 11 More than 11 1121314156171813 110 11 More than 11 Figure 295 Report Creator Automatic Questionnaire Comparison Overview On the bottom of the page you can change the basis questionnaire Furthermore you can specify by how many characters the questions and or the modality text texts describing the checkboxes can vary Change base form train _en train_en_1 Search limit Maximum amount of different characters in the question text 10 Maximum amount of different characters in the modality text 5 _ Apply Changes Figure 296 Report Creator Define Base Questionnaire Number of Different Characters Please note Additional questions are of course not included in the total report because they cannot be compared to questions from the comparative question naire 278 Scantron Corporation Copyright Electric Paper GmbH thy AN Class CI mate Phase 4 Advanced Reporting COURSE 3S GH mat SYSTEM e You should opt for manual assignment when the questionnaires differ greatly so that a string comparison cannot turn out any similarities as in the second example Ifyou choose this option the questions on the manual assignment are presented to you in the following screen The drop down menu of each ques
301. deactivated the Instructor s Optional Questions for the rele vant survey Content Personalized text with the name of the instructor as well as the course name Form PSWDs to Instructor Instructor s Optional Questions Trigger The Instructors Optional Questions for a survey has been completed by the instructor Now he she or the group address receives an email with the required cover sheet and the questionnaire The function Class Climate Settings Survey Instructor s Optional Questions activation status must be activated Content Personalized text and attached PDF documents Information Concerning Activating the Instructor s Optional Questions Trigger The administrator has activated the Instructor s Optional Questions for a survey Content Personalized text as well as a link to the Instructor s Optional Questions In most email programs clicking the link will lead directly to the Instructor s Optional Questions Reminder for the Instructor s Optional Questions Trigger The administrator has initiated a reminder for an activated Instructor s Optional Ques tions 488 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Content Personalized text as well as a link to the Instructor s Optional Questions In most email programs clicking the link will lead directly to the Instructor s Optional Questions Regulatory Informati
302. desired instructor Scantron Corporation 65 Copyright Electric Paper GmbH y eo j COURSE EVALUATION FEEDBACK SYSTEM OA Users in subunit Department Training eI Name co eys Created Actions Donna Harwood 3 33 5 08 17 2007 A O amp C amp Carlos Hernandez 3 L 172 08 17 2007 A O amp C amp DrRichelle White 1 2 3070 08 17 2007 A O amp Select all Move selected to Computer Sciences Figure 41 User List within a Subunit The course list of an instructor opens Via the button Create new course you can add new courses at any time The entry mask shown in the picture above opens and the data for the course can be entered L Courses of Carlos Hernandez Organization and ee 47 Management 02 P1236 continuous Seminar RP 410 10 german Human Resource a Ie 3 WF i 48 Management 02 P1237 continuous Seminar R P412 20 english Leadership oe a 66 Havsicanent tees continuous Lecture R P 080 150 english Y Figure 42 Course List An existing course can be edited with a click on P Courses can be deleted by clicking on os By clicking on the respective column header the course list can be sorted ascending and descending Definition of Secondary Instructors lf a course is held by more than one person but only one evaluation questionnaire is to be used then secondary instructors are specified who will also receive a copy of the PDF 66 Scantron Corporation Copyright
303. dmin Adrrinis trator Preset color scheme All colors will be replaced by a preset color scheme insirumernis Text Tempiates E Documents Wa Report Settings r Background color contents Onine Templates EAEEFS 2 This setting determines the background color of the content area Conhiguration Make this option avaiable fo Subunit Ad Background color external DEESEA 2 This setting determines the background color of the external area Figure 7 Color Setting of the Class Climate Interface For further information please contact our support team 2 3 Central Evaluation and Active Instructor Accounts Within Class Climate you have two options for governing responsibilities for surveys The option usually used for regular evaluation processes is the so called central evalua tion option Hereby a central evaluation office takes care of the evaluation s coordina tion In addition to this central evaluation you may authorize individual instructors to create and conduct their own questionnaires and surveys This is what is called active instructor accounts 2 3 1 Central Evaluation A Central Office controls the Evaluation The central evaluation is tailored to a service and competence center by which the entire course evaluation is handled The instructors will only have indirect contact with Class Climate insofar as that after completion of a survey an email will be sent to them outlining
304. dministration is activated and confirmed Use this function therefore with extreme Care e Form Management Actions Abbreviation Title Pages Date ition ail TEN ee ea 9 Settings Copy Delete Edit Preview Export Evaluation N Quest 4 Questionnaire 2011 05 16 SS bb o Z E 13 51 51 Template sample Questionnaire 2011 05 24 a 3 Sample Template 16 31 39 sA PES prey eE Figure 565 Form Management of an Active Instructor The user of an activated user account must be extremely careful when deleting a ques tionnaire he has created himself because there may be surveys which depend upon the questionnaire to be processed The delete function can only be activated by opening the lock symbol amp When a questionnaire is deleted ALL surveys based on that question naire will be automatically deleted as well 7 3 Import Export of VividForms Questionnaires VividForms forms can be exported as files These files have the ending vfd As a subunit Administrator the export function is available in the details of a question naire Settings Questionnaire Details by clicking on the Export button Scantron Corporation 457 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Ei Details for questionnaire Sample_01_ Sample_01 Sample Questionnaire WP VividEorms Editor C Copy and open the questionnaire in the VividForms
305. dnbiexaledeinnant 484 INDE ra E E E 531 Scantron Corporation 3 Copyright Electric Paper GmbH af z Class Climate COURSE EVALUATION FEEDBACK SYSTEM Scantron Corporation Copyright Electric Paper GmbH l m Class Climate COURSE EVALUATION FEEDBACK SYSTEM Table of Contents A PREPARATION AND GENERAL NOTES sessisiieestecssssiiccnsctiedessnnastentetstsuseesssevestevetenesenndetaaratnwestnece 11 Me RODU CTI ON st ie acts ptt teat erecting A E cond ideale ASE A E 11 1 1 MANUALS AND DOCUMENTATION ccscceecceceeeeteeeeeceeeceeeeeeeseeceeesnecaneceeeteeeeeeceeeseeeeneeaeetseeanenes 12 es Dies oe ER OUDE rrea ne ee cee ee ee eee een eee ee eee eae 12 Ve dee FURTHER MANUALS sueuscecscitetnaynnedinasnedavkaidsducsscuhsngsncunswcneadsastestbeisebanesemadontevanightesteisess 13 Teg Mise Ole WES senai E E E 13 1 2 SUPPORT AND REMOTE MAINTENANCE cc0ccceceeeeceecenceeeeteeeecesecteeeesecseeseeeteeeseeteeeeeeseeeaeees 14 1 2 1 CLASS CLIMATE WEBSITE AND SUPPORT AREA ccsscceeccesceeeceeeeeeeceseeeeeeeseeeeeeeeeeeeeneees 14 1 2 2 EMAIL TO THE SUPPORT DEPARTMENT sccescceeececceeeceeeteceeneceeetneeseeteeeteeeeeeeeeeeeeseeteeees 14 Ze VTA TOP SHS a A ann ervateenamrtatiiteaanntantonieies race aowenna E R 16 2 1 STRUCTURE OF THE CLASS CLIMATE SYSTEM ccccceccceceseeceeeeeeceeceeeeeeesseteeteeeeeeseeseeeeeeeeees 16 2 2 WEB ACCESSIBILITY IN CLASS CLIMATE c ccccecccsecescceecceeseeeeeeeueceesesee
306. dual comments in the report If this option is activated repeated entries to open comments which have been marked as such during data Scantron Corporation 245 Copyright Electric Paper GmbH mate i Your Evaluation Process The Phase Model AN Cla iep ss Cli mat entry are displayed in a summarized form e g The course was well organized 2 Counts e Dual scale profile line When activated critical values of dual scale questions are highlighted by means of a color gradient 0 deactivated 1 critical values on the left side of the scale 2 critical values on the right side of the scale e Profile line Display question groups If this function is activated the question groups are displayed in the profile line e Page Break before Responses to each Open Question If activated and at the same time open questions appear at the end of the report option separate closed open questions a page break is inserted into the report before the answers to each open question In this way clarity is enhanced particularly when there are many answers to open questions 4 5 2 PDF Report Definitions The evaluation reports in Class Climate can be influenced in two places The configuration of each PDF report can be edited under System Settings Report Set tings Please click on the configuration icon in the column Configuration The PDF report configuration of the corresponding questionnaire opens automatically
307. e Managing and maintaining a healthy lifestyle Name of the survey Comparative line Course 1 The lead time of the course is adequate Strongly dis Strongly agree av 3 2 agree Ta av eg 6 The course focuses on the current professional discussion Strongly dis Strongly agree av 3 agree av 4 6 The course perfectly prepares me for my professional life Strongly dis Strongly agree avaa agree ay 3 Please grade the course altogether failure very good av 3 4 Figure 373 Report Creator Profile Line Emails Options Anonymize comparative lines Of course these options can also be combined You could for example have a profile line comparison displayed to you in which you mark the minimum and maximum values with gray add the total average to the graphic and anonymize the comparative lines Hint on Falling Short Short Number of Minimum Responses If you wish to display the profile lines only for the surveys that achieved a certain level of participation you can freely define this through Check if the number of completed forms exceeds the minimum level defined in parameters If this option is activated the limita tion applies which the administrator has set in the menu System Settings Class Climate Settings Survey Minimum number of returns for reporting If the number of returns to a survey lies below this value instead of a profile line a corresponding message is dis played Scantron Corporation 3
308. e Telephone Number Address Institute Number Email Login name Password Password repeat QM Views Additional Subunits Form Editor Phase 1 Preparation of a Survey Period Content Mr or Mrs Max 50 characters optional field In the report document the combination Title2 Surname will appear Max 50 characters optional field Max 50 characters non optional field Max 100 characters optional field User defined three lines recommended optional field This field is used as the internal email address in the Central Evaluation server version Self registering version and has no function when the standard user profile decentral or the Stan dard version is used Max 6 numerical characters This field is used for the subunit classification in the Central Evaluation server version self registering procedure and has no function for the standard user profiles decentral or the Standard procedure Max 100 characters optional field Class Climate sends all messages to the user at this email address e g PDF reports for processed questionnaires Max 50 characters non optional field This field must be unique across the system i e it may be only used once Max 50 characters non optional field Max 50 characters non optional field No QM views Only own surveys Only own subunit Full authorization Additional subunits can be added to QM views QM views has to be set to Only o
309. e you have to save the settings of the operation In general it is possible to assign the date time and status for all selected surveys using the Apply to All button e Operation Close Survey This operation serves to close the online survey When the survey is closed then no more returns are possible Unused PSWDs are then invalid and cannot be used anymore Survey participants are not informed of this operation The evaluation report can be sent directly to the survey owner When this is the case then the owner of the survey i e the user allocated to the survey in the system receives an email of the results of the online survey automatically This operation is terminated by a start date and saved with Save In general it is possible to assign the report delivery date time activation status and setting for all selected surveys using the Apply to All button e Use of Calendar The calendar is used for selecting the date and time for a planned operation Scantron Corporation 141 Copyright Electric Paper GmbH j i E June 2011 x Ewell e Today Del BL wk Mon Tue Wed Thu Fri Sat Sun 22 i 2 3 A 23E T g SB 10 i 2 24 S eS 16 1 id as 25 20 21 22 23 24 25 26 26 27 28 29 30 Time 23 00 Select date Figure 125 Calendar All changes in the calendar are adopted by the enter templates behind the calendar The calendar does not need a save button as it can be closed by x
310. e Survey Template Online template description Logo 0O Upload pictures Logo to be shown in the survey header Delete picture M Logo justification left aligned Determines the Justification of the logo in the page header Figure 139 Customized Online Survey Template Create template In the upper half of the window a preview of the online survey template is displayed In the lower half the layout of the template can be edited All changes made to the layout are immediately shown in the preview Numerous functions for customizing the templates are available in four different tabs e General Settings The name of the template is defined here your own logo can be uploaded and aligned the organization s logo and the survey header can be shown or hidden etc e Colors The color settings for the different areas and elements of the template are set here The background as well as the font colors of all areas displayed can be customized 154 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Example Institute Dr Sima Seeland a business economics business economics introduction u 2 Questions about the instructor The instructor is always well prepared The instructors explains even complex topics in a comprehensible way Sir oe le ede cre oe oe e ome ee ee he o Be am e ee le ee oh General Settings Colors Navigation Question Types
311. e VividForms Editor see chapter C of this manual Remember to give the forms short relevant names so that they can later be separated Figure 437 Create Module Questionnaires Now the single questionnaires have to be linked to course types In the context of module surveys the course type has the function to define which of your questionnaires Class Climate will use for the evaluation of a course If for example a questionnaire is linked to the course type lecture this questionnaire will be used for the evaluation of all courses of the type lecture on the combined module questionnaire Scantron Corporation 371 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Thus in the context of module surveys the category course type does not have to equal the classic course type in common evaluation In some cases it can be advisable to cre ate own course types for the evaluation of your modules If for example you want to use a general questionnaire for the evaluation of the module in total and a trainer question naire to evaluate the single courses of your module you can create corresponding course types such as module general and module trainer To link questionnaires to course types open the dialog System Settings Course Types Subunits Questionnaires System Information orn Pits SS11 TNS
312. e ane a i a 369 7 1 SETTING UP A SURVEY WITH MODULE EVALUATION 0c ccccceceeeceeceeeseeuseeceeueeueeeeeeeeeeaeeeeeenanens 370 7 2 ACTIVATING MODULE SURVEYS c ccccccccceccuecceueeceueeeeueeeceueueeueauceuaeeeuueaseuaueauueuseuueeueeeaueueueaeeees 370 7 3 CREATING MODULE QUESTIONNAIRES AND LINKING THEM TO COURSE TYPES c secsseeeeeees 371 7 4 CHARACTERISTICS OF THE AGGREGATED QUESTIONNAIRE cccccecccececececeseaneeueeeeeeeeaeeeaeeeaees 373 7 5 CREATING A MODULE ACCOUNT cccccccccecceeseeceeeeeeceueceuueeeeeucscuueeeeuaueeuueaseuaesaueeueueaeeueeeneenas 374 7 6 CREATING MODULE COURSES ou c cceccccccccccecceeseeceeeeeeeeeeceueeeueeeuceuaueeueeaeeuaueueueneueaueueeeueusaneneneas 376 7 7 GENERATING A MODULE SURVEYS ccccceccsececceeeeeeuecsueusceeeeuuceueceueceeeueeuuceueeeeaueeaeeeueeeaeeeaeuss 378 Scantron Corporation Copyright Electric Paper GmbH 7 0 INSTANT FEEDBACK cssicasissicsaittansatesntarnsndsvidas iapssaicsatasoitanstounssdiedaeereatecararaaSenaters 9 FURTHER SING ere sete eE AE C CREATING QUESTIONNAIRES WITH VIVIDFORMS nnnsssssssnnnnnnnnnnnnnnnnnnnnnnnnnne 1 ACCESS TO THE VIVIDFORMS EDITOR scccececsseeeeeeceeeteeeeaeeeanecsecsneeteeeeaneesaes 2 CREATING A QUESTIONNAIRE IN THE VIVIDFORMS EDITOR ccecceeeeeeeeeeeeeeees 2 1 DEFINE FORM INFORMATION cccccecceescecseeseuceeececueeuueeeseeueeuesueeeuuueuueaeeeesnes 2 2 THE EDITOR CONTROL a daceccscsndhsexeaesccnc
313. e automatic and the manual questionnaire comparison Please activate one of the two options here if you use surveys with several questionnaires With these options you have diverse possibilities to use the batch profile lines for compar ison purposes In conjunction with the summary reports this is a powerful tool for pro cessing your data at hand 5 2 4 Result Reports With the report creator you can download further reports that provide an overview of sur vey results to the management of your institution or your company You can find these reports in the menu Reports on the left hand side Scantron Corporation 325 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM System Logins eh ssa W ji Lf Aii Cee CLEATOR PIDAL PILNE Report Creation C E z a 3 Business Studies a P z Basic setting Chemistry Continue for result Computer Science reports Economics Geoscience Gl Surveys Mathemi Surveys Busines Laine ISu TATI Additional Re D teports Figure 377 Additional Reports Using this function you can create summary reports for the president the deans of stud ies as well as the deans which give them an overview of the results of the course evalu ations These functionalities are for questionnaires that were set up for the creation of summary reports There are three report forms for summary reports e Re
314. e forms than can fit in the feeder then after scanning the first partial batch the next batch is inserted and the scanning operation is continued Insert the paper as shown in the illustration Figure 208 Correct Insertion of Questionnaires The survey ID the double seven digit number on the cover sheet or on the first page of the questionnaire must be on the first page of the batch In the cover sheet procedure the cover sheet must be scanned first If the questionnaires have more than one page the questionnaire sets should be if pos sible scanned in a sorted sequence If multiple page questionnaires are mixed up then processing is still possible and the final results will be accurate but an analysis of subgroups cannot deliver accurate results unless a serial number has been added during batch print Now start the scanning operation As a rule documents are scanned on both sides of the page duplex which is counted as one page each If you scan 12 pages of paper printed on one side then the message box in duplex operation will show 24 pages scanned Afterwards empty pages will be automatically eliminated so that there will be no interfer ence with the data capture Now select Continue scanning if you want to capture a further batch from the SAME survey Scantron Corporation 207 Copyright Electric Paper GmbH Class Climate Your Evaluation Process The Phase Model Class Cl mate Select Finish batch wh
315. e g for representation purposes As does the administrator the secondary administrator has administration rights for the entire system and can access all subunits For the creation and management of secondary administrators go to the menu Adminis trators in the main menu System Settings Profiles A click on the menu item opens the administrator management A summary table displays all existing secondary administra tors The first column shows the name and in parentheses the additional roles of the secondary administrator The second column shows the number of reports generated by the report creator role The administrator can customize the user settings in the column Edit By use of the red cross in the column Delete a user can be removed completely 56 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Subunits Questionnaires System Settings System Information 511 r R Additional Secondary Administrators Pa alre pe _ E TAN li Taafit e tre hoe a hame EQ Delete 4 a John Doe Report Creator Venfier Data Entry Assistant Figure 32 Management of Secondary Administrators To create a secondary administrator click on the button Create new secondary adminis trator A three step wizard opens facilitating the creation of a user In the first step the user type Secondary Administrator is already selected Click on Next
316. e labelS 2 lt 4462 lt reedi eredi 4554664044058 68 427 Horizontal pole labels 0000 427 MOCO oe deo a A Cri ER a Boe ee eee 429 Vertical pole labels 0 0 2 0 0 0c 428 Preparation of a survey period 39 Preview function 0 0 e eee ee 396 Preview of online surveys 0000 ee eae 136 Process defaults 0 0 c eee eee 502 Profile comparison 0 000 eee ee eee 329 Prole INES 2 o4 204 ce e5 es dbo ks RP ERE wee RS 268 Dispatch of comparative profile lines 313 Protect mode cee eee eee 455 PSWD FOMMGU voto k tenere eas Bae honed 511 PSWD procedure ananuna 0 000 eee 109 534 Q QM views Authorizing access rights to QM views Use of QM views Quality guidelines Average based Convert from indicators Convert from norms Define Frequency based Setting quality guidelines Quality management Question Adding a question from the library Adding a question to the library Deleting a question from the library Grade Value question Multiple Choice question Open question Question Library Question Library with VividForms Question types Required questions Scaled question Single Choice Extended question Single Choice question Undoing connection between question and library Question group Adding a group to the library Adding and Editing question groups Deleting a group from the library Question library Administration Scantro
317. e letter The words that are written in capitals and marked through angular brackets serve as place holders and will in the case of an actual letter be replaced by the respective values SAL UTATION is replaced by Dear Ms Dear Mr or similar TITLE is replaced by Prof Dr Dr if existent SURNAME e g by Harwood A list of all available placeholders can be found in chapter D 2 1 5 Placeholder for Texts Scantron Corporation 227 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM The Layout of the Letter You design the letter using a PDF template which you can upload in Documents in the main menu System Settings th Class Climate Search S511 h Y Class Climate Admin Administrator v Descnption File name Save iIn inumenis EI Text Templates za aa Report Settings nine tempiates 5 PDF templates Configuration P Poon ee elf J bee Description File name Gf Clase Climate Settings i Evaluation latter Sample 1 new Custom Cover Letter Sample pdf Se Define Tree Structure Evaluation letter Sample 2 Custom Cover Letter Sample pdf WW Course Types w P rids TE 08 custom Tews Description File name LE Web Service Settings ah Language Sets Figure 234 PDF Letter Uploading Letter Template for Designing the Layout You choose the template via the button Browse In the field Description you
318. e minimum response for unweighted merged reports lf activated those questions which reached an insufficient number of responses are ignored When deactivated every question will be included into the unweighted merged report Force settings of the administrator If activated after the processing of paper surveys the settings of the administrator are used instead of the responsible subunit administrator Automatic verification The automatic verification allows certain cases of a batch to be verified automatically Scan resolution Resolution in DPI This setting scales the images of answers of open questions in the PDF report Default value is 200 DPI 516 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM HTML report Relative values The HTML reports show the distribution of the responses to closed questions with relative activated or absolute deactivated values HTML report Minimum percentage for display Defines the minimum percentage of response frequency to a question in relation to the total number of returns needed in order to display the respective question in the HTML report If the value is set to 0 all questions of the reports will be displayed HTML report Minimum percentage for display absolute Defines the minimum absolute response frequency to a question required in order to dis play the question in the HTML repo
319. e only for users of activated accounts after anal ysis of the survey The certificate can be retrieved in the details of the survey after evaluation The footer can be changed at Class Climate Settings Instructor Accounts decen tral There you will find the option Footnote certificate of participation e Certificate of Results In contrast to the certificate of participation this document gives the score for each of the dimensions given in the survey Its description is identical to the Certificate of Par ticipation 3 1 4 Adjustments in the Text Templates At any case you should check the text templates that serve as templates for letters emails and welcome texts at different occasions Some of them should urgently be adjusted some of them may be For this purpose please read the chapter about the text templates 3 1 5 Adjustments in the Documents You can add documents to the emails sent by the system Please consult the chapter D 2 2 Documents For example you can send the evaluation regulation of your institution together with the PDF report In addition to this the adjustment of the documents affects the letter that can be added to the evaluation report The text of the letter is defined in the text templates but the layout is defined by means of a PDF template with variable fields The layout of the template can be adjusted freely and can thus e g correspond to your corporate design Neverthe less it is
320. e same time Current Users Logged in 2 Online Surveys 2 Figure 591 List of Active Users Scantron Corporation 477 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM By clicking on Users logged in or Online surveys you will automatically reach the menu System Information in the area System status There you will find a detailed listing of all users currently logged into the system OS Current Users User User type Last action Peter Brown Administrator 05 25 2011 at 09 45 02 Carlos Hemandez Instructor 05 25 2011 at 09 43 03 Number of participants in online surveys of the last 5 minutes 2 Figure 592 Detailed Information of all Active Users You can sort the active users according to name user type and last action by clicking on the relevant column head 1 9 3 Display of Online Surveys To optimize system performance it is recommended that the display of online surveys especially for questionnaires with several chapters question groups is set to Com plete In this way for a questionnaire of 35 chapters with regard to page views in online surveys the system load can be reduced in the range of 97 This option is set as default for all questionnaires To change the display of online sur veys in the menu Questionnaires Questionnaire List select Details in the drop down menu As these settings a
321. e sent as an Excel readable CSV file see System Settings Class Climate Settings Email Functions amp Accounts PSWD to Online Survey Respondents This text is an exception It is an email to participants in an online survey sending the PSWDs and the server address for voting The placeholders PSWD and SERVER must NOT be removed The other placeholders cannot be used for this email Reminder to Online Survey Participants The PSWDs and server addresses for response returns are entered here similar to the initial delivery of PSWDs Data Entry for Instructor Trigger A survey has been validated i e the manual data entry of the handwritten comments has been completed decentral CE The administrator sends the instructor the reports from the survey CE Scantron Corporation 487 Copyright Electric Paper GmbH a System Settings and Management Class Climate Content Personalized text accompanying the processed survey The PDF report is normally sent with this text In addition or as an alternative the raw data can be sent as a Excel read able CSV file see Class Climate Settings Email Functions The message of a paper survey after the handwritten comments to open questions have been manually entered by a data entry assistant This is the case for those subunits working with manual data entry Information Concerning Deactivating the Instructor s Optional Questions Trigger The administrator has again
322. e system decides whether a checkmark is valid or not or whether a completely filled in box is to be considered a correction or not Open question fields are also searched for a significant marking and then saved as an image file These image files are later integrated into the PDF reports 208 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Evaluation Sheet E EA N 0s Show gg ogogo Pease use 2 bed polet per or atin fet tin The form wil be processed auerratcaly OSOH 0 Musse fsk te ersrpiss shows on the lef kand side io holp optimize the rearing results 1 About the Course Subunit 1 1 Ilearmed a fot in this wa Z i 12 pared this course than in others a go Program of Study 13 This course was extremely valuable to my 0 8 O education would recommend 6 os Agres s Instructor Alice Eddison friends 1 5 This course t p d impact Agee E O o o LDL Diag i H J Course Introduction into chemistry 1 6 Students who go to the instructor for help get gee G OF OF 0 O Oitagree the assistance Mey need he instructor has a comprehensive Agres Disagree co iD understanding of the subject 1 8 This instructor inows this subject very well oO OF O 0O Oisagree 1 9 What was the best aspect of Mie course Questionnaires 0 Form Sample2 Date 5010 02 11 09 28 24 1 1 10 What was the worse aspect of this course Number of returns Cover Sheet
323. e time or only to those surveys currently selected 9 Change Summary of scheduled tasks The scheduled tasks belong to a survey which was generated at the same time as other surveys Do you want to edit these scheduled tasks with effect on all of these surveys Click on No to change the scheduled tasks for this survey only o ys J no Figure 127 Scheduled Tasks Saving Changes for all Surveys Created at the same Time Actions for all surveys with a definite status can be directly performed by selecting from the footer In this way for example all surveys with the status deactivated can be edited In the drop down list Action you can choose between the actions Edit Run and Deactivate The tasks on which this action should be performed and with which status are set in the second drop down list box Different statuses are visible here depending on the selection in the box Action To which task the selection applies can be defined in the last drop down list Task In this way for example all deactivated tasks in the section Finish survey can be edited immediately Or all open task can be immediately performed or deactivated Online surveys Sending PSWDs In online surveys the Class Climate administrator either sends the PSWDs by batch email to the survey participants or sends emails with PDF files containing the PSWDs to the instructors so that they ca
324. eator Profile Line Emails Options Remove certain questions from profile line s Adding Trend Graphic lf you have defined indicators for the relevant questionnaire you can display a trend graphic in addition to the profile line For this purpose mark the option Add trend graphic for indicators to the profile line as far as corresponding data is available over several sur vey periods 324 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 4 Advanced Reporting The trend graphic shows you a course of time of the averages for indicators determined over several survey periods Trend graph of the indicators s ea go WS00 10 5510 WS10 11 5511 Figure 376 Report Creator Profile Line Emails Trend Graph Prerequisite for this is the availability of indicators on the selected questionnaire as well as captured data from several survey periods The trend graphics each show groups of up to five indicators with a maximum of five survey periods in one graphic If data is avail able from more than five survey periods the graphics are divided up correspondingly Assignment of the Questions in the Case of different Questionnaires As you are familiar from the report creation with profile line comparison you have the option to compare surveys that are based on different but comparable questionnaires To do so there both options are available th
325. eator Subunit Report as Overview This view provides you with following information e Type of the weighting If itis a weighted summarized report the symbol as here at the top of the column shows two sheets with green arrows For unweighted reports a symbol with paper and a warning triangle appears here For an unweighted report choose the respective option whilst creating a report Description rall Report unweighted Question mapping of different questionnaires Automatic with text companson Manual Include answers to open questions v Combine surveys unweighted Please note For this combination the mean values of the single surveys are averaged Verify Bax Figure 347 Report Creator Create Unweighted Report The report that is then created shows a symbol with paper and a warning triangle HTML Ce Data mA 5 CSV Overall Report weighted available train_en 05 19 2011 241 B choose pdt repot SPSS A HTML EN Data ws AG oe Overall Report unweighted available train en 05 19 2011 7 019 BS choose pdf report Figure 348 Report Creator Unweighted Report 306 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Hint If the date is added automatically to the name of the report then within this report creator access a report with exactly the same name already exists This is determined not by the folder level but rather by the report crea
326. ebug Mode 0 cc ees 526 Maintenance Mode 0 000 ee eee 528 Manual entry Handwritten comments 000000 eae 219 Manuals 26st wo dee Se ee a ee ee ee ws 13 Manuals and documentation 5 12 Matrices ct ac in ace ee db as eo ee hee eae 92 447 451 Matrix field 0 0 0 cece ee 408 Memory function 0 00 cee eee eee 396 Module Creation of module account 374 Creation of module courses 0 374 Generation of module surveys 378 Scantron Corporation Copyright Electric Paper GmbH Module evaluation 2 0 0 eee ee 369 PGUIVALG 2 oct Oe oe Re ee Bae eee ed eee eer eee 370 Assign module questionnaires 371 Create courses 0 ee es 376 Create module 0 cc es 374 Create module questionnaires 371 Creating of questionnaires for the module evaluation 371 Further settings 0 0 cece eee eee 382 Generate survey 0 00 cee eee 378 Instant feedback 0 0 cee eee 380 Linking of questionnaires to course types 371 SOUND acantecees sa Gacug oe aes oe sean ae es ee 370 Module questionnaire Characteristics nanana 0c eee 373 Multiple Choice question n aana nananana nnan 420 Multiple languages 0 0 eee eee eee 98 N Network Settings 0 00 cee eee eee 523 Non anonymous SurveyS 000e0 e
327. ected question group to library the group you have highlighted will be entered as a new group to the library All questions of this question group are copied to the library This does not concern other elements of this group such as advanced pole labels pictures and spaces 4 6 Deleting a Group from the Library With the symbol in the editor control bar you can delete the current group from the library 446 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Filter Settings Validation Required Questions Cross Tabulations COURSE EVALUATION FEEDBACK SYSTEM 5 Filter Settings Validation Required Questions Cross Tabulations 5 1 General Information If you open the menu Form Properties on the left hand in the VividForms Editor you will find the option Filters Validation Cross Tabulations Required Questions These options are also available in the details of a questionnaire in the area Advanced Set tings In Questionnaires Questionnaire List please click on the name of the question naire you like to activate the filter settings validation required questions or cross tabulations for The details of this questionnaire open automatically Open the drop down list in the area Advanced Settings and choose the desired option Thus click on Edit to edit the option Filter Settings This is where you define whether certain answers will cause other questions to be sup press
328. ed In an online survey suppressed questions will not appear or will be inactive For paper surveys filter settings apply after processing i e retrospectively Validation By defining validations you can test entries to open questions and matrix fields in online surveys with value ranges and regular expressions before a survey participant can send the questionnaire Required Questions Those questions of online surveys for which an answer is compulsory can be defined here Cross tabulations The cross tabulations shown here will appear in the PDF report 5 2 Filter Settings Filter settings allow you to suppress questions which may in certain circumstances be irrelevant This is especially interesting for online surveys where this prevents invalid questions from being responded to Scantron Corporation 447 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Filter settings Item triggering filter Value Options Add question have already been in the refectory Add Figure 549 Filter Settings However the filter settings defined here are also used for data from paper surveys When analyzing each completed questionnaire a check is carried out whether the filter settings should be applied A question asks about the use of presentation programs in a course If this question is answered with a No then questions about the quality of such p
329. edge of CSS styles edition you can build your own online template The easiest way is to copy the file onlinesurvey css you find in C Apache htdocs classclimate application modules online templates onlinedefault 156 Scantron Corporation Copyright Electric Paper GmbH thy Class CE imate Phase 2 Implementation of Surveys COURSE 3S UH FEEDBACK SYSTEM Zip this file go to the menu System Settings Online Templates and upload the ZIP file you created Afterwards use a CSS editor to modify the file that is now in a folder named like your template in this case My Template in C Apache htdocs classclimate data templates My Template This file can now be modified using a CSS editor To display the modifications you have made in the style sheet you need to remove the content of the folder C Apache htdocs class climate data tmp online and restart the system service mem cached Server To do this select the option Administrative Tools Services in the Con trol Panel and search the list for the entry memcached Server If you right click on the entry a context menu opens where you can choose the option Restart by a left click Here is an example of what can be changed by simply editing the styles in CSS Sunny Narrow Engineering Data Analysis 571 Dear participants we are very interested in your opinion concernig the course you are currently visiting Please take some time to fi
330. ee AR speak numeri T mobde pagination ano l speak punctuation Le moble pagination aparti atediat De moble pagnaton auna fauryeyhesader div sirenk T3 mobie pagination achower gt Width 390px7 E volce family De noblackberry item span float left yoke E y noblackherry ikem soar 2 Ue noblackberry item apan dkn both E mobiadkbery bem soan pagination fl margin Die l a obleckherry item fitere margin 0 0 0 20x H i te Aobisdbery item Aters padding border iia noblackberry item fltere Glear bath fe mg ngiblackDerry iben filter Pifinavigetion show pagination display block display none displaytbliock Sample Text noblackberry span bigche sindexi9999 lo obleckherry mant bigad q fumbered label scaled 5 OFF OF j i ech sye rs Freae Glare RE eee Figure 144 CSS Editing In this example a button is defined with a light blue background and dark blue border and text sample of how it will look like on the right of the example image E Advanced Template Editing The way online templates are programmed in Class Climate allows you to modify many aspects such as colors and location but also each detail of how the single elements will be displayed You can for example include flash interaction into your survey create a picture based survey e g displaying pictures as multiple choice options and so on Working at this level of customization re
331. ee ee 399 Preview functions 0 0 00 ce eee eee 396 Viewing options Online view 0 ee 394 Paper VIOW 0 0 0 0 cece eee 392 VividForms Editor 2 0 0 00 cee eee 387 Questionnaire header IMAGOS cai eoate es eke Meee ea ae oh 398 place holders 0 0 cece eee 398 R Recognition set management 457 Recognition Set of the VividForms Reader 88 Remote maintenance 0 00 eee ees 14 Repa ON 2 2542e0es cee teehee wees eee eS es 441 Report creator 0 0 cee eee eee 268 269 Any compilation Tree structure 294 Creating a report creator 0005 269 PEPOMING ois xd ciew batten eed aw gr de wee wow Paw 256 Reports io o4 bon bbe ne babes banded ee 268 480 Designing individ config letter for sending reports 252 Download and sending of reports 253 Generating aggregated reports 279 Individually designed reports 250 Reports forthe dean 0 eee eee 325 Reports for the dean of studies 325 Subgroup reports 0 0 00 cece ee ee 480 Required questions 92 447 450 Response Rate 0 cee ee 121 CalCulaliOn sesers erdee feet ae ee web eeedeee ee 510 Scantron Corporation Copyright Electric Paper GmbH Rules for scanning 0 cece eee eee 207 S Sample files 0 0 0 ccc cee ee 13 Scaled ques
332. eeteuesseesaeseeeseesaeeaeees 19 2 3 CENTRAL EVALUATION AND ACTIVE INSTRUCTOR ACCOUNTS ccccscceceseeeseeteeeseeeseeeeceeeeneees 21 2 3 1 CENTRAL EVALUATION A CENTRAL OFFICE CONTROLS THE EVALUATION cc0eceeeeeeees 21 2 3 2 ACTIVE INSTRUCTORS ACCOUNTS dicwnttaccincevinnange scisivtdeasseaun dens bdashanleacadunauensaaintnsnweacainionnseiee 22 2 4 BASIC TERMINOLOGY WITHIN THE CLASS CLIMATE ADMINISTRATOR MANUAL 2cc0eceeeeeeees 24 3 SYSTEM START UP AND SECURITY sancvaccitnetataneiensewscuhtestuinaansarGiadnsadayrtsmaudterunddsdadsnoweaapensativbaneibbentudadaes 26 3 1 ADJUSTMENT TO YOUR ORGANIZATION wissstaciawsaceasavns dawvsvestuvenaacnnavansiaacanisenenanevanseadsaweanawanenveouss 26 3 1 1 LOGGING INTO CLASS CLIMATE ENTRY POINTS cccecceecceeceeceseeeeeceeeseeeseeteeeeeeseeteeeaues 26 aT HOGI SECU IRE eer a E A E a nese eae sama nee nsetaar A 28 3 1 3 ADJUSTMENTS IN CONFIGURATION TEXTS COLORS DOCUMENTS ssccececeeeeeeeeeeeees 30 3 1 4 ADJUSTMENTS IN THE TEXT TEMPLATES ccccccescceceeeecesece cece eceneeaeeeeeeeueceeeteesaueeaeeseeeanes 32 3 1 5 ADJUSTMENTS IN THE DOCUMENTS sisiiasscccavctsauenierve dnoncsassapensanseasettawaveianteniesaanbenvaesialanees 32 3 2 DEFINING ACCESS RIGHTS ccccsasunstumracansiehwstorustinativabauatmag Seat wmiaiiansavnawaserat seman Saalesgeaderedunamiuaawesies 32 3 3 IMPLEMENTING BACKUPS crsccczceasmsanndenncsencasseirepouncdpenaiausinsyudenaaamesinannd
333. eine sauevacbaceevenveueusan snes eovecceixeinwnese 339 T MODULE EVALUATION sorcier cian bel in gioais ua a a a aa a 369 C CREATING QUESTIONNAIRES WITH VIVIDFORMS cccscceeeeseseceseeeseecesenseeeeeeenseeseenaes 385 1 ACCESS TO THE VIVIDFORMS EDITOR uu cccecececeececeecececeeeeneceeeeeeceeeeeeneceeseeececeeeeneeeeeeseeenenenseeneeees 385 2 CREATING A QUESTIONNAIRE IN THE VIVIDFORMS EDITOR cccececeececeeeceececeeeeneceveeeeeevaeeeeeeeeanees 387 3 REPAIR FORM tes deeasiacia bbees sere dpe etree tte cepseaen ls a bac iota te cassin adh eee dmmsad Sdaw etcetera nceetedan lt eeesaet ocean 441 4 USE OF THE QUESTION LIBRARY WITH VIVIDFORMS cceceecececeecececececeeeeeeeeeeeeeeeeeeeeaeeeeeneenenenens 441 5 FILTER SETTINGS VALIDATION REQUIRED QUESTIONS CROSS TABULATIONS c cccecceseseeseeeees 447 6 DEFINING GENERAL TEMPLATES cccececcececececceceeeecececeecececeeeeeeceeeeeececeeeeseceeeeeeceeeeseeeeeunenseeneeneees 452 7 EDITING AND PASSING ON QUESTIONNAIRES cccecececeececeeeececeeeececeeeeeeeeeeeaeeeseeeeeeseeaeaeseeenaesesenaens 455 D SYSTEM SETTINGS AND MANAGEMENT ccccceecceeceeeenseesseeseeeeenseenseessenseonseeesenseeaeens 461 1 SYSTEM MANAGEMENT AND SUMMARY cccececcecececeecececeecececeeeececeeeeseceeeseseceeneneeeneeseeeveeneneneraenes 461 2 CONFIGURATION SETTINGS onivwciccanendincsantatsnnsiingeadceencninmetiiesansewesldsueiemindanmsinemaind inianidvdneadtedunmema
334. election fields such as subunit period etc 288 Scantron Corporation Copyright Electric Paper GmbH X Class Climate You could summarize the reports for two courses that are held by two different instruc tors for example for Donna Harwood the lecture on Web Design and for Carlos Hernan dez on the New Economy Of course the courses can also belong to completely different subunits Or you summarize everything that you have ever evaluated in order to receive an over view of the assessment of your university or your company Or you summarize the reports of all courses assigned to the course type Excursion in order to receive an overview of the assessment of the study excursions These are only a few possibilities as previously mentioned in the central evaluation you can freely combine options For technical reasons surveys of active users cannot be Summarized by means of Any Compilation To create a report which combines freely definable elements choose the option Any Compilation from the drop down list and click the button Next Create reports Summarized aay cnpiion antisin Reports EG Comparisons Batch Profile Lines Next a Figure 316 Report Creator Create Any Compilation The window which then opens offers you the usual selection Here you can mark several elements by simultaneously pressing with the mouse and the Ctrl key In the following example a
335. elow Above Above value Average Average Average Average 1 General norm 7c a5 95 105 115 P Name P New Back Assignment of General norm m Course Type m Subunits m Basis for norm value ALL _ PF AL A Ownvauebase value base ja Belmore WS 10 11 Economics WS10 11 Tutorial Engineering Hernandez WS 10 11 rofessional Development Hernandez Belmore WS 10 11 instatio no Si Overall Report unweighted bunt Overall Report weighted Prof Dev Economics Overall Re Figure 404 Norming Edit Norming Types In the upper part of the screen you will see a list of the available norm types which can not be deleted This total norm is generally valid unless you create a special sub norm You can now give the total norm a norm value basis by selecting one of the reports shown in the list in the area Assignment of the norm type total norm It is not possible to limit the total norm to courses or subunits In order to create sub norms enter the name of the sub norm in the list norm types and click on New The assignment area for the new sub norm now appears You can now select all of the course types and subunits as well as the corresponding norm value basis valid for this sub norm 6 2 Quality Guidelines With quality guidelines you can define minimum standards for questions in a question naire that have to be reached by survey responses Note Please note that
336. ements You see that except for the selection of the program of study this window largely corre sponds to what is presented to you during the creation of a subunit report In the same way the information windows resemble one another prior to the actual gener ation of the report Here you once again receive detailed information on the report that you create you can again exclude single questions from the report and create the report via Create Scantron Corporation 285 Copyright Electric Paper GmbH ae e COURSE EVALUATION FEEDBACK SYSTEM Request report on a program of study Your choice Program of study Economics Compilation name Economics WS10 11 Questionnaire train_en Period WS10 11 2010 09 01 to 2011 02 28 No of Surveys 3 No of completed questionnaires 46 The report ceation may take a moment Please wait until an acknowledgment has been sent back from the server Create Which gender do you belong to male female Figure 310 Report Creator Program of Study Report Overview of the Selection made and the Questionnaire Then the report is added to the report list Type Prof Development W 10 11 Data available train_en 05 18 2011 046 choose pdf report CSV SPSS Figure 311 Report Creator Program of Study Report in the List of Reports Instructor Profile The option Instructor profile allows all surveys of an instructor to be periodically summa rized into repor
337. emplate Instructor Configuration af y E Types Figure 110 Setting up the Tree Structure In the drop down menu below the structure list apart from the instructor all levels which are linked with the course i e program of study room and the five user definable data fields in this example only two are used namely language and location are available To add a level to the tree structure select the appropriate level from the drop down list and determine its position Afterwards click Add The selected level is now displayed in the desired location in the list of levels Continue in the same way with all other desired levels Scantron Corporation 129 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM y Define Tree Structure Element i Po PENE 1 Subunit 2 Program of Study 3 3 Location Bo3 4 Instructor amp Ti 5 Course Course Location Position 2 Add Figure 111 Edit the Tree Structure The individual levels added can be moved up or down one step at a time retrospectively via the arrows in the area Action With the help of the red cross icon a level can be deleted from the list The framework levels Subunit and Course can neither be moved nor deleted As soon as the tree structure has been set up in the menu System Settings it can be displayed in the menu Subunits To do this click on the entry Tree Structure in the left context menu T
338. emplate he has to copy this questionnaire in his own form management For this purpose click Templates in the left menu A new page opens listing all the existing templates of the administrator and the corresponding subunit administrator Click the icon in the column Template and the questionnaire automatically is copied in the form management of the active instructor i K Form Templates Abbreviation Title Pages Date Template Preview Quest_01 Evaluation Questionnaire 1 2009 05 05 10 52 06 Quest_3 Evaluation Questionnaire 1 2011 05 12 15 16 54 Note Please bear in mind that required questions cross tabulations and online survey designs cannot be copied when copying the template into the form management Figure 194 Copying a Template in the Own Form Management An active instructor can find the form management in the left hand menu when clicking Questionnaires When clicking this option the list of own questionnaires opens Information Aform was added to your form management view Form Management Actions BES watlon Bte Sages Euis Regain Settings Copy Delete Edit Preview Export Evaluation Questionnaire 2011 05 16 aij l Quest Template 1 3616 amp ym Pie 2 Figure 195 Copied Template in the Own Form Management The questionnaire that has been copied from the list of templates is contained as a tem plate here You can recognize the copy by the modified Abbreviation it is counted up
339. en answers can be associated with you Figure 180 Reference for Anonymous or Non anonymous Online Surveys Text Templates In addition to this you can always render a non anonymous survey anonymous by removing the participants data from the survey details You must confirm this action by clicking on OK In doing so all information on the participants in the raw data exports for SPSS as well as in the CSV export is deleted After clicking on OK a message window indicates the removal of the information to you At this point you still have the option of aborting the process Scantron Corporation 189 Copyright Electric Paper GmbH a a COURSE EVALUATION FEEDBACK SYSTEM p r i Le i i a IIS wage Ser lee Show cover sheet form in browser English Y data This action cannot be undone Itis not recommended to remove participant data as long as the A Finish survey has not been completed Do you want to continue amp Resta 2 Delet Edit a i fa Assign survey to substitute instructor Li Edit Show notes EJ Remove participant data 4 Figure 181 Subsequent Anonymization of a Non anonymous Survey Customizing the Questionnaire for a Non anonymous Survey With non anonymous surveys the questionnaires are assigned to specific participants So that these allocations can be adhered to during distribution of the questionnaires you have to insert the relevant information of the survey part
340. en the scanning is completed The scanned forms will be trans mitted to the Class Climate server and further processing is automatic In order to scan another survey click in the main window Scan lf the scanning operation was not successful then click on Discard batch in order to destroy the data scanned from the current scanning operation and to repeat as a new scanning operation Scanning process completed ry You have scanned 4 pages Would you like to continue scanning pages from this batch release this batch for further processing or discard it Figure 209 Release Cancel Batch 4 2 Evaluation of Scanned Questionnaires The processing of scanned batches is done with VividForms In order for processing to continue the VividForms Reader must be in operation 4 2 1 Recognition of the Checked Boxes via Barcode and OMR In the following graphic you see two form pages one of which is a cover sheet and the other a page from the questionnaire The relevant capture zones have been marked in red Barcode Recognition On the cover sheet as well as the pages of the questionnaire there is a process number in the form of a 2D barcode The barcode also contains information about the type of form being used OMR Recognition Checkbox fields as well as open questions are processed using so called OMR Recogni tion OMR Optical Markup Recognition In a defined capture zone the mark is scanned Using a predefined threshold th
341. enerate indicators from question groups Set new indicators Figure 280 Free Indicators Generate from Question Groups To edit an indicator click on the pencil icon An overview of the questionnaire is now shown Free indicators Indicator name English instructor Indicator name German Lehrende r W Hide all questions which are not scaled questions Contents of Questionnaire Scale 1 Questions about you 2 Questions about the instructor vi The instructor is always well prepared ca feo fa jal fe v The instructor explains even complex topics in a comprehensible way oboooadao The instructor handles the technical equipment video projector etc i without any problems V Please grade the instructor for this course por 00 000 0 very good 3 Questions about the course Strongly ji ad ti if th Se D CoO g0 0 The lead time of the course is adequate dis agree Strongly agree Figure 281 Free Indicators Editing Initially the indicator name is displayed and can be changed as desired If the question naire exists in different languages the indicator name must also be deposited for each respective language in this case English and German In order to achieve greater clar ity it is possible to hide all questions that are not of the scaled question type Via the selection box in the left column the questions relevant to the indicators can now be selected or deselected Please
342. epending on the option selected in the Action box you can define the text of the PDF letter or the email Within the text you can make use of placeholders Changes to the text can be saved by clicking on Save Editing of text templates Action Automatic email attachment list E MAIL Password for online survey participant E MAIL Profile Mail for instructor E MAIL Profile line No email attachment defined E MAIL Regulatory information E MAIL Remind online survey participant E MAIL Results of a survey E MAIL Results of a survey Summary EMAIL Form PSW0Ds to the instructor Instructor s Optional Questions 1 Si Language English Higher Education w Reference Class Climate survey SURVEY Mail text SALUTATION TITLE SURNAME 2 This email contains evaluation results for SURVEY QUESTIONARY imi The global indicators are listed first followed by the individual average values consisting of the following scales DIMENSIONS In the second part of the analysis the average values of all individual questions are listed v Save Figure 597 Editing of Text Templates 2 1 2 Template for Class Climate Here you can define the welcome text for the first login of an active instructor There you will find the option Welcome text for the first login for instructors Default Welcome to Class Climate the Faculty Evaluation Feedback System Fi
343. er GmbH a System Settings and Management Class Climate New surveys This setting determines the background color of the table lines for newly created surveys Deleted surveys This setting determines the background color of the table lines for deleted surveys 2 5 10 Section Instructor Accounts Display question numbers Question numbers are displayed when processing the optional additional questions Activate link to PDF preview When activated users can click on a questionnaire name in the list of surveys in order to see a sample of the questionnaire 2 5 11 Section VividForms Recognition Set Folder Recognition folder for VividForms forms Image directory for open questions Path to a directory in which the VividForms Reader will store the images of an open ques tion Default form editor access for users You can set the following access modes 0 Unrestricted access 1 Only templates 2 No access Cover sheet text Instruction text on the cover sheet Default Font size Default font size for VividForms questionnaires Allow editing of HTML code in the VividForms Editor If activated users are allowed to edit HTML code in the VividForms Editor 522 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Maximum amount of pages that can be printed through batch printing of forms Maximum amount of pages in
344. er account of the instructors must be in both LDAP as well as in Class Climate You can use the XML import interface in order to synchronize this user data with Class Climate For further information please consult the special XML manual Scantron Corporation 63 Copyright Electric Paper GmbH If desired the LDAP connection can be encrypted in the configuration LDAPS System Settings Class Climate Settings Network Settings LDAP secure connection 2 2 3 Creating Courses The administrator as well as the subunit administrators can assign courses to an instruc tor or dean This function is only available when using the Central Evaluation server ver sion The basic idea of the Central Evaluation is the repetitive implementation of large scale surveys of a correspondingly large number of courses A survey is always related to a course In order to be able to compare survey results each course must be evaluated only once in a given survey period The survey period is in most cases a semester although it could also be set as a tri semester or a half semester menu System Settings Periods The fields available for a course include e Name Title of the course e Program of Study The short name of the program of study can be used to create pro gram of study reports across subunits e D number Unique ID of the course e Type Lecture seminar etc Course types can be viewed and changed at Settings Course Typ
345. erent color shadings for question groups and questions can be defined This improves the readability and increases the optical quality of the questionnaire tb Color Scheme Assistant mM Change color scheme Font question groups ee Background question groups Background odd questions P Background even questions P Form Properties iow u Example preview Form Propertie 1 Personal Data Layout settings 11 Gender Repair form 1 2 Age Enable numbering Edit Pole Template 2 General Assessment Filter settings 2 1 Adequate parking spaces are available Validation Required 2 2 am taking part in further education actmties questions Cross 2 3 Your notes and comments tabulation Picture Library Apply Cancel Figure 538 Adjusting Color Scheme To change the color of your question or question group click on the green pencil icon next to the corresponding option Scantron Corporation 439 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM You can change the following areas e Font color of the question groups e Background of the question groups e Background of odd questions e g 1 1 and 1 3 etc e Background of even questions e g 1 2 and 1 4 etc After clicking on the pencil icon the color selection dialog opens Here at the top of the window you can select a color direc
346. ermepie Enginee ing m Mriheniit O kinealg C Aueclear Physi O Opics L Presics QE rontana Gaoi O Business inionmnatcs O Chemical Engirsenng O Coenparatne Priloiegy O nausia Engineering ami Management e you already nove al he ll O yes O ro another ins Teo tertiary oka 2 Queshons about the insiructor A a a E The instructor is always wel prepared Ooodaqg ao 0O Thei instruction hacen ine ichni n ent OUuUO 0 O O m ideg prieto etc without amy problar Fa ade the instructor tor this cou rec eae 0 O OOO O svengece O ata Please give us your feedback abou the instructor as well as suggestions for improvement 4 Quesions about the course Serr TET Page 22 Figure 81 Hard Copy Procedure 3 1 3 PSWD Based Online Survey The online surveys are done with the so called PSWD procedure When an online survey is created Class Climate generates a number of PSWD codes PSWD codes ensure that a participant takes part in a survey only once as without them it would be impossible to prevent an individual from completing a questionnaire more than once No software is necessary for filling a HTML questionnaire apart from a browser An online survey can appear as either a complete questionnaire or in sections in which case the respondent can navigate back and forth between sections Also in PSWD based surveys participants can save their entries and return to the questionnaire at a later point in time to complete it A print button may be activated in
347. erning for example the number of scanned questionnaires and number of surveys can be viewed by your colleagues if you permit it Otherwise only the administrator can view the utilization statistics After the scanning operation automatically generate email with message or report only paper surveys You can automatically send emails also with reports after the forms have been scanned The email will be sent to the email address given in your profile If the email does not have a report file then it is a matter of system configuration A message text or 502 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM in addition a PDF report and or CSV raw data can be sent This setting is made by the administrator End the survey after the scanning operation Surveys can be highlighted as either ended or not yet ended This function allows you to collect data in a number of scanning operations in different periods of time e g when returns come in waves If you are sure that you will not need further scanning opera tions after the first scanning operation then you can answer this question with yes Keep survey data after analysis in the system only paper surveys only activated instructor accounts The survey data is stored in the Class Climate database after it has been captured No one other than you has access to this data
348. es e Evaluation period Continuous which means that the course can be surveyed more than one time or a specific period e g WS11 12 e Location Optional information e Number of participants The number of students in a class can be used to create the appropriate number of PSWDs for online surveys or questionnaires Apart from this up to five so called user defined course fields are available which can be defined at will in the example below language and location Furthermore further report recipients resp secondary instructors can be assigned to each course 64 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Edit course of Dr Richelle White Course Introduction into Sociology name Program of Social Sciences Sociology study Course lD 02 P1246 Evaluation continuous period Course Type Lecture X Location R P 061 Enrollment 80 Participants Anonymous survey participants Administrate participants data Non anonymous survey participants panel Language english Ly Further report recipients secondary instructors lv existing Department Training Donna Harwood v Add Department Training Donna Harwood Remove Figure 40 Create Course Adding Editing and Deleting Courses Manually To access the course list of an instructor open the user list of a subunit Click on the number in square brackets in the column CO next to the name of the
349. es on the right If necessary these can also be filtered according to course type by activating the option Course Type The display can be refined by different types of surveys and status by using the drop down menus 3 Filters Survey Period __ Course Type f Additional filters ALL a EN Seminar Course Type ALL F WS09 10 h LVS iat E ALL x Questionnaire a Show Quest_01 train _01 trainen Show instructors 48 Human Resource Management 73 Human Resource Management 63 Management Strategies 62 Managing and maintaining a healthy lifestyle 47 Organization and Management Figure 115 Tree Structure Selecting the Courses By clicking on the button Show the courses are shown in the list If required the name of the instructor can also be shown by activating the option Show instructors By using the control button and mouse clicks any number of courses can now be selected After clicking on Display Surveys you are redirected to the survey list of the desired surveys 132 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM 3 Filters Survey Period _ Questionnaire Additional filters ALL Course Type Quest_01 train_en WS10 11 310 WS09 10 WS06 07 ALL 73 Human Resource Management 62 Managing and main
350. es that you can use to test different functions in Class Climate such as the CSV import of users and course participants imports into the question library uploading a cus tom cover letter for the PDF report etc Scantron Corporation 13 Copyright Electric Paper GmbH COURSE 3S oN mat SYSTEM Preparation and General Notes thy AN Class CI mate 1 2 Support and Remote Maintenance 1 2 1 Class Climate Website and Support Area When logged in as an administrator in Class Climate via the main menu System Infor mation on the sub menu s left hand side you will find the option Class Climate Web Site When clicking on it you are granted access to the Class Climate web site as well as to the support area subunits Questionnaires System Settings License Management Class Climate Product Central Evaluation Version V5 0 Database MySQL localhost Information Paper surveys Licensed oo Search Online Surveys Licensed Send Ema Handwriting recognition Licensed 2 Utilization Statistics ViidForms Designer Licenses Not Licensed O System Summary Scanstation licenses 4 eoi Premium License Maintenance PA ADERS A Assign to subunits tP License a Send Email to Supp License key ystem Cleaning id System Status oe Customer name Class Climate Website Figure 1 Link to the Support Area when logged in as an Administrator 1 2 2 Email to the Sup
351. eseueeees 329 5 3 DATA EXPORT TO EXCEL AND SPSS siecsteccsienscesacseacoseindeacssisncnhectevesubessientandetseeneadeddeeveadsaonnnss 335 5 4 DEFINITION OF THE EXPORT VALUES AND NAMES FOR VARIABLES cccceecsesseeseueseeeeeeseueenes 336 6 PHASE 5 QUALITY MANAGEMENT ccccceccceceeeceeececeueeeuceueceuececeuseeueeeueeueueeaeseeueeuaeeseeeeeneeuneeaeenes 339 651 NORMS scisinxsicavinacnsisaccwts vaahaspmbanntinevchaenansncwdanandnlaennantnawabansenendada xeumanigdwnabiaabewhensanaedmeendeeunesanananas 339 61 1 CALCULATION OF NOG ec eset sie dace ate sees ose E Ea 340 6 1 2 DEFINITION OF NORM VALUES FOR QUESTIONNAIRES ccceccceeseeeceeeeeeeeeeaeeeueeeueeeeeeeeeeees 342 6 2 QUALITY GUIDELINES sarcsrooererrere ono nie aE EEE T ET dae satevioe E EE AEN EER 345 6 2 1 SETTING QUALITY GUIDELINES ooo ccc cccccc cece cecceecseecseeceeeueeue cena ceseeeeueeuueeueeeueeeseueeaneeaaeenes 346 6 2 2 CONVERTING INDICATORS INTO QUALITY GUIDELINES cccccccccceecesesseeseueeueseeeeueeeaeeeees 354 6 2 3 CONVERTING NORMS INTO QUALITY GUIDELINES cc cccceeccccecceeeeeeeeeeueeeeeeneeseaeeeeeeneeens 358 6 2 4 AUTHORIZING ACCESS RIGHTS TO QM VIEWS u cecccecseeceeeceucsueeseueeeeuseueseueuseeueeeeeeneeens 362 0 2 5 USE OF OM VIEWS niisiis e a a a aE E aa 364 6 2 6 DEFINITION OF SPECIAL SEARCH AND TABLE CONFIGURATIONS cccccccecseesseeeeessee eeu eenes 366 T MODULE EVALUATION re ctictes ence aces aneii a a aa aa a iaaa a tate at
352. eshold value In this example for question 1 4 1 5 4 3 2 5 For the quality in the following applies If the absolute quality is gt 1 then 100 is reached If the absolute quality is lt 0 this corresponds to 0 For all values between 0 and 1 the quality in absolute quality 100 Scantron Corporation 351 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM In this example for question 1 2 5 gt 1 100 lIn order to calculate the quality index for the whole quality guideline use the following formula gt observed quality per question in weighting per question 100 In this example for quality guideline 1 100 25 0 75 100 25 The overall quality of the survey is calculated using the following formula gt quality index of whole quality guideline weighting of whole quality guideline in relation to the overall quality index 100 In the example the calculation is thus 25 25 75 75 100 62 5 The survey thus reached an overall quality of 62 5 ES If in the questionnaire you have defined questions where the best worst evaluation result can be found exactly in the middle level questions you can choose them twice when defining a quality guideline A possible level question is Do you think the number of presentations was adequate In answer to this the interviewees can select one of seven
353. estion group and indicator are consistent with regard to the questions included It is also possible to freely define indicators so that questions of different question groups can serve as the basis for the calculation of an indicator The elements of an indicator are as such freely distributable throughout the questionnaire These so called Free Indicators can be stored separately for each questionnaire and displayed later in the PDF report in place of the conventional indicators The Free Indicators can be defined in the questionnaire details drop down list in the area Advanced Settings option Free Indicators Scantron Corporation 265 Copyright Electric Paper GmbH AN Class Climate Ei Details for questionnaire train_en G Copy and open the questionnaire in the VividForms Designer wW PDF Sample Show PDF paper survey Show In the recognition set of the VividForms Reader Refresh VividForms Editor Preview online survey Advanced settings Questionnaire Edit Form Delete Ted Tewites Se a Text Templates 2 Norming Export __ PDF Reports Quality Guidelines Report for comparison Data export configuration Filter settings Validation Required questions Cross tabulations _ 4 Free indicators Languages Figure 278 Free Indicators Access in the Questionnaire Details Online Design 7
354. et forwarding to the following URL Please observe the following URL format http www example com http www example com lottery php Determine the secret word with the following method Apply the system configuration method Define a questionnaire specific spare secret password This secret password will only be used if there is no other secret password defined in the course user data field and in the system configuration menu System Settings Class Climate Settings Survey Online Altemative forwarding including authentication j Save Cancel Figure 71 Define Forwarding Here you can e deactivate the questionnaire specific forwarding In this case the setting in the menu System Settings Class Climate Settings Survey Online Alternative forwarding for online surveys is applicable e activate the questionnaire controlled specific forwarding and enter a questionnaire specific address please observe the format of the URL http www example com As a password you can either define your own secret word or use a predefined one which can be defined in the System Settings and which consists of information from the course e g a combination of the user data field and the survey ID System Set tings Class Climate Settings Survey Online Alternative forwarding including authenti cation Scantron Corporation 97 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Clim
355. ettings in the head of the table allow you to refine your search queries Cok Pnntversion Bat Survey Type Recipient Address Way Sent every Managing and maintaining a healthy lifestyle Ses m hernandez example com m hemandez examplecom _ W Ants 2 Form train_en z Pee Course type Seminar Managing and maintaining a PSWD to 05 16 2011 healthy lifestyle respon dents p taylor example com p taylor example com sy e at 10 21 28 os Form train_en Course type Seminar Figure 578 Search Query under Delivery With the button Print Version a printer friendly version will be displayed 1 4 Batch Export With the batch export you can download the entire raw data from all surveys of a subunit The name of this menu point was formerly known as Archiving Select the subunit the survey period and the questionnaire in order to limit the data to be exported from Class Climate Then select the export format Scantron Corporation 467 Copyright Electric Paper GmbH A Class Climate System Settings and Management Class Cl mate D Class Climate Questionnaires System Settings System information saq A x Batch Export te s r x Class Climate Admin Administrator A 1 Subunit 2 Survey Penod Subunits Business Siudits P 5510 Chemestry C Overview Computer Science Hi Business Studie ay Cherssiry Mathematics Hh Computer Scienc Musics P
356. euueeaeeaeeeeees 2 8 ADDING POLE LABELS c cccccccccecsceceecececeueeeeceueueuueeuseueeeuuueaeeueueuueeuseueeenees 2 8 1 HORIZONTAL POLE LABELS cceccecceecseeseeeeeeseeueeeeseecsueueuesueesauueueeuaess 2 8 2 VERTICAL POLE LABELS cccceccceccecceeseecsecsceseueeeueeuueeuesuaeseuueeeeaeeaueas 2 8 3 INCLINED POLE LABELS ccccecccecceccceseeeseecseeseueeeueeueeeeseuueseuueeeeeaeeauas 2 9 ADDING GRAPHICAL ELEMENTS cccceccecceeceeeceeeseeceueseuusuueeuueeuseueeuueeauenees 2 9 1 LINE SPACE oo cceccccccecccccccccueceecseeceueceueueueeueueuueeueeueueaeeeaueueeeneueaesaeeeaeeuasss 2 9 2 GEPAPATOR ernier nip ein ESE E e a tase saesdasuadoaceemestauectaqsatosee AAS ie Seal TEOT o E A E E E E E EE N A E E 2 9 4 PAGE BREAK spaces goeace cae seeseoceen ess cessing case tcat noe ioe vtreeeeiede ace sexecenecenceeen 2 9 5 LINE HEIGHT FONT SIZE AND FONT TYPE ccccecsccseeceeeseeeseeeeueueeeeeees 2 9 6 FILTERING OF HTML TAGS oo cece ceccecccecceeseeceeeeeuesueseeuveueeueeeaeeeaeeuess 2 10 ADDING PICTURES TO A QUESTIONNAIRE ccccccseecseeceeceeeeeueeeeeeuueeaeeaeeenaaes 2 10 1 UPLOAD PICTURES TO THE PICTURE LIBRARY cc ccccceseeseesseeesaeeeeees 2 10 2 INTEGRATING PICTURES IN A QUESTIONNAIRE 0scccecececeeseceseeeeeees 2 11 LAYOUT SETTINGS poesin imaa a ON aaa a Aa 2 12 ADJUSTING COLOR SCHEME c ccccceccceccecsceseecseecseuseueeeueeeueeueseeesuuueueeeeeaues Je REPAIR FORM incl cesta tte ce
357. ey Description Scanned Forms Quality Index Survey ID scan Date Course Description Enrollment Location Program of Study Period Last name First name Subunit Form Description Form ine lea Now you can save your current search setting Activate the option Save search Enter a name By highlighting Set as default the current search setting will be displayed every time you login Finally click on Save Search 368 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli mat SYSTEM Filter Selection Standard Save search w Save current query configuration Set as default Query name Save search Figure 433 QM Views Save your Search Settings Deleting your Search Settings Using the option Delete search brings you to a selection list in which you can select the search settings to be deleted Then click on Delete You can only delete settings you have defined yourself Filter Selection Individual Search 3 Delete search w 50 Show Delete saved queries individual Search w Figure 434 QM Views Delete your Search Settings 7 Module Evaluation The functionality Module Evaluation was developed to allow multiple separate surveys to be combined into a single questionnaire Class Climate generates a module questionnaire which contains multiple areas belong ing to the individual courses in a module After processing the mod
358. ey participants as a CSV file This can be useful if the list of the current participants should be revised and then imported again Existing data sets for a course are expanded but are not overwritten If they are to be overwritten then the participant data must be deleted from the system beforehand All nexuses between courses and email addresses can be deleted from the system using the Delete button You must then delete the email addresses particularly if courses with the same id but dif ferent participants are kept over several cycles in Class Climate Scantron Corporation 83 Copyright Electric Paper GmbH 2 4 Administration of Questionnaires Another precondition for creating surveys is of course along with the organizational structure the creation of questionnaires Without questionnaires you can t interview anyone therefore some fundamentals regarding the questionnaires follow in this chap ter You can create questionnaires using a form designer which is integrated in Class Cli mate the VividForms Editor To be able to explain the creation of questionnaires with these two tools clearly and com prehensively this manual contains a complete chapter dedicated to VividForms If you are reading this manual as an introduction to Class Climate and are not presently using it as a reference it would be helpful for you to create a small questionnaire with the aid of the chapter on VividForms before reading on
359. f Dr Philipp Belmore a Ea Strategies NA_2 a Managing and maintaining a healthy lifestyle NA_ 1 B Carlos Hernandez Organization and Management 02 P1236 train_0 1 train_en train_en train_en train_en_1 train_en Belmore WS 10 11 train_en First Comparison Line Prof Development WS10 11 train_en Second Comparison Line Deactivated Please Choose a Selection Figure 366 Report Creator Select two Courses Comparison Line In this case in the PDF you will see the profile line comparison shown above on the sec ond page On the first page the profile line of the course of Prof Dr Belmore is compared to the first comparative line Prof Development WS10 11 Exception you send out these comparative lines then Prof Sunny Narrow and Prof Dr Michel White each receive their profile line compared with the subunit report SSS dl Comparison Options during the Batch Profile Line Dispatch Below the selection of the comparative lines you have the option to modify the presenta tion of the profile line comparison through a number of options or to integrate additional comparative lines V Compare selected courses reports with each other Comparison options C H Minimum Maximum Values gi Overall Average z 2 Comparison lines E Anonymize comparison lines Figure 367 Report Creator Profile Line Emails Options Comparison of the Selected Courses of Reports to Each Other Activate this
360. f Introduction into Sociology Email Delete joe doe example com os Add Delete all Figure 51 Email of a Participant was Added In the case of erroneous input or a changed email address you can also delete the email address here To do this click in the relevant column on the red cross As already mentioned you also have the possibility of importing the email addresses of your anonymous participants via CSV import In the details of a course click on Edit data of participants In the following window choose the CSV import of survey participant data Scantron Corporation 73 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM B CSV import of survey participant data Import the participant data CADocurnents and Settings Adr Browse Figure 52 CSV Import of Survey Participants Data Click on Browse and indicate the location of the CSV file File Upload Look in 5 Sample Files CN i Particpants_anonymous csy My Recent Documents 3 Desktop J File name Particpants_anonymous csv E f My Network Files of type All Files Figure 53 Choosing the CSV File Click on Open and then on Import The email addresses of your participants are now linked with the course 74 Scantron Corporation Copyright Electric Paper GmbH Class Climate P
361. f Prof Belmore and Prof Hernandez from winter term 2010 11 Merge report Belmore WS 10 11 with Reports train_en train_en_1 Summary Reports 2010 train_01 train_en Summary Reports 2010 Compilation name Prof Development WS10 11 Summary Reports 2011 Hernandez Belmore WS 10 11 Economics WS10 11 Summary Reports 2011 Report of Train_en Summary Reports 2011 Prof Dev Economics Overall Report Summary Re Hernandez WS 10 11 Summary Reports 2011 Subgroup Male from Report of Train_en Summary R Male Business Studies from Report of Train_en Si Overall Report weighted Summary Reports 2011 l l Question mapping of diferent questionnaires Prof Dev Economics WS10 11 Summary Reports 2 Automatic with text comparison Hernandez Belmore WS 10 11 Summary Reports 20 O Manual Include answers to open questions Combine surveys unweighted Please note For this combination the mean values of the single surveys are averaged Merge Figure 328 Report Creator Merge Evaluations Selection of Reports Since these are combinations too the usual options are available to you questionnaire comparison inclusion of responses to open questions as well as the unweighted combi nation Choose the options that you wish here and click on Merge Then a new report is added to your report list the combination of reports you chose Scantron Corporation Copyright Electric Pa
362. f segmented box Display in report Open above Verification display Le ad Figure 499 Open Question Setting the Segmentation Style The segmentation is not only displayed in paper questionnaires but in online surveys too The display of an ICR question can be set in the report additional to segmentation The following options are available here e Like an open question In this case the results are displayed individually one below the other analogous to the results of an open question Identical entries are concen trated and have mentions added to the corresponding number for example 21337 2 mentions E 20 m 21 2 Counts E 22 Figure 500 ICR Question Display like an Open Question e Bar for every mention The results are analyzed using bar charts with each answer option receiving its own bar Identical entries are concentrated This option is recom mended for double digit numbers at maximum Scantron Corporation 417 Copyright Electric Paper GmbH Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM aC 2 22 _ 1 Figure 501 ICR Question Display with Bars for every Mention e Bar for mentions across 10 groups The results are analyzed in a bar chart The group number relates to the number of bars here 10 that should be displayed later in the PDF report as the analysis of this question In this way numerical queries in the value range 0
363. following example for the scaled question The instructor is always well prepared with 6 response options it was defined that at least 36 of respondents must have cho sen response options 5 or 6 At the same time it was set that high values are better Questions of this quality guideline Based on frequencies The instructor handles the technical equipment i Ea E video projector etc without any problems Delete Figure 411 Define Frequency Based Quality Guideline Scantron Corporation 353 Copyright Electric Paper GmbH ia Your Evaluation Process The Phase Model thy Class Cl imate COURSE ss Cli FEEDBACK SYSTEM In the following figure 52 9 35 3 17 6 have ticked the values 5 or 6 in response to the question The instructor is always well prepared Therefore a green traffic light symbol in the PDF report indicates that the target value was met The instructor handles the technical equipment video um cn cn er er ren Bare projector etc without any problems pi av 548 dev 0 Figure 412 Frequency Based Quality Guideline Traffic Light 6 2 2 Converting Indicators into Quality Guidelines If you have defined indicators for your questionnaire already you can use these in order to save work when defining quality guidelines Class Climate can convert question groups for which you have set indicators automatically into quality guidelines it allocates the questions corresponding to the que
364. for which a separate manual is available NonForms A non form is a scanned page that is not recognized as a form This may be the case when you scan a questionnaire that does not yet exist in Class Climate Then the VividForms Reader cannot read this form and will treat it as a non recognized form scan a Class Climate form that is faulty in some way For example the forms were stapled together and the corner s were cut off or they were scanned in askew which too destroys the corners needed for alignment Then the form cannot be identified scan something completely different for example in order to test the scanner These image files will also be treated as non forms The VividForms Reader stores the non forms in a so called non forms folder Survey Survey Process Conducting a survey in Class Climate is a process based on a questionnaire In order to create a survey you have to select an existing questionnaire in the system which you uti lize for the survey Scantron Corporation 25 Copyright Electric Paper GmbH Class Climate As a consequence a personalized copy of the questionnaire template is created and linked to this particular survey hard copy procedure or respectively a cover sheet for the survey is created which supplements the standard questionnaire with survey details cover sheet procedure The related survey is identified through a distinct mark in the case of VividForms for example a barco
365. formation fields you would like to use You may add from 0 zero to 5 cB Class Climate Settings Course User Data Fields x i Advanced Number of additional fields 2 Sets the number of custom course data fields Zero corresponds to no additional fields Ji Ware i avala i Ad Title of first additional field Language Enter the title of the first additional field here lhis fare aalan svariati fie She Aaesisieleoiars w Mare TNS ODT average 0 SUDO ANNS a N Title of second additional field Information Enter the title of the second additional field here Enter the title of the third additional field here Enter the title of the fourth additional field here Enter the title of the fifth additional field here Content of first additional field Enter the permitted values for the first custom field here Separate values using the pipe English Spanish Frenchlitalian character Alt Ctrl gt As well as the values stated here other freely selectable values can be entered into the details of a course which needn t be predefined here Figure 45 Define Course User Data Fields Then indicate the headings of these fields at Titles e g languages as well as the possi ble values of the field at contents e g English German Spanish These additional infor mation fields reappear for selection in the following areas e CSV import of instructor and course
366. from Class Climate increasing and maintaining clarity of the system During the export you can determine whether just PDF reports or CSV data or both are to be archived This option is only available if you have activated the archive function of the batch events in the menu System Settings Class Climate Settings Email Functions amp Accounts Archive mailing of PDF reports and entered a valid email address in the menu System settings Class Climate Settings Email Functions amp Accounts Email address of the archive Send PSWDs to Instructors For online surveys the PDF files containing the PSWD codes can be sent to the survey owners by email This option is only available if you have selected the option 2 PDF lists of PSWDs for printing and distribution are sent to the instructors in the menu System Settings Class Climate Settings Email Functions amp Accounts Delivery method PSWDs central evaluation select the courses which require the PSWD lists to be delivered to the survey owners The submission will be started by clicking Request Print PDF Reports For surveys that have already been evaluated the evaluations of a selection of courses can be requested There are two possibilities e The PDF reports of the selected courses are created together in a common PDF file This is advantageous for example when the PDF reports for multiple courses are to be printed at the same time e The PDF reports requested
367. g in a so called CAPTCHA graphic after a defined number of failed logins from an IP address This function protects Class Cli mate from automated attacks CAPTCHAs are graphics in which figures numbers or alphabetical characters are dis played so that machines cannot read them They are employed to detect whether the counterpart is a human being or a machine If CAPTCHAs are activated after multiple failed login attempts the user is prompted to enter a CAPTCHA E Error Message 3 failed logins were registered from the network address 192 168 245 1 The access was blocked for this network address You can unblock the blocking by typing in the characters you can see in the picture or by waiting 15 minutes If you did not try to log in the system before you may share the network address with other users Recognized character string OK Figure 12 CAPTCHA Function after several failed Logins If the CAPTCHA is entered correctly the user may repeat the login procedure You can activate CAPTCHAs under System Settings Class Climate Settings System security In addition you can define the number of failed login attempts to trigger a CAPTCHA The number of failed login attempts always relates to a time frame fixed by you again under System Settings Class Climate Settings System Security Should a user fail to login correctly within the given time he will be requested to enter a CAPTCHA At the s
368. ge y The technical equipment of the university is excellent 1 18 29 1 strongly disagree 2 30 39 2 3 40 49 3 4 50 59 4 5 60 69 5 6 Older than 69 6 strongly agree Figure 555 Cross Tabulations in the PDF Report Scantron Corporation 451 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 6 Defining General Templates 6 1 Defining a Template by the Administrator The administrator can create templates whose contents cannot be modified by users with instructor accounts By activating the box Template the form is made available to the active instructor The instructor can only supplement the questions set up by the administrator W Form Wizard Form creation information Abbreviation Sample_01 Title BIUS gt Sample Questionnaire Paper A4 oo Template V Activate deactivate template mode V New items can only be added at the end Max Pages 2 Max Items 20 Apply l Cancel Figure 556 Activating the Option Template By activating the answer box Activate deactivate template mode the form is put at the active Instructors disposal The administrator can also determine that the new items which can be added by the active Instructor may only be added at the end of the ques tionnaire This means that the structure of the questionnaire provided by the administra tor cannot be c
369. ght Electric Paper GmbH X Class Climate When a new CSV import with up dated data is made in a survey period the user can decide how to proceed in the case of doubling or changes 3 The user account or course is not in the database and is now added Default The user data have changed for example the email address or title The changes are made in the existing user profile The identity is determined using first and last name combination since a personal number code is unknown Course names are assigned using an ID number If there is already a course with the same ID number then all the data fields of the CSV file are adopted J The course or the user account is no longer found in the new CSV file The orphaned entries in the database are deleted along with all surveys and their data related to the course or the user account eh The user account is no longer in the new CSV file but should be kept so that data related to the surveys is not deleted and remains in the system The user account is given the status archived and can no longer be reactivated The courses contained in the CSV import file must be assigned to an survey period Select a corresponding period from the selection list above Here you are also offered the option Continuous instead of an individual period In addition to the general determination of an survey period for all courses contained in the CSV import files you can individually
370. goes from 1 to 1 whereby in general with a value above 0 7 the scale question group is considered to be reliable Class Climate uses the regular non standardized Cronbach s Alpha which is calculated from the variances and covariances of the questions within a question group Norm Profile Lines As an alternative to averaged indicators you can show norm profile lines In addition to the setting discussed above calculate indicators you must activate the option System Settings Report Settings Configuration Show norm values You must also specify the norm values in the questionnaire administration 232 Scantron Corporation Copyright Electric Paper GmbH Class Climate Dimension Value Norm value 70 100 130 2 Questions about the instructor 48 106 3 Questions about the course 4 107 4 Questions about the teaching material 45 106 5 Questions about the studying conditions 4 105 Figure 242 PDF Letter Norm Profile Lines If the alignment of the poles is different for different questions i e positive answers are not always on the same side negative not always on the other you can despite this enforce a standardized display of the norm profile line For this purpose activate the option Pole reversal of scales when taking norms You can find this option in the system settings of the PDF report If you activate it the scales of those dimensions items where smaller values
371. grated too You can create any number of customized online survey templates and use them for each subunit individually Also subunit administrators can define their own customized online survey templates e CSS Editing Use CSS editing to modify colors positions and rendering of each element of your online survey requires advanced knowledge in CSS edition e Advanced Template Editing Use the whole set of files to change absolutely anything in the layout of your online survey requires advanced object oriented PHP programming and extended knowl edge of accessibility requirements When using standard templates or a customized online template based upon the stan dard template the size of the template is automatically optimized for the screen resolu tion of the client that is as well as PC s mobile devices too cell phones smart phones internet tablets etc are supported The prerequisite for this is that the corresponding function is activated in the configuration System Settings Class Climate Settings Survey Online Support for mobile devices All other templates must be adapted for display on mobile devices All kinds of templates are organized in the menu System Settings Online Templates Here you can view and edit existing templates or create and upload new ones Scantron Corporation 151 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM System Information Search e511 t ort Fi
372. gs 0 0 0 0 c eee eee 923 Online Survey 0 0 eee eee 510 SUNG scaderi eee eneabeewehed sii haia 508 E e EET E E E E EE E E E ee ae ee 30 VividFOrmMS 42445 4 4a cuca ore ee eae eRe wees 522 Configuration settings 0 cece eee 484 Connection between a question and the library 444 Correction of checkboxes 000005 210 Correction VIEW 1 6 ee ees 213 Course typeS 2 ee ees 40 Course user data fields 00005 514 Courses Creating COUrSES 0 ce ee 64 Cover sheet procedure 0 00 e eee aes 107 Create Comparative profile lines 00 268 Questionnaire VividForms Editor 0 0 0 0 00 e eee ees 387 Questionnaires 0 0 00 cee eee 84 385 REDONS ocheectaceaeeuneeeueneeneateea eases 268 Cronbach s Alpha 00 00 cece eee eee 263 Cross tabulations 0 00 eaee 447 451 CSV Import within subunits 85 77 Custom titles endaeteese eels teow Recess 43 D Data CXNON 6336446 een doen 5 tp eiria erini 390 010 CCM oi ce honk wits oo Eide Wa pen ata nortan aes onan ose se 335 l ae e fee eee eee se Se oe re Bere ooeeeeeees Ee 335 Data import 2 0 ccc eee 513 Database nananana 34 Dean Reports for the dean naana naa 325 531 Dean of studies Reports for the dean of studies 325 Decentral evaluation 0 000 ee eee 522 Defaults P
373. gs Class Climate Settings Survey Minimum number of returns for reporting of completed questionnaires was not reached and so a report is not created and sent Summary Report for Dean The dean receives a summary report with the indicators for all evaluated courses selected from a combination of subunit Survey period questionnaire Scantron Corporation 491 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Summary Report for Dean of Studies The dean of studies receives a summary report with the indicators for all evaluated courses The selection is made by the deans themselves in their login account The func tion Class Climate Settings Central Evaluation dean of studies must be activated A cor responding user account must be set up and used Report to the Instructors Informs about the survey report SALUTATION TITLE SURNAME You are receiving the results of the automatic evaluation of the course SURVEY Questionnaire type QUESTIONARY The overall indicator given first is made up of the following scales in the questionnaire DIMENSIONS Then you will see the individual averages of the scales given above In the second part of the report you will find all the averages of each individual question The value 1 represents from the students viewpoint minimum score for the course while the value 7 is a maximum score E Certificate
374. h design templates for online surveys Default file is simple html_template inc The images and colors of the online survey are defined in the file Alternative forwarding for online surveys This option activates the forwarding of participants to online surveys After dispatch the participants are forwarded according to the settings under System Settings Class Cli mate Settings Survey online Alternative forwarding address for online surveys Alternative web address for forwarding the participants of online surveys The participants of online surveys are after dispatch of the results forwarded to the email address given here The address must be given complete with protocol i e http Language selection using images If activated you can select the language for multiple language online questionnaires by language icons The icons must be defined for the languages and the files must exist Class Climate automatically stores the images you have uploaded in the following folder C Apache htdocs Class Climate data images flags As an alternative you can also use predefined flags included in the system These are stored in the folder C Apache htdocs Class Climate images flags If this option is deactivated languages can be selected using a dropdown box Participation tracking online survey Protection of anonymity With participation tracking available as a CSV export the participation anonymity for online surveys is abroga
375. h the aid of additional roles the administrator can from his own user account take on tasks such as data entry verification or creating reports without having to log into the system as a new user Later the administrator can switch between the different user roles via a drop down menu in the top left corner of the screen All changes must be confirmed by entering the old password The entries are applied by clicking on the OK button Scantron Corporation 55 Copyright Electric Paper GmbH aa te a COURSE EVALUATION FEEDBACK SYSTEM System Information a th thy Class Climate Subunits Questionnaires Cantie CLR PE PL z eN Class Climate Admin 2 User profile of administrator Administrator z A Form of Address Mr Title Instruments _ _____ First name Class Climate EJ Text Templates E Documents Last name Admin igs Report Settings Phone Online Templates o TF P Email admin localserver com Configuration Language Default language i Ciass Climate Settings l S Define Tree Structure Login name admin Course Types Password 3 New password QA custom Titles E Process Defaurs Confirm new password J WebService Settings J a Language Sets V Report creator Additional roles F Data Entry Assistant V Verifier i OK Cancel Profiles aneri Figure 31 Administrator Profile The administrator can where necessary define further secondary administrators
376. hanged as the Instructor may only add his questions at the end To select this option activate the checkbox New items may only be added at the end As soon as an active user has added a copy of this questionnaire to his questionnaire administration a green ball with a white arrow appears in the questionnaire list l Evaluation A AAT ae 259 Quest_01 Guecdaanaire 05 05 2009 VF Editor 3 Select Figure 557 Template Questionnaire Complemented by an Active User 452 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Defining General Templates COURSE EVALUATION FEEDBACK SYSTEM By clicking on the name or description of a questionnaire in the form list you can open a detail view of the questionnaire You can even choose under action the command details In the detail view you can define how the questionnaire will be used Ei Details for questionnaire Sample_01 Sample_01 Sample Questionnaire VividForms Editor C Copy and open the questionnaire in the VividForms Designer PDF Sample Show W PDF paper survey Show Of In the recognition set of the VividForms Reader Add Preview online survey Advanced settings Questionnaire EditFom Delete Text Templates Edit EditFom Export Form l Reporting Options Online Design Activated Mirrored scale values J Show the header of the survey V Allow Sum
377. hase 1 Preparation of a Survey Period COURSE EVALUATION FEEDBACK SYSTEM Information 8 of 8 survey participants imported Administrate participants Participants of Introduction into Sociology Email Delete joe doe example com m muiller example com s brown example com p bowman example com j black example com fhernandez example com h james example com b button example com fox example com Add __Delete an_ Figure 54 Import of Email Addresses was successful As already mentioned you can delete single email addresses by clicking on the red cross next to the relevant email address In addition you can delete all email addresses by clicking on Delete all Displaying Courses The function Display courses in the main menu Subunits under Central evaluation offers an overview of the courses of an entire subunit Here along with the access to respective properties the period affiliation of a large number of courses can be defined here After clicking on Display courses select a subunit and an survey period Then click on Display A table appears showing the identification data of the identified courses By clicking on the respective column headers this table can be sorted as you wish whereby the order alternates between ascending and descending By clicking on the icon a course can be edited Clicking on this icon a will delete a course Scantron Corporation 75 Copyright Electr
378. hat is your age 20 Age ma ru Matrix Field AHS What is your age COOS a Figure 393 Define Data Export Configuration Scantron Corporation 337 Copyright Electric Paper GmbH l S Your Evaluation Process The Phase Model Class Climate The first column shows you the types of questions and the question text the second dis plays the internal description of the variable In the third column you can rename the vari able Please observe the following rules when renaming The name e must begin with a letter reason variables in SPSS must begin with a letter e may only consist of letters numbers and the underscore This means that other spe cial characters also the space bar are not allowed Capital and small letters are however not important e may be a maximum of 32 characters long Please note In SPSS the variable names will be truncated to 8 characters e must contain at least one character The field therefore cannot be empty In the fourth column the export values are displayed to which you can allocate new numerical values Please note that you can only use numerical values for the export value no alphabetical characters After completing your changes click at the end of the dialogue on Save Class Climate informs you whether the saving of your changes was successful i Information Export configuration successfully saved Figure 394 Data Export Configuration successfully saved
379. he PDF Scantron Corporation 421 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 3 Questions about the course M lt attend the course check as many as apply C because am interested in the topic O because I need to earn the credit L because the instructor is really hours good O because it is important for my O for the preparation of my exam O for other reasons professional life Figure 508 Multiple Choice Question in the Editor Preview 2 6 5 Horizontal Matrix Question The horizontal matrix question enables you to inquire up to five digit numbers Select the matrix field question type and click on Next You can now enter the text of the question Then click on Next In the following window select the matrix type horizontal or vertical the minimum and maximum value as well as the number of groups displayed in the PDF report and the method of capturing the matrix value t Question Wizard Define Options Orientation Horizontal up to 5 digit numbers Vertical up to 10 digit numbers Minimum Value 4 Maximum Value 99 Question group 40 count Matrix value as Number Back Next Apply Cancel Figure 509 Create a Horizontal Matrix Question In this example the minimum value is set at 1 the maximum value at 99 The group number refers to the number of bars th
380. he export function can be used for all of the surveys and reports In the following you can see a description of the different formats CSV Format CSV stands for Comma Separated Values and provides a free text format that is able to be read by all statistical tools as exchange format One line of a CSV file is equivalent to the content of one questionnaire The values are separated by a separator You can define this separator at Settings Data Import and Export the default setting is a semico lon A line of data contains Scantron Corporation 335 Copyright Electric Paper GmbH instructor name course name course additional fields set ID variable 1 vari able n Data from surveys whose questionnaires were created in batch printing with serial num bering additionally receive the batch print ID SPSS Format SPSS is a common tool for statistical analysis and solutions Exporting from Class Climate creates a SAV file which contains the format of the sheet and all the raw data of the survey report Export of Online Surveys For online surveys the export data includes a time stamp showing the completion time of every record 5 4 Definition of the Export Values and Names for Variables In export Class Climate assigns the names of the variables questions automatically In CSV export this is unproblematic because the question text is adopted With export to SPSS however no meaningful variable name
381. he left side of the table or select all courses by ticking the checkbox Select all Then determine from the period selection list the respective survey period and click on Assign 2 3 Import Interfaces The import is intended for data migration from existing systems Existing data structures can be imported into Class Climate via CSV and XML import This is possible not only via the administrator s access for the complete system but also via the subunit administra tor s access for the subunits of the relevant subunit administrator 76 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 1 Preparation of a Survey Period COURSE EVALUATION FEEDBACK SYSTEM 2 3 1 CSV Import within Subunits Creating a User with CSV Import In order to avoid having to enter all the instructors and courses in a subunit manually Class Climate offers a CSV import interface which allows the import of user profiles CSV stands for Comma Separated Values and means that data sets are changed line by line or other separators such as in our case semicolons into data fields separated by com mas in text files You can set the separator at Configuration Data Import and Export Separator CSV Files Spreadsheet programs e g Microsoft Excel offer the possibility to save tables as CSV files To import this file click on Subunits then Browse and select the file Finally click on import All users as
382. he option Placeholder across both columns Please observe that Class Climate will automatically delete the placeholder in the other column and where applica ble you will need to insert it in another area of the questionnaire header l Placeholder Wizard Form header settings Number of lines 2 Edit placeholder Default Placeholder SUBUNIT Please choose a placeholder and or individualize the form header Placeholder Ey a g g 5 J anit mi SUBUNIT Participant wP Placeholder peace z Figure 470 Extend Placeholder across two Columns In order to expand or contract the size of the questionnaire header the number of lines made available can be adjusted in the placeholder wizard You can choose between 1 and a maximum of 10 lines The more lines included in the form header equates to more room being available for the logo Scantron Corporation 401 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM l Placeholder Wizard Form header settings Number of lineg 2 ral m Edit placeholder Default Placeholder ORGANIZE Please choose a placeholder and p i alize the form header Placeholder BH a a Ei E T Imt ORGANIZATION Participant Placeholder Peet anne v urs Placeholder across both Note The placehokter in the other column ates of this line will be deleted automatically
383. he profile fields title first name last name user name and email For example you are searching for users who have the word demo in their profile data Enter demo as a search term and highlight users as search goal Then click on Search Courses Surveys Deliveries 7 smith search Search Result zr 2 Hits in this Table Details Figure 572 Searching for Users 462 Scantron Corporation Copyright Electric Paper GmbH EN H th Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM You will then see under the search template the area for search results In hits you see that two users were found Click on Details to display the search returns Search Result Users 2 Hits in this Table 25 User Search Result Detalls Adam Business Studies a smith example com Details Details S it Software Trainings j smith example com Details Details 0to 2 Figure 573 Search Result Details The results can be sorted in ascending or descending order by clicking on the column name The data fields are themselves the references e Last name Refers to the user profile e Subunit Refers to the subunit window e Email Initiates an email to the relevant user e Surveys Opens the surveys of the user 1 1 2 Search for Courses With this search you can find a list of the existing courses
384. he resulting restrictions you will then see only the valid options Scantron Corporation 111 Copyright Electric Paper GmbH l 8 Your Evaluation Process The Phase Model Class Climate Select a subunit a survey period one or more courses types a questionnaire one or more courses a survey type You can select more than one option by pressing down the left mouse button and pulling the mouse down You can also hold the Ctrl button and select any number of individual courses Finally you must select the survey method You have the choice of Hard copy procedure Each questionnaire for each course is downloaded automatically personalized and printed Cover sheet procedure A cover sheet is printed for each course while the questionnaires are reproduced Afterwards the cover letter is scanned together with the completed questionnaires and serves to identify the survey Online surveys For each course the appropriate number of PSWDs will be produced The number of PSWDs is taken from the data field number participants in the course data If this information is missing then there is a default setting at Class Climate Settings Online Survey default value PSWD per survey Central Evaluation These PSWDs are then sent to the survey participants There are two ways of doing this The possibilities of distributing questionnaires and PSWDs are described in chapter B 3 2 9 Batch Events 112 Sca
385. he tree structure opens in an overview a t 4 lass limate Subonits Questionnaires Syalem Settings System Information Stig j The Cla Cli PUDNEAER garbia a r mist Aa s Tree Structure 1 Actions Display Surveys Generate SS Delete Surveys Class Climate Admin tm Subunits PERN 1 Business Studies E _ Business Studies iin i _ Additional filters v Fo Industnal Engineering and Man train_O1 Course Type s 1 Prof Dr Adam Smith WSO irain en i ms m 5510 irain en v English wesoart a S509 Sees Chemisty ws0a09 Computer Science 508 Economics Subunits Ji C Linguistics L Mathematics FI Shaa inatrictor 4 _ Musics nge rann inks aeee a Physics Phage 1 tors pi eaistabon Derm la Sa ware Tran Tree Stuciure A Generate Surveys Figure 112 Tree Structure in the menu Subunits In the header of the menu three different actions are available Display Surveys Gener ate Surveys and Delete Surveys In the left menu area the tree structure of the organization is displayed By clicking on the name of an element or the button the respective underlying level can be opened up 130 Scantron Corporation Copyright Electric Paper GmbH gt is Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM Use the selection boxes next to the relevant entries to define which surveys or courses should be displayed in the right w
386. heet for a paper survey in the cover sheet pro cedure a PDF file Form to Instructor Trigger The instructor has used an activated user account to create a Survey according to the hard copy procedure decentral or the administrator has sent the instructor a question naire CE Content Personalized text with attached form for a paper survey in hard copy procedure as PDF file or FDF file 486 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM PSWDs for Online Surveys to Instructor Trigger The instructor has used an activated user account to create an online survey decentral or the administrator is sending the instructor the PSWDs for an online survey CE Content Personalized text with attached PSWD document for an online survey as PDF file The document contains all PSWDs and can therefore be very large Information about a New User Account This message can be used to inform new users directly about their new user account Activate the checkbox Inform user about profile creation via email Report on the Survey to the Instructor Trigger Class Climate has just processed a scanned survey and sends a message decentral CE or the administrator sends the instructor a report CE Content Personalized text processed survey Normally the PDF report is sent with the text In addition or as an alternative the raw data can b
387. hen generating an online survey put a check mark in the box You can always activate the time triggered control at a later date by using the menu item in the survey detail view 138 Scantron Corporation Copyright Electric Paper GmbH Class Climate Paper survey J Hard Copy Procedure __ Cover Sheet Procedure Web Verification Online Online Survey Use Time Control Generate Surveys Figure 123 Time Trigger After generating the survey you can define the planned operations for the survey in the following view In the header is the name and number of the survey By clicking Next survey and Previous survey you can navigate between the surveys In the view beneath the header there are three actions which can be activated and controlled separately Clicking on the button Edit will take you to the action you want After generating the survey all actions are deactivated by default By clicking on Acti vate you can activate the operation The next sections give a detailed description of the individual actions operations Operation PSWD to Respondent The PSWD to Respondent operation starts the online survey That means that the participants to the survey receive an email with the login information For this email you can define the following details Sender email Default Email address from the system settings Sender name Default Email address from the system settings
388. her elements which are included in the complete module questionnaire e All PDF reports allowed for all questionnaires involved Scantron Corporation 373 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy AN Class CI mate COURSE 3S UH mat SYSTEM e All languages defined for all questionnaires e Filter questions are taken over from all questionnaires e Cross tabulations Required questions and PDF report plugins are taken over e Online Design If the display mode is set to per chapter for one of the question naires then this view is taken over for the whole survey e Validation plausibility checks is taken over e Norms and Quality Guidelines are taken over from the corresponding questionnaire 7 5 Creating a Module Account You create module accounts as you do a regular user account Open a subunit and select Create new user Select Module as the user type 2 Please choose a user type Instructor Dean of Studies Dean See utilization statistics for the subunit TEA Creator Data Entry Assistant Handwritten comments Verifier Subunit Administrator Figure 439 Create a Module Step 1 Subsequently click on the Next gt gt button A second window opens in which an addi tional input field for the module name appears Enter the name of the module here The remaining address record is intended to be used for the person linked to the module e g a module coordinato
389. hes _ Figure 213 Verification Survey View 4 3 3 Form View The form view gives you an overview of the questions that remain to be corrected at the form level A form is normally made up of a number of surveys which are scanned in a number of batches The table has the following columns e Form Short name of the form e Description Title of the form e Pages Number of pages of the form e Sheets Number of recognized forms e In progress shows whether other users are already processing the batch e To verify Number of corrections e Cover Sheet Display cover sheets e Verification Process batch Verify automatically Delete batch 212 Scantron Corporation Copyright Electric Paper GmbH COURSE S UH mat SYSTEM thy AN Class CI mate Phase 3 Capture and Instant Feedback Current forms in Verifier Form Description Pages Sheets se verify Cover sheet Verification Tech_01 Questionnaire on Technical Skills 1 6 D 2 7 YO g train 01 Course Evaluation Questionnaire 2 T ah 2 2 Ei x a Selection for automatic verification No valid checkbox found invalid One checkmark and correction s found _ Search for new batches Figure 214 Verification Form View 4 3 4 Carrying out the Verification As soon as you click on the Process symbol green pencil in a view you will be auto matically taken to the correction view In the correction view there is alway
390. hich order the questions for the single courses will be displayed on the module questionnaire The course with the lowest ID for example 01 will be evaluated first then the other courses will follow in ascending order 02 03 etc Select the course type which is linked to the questionnaire you want to use for survey ing the course With module courses the field Further report recipients serves to define the instruc tor who has held the course The person you add in this field will receive the report for this single course 376 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Edit course of John Doe Course name introduction into Class Climate Program of study Evaluation period continuous Location Enrollment 0 Participants data Anonymous survey participants Administrate paricipants Non anonymous survey participants panel lt s Language v Location Report recipient instructor W existing Computer Sciences Donna Harwood Computer Sciences Donna Harwood gt i 1 L ua Remove Please see the setting Module evaluation Delivery of module sections with no instructor in the settings OK Cancel Figure 442 Module Evaluation Entering Course Data In the following example you can see the course list of a sample module Class Climate Basics In this ca
391. hysics an Economics A Linguistics k GA Mathematics _ Select program of study Hy Musics Genyes 5 Course s F 3 hr Fa r Central Evaluation introduction into Linguistics ire Pronunciation fase know ledge ES Tree Structure r g Generate Surveys Basics of Economica introduction into Economics B Display Surveys _ l ina x Delete Surveys Differential calculus Seminar Request Differential calcules Tutor A instructor s Optional Questions Hie gr 5i Cae i Sema af miegi al CRCUNS Tuto rigi r Batch Evenis introduction mia Statielics Tutorials HE A fp SUP N a O E gf Dispiay Courses Scheduled Tasks Osta import 7 amp Batch Export Figure 579 Batch Export For the batch export three export formats are available CSV A text file with the raw data of all selected surveys is exported including the course data SPSS A SAV file with the questionnaire contents as well as the raw data of all selected surveys including the course data is exported In the case of SPSS a special feature offers the ability to export across several question naires In this way survey projects consisting of several questionnaire types such as 360 Feedbacks can be easily exported in a single large file and processed with SPSS CSV SPSS Figure 580 Batch Export of Several Questionnaires SPSS 468 Scantron Corporation Copyright Electric P
392. iated with this 310 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli mat SYSTEM thy gt Class CI mate Phase 4 Advanced Reporting questionnaire and or if the questionnaire was translated you can download the user defined report or reports in other languages here In the following figure you can recognize for example that besides the Class Climate PDF Report a user defined report was produced automatically for the computer center It contains for example only the questions which are important to the employees of the computer center tax Results in HTML format Results in PDF format Class Climate PDF report Standard Class Climate PDF report PDF Report Plugins Class Climate PDF report Class Climate PDF report Copy Individual report 2 Raw data in CSV format J Profile Line F CETE Figure 354 Report Creator Detailed View Downloading User defined PDF Reports lf your questionnaire was translated you can decide here on the language in which to download the standard or the user defined report Here a selection is possible between English and German tax Results in HTML aa Results in PDF format Individual report Y English English Deutsch Figure 355 Report Creator Detailed View Downloading Multilingual Reports So in this example you could download four different reports e the English standard report e the German standard report
393. ic Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Class Climate QueSOnnalres System settings system Information or ES l pE CARSLINALREIDE POCHKA TENNE y g Search 5511 th gt gt Display Courses io Business Studies a e Chemistry Display Courses Computer Science Class Climate Admin Economics Administrator Geoscience Subunits Courses for each period Ei Over Course n Sus Geology and James oo Chemairy e Evolution GE 01 JH Hutton No continuous GeologyiMinaralogy 1 0 5 5 fm Comauter Science Scottish Spates F g fang L 02 JH ae No continuous GeologyiMineralogy 2 5 6 p TE Seminar 4 Sys Scottish it Haihamaties Limestone James f gt usics J amp Layers Fite SHH ution Mo Pornos Mace Too 3 o 55 FR Hi Piriac Trip h Rhetoric Typical montane a e a ZB fomationsin MF O4JH JAMES No ea a rin aeaa RE 0 55 JR iit SCAnstaion Dan England k i Sc thware Tras gl Central Evaluation t ssion selected Assign mS Tree Structure C Generate Surveys Display Surveys ki Delete Surveys GS isirudors Optional Questions a Batch Events GF Osplay Courses Scheduled Tasks Figure 55 Display of a Subunit s Courses At the bottom of the table a function is available which allows you to re define the period link of one or more courses Figure 56 Redefine the Period Link of one or more Courses Select either an individual course by ticking the checkbox on t
394. icipants Password Based Online Survey Each PSWD based online survey can subsequently be converted into a password based online survey The precondition for this is that there are no online survey responses and that the function of the online password based survey is activated in the Class Climate settings System Settings Class Climate Settings Survey Online Allow password based online surveys Central Evaluation To convert a PSWD based to a password based online survey click on the name of the PSWD based survey to open the details In the area Actions click on the option Con vert survey to password based survey Scantron Corporation 167 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model h Class Clim COURSE EVALUATION mate SYSTEM Show PSWDs in browser 3 Receive PSWDs by email __ Send PSWDs by email to respondents J Download PSWDs in CSV File Generate more PSWDs 0 Number of peters for EREA response rate Preview online survey Scheduled Tasks Finish Data Collection Close Survey 38 Delete Surve gt Convert survey to password based survey a Assign survey to substitute instructor Figure 153 Convert Survey to Password based Survey The PSWD based online survey will now be converted into a password based online sur vey You will see a warning message that this operation cannot be undone Confirm the message with Yes Q Change
395. icipants in the header of the questionnaire This is achieved by placeholders recognized by the continuous upper case and the angular brackets The VividForms Editor Designer allows you to use placeholders for participant data in the header of the questionnaire The placeholder names refer to the data structure intro duced above as follows 190 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli FEEDBACK SYSTEM thy AN Class CI imate Phase 2 Implementation of Surveys iii mail address mail address of survey participan itle of Survey participant NAIWV irst name irst name of survey participant ATION alutation alutation of survey participant oes ee re PARTICIPANT_CUSTOM1 Blank rst user defined field of resp survey par E ticipant econd user defined field of resp survey PARTICIPANT_CUSTOM2 Blank2 an PARTICIPANT_CUSTOM3 Blank3 ira user defined field of resp survey par 7 ticipant Table 11 VividForms Placeholders Click one of the placeholder fields in the questionnaire s header in order to select the placeholders which you wish to insert The following figure shows an example questionnaire header In the left hand side the text Participant has been inserted as well as variables for the first name and surname Class Climate Course Evaluation Questionnaire Participant PARTICIPANT_FIRSTNAME PARTICIPANT_LASTNAME Course AUTHOR SURVEY Mark as shown OMOOO MARK Correct
396. ies SCANTRON 2011 06 Class Climate COURSE EVALUATION FEEDBACK SYSTEM User Guide v5 0 Copyright Electric Paper GmbH Subject to change without notice Class Climate COURSE EVALUATION FEEDBACK SYSTEM Table of Contents Overview A PREPARATION AND GENERAL NOTEG 2 2 cceccceecceeeeenseeeeenseeenseenseeaseenseeuaseuaseensennssenssenseenes 11 1 IRODUC TIONG setuesitendacttaasaes ances das AAE EARE E AEAEE E EENAA EAA EEE 11 Ze TAE ASICS oana A E E O E E E E E EAT 16 3 SYSTEM START UP AND SECURITY ceeccisacsicsicwstaaicntaseleauctisienctn nuns jonineiceiciimmineiuncinediawndindvmecandemaniekisamcieieaicindammstltontions 26 B YOUR EVALUATION PROCESS THE PHASE MODEL nnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnne 37 1 THE PHASE MODEL YOUR WORKFLOW IN THE PROCESS OF EVALUATION ccceceseceeceseeeeeeeeeeees 37 2 PHASE 1 PREPARATION OF A SURVEY PERIOD cccececeecececeececeeeeeeceeeeeeceseeeeseseeeeueeeeaeneseeeeneneeenes 39 3 PHASE 2 IMPLEMENTATION OF SURVEYS ccccececeecececeececeeeececeeeeeeeeeeeeeeeseeaeeeseeaeeeseeeeaeeeseeneseeeeeens 107 4 PHASE 3 CAPTURE AND INSTANT FEEDBACK cccecececcececeececececeececeeeeeeeeeaeaeeeeeeaeeeeanaeeeneeeeaesenans 205 5 PHASE 4 ADVANCED REPORTING ccccececececececececeeeeeecececeeeeeueeeuavaueeeeceeeeeeeeeeevevaeaeeeeeneeeeenevenenenaes 256 6 PHASE 5 QUALITY MANAGEMENT sccicscassisacccscsasacseniciems ecu vcaiadisacacari
397. igure 363 Report Creator Profile Line Emails Additional recipients e Download of the profile lines zipped Corresponds to the version just described with the difference that here you can download a zipped file Thus you download except for the first option a document containing the profile lines of all selected courses Compare the course Organization and Management with the subunit report Prof Development WS10 11 Here the course Organization and Management instructor Carlos Hernandez is selected from the list of courses and as the first comparison line Prof Development WS10 11 the name of the subunit report 5 Courses Reports Management Strategies NA_2 Managing and maintaining a healthy lifestyle NA_1 Organization and Management 02 P1236 Report Creator train_01 train_en train_en train_en train_en_1 train_en Belmore WS 10 11 train_en First Comparison Line Prof Development WS10 11 train_en Second Comparison Line Deactivated Please Choose a Selection Figure 364 Report Creator Selection of Profile Line and Comparison Line When you download with this selection the batch the following profile line appears 316 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Carlos Hernandez Organization and Management Subunit Professional Development T Name of the instructor Carlos Hem
398. ih pie Send Emai Handwniting recognition Licensed Sen Configuration A Utecation Statestic ViidF orma Designer Licenses Hot Licensed GD Son Curent Users 2 cuss Chmate Setings Q System Summary Scanstation licenses 4 a Geine Tree Strochane uarlicaneas Premium License si anrai BF 7 5 l Caniral Evaluation we Logged i gt Course types Maintenance Assign io subunils Onine Surveys teeta ee I i me Tre Shudu d i Perods TF Lense fia Generale Survey GS custom Thies i Send Emal te Support License key o Diapay Surveys Process Dotaut amp system Cuang J Delete Sure hab Service Setting 5 Stat aj A Surveys cj Vieb Service satinga dl Sy aia to Customer name B mstroctor s Optional 4a Lonmguege Seta cr Email Cue Batch Everts Profiles Documentation respite tat oF Dapy Courses x Sane a zs E My Profs W Mima gt Scheduled Taska 0 i Adminisirators E Same Fes Cate moor F 3 3 x fy Cypanizater HN About Cims Cirrate Scanstation licenses fake i Figure 30 Administrator Account The data fields of the administrator profile can be edited in System Settings My profile Here the personal data of the administrator such as salutation title etc can be set The email address is particularly important because Class Climate users send their inquiries by email to the administrator In addition the administrator can change his password login name and password and if desired take on additional user roles Wit
399. ile line appears in addition to the profile line of the current course Profile Subunit Professional Development ji Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies Name of the survey I Overall average of Management Strategies Organization and Management The lead time of the course is adequate Strongly dis Strongly agree av 3 5 agree av 3 6 The course focuses on the current professional discussion Strongly dis strongly agree av 2 8 agree av The course perfectly prepares me for my professional life Strongly dis Strongly agree av 3 8 agree a 3 3 Please grade the course altogether failure very good mused aVv Figure 372 Report Creator Profile Line Emails Options Comparative line deactivated with the Overall Average 322 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Anonymizing Comparative Lines With the comparison of several events reports to each other it is possible for data protec tion reasons to anonymize the names of all comparative lines So the instructor to whose course it relates only sees the name of his course the rest is anonymized Comparative line Course1 Comparative line Report 1 Prof Dr Philipp Belmore Managing and maintaining a healthy lifestyle Subunit Professional Development T Name of the instructor Prof Dr Philipp Belmore Name of the cours
400. ill be shown as a traffic light symbol in the PDF report Please note that indices will only be shown for items used in quality guidelines e Show standard deviation as number Activates the display of the standard deviation e Show average median You can display the following values in the PDF report 1 Average value 2 Median 3 Average value and median Scantron Corporation 243 Copyright Electric Paper GmbH l 8 Your Evaluation Process The Phase Model Class Climate 244 Show quantile You can display the following quantiles in the PDF report 1 No quantile 2 10 quantile levels Decile 3 25 quantile levels Quartile Show standard deviation in graph Show the standard deviation in the graph of scalar questions Show scale divisions for bar diagrams Activates the display of the export values for response options as scale under the graphic report bar Show notice for suppressed report Activates the display of a notice instead of the question summary when the minimum response is not reached The content of the text can be changed in the text templates Action PDF Report Text for too little response If deactivated the respective ques tion does not appear in the report Font size question texts Font size of texts in the PDF reports Font size pole texts Font size of pole texts in PDF reports Font size for numerical data Font size for average av standard deviation s and frequency n in the PDF repor
401. imat 7 4 Characteristics of the Aggregated Questionnaire When generating a survey the questionnaires for the different module parts are automat ically merged to a complete module questionnaire The complete questionnaire adheres to the following rules e The single parts are put together in ascending order with reference to the course ID e fa module part has no course ID it will be the first part of the module questionnaire e f more than one module parts have no course ID the creation dates of the module parts define their order on the module questionnaire The first questionnaire used for the module questionnaire defines e Font type e Default font size e Line height Exception If the font size of a question group of one of the questionnaire parts is bigger than the line height of the first questionnaire the line height will be accordingly adapted for the whole questionnaire e Layout traditional or optimized e Position of the answer options of single choice questions e Color scheme e Display of question numbering Placeholders e Entries for the placeholder AUTHOR and COURSE are deleted e The standard placeholders are reactivated lf the following characteristics apply to all questionnaire parts they also apply to the questionnaire in total e Enable temporary save e Evaluation for participants Allow result access Display answers to open questions e Show print option e Show certificate of participation Furt
402. imate e g Send PSWD to respondent or Send report to instructor can be provided with its own email attachment For example an instructor could receive along with his PDF report a document with the evaluation requirements Under the heading Documents for Email Attachments you can find all related files Email attachments can be created in any file type so please remember that recipients may have trouble opening uncommon file formats More about assigning documents to specific email types can be found in the section Text Templates Customized letter templates PDF templates can be entered for the various PDF report types e g Report to Instructor or Summary Report to Dean The template layouts can be designed so that they meet any corporate identity require ments As the name says the templates must be in PDF format or converted into this for mat Scantron Corporation 499 Copyright Electric Paper GmbH AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM System Settings and Management 2 2 2 PDF Templates Evaluation Results To GENDER TITLE SURNAME IPersonal and Confiden gam Figure 605 PDF Template Acrobat Professional View The templates in Class Climate are filled with data from the Class Climate system when the reports are generated In order to do this certain fields are necessary on the PDF A full version of Adobe Acrobat V5 0 and higher is necessary
403. in 2 Questions about the instructor Adans bra bor The instructor is always well prepared Instruments The instructors explains even complex topics in a comprehensible way Ej Text Temples ED Documents The instructor handles the technical equipment GS Report Settings video projector etc without any problems Please grade the instructor for this course poor very good abet Configuration I Class Cimate Settings Please give us your feedback about the instructor as well as suggestions for improvement 6 Define Tree Structure g Course Types UT Periods 2 DA Custom Tities E Process Defaults General Settings Colors Navigation Question Types Leal Web Service Settings a Screen background color A anguage Sets ree FFFFFF I i This color will be used as the screen s background color Profiles Logo background color G ity Protte FFFFFF e This color will be used as the logo s background color i Adminisirators Figure 6 Color Setting of Online Templates 20 Scantron Corporation Copyright Electric Paper GmbH Class Climate eases COURSE EVALUATION FEEDBACK SYSTEM It is also possible to set a high contrast color scheme for the administration interface Fh Class Climate Subunits Ouesthonnaires AT eT CGT TLE DE System Information Search amas f i i aS Le i We Class Climate Setting Color Settings Advanced Class Climate A
404. ination of all Male Interviewees with main subject Busi ness Studies In this example you wanted to consolidate all male students with the main subject Busi ness Studies in your subgroup report This means that both conditions must be met at the same time i e the student is male AND he studies Business For this reason both of the selected criteria are connected with the logical operator And for computer scientists amongst you you can select the Booleschen operators here On the other hand if you want to create a subgroup report containing the results of all interviewees who are either male OR studying Business select here the Or operator Your subgroup report would then contain the results of all male students as well as the results of all other students who have the main subject Business Studies This means that this subgroup report also contains the results of female students who study Busi ness Scantron Corporation 303 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Default criteria combination Which gender do you belong to Main subject Figure 341 Report Creator Two Criteria with the Operator Or Finally as you are accustomed allocate a descriptive name decide for or against includ ing open questions in the subgroup report and click on the Create button The subgroup report now appea
405. indicators at the beginning of the questionnaire The other display options which are presented in the following are not affected by it In the configuration you can also find some further settings which influence the display of the indicators in the PDF report System Settings Report Settings Configuration 260 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM a thy AN Class CI mate Phase 4 Advanced Reporting e The setting Create profile Line for indicators some lines above Calculate indica tors subsequently adds to the usual profile line for individual questions a profile line for the indicators defined in the questionnaire av 5 1 2 Questions about the instructor 7 e a a EE 3 Questions about the course av 25 2 4 Questions about the teaching material av 5 4 5 Questions about the studying conditions i Figure 270 Indicators Profile Line in the PDF Report Here you see the profile line for the three indicators Evaluation of the instructor Evaluation of the course and Overall rating e In addition to the display of the indicators that you chose you can add the global indi cator of the survey Deactivate the setting Hide global indicator in the configuration In addition to the other indicators the global indicator is displayed at the beginning of the report Overall indicators ka
406. indow When an element of a higher level is selected all elements on the levels below are automatically selected too m Professional Development v G Economics si v Central Campus v Philipp Belmore w Carlos Hemandez v Media amp information Center Engineering Figure 113 Tree Structure Selecting the Levels By clicking on the level name in the header of the list all elements of a level can be dis played or hidden A Subunits Engineering 5 Professional Developmant _Data Entry Demo Subunit _Verifier Demo Subunit _ Engineering _ S Economics it _ M Engineering Jm Comuter Scan A Enpneenng Program of Study Location bh Economics _ Technical School Subunits A Media amp information _ C Engineering Engineering _ Economics FV Technical School Peter Huddle Figure 114 Tree Structure Opening and Closing Levels Scantron Corporation 131 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Display Surveys To display surveys in the tree structure select the option Display Surveys in the actions panel On the left side select the levels to be displayed in the view of the surveys you require by checking the appropriate boxes Then select the desired survey periods and questionnair
407. ing In addition to this surveys can be generated displayed and evaluated and raw data exported 54 Scantron Corporation Copyright Electric Paper GmbH thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM Phase 1 Preparation of a Survey Period i n Lids ulimate Subunit Questionnaires System Sottings System information Search ait fi AT haat dhi DAREI APLDAN PNEC OT a Class Climate subunits DihreSonngines System satinga System Information SEE ene Cuba tne riino agite i k 2 z uf Liss Climate Admin Ba ta ran FE M E i 3 ar H yy Class Climate Subunits Questionnaires System Settings System Information e th They art A TIF ki AEBHE tidikaiipi Nipaa ia i AAi creta Fmniaa niaaa mma Pens Subunits Guestionnaires System Settings syaitan imfonmation Sear Ajminatrator EROA Glass Climate Admun Subunits Sdmanetestor bal tan vr License Management ih Class Climate Admin ee Questionnaires An c LERRA Adereniatrazer i in r te J Gogstonnare Lai 1 hc 3 uestionnare fe re Gradis Class Climate h Eco Ed Create Questionnaire Class Climate Admin Central Evaluation h cae E Guesten utes iid china Aderinestrator y r a E I Lin 5 Text Templates Version V5 0 ine F q Ar tini T Documents Database MySQL localhost Ar 7 nino st wie Ub Report Settings Information Papar surarys Licensed rf ar Pry roih gt Search Online Surveys Licensed
408. ing to specific criteria was explained How to summarize these compiled reports again or evaluate the reports according to different criteria is the topic of the following chapter For these two needs mentioned the combining as well as the taking apart of existing reports there are two options in the details of a report Just a small reminder You will find the details of a report by clicking on the name of this report in the report list Combining Reports First of all the combinations are dealt with here This option enables you to summarize several created reports If you go to the details of a created report you see at the bottom right the second to last point Merge evaluations 296 Scantron Corporation Copyright Electric Paper GmbH gt Class Climate COURSE EVALUATION FEEDBACK SYSTEM tm Results in HTML format Results in PDF format individual Report 7 Engish Show Ema E Raw data in SPSS format Raw data in CSV format S Profile Line l Show Automatic Manual W Kiviat diagram 4 Merge evaluations Evaluate subgroup Phase 4 Advanced Reporting Figure 327 Report Creator Report Details Merge Evaluations lf you wish to summarize several reports click on this option A new window appears in which you can mark all reports that you wish to combine with the current report In this fig ure two instructor profiles are united in one report o
409. ing only Instructor s Optional Questions forms Figure 61 Menu Questionnaires List of all Questionnaires Scantron Corporation 85 Copyright Electric Paper GmbH a l a Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM The Administrator can if required allow all the questionnaires of the Subunit Administra tors to be displayed For this the option Show all questionnaires of the Subunit Adminis trators is activated Deactivated questionnaires can be displayed by activating the option Show deactivated questionnaires at the end of the listing including module questionnaires Activated forms are available for creating new surveys while deactivated ones are not In the column Engine you can see an information if the form is a VividForms Editor or a VividForms Designer form In the column Action a questionnaire can be edited copied and deleted depending on the Engine If the option Edit is selected the editor opens to revise the questionnaire Protected questionnaires which should be changed for future surveys can therefore be copied When copying a questionnaire the user can decide which features of the ques tionnaire beyond the standard features questions free texts formatting etc should be copied 86 Scantron Corporation Copyright Electric Paper GmbH thy Class CI imate Phase 1 Preparation of a Survey Period COURSE ss
410. ing to the date for 10 010 mat configured in Class Climate Table 9 Placeholder Scantron Corporation 179 Copyright Electric Paper GmbH Special characters are filtered out of the filenames and spaces are replaced by under scores When defining the naming conventions the following characters and special characters may be used e All letters and numbers e Round brackets Parenthesis e Square brackets e Hyphen e Comma e Period or full stop dot e Equals sign e Underscore _ Send PDF Reports You can determine that an instructor receives all evaluations of his courses accumulated in one email To do this please activate the option Reports of all courses of an instructor collected in one email Should this not be the case the instructor will receive a separate email for each course Please observe the defined maximum size for email attachments System Settings Class Climate Settings Network Settings Maximum document size In System Settings Text Templates the relevant email text can be edited E MAIL Results of a survey and E MAIL Results of a survey Summary Sending PDF Reports as Instructor Profiles You can send your instructor profile for surveys that have already been evaluated as a batch email By activating the option Include courses with secondary instructors in instructor profiles courses with additional report recipients are also included
411. ings Configuration Create maxi histogram Scantron Corporation 235 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Cross Tabulations x What is your age y The technical equipment of the university is excellent 1 18 29 2 30 39 3 40 49 1 strongly disagree 2 3 4 50 59 4 5 6 60 69 6 Older than 69 strongly agree Figure 250 PDF Report Cross Tabulations Scaled as well as single choice 1 of n questions can be correlated and put into cross tabulations The creation of cross tabulations can be activated in the Editor Control of a questionnaire under Form Properties Filters Validation Cross Tabulations Required Questions In order to activate the creation of cross tabulations use the function System Settings Report Settings Configuration Create cross tabulation Profile Line Profile Subunit Professional Development Name of the instructor Carlos Hernandez Name of the course Graduate Survey 2011 Name of the survey n What is the grade of your last school graduation 1 Grades 1 01 5 av 17 to 5 0 ee n 6 The instructor is always well prepared a x av 5 n The instructor explains even complex topics in a comprehensible way a av 5 n The instructor handles the technical equipment video projector etc without any i aw 4 7 problems n Piease grade the instructor for this course per
412. inology used in Class Climate 2 1 Structure of the Class Climate System Class Climate consists of four resp five with the VividForms Designer components e the web server e the data base e the scanstation or several scanstations and e the VividForms Reader e optionally the form creation software VividForms Designer The single components bear the following functions Web Server Class Climate Interface Class Climate is controlled via the web server providing users with the user interface which is accessed via the web browser For data transfer Class Climate offers two different access methods e aregular unsecured connection via the http protocol and e an additional optionally usable secure connection via SSL SSL stands for Secure Socket Layer and offers administrators the ability if desired to securely encrypt any data traffic from Class Climate SSL connections are most easily recognized by https instead of the usual http in the browser s address bar Usually current browsers graphically indicate the presence of a secure connec tion The number of users is only limited by the number of user accounts Participants of online surveys can also communicate with the Class Climate server via an encrypted connection Email messages to the respective recipients are sent via your local mail server 16 Scantron Corporation Copyright Electric Paper GmbH X Class Climate
413. instructor account Defines the maximum number of participants in an online survey instructor accounts only This value is theoretically unlimited but should be limited to an acceptable size for the organization Default value is 1000 Default value PSWD number per survey in active account This number will be used as a default value for the number of participants of a survey in active accounts Server address for online evaluations This address is used on the PSWD cards and in the PSWD emails Instruction text for PSWD cards Defines the instruction text on the PSWD cards for online surveys Standard text This PSWD allows you to participate in an online survey Please use a web browser to open the following web address 510 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Default value PSWD number per survey central evaluation Online surveys created in central evaluation use as the number of participants the depos ited number in the details of a course If this number is missing then the value defined in this constant is used Format PSWD Document Different formats are available for the PSWD document 1 3x8 PSWDs per page A4 2 2x PSWDs per page A4 3 3x7 PSWDs per page A4 4 3x6 PSWDs per page Letter The standard setting is the original format of 3x6 PSWDs Letter Design Template for Online Surveys File wit
414. into HTML line breaks before sending Scantron Corporation 495 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 1 7 The PDF Report Header The contents of the PDF report header can also be defined in the text templates Editing of text templates Action Norming PDF report Letter a PDF REPORT Format of the instructor name PDF REPORT Header line right upper corner POF Heport Header PDF Report Text for too little response profile line PDF Report Text for too little response scaled questions PDF Certificate of participation for online surveys POF Report Report Header Report Creator Language English Higher Education w Mail text lt center gt lt font size 14 gt TIILE FIRSTNAME SURNAME lt font gt lt font size 3 gt lt font gt lt font size 9 gt SURVEY COURSEID No of responses FORMCOUNT lt font gt lt center gt Save Figure 600 Text Template for the PDF Report Header In the text field the header content is defined by HTML formatting and placeholders The example shown here produces the following PDF report header Prof Dr Smith gt History of liberalism HL 02 AS thy No of responses 9 Figure 601 Sample PDF Report Header You could for example insert a line containing the static text Result of student survey in the example in font size 8
415. ion After authentification of the instructor he can click on the link Central Evaluation Report and then receive the same view as the passive instructor After selecting the period he can download the reports from the survey Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM E m a A I Class Climate Business Studies i ie panipi CM EE miiia Mi Requesting central evaluation reports Survey Period s r 5508 Adam Smith WS08 09 a PAra S509 Reload wso0s 10 Surveys g Folkers GJ Surveys 2011 naa Survey Status Form Created a Forms Request Additional Reports Class Climate PC 2 introduction into macroeconomics E Data available train_01 06 12 2008 4 PDF A Class Cimale Pi History of liberalism id Data entry train_01 04 08 2009 9 a Questionnaires POF __ Figure 266 Download of Reports by Active Instructors In order for the instructor to receive a message that he can download new reports the automatic dispatch of emails should be activated after scanning At the same time the dispatch of the PDF reports or CSV data must be deactivated at Class Climate Settings Email Functions amp Accounts The email text E MAIL Report for Survey can be modified and for example describe how the instructor should login to the system The settings for email delivery do not only affect the automatic email dispatch but
416. ion Copyright Electric Paper GmbH a E AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM i Logo Assistant Insert logo Use standard logo subunit logo Use own logo Sample_red ba Position in questionnaire header Left Sample 4 Right Vertical alignment Top Middle Bottom Scale of the box width in outer third of the header 100 Figure 472 Adjusting the Logo The following illustrations give an example of a questionnaire header expanded to three lines with adjusted placeholders and custom logo in the editor view as well as in a PDF Questionnaire on Technical Skills ORGANIZATION Example City University AUTHOR SURVEY PERIOD Figure 473 Adjusted Form Header Editor View Class Climate Questionnaire on Technical Skills a a ah Example University Prof Dr Adam Smith Introduction into macroeconomics 5511 mple City xa Unive ty Figure 474 Adjusted Form Header PDF Scantron Corporation 403 Copyright Electric Paper GmbH Creating Questionnaires with VividForms Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 5 Adding and Editing Question Groups Question groups unite questions that are thematically similar under a general heading so that for example indicators can be calculated w Question group Wizard New question group Page 1 Title
417. ion OBORO CORRECTION Figure 182 Customization of a Questionnaire here through the Name in the Header In the case of a survey data of specific participants is inserted here so that during imple mentation it is clearly visible which questionnaire was distributed to whom Scantron Corporation 191 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Implementing a Non anonymous Paper Survey When you create a survey with a customized questionnaire for a course for which partici pant data was imported Class Climate assumes that it is a non anonymous survey Therefore for paper surveys each questionnaire has to be personalized for example the participant s name has to appear in header This is why the cover sheet procedure is not suitable for non anonymous surveys However you can also use the function Print Cover sheets Forms in batch procedures so as to produce personalized PDF questionnaires for all survey participants To do this select in the configuration of the batch procedures the option Create complete sets of questionnaires according to enrollment figures After a click on Download the respec tive PDF file is produced and displayed Please note that the number of generated ques tionnaires is determined by the number of occupancies defined in the courses and not by the number of imported participant data for the respective c
418. ion and the handling of surveys in the central evaluation 3 2 1 Generating Surveys With this function you can generate any number of surveys You must only make sure that the questionnaires you need exist have been tested and are set for use For creating questionnaires please consult chapter C C Creating Questionnaires with VividForms ia Generate Surveys 1 Subunit 2 Survey Period 3 Course Type 4 Questionnaire Business Studies a WS11 12 a a Norm_low A Chemistry Ss Samplt Computer Science WS10 11 Economics 510 Sample_01 Linguistics wsog 10 Subunit Mathematics 509 Tech_01 J Musics WS08 09 train_01 Physics 5508 train_2 e wS07 08 vi train_en_3 bi _ Select program of study 5 Course s Esmeralda Parker Basics of Economics introduction into Economics Paper survey Hard Copy Procedure _ Cover Sheet Procedure v Web Verification Online Online Survey Use Time Control Generate Surveys Figure 82 Generating Surveys The setting which questionnaire can be used for which course is done at Questionnaires Questionnaire List Details You can define here which questionnaire should be used for which subunit course type and period After clicking on Generate Surveys the screen above will appear Now you must in succession in each field select one or a number of options Depending on what you have chosen and t
419. ionally to a program of study So you could for example assign courses of the departments of chemistry and physics additional to the program of study nuclear physics To create a program of study report choose the option Program of Study from the drop down list and click the button Next Create reports Reports L oo Comparisons Batch Profile Lines Next Figure 308 Report Creator Creating a Program of Study Report 284 Scantron Corporation Copyright Electric Paper GmbH lass Climate Choose the program of study the period the course type as well as the questionnaire in the window that appears Also the usual options questionnaire comparison display of open questions creation of an unweighted report are available to you Create Program of Study Report 1 Program of Study 2 Survey Period 3 Type 4 Questionnaire Computer Sciences S511 P Non_Anonym Economics o o Seminar Quest_01 Engineering 5510 social Sciences WS09 10 train_en_1 Psychology 5507 WSST 15506 15505 Template forms Description Economics WS10 11 Question mapping of different questionnaires Automatic with text comparison Manual L Include answers to open questions Combine surveys unweighted Please note For this combination the mean values of the single surveys are averaged Verity we Back Figure 309 Report Creator Program of Study Report Selection of El
420. ipants Default value if enrollment information is missing Human Resource Management 02 P1237 Leadership Development 02 P1234 Add senal number for automatic sorting Request Figure 161 Batch Events Selecting Courses for Printing Cover Sheets Forms By default the PDF document of a cover sheet survey only contains the cover sheet and not the questionnaire If you want the questionnaire to be produced as well activate the option Batch printing form printing when using the cover sheet procedure in the menu System Settings Class Climate Settings Functions Please be aware that this setting is only valid for printing cover sheets and forms and not for sending them lf you want to print your questionnaires double sided you can also activate the option Batch printing Duplex printing in the menu System Settings Class Climate Settings Functions Then the PDF document will contain blank pages which are necessary for double sided printing i e after a cover sheet or with questionnaires with an odd number of pages Surveys in hard copy procedure have the option to include all the questionnaires needed in the PDF document and to number them serially When each questionnaire has its own number then the consistency of each data set during scanning can be guaranteed This is especially important when your form has a number of pages Should the pages get mixed 174 Scantron Corporation Copyright Electric P
421. ires Question Library Different editing functions as well as functions for import and export are avail able here Also a print preview of all question groups and questions can be accessed Class C 1 Subunits hil COTELE TALAANGE FO Ee System Settings System Information eat fh fy Question Library Editing View of the Question Library Actions na ag fa Peter Grown Public Peter Brown College Evaluation Administrator cay f Course Evaluation E Instructor Evaluation Excellent Very Poor iseina S instructor Evaluation Poor Outstanding Group 8O J de r nstructor Evaluation Strongly Disagree Strongly Agree Question 74250 Quesionnare Let a Fc students who go to the instructor for help get the assistance they need LTA Wve sioniare Fa The instructor encourages students who are struggling to visit Gl Yueshon library i i The instructor has a comprehensive understanding of the subject The instructor is clearly an expert in this feld The instructor seems committed to helping students succeed The instructor willingly assists and helns the students This instructor has an encyclopedic knowledge of this subject This instructor knows this subject very well Curent Users i a ed a Print view Snow ft Online Surveys 0 DS Expor Epot Log Off 5 import Browse ___ Import Figure 77 Question Library Editing View In the editing view the current content of the questio
422. it Via the but ton Browse in the section Import instructors from CSV File you can select a CSV file which contains all instructors and courses you wish to import Click the button Import to upload the file GSusers in subunit Economics Select all L Move selected to Business Studies v Create New User SS A CrDocuments and SetingstAdr Browse Import instructors from CSW File CSV file contains a column with information whether the course has secondary instructors Figure 58 CSV Import of Structural Data After clicking the Import button a synchronisation view will be displayed CSV import Create new user or course Accept the changes in the CSV file Delete user or course Deleting a course means deleting all surveys too Archive user The user gets a new status and new results cannot be added to their surveys E RNG Change the evaluation period for all courses continuous TAE Instructor Mr Prof Dr Adam Smith user example com v Course Introduction to Economics ECS001 Lecture v i Economics Engineering 25 Evaluation period continuous Undefined values in course user data fields S23 Instructor Mrs Dr Erica Miller user example com v Course Legal Environments ECS002 Lecture iv ee l Economics 25 Evaluation period continuous Undefined values in course user data fields Figure 59 CSV Import Synchronization Overview 80 Scantron Corporation Copyri
423. it number is automatically incremented It can be adjusted if necessary 46 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 1 Preparation of a Survey Period If desired a separate online survey template can be defined for each subunit which defines the presentation of an online survey for the subunit For more information please see chapter B 3 2 7 Effective Management and Conduction of Online Surveys section Online Surveys Customization of the Used Layouts The visibility of a subunit can be limited for example to hide subunits containing only old survey data which should however remain in the system Thereby the clarity of the sys tem can be increased In the area Subunit visibility there is a choice of different display options Hidden Unre stricted Subunit Administrator only Report creator only As well as this it can also be determined whether the subunit regardless of the status should be displayed in the context menu on the left If a subunit is set as invisible it is also hidden in the subunit overview Via the option Show all subunits it can if desired be displayed C List of all Subunits 4 Subunit s not visible Edit Delete Subunit administrators th Business Studies a2 4 38 Elizabeth Doe th Chemistry 22 A 3 Andrew Bennett th Computer Science a2 A X Gina King Economics a2 Z 4 Ste
424. ith a globe You can create so called templates to customize online surveys to individual needs 3 1 4 Password Based Online Survey The password based online survey is an online survey with a pre established general password for all participants As opposed to the PSWD based online survey not every participant receives their own password This method is a comparably unsafe one because participants cannot be prevented from voting more than once in a survey with the same password On the other hand the password based process allows a survey to be conducted without precise knowledge of the group of participants i e without being able to invite participants personally The standard method for online surveys in central evaluation is by default the PSWD based method In order to perform a password based online survey this function must first be activated in the Class Climate settings menu System Settings Class Climate settings Survey Online Allow password based online surveys Central Evaluation Once activated standard PSWD based online surveys can be converted in password based ones To create a password based online survey see chapter B 3 2 7 Effective Management and Conduction of Online Surveys 110 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM 3 2 Central Evaluation In the chapter below you will learn about the generat
425. iversity in general Therefore we would le 1 ene COnAaTNesS band eirt heie pieri i MONEE you sch co ID IIM 01 A5 iC mate O teenie s i 4 1e s w ap E Te 5 W pinpin iE Cidar than amp Questionnaires ag Re heh gt OOOPORUGRG Form jtrain_en_2 mietalefelelalateler Gia 0607 2011 at 04 353 gs te G00 20717 at 04 35 35 pm 19 Da te IP O More man 4 Woks O Appied inicematcs Number of returns jue O Chemistry O kiomas Engineenng O Mathensatics AE Opis jail Gelo CI Gusiess inlormatcs e hiak D irdustiai Engineering an anajement p yea O mg E lt o ee a a oOooOdag oda oO aiki uU 0u 0 0 oO g E L m m J woona ap wii Od ji Priamar h pi Sn eee a eS ANS Aon pener 2 Questions about the course Figure 80 Cover Sheet Procedure The alternative would be to allow survey participants to enter in the name of the course on the questionnaire but this would involve significant amounts of correction in later pro cessing In addition it would at any rate be necessary to collect the returns simultane ously in order to set an end to collection so as that a report could be generated 3 1 2 Hard Copy Procedure The hard copy procedure involves identifying the questionnaire for every course The operation number is printed at the bottom of the page Additional information fields can be printed in the header of all the questionnaires Optional additional questions whose content can be determined by the instructors themsel
426. ized by the VividForms Reader and therefore provides a quick overview of the recognition process This option is available for paper based surveys 126 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli mat SYSTEM thy Class CI mate Phase 2 Implementation of Surveys 1 Questions about you Which gender do you belong to male female What is your age 18 29 30 39 C 40 49 L 50 59 C 60 69 O Older than 69 Figure 107 Show recognized Form Originals as PDF Maintenance In the area of maintenance you can change the survey ID as long as the changing of the survey ID in Settings Class Climate Settings Maintenance Is activated This can become necessary for example if you have distributed questionnaires in the self print process with a different incorrect survey ID To enable you to assign these com pleted questionnaires to your Survey anyway you must replace the ID of the existing sur vey with the survey ID of the questionnaires distributed To change the survey ID enter your chosen ID in the survey ID field and then click on change The new survey ID must consist of five characters The following window opens automatically oO Change Do you really want to change the survey ID Changing the survey ID results in the fact that questionnaires of this survey that have already been distributed can not longer be assigned to this survey Are you sure to continue Figure 108 Confirmation
427. justed according to your needs In the following chapters you will get an overview on how change the layout of the system and the relevant documents or where to find the relevant chapters in the manual 3 1 1 Logging into Class Climate Entry Points The Class Climate server offers users two entry points to login Put a link to the relevant entry point at an appropriate place on your university website 26 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli FEEDBACK SYSTEM E thy Class CI imate System Start up and Security Entry point for Instructors and Administrators lt Class Climate serveraddress gt indexeva php Version 5 0 ir F l User name Password OK Figure 10 Entry Point for Instructors and Administrators Portal for instructors and administrators User names and passwords are required When access is limited this page can be opened only from computers in the defined IP address domain for users Entry Point for Participants of an Online Survey lt Class Climate serveraddress gt indexstud php Version 5 0 iA r ai D OK Figure 11 Entry Point for Participants of an Online Survey Portal for voting in online surveys A PSWD is required Scantron Corporation 27 Copyright Electric Paper GmbH mate Preparation and GeneralNotes QD Class Climate 3 1 2 Login Security Showing a CAPTCHA Graphic Class Climate offers you the possibility of blendin
428. ke to integrate into your template You can also create several other folders here like for instance the folder images where you can save files specifically needed for your template To have Class Climate load your template zip the content of your folder Please note The ZIP file has to contain the content of the folder and not the folder itself Go to the menu System Settings Online Templates and upload the file You can then modify the template directly in the folder where it has been created in C Apache htdocs classcli mate data templates Please if you make modifications to the CSS file onlinesurvey css do not forget to remove the content of C Apache classclimate htdocs data tmp and to restart the system service memcached Server As a general concept the form is available as an object the methods of which will pro vide you with all information you need in order to choose the way you wish to display each element on the page Scantron Corporation 159 Copyright Electric Paper GmbH X Class Climate Here are some of the functions that you might regard as useful when starting to work with Class Climate advanced template editing You will find examples of other functions methods and classes used to get information about items you are editing and willing to modify in the files that are available in this folder pthis gt getValue returns the value of the current question very useful if you
429. king of questionnaires to course types 371 Module oso otice nous eee eee ere BO AES Sd 369 Evaluation of scanned questionnaire 208 Evaluation periods 0 000 cee eee 40 Evaluation process The Phase Model 0 0000 cece eee 37 Evaluation statistics a 0 0 00 e eee 470 CEN gw ieee bes Choe eed oe eee Fork a 335 Export Batch export esc cesaundade dee Guduwdu dee da 467 OAS 26454504 ban oe GEE Ee Oe Gee oe ee eee eS 513 Questionnaires nnana ouaaa eaa 457 F Filling Degrees CHECK EEEE E E E 216 Filter settings nnna anaana 91 447 Filtering of HTML Tags 00005 434 532 Class Climate COURSE EVALUATION FEEDBACK SYSTEM FONUSIZS occas bp ee va ey oes ah ee eae 433 FOULIVOC 2c ad 2art es anvace Ree Gansa EENES EEE 433 Form VIOW auauua aaaea eee 212 Forms of address 0 ccc eee ees 40 Free Indicator 0 0 0 cee ee eee 92 Free INGIGAION o nia e eon a bose teed ed eoe HE wee eds 265 Free Indicators 0 cee eee 265 PUMCHONS iagvetnecedaeseaeee dy ue ete ee ee ee 915 G Grade Value 0 ccc es 424 Graphical elements 000 eee eee 431 H Handwriting Recognition 000 00a 415 Segmentation 0 0 0 ee 415 Handwriting recognition 0 00 eee 218 Handwritten comments 000 0 eee 219 Hard copy procedure 00 e ee eee 108 Header PDF report header
430. l _ Send PSWDs by email to respondents 3 Download PSWDs in CSV File Generate more PSWDs 0 Number of participants for calculating response rate Preview online survey Scheduled Tasks Finish Data Collection Close Survey amp Restore Survey 2 Delete Survey a Edit answers t to open questions i Edit Show notes Figure 98 Survey Details Assign this Survey to a Substitute In the following dialogue you can select the subunit as well as a substitute from the list of instructors Select substitute instructor Human Resource Management Please select a subunit Please select a substitute instructor Send PDF report Computer Sciences a Dr Richelle White a iv Economics Philipp Belmore Engineering Conna Harwood Professional Development Scanstation Demo Subuni fi _Data Entry Demo Subunit _oystemiogins _Verifier Demo Subunit _VividForms Demos Next Canca Figure 99 Select Substitute Instructor The checkbox Send PDF report permits the dispatch of PDF reports to the substitute instructors again To continue click on Next The survey will then be assigned to a substitute instructor and is then no longer existent for the original instructor If there is only one survey for the course that is to be moved Class Climate will ask whether the associated course is to be moved as well Scantron Corporation 123 Copyright Electric Paper GmbH
431. l pole labels which can be generated separately W Question Wizard Define Options Abstention activated Checkboxes 4 OO00 0 70 o M Individualize pole labels sine a Right Pole Sewage O Disagree Type of Diagram Histogram Use these settings as default for scaled questions Set this scaled question as mirrored question Combine to dual scale with previous question 7 Apply settings to all other scaled questions l i Define settings fi Back Next Apply Cancel Figure 485 Scaled Question Individualize Pole Labels A choice of diagram types to be used in the report is available at the bottom Note Experts may edit the appearance of the report graphics by editing the file lib jograph php in the Class Climate email folder Contact your support representative to receive the necessary unencrypted file Information on further options when creating a scaled question can be found in the follow ing sections Click on Apply The scaled question will now appear in the preview and will be automatically highlighted got access to the technical resources very Stony O O O O O DO Strongly O N A quickly Agree Disagree Figure 486 Scaled Question in the Editor Preview Use these settings as default for scaled questions If you would like to apply the settings of the created scaled question abstention check boxes pole texts chart type etc for all further scaled q
432. l questions contained therein are also deleted lf you want to create a new question or question group click on the corresponding icon in the category Group or Question The wizard opens with which you can undertake the required settings Finally click on Apply The group or question is now displayed in the library Please observe that the new question is always created in the library group which is currently marked Rights Structure The administrator as well as subunit administrators and active users Instructors Deans all have access to the question library administration Each user can maintain their own library and add edit and delete questions and question groups at will However depend ing on the user role access and editing rights differ for the libraries of other users The fol lowing table to be read from left to right is intended to clarify the rights structure of the differing user roles 104 Scantron Corporation Copyright Electric Paper GmbH thy AN Class CI mate Phase 1 Preparation of a Survey Period COURSE 3S oN mat SYSTEM Question Libraries User Administrator Subunit Administrator Active User Data Access yublic non public ic non public non public Administrator poxo fT xo xo Subunit Admin own subunit x Tx public fothersubunit x Subunit Admin own subunit x J Jo s fo oe o non public other subunit x o y Active fownsubunt x user fotnersubunt x Te Legend x
433. l selected courses These emails contain a link to the webpage of Instructor s Optional Questions Such an email could read as follows Dear Mr Example The Instructor s Optional Questions has been activated for you You can enter questions for the survey or course Time Management by clicking on the link given below Alterna tively you can copy the complete link and enter it into the address line of your Internet browser Link http localhost classclimate mask php mode show amp tan C7XES Your Class Climate Administrator o SOS After clicking on the link the Instructor s Optional Questions a new window appears where the instructor can change some settings concerning the course At the top the instructor can supplement or if necessary correct information concerning the course Scantron Corporation 171 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate Use of a VividForms Questionnaire When using a VividForms questionnaire the recipient will receive a template with options to extend the existing questionnaire using the VividForms Editor The administrator can limit the size of the questionnaire by defining a maximum number of pages when creating the form template e Remind The instructor is reminded of the Instructor s Optional Questions Again the link is entered in the email Optionally the dispatch of emails can be prevented by activating the option No email s
434. lation Activates the display of cross tabulations in the PDF report They are defined in the details of a questionnaire Advanced Settings Cross tabulation e Create presentation template Once the indicators for a questionnaire have been defined they can be displayed together with a short descriptive text at the end of a PDF report as a presentation tem plate The presentation slide can serve as a discussion aid to discuss the results with the course participants e Show notes in the PDF Report This option activates the display of survey notes in the PDF report For example the notes of a survey of the Instructor the dean or the administrator are displayed in the PDF report e Left Right Top Bottom margin Left Right Top Bottom margin for all pages on the PDF report e Show internal question number Shows the internal question numbers e Relative values The PDF reports show the distribution of the responses to closed questions with rela tive activated or absolute deactivated values e Minimum percentage for display Defines the minimum percentage response frequency to a question in relation to the total number of returns needed in order to display the question in the HTML PDF report For example with 50 returns the value is set at 20 As a result only analyses of questions that have been answered by at least 10 persons will be shown If the value is set to 0 all questions of the reports will be displaye
435. le that is the linking of a quality to an importance scaled question is marked by a yellow bracket The technical equipment is excellent OO OF OF O O O poor The technical equipment is important O O O O O O notimportant Figure 488 The Marking of Scaled Questions in the VividForms Editor Dual Scale Display in the PDF Report In the menu System Settings Report Settings you can change the configuration settings for every PDF report by clicking on the icon in the column Configuration With the con figuration setting Dual scale profile line you can activate the display of the dual scale in the PDF report By selecting 0 the display of the dual scale is deactivated By selecting 1 you define that the critical values appear on the left side of the scale with 2 the crit ical values appear on the right side of the scale The critical values are calculated by subtracting the result of the quality question a from the result of the importance question b On a 6 point scale the values range between 5 and 5 Values of 1 to 5 are considered critical as soon as the positive pole agree Scantron Corporation 411 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM very important in the questionnaire appears on the left side Values from 1 to 5 are considered critical as soon as the positive pole agree ver
436. le criteria 005 300 SUDURIS wAstcerectadewuciasiuesecdeaseen e4es 46 CSV IMPOM aes ceoe ae tek we Cabo e dade eet ee ences 77 Visibility aaa aaa aaa ee nee 47 Summary reports 0 0 0 ee ee ee 279 Support 0 ee ees 14 Support area eee 14 Support department 0 0 ees 14 535 SUMGY 2442454855 65856508 se okk enon eee bee ee 508 Delete Tree cece 135 Delete Survey 0 ccc eee 128 Display Tree 0 2 0 ees 132 Display Survey 0 0 c eee 113 Generate Tree 0 0 cee ee 133 Generating SurveyS 00 eee 111 202 Generation of module surveys 378 Implementation 0 0 0 0 e eee eee 107 NON ANONYMOUS esasa saaa aaea ee 188 Non anonymous surveyS 0000e eee 181 Paper survey 00 ce ee eee 136 Survey period 0 00 cece ees 39 Survey procedureS 0 0 ee ees 107 Survey VIOW 0 cee ee eee ee 211 Survey details 0 00 es 117 Surveys Anonymous SurveyS 000 eee eee 71 Non anonymous SurveyS 000e ee eeee 70 System Performance 0000 c eee eee eee ees 476 Security 2 ee es 26 28 PaSSWOI act d 4 iiem EE EREE E cad wae os 29 System cleaning 0 000 c eee eee eee 480 System information 000 c eee eee 471 System management 00 eee eeee 461 System settingS 0 00 cc eee eee 461 System start up 0 1
437. lectric Paper GmbH Class Climate e Selection of procedure e Hard copy procedure e Cover sheet procedure e Online survey and number of PSWDs e Open online surveys with semi public password The survey is then In Progress The questionnaire and the PSWD document can be downloaded and printed or distributed The batch mailing of emails to online survey par ticipants is also possible 3 3 6 Working with the Active Instructor s Data lf data already exists for a survey of an active instructor he just like the report creator does with his reports can create the survey subgroup reports This means that single reports for example one report each on male and female students are created for the individual options single choice multiple choice or scaled questions These types of sin gle reports are also known as filtering The survey does not have to be closed when the subgroup reports are created meaning that more data can yet be captured In this case the subgroup reports of an active instructor can be updated automatically unlike those of the report creator An active instructor can decide whether he wants to create a dynamic subgroup Dynamic sub group reports are updated automatically upon receipt of new data This way repeating the creation of subgroups is prevented This function is particularly interesting when long term surveys are running and if over the course of the survey one wishes to follow up
438. licenses If necessary a license can be revoked by clicking the icon with the yellow brush In the bottom section of the license management a list of all licensed scanstations depending on the license and activation one or more scanstations are listed As an administrator you can activate the option Automatically assign a license to next request ing Scanstation By doing so the next scanstation to log on to the Class Climate server is automatically issued a license Needless to say automatic activation can only take place as long as a license is available Once the scanstation is activated the option is automatically deactivated This means that as an administrator you can control the point in time at which a scanstation can automatically activate itself As a default this option is deactivated 1 8 2 Administrating User Accounts The number of available user accounts for each subunit can be freely determined by the administrator and as such be limited This possibility exists for the User License Model as well as for Premium licenses Via the button Assign to subunits in the license administration the administrator can dis play an overview of the existing subunits and limit the number of user accounts per sub unit 9 License Management Class Climate Fcleast Central Evaluation Version V5 0 Database MySQL localhost Paper surveys Licensed Online Surveys Licensed Handwriting recognition Licensed VividF
439. lity of creating a subgroup report with several criteria i e with multiple questions To create a subgroup report with several criteria click as you are accustomed in the details of a report on Evaluate subgroup the last option on the bottom right Subse quently a window opens offering you all possible questions with which you can evaluate a subgroup In this window you can click on the link Choose several criteria for sub group reports This allows you to select multiple criteria for your subgroup report 300 Scantron Corporation Copyright Electric Paper GmbH EN AL COURSE EVALUATION FEEDBACK SYSTEM Evaluate the report according to the following criterion To the selection of several criteria for subgroup reports 3 A B 1 Questions about you Figure 334 Report Creator Selection of Several Criteria for Subgroup Reports After that the following window opens Selection of several criteria for subgroup reports 7 Questions about you Which gender do you belong to What is your age What is your age How many terms have you been studying so far Main subject Do you already have a university degree or a degree of another institute in tertiary education The instructor is always well prepared The instructor explains even complex topics in a comprehensible way The instructor handles the technical equipment video projector etc without any problems W Defaul
440. ll as to the profile lines sent by the report creator 520 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Email address of the archive Defines the recipient address of the email archive function Maximum number of attachments The maximum number of email attachments Maximum size of attachments The maximum size of attachments in MB concerning the mailing of PDF reports Emails in HTML Format If this function is activated emails are sent in HTML format You can then use HTML tags in the text templates for formatting and linking 2 5 9 Section Color Settings Preset color scheme All colors will be replaced by a preset color scheme Background color contents This setting determines the background color of the content area Background color external This setting determines the background color of the external area Table line 1 This setting determines the background color of the first line of each table Table line 2 This setting determines the background color of the second line of each table Table head This setting determines the background color of the table heads Active area This setting determines the background color of a selected menu item Processed surveys This setting determines the background color of the table lines for processed surveys Scantron Corporation 521 Copyright Electric Pap
441. ll grade teaching material 5 Questions about the studying conditions have already been in the refectory The meals in the refectory are always warm The meals in the refectory are always fresh The meals in the refectory are always tasty __ The university is connected to the public transportation very well Figure 258 PDF Report Definitions Exclude Questions 248 Scantron Corporation Copyright Electric Paper GmbH e CD Glass Climate Prase 3 Capture ana instant Feedback After saving the basic settings you now have the option to define the contents of the report Select from a list all the questions that should not appear in the report By press ing the CTRL key you can select a number of questions simultaneously By pressing the button Save at the bottom of the list your selection of questions to be eliminated will be saved You can see this by the blue background behind a selected question Automatic Subgroups I ic sde open questions i 1 subgroup rer rts EI What is your age _ Save Figure 259 PDF Report Definitions Build Automatic Subgroups In the section subgroup questions you can define a question for which automatic sub groups are built for each option in the report The question has to be a single choice mul tiple choice or a matrix question Subgroups allow you to take advantage of for example automatic filters according to the program of study For each response opti
442. ll in this questionnaire You will help us improve our courses Thank you very much General information You are female male Your Age 18 29 30 39 40 49 30 Why did you choose our university check as many as apply recommendation of my friends advertising do not know Figure 143 Example CSS Editing Scantron Corporation 157 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM 55 Selectors x onlinesurvey cas 2 Shyle inspector X pp pig item odd static odd wr CH leva 2 7 PT a Me Janguageselector lang clear both IE T3 kanquageselector lang a background coicr replace celors background questicn_edd DEE3EA anmuth Ty Jaeguageseliector lang a display block Tar L a lenguagesd hector lang a l arwahe a lefty cue before Te dega pord ltem even static aven elevaton Joginformeasnvtener clear Bath E pause t y Jdognformcontaner Suse background color replace colora background _ question_even eellfi pause afber T a logmformcontiainer emot display block ERA i ea Le dopnionmeont ner input j mR masntabeebaceground rr pebch narge manopla mpulsea Ssurveyheader E EE E olor freplece colors text surveyheades G6G6665 t a moble pagnaton a Eon an nchness a Font sire Lipx k gm mobie pagnyton B Com utie eae paan Te mobe pagination a curent e eaei 2 speak header F3 mobie pagination a T aes Ae
443. lphabetical Segmented Format oO O 2222222 d New format i Style of segmented box Closed wt Display in report Like open questions Verification display Always Settings sre only valid if verification is activated when the survey is created Next Figure 493 Open Question Define the Required Space After having defined all options click on Apply The open question will now appear in the preview and will be automatically highlighted What did you particularly like about this course Figure 494 Open Question in the Editor Preview 414 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM Handwriting Recognition in Class Climate Class Climate supports handwriting recognition via ICR This feature is only available when licensed For further information please contact your vendor By means of handwriting recognition short handwritten texts can be read and processed automatically For this activate the option Handwriting recognition when creating an open question tH Question Wizard Define Options lt Box Size 0 lines left on this page Max number of characters Online Survey Handwriting 7 recognition Characters Alphabetical Language Engish Segmented Format New format Style of segmented box Dis
444. lue case 1 Sshbstention S sInput this gt getAbstention break default SsInputarea SsInput break t J Sthis gt placePartial errormessages T gt lt div class item lt Sthis gt qgetCSS5Class gt gt lt label gt lt Slabel gt lt label gt lt div class content gt lt div class leftpole gt lt Sthis gt getLeftPole 2 gt nbsp lt div gt lt div class inputarea gt lt SsInputarea gt lt div gt lt div class rightpole gt lt this gt getRightPole gt nbsp lt div gt lt div class abstention gt lt sAbstention gt nbsp lt div gt lt div gt lt div gt gt Figure 146 PHTML Editing SSS S 162 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Class Climate Phase 2 Implementation of Surveys Access Rights to Online Survey Templates for Subunit Administrators You as the administrator define within the user properties the of subunit administrators whether a subunit administrator has the right to create or modify online survey templates In the drop down menu next to Online survey templates you can choose between fol lowing rights e Defined by Administrator No access e Templates only meaning the subunit administrator cannot create his own templates e Unrestricted This option of assigning rights can be seen in the following figure 1 2 3 4 2 Change the user rights
445. lue chosen from the properties of a course Use the following field to determine the secret word 0 no course user data fields If no questionnaire specific spare secret password has been defined in the details of the questionnaire no secret password will be requested for the authentication 1 Course user data field 1 2 Course user data field 1 Survey ID 3 Course user data field 2 4 Course user data field 2 Survey ID 5 Course user data field 3 6 Course user data field 3 Survey ID 7 Course user data field 4 8 Course user data field 4 Survey ID 9 Course user data field 5 10 Course user data field 5 Survey ID 512 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Please note If no questionnaire specific forwarding address was defined in the details of the questionnaire the forwarding occurs based upon the system wide defined forwarding address Menu System Settings Class Climate Settings Survey Online Alternative for warding for online surveys no secret word will be used Support for mobile devices If activated when recognizing a mobile device Cell phone Smartphone Internet Tablet PC or similar the display of the online survey will be optimized to the screen size of the corresponding device as far as possible 2 5 4 Section Data Import and Export Permit data export
446. m BS ag Ee cae ee E Ce ee ee ee ee Ree 479 1 11 SYSTEM CLEANING ssnipe eisin nian delta Eaa a a a aa e Aae Aaa 480 WEA l D ESAI D IS eeasueedeenaedgccca nin see eiestescancassanceptosensaubeiactastseoscec inncuonetncatze nemeuemeteccatesvectasetiewts 480 PI So ee ant mee a en eee OR eee ee ee eee ee 480 1 11 3 ENTRIES IN THE LOG BOOK ou cccccccceccccccecceeececseeseueseucueuseueueuesaueeuueueeaaeeueueauueeueaeueuesuaes 480 1 11 4 DELETE COMPILATIONS AND SUBGROUP REPORTS ccccceceeceseceueseeeseeceueeeeueeeeueeeaeeaees 480 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate COURSE S il mat SYSTEM 1 12 ANALYSIS OF ERRORS sedecedtsiccdetcsexcadcwauiue sas csaisdasendcincedaanadeudesangeeneuskesatavaitasseddeietaneudseestenadies 481 PI EO BOOR aeee E E E E EE 481 1 12 2 MAIL SERVICE LOG oo ecccccceccccccecce cece cecueeueeeceuueeueueceuueeueeaueaeeaueueuueaueueeeaueueueaeeeauueegs 483 ein IID OI LOG FILE sos rparetcpe se peepee E Eea 483 2 CONFIGURATION SETTINGS sccsecsicncaisacnesunsasvenesagebste edondanbadesebanaiheoebheGebuule davtdulindnsendnabedeaneustecivloctdabnoues 484 2l TEXT TEMPLATES sree ieee nctescisetse ear e E EEE EEA TEE EANA AE EEE EEN 484 2 1 1 VIEWING EMAIL TEXTS AND TEXT TEMPLATES u ccccccccccceccecseecseeceueseuesuuseuueeeueaeeaeeeaeeuaes 484 2 1 2 TEMPLATE FOR CLASS CLIMATE cccccccccccecceeccecseuusueseeueeuseueeeuueaueeueueeueeaeeueueauseeeneeeausuaes 485 2 1
447. main user 255 255 255 255 Last permitted IP address for users m Begin IP address domain for administrator 0 0 0 0 First permitted IP address for the administrator End IP address domain of administrator 255 255 255 255 Last permitted IP address of administrator Figure 14 Defining Access Rights For each of these user groups you can specify under Class Climate Settings Network settings a valid IP address domain In each case both the first and the last valid address are entered Your computing centre informs you that instructors can have IP addresses in the domain 134 127 0 0 until 134 127 127 255 This gives the address 134 127 23 142 access but not 134 127 142 34 You need to enter the IP addresses given both at Begin IP address domain user as well as at End IP address domain user Access security becomes effective as soon as the field limited access is set at activated Confirm with Save SSS Scantron Corporation 33 Copyright Electric Paper GmbH Class Climate When access is denied a message Is shown for a few moments and then the individual is redirected to a website given at the HI TP redirection address You can put in the address of an appropriate website in your intranet 3 3 Implementing Backups 3 3 1 Backing up the Database The Class Climate database contains e All of the profile data organization department user e All of the survey
448. male So female Ll invalid Figure 216 Verification Correction of a Scaled Question In the figure above you can see a single choice question with more valid answers than permitted The checkmarks were then displayed for verification You can now correct the recommendation by selecting a different box or marking the answer to this question as invalid By clicking on Next at the bottom of the view the correction is adopted and you are taken automatically to the next question By clicking on Back you can move backwards within a verification batch so as to edit a verified question again In addition the following buttons are available Sheet Displays the complete sheet in a new window The question being processed is circled in red This view can be helpful for seeing the whole context Cancel The correction is cancelled Please note that all corrections made since the last save will be lost Save The current corrections including the open view are saved Then you will be automatically taken back to the view you were in before going to the correction view The verification can be continued immediately or at a later date Saving the verification is necessary for example when you interrupt your work When you have finished verifying a batch the results are automatically saved and the overview is displayed el lomo alle Sheet Back Cancel Save Next Figure 217
449. mary Reports Enable temporary save Survey Type Show print option Allow result access Certificate of None z Procedure F Display answers to open participation ALL questions Advanced T configuration Edt Subunits Course Type WALL Lecture Seminar Laboratory Tutorial Computer Sciences Economics Engineering 5511 WSTI 5510 WSUS T0 SSour Ws06 07 Working Group Others Module General Professional Development canstation Demo Subund _Data Entry Demo Subund _5ystemiogins Module Trainer E ___ Apply Figure 558 Details for a Questionnaire The VividForms recognition set organizes itself automatically As soon as the first survey has been created on the basis of the questionnaire it is activated deployed and can no longer be modified with the editor If you want to create a new version of the question naire then you must copy the questionnaire You cannot delete the questionnaire as long as surveys based on the questionnaire are in the system This is to protect your data Scantron Corporation 453 Copyright Electric Paper GmbH EN e O Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM 6 2 Use of Templates in Instructor Accounts In the menu of the instructor account in the template area you will see a list of question naires from the administrator Form Templates
450. me Max 50 characters optional field Surname Max 50 characters non optional field Email Max 100 characters optional field Course Name Course Code Course Location Program of Studies Type Course Participants Max 200 characters non optional field Max 150 characters non optional field Max 100 characters optional field Max 50 characters optional field Index of course type non optional field according to the number in the Course Types e g 1 Lecture 2 Seminar 3 Proseminar etc Number max 10 digit optional field Table 3 Structure of the CSV File Il You can define further titles in the main menu System Settings in the submenu Course Types Periods and Custom Titles 78 Scantron Corporation Copyright Electric Paper GmbH Class Climate These are the default values You can change them in the main menu System Set tings in the submenu Course Types Periods and Custom Titles The Following Rules must be followed The course code must be unique The left side of the table instructor data must be repeated for each course an instructor teaches Course data itself cannot be imported unless assigned to a instructor The right side of the table course data can remain empty except for the course ID You just import the instructor data In addition to the information depicted above you can add further data fields e Secondary instructo
451. ment WS10 11 J Study Summary Reports 2011 Type Compilation of multiple survey results reports Questionnaire train_en Status Data available report available 2 Compilation Created on 05 18 2011 at 16 33 46 No of collected questionnaires 46 Actions Report data P Rename Compilation tat Results in HTML format J Move Compilation Results in PDF format 8 Delete Compilation individual Report Li Edit Show notes Engish Show show Email Email t Raw data in SPSS format Q E Raw data in CSV format Profile Line a p Show J Automatic Manual Kiviat diagram m Mi Merge evaluations 3 Evaluate subgroup Figure 353 Report Creator Detailed View of a Report Here you receive information on the name the folder Study and the type of the report created and just like in the overview you can call up the questionnaire template The status the creation date and the number of returns are also indicated here In the left part of the window in the area Actions you can rename the report if for exam ple you realize that you have produced a report bearing the same name as an existent one and therefore the date was added automatically at the end Furthermore you have the possibility of deleting the report In the right part of the window under Survey data you can download the evaluation in HTML and PDF format If any user defined PDF report definitions are assoc
452. mentation of Surveys COURSE EVALUATION FEEDBACK SYSTEM Deleting Surveys To delete surveys using the tree structure select the option Delete Surveys in the actions panel On the left select the levels in which you wish to delete surveys Then on the right select the desired survey periods and the questionnaires If necessary you can also filter according to course type by activating the option Course Type By clicking on the button Show the courses are displayed in the list If required the name of the instructor can be displayed by selecting Show instructors Select the desired course whose surveys are to be deleted and click on Delete Surveys The surveys are now irrevocably deleted from the system 1 Actions Display Surveys O Generate Surveys Delete Surveys m Fl Subunits 3 Filters Engineering ae TI Questionnaire diin RAS m Professional Development _ ie Additional filters v Economics E Course Type v Central Campus very vw Philipp Belmore vw Carlos Hernandez v E Media amp lnformation Center v Philipp Belmore v Carlos Hernandez _ O Engineering _ Computer Sciences V Show instructors _Data Entry Demo Subunit Philipp Belmore 73 Human Resource Management iG Management Sategies i 62 Managing and maintaining a healthy lifestyle Verifier Demo Subunit 46 Human Resource M
453. mit your selection and choose all properties of a course multiple selections possible 292 Scantron Corporation Copyright Electric Paper GmbH thy Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK SYSTEM The following filtering criteria with the following values are possible earch type Name imple text searc election Available Not available Additional course user if defined up to 5 items Table 15 Filter Criteria for Any compilations Entries in several search fields are linked with an AND conjunction meaning that only those courses are displayed that meet all criteria The contents of the course user data fields in this case Language and Location can be selected from drop down lists If required they can also be typed in directly When you have defined all necessary restrictions click on the button Reload Only then will the courses that meet your criteria be displayed to you 1 Subunit 2 Survey Period 3 Course Type 4 Questionnaire Engineering gt 5511 a Non_Anonym Professional Development Quest_01 _Data Entry Demo Subunit S510 i WS0S 10 train_en_1 S507 WS06 07 3506 WS05 06 s505 J J _ Select program of study template forms V Show extended filter options Course name Course ID Location Participants gt Secondary instructors Language Location l Reload Undo Figure 322 Report Creator
454. mpletely adjusted PDF report you can also include a so called PDF Report Plugin into Class Climate A plugin is normally a small program which is inserted into a larger program and provides additional functionality In this case it is not a software but special report types that you can import into the Class Climate system These report types can define the reports for one several or all ques tionnaires available in the system Also an imported PDF report plugin can replace the Class Climate PDF Report that is firmly integrated in Class Climate In order to integrate a PDF report plugin into the Class Climate system you click in the main menu System Settings on Report Settings 250 Scantron Corporation Copyright Electric Paper GmbH ee COURSE EVALUATION FEEDBACK SYSTEM system Information search 314 f omy Class Climate Subunits Questionnaires A PAPEETE PEER Se AA Report Settings Class Climate Admin L Adm ir i si rator Co nfic ira tion Co py o D elete Administrator v Class Climate PDF repon Copy Class Climate Admin oe 2 B Class Climate PDF report Class Climate Admin SE Er individual report Class Climate Admin w Instruments E Text Templates E Documents Report Settings FDF Report Plugins ettings Description File name Onine Templates Figure 261 PDF Report Plugin Upload Plugin Via Browse you can choose the PDF Report
455. n Then click Next In this example a vertical matrix question was selected with a minimum value of 00001 and a maximum value of 99999 In the report the results are presented in 10 categories In order to also register leading zeros the matrix value is captured as text W Question Wizard Define Options Orientation Horizontal up to 5 digit numbers Vertical up to 10 digit numbers Minimum Value 00001 Maximum Value 99999 Question group 140 count Matrix value as Text Back Next Apply Cancel Figure 511 Create Vertical Matrix Question Scantron Corporation 423 Copyright Electric Paper GmbH Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM The PDF preview of this vertical matrix question looks as follows Your Zipcode O O NDNA Wh poggoooo0og0 OOOOOOOOOO OOOUUUOUOUUOOU OOOOOOOOOO OOUOUOUOOUOOO Figure 512 Vertical Matrix Question in the PDF Preview When filled out such a matrix question could for example look like this Your Zipcode 7 QOOODODOROO fe OOOUNOOOOOO ooOoDooooowo oooooooDoO 000CCCORCO oO O o s Oo amp Figure 513 Completed Vertical Matrix Question 2 6 7 Grade Value Select the grade value question type and click on Next You can now enter the question text and then click on Apply The survey participant can now give a grade by checking a place before
456. n Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 8 Adding Pole Labels 2 8 1 Horizontal Pole Labels This function allows pole label headers for groups of scaled questions to be defined Firstly it requires the section Form Properties in the VividForms Editor control to be opened Select the option ie Edit pole template W Pole Text Assistant m Edit Pole Left Pole BIU S strongly disagree Right Pole B IUJ S strongly agree Standardtextfor BT U abstention Figure 516 Edit Pole Template Enter the text elements which should be used for the labels and click Apply Next create a new question group Now the option at Pole Labels in the section Add can be selected Click on i Pole Labels to add them to the questionnaire strongly disagree strongly agree n a The meals in the refectory are always warm Oooooo dO o The meals in the refectory are always fresh Oooo uo OU O The meals in the refectory are always tasty coad Hi go Figure 517 Pole Labels in the PDF Preview Continue adding scaled questions Do not define individual pole labels since the pole label headers perform this function The pole labels are automatically assigned to all scaled questions below This allows them to be displayed in the PDF reports Scantron Corporation 427 Copyright Electric P
457. n Corporation Copyright Electric Paper GmbH Class Climate COURSE EVALUATION FEEDBACK SYSTEM Class Climate COURSE EVALUATION FEEDBACK SYSTEM Questionnaire 2 00 ee ee 24 208 Adding pictures 0 cee ees 435 Color Scheme 0 ccc ee ee 439 CODY et44feseeed sees couse ge betcha eels eee 86 Creating of questionnaires for the module evaluation 371 Creating questionnaires for VividForms 385 Creating the indicators for a questionnaire 262 Creation and administration 84 Definition of norm values for questionnaires 342 DCCC oat Sse Se He ee eee eee eee eS 87 Detailed view of questionnaires 85 Edit header 0 ccc eee 398 Editing questionnaires 198 455 Editor control 0 0 eee ee eee 389 Essential information on the questionnaire 84 Evaluation aana aaa eee 208 Form information 0 000 e eee ee eee 387 Generating questionnaires 0 198 ielo agene cite a goa ss eee tere beech ene ess 398 Languages nana ees 92 Layout Settings 0 0 0 cee cee ees 438 Layout settingS 0 0 0 eee eee 438 Linking of questionnaires to course types 371 LOGO 4255262558 ween sie pee eta eee eae ea 402 Management of questionnaires 85 Passing on questionnaires 005 455 Placeholder 0 0 0 eee e
458. n distribute the PSWDs to the participants directly Instead of sending the PSWD and the server address for the online evaluation you can use the placeholder DIRECT ONLINE LINK This placeholder adds a link to the online 144 Scantron Corporation Copyright Electric Paper GmbH X Class Climate survey that contains the server address as well as the PSWD password Simply clicking the link therefore shows the online questionnaire e Batch emails The PSWDs are sent to the survey participants using an email address list This dis patch is carried out by the Class Climate server Using the reminder function you can send an email at a later time to all PSWD recipi ents who have not yet taken part in the survey e PSWD cards The PSWDs are produced as a PDF document These PSWD cards have an entry code the Internet address as well as the name of the survey These PSWD docu ments can be either opened by the administrator or sent to the instructor per email The possibilities of distributing PSWDs are described in chapter B 3 2 9 Batch Events Participation Tracking Participation tracking enables you to create a CSV file where all of the used and non uti lized PSWDs of your online surveys are listed In online surveys whose PSWDs have been sent by email to the respondents the partic ipation tracking allows for easier identification of those participants who haven t taken part in a survey Whilst preserving the anonymi
459. n library is displayed in the form of a tree structure consisting of three levels e User which means the Owner of the question groups questions Administrator Sub unit Administrator or Active User e Question Groups e Questions By clicking on a user a question group or on the open close symbol in front of the entry the entry is opened and the elements contained therein are displayed By clicking on a question group or question the corresponding properties and available actions are dis played in the right hand window In the upper area it is defined whether the question group or question is a public or non public one Public questions and question groups are available to all users Subunit administrators active instructors non public only to the 102 Scantron Corporation Copyright Electric Paper GmbH j Cl limate relevant owner of the question group By activating or deactivating this option the public status can be changed at any time For each question group and question four actions can be undertaken e Edit enables the retrospective editing of a question group e Delete deletes the question group from the library e Copy copies a question group e New Group Question creates a new group or question in the library Actions Public Group P R E Question ZF R e Delete New question group Figure 78 Question Library Actions To edit a question use the mouse in the editing view to mark
460. n list and save your changes by clicking on Save Please note that the Class Climate PDF Report is selected by default Scantron Corporation 247 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM To create a new custom PDF definition click on New PDF Report Definition If required you can create more than one report definition for one questionnaire In the window now open you have the following settings e name of the report e selection of the basic report The configuration settings are adopted from the basic report e description of the report e recipient list for automatic email delivery e activate recalculation of indicators only available if you have defined indicators for the corresponding questionnaire You can now enter further recipients in this report definition Further recipients could include for example the dean of studies or a head of technical services if a section of the questionnaire deals with the technical infrastructure of the university The recalculation of the indicators causes the average values of the indicators to be recalculated independently of the questions used A click on Save saves the settings Select Eliminate Questions Please give us your feedback about the course as well as suggestions for improvement t complements the learning matter t is well structured t benefits from the technical possibilities internet videotaping blogging etc Overa
461. n of the different reports you must make a selection in several fields This affects report specific fields also for all of them the type of course and the questionnaire must be selected multiple selection is possible Subunit Report A subunit report is the summary of the survey results for a specific subunit and a specific semester Create reports Comparisons Batch Profile Lines Next Figure 302 Report Creator Create Subunit Report Scantron Corporation 281 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Choose the option Subunit from the drop down list If you click the button Next Now four fields are presented to you in which you can select a subunit a survey period a course type or even several types and a questionnaire or several questionnaires Create Subunit Report 1 Subunit 2 Survey Period 3 Type 4 Questionnaire Engineering S511 i Lecture Non_Anonym Professional Development WSO Seminar Quest_01 _Data Entry Demo Subunit 5510 tranen o WS09 10 5807 WS06 0T So06 WS05 06 3505 train en 4 Template forms Descnption Prof Development WS1 Question mapping of different questionnaires Automatic with text comparison Manual Include answers to open questions Combine surveys unweighted Please note For this combination the mean values of the single surveys are ave
462. n the Class Climate server Give the file a unique name and be careful not to overwrite any of the data already in this directory In the window of the subunit details you can select a logo in a drop down menu from the logos available in the system If the logo you would like is not yet in the system then you can add it by clicking on the button Process In the window that appears select a logo file with a click on search and enter it into the system with Upload Uploading copies the logo automatically in the logo directory C Apache htdocs classclimate data images logos subunit on the Class Climate ser ver Logos for subunits Default Lago a A system logo Individual Logo 2 R Figure 26 Manage Logo Files In the table in the window you can see all the logos in the system You can use the pencil symbol to change the name or with the cross symbol to delete the logo from the system In the first column you can select a logo as default logo and it will be automatically used whenever a new subunit is set up Click on return to get back to the subunit details Scantron Corporation 49 Copyright Electric Paper GmbH y eo a COURSE EVALUATION FEEDBACK SYSTEM The logo graphic will be displayed in the interface as an illustration of the active subunit Even when the instructor logs in with an active user account this logo will appear in the upper right hand corner of the screen In addition
463. n when the Mode of calculation for norming is set to 1 e Pole reversal of scales when taking norms If activated the poles of those dimensions items are reversed in which small values are judged as positive and large values as negative This option is decisive if you use different alignments of scales in your questionnaires That means that positive evaluation results are on the left side of the scale for some questions i e smaller values are positive but for some questions you can find posi tive results on the right side of the scale i e bigger values are positive If you do not activate the option Pole reversal of scales when taking norms you have to take those differences into account when interpreting the norm profile line When activating the option the norm profile line is standardized and thus can be inter preted more easily If smaller values are positive i e left of the norm those values are reversed Furthermore the reversed values are used for the calculation of the mean values Thus all the amplitudes on the right hand of the norm can be interpreted to be positive Accordingly values on the left side are negative Those questions where the center is the best value are an exception to the explained rules e g with the question Was the number of presentations adequate and the answers too few just perfect too many e Permit listing of open questions Listing and counting of indivi
464. nar 02 P1237 R P412 iv Human Resource Management Prof Dr Belmore Seminar 02 P1237 RP 412 iv Leadership Development Hernandez Lecture 02 P1234 R P 080 v Management Strategies Prof Dr Belmore Seminar NA 2 Sem 02 v a j Prof Dr Belmore Seminar NA_1 Sem 03 Iv Organization and Management Hernandez Seminar 02 P1236 R P 410 Figure 382 Additional Reports Selection of Courses for the Dean of Studies For the report type dean of studies it is essential that the user profile of the type dean of studies has been set up The deans of studies can then login with user name and password and from a list of all evaluated courses select those that they would like to have in their report The user type dean of studies cannot however create this report himself This is done on the report cre ator interface Peter Brown Report for the Dean of Studies Vera White Download Choose a dean to create the report for Figure 383 Additional Reports Report for the Dean of Studies Select the name of the dean of studies whose report should be created Click on Down load to create the document 328 Scantron Corporation Copyright Electric Paper GmbH X Class Climate 5 2 5 Integrating Profile Comparison Lines in the PDF Report Comparative Profile Lines in the PDF Report Fundamental Possibilities The automatically generated PDF report of a survey shows you if activated in the config uration of the corres
465. nd click subsequently on Add criterion Available questions Value 7 Questions about you Which gender do you belong to What is your age What is your age How many terms have you been studying so far Main subject Do you already have a university degree or a degree of another institute in tertiary education 2 Questions about the instructor The instructor is always well prepared The instructor explains even complex topics in a comprehensible way The instructor handles the technical equipment video projector etc without any problems Criteria combination 2 Add new criteria combinatio The oiterion will be added to the chosen citera combination Add criterion Figure 345 Report Creator Selection of the Criteria Combination for the new Criterion Subsequently this criteria this question with the selected answer is added to the selected criteria combination Scantron Corporation 305 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Information on a Report Report List The list of the reports of a folder provides you with an overview of the properties of the reports Reports in Folder Summary Reports 2011 Type Name Status Form Created lt Del Report Export R HTML 4 Prof Development WS10 11 Data _ 05 18 2011 1046 QB choose pat report Ey available train_en SPSS Figure 346 Report Cr
466. ne Surveys Procedure Select either ALL i e Central Evaluation and activated instructor accounts Central Evaluation or activated instructor accounts decentral Scantron Corporation 93 Copyright Electric Paper GmbH im amp a Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Reporting Options e Mirrored scale values The option mirrored scale values allows the mirroring of the raw data which is linked to a survey This has an effect on the calculation of the average and the median The standard scale in Class Climate goes from 1 to n from left to right Mirrored values will have a highest option on the left All raw data including averages and medians will be affected by this e Allow Summary Reports Defines whether summary reports dean of studies report dean report can be cre ated for this questionnaire Evaluation for participants For online surveys you can grant the participants access to the results of the survey After the survey has been closed participants can use their PSWD to have a look at the HTML report You can decide if answers to open questions are to be displayed or not Online Design Here you can decide whether in online surveys the survey header should be displayed Should you decide to display it the survey appears as follows 94 Scantron Corporation Copyright Electric Paper GmbH a te COURSE EVALUATION FEEDBACK SYSTEM
467. ne survey templates 60 69 D Older than 69 ___ Class Climate Online Survey Te l g Figure 464 Online View for Mobile Devices Scantron Corporation 395 Copyright Electric Paper GmbH Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 3 0 Preview Functions Independent of the view in which you find yourself paper view or online view preview options are always available by which the paper forms as well as the online survey can be displayed in a separate browser window Both preview possibilities can be found in the viewing bar above the questionnaire Editor Control I i E S Add a 3 Add Question Group Figure 465 Preview Possibilities In order to display a preview of the future PDF questionnaire click on the PDF symbol A new window opens with a PDF example of your questionnaire This PDF document is generated in real time on the server Check to make sure you like your layout Close the window in order to continue editing the questionnaire Please note that this preview is not suitable for implementing a survey In order to create a survey on the basis of a new questionnaire you must first create a folder and then cre ate a Survey 396 Scantron Corporation Copyright Electric Paper GmbH LN a thy Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM Comment Share Wort Ba Bae O1
468. nfiguration in the main area System Settings This basic data is very important and should be permanently defined before beginning operations 40 Scantron Corporation Copyright Electric Paper GmbH aa te a Class Climate Phase 1 Preparation of a Survey Period COURSE EVALUATION FEEDBACK SYSTEM Configuration 453 Class Climate Settings aS Define Tree Structure p Course Types 3 Periods g3 Custom Titles Figure 17 Course Types Periods Custom Titles Course Types The default course types include lecture seminar proseminar tutorial lab and working group You can change this list according to the needs of your organization If you want to add a new course type enter its name in the input box beneath the list and click on New If you want to remove a course type from the list click on a y Course Type 1 Lecture 2 Seminar 4 Laboratory Tutorial 5 Working Group 6 Others 7 Modul General 8 Modul Trainer VV gt Course Type Course Type Form Link for Modular Surveys Figure 18 Course Types The numbers at the left represent the index of the table in which the course types are recorded Using this key course types are allocated from the CSV import table i e the index number 2 always corresponds to the second value from the top down Scantron Corporation 41 Copyright Electric Paper GmbH y eo a COURSE EVALUATION FEEDBACK SYSTEM Periods A survey peri
469. ng Pictures in a Questionnaire As soon as you have uploaded pictures into the picture library you can integrate them into the questionnaire You can find the option Picture in the menu Add As with the other items you can only add a picture to a question group As long as you do not define a question group you can not select the option Picture When you have created a question group you can integrate pictures the option can be selected 436 Scantron Corporation Copyright Electric Paper GmbH Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM Add Question Group Add Question Pole Labels Extended Pole Labels mall Fa 4E saske 2 Line Space Separator Text Box i Page Break Figure 533 Option Picture in the Menu Add wy oth iy When clicking on Picture the picture assistant opens in a new window tW Picture Assistant m Insert picture Please select a picture file Smiley Alignment left aligned 9 centered i right aligned Scaling in of page width 10 Apply Cancel Figure 534 Picture Assistant You can select a picture from a list there You will see the selected picture in the preview Additionally you can define the position of the picture on the questionnaire left aligned centered or right aligned lf you choose to scale the picture the basis for this is the width of the page
470. nger be correct For this reason you have the possibility of reloading the form definition files created by clicking on Refresh in the survey details under In the recognition set of the VividForms Reader see figure above You also have the possibility of refreshing the entire recognition set To do this click in the questionnaire list in the area VividForms Recognition Set the Refresh button By doing so all existing questionnaires in the recognition set of the VividForms reader will be refreshed Scantron Corporation 89 Copyright Electric Paper GmbH COURSE ss Cli FEEDBACK SYSTEM a Your Evaluation Process The Phase Model thy AN Class CI imate ECan i er ares gure oe R ee m a i td a FW eee E Faa r ar at k ros E LUA II j E a an et E gt a Activated with restrictions see details Figure 66 Refreshing the Recognition Set of the VividForms Reader in the List of Questionnaires The option Copy and open the questionnaire in the VividForms Designer offers you the opportunity to reorganize your existing VividForms Editor questionnaires in the designer In order to edit your questionnaires in VividForms Designer you require a corresponding license For further information please do not hesitate to contact us You can open a cover sheet questionnaire with the option PDF paper survey As this already has a barcode it can be printed out and use
471. nnaire Data entry assistant Sending a report to the instructor If this function is activated the data entry assistant can use a button to send a PDF report to the instructor once all survey comments have been processed 2 5 7 Section Central Evaluation Depending on the system version some of these settings are preset and cannot be changed Creation of summary reports Permits the creation of summary reports e g the dean s report dean s of studies report as well as the president s report Report president Report function for the president Report dean Report function for the dean Report dean of studies Report function for the dean of studies Program of study reports Report creator can download reports on programs of study Instructor profile reports Report creator can download reports on instructor profiles Dean of studies Toggles existence of the Vice Dean Quality Management Activate deactivate the availability of quality assurance and QM views 518 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Passive instructors Login for report request Passive instructors can log in to Class Climate and request existing reports for their courses Active instructors Access to reports from central evaluation The active instructor account has a menu item with a link to the reports of his courses from the centr
472. nnaire in the left context menu In the main window two tools now appear for creating questionnaires the VividForms Editor left and the VividForms Designer right System Settings System Information ast H a Subunits i Create Questionnaire Please choose between the VmidForms Editor and the VmidForms Designer Class Climate Admin Administrator VividForms Editor Questionnaires AE Question Library Web based questionnaire editor for quick and easy A professional questionnaire designer offering multiple design of questionnaires with limited layout options layout options When first executed the application will be transferred to your local system This may take a few Current Users minutes Should your browser present a file open that ga Logeed in file to start the designer Fa Onine Surveys Hote Fleaee note thal questionnaires oeated with the VivridFonns Designer cannot cumantly be used for module evaluation or the Loa off instructor s optional quesiions process Figure 456 Access to the VividForms Editor The VividForms Designer is a questionnaire designer with extended layout versatility which is available as an add on to Class Climate To use this a separate license must be acquired In systems without this license the Designer is deactivated and cannot be started For further information on the VividForms Designer please consult the Vivid
473. no 50 such information is given This value can however be changed when batch printing Figure 609 Option Activated for Subunit Administrator Scantron Corporation 505 Copyright Electric Paper GmbH system Settings and Management thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM With this function activated the subunit administrators are able to implement settings which deviate from central settings If any particular released configuration options are to be removed from control by subunit administrators the marking can be removed The page at http localhost says P Removing authorization will remove all existing settings made by Subunit Administrators For this option Figure 610 Warning when Deactivating the Subunit Administrator Release 2 5 1 Section General Title Login Window Text of the title line on the start page System Language Sets the default language of the Class Climate interface as well as all generated report documents Users instructors report creators etc can change the language in their settings Date Format Here you can define the date format The following characters are recognized notice upper and lower case d Day of the month 2 digit beginning with zero m Month as number beginning with zero M Name of month with 3 letters y Two digit number for year Y Four digit number for year 506 Scantron Corporation Copyright Electric P
474. now newly calcu lated for this survey Human l esource 69 a Eco GOOO R 3 697 22672 2119723 m anaE i ma 11 04 12 There is new data available for this survey which has not yet been incorporated inthe JaJa quality guidelines calculation Click here to update the calculation for this survey Deverupirient 7 ii L L PSs Human n S DE T Resource 11 67 6 43010 SIOS le _ 20 oe Eco Management 15 30 02 P 412 Figure 428 QM Views New Calculation for Single Surveys 6 2 6 Definition of Special Search and Table Configurations In order to build a table according to your own specifications you can define searches yourself and save them One of these self defined searches can then be saved as the new default search When you next login at Class Climate this self defined default search will automatically be used To define a search use the menu Options to arrive at all the necessary functions These are Filter Selection Standard i Search I 50 Search Field selection Search Result Field order Save search Delete search Figure 429 QM Views Special Search Configuration e Search This is the search mode in which you will use the table view e Field selection Here you can select those database fields you would like to use in your search e Sequence fields This allows you to determine or change the sequence of columns selected in field selection e Save search This
475. ns Survey of same course in period WS09 10 F Minimum Maxi Survey of same course in period 5510 S Comparison lines Survey of same course in period WS10 11 survey of same course in period 5511 train_01 train_en train_en T Check if the number ol train_en train_en_1 train_en i appears on the docum Belmore WS 10 11 train_en Economics W S10 11 train_en Hernandez WS 10 11 train_en __ Remove certain questi yernandez Belmore WS 10 11 train_en Male Business Studies from Report of Train_en train_en To 3 rerall Report unweighted train_en Add trend graph for inc OY ar graph Overall Report weighted train_en Prof Dev Economics Overall Report train_en x2 r ae Figure 361 Report Creator Profile Line Emails Selection of a Comparative Profile Line Instead of a report the option Survey of Same course in period XY can also be selected This selection adds the line of an earlier survey to the profile line of a selected course if available lf you make such a selection and then download the profile lines a profile line is created for each selected course report except for those of the two comparative lines In addi tion the first profile line and if selected the second profile line are laid over each other You thus receive a document which bears at least as many pages as selected courses After the selection you can scroll to the end of the page and choose one
476. nstructors in the appropriate subunit Ad dminist tra atia na of s UT E ey p jz articipants Number of existing survey participants inthe 10 Data sets found system Import survey participant CI Import courses with multiple course IDs data eros Export existing survey participants as a CSV file Delete all survey participant data Be Figure 169 Data Import via CSV File User this window to import the data on survey participants either just course ID and email in the case of anonymous surveys or further data like name address additional information etc for non anonymous surveys Prepare the survey participant data as CSV file You can use either a semicolon or the character that you define in System Settings Class Climate Settings Data Import and Export Separators CSV import and export serves as a separator Use the following data structure for importing CSV based survey participant data anil a e y e Table 10 Data Structure for Importing CSV based Participant Data Here the text file would appear as follows DEMO120 hardy example com Hardy Amy Mrs DEMO120 smith example com Smith Dr Mary Mr DEMO120 harrison example com Harrison Pasha Mrs The field Course ID forms the link to the courses existing in Class Climate One import file may contain participant data for any number of courses If on a large scale survey par Scantron Corporation 183 Copyright Electric Paper GmbH aa te a
477. ntron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM 3 2 2 Display Surveys ae a i eee 3 aed bemwes w lt Additional filters 1 amp 2 Engineering E a r Professional Development Philipp Belmore SS11 train 01 status In progress _Data Entry Demo Subunit Donna Harwood ws10 11 train_WB1 ALL X Carlos Hernandez Verifier Demo Subunit lwsogt0 lt Show Figure 83 Display Surveys In order to display a number of surveys select in the box Central Evaluation the option Display Surveys Then select one or more subunits survey periods the instructors and the relevant questionnaires and click on Show Via the additional filter the selection can if desired be refined according to differing sur vey status and types In the drop down lists the following status and types are available e Survey status ready data available data deleted quantity of data too low data cap turing verification open closed e Survey types online surveys hard copy procedure cover sheet procedure merge report filtering report unweighted dynamic subgroups e Submission status PSWDs reminder questionnaire evaluation submitted not sub mitted Additional filters 1 amp 2 ALL v Status In progress status Data available Status Data entry _ Status Web verifier Type C
478. o make this process sim pler Statistical Approach The direct basis of the quality guidelines are the norm values i e mean and standard deviation of the norm base of the individual questions The strength of this approach is that the norm values are based on a very large data basis and the poling of the questions is already set The idea of the conversion is to tie the lower and upper thresholds of the quality guide line to the means and standard deviations of the norm base Whether the threshold value corresponds exactly to the mean of the norm base or is slightly better or worse can be defined by the user by choosing a multiple of the standard deviation of the norm base S This multiple is called granularity The granularity can be between 3 and 3 so that you can define whether the threshold of the quality guideline is to be below or above the mean of the norm base The granularity is chosen once for the lower and once for the upper threshold for all questions together 358 Scantron Corporation Copyright Electric Paper GmbH AN Class CI imate Phase 5 Quality Management COURSE ss Cli FEEDBACK SYSTEM The calculation of the threshold values for the quality guidelines is done automatically after the conversion Conversion In order to access the conversion view choose Quality guidelines in the questionnaire details in the drop down menu under Advanced Settings then click on Edit In the win dow tha
479. ocated in Text Templates Calculate indicators If the questionnaire supports the calculation of indicators these can be displayed at the beginning of the PDF report A general average value is also displayed which once again merges the indicators to generate a total average value the latter can be activated deactivated using Hide overall indicator This function should only be used with questionnaires which have been developed to average individual questions within a category Show norm values If there are norm values then both indicators and the profile line in the PDF report will be normed Analysis of single questions Activates the detailed analysis of single questions main part of the PDF report Create maxi histogram After the detailed analysis part of a PDF report large histograms of scaled questions can be created using this function The bar for the response distribution the question text the pole identifiers the average the standard deviation and the total response percentages will appear as well Scantron Corporation Copyright Electric Paper GmbH X Class Climate e Create profile line Activates the display of the profile line in the PDF report e Show normed profile line When normed data exists for the questionnaire a normed profile line will be shown in the PDF report e Create Profile Line for indicators Activates the display of the profile line for indicators in the PDF report e Create Cross Tabu
480. ocedure When using the cover sheet procedure the cover sheet and the form will be included in the PDF either in the number given or once depending on whether this button is acti vated Scantron Corporation 515 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Batch events Naming conventions for PDF reports in ZIP files lf PDF reports are opened in the batch events as individual reports merged in a ZIP file then the file name for the PDF reports is created using the naming conventions defined here A variety of place holders listed in the manual can be used for the file names see chapter B 3 2 9 Batch Events Delete answers to open questions Activates Deactivates the possibility as an administrator to delete answers to open ques tions Serial dispatch of the profile lines for active user accounts If activated serial dispatch of the profile lines of the report creator can also be used for active user accounts If this option is deactivated the report creator can only choose courses of inactivated user accounts when creating profile line emails If this option is activated the report creator can additionally see and choose the courses of active user accounts Blocking time for pages of forms in the Web Verifier Time in minutes for which a page of the form is blocked by a user During this time no other user can access the form Consider th
481. od is the period of time in which ONE survey per course is carried out In most cases the courses are evaluated once per semester and so Class Climate is deliv ered with semesters as survey periods lf for example you would like to evaluate twice per semester you can set up quarters as survey periods Survey periods play an important role in enabling internal allocation to surveys including the image files from open questions The survey periods must therefore be defined before beginning productive operations We strongly discourage making changes in com pleted or current survey periods In order to set up a new Survey period enter the name enter the start date and the end date and click on New 72 Survey Period Eee 4 m J Fl A AMEI 5505 03 01 2007 08 31 2007 WS05 06 09 01 2007 02 29 2008 S06 03 01 2008 08 31 2008 WS06 07 09 01 2008 02 26 2009 SS07 03 01 2009 08 31 2009 WS09 10 09 01 2009 02 28 2010 S5510 03 01 2010 08 31 2010 ws10 11 09 01 2010 02 28 2011 5511 03 01 2011 08 31 2011 WS11 12 09 01 2011 02 28 2012 New period New period Start date of the period End date of the period Figure 19 Survey Periods 42 Scantron Corporation Copyright Electric Paper GmbH Class Climate Please remember the defined date convention MM DD YYYY The date format is defined in the menu System Settings Class Climate Settings General Date Format Overlaps of existing survey periods
482. oe ee errr E ee ee ere ee er ere ee 197 Adding A group to the library 000008 446 A question from the library 005 441 A question to the library 005 445 Graphical elements 00 00 e cues 431 Pictures to a questionnaire 005 435 Pole labels 46526 eciete tee teeee Seeee sete 427 Question groupS 0 cee eee 404 Questions o 45 eeaceg eaueseh boas ees kepr esses 169 Adjustment to your organization 26 Administration of questionnaires 84 Administrator ACCOUNT 26224 0enoeeeesasoac ese be eteseee ees 54 Creating active instructors as administrators 195 My Profile 0 0 cc cece eee eee 54 Secondary Administrator a aana naana aaa 56 Administrator Manual ananasa aaaea aana 24 Advanced reporting noana aaaea 256 Aggregated reports aaa 279 Analysis of errorS 0 0 0 es 481 Anonymous SurveyS 0c e eee ees 71 Any compilation Tree structure 294 Attachment Email attachments 000000 e eee 499 Automatic recognition set management 457 B Backup 0 0 0 cc ee eee 34 Database 212s ois eee dee edness eee oe ee RE EES 34 Image files from Scan Station 0 35 Image files of the open questions 35 Barcode Recognition of the checked boxes via Barcode 208 ASICS Geese oes Our ene or eu Gere eee eee es
483. of Surveys COURSE EVALUATION FEEDBACK SYSTEM 3 2 5 Tree Structure In the menu Tree Structure it is possible to view the structure of subunits instructors and classes built in the system in a hierarchical tree structure Also hidden layers such as the program of study or the user defined fields of a course can be made visible and used for survey administration Furthermore the features of display creation and deletion of surveys as described in previous sections can be undertaken directly via the tree struc ture Displaying the organizational structure is enabled in the system by default If necessary this display can be switched in the system settings System Settings Class Climate Set tings Functions Open Tree Structure The arrangement and number of levels displayed is preset in the menu System Settings Define Tree Structure As a framework here the two levels Subunit and Course are displayed If necessary additional levels such as program of study instructor etc can be inserted Subunits Questionnaires System Information ost i i _ it pe q _ nece Subunit Class Climate Admin 5 a Administrator Program of Study Instruments Course Location Text Templates Language A n information E Documents Course User Data Fieki No 3 igs Report Settings Cours User Data Field No 4 r Ae ee pee Course User Data Field No 5 Onire T
484. of the Changing of the Survey ID After confirming this prompt your survey receives a new survey ID Scantron Corporation 127 Copyright Electric Paper GmbH a te amp Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM 3 2 4 Delete Survey Delete Surveys 3 Course Type 4 Questionnaire Leciure Business Studies Chemistry Computer Science Economics Linguistics WS08 09 Mathematics 5508 Musics Physics _ Select program of study 5 Course s Esmeralda Parker Basics of Economics introduction into Economics Luke Snowden Introduction into Computer Science Delete WARNING The surveys will be deleted irrevocably Figure 109 Deleting Surveys This function allows you to delete large numbers of surveys As with all other dialogs you have an intelligent option which only displays the valid options Select 1 One or more subunits 2 One or more survey periods 3 One or more course types 4 One or more questionnaires 5 One or more courses After clicking on Delete the data will be deleted from the system The deletion process may take between a couple of seconds and a few minutes depend ing on the amount and size of the surveys selected In order to save the raw data before deleting surveys use the archiving function 128 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation
485. oject XY Survey empirical studies YZ etc e Student projects if you allow that access Surveys Diploma John Doe Surveys Mas ter Thesis Jane Doe Surveys PHD Thesis John Sample e Etc Of course you can combine several of those examples if suitable But please notice You cannot generate tree structures i e a folder within a folder is not possible To generate a new folder click the button Create new Folder Scantron Corporation 201 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Cl mate COURSE ss Cli mat SYSTEM Y Listing of folders Create new Folder 4 i Figure 200 Create New Folder In the following dialogue the active instructor is asked for the name of the folder New folder Surveys 2011 C o canes Figure 201 Name New Folder After entering the name and clicking OK the folder appears in the list J Listing of folders O Surveys 2011 0 Surveys 0 evaluated 05 16 2011 Rename P 4 Figure 202 New Folder in the Listing of Folders 3 3 5 Generating Surveys After a folder has been created surveys can be set up in it The user will be guided by an assistant who will ask the following questions e Selection of the questionnaire for use e Selection of template for optional questions e Entry of optional questions self formulated or from question library e Entry of survey name 202 Scantron Corporation Copyright E
486. old 3 57 Upper threshold 3 57 Figure 420 Quality Guideslines Setting of Threshold Values Select a norm set as basis under Base norm in the header area This norm set needs to be already there for the norms of this questionnaire The guidelines are listed with the respective questions belonging to them underneath On the right the norm base mean avg the norm base standard deviation dev as well as the lower and upper threshold are shown for each question Initially the default set tings of the threshold values correspond to the norm base mean avg Now the factor for the positive and negative threshold can be selected in the drop down list in the header area Threshold values can be changed with the drop down list in the header area by setting the granularity It should be noted that the granularity of the negative threshold needs to be equal to or larger than that of the positive threshold Pressing the button Convert this norm generates the quality guidelines and the quality indices of the relevant surveys are re calculated automatically Of course once the quality guidelines have been generated automatically they can be further edited and adapted 360 Scantron Corporation Copyright Electric Paper GmbH T a COURSE EVALUATION FEEDBACK SYSTEM Example Calculation when Higher Values are Better For a questionnaire where higher values are better the granularity set for the negative threshol
487. on Trigger The message to the instructor about which deans of studies received a summarized form of the results has been activated self registering procedure Content Personalized text with a list of the deans of studies who have been given access to the summarized results of the survey Certificate of Participation for Online Surveys Trigger Certificate of participation has been activated for a questionnaire Option email The PSWD has been sent to the respondents by email The respondent has submitted the online survey and received this email Content Personalized certificate of participation 2 1 4 Template for Letter in PDF Reports The letter text for PDF reports can be defined in same list like email texts Letter texts starts with LETTER For using a letter you must have activated the function System Settings Report Set tings Configuration Generate letter A complete default letter can be used or a PDF template attachment for a one or more page letter Scantron Corporation 489 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Example University Washington Sreet 5 Lp Te Mt Depry comes aeey Celiac Oue Pimi gio Shae t Dear Mr Prof Dr Adam Smith as private and confidential Report Course Evaluation to the Teachers Dear Mr Prof Dr Smith This email contains evaluation results for History of li
488. on OK the questionnaires and all related surveys and their results will be deleted Scantron Corporation 87 Copyright Electric Paper GmbH Further details about a questionnaire can be opened when the option Details is selected in the column Action in the questionnaire table This window is subdivided into two sections In the top part you can among other things open the PDF files Bi Details for questionnaire Quest_01 Quest_01 Evaluation Questionnaire WP VividForms Editor O Copy and open the questionnaire in the VividForms Designer w PDF Sample Show PDF paper survey Show 38 in the recognition set of the VividForms Reader Add Preview online survey Figure 63 Details of a Questionnaire With which Engine the questionnaire was created VividForms Editor VividForms Designer can be seen on the top left A sample questionnaire can be opened with the option PDF Sample Click the option Show for this Note The PDF sample is for viewing purposes only and cannot be used for surveys In the Recognition Set of the VividForms Reader The VividForms Reader must know the forms that you are using so it Knows where to look for checkbox areas Only with the aid of this information can it evaluate the graphics of scanned questionnaires In this way it checks during the evaluation that in those areas where crosses could lie areas are actually blackened For this rea
489. on to this single choice or matrix question the answers are filtered and the subgroup report is attached to the standard report Please bear in mind that the standard PDF report is only attached to the subgroup reports if you have activated the option Show overall report before subgroup reports This is of course done only for options that have been marked and that exceed the minimum number of returns Sys tem Settings Class Climate Settings Survey Minimum number of returns for reports With the option Show divider for subgroups with information about subgroup in report you activate the use of a separator between the subgroups The following information is shown on the separator e The question to be filtered e The option the subgroup was constructed for e The number of returns for this subgroup Scantron Corporation 249 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate Exaiyn e TE Subgroup For question What is your age Figure 260 PDF Report Definitions Divider for Subgroups With the last configuration option Include open questions in subgroup reports you can define the use of open questions in the subgroups 4 5 3 Individually Designed Reports PDF Report Plugins Class Climate generates survey evaluations in the form of standardized PDF reports You can adjust these reports in different ways according to your needs If you require a co
490. one batch printing charge the maximum number is 30 000 pages Display of recognized form data If activated the checkboxes whose values were transmitted to Class Climate will be marked green in the PDF overview of the processed forms accessible in the details of a survey Standard view VividForms Editor This option defines the standard view of a questionnaire in the VividForms Editor The user can switch between the paper and online view at any time if the license allows 2 5 12 Section Network Settings Display value support link Display text of the web link shown in the interface default Class Climate web site HTTP link on support page Target address of the web link shown in the interface default http www scantron com HTTP redirection address Redirection address for rejected access attempts IP address mail server IP address or domain name of the mail server Class Climate should use for messaging functions lf you want to use a secure mail service you have to add the string ssl to the IP address ssl lt P address gt Additionally the port of the mail server has to be changed to the 465 You cannot use the TSL protocol here Port mail server Port of the target mail server Default 25 HELO to mail server Greeting for the mail server in this case the name of the mail server to be addressed Ignored impolitely by most mail servers Scantron Corporation 523 Copyright Electric
491. online template management opens automatically 152 Scantron Corporation Copyright Electric Paper GmbH gt COURSE EVALUATION FEEDBACK SYSTEM thy Class Climate Subunits Questionnaires System Settings System Information search sst EN CURIEI CYQLEUTION LABACA SEER kes i peas a Online Template Management Customized Online Survey Templates Class Climate Admin Ackranistr alee v Class Climate Online Survey Template Class Climate Admin E 8 High Contrast Glass Climate Online Survey Template Class Climate Admin 7 De WebinarTest Class Climate Online Survey Template Class ClimateAdmin y GD Mt Create new customized online survey template instruments E Ted Tempines ip Documenis esl settings Online Survey Templates i j a 5i Name wer Actions Class Climate Online Survey Template SYSTEM 7a Template ZIP file for online surveys BE Broesie_ Name of Online Survey Template ay Configuration ig Class Climate Settings aS Define Tree Structure g Course Types C Periods GA custom Tities T Process Detoults EJ Web Service Settings Language Sets Figure 137 Online Template Management Predefined templates can be uploaded in the bottom area of the window In the upper area of the window customized templates are created and managed To create a customized template in the upper area of the window click on Create new customized online survey templ
492. ons The Class Climate question library can be made use of as it offers a collection of valid items Class Climate Settings Survey Instructor s Optional Questions question library gt activated Changes to the course data can be either authorized or blocked Configuration Survey Instructor s Optional Questions Changes to Course Data gt Activated 170 Scantron Corporation Copyright Electric Paper GmbH Class Climate This procedure offers the opportunity to send instructors the personalized PDF question naire for printing once they have completed the Instructor s Optional Questions Alterna tively these emails can be sent to the addresses of those responsible for the production of the questionnaires System Settings Class Climate Settings Survey Instructor s Optional Questions direct delivery of questionnaire PSWDs or System Settings Class Climate Settings Email Functions amp Accounts Instructor s Optional Questions group address To configure the Instructor s Optional Questions proceed as follows Open the menu Instructor s Optional Questions in the main menu Subunits Select 1 the subunit 2 the survey period 3 the course type 4 the questionnaire and 5 the course s Select now activate Activate Remind _ Deactivate V Sending emails to instructors Figure 158 Activate Instructor s Optional Questions Personalized emails are sent to all instructor accounts for al
493. ons indicators as well as items only scaled items are permissible norm values and analysis rules R Recommendation Report N Norming 1eNsi Here a Text can be 2 Questions about the instructor entered which will be asiak a shown as a ar recommendation text Figure 403 Norming Edit Whether results are to be seen as positive must be set for each dimension e g for meth odology and structure above average for redundancy average for anomie lack of dis cipline below average At the right hand side of the screen you will see the average as well as the standard devi ation of the comparative group This is repeated for the complete contents of the ques tionnaire Scantron Corporation 343 Copyright Electric Paper GmbH lass Climate In the column recommendation text three text building blocks can be placed which should be displayed depending on whether the results are above average average or below average At the left using checkboxes you determine whether in addition to the dimensions there should also be text building blocks for individual items Example Atmosphere Dimension Above average score Congratulation Your course is considered by your students to have an above average positive atmosphere friendly manner with students cooperative instructor is open Par ticularly in courses with interactive teaching is this an important aspect Average score Average score
494. option if you wish to compare the selected courses reports not only with the respective comparative lines but also with one another Though in this case a profile line comparison is created for each course report the profile lines of ALL selected courses reports are contained in each graphic Example 2 continuation In the upper example 2 this would mean that in the graphic for Philipp Belmore Manage 318 Scantron Corporation Copyright Electric Paper GmbH y eo a Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK SYSTEM ment Strategies additionally the profile for Carlos Hernandez Organization and Manage ment is included and the other way round as you can see in the figure below Prof Dr Philipp Belmore Management Strategies Subunit Professional Development T Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies Name of the survey Comparative line Carlos Hernandez Comparative line Prof Development WS10 11 Name of the course Organization and Management a Name of the survey a The instructor is always well prepared f t poe wk The instructor explains even complex topics in a comprehensible way iii en av 3 6 The instructor handles the technical equipment video projector etc AU Ta without any problems 4 w 37 Please grade the instructor for this course Ai wi ys av 3 8 f if av 3 5 The lead time of the course is adequate
495. or for this course poor a very good av CiM N ne nie The lead time of the course is adequate Strongly as A Strongly agree av 3 6 agree E Ma awed nad Figure 390 Profile Line Comparison PDF Report with the Profile Line of the Report for Compari son In the questionnaire details you can define as many comparative reports as you may require In doing so please note that you can only define one comparative report per sur vey period and subunit This means that you cannot define any more comparative reports for the subunit Prof Development in WS10 11 if you already have defined a comparative report for this subunit in WS10 11 If you combine the settings defined above thereby defining both the two previous periods as well as the comparative report Prof Development WS10 11 for the comparison lines your PDF reports will additionally contain these three comparison lines In the following graphic you can see the profile lines for the survey results of the course Data Analysis in SSO7 in the subunit Engineering together with the four comparison profile lines defined 334 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Prof Dr Philipp Belmore Management Strategies Profile Subunit Professional Development T Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies l Name of the survey Com
496. oration Copyright Electric Paper GmbH m AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM The placeholders include for example the name of the subunit the name of the course to be evaluated or the name of the instructor Usually the placeholders which are auto matically indicated during editing of a questionnaire suffice If required however these can be individually adjusted In the following figure you can see the placeholders that the header area contains by default Mark as shown ORO OO mi migm MARK CORRECTION Figure 468 Placeholders in a Questionnaire Corechon Click on a placeholder to edit its content ab Placeholder Wizard Form header settings Number of lines 23 m Edit placeholder Default Placeholder ORGANIZATION Flease choose a placeholder and or individualize the form header By Fal Placeholder RB Gi 2 7 2 EST ORGANIZATION Participant First E Placeholder a us PI Ider disci Aare Note The placeholder in the other column of this line will be deleted automatically columns Apply Cancel Figure 469 Editing the Placeholder A placeholder wizard will appear as shown here You can insert different placeholders in the text fields provided To do this click on the buttons which symbolize the relevant content with small graphics Scantron Corpor
497. orms Designer Licenses Not Licensed Scanstation licenses 4 User licenses Figure 587 Administrating User Licenses By default the number of user licenses for each subunit is not restricted this means that any number of users can be created in each subunit until the quota of user licenses has been exhausted To make restrictions per subunit remove the tick from the checkbox next to the option unlimited for each subunit In the column user licenses in the input field you can now specify the maximum number of licenses allowed per subunit For each subunit you are 474 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM shown how many user licenses are currently in use At the end click on Save to apply the settings 3 User licenses 10 Computer Sciences 3 13 7 unlimited Econ CA User licenses Engi a Subunit Cet it 10 Computer Sciences 3 j30 unlimited 25 Economics 0 15 unlimited 6 Engineering 3 60 unlimited 20 Professional Development 5 60 unlimited 23 Scanstation Demo Subunit 1 15 unlimited 14 _Data Entry Demo Subunit 1 10 unlimited 15 _Systemlogins 0 10 unlimited 13 _ Verifier Demo Subunit 1 10 unlimited 19 _VividForms Demos it v unlimited Summary 15 271 max unlimited unlimited free mm Figure 588 Limiting User Licenses Alternatively restricting the number of
498. ort for surveys of the subunit Prof Development created in the period WS10 11 with the questionnaire train_en as well as the profile line of this survey you will also receive the comparison profile line of the subunit report Prof Devel opment WS10 11 In the following graphic the profile line of the survey results of the course Organization and Management from Prof Carlos Hernandez in the subunit Prof Development in WS10 11 is displayed with the profile lines of the comparative report Prof Development Scantron Corporation 333 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM WS10 11 defined above displayed with the profile lines of the comparative report Busi ness Studies WS 10 11 defined above Carlos Hemandez Organization and Management Profile Subunit Professional Development T Name of the instructor Carlos Hernandez Name of the course Organization and Management l Name of the survey Comparative line Prof Development WS10 11 18 The instructor is always well prepared i a Y paria av 3 7 n ae naig The instructor explains even complex topics in a comprehensible way fi i av 3 6 a 3_ 8 nage nai The instructor handles the technical equipment video projector etc il i av 4 4 without any problems e et ee A naig Please grade the instruct
499. ot want to delete 480 Scantron Corporation Copyright Electric Paper GmbH Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM You cannot delete the data you have created in your surveys it is only possible to delete that of the report creator When the report creator compiles some reports when he creates profile lines etc the system always duplicates the raw data to obtain the data for the new reports The PDF reports are based upon this data Thus no PDF report is available as a file in the system every report is created on the fly using the raw data or the copies of the data when the user calls up the report In a sense the deletion of the data copies also implies the deletion of the report of the report creator But in fact when clicking on the button Delete reports you only delete the duplicated data which overloads your system 1 12 Analysis of Errors 1 12 1 Log Book The log book reflects all the operations that occur in connection with the automatic cap ture of paper questionnaires Wig Book p There are 129 Log entries available Messages warnings and errors Show 15 Records starting from 0 OK Type Text Picture From Batch User Date Attention The Mail Service appears to be incorrectly configured This can lead to problems regarding the system functionality e g the processing of scheduled EJ tasks Please contact the support team to verify the 0 a SYSTEM 05 25 201
500. ou can now see the question groups of the questionnaire as quality guidelines Course Evaluation Questionnaire 25 5 Questions about the studying conditions Change Delete 25 4 Questions about the teaching material Change Delete 25 3 Questions about the course Change Delete 25 2 Questions about the instructor Change Delete o o lens ens Convert quality guidelines from norms Convert quality guidelines from indicators New Re calculate all Surveys Figure 417 Quality Guidelines Overview of Quality Guidelines You find this list in the area Advanced Settings in the questionnaire details choose the option Quality guidelines then click on Edit The dialog pictured above appears Each quality guideline can now be edited as usual For example individual questions can be weighted differently if necessary or different threshold values can be defined Scantron Corporation 357 Copyright Electric Paper GmbH l Your Evaluation Process The Phase Model PA ENELASTIBRTTTORITG TUSTIN Edit quality guideline 6 2 3 Converting Norms into Quality Guidelines When defining quality guidelines it is often difficult to decide where to set thresholds for good and poor quality A natural approach is therefore to set these thresholds on the basis of results that you have collected with this questionnaire in past surveys The func tion Convert quality guidelines from norms has been created t
501. ourse In the following you will find two examples for personalized questionnaires The text below with placeholders was inserted into the header Example 1 The personalized questionnaire for Janet Gabriel Class Climate Course Evaluation Questionnaire TTANTEOR Participant Janet Gabriel Course Prof Dr Adam Smith Introduction into macroeconomics sar asshown O ROO LC Please use a ball point pen or a thin felt tip This form will be processed automatically correction O B CS U Please follow the examples shown on the left hand side to help optimize the reading results Figure 183 Questionnaire for Janet Gabriel example Example 2 The personalized questionnaire for Michael Brown Class Climate Course Evaluation Questionnaire Participant Michael Brown Course Prof Dr Adam Smith Introduction into macroeconomics l 3 Mark as shown O amp CJC O Please use a ball point pen or a thin felt tip This form will be processed automatically Correction O E COC amp O Please follow the examples shown on the left hand side to help optimize the reading results Figure 184 Questionnaire for Michael Brown example Now the survey can be implemented whereby attention has to be paid to the fact that the person specified on the questionnaire is actually the person who fills it in 192 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 2 Implementation of S
502. ourse the Class Climate administrator can create additional fields For this purpose he or she defines a number of additional fields in the configuration on the side course user data fields their names and contents As soon as the administrator inserts these fields in the configuration they are displayed in all courses and in addition to the standard information selection of the set contents from a drop down list further details can be entered For further information on course user data fields see chapter B 2 2 3 Creating Courses section Expanding the Course Data with User Specific Fields These data fields complements a course s standard data and can in the same way serve as a filter criterion for Any compilation reports If you select the Any compilation as a report type you can activate the option Show extended filter options 1 Subunit 2 Survey Period 3 Course Type 4 Questionnaire Engineering 511 a gt Non_Anonym Professional Development Quest_01 _Data Entry Demo Subunit 5510 itrain WS09710 i train_en_1 5507 WS06 07 506 WSOS 06 S05 _ Select program of study Template forms V Show extended filter options Course name CourseD Location Participants gt Secondary instructors x Language Location Reload Undo Figure 321 Report Creator Extended Filter Options If you activate the filter options here you can further li
503. ourse User Data Fields e Functions e Central Evaluation e Email Functions amp Accounts e Color Settings e Instructor accounts e VividForms e Network Settings 504 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM e System Security e Maintenance Select an item from this list in order to display its settings Click in the field Settings on Advanced in order to reach the save option M Advanced Settings Settings View Sort options to categories w i Show j Current Configuration Name sae Chosen Configuration Standard Replace Old Configuration Standard w Delete Cancel Figure 608 Advanced Settings You can save the current Class Climate setting here under a name This allows you if required to recover an earlier Class Climate setting You can do this by using the func tion replace the present configuration by And finally you can delete a configuration you have saved at delete an earlier configura tion Many of the available configuration options are characterized and marked by gray text Make this option subunit available to subunit administrators meaning that they can be activated for the use by subunit administrators Default value course participants The default value of course participants is used for batch printing when
504. over Sheet Procedure Type Online Type Hard copy procedure Status Open Status Closed Report sent Report not sent Figure 84 Additional Filters in the Survey Display After clicking on Show the surveys are displayed in an overview according to the choices made Scantron Corporation 113 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM amp 7 ag Additional filters 1 amp 2 a SH b we lhe SS SS ee Engineering a a ALL I Status Data avaiable Professional Development Philipp Belmore soll train_en _Data Entry Demo Subunit Donna Harwood WS10 11 ALL X Verifier Demo Subunit Carios Hernandez 55140 Eee E wS09 10 x Show Professional Development Philipp Belmore ws10 11 2 Management Strategies NA_2 Daa 013 05 12 2011 _ train _en 3 tas oe foie cla 4 F x Managing and maintaining a healthy Data Resa air Ses o pes lc A ifestyle NA 1 available 015 05 12 2011 _ E train_en D a rR amp Professional Development Carlos Hernandez ws10 11 Y Human Resource Management 02 P 1237 Role 017 05 12 2011 1O train en SES ji R X ric R 3 r 2 Figure 85 Display the Selected Surveys Alternatively the survey list of an instructor can be opened directly via the content view of a subunit In this overview a column with the heading Su
505. ower and upper threshold values for the quality guidelines are set for all scaled questions in terms of percentage values In addition you can declare a global default setting regarding the orientation of the scales whether higher values are better or lower values are better Underneath you find the question groups with all scaled questions that belong to them On the right hand side you find for each scaled question a drop down menu as well as the lower and upper threshold values The orientation of the scales is particularly important Here this can be defined individu ally so that you can change poles for individual questions if necessary The threshold values for the range of tolerance depend on the length of your scale 2 to 11 options Scantron Corporation 355 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM exact target values can be defined later In order to refresh the view after editing values click on Reload The following examples illustrate some threshold values for different scales ower Upper 40 60 28 Higher values are better gt 2 2 2 8 3 4 Higher values are better A point scale igner values are better Lower values are better 2 6 3 4 ower values are better 4 Table 19 Threshold Values Calculation of a tolerance range for lower threshold 40 upper threshold 60 dZ J point scale J AD s 2 6
506. parative line Prof Development WS10 11 T Comparative line 3510 Management Strategies I h comparative line WS03 10 Management Strategies B f av 3 What is the grade of your last school graduation wWe28 ned ave 6 8 ned av 2 5 n 20 n 13 ee aw i The instructor is always well prepared m Ww 3 7 onde i viet neil av 3 1 n 20 n 13 f oer f av 3 5 The instructor explains even complex topics in a comprehensible way ffl av 3 8 n i r aw 3 4 n l av 3 1 neo nei 3 awe The instructor handles the technical equipment video projector etc f i Y av 7 na45 without any problems av 3 7 maji av 3 5 ni neg aw e4 Please grade the instructor for this course poor very good amj ned av ega nath av 1 nate i ho fif Figure 391 Profile Line Comparison Combination of the Various Profile Lines In conclusion it can be held that as an a Subunit administrator you can define compar ative profile lines for a particular questionnaire in the details of a questionnaire via the option Report for comparison in the area Advanced Settings You can there e define the number of previous periods to be included in the comparison and e select a comparative report which has already been created by the report creator 5 3 Data Export to Excel and SPSS For further reports and evaluation you can export the collected data to three different for mats T
507. parts of the questionnaire for a given feedback recipient Additionally subgroup reports for single choice multiple choice or matrix questions can be created e Quality Guidelines This is where you can set the quality standards for the questionnaire These stan dards are found again when using the QM views QM views can for example be given to deans at the end of a survey period so that they have a clear overview of the results of their department The quality guidelines should give an impression of the quality of a course so that if necessary a detailed report can be consulted e Report for Comparison Here you can define the number of previous periods and comparative reports of the report creator which should be compared with the current PDF report e Data Export Configuration You can rename the variables and allocate new numerical values for the export of the questionnaire e Filter Settings This is where you define whether certain answers will cause other questions to be suppressed In an online survey suppressed questions will not appear or will be inac tive For paper surveys filter settings apply after processing i e retrospectively In this way the filters in the paper surveys have an effect on the report e Validation By defining validations you can test entries to open questions and matrix fields in online surveys with value ranges and regular expressions before a survey participant can send the questionnaire Sc
508. passive it can only be used indirectly by the administrator e Activated Instructor Account Mode When the instructor account is activated then it can be accessed by its owner with a user name and password It can now be used for the creation of individual question naires and surveys while at the same time the general course evaluation is carried out by the administrator Instructor accounts should be activated when internal clients need a tool for carrying out a number of Surveys e g an instructor the library or the administration Dean e Decentral System Mode The only difference between the user type Dean and the user type Instructor is that for the Dean a complete user statistic for the relevant subunit is created e Central Evaluation Mode In Central Evaluation the dean can be labeled as active or passive An active dean similarly to an active instructor can create questions form questionnaires and for example access the activated QM views stage 5 A passive dean has access only to his personally activated QM views 52 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH FEEDBACK SYSTEM thy Class Cl imate Phase 1 Preparation of a Survey Period Dean of Studies This user type is only available for the server version Central Evaluation The user of this profile can make a selection from a list of evaluated courses and have them summa rized in a special report The dean of studies does not coun
509. per GmbH 297 mate CSV SPSS Data r available train _en i HTML 05 18 2011 112 choose pdf repot 4 Hernandez Belmore WS 10 11 Figure 329 Report Creator Merged Instructor Profiles Belmore and Hernandez of 2010 11 The properties of these merged reports correspond exactly to those of the other existing ones Here you also obtain the information through the details in the list or through a click on the name There you have the option to merge further reports Forming Subgroups Not only can you merge existing reports with others but you can also form subgroups from all reports created meaning the reports can be evaluated according to certain crite ria age gender subject etc These criteria are specific groups of returns meaning completed questionnaires and these you determine yourself through the creation of your questionnaire You can form these groups according to your e single choice questions e multiple choice questions and e scaled questions Your questionnaire contains a single choice question regarding the gender with the answers female and male You can then create for all summarized reports each a sub group report Female and Male based on this questionnaire These reports could give you information on whether women and men answered differently Your questionnaire contains a single choice question regarding the age e g you ask for the groups of
510. play in report Like open questions Verification display Always Settings sre only valid if verification is activated when the survey is gested Back Next Apply aaa Figure 495 Open Question Activate Handwriting Recognition After activating this option the box size is automatically set to 2 as Class Climate can only read single line handwritten texts one handwritten line matches two VividForms lines In the first drop down menu you can define the kind of characters to be read You can choose between the following four options e Alphabetical letters only e Alphanumeric letters and numbers e Numeric numbers only e Numerict numbers and special characters lt gt E Scantron Corporation 415 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Handwriting 7 recognition Alphabetical Alphabetical Alphanumeric Segmented Numeric Numeric Characters Language Format Figure 496 Open Question Choice of Character Types Possible fields of applications could be the following e Alphabetical names of persons or places e Alphanumeric license numbers e Numeric measurements e Numerict prices dates In the second selection box you can define the language for which the handwriting rec ognition is to be conducted The English language is set as default Handwriting p
511. ple change the online design edit the text templates etc After all settings have been done the survey can be conducted just like any other paper or online survey in Class Climate i e print or email questionnaires or PSWDs scan forms etc 7 8 Instant Feedback As soon as the questionnaires have been scanned and analyzed by the VividForms Reader resp the online survey participants have taken part in the survey Class Climate will automatically generate reports on both the module survey in whole and all its single components courses which have been surveyed 380 Scantron Corporation Copyright Electric Paper GmbH Class Climate In the following figure you can see the report on a module survey and all of its compo nents The report for the whole module has the name of the module in this case Class Climate Basics It can also be recognized by the name of the module questionnaire in the column Form in this case Z1ALSCN9Q rr s511 Status Forms Processed Report Export Actions _ 008 Jae e Jd SPR 008 32 05 23 2011 QUXLZ79XWT Liat wh x I SOR Late 008 05 23 201 O Trainer Cee S I SD DPR EEE Name a 2 Class Climate Basic Training General 01 Class Climate Basic Training Introduction into Class Climate 02 Peter Huddle Norming and Quality Data m _ a en i ie Esis Guidelines 04 available E008 05 23 2011 O Trainer OGA S I SPR S
512. ple Choice Question Select the single choice question type and click on Next You can now enter the text of the question and then click on Next The procedure is the same for all single choice and multiple choice questions th Question Wizard Question text BiIuU Y What is your age Figure 504 Single Choice Question Enter the Question Text t Question Wizard m Define Options Option BIU S Add option Option List h 18 29 a 2 30 39 J a 40 49 T 50 59 coss Online Drop down list Mean disable calculation Position of the answer Default Questionnaire Layout options Backo Nex Apply Cancel Figure 505 Single Choice Question Enter the Answer Options Next to Option enter the text for the first option and click on Add option The option will now appear in the option list Repeat this procedure until you have entered all the options 420 Scantron Corporation Copyright Electric Paper GmbH Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM You can highlight each option edit or change their sequence by clicking on the symbols P oP and Settings for the display in online surveys can be made for single choice question types You can choose between the drop down list and checkbox list For paper based surveys the alignment of answer options of single choice questions can either be set to
513. ple when only one question was added such as in the first example The questionnaires are compared with each other by pure string comparison In computer science a string is a sequence of letters and special characters i e a character string Class Climate thus lays the character strings over one another and checks them for identity Decisive is therefore the number of different characters in the questions and the level of marking When you choose Automatic with text comparison a page opens where you can view the result of the text comparison The left questionnaire is the basis question naire the wording of which is carried over into the report Scantron Corporation 277 Copyright Electric Paper GmbH Ti n COURSE EVALUATION FEEDBACK SYSTEM Request preferred compilation Your choice Compilation name train_en train_en_1 Questionnaire train_en train_en_1 No of Surveys 24 No of completed questionnaires 304 The report creation may take a moment Please wail until an actnowledgment has been sent back from the server e Which gender do you belong to Which gender do you belong to male female male female a irat is your age What is your age 18 29 30 39 40 49 50 59 60 69 Older than 69 18 29 30 39 40 49 50 59 60 69 Older than 69 a What is your age What is your age 18 99 18 99 iv What is the grade of your last school graduation What is the gra
514. ponding PDF report a profile line at the end With regard to scaled and matrix questions it gives you an idea of how the interviewees voted As report creator you can compare the profile lines of the evaluated surveys with each other or with the profile lines of other reports available The profile line comparison gives you one or more PDF documents in which several profile lines are placed next to each other The following conditions are necessary in order to create these documents e You have already collected data e As a report creator you can manually recall or send documents for the existing data e The documents are independent of a specific PDF report and are not integrated as such You also have the possibility of displaying other comparison lines together in addition to the current profile lines in the automatically generated PDF report Whereby the following comparison lines are possible e Comparison lines from up to five previous periods as well as e A comparison line originating from a report of a report creator If the relevant data is already available in the system the relevant comparison lines will be displayed together with the profile lines of the survey in the profile line of the automat ically generated PDF reports You specify which profile lines you would like to see in a PDF report in the details of the questionnaire Main menu System Settings gt questionnaire list gt click on the name of the relevan
515. port with closed questions The part with open questions can take up a great number of pages Notes of a Survey You can display the notes of a survey in the PDF report by activating the option Show notes in the PDF report under System Settings Report Settings Configuration This option is deactivated by default Scantron Corporation 239 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate All notes of the surve Peter Brown 05 12 2011 at 11 21 52 The room was far too small for all particpants Internet was extremely slow Figure 255 PDF Report Display Notes of the Survey Additional information on adding editing and displaying notes can be found in chapter B 3 2 3 Survey Details Editing displaying notes General Configuration The PDF report settings in the menu System Settings Report Settings have to be con figured for each PDF report In the details of the questionnaires you can define a default PDF report for each questionnaire Thus you can configure an individual PDF report for each questionnaire 240 Generate letter Creates a letter for the PDF report In addition to the sender s address defined in the sections Sender part 1 part 2 and part 3 the letter contains the system logo taken from the setting in the organization profile and a predefined text which can be per sonalized using placeholders This text is l
516. port Department The Scantron Technical Support Department provides support to customers with current maintenance agreements Technical support is available Monday through Friday from 5 30 A M to 4 30 P M Pacific Standard Time PST Daylight Savings observed Scantron s support department may be reached at 800 445 3141 or via email at sup port scantron com In the main menu System Information you will find the option Send email to support in the sub menu on the left If you have a query addressing Scantron s support department click on this option The following page will open 14 Scantron Corporation Copyright Electric Paper GmbH Class Climate troduction COURSE EVALUATION FEEDBACK SYSTEM ih Class Climate Subunits Questionnaires System Settings i hil CORE Pen cate dee Ieee Send Email to Support Organization Sender Example Unwersity Sender name Sender ernal Phone Recipient inforrnatlor Module Moe beri General question Type Architecture Privileges o Subject Your message Documentation 2 Mamuak Sample Files AH About Class Cimate Protocols E Denvers Attachments Log Book Browse Add e Detetion Log B Veb Service Log SS A hind Teryt Log Meri Cancel Figure 2 Email to the Support Department This function enables you to send an email to the Class Climate support department Enter your name as well as your email address in the field sender
517. port for the President Contains an overall indicator for all surveys in the past semester sorted according to subunits e Report for the Dean Contains an overall indicator as well as individual indicators for all surveys in the past semester in his or her own subunit e Report for the Dean of Studies The dean of studies selects from a general list of all surveys in all subunits those which should be compiled in his report The report has the same degree of detail as for the dean General Settings First you must select a general setting Choose a subunit a survey period and a ques tionnaire and then click on Continue gt gt 326 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Report Creation SSS EEE EEE EE E Computer Sciences a WS11 12 a DEMOFORM Basic setting for result 9mies fallssi train_01 gt Continue gt gt bl Engineering E train_2 E i reports Professional Devenopment So tO Data Entry Demo Subunit WS09 10 train_en_1 Figure 378 Additional Reports Basic Settings The general setting can always be selected again at the bottom of the screen generating reports and applied with Next Report Creation o B a t A Computer Sciences a z Basic setting for i ete _ontinue gt ngineering result reports Professional Development _Data Entry Demo Subunit 4
518. possible options connected with the ratings too few just perfect too many The positive judgments lie in the middle when the interviewees choose just perfect respectively the value of 4 To inte grate these questions into the quality guideline in a meaningful way first choose a ques tion and define the first side of the scale to be negative left of the middle For evaluation results below a certain threshold e g 2 5 you have to make a quality deduc tion As normal you have to define a range of tolerance here e g 2 0 to 2 5 For the other side of the scale right of the middle you have to choose the question once again Now you can say that results bigger than the upper threshold will also cause a deduction of quality e g the upper threshold may be 6 again with a chosen range of tolerance In this way you ensure the level questions are interpreted in a meaningful way in regard to the quality guideline If you integrate level questions into the quality guidelines the total quality percentage of all scaled questions can exceed 100 because each of the level questions needs to be included twice 352 Scantron Corporation Copyright Electric Paper GmbH X Class Climate oua Frequency Based Quality Guidelines As an alternative to the averaged based quality guidelines discussed above you can set so called frequency based quality guidelines In this case the decisive criterion is not
519. prehensible way it y na av 5 2 md 5 v 0 7 Figure 477 Analysis of Scaled Questions Open Questions Responses to open questions are automatically recognized as answered during process ing and are integrated in the report document as image files If the responses have been manually anonymized or are part of an online survey then the responses are in machine print and can be exported together with the raw data Please give us your feedback about the instructor as well as suggestions for improvement Udy mwe and Hitadly 2 G Q od TROL ory Ye age A Ue Sons P Figure 478 Illustration of a Result of an Open Question as Image File 406 Scantron Corporation Copyright Electric Paper GmbH Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM Please give us your feedback about the instructor as well as suggestions for improvement E Very nice and friendly E We had enough time to ask questions Figure 479 Illustration of a Result of an Open Question in Machine Print Form Grade Values Survey participants check a value paper survey or give directly a grade value online survey What is the grade of your last school graduation a e O no dev o0 4 Figure 480 Illustration of a Question with Grade Value Single Choice 1 of n A single choice question has multiple answer options of which only one can be selected e g age gender etc Generally
520. processed X forms The survey was correctly processed 1 12 2 Mail Service Log Emails from scheduled tasks are sent in the background by the service Mail Service This service can provide detailed information in case of problems All errors are docu mented in the menu System Information Mail Service Log After each administrator s log in Class Climate checks if any errors have occurred If new errors have been noted a message appears in the menu Subunits with a reference to the mail service log where the error message can be confirmed Mail Service Log W There are 99 Log entries available All entries m Show Entries per page 15 Show Page W 1 Show gt H Log ID Object Description Type Message Date Confirm error 99 Mail Service started i 20 05 2011 at 13 50 11 98 Mail Service started a 17 05 2011 at 09 47 45 97 Mail Service started Q 16 05 2011 at 16 24 29 96 Mail Service stopped 16 05 2011 at 16 20 59 95 Mail Service started i 16 05 2011 at 13 58 32 94 Mail Service stopped i 16 05 2011 at 13 54 59 93 Mail Service started i 16 05 2011 at 13 53 24 92 Mail Service stopped 3 16 05 2011 at 13 49 44 Figure 596 Mail Service Log If the Class Climate server is temporarily switched off after the new login a message appears reporting that the mail service does not seem to be functioning When the mail service notifies Class Climate that it is active again the message
521. pyright Electric Paper GmbH Class Climate Filter Settings Validation Required Questions Cross Tabulations COURSE EVALUATION FEEDBACK SYSTEM surveys are to be grayed out or completely hidden It is possible to hide questions in all three display modes for online surveys per chapter per page and complete Display of filtered questions in online surveys 0 Filtered questions are deactivated displayed grayed out 0 1 Filtered questions are hidden invisible as such no longer visible for the participant Figure 551 Settings for Filtered Questions 5 3 Validation By defining validations you can test entries to open questions and matrix fields in online surveys with value ranges and regular expressions before a survey participant can send the questionnaire Validation Question to check Range of values Options Add question What is your age 7 Add Figure 552 Validation To create validations select a matrix field or an open question from the list and click on Add Now select which values can be accepted e Numbers only Here you can delimit the value range by storing a minimum and max imum value e Letters only i e no blanks e Letters or numbers only e Date e Pattern simplified syntax By default the following templates are available three digit number word underscore number serial number All three examples are based on the follo
522. quires advanced object oriented PHP program ming and extended knowledge of accessibility requirements To access these functionalities start by copying the whole online default template you find in folder C Apache htdocs classclimate application modules online templates onlinedefault Here are the objects in this folder files and subfolders 158 Scantron Corporation Copyright Electric Paper GmbH Class Climate element i images di partial formecontent phtml _ lanquageselector phtml layout phtml login phtml 4 onlinesurvey css _ organizationheader phtml _ pagination phtml __ submitted phtml _ surveyheader phtml Figure 145 Content of the Folder onlinedefault Each part of your online survey is available for you to modify it the login screen the way pagination is dealt with the header the content of the form etc Most important the CSS style sheet onlinesurvey css allows you to modify almost everything as each object of the online survey layout is described by a style In the subfolder element you find files describing how each question type single choice scaled question multiple choice question and so on will be displayed In the subfolder partial you will find how errors and warnings such as please fill in this required field or only numbers are allowed in this field will be displayed You can add further files you would li
523. r GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Section 2 1 4 In Adobe Acrobat placeholders are defined in the text field at Options Default Value For example To GENDER TITLE FIRSTNAME SURNAME confidential e subject This field is filled with a heading or the subject line of the letter The subject line can be defined in the Class Climate menu item Text Template see Section 6 7 e text This field contains the personalized text of the letter for the PDF report The text can be defined in the Class Climate menu item Text Template In Adobe Acrobat the templates must be saved by Save As so that the internal PDF structure is clean 2 3 Process Defaults In the menu System Settings Process Defaults you can set the defaults for the config uration of user accounts The configuration of Class Climate user accounts allows you to customize the surveys to your requirements The following points are available When creating surveys automatically send emails with cover sheet questionnaire PSWDs only activated instructor accounts This option sends the cover sheet or personalized form for your new survey immediately after creation of the survey to the email addresses given in your profile Make own utilization statistics available for other instructors only activated instructor accounts The information contained in the utilization statistics conc
524. r Preview Please note that those labels between the two poles are not linked to the scaled question and will not be visible in the PDF report or exports 428 Scantron Corporation Copyright Electric Paper GmbH A i a H th Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 8 3 Inclined Pole Labels In addition to horizontal and vertical pole labels you can also use inclined pole texts for paper surveys You can define the degree of inclination under Extended Pole labels t Extended Pole Labels Extended Pole Labels Option strongly Agree Agree Rather Agree Rather Disagree Disagree Strongly Disagree Abstention Degree of inclination Piease notice that the inclination of the ang z iE shown in the preview of the VividForms oe d to technical reasons 55 and software components Thanks for attending the sy gg etping us improv ase ArAnA Figure 520 Inclined Pole Labels Degree of Inclination As you can see in the above graphic you have eleven different degrees of inclination to choose from The following graphic shows you the preview in the VividForms Editor which is identical for all levels of inclination Scantron Corporation 429 Copyright Electric Paper GmbH AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Creating Questionnaires with VividForms W 2 g in 4 g eg Z a o 909 Fy i i if EEE
525. r RELOAD F5 as this results in the submission being repeated Language English Recipient 5oe doe example com m miller example com s brown example com p bowman example com j black example com f hernandez example com h james example com example com mple com mme 2 cnag mii Q EE E survey Number of participants for calculating response a rate 9 J Finish Data Collection Close Survey 3 Delete Survey fa Assign survey to substitute instructor Li Edit Show notes Figure 156 Sending passwords to participants 3 2 8 Adding Questions Using the Instructor s Optional Questions The function Instructor s Optional Questions was developed in order to give instructors also in the Central Evaluation the opportunity to create their own individual questions for the questionnaires for their courses Scantron Corporation 169 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM Class Climate COOL CALLAN IE sirom pretii Questonnaires System Settings System information Search S544 i j ane amp instructor s Optional Questions Class Climate Admin a Activate Remind Deactvate Admantsiratar Sending emails to instructors Subunits n 1 Subunit 2 Survey Pernod 3 Course Type 4 Questionnaire ever Business Sluches A j 3 i T Computer Science MATEY en WS Hi he inimes Perra uh i
526. r experience in program ming nor technical knowledge is necessary For a comprehensive introduction it s best to work through the manual chapter by chap ter Should you wish to look up certain steps the index will lead you to the topic in ques tion When working with the manuals PDF version the index will also appear as bookmarks on the left hand side of the screen enabling you to navigate to the relevant chapter In addition you will find an index at the back of the manual where you can look up impor tant terminology and topics in alphabetical order The manual s structure is based on the operating steps of the evaluation Following the first three chapters that relate to the basics of the system the initial operation and secu rity specific operations are introduced as and when you need them during the evaluation The manual follows a so called phase model that illustrates the workflow which you may have already come across during Class Climate training It will be dealt with in depth in this manual Scantron Corporation 11 Copyright Electric Paper GmbH mate Preparation and GeneraiNowes C Class Climate A major part of the evaluation is the creation of questionnaires Class Climate offers you a tool for creating questionnaires the VividForms editor and the VividForms Designer optional In order to enable fast access to the explanations relating to the editor you will find a chapter on VividForms after the illus
527. r last school graduation How many terms have you been studying so far Main subject Do you already have a university degree or a degree of another institute in tertiary education Figure 553 Configuration of Required Questions 450 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Filter Settings Validation Required Questions Cross Tabulations COURSE EVALUATION FEEDBACK SYSTEM To define the required questions select one or multiple questions and click on Save The selected questions will be displayed with a blue background 5 5 Cross Tabulations In order to use cross tabulations this function must be activated at System Seittings Report Settings Configuration Create cross tabulation Select from both lists the variables you would like to use You can use scaled questions as well as single choice questions with as many as eleven choices Cross tabulations Matrix 1 eaoh 4 Whatis your age z 7 Question 2 The technical equipment of the university is excellent Hew ccs Question 1 ja tabulation Add Question 2 bd Figure 554 Create Cross Tabulations The upper question is displayed in the X axis while the lower question is found in the Y axis of the matrix The number of cross tabulations is unlimited In the PDF report two cross tabulations per page will be displayed 33 3 33 3 33 3 0 0 17 6 235 11 8 29 4 118 x What is your a
528. r or the administrator 374 Scantron Corporation Copyright Electric Paper GmbH COURSE 8 Cli mat SYSTEM 2 Change the attributes of the user Mr v Title First name Last name Phone Email john doe example com Address Language Default language Login name New password KIILI HOO SEOESOHORESOSSOOOEEOOOe Confirm new password LDAP registration Deactivated w Figure 440 Create a Module Step 2 After filling out the fields click the button Save The module account is now created in the list of users 5 ton ST E amp Donna Harwood 0 07 0 05 11 2011 4 2 amp M Select all _ Move selected to Economics 3 Class Climate Basic Training n Doe Figure 441 Module in the User List Scantron Corporation 375 Copyright Electric Paper GmbH mate Your Evaluation Process The Phase Model AN Cla UldSS ss Cli mat E 7 6 Creating Module Courses After the module account has been created courses can be added to the module To access the course list click on the number in angular brackets in the column CO Course By clicking the button Create new course you can add a new course to your module Apart from entering the name of the course at least three further entries have to be made which are essential for a successful conduction of a module survey e Enter an ID for the course in the field Course ID This ID defines in w
529. raged Verify Back Figure 303 Report Creator Subunit Report Selection of Elements and Properties In the figure the subunit report is created based on one questionnaire If several ques tionnaires are displayed for the selection in the list you can mark these then however you must decide to either go with the automatic text comparison or with the manual assignment in order to combine the reports Give the report a relevant name so that later you are able to relate to what was summa rized and make a selection regarding the open questions and the weighting of the sur veys that you compile As soon as you Click on Verify Class Climate calculates how many surveys suit your selection In another window you are again informed of the details of the summary before you actually produce the report 282 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 4 Advanced Reporting COURSE EVALUATION FEEDBACK SYSTEM Request report on a subunit Your choice Subunit Professional Development Compilation name Prof Development WS Questionnaire train_en Period W3S10 11 2010 09 01 to 2011 02 28 No of Surveys 3 No of completed questionnaires 46 The report creation may take a moment Please wait until an eccnowledgment has been sent back from the server Create xy Choice train_en Which gender do you belong to male female What is your age F 18 29 3
530. ration The secure storage of documents in the Class Climate database means that they will be there when you need them e g email delivery Uploading Documents Please enter the following information in order to upload documents Description Description of the document File name path to the document on your local system With a click on Save you can upload the document to the server In the table you can now see more information about the document columns 3 4 498 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Size Size of the uploaded document in bytes Type File type of the document mime type Updating Documents Changes to documents must be first be done locally on a workplace computer Then upload the modified document again to the server Displaying Documents Display documents by clicking on the icon in the next to last column You will need to have the appropriate application software e g Microsoft Office for DOC files Deleting Documents Delete documents from the system by clicking on the icon in the next to last column All links to email types or to PDF report types are also deleted The size of the document is limited to 1 megabyte You can change the maximum size in the Class Climate settings Configuration General Maximum Size of Document 2 2 1 Email Attachments Every email type in Class Cl
531. re sponding norm values and a normed profile line is displayed in the section Overall indicators at the beginning of the report Interpretation is made easier with colored icons that signal if a result is to be interpreted as good or bad 5 Positive result 0 Neutral result B Somewhat critical result Critical result Overall indicators Dimension Value Norm value 70 100 130 2 Questions about the instructor 5 1 107 3 Questions about the course 5 2 110 4 Questions about the teaching material 5 2 108 5 Questions about the studying conditions 5 4 113 Figure 396 Normed Profile Line for Indicators In addition a detailed profile line can be activated in the PDF report which shows the norm values for all questions of the questionnaire System Settings Report Settings Configuration Show normed profile line This is displayed in the PDF report after the analysis of the individual questions Scantron Corporation 339 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Carlos Hernandez Graduate Survey 2011 Normed profile Subunit Professional Development Name of the instructor Carlos Hernandez Name of the course Graduate Survey 2011 Name of the survey 70 a5 100 115 130 Dimension Norm value The instructor is always well prepared H The instructor explains even complex topics in a comprehensible way 2 Questions
532. re stored in a so called NonForms folder meaning in a folder for non recognized image files In the case of online surveys of course no scanning is required The data will be trans ferred directly to the data base Once the data has reached the data base the user can access the data base via the web server with a web browser and view the results of their survey 18 Scantron Corporation Copyright Electric Paper GmbH thy Class Climate ee COURSE EVALUATION FEEDBACK SYSTEM 2 2 Web Accessibility in Class Climate The HTML content generated by Class Climate is optimized for accessibility Particularly for participants of online surveys special aids are built in to the display output Such con tent can be detected by so called screen readers and voice output can be used for a bet ter understanding This allows blind people to take part in online surveys easily and without complication scantron orientates itself on the Web Content Accessibility Guidelines WCAG 1 0 and partly according to WCAG 2 0 which in turn are based on national guidelines Such as BITV ADA or Section 508 As part of the Scantron quality management the graphical interface of the complete sys tem is tested for Web accessibility using suitable tools such as WAVE http wave webaim org o WAVE has detected no accessibility errors but you must still check your page to ensure itis actually accessible Subunits Questionnaires System Se
533. re stored in the details of a questionnaire it is possible to set an individual display setting for every questionnaire 1 9 4 More Tips for Avoiding System Overload Dispatching email If you send your email invitations to online surveys spread over a few days instead of all at once the feedback phase is also spread over a wider period This distribution in the feedback phase leads to continuous system utilization and helps to reduce one off access peaks In this way even at peak access times system perfor mance is optimally utilized Archiving Your existing PDF reports and CSV raw data can be archived by sending them to the email address defined in the configuration In this way legacy data can be exported with a complete audit trail and subsequently deleted from Class Climate increasing and maintaining clarity and performance of the system Please note that Class Climate is a productive system and should not be used as an archiving system see also chapter B 3 2 9 Batch Events System cleaning Please delete all reports compilations subgroup reports PSWDs deliveries and log book entries that you do no longer need via the system cleaning menu 478 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate System Management and Summary COURSE EVALUATION FEEDBACK SYSTEM System Information Thus the clarity and performance of the system increases see also chapter D 1 11 System Cleaning
534. reating questionnaires and reports to off peak periods Performance values of the system of the last 15 minutes 3 O S 0 80 ik u Ma E 0 60 i aw n ak 0 40 ah k O 20 aH aR 00 uw f j pJ A wo LF f oc 1 Ti Ti Di Ti nH Di Ti Ti Di m Ti Di Th an gt gt gt w ka aa be bao we ba be i gt Gi Gam C Cs _ lt lt gt Ca a i gt Ss a a x a a A S a z SI a z Si a Ww uw Ww Ww Ww Ww Ww Ww Ww Ww wa Ww Ww Ww Ww S S 3 S 3 S 3 3 S 3 S Wii Wy W F Ww we wi wi wi wi wi wo wi wi wi CJ CJ Ch tJ Li CJ CJ CJ Lia tJ CJ tJ tJ CJ ci Figure 590 Overview of System Utilization This option can be activated or deactivated in the configuration under System Settings Class Climate Settings Maintenance Measuring of performance values Also this is where the limiting values Yellow limiting value for performance diagram and Red limit ing value for performance diagram for the performance statistic are stored 1 9 2 List of all Active Users Logged In As a subunit administrator you will find a list of all logged in Class Climate users and online survey participants at the bottom left of every Class Climate page In this way you can see how many people are currently online and avoid an overload due to a high num ber of people being logged in at th
535. reator The report creator is a user created by the Class Climate administrator in order to pro duce summary reports for the captured data and to send comparative profile lines In practice the person in charge of the system s administration often also takes on the func tion of the report creator too Administrator and subunit administrators can therefore also take on the role of Report Creator in their user profile In order to be able to separate the functions there is a separate user role for the report creator in Class Climate Of course multiple report creators can be created in the system 268 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Fundamental Considerations and Settings First of all it is important that you carefully consider what insight the report creator should be permitted to have or must have e s the report creator supposed to Summarize the data of the entire system In this case please note that he can then also view this data lf you decide on this option you need a system wide report creator e Or he should only view data subunit wide That also means however that he cannot produce subunit comprehensive summary reports or comparisons respectively e In this case you should define subunit wide report creators e f your report creator may access several subunits please choose the option own subunit in the area Data access Subsequently mark all necessary su
536. reator access for example password language etc e The utilization statistics give you an overview of the activities of this report creator for example the number of the log ins the created folders etc e Deliveries informs you how many emails the report creator has already sent e The field System Info gives you an overview of the address data of the organization as well as of the individual subunits e Clicking on the option Send Email opens a page that enables you to send an email to any address e The option Manual below provides you with further information on Class Climate and the use of the program Here you have access to the online user manual for all active Class Climate users explaining the essential points on the user access in a much more compact fashion than the Administrator Manual at hand does 272 Scantron Corporation Copyright Electric Paper GmbH aa te L COURSE EVALUATION FEEDBACK SYSTEM Maria Report Report Creator Reports Folders Additional Reports E Reports System Settings amp My Profile system Information la Utilization Statistics Deliveries System Info Help C3 Send Email Manual Manual for Creating Questionnaires Figure 288 Report Creator Main Menu If you wish to create summary reports or send out profile lines this is not possible without a folder Therefore you should initially create a new folder by clicking
537. receive the following warning The preview of the online survey does not show all the functions of a real online survey It only offers you a visual preview lf you want to test temporarily saving or similar please generate a real online survey for testing Figure 122 Warning Message of a Preview of the Online Survey Scantron Corporation 137 Copyright Electric Paper GmbH a te amp Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM This warning makes you aware that the preview of your online survey is not a real online survey but solely offers you a visual preview Generating and Managing Time Scheduled Online Surveys Class Climate provides the option to run time controlled surveys The following actions can be controlled e Starting the survey and dispatching the PSWDs by email to the respondents e Reminder to respondents per email with PSWD e Closing the online survey and if necessary sending an email with evaluation report to the instructors These actions are managed separately in the so called Planned Operations The activation and settings of the time triggered control system are dependent on each survey That means that the process of each online survey can be separately controlled An overview of all planned operations can be found in the menu item Settings Planned Operations e Activate Time triggered Control To activate the time triggered control w
538. rent available raw data This means that you can scan new data in at any time and the reports are modified accordingly If you wish to avoid the scanning of further data and so modify ing the PDF report its best to simply close the survey 222 Scantron Corporation Copyright Electric Paper GmbH X Class Climate The reports give you an overview of your survey s results by means of different elements For feedback on the evaluation results a PDF report is usually sent by email to the rele vant people In Class Climate you can also automate this dispatch You can of course as with any PDF file save the report in your file system and send it yourself through your email account Saving the PDF report in your system however this entails that upon scanning of further data the PDF report in Class Climate and your saved version will dif fer Only the report in Class Climate will be automatically updated Since the PDF report is clearly utilized much more often than the HTML report you are offered various configuration options with which to customize the report according to your needs There are the following ways to configure e the menu Report Settings in the main menu System Settings e the questionnaire specific settings in the edit mode of the VividForms questionnaire such as diagram type of scaled questions indicators cross tabulations e the questionnaire specific settings in the questionnaire s detailed view
539. resentations will not be asked online surveys or not analyzed paper survey Filter settings Item triggering filter Value Options have already been in the refectory Field valuesjro Remove Select items to be skipped Questic ene i ie ns a h Save ee Be ee MME Te RIE IE Ct ESTE Te The meals in the refeciory are always warm The meals in the refectory are always fresh I The meals in the refectory are always tasty The unwversity is connected to the public transportation very well The technical equipment of the university is excellent I got access to the technical resources computer centre etc very quickly duly got introductions into all the necessary hardware and software components Figure 550 Filter Settings Selecting Items to be Skipped E In order to create a filter setting select from the list a single choice question and click on Add Now select a response value for which the filter setting should be applied In the lower area you will see a list of all the questions following the filter question You can now high light all of the questions that should not be displayed or should not be analyzed When you are finished click on Save Repeat this procedure for each additional filter setting The system settings System Settings Class Climate Settings Survey Online Display of filtered questions in online survey determine whether deactivated questions in online 448 Scantron Corporation Co
540. review Online Survey You have the possibility of displaying a preview of your online survey either in the details of a survey or in the questionnaire details In the details of a survey as you can see in the following graphic click in the area Actions on Preview online survey 136 Scantron Corporation Copyright Electric Paper GmbH EN COURSE EVALUATION FEEDBACK SYSTEM Show PSWDs in browse C Receive PSWDs by email C Send PSWDs by email to respondents g Download PSWDs in CSV File wr Generate more PSWDs 0 q Number of participants for calculating response Scheduled Tasks Finish Data Collection Close Survey Delete Survey FA Assign survey to substitute instructor Lid Edit Show notes hh Figure 120 Preview of an Online Survey in the Survey Details You can also display a preview of your online survey in the details of a questionnaire by clicking on Preview online survey Details for questionnaire Quest_01 Quest_01 Evaluation Questionnaire W VividForms Editor 5 Copy and open the questionnaire in the VividForms esigner w PDF Sample Show w PDF paper survey Show f In the recognition set of the VividForms Reader Refresh E Preview online survey Figure 121 Preview of an Online Survey in the Questionnaire Details In both cases calling up the preview of your online survey in the survey details or ques tionnaire details you will
541. rmation of the certificate does not match that of the server if the lifespan of the certificate has expired or if the issuer of the certifi cate is not trustworthy This last point is often the case with self generated certificates 3 1 3 Adjustments in Configuration Texts Colors Documents You can also adjust Class Climate to your organization in several points Some text sent respectively shown by the system can and partly should be changed in the Class Cli mate Settings You can find these on the left hand side in the main menu System Set tings Your changes are only active when you save them For that purpose click Save at the bottom of the page With Undo you can reconstitute the default settings By changing the following settings you can adjust Class Climate to your organization e You can change the header of the login screen default is Course Evaluation Feed back System in the Class Climate Settings main menu System Settings On the page General you will find the option Title Login Window to change this title e For denied access you can define a redirection address at Class Climate settings network settings option HTTP redirection address The default value is http www scantron com e The so called support link can be found at System Information Class Climate Web site and provides you a quick access to the webpage of Scantron If you wish to change
542. rmation on handwriting recognition in open questions see chapter C 2 6 3 Open Question In this case the results of the ICR analysis can be controlled and if necessary corrected with the help of the WebVerifier Open questions without handwriting recognition are directly transferred to the database in form of an image and if desired can be further processed by the data entry assistant 4 3 8 Keyboard Control in the Verification There are a number of keyboard shortcuts that allow you to use verification without a mouse The shortcuts function in most current web browsers The actions are done by pressing the ALT key and a further key Please note that some keyboard shortcuts may be missing from some views ALT B Batch View ALT R Form View ALT N Search New Batch Seanov Table 12 Keyboard Shortcuts in WebVerifier 218 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 3 Capture and Instant Feedback 4 4 Manual Entry of Handwritten Comments If handwritten responses to open questions should be anonymized then for each subunit concerned the option display after manual collection in the section handling of hand written texts must be activated You can change this in subunit details For subunit details click on the subunit overview in column Edit on the icon 2 Subunit details Subunit Name Business Studies Dept No 2 Logo File
543. rocess defaults 0 0 00 cee eee eee 502 Defining access rights 0 0 0 0 0c cee eee 32 Defining general templates 452 Definition of norm values for questionnaires 342 Delete compilations 0 0000 0 eee 480 Delete Survey 0 ee eee 128 Deleting a group from the library 446 Deleting a question from the library 446 Deletion log 222 eucdew Code Fees Sect e eae dake 479 Deliveries 0 0 0c cee ees 480 Delivery ences Meese atone Keds eee 466 Display Survey 00 e eee eee 113 Documents 0 ccc eee ee eee 32 498 Download of reports 0 00000 ee eee 253 E Editing Question groupS 2 0 eee 404 Editing on questionnaires 0 0000e 455 Editing Participant Data 40 69 Editing participant data 0005 185 Editor Control naana 0 0 cee ee 389 Elid sete eee tt toe eet eres eee eae 465 HIME formal e454 de522be4ers0 eoeeneeee nes 495 Email accounts 0 0 eee 519 Email attachments 0 00000 eee eee 499 Email functions 0 0 ee 519 Entries in the log book 0 000 ee eae 480 Error Analysis of errors 2 0 ee ees 481 Evaluation 0 c cc ees 37 Central evaluation 00000 e eee 21 111 Creating of questionnaires for the module evaluation 371 Decentral evaluation 0 00 522 Lin
544. rof Development WS10 11 In addition you have per haps created instructor trainer reports like Belmore WS10 11 or Hernandez WS10 11 These reports created in the report creator can be defined here as comparative reports for special periods and subunits In the following example the comparative report Prof Development WS10 11 was selected This subunit report which was created by a report creator contains all survey results of the winter term 2010 11 for the subunit Engineering Once you have selected the comparative report define in the area Survey Period which period it should be used for You can only mark one single period lf for example you define here the period WS10 11 in all PDF reports of the surveys which were created with this questionnaire in WS10 11 the profile line will be supple mented they contain additionally the profile line of the subunit report Prof Development WS10 11 Additionally you define for which subunits the comparative report should be used for As opposed to the survey period whereby only one period can be selected in the area of Subunits you can define several subunits To do this press and hold down the Crtl but ton and click on the desired subunits Please note that a subunit administrator only has access to his subunit You can allocate subunits to a subunit administrator in his user pro file In the following screenshot you can see that the comparative report
545. rongly agree n 3 transportation very well rt Wr eo dev 2 1 Figure 243 PDF Report Detailed Report of the Scaled Questions This is the main part of the PDF report which can be deactivated in the menu System Settings Report Settings Configuration Analysis of single questions It is possible to remove single questions from the report using the PDF report definitions For scaled questions the following graphical representation styles can be selected Standard Histogram 0 0 0 16 7 83 3 0 Figure 244 Standard Histogram Bar Diagram Figure 245 Bar Diagram Line Diagram Strongly dis agree Figure 246 Line Diagram 234 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Ring Diagram E 6 O5 O4 Os D 2 Figure 247 Ring Diagram Pie Diagram Figure 248 Pie Diagram The diagram type can be selected for each scaled question using the VividForms Editor Maxi histograms The instructor is always well prepared The instructor explains even complex topics in a The instructor handles the technical equipment comprehensible way video projector etc without any problems Figure 249 PDF Report Maxi histograms Maxi histograms do not contain except for their size any differences in comparison with the description in Part 3 You can activate the creation of this part of the analysis at Sys tem Settings Report Sett
546. rs If the course is held by more than one instructor and if they are to be evaluated together using the same questionnaire and will receive the same report then add a 1 in the next column This indicates whether there is a secondary instructor for a course Information about additional instructors is collected in the properties of courses e User defined course fields Data fields to be entered in the administrator interface at System Settings Class Cli mate Settings course user data fields can be automatically imported Insert data col umns following the sequence first additional field second additional field and so on to the CSV files which then contain key words which you have also defined at Class Climate Settings course user data fields Please follow the sequence first secondary instructor then user defined course fields An example for a CSV data line along with these additional fields Instructor Mr Prof Dr Adam Smith a smith example com Math II 10574 v 02 104 Eco nomics 1 20 0 German Theory In this example the line was filled in with a O no secondary instructors as well as Ger man and Theory for user defined course fields for language of instruction and theory practice orientation aE ll Scantron Corporation 79 Copyright Electric Paper GmbH lass Climate CSV Import Procedure To carry out a CSV import for structural data go to the user list of a subun
547. rs in the list of reports HTML a Male Business Studies from Report of Train_en Data available aS train_en 05 19 2011 005 28 choose pdf repot CSVSPSS Figure 342 Report Creator New Subgroup Report in the Report List You also have the possibility of creating several criteria combinations If for example you wish to summarize the results of all female students who have the main subject Busi ness Studies or the results of all students between 18 and 29 who have the main subject Business Studies proceed as follows In the default criteria combination as you are accustomed set the criteria to female and Business Studies Then click on the button Add new criteria combination so as to cre ate a second group Criteria combination 1 Add new criteria combinatio The giteron will be added to the chosen citetia combination Add criterion 7 me i 3 Ss a Fa y Question Operator Value Options Default criteria combination Which gender do you belong to 2 female ag And w Main subject S Business Studies F a And Criteria combination 1 4 Figure 343 Report Creator Add new Criteria Combination This second group automatically receives the name Criteria combination 1 Add the cri teria What is your age with the value 18 29 and Main Subject with the value Busi ness Studies to this criteria combination 304 Scantron Corporation Copyright
548. rst name Form vi Survey ID __ Program of Study Scan Date Period Y Select all query result fields Select all search fields Attention this might cause long query time Figure 430 QM Views Field Selection Please note that it may not be possible to completely display more than 10 fields in the screen horizontally i e you will then have to scroll Also a large number of search fields will mean greater use of the database and a noticeably longer processing time By clicking on Select all fields of the search display or Select all search fields at the bottom of this view you can save time if you want to activate all of the above fields Scantron Corporation 367 Copyright Electric Paper GmbH oH Your Evaluation Process The Phase Model thy gt Class CI mate COURSE 35 UH mat SYSTEM Select all query result fields Select all search fields Attention this might cause long query time Figure 431 QM Views Select all Query Result Fields Defining the Sequence of the Fields After you have selected the fields you can change their sequence by using the option Sequence fields Highlight as shown in the figure a field name and then click on lt lt up or on gt gt down Filter Selection Standard Figure 432 QM Views Order Fields Saving your Search Settings i Hi j 3 fi l iai a bihe Field order 50 Order fields Surv
549. rst of all please change your user name password combination Click on My profile in the left navigation menu In order to return to this window click on Folders You can set up your Scantron Corporation 485 Copyright Electric Paper GmbH system Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM first folder a directory for surveys by clicking on Create new folder For further infor mation please consult the online manual We wish you success 2 1 3 Templates for Email Messages First you will see a description of all message types and then you will find details to the various placeholders available Report for the Dean Trigger Provided that the function Class Climate Settings Central Evaluation dean s copy report has been activated all users of the type dean will receive a copy of all PDF reports that have been created in a given subunit Content Personalized text for the processed survey PDF reports are sent as a rule In addition or as an alternative raw data as Excel readable CSV files can be attached see System Settings Class Climate Settings Email Functions amp Accounts Cover Sheet to Instructor Trigger The instructor has used an activated user account to create a Survey according to the cover sheet procedure decentral or the administrator is sending the instructor a cover sheet CE Content Personalized text with an attached cover s
550. rt Please also consider the setting Show notice for suppressed report HTML report Separate closed open questions When activated the results for open and closed questions in the HTML reports are dis played separately This results in better readability particularly of those reports created with a mix of open and closed questions HTML report Listing of open questions Listing and counting of comments in the report Create distribution for the report for the dean of studies This function shows the distribution of results from all reports and is only available for reports to the dean the dean of studies and the president There is a distribution graph for each active indicator of a questionnaire Open tree structure If this option is activated the open tree structure configured parallel to the standard structure will be activated Subunit administrator View the original recognized forms If this option is activated then subunit administrators can view recognized forms as PDF files Subunit administrator View survey results If this function is deactivated then subunit administrators have no authorization to view or export survey results Scantron Corporation 517 Copyright Electric Paper GmbH a System Settings and Management Class Climate Data entry assistant Verifier View entire original questionnaire page If this function is activated the data entry assistant and the verifier can view the entire questio
551. rt and export of secondary data Only the fol lowing form attributes can be imported or exported with the questionnaire e Filter settings e Validation e Required questions e Cross tabulations If the administrator exports a questionnaire with secondary data such as languages text templates norms etc these are automatically filtered out when the questionnaire is imported into an active user account 460 Scantron Corporation Copyright Electric Paper GmbH AN Class Clim ate system Management and Summary COURSE ath mat SYSTEM D System Settings and Management 1 System Management and Summary 1 1 Search With the search function you can search for users courses surveys as well as deliveries either individually or in combination The search function can be found on all menu pages in the upper right hand corner Enter your search term and click on Search All four categories are searched and you are directed straight to the search result pages a a th Class Climate Subunits Questionnaires System Settings System Information Search ee t ACL cpmene cratenrien FLLPBOGE Srstun ae lire hil List of all Subunits 3 Subunit s not visible Class Climate Admin Administrator AA Business Studies Figure 570 Search Function You can find the same results by opening the Class Climate search template at system information search and making no restrictions in search in th Clas
552. rther processing 1 Access to the VividForms Editor Using the VividForms Editor is possible not only for the administrator subunit administra tor but also for active users active instructors Whereas administrator subunit adminis trators always have full access to the editor access rights for active users can be defined in the user properties The administrator can make the following settings for each user of an active account 2 Change the user rights QM Views Only own surveys r dditional subunits for QM views Unrestricted access VividForms Editor Unrestricted access Extension of templates only No access e Figure 455 Access Rights for the VividForms Editor e Unrestricted access The user can create own questionnaires or work with existing templates e Templates only The user can extend templates with his own questions but cannot create his own questionnaires Scantron Corporation 385 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM e No access The user is not authorized to use the VividForms Editor to modify or cre ate questionnaires In the administrator s and subunit administrator s account you can access to the Vivid Forms Editor in the menu Questionnaires To create a new questionnaire click on the option Create Questio
553. rts e Text Templates e Report for comparison e Languages e Filter settings e Validation e Required questions e Cross tabulations You can get to the export function in the questionnaire detail dialog Questionnaires Questionnaire List Details The import of VividForms questionnaires is done in the questionnaire administration Set tings Questionnaire Activate the checkbox VividForms Then select a vfd file using Browse and upload it Questionnaire Import Browse MA VividFrorms rs new om Figure 568 Questionnaire Import You can also import and export VividForms questionnaires using active instructor accounts The active instructor will find a form import function in the questionnaire admin istration area Imported forms are subsequently only available to the instructor account owner In the list of personal questionnaires you will see an export function L which can create a vfd file Scantron Corporation 459 Copyright Electric Paper GmbH Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM Form Management Evaluation Quest_4 Questionnaire 1 Sea Template EAE Sample Questionnaire 2011 05 24 Sample 2 Template 16 31 39 3 K Form Import E Switch to Edit Mode Figure 569 Import and Export of Questionnaire for Active Users Active users have limited access to the impo
554. rveys is displayed This includes two numbers for each instructor separated by a forward slash e g 4 5 This corresponds to number of surveys processed number of surveys created CR Users in subunit Professional Development e Name CO Surveys Created Actions amp Philipp Belmore 2 7 7 09 06 2007 ALR C amp Donna Harwood 3 2475 08 17 2007 4 3 amp O amp Carlos Hernandez 3 3 3 08 17 2007 438 o amp DrRichelle White 2 o o 08 17 2007 A 3 amp O Select all L Move selected to Computer Sciences Move Figure 86 Accessing surveys within a Subunit The display 4 5 means that the user has created five surveys in his user profile for four of which returns have been received With a mouse click on the numbers in brackets you can access the survey results In the survey window you will see a table of surveys you selected according to the filter above depending on the status of the survey you can now initiate a number of different operations 114 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM All available actions and information about the survey can be found in the survey details which can be reached by clicking on the survey name With a click on one of the column headings in blue the window will be sorted according to this column You can sort the surveys according to e Type e Name e Sta
555. ry are marked with an L Library Course EvaluationlfL learned a lotin this course L Strongly Disagree O OF OF O O Strongly Agree learned more in this course than in others L Strongly Disagree O OF OF O O Strongly Agree After taking this course am interested in taking L Strongly Disagree O O OF O O Strongly Agree others in this field would recommend this course to my friends L Strongly Disagree O OF OF O O Strongly Agree Figure 544 Question Library Inserted Question Group and Questions in the Editor Preview Scantron Corporation 443 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM 4 2 Undoing the Connection between a Question and the Library You cannot modify questions or chapters from the library You will see this by the gray shading of the selection options in the properties dialog as well as by the symbol L lf you would like to edit a question from the library you must first undo the connection to the library by using the symbol The question can then be edited again t Question Wizard Please choose a question type Scaled Question Open Question single Choice Multiple Choice Matrix Field Grade Value Baci Next Apply Cancel Figure 545 Question Library Library Symbol You can detach the library question by selecting the question on the questionnaire and choosing the option
556. s in the menu Form Properties you can choose between two layout variations the Traditional Layout and the Optimized Layout New questionnaires are generally produced with an optimized layout which has an improved alignment of the checkboxes Existing forms that were created with earlier versions of Class Climate retain the traditional layout If these are copied for further processing the optimized layout can be assigned to them later The default setting for the position of the response options of single choice questions is anchored in the layout settings at the bottom The settings selected here next to the question text beneath the question text apply to all single choice questions that are newly inserted In the properties of each question the position can be adjusted manually if necessary 438 Scantron Corporation Copyright Electric Paper GmbH i A AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM W Questionnaire layout settings Questionnaire layout settings Layout selection Traditional layout Optimized layout mi ama a a a noone Bonne 0 EELIS Layout settings single choice Single Choice Position of the answer options next to the questiontext _Apply Cancel Figure 537 Adjusting Layout Settings 2 12 Adjusting Color Scheme Under a new menu item in the Form properties Change color scheme diff
557. s 70 181 Legal references 0 0 0 cc cee eee 181 Norm values for questionnaires 342 NOMINO 2 o t0 0440 0 Gade owe a ace ace oe oe eee 339 NOMMIG 6 oon 626 beens coms Ree ae eee hare 339 Calculat w 22684524454 5 243662n4 5252 boos 340 Notes of a survey 0 00 cee eee 224 239 O OMR Recognition of the checked boxes viaOMR 208 Online Design 0 cc ees 94 Online survey template Access rights 0 0 0 eee 163 Creat 355 2 25h ee be eee esas saeeaes ees 152 Online SurveyS 00 c eee eee eee 510 Accessibility 0 ccc eee eee 19 Advanced Configuration 0000 eee 96 Certificate of Participation 96 GONGUCHON lt 2 ec00s40endeee cb aserdeeedex es 136 Design x nt toe ae ae A eR Ree Nea dua dee on 94 Effective management 000 eee 136 Forwarding 0 0 cece eee ee eee eee 96 LANGUAGES 06504 208d Hees weds ee ee bee 146 LAVOUL seee dee deere eo eae eee ee 151 Mobile devices 0 0 ee eee 151 Participation Tracking 00 ce eee eee 145 Password based 0000 eee aes 110 167 PIEVIEW g24 22 656 es oe rs bee geen eee Ee 136 PSWD procedure 0 0 0 eee ee ees 109 Results for participants 0005 163 Time scheduled surveys 0000 eee 138 Open question Handwriting recognition 000 415 Segmentation 0 00 eee 41
558. s Climate Subunits Questionnaires System Settings hil COREL CRA PLEO TERT sQ Class Climate Searchmask ai ii H Courses Surveys Deliv eries Class Clmate Admin Administrator z Users search Information Cd Send Email Figure 571 Searchmask Scantron Corporation 461 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM For the search text you may use the following operators Without operator day Entering day as a search term leads you to day Monday Daytona daylight Wildcard characters are automatically placed before and after the search term The same as the search term day or day The search term day will just return day Alternatively you can use day In contrast to day day can be expanded by an asterisk that is tday which also returns the term Daytona Exclude a term day Monday Returns day Tuesday Daytona etc but not Monday Greater than gt 10 Returns number entries that are greater than 10 Smaller than gt 10 Returns number entries that are smaller than 10 You can combine more than one search term e g day Henry Maria searches for text passages in which the terms day and Henry but not Maria are found 1 1 1 Searching for Users Searches for users are conducted in t
559. s Climate Admin switching between the open browser windows Class Climate users The administrator as well as subunit administrators can take on additional roles in their user accounts which means from their account they can perform other functions such as report creator data entry assistant or verifier without having to log in as a separate user The additional roles are assigned by the administrator and can only be adjusted by him After logging in the administrator or subunit administrator can switch between user roles via a drop down menu in the upper left corner of the screen Class Climate Subunits Questionnaires System Settings Au COURTE CTALEATIOH FLEORLEE STENCH List of all Subunits f by Business Studies Report Creator Data Entry Assistant Lts _ 3 th Computer Science Figure 28 Switching between User Roles The Class Climate User Types Administrator The administrator manages the complete system and sets up user accounts question naires as well as the configuration In the central evaluation procedure the administrator manages all surveys as well as their reports Subunit Administrator The subunit administrator has a user account that allows the administration of all of the activities in the subunit Within a subunit the subunit administrator can set up user accounts create questionnaires start surveys and send reports One or more subunit administrators can be created per subunit
560. s a question to be verified You work through the questions one by one until you are finished verifying all the questions in the batch or in the survey or in the form m Reader errors and warnings 4 Question has more valid answers than permitted __ 36 49 Figure 215 Verification Processing Status and Messages The current processing status is shown in a bar in the upper left corner of the screen The green area symbolizes the questions that have already been corrected while the red area shows the number still to be corrected The number of questions is also shown Left of the bar graph you can see the status messages from VividForms Reader The three most common alarm signals are e The fill value of the response field is borderline e More than one checkbox has been checked for this question e The fill value of the checkbox field exceeds the upper fill value cancel checkmark Below the header you can see the original image box and below that the correction view In the correction view you can see the solution VividForms Reader suggests A click on the image box enlarges it in a separate window Scantron Corporation 213 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate Reader errors and warnings Filling degree of checkbox is marginal 4 Filling deg is margi wee Scanned Question You are ik male O female Revision Single Choice You are
561. s and operating sys tems and are easy to generate you can import the relevant data directly into the Class Climate database system You will find an example of a CSV file on the documentation CD The file is created in cooperation with the administration as well as the IT support team of the subunit concerned Scantron Corporation 77 Copyright Electric Paper GmbH Class Climate Your Evaluation Process The Phase Model COURSE EVALUATION FEEDBACK SYSTEM The following structure is necessary for CSV import files Instructor Data Course Data Func Title 1 Tite2 First Last Email Course Course ID Course Program Course Number tion Name Name Name Location of Studies Type Partici pants Examples Instruc Mr Prof Dr Ned Overend over Math 10554 v 02 105 Economics 1 34 tor end exa mple com Instruc Mr Prof Dr Edward Mont montg ex Math II 10564 v 02 123 Economics 2 20 tor gomery ample com Instruc Mrs Prof Dr Mary Cheva m cheva 20 tor lier lier exam ple com Table 2 Structure of the CSV File A line of the CSV file looks like this Instructor Mr Prof Dr Ned Overend overend example com Math I1 10574 v 02 104 Economics 1 20 Column Function Function Keyword Instructor or Dean Dean of Studies Data Entry Assistant Report Creator these user types cannot be given course data Title 1 Keyword Mr Mrs Neutral or custom title Title 2 Max 50 characters optional field First Na
562. s found for a question are determined invalid e One checkmark and correction s found All cases in which a checkmark and one or more corrections is found are automatically determined valid with the corresponding checkmark With one or both of the options selected the verification is initiated by clicking on the icon EE the relevant cases are then filtered out of the list of elements to be verified Scantron Corporation 215 Copyright Electric Paper GmbH Class Climate 4 3 6 Check Filling Degrees In the batch view the section Filling Degrees appears in the table Using the PDF icon here a PDF file can be opened which contains the scanned pages with all of the degrees of shading measured for the check boxes and open questions If the ICR recognition handwriting recognition is in use the characters read can also be viewed in this file F ei ppc uecyIees Figure 219 Verification Check Filling Degrees The presentation provides a good overview of the values measured and allows for con sideration of adjustments to the OMR threshold As in this PDF file only data above the minimum degree of shading standard 15 is shown the minimal degree of shading can be experimentally lowered to 1 so as to get a clearer insight into the degree of shading of empty unchecked check boxes For expedient OMR thresholds it is important to keep a sufficient gap between the degree of shading of empty check boxes as
563. s with raw data as well as statistical indicators e The contents as well as the evaluation rules governing all questionnaires e Operating data logbooks survey periods PSWD lists You should regularly backup the database In case of a MySQL database the MySQL service must be stopped first Therefore open a command line by Start run type cmd and press enter Type net stop mysql and the database server will stop You can then save the contents of the folder C apache mysql data classclimate2 and start the MySQL service again To start the database server enter the command line net start mysql Close the command line by entering exit If you use a MS SQL database please consult your database administrator Additionally the Apache resp IIS service should be stopped because otherwise further components attempts to access the database might fail The corresponding command is net stop apache2 resp net stop w3svc After the backup the service can be restarted by the command net start apache2 resp net start w3svc Generally it is advisable to stop all Class Climate services before carrying out the backup The further services are e VividForms Reader Service for form reading e Cron Service for initiating scheduled tasks and performance checks e Memcached Server Service for having in store templates of online surveys on the server e ESCCMailservice for sending emails via
564. save your changes by clicking on Save at the bottom of the page Scantron Corporation 267 Copyright Electric Paper GmbH a a Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Using the button Set new indicators the indicators can be set up manually After clicking on the button the questionnaire is shown in the overview Again a name for the indicator must first be given and then the individual questions can be selected by activating the checkbox By clicking on Save the new indicator is added to the list of indicators Free indicators are displayed in the PDF report if the calculation of indicators is activated in the configuration of the PDF report Overall inhi CAROES sd av 5 1 Instructor j dev 0 5 w 52 Course j l i dev 0 6 1 2 3 4 5 6 er Teaching material ECT T_T H dev 0 6 Figure 282 Free Indicators Display in the PDF Report 5 2 Creating Reports and Comparative Profile Lines As soon as you have scanned data into Class Climate for a survey and or received data during online surveys a PDF report is generated automatically with this data The more data you scan the more important it is to be able to compare and summarize this data For these purposes there are several aids available in Class Climate One of these is the functionality of the so called report creator which is presented in the following 5 2 1 The User Role of the Report C
565. scecova neascniansdbegeceensest seers posesucexwacnseciceun 2 3 VIEWING OPTIONS siseceieicticnccacrotiecduadiensisiecie cticnsiluescupauteionsdandeincredenlenbeddieamosisiemwtene 2 3 1 PAPER VIEW o cccccccccccccccecsceeseceueceeeseeceueeeeuseeseueeeuuueeesuueeuueaeeueesaeeeueeuaess 2 3 2 ONLINE VIEW sets dec at na eeceer codec tema eerste aaea 2 3 3 PREVIEW FUNCTIONS cccccccceccceseeceeeseueseecseuseeeseaeeeeeeuseeaeseueeaeeuaeeans 2 4 EDITING THE QUESTIONNAIRE HEADER cccceccecseeseeeeeeceeeeueeueeeuueeeueueeeeeees 2 5 ADDING AND EDITING QUESTION GROUPS cece ecccecceeeeecseeeeeeseeeenueeeeeeeeeaees 2 6 ADDING AND EDITING QUESTIONS u cccceccceccecseeeeeeseeceueeeeusuueeeueeeueuaeeaeeeaeenaess 2 6 1 OVERVIEW ON THE QUESTION TYPES ceccccscecceeeesseeseueseeeseeeeeesaeeenees 2 6 2 SCALED QUESTION ssccisisassuiveeinansndvaaaccundiiuassdnsscvssanievevabussandiiwadnsaeeveasans 20 3 OPEN QUE S TION sseouetcousetsimceesennonciaceatoonieouteubrrsdaesueoobrcuneasatieaccoanreteaies 2 6 4 SINGLE CHOICE MULTIPLE CHOICE QUESTION ccccceceeeceeeeeeeeeeeeeeees 2 6 5 HORIZONTAL MATRIX QUESTION ccccceccecseecseeseueseeesueeeeeeeueueeeaeeeaneuees 2 6 6 VERTICAL MATRIX QUESTION cecccccccccceceeceeecsueseueeueeeueeeaseeeueueeeeeueeeenees 2 6 7 GRADE VALUE o cccccccecceccccsceccueseecseeseueseucseueeueeueeuaueeueeeeeuaueeeeeeeueeeauees 2 7 ADAPTING THE SIZE OF ANSWER BOXES c ccccecseeceeeseeceeeeeueeuee
566. se a dummy course called General questions for means of survey ing general aspects concerning the whole module has been created as well as three reg ular courses The general course is surveyed with a general questionnaire course type Module general the single courses are surveyed with a trainer questionnaire course type Module trainer A secondary instructor is assigned to each course who will later on receive the report on his part of the survey Scantron Corporation 377 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM gQ Courses of John Doe Class Climate Basic 78 Training General S continuous General J 17 pic Stel 02 continuous Module 0 78 TEENA 03 continuous Ma z 0 79 Nomning and Quality 04 continuous Module 0 Guidelines Create new course Figure 443 Module Courses in the Course List 7 7 Generating a Module Surveys The generation of module surveys is done using the function Subunits Generate Sur veys Select the checkbox Switch to Module Surveys to show selections for modules You may generate either paper or online surveys 378 Scantron Corporation Copyright Electric Paper GmbH K Class Climat Pa Generate Surveys 1 Subunit 2 Survey Period 3 Module gt WS11 12 Class Climate Basic Training WS09 10 507 WSO6V07 S506 ws05 06 S505 iv Switch to Module Surveys
567. se standard deviation Hence for the example below the calculation is as follows 1 upper threshold value 3 5 1 1 1 4 6 2 upper threshold value 4 2 1 0 95 5 15 Base norm Generalnorm Legend Positive threshold 0 Negative threshold 1 y eat aa ae ay oh T a ia EL eA Bi mie Pe ttc Pa at oes be ee eee ae ee Wua lif a iida Ane ahnwt the ctii mna mene F i E G aT 1 iti E I 1 i 1 j Laity oude INS ADOUT THE siuuying conc ee P aa a ee a TESE MEER St ae ine 5 Fa T MrS J WUES duly got introductions into all the necessary hardware and software components Calculate threshold values got access to the technical resources computer centre etc very quickly Calculate threshold values Figure 422 Quality Guideslines Example Calculation when Lower Values are Better 6 2 4 Authorizing Access Rights to QM Views In order to grant for example a dean access to QM views a user account must be set up in the relevant subunit If the dean is already a user because his own courses are evalu ated then the existing user account can be activated for QM views amp Carlos Hemandez 3 L 17 18 08 17 2007 A O amp C amp Samantha Miller Dean 0 0 0 05 23 2011 A O amp Figure 423 QM Views Editing User Data 362 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 5 Quality Management To acq
568. set Francais For the questionnaire s French translation Properties Language French Current logo Wl M Please choose a flag Language Picture C Upload the file Browse English Higher Education w Linked System Language Linked language set English Higher Education English Higher Education system Enable Language English Please note that VividForms or Danish Deutsch Espa ol Francais aaeoa Nederlands Svenska cp xr Figure 134 Linking the Language Set with the Translated Questionnaire 150 Scantron Corporation Copyright Electric Paper GmbH X Class Climate Online surveys Customization of Used Layouts The layout of online surveys in Class Climate is handled by online survey templates A template is a sample that for example controls the color the insertion of logos or the questionnaire display In Class Climate there are four types of online survey templates e Predefined standard templates The predefined standard templates are firmly integrated in Class Climate and are used as default for online surveys e Customized online survey templates The customized online survey templates can be created in Class Climate without any previous technical knowledge or knowledge of programming The colors of these online survey templates can be adapted to your wishes your corporate design In addition an individual logo can be inte
569. sion e the default system language e the current configured language e the product derivative e the content of the configuration setting server root path e the ID of the supplier e aunique ID for the update check process itself which is added for reasons of security This information is SSL encrypted in its entirety and serves solely technical purposes No personal data or captured data from the system is ever transmitted lf you do not agree to the transfer of the above mentioned information this function can be deactivated in the system settings System Settings Class Climate Settings Mainte nance Automatic Update Check Independent of this function you will be informed of available updates through other channels Scantron Corporation 29 Copyright Electric Paper GmbH Class Climate If the administrator uses a secure https connection to the server and if the main server path in Class Climate is also defined for https like https example com classclimate and a secure certificate is not installed on the server the update check will not function Depending on the browser being used a warning from the browser appears after logging in Because the use of non secure certificates causes problems in other areas and browsers generally recommend not connecting to a server with non secure certificates it is strongly recommended to procure a secure certificate Certificates are rated as non secure if the info
570. siwndensenndapeuuecsaieaiuasslseebewusnee dencsuateatesseutubdubewmendootndeeveiesmeeesieedeeeatus 211 A rol 0d he E EEE 212 4 3 4 CARRYING OUT THE VERIFICATION c ccccceccceccececececussucseuseuueeuceeeesauueueeuaeeaueeaeeueueauueeenenss 213 4 3 5 AUTOMATIC VERIFICATION cccccccecceeccecseuceueceuceeeeeueeuceeaueuseueseueeuuueuesuueeaesueesuaueaeeueesauses 215 Scantron Corporation Copyright Electric Paper GmbH thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM 4 3 6 CHECK FILLING DEGREES ou ccc cccccccceccccsceccueeeecseeceeeeuceeueeuueeueseausaueaeseaueaeeeaeseausueueaeeneess 216 4 3 7 RESPONSES TO OPEN QUESTIONS cccccccececceceeseeseeseueeseeseeeuseeeeasueuueueuueuseeseusauseusenes 218 4 3 8 KEYBOARD CONTROL IN THE VERIFICATION c ccccceccsescecseeceeuseucseuseuueeuseueueueeuaesueueuneausss 218 4 4 MANUAL ENTRY OF HANDWRITTEN COMMENTS cccceceseeceeeceeeceeeceeececeseuueeueeeueseeeeeaeeeneeenes 219 4 5 INSTANT FEEDBACK THE PDF REPORT ccccccccceecececeeeeeeeeeeuceeueeeeueueceseeeueeueeeueeeeaneeaeeenes 222 4 5 1 COMPONENTS OF THE PDF REPORT ouu cccccccceseecseeseueseeeseeeeucseaeseueeueseueeueeeueeuaueueueaeeneess 223 4 5 2 PDF REPORT DEFINITIONS wicvossiannarnrsnnneaneeaebnoediinasnncneiainn aeneninndldaenae a 246 4 5 3 INDIVIDUALLY DESIGNED REPORTS PDF REPORT PLUGINS ccccecseesseeseeseeeeueeeeeeuees 250 4 5 4 DESIGNING AN INDIVIDUALLY CONFIGURED LETTER FOR SENDING REPORTS
571. son the VividForms Reader has at its disposal a file in XML format for every questionnaire which defines this form definition file XML is a description language The pool of these definition files is known as Recognition Set However Class Climate first makes such a definition file available to the VividForms reader when you have created the first survey with a new questionnaire regardless of whether a paper or online survey Only then at this moment is the VividForms Reader informed of your form and the checkbox areas on it This means precisely that the pool of XML files available to the VividForms Reader is only then complemented with the new XML file This then defines your new form With each new creation of a survey this XML file is refreshed As soon as you create a survey for a VividForms questionnaire a corresponding form definition file in XML format is added to the recognition set of the VividForms Reader The questionnaires scanned in are evaluated by means of these form definition files This 88 Scantron Corporation Copyright Electric Paper GmbH COURSE 3S UH mat SYSTEM thy AN Class CI mate Phase 1 Preparation of a Survey Period means that the VividForms Reader knows from these form definition files which parts of the questionnaire could contain crosses In the following graphic you can see a questionnaire for which a survey has not yet been created It is as such not in the recognition set of the Vivid
572. stion group to the respective quality guideline Like this the structure of a questionnaire with its question groups and questions belong ing to them can be directly adopted for the quality guidelines In order to convert guidelines choose the option Quality Guidelines in the drop down menu Advanced Settings and click on Edit You are now offered a dialogue where you can define quality guidelines Now click on Convert quality guidelines from indicators Course Evaluation Questionnaire Re calculate all Surveys Figure 413 Button Convert quality guidelines from indicators 354 Scantron Corporation Copyright Electric Paper GmbH thy Class Cl imate Phase 5 Quality Management COURSE ss Cli FEEDBACK SYSTEM After clicking on the button Convert quality guidelines from indicators the following win dow appears listing the content of the questionnaire with its question groups and ques tions Conversion of Indicators Lower threshold 0 Upper threshold 100 lower values are better w f Convert these indicators lower values are better The instructor is always well prepared Lower threshold 1 Upper threshold 6 lower values are bette w The instructor explains even complex topics in a comprehensible way Lower threshold 1 Upper threshold 6 Figure 414 Converting a Quality Guideline from Indicators Dialog for Conversion On the top left the relevant l
573. stions that indeed contain scaled questions W Question group Wizard New question group Page 1 Title 2 Questions about the instructor Presentation Slide Text Scaled questions with 6 options ME No indicator Font Size l Skata questions wih 2 options Text Element Sealed questions with 3 options Scaled questions with 4 options Scaled questions with 5 options ap Scaled questons with 6 options Scaled queshons with 7 options Scaled questions with 8 options Please give US yOUr feedback Scaled questions with 9 options Scaled questons with 10 options Scaled questions wih 11 options Figure 273 Indicators Editing Window in the Question Group 262 Scantron Corporation Copyright Electric Paper GmbH e Class Climate Phase a advanced Reporting The first specification of the window refers to the heading of the question group this however is possibly grayed in since you can no longer change it once the surveys have been created Below it you find information on the indicator If no indicator has been created so far it reads No indicator When you open the drop down menu you see that you can also select an indicator for all kinds of scales Make your desired selection here according to the scale of your scaled questions and close the window by clicking on Apply 5 1 4 Internal Consistency of the Question Group Cronbach s Alpha In Class Climate Cronb
574. surveys or Footnote for non anonymous online surveys These text templates are used automatically when sending the PSWDs to interviewee s Conducting Non anonymous Surveys Non anonymous surveys can only be realized by the subunit administrator Observe the following steps so that survey participant data can be used in Class Climate e Firstly import the participant data e Ensure that the questionnaire used contains placeholders for the participant data Otherwise the questionnaires used later cannot be assigned to participants in Class Climate e Create a survey for the relevant course Importing Participant Data You can import the participant data similarly as how you would import the email addresses for courses in the menu Subunits in the area Central evaluation Option Data import Central Evaluation Tree Structure fe Generate Surveys Display Surveys ie Delete Surveys QB instructor s Optional Questions Batch Events amp Display Courses D Scheduled son a Participation Tracking Figure 168 Data Import in the Area Central Evaluation Click the option Data import The following window appears 182 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Ys Data Import XML Import for subunits instructors courses and modules wet te Load XML File ee pee import Note You can find the CSW import for i
575. t Font size for presentation slides Font size of texts in PDF reports presentation slides Bar Mean Value Line thickness for mean value Bar standard deviation Line thickness for standard deviation Show recommendation text When activated a link for generating a recommendation document will be placed after the detailed norm profile line Scantron Corporation Copyright Electric Paper GmbH X Class Climate e Mode of calculation for norming 1 Mean value of the dimension Mean values of all datasets 2 Mean value of the dimension Mean value of the mean values of the data sets Please note In this case in each dataset the number of answers for each item must be at least as high as a defined minimum value see also Configuration of Norming You can choose between two ways of calculating the mean value here When choosing the first one the raw data of all given answers to the questions is taken into account for calculating the mean value When choosing the second one the mean value is calculated from the already com puted mean values for the questions those in turn have been calculated from all the answers of the interviewees e Minimum percentage of given answers to enable norming Percentage of answers which must have been given for the norming If less answers than this percentage have been given the norming for the dimension cannot be con ducted Attention The setting is only taken into consideratio
576. t a survey the system always has to be built up to the third level the course level By choosing a questionnaire as well as an evaluation period the survey for a course can be created The following figure shows an example of an organizational structure for a university 44 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 1 Preparation of a Survey Period COURSE EVALUATION FEEDBACK SYSTEM Figure 21 Example of an Organizational Structure of a University The functions for creating the organizational structure within Class Climate can be found in the menu Subunits Here the single levels can be created or imported and their con tents can be managed Furthermore you will also have access to the survey manage ment thy Class Climate Subunits Questionnaires System Settings System Information COREE CALITiITIOE CLE KTFTLE a E S List of all Subunits Class Climate Admin User Edit Delete Adminstrator tt Business Studies wa a a Elizabeth Doe Subunits thy Chemisiry a A Andrew Bennett Sa Sree E Computer Science a 0 R Gina King A Business Studie ans i wB 5 i Chemisiry AA an i on ee He Computer Scienc BS The Economics a2 E 4 Steven Jakes PN Economics l A Geoscience ED Geoscience wa A amp Henry Darcy Ph Linguistics l h Mathematics tty Linguistics a A X Roberta Lopez Figure 22 Menu Subunits Scantron Corporation 45 Copyright Electric Paper
577. t as a user license Data Entry Assistant This user type is important when handwritten responses by respondents are not to appear in the report document The data entry assistant can access the responses to open questions as sorted according to survey and enter them in plain text After a survey has been processed you will have a completely anonymized analysis available In order for this user type to be able to work you must under the properties of this subunit in Han dling handwritten text set the option Show after manual collection A user license is not necessary for the data entry assistant You can define individual access rights for each data entry assistant e own subunit data entry assistant has only access to handwritten comments of all surveys proceeded in own subunit e multiple subunits data entry assistant has access to handwritten comments of all surveys proceeded in the selected subunits Multiple selections of subunits can be made by pressing and holding down the Ctrl key e system level data entry assistant has access to handwritten comments of all sur veys proceeded in Class Climate 2 Change the user rights Data access own subunit m Assign additional subunits Computer Sciences i Engineering Professional Development canstation Demo Subunit _Data Entry Demo Subunit _ Verifier Demo Subunit _VividForms Demos _ Cancel lt lt Back aaa Figure 29
578. t criteria combination Add new criteria combinatio The giteron will be added to the chosen citeria combination Add criterion Subgroup 1 from Report of Train_en Note Data compilation may take a moment V Include answers to open questions Please click the button only once Figure 335 Report Creator Selection of Several Criteria Questions for Subgroup Reports In this window for example you can select all female interviewees as the first criteria To do this click in the area Available questions on the criteria Gender Choose on the right hand side the value of the criterion i e the desired answer for this question In this example you would choose female Scantron Corporation 301 Copyright Electric Paper GmbH Ti n COURSE EVALUATION FEEDBACK SYSTEM selection of several criteria for subgroup reports T Questions about yo l Which gender do you belong to What is your age What is your age How many terms have you been studying so far Main subject Do you already have a university degree or a degree of another institute in tertiary education The instructor is always well prepared The instructor explains even complex topics in a comprehensible way The instructor handles the technical equipment video projector etc without any problems Default criteria combination Add new criteria combinatio The citerion will be added to the chosen
579. t hours 66 7 because the instructor is really good 33 3 because it is important for my professional life 33 3 for the preparation of my exam 33 3 for other reasons 11 1 Figure 482 Illustration of a Multiple Choice Question Matrix Field The matrix field allows the capturing and evaluation of five digit numbers horizontal matrix question or ten digit numbers vertical matrix question Analysis of matrix fields can portray numbers in any dimension What is your age 18 26 22 2 a 2T 4 66 7 oo 42 11 1 Figure 483 Illustration of a Matrix Field Question 2 6 2 Scaled Question Select the question type scaled question and click on Next In the next step enter the question text and click on Next W Question Wizard Question text BIU J S got access to the technical resources very quickly Back J Next Apply Cancel Figure 484 Scaled Question The last step involves entering the text of the two poles and selecting the number of check fields You have the choice between two and eleven fields 408 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM The pole labels and the optional abstention text can be defined individually after enabling the checkbox individualize pole labels Otherwise these labels remain empty or will be defined by the horizontal or vertica
580. t interest to him lf your questionnaire contains a single choice question regarding the grade level you can then evaluate subgroups regarding the grade level 1 Questions about you Which gender do you belong to O male C female What is your age O 18 29 C 30 39 LJ 40 49 LJ 50 59 L 60 69 O Older than 69 Figure 330 Report Creator Single Choice Question Regarding a Respondent s Age a In order to produce a subgroup report click in the details of a report on Evaluate sub group the last option on the bottom right im Results in HTML format Results in PDF format individual Report 7 English Show Email amp Raw data in SPSS format E Raw data in CSV format Profile Line Show Lafa Automatic Manual J Kiviat diagram v Show Merge evaluations e 3 Evaluate subgroup Figure 331 Report Creator Report Details Evaluate Subgroup In turn another window opens that presents you with all possible types of questions on which you can evaluate subgroups Scantron Corporation 299 Copyright Electric Paper GmbH COURSE S GH mat SYSTEM Your Evaluation Process The Phase Model thy AN Class CI mate Evaluate the report according to the following criterion To the selection of several criteria for subgroup reports B 1 Questions about you What is your aga 1 18 29 How many terms have you been studying so far 1 1 Main subject 1 Angtsti
581. t levels For the whole sys tem in the menu System Settings Text Templates and for individual questionnaires in the details of a questionnaire menu Advanced Settings option Text Templates Set tings at questionnaire level have priority over general settings 2 1 1 Viewing Email Texts and Text Templates The key elements for these settings are the selected actions and the language Head ings text and attachment or PDF template can be defined for this combination The window for processing the text template is made up of five different areas Action In the action box on the left you can select an email type or a letter text Language Below the box Action you can select the language for the text The default language is the system language PDF Template or Email Attachment If you selected in the Action box a PDF letter then you will see PDF Template that is you can assign a PDF template for the layout to a given letter If you selected in the Action box an email text then you can add here one or more attachments Email attach ments and PDF templates are saved by clicking on the button OK 484 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Heading or Subject Depending on what was selected in the Action box you can define the heading text in the PDF or in the email subject line Text D
582. t opens click on the button Convert quality guidelines from norms Course Evaluation Questionnaire Re calate al Sune Figure 419 Button Convert quality guidelines from norms After you have clicked on the button Convert quality guidelines from norms a new win dow opens showing your questionnaire with all question groups and the scaled questions that were assigned to them as well as the mean and standard deviation of the norm base The conversion of the dimensions question groups of the norm base into quality guidelines is conducted as the conversion view is accessed Initially all questions within a question group are weighted equally within the quality guideline Scantron Corporation 359 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Conversion of Normings Base norm Generalnorm l Cancel f Convert this norm te Legend Positive threshold 0 Negative threshold 0 avg average dev standard deviation Quality Guideline 5 Questions about the studying conditions gt higher values better duly got introductions into all the necessary hardware and software components avg 3 49 dev 1 72 gt Calculate threshold values Lower threshold 3 49 Upper threshold 3 49 got access to the technical resources computer centre etc very quickly avg 3 57 dev 1 7 Calculate threshold values Lower thresh
583. t questionnaire Note You should login under the Class Climate user role which created the questionnaire Administrator Subunit administrator Profile Line Comparison in the PDF Report Add Previous Period In the details of a questionnaire you can define the number of previous periods which should be compared with the current period This means the profile line of the period of the current survey will be compared to the profile lines of the survey of the same course from the previous period In order to activate the profile lines for a questionnaire go to the questionnaire details in the area Advanced Settings and select the option Comparison report in the drop down menu and click subsequently on Edit Scantron Corporation 329 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM z r t j Class Climate Subunits Questionnaires System Settings System Information lt b ET ii iiaii pikinta taiti Pe ss hie r Details for questionnaire train_en J Copy and open the questionnaire in the VividForms Wf VividForms Editor Class Climate Admin Designer TOER w PDF Sample Show PDF paper survey Show ors recognition set of the ViadForms Reader Preview online survey Questionnaires Advanced settings Questionnaire 4 Questionnaire List EditForm Ea am 5 T i Edit Form Delete ad Create Questionnaire Tex Templates x Edil l a Export
584. taining a healthy lifestyle 47 Organization and Management Display Surveys Professional Development Philipp Belmore ssit Type Name a Status Forms Processed _ Form Report Export Actions Human Resource Management ARAF en i S 0271237 G g ail 3017 85 05 12 2011 OQ trainen Qa my Br ISPR Ve sca ele ccm a healthy oe D Quest_01 Show Questionnaire gj J amp Figure 116 Tree Structure Display Surveys Generating Surveys In order to use the tree structure to create new surveys in the panel actions select the option Generate Surveys On the left select the levels in which you would like to gener ate the surveys by checking the appropriate boxes Then on the right select the required survey periods and questionnaires If necessary you can also filter according to course type by activating the option Course Type By clicking on the button Show the courses are displayed in the list If required the name of the instructor can be displayed by selecting Show instructors By using the mouse and the control key any number of courses can be selected for which a survey is to be generated At the bottom of the window the various types of sur veys and their additional options verification timing are available Select a type of sur vey and if necessary the additional options and click the button Create Survey Scantron Corporation 133 Copyright Electric Paper GmbH EN e
585. tation Slide Text is shown where the desired text can be entered Each time you change the text length check to make sure that it fits in the field You can do this by opening a PDF report from a survey with the corresponding questionnaire 238 Scantron Corporation Copyright Electric Paper GmbH lass Climate Responses to Open Questions Comments Report Please give us your feedback about the instructor as well as suggestions for improvement Udy mitre And Picudly l We bod CQHENY lame Veo ask AUes konte Ky Herrender ua Very deveudly anel basha Please give us your feedback about the course as well as suggestions for improvement Cucsy tun ku i dhaub A 4 p Lew M s ae Khe alot secon a enjoyed Aea Curk a lot l Figure 254 PDF Report Responses to Open Questions The responses to open questions are shown as image box sorted according to question If an online survey was carried out then the answers will be displayed in machine print lf there are high return rates then this part of the report can be extensive depending on the amount of space given in the questionnaire You can separate the output of the responses to open questions from the part of the report with closed questions by activating the function System Settings Report Settings Configuration Separate close open questions This is especially recommended when there are high return rates in order to for example print out only the part of the re
586. tch mail by administrator 2 PDF lists of PSWDs is sent for printing and distribution to instructors Conditional email report dispatch send email report after scanning depending on the settings of the admin settings of the administrator at Process Defaults dep admin settings of the subunit administrator at Process Defaults user configuration of the respective user survey according to the information on the cover sheet Instructor s Optional Questions group address Group address to which the questionnaires personalized with the Instructor s Optional Questions are to be sent Sender name for all system emails Sender name that is used for all emails sent by Class Climate Sender mail address for all system emails Sender address that is used for all emails sent by Class Climate Email address of the support department This address will be used when sending emails to the support department Dean s copy evaluation When sending PDF reports via the Process Defaults the dean of the discipline subunit receives a copy of the instant report Dean s copy open ended questions The Dean s copy of the instant report contains responses to open ended questions Archive mailing of evaluation reports If activated a copy of each email concerning reports will be send to the configured archive address compare configuration Email address of the archive This applies to the reports of the central and decentral evaluation as we
587. te B Your Evaluation Process The Phase Model Over the course of this chapter you will be acquainted with the actions and settings which are important for your evaluation work with Class Climate This ranges from displaying the structure of your university or organization to creating questionnaires and implement ing and processing captured data Out of our experience a five step phase model has evolved that follows in chapter B and so will be introduced to you first This way you can get your bearings within the chapter and find relevant paragraphs fast 1 The Phase Model Your Workflow in the Process of Evaluation This chapter first offers a brief overview of the phase model before the respective phases are discussed in detail The following five stations show the implementation of survey periods in accordance with the procedure of central evaluation e Phase 1 Preparation e Phase 2 Implementation e Phase 3 Capture and instant feedback e Phase 4 Expanded reports e Phase 5 Quality management The single phases comprise of the following steps Phase 1 Preparation e Create the organizational structure Subunits instructors courses OR e Create subunits and import instructors courses CSV import OR e Import subunits instructors and courses XML import e Integrate the questionnaires e possible setting of additional report definitions e possible definition of norms and or quality guidelines e Generate
588. te that VividF orms only supports multiple languages for online surveys English Higher Education v_ English Higher Education v Figure 74 Languages Define Attributes e Name of the Language Enter the name of the language Scantron Corporation 99 Copyright Electric Paper GmbH e Language Picture Here you can specify the logo of a language that can be used for switching the lan guage in online surveys You should choose the size of the logo in such a way that the display is fitting i e for flags 40x27 pixels Either you activate the option Upload the file and then click on Browse and choose a graphic file The file formats JPG GIF and PNG are supported Or you use the logos supplied Here Class Climate offers you the country flags of the world to choose from Activate the option Please choose a flag and then click on the button Choose In the window that opens automatically you can choose the flag that fits the language e Linked System Language The language selected is used for the cover letter of the evaluation report and the email texts e Linked language set The language set selected here is used for the system dialogue for online surveys Language sets are defined in the menu System Settings Language Sets e Use Activate Deactivate the language Then click Save to save the main language You can add a new language with the but ton Add language First
589. tected against modifications This is done in order to guarantee processing of a form being used No changes of any sort to the layout or contents can be made to protected forms 7 1 Write protect Mode As soon as you generate a survey with a certain questionnaire it is automatically pro tected against further changes Write protected forms in the VividForms Editor have a yellow lock in the area Form Prop erties see figure Scantron Corporation 455 Copyright Electric Paper GmbH Creating Questionnaires with VividForms Class Climate COURSE EVALUATION FEEDBACK SYSTEM Form Properties Ad Q 732 O 148 uf To protect running surveys this questionnaire has been set to read only mode You cannot apply any changes which affect the graphical representation of the questionnaire Figure 563 Write protect Mode The following points have no effect on the display of the questionnaire and can so be modified in the write protect mode Building indicators for question groups Display of single choice questions in the HTML survey Options available include Checkbox List and Drop Down List For matrix fields number of groups in the evaluation report Limiting the maximum responses for multiple choice questions Selection of the diagram type for scaled questions in the PDF report Definition of filter rules required questions and cross tabulations In particularly exceptional cases
590. ted on 05 12 2011 at 10 53 36 Actions Maintenance Show cover sheet form in browser A Survey ID 15956 Change English m show Email Number of participants for calculating response fate 20 Accept Finish Data Collection Close Survey Delete Survey f Assign survey to substitute instructor id Edit Show notes Reload Back Figure 94 Survey Details Status In Progress Ready for data In the following graphic you can see the evaluation possibilities of a survey for which data is already available In this case considerably more options are available to you Here you can for example display the results in different export formats i e PDF CSV SPSS Scantron Corporation 119 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Survey Details 2 Survey History of liberalism amp Instructor Prof Dr Adam Smith J Course History of liberalism C Survey Period 5509 Type Online survey using PSWDs amp No of PSWDs 25 of 25 PSWDs are still available Questionnaire train_en Status Data available report available 2 Survey Created on Last data collection On No of collected questionnaires Show PSWDs in browser _ Receive PSWDs by email C Send PSWDs by email to respondents Download PSWDs in CSV File e Generate more PSWDs 0 Number of participants for calculating response Preview online s
591. ted whereby the survey anonymity should be preserved The Scantron Corporation 511 Copyright Electric Paper GmbH a System Settings and Management Class Climate COURSE EVALUATION FEEDBACK SYSTEM minimal return value defined here must be attained so that the information on participa tion or non participation of a specific survey can be released Please observe that under certain circumstances a value of 3 or less can compromise survey anonymity Allow password based online surveys Central evaluation If this option is activated a PSWD based survey for which PSWDs have not yet been sent and for which there are as yet no responses can retroactively be converted to a password based survey This option is only valid in central evaluations therefore active user accounts are not affected by this setting Display of filtered questions in online surveys 0 Filtered questions are deactivated displayed grayed out 1 Filtered questions are hidden invisible as such no longer visible for the participant Alternative forwarding including authentication Participants of online surveys can be directed to a different internet site once their survey is submitted The forwarding occurs based upon the forwarding address which is defined in the details of the corresponding questionnaire Each questionnaire can be given an individual forwarding address The following option determines whether the authentication for forwarding requires a va
592. templates in instructor accounts 454 Scantron Corporation Copyright Electric Paper GmbH Class Climate COURSE EVALUATION FEEDBACK SYSTEM Instructor s optional questions 169 Internal consistency 0 00 eee eee 263 K Keyboard control in WebVerifier 218 L Languages Multiple languages 00 ee eee eee 98 Layout Settings 0 00 c eee eee 438 Layout settings 0 0c c eee ees 438 Legal references in non anonymous surveys 181 Library Adding a group to the library 446 Adding a question 0 000 eee eee 441 Adding a question to the library 445 Deleting a group from the library 446 Deleting a question from the library 446 Question Library 0 0 0 0 ccc eee 102 Undoing connection between question and library 444 License User licenses 0 0 0 cee ee 474 License administration 0000000 472 Line eight 16404 hat Gee aida bara w aces Ph ace eae 433 Line space von244oueeheeseeee ed Fou ee beeee oH 431 LOG DOOK goitieti geste eos ds CDs ees aaa 481 Entries in the log book 00 005 480 Log File VividForms Log File 00000 e eae 483 Logs Deletion Log 0 ccc eee 479 Mailservice Log 0 cece eee ens 483 M Mailservice Log 0 eee eee 483 Maintenance 0 cee ees 526 D
593. tes the questionnaire and the survey data from the database Therefore Take care with ongoing surveys Note You will not be able to then create report documents for surveys carried out with this questionnaire You will be able to access the raw data though 92 Scantron Corporation Copyright Electric Paper GmbH F s Class Climate Phase 1 Preparation of a Survey Period COURSE EVALUATION FEEDBACK SYSTEM Reporting Options Online Design Mirrored scale values Show the header of the survey Allow Summary Reports Enable temporary save Survey Type 1 Show print option ALL Evaluation for participants Design Complete Allow result access None lw Certificate of None gt E F Display answers to open participation ALL x questions Advanced dit Computer Sciences al Lecture WST11 12 Economics seminar S511 Engineering Laboratory Tutorial WS 10 11 Professional Development Working Group S610 Scanstation Demo Subunit Others wWs09 10 _Data Entry Demo Subunit Modul General SUT _Systemiogins Modul Trainer WS506 07 Figure 68 Section Usage in the Details of a Questionnaire In the section Usage you can define the use of the questionnaire Form Activated or deactivated The latter is the soft solution Existing surveys can still be ana lyzed and displayed but you will not be able to create any new surveys Survey Type Either ALL or Paper Surveys or only Onli
594. the Edit Button column Action A window opens automatically displaying the properties of the course Scantron Corporation 185 Copyright Electric Paper GmbH a a Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Edit course of Philipp Belmore Course name Managing and maintaining a healthy lifestyle Program of study Economics Engineering Computer Sciences Course ID NA_1 Evaluation period continuous Course Type Seminar Location Sem 03 Enrollment Participants data english Central Campus Figure 174 Administrate Anonymous Non anonymous Participants lf you wish to edit the imported participant data click on the button Administrate partici pants In the following window you can edit green pencil and delete red cross each existing participant You can also delete all participants by clicking on the Delete all but ton only the participant data name email etc will be deleted the survey results are not affected Administrate participants Participants of Managing and maintaining a healthy lifestyle _ Hide user defined columns custom field 1 custom field 2 para EPEAN a ra get z z rsy Last ar pa 2 ee kori i eer a Name Michael Brown m brown example com Engineering Samantha Miller s miller example com Economics Janet Gabriel _ j gabriel example com Economics Peter Taylor p taylor e
595. the desired question and then click on the green pencil in the area Question The Question Wizard known from work with the VividForms Editor opens Here the desired changes e g changes to the question text the answer options or the pole texts etc can be made Scantron Corporation 103 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM itty Question Wizard Please choose a question type Scaled Question Open Question W Question Wizard Single Choice Question text Multiple Choice Matrix Field BIU amp S Grade Value Students who go to the instructor for help get the assistance they need 4 Question Wizard Define Options Abstention deactivated w i Public Checkboxes 5 e0 0 0 o gp o M V Individualize pole labels Ba Next Left Pole Strongly Disagree FE Right Fole Strongly Agree FA L Set this scaled question as mirrored question Back Nex Apply Cancel Figure 79 Question Library Editing Questions To edit a question group use the mouse to mark the group or any question within the group and click on the green pencil in the area Group Here too the Question Wizard opens and enables editing To delete or copy a group or a question mark the desired element and select the relevant action Please observe when deleting a question group al
596. the survey participant for his response here In grade value questions this field remains empty In single choice and multiple choice questions the response options are recorded here Please note the dif ferent response options must be separated by a vertical line Pipe In matrix field questions enter the minimum value here Right pole In scaled questions the right pole description is recorded here In matrix field questions enter the maximum value here For all other question types this field remains empty Abstention In scaled questions an abstention text can be stored here For all other question types this field remains empty 106 Scantron Corporation Copyright Electric Paper GmbH C Cla COURSE ss Cli mate SYSTEM Phase 2 Implementation of Surveys The following example should clarify the structure of a CSV file for you Si A a E a ase o Personal Detalls Gender VialelFemale pe ourse Planning e course The canes Wavidese wood a good A ree Disagree h a and Presentation P f ene of the topic g ourse Planning Your comment on the course and Presentation content Table 6 An Example of the CSV File Structure when Importing and Exporting the Question Library This structure is also valid for the export of the question library as a CSV file To import a question library click on Browse and select a Class Climate question library file To start the import process click on Import To export
597. their evaluation results Through further feedback options instructors can receive comparative reports compar ing their own course to others in the course of studies and or the faculty or prior to a survey they can add their individual questions to the predetermined questionnaires Scantron Corporation 21 Copyright Electric Paper GmbH Class Climate At the end of an survey period summary reports for deans of studies can be submitted and the collected raw data can be transferred for the implementation of further analyses in statistics programs such as SPSS or Excel This means that the system is managed and organized by a central entity this entity being the administrator in interaction with some other user roles for example the report creator The Class Climate administrator creates the structure as well as the question naires implements the survey and passes on the questionnaires and reports This principle is illustrated in the following graphic Figure 8 Central Evaluation Model The central entity the Class Climate administrator top circle colored teal is in charge of the evaluation s flow and ensures that the survey s questionnaires are passed on to the instructors bottom row of circles of various sub units middle row Of course several people may share a user role so that for example two or three staff members of quality assurance can share the administrator s log in However
598. tion 0 e eee ee ee 408 ADO to dll once ead eciaeeda san dene ete te dues 412 Dual scale nananana cc ees 410 Scan Station s2see50Geceecceeeessc aera ae Gees 35 Scanned questionnaire Evaluation 3 00 54 26 0 5 44 a amp deed w oS ek owe 208 SCAMMUAG o a2 45 ne aehe E ees eae 207 Scanning the forms 0 000 eee 205 Search Search configurations 00 000 eee 366 Search function 0 00000 cece eee ees 461 Searching for courses 0 00 e eee eee 463 Searching for deliveries 0 000 eee 465 Searching for SurveyS 0 0 cee eee eee 464 Searching for users 00 eee 462 Special search configurations 366 Secondary Administrator 0 00005 56 Security 6 ee eee ees 26 Selection of several criteria 0 005 300 Sending of reports 0 0 cee ee 253 SeVAIAIOl 262 207 8n05oe80 4 2 ls whe oe EEST EERS 431 Setting up the subunits 0085 46 Settings Configuration settings 00 00 eee eee 484 Several criteria 0 eee 300 Single Choice question 000 0 420 OPODO eaa aa eae a AAE TA dae de hee eee ees 335 SLAUSUGS c20uee cede ee ncesd ew eateawetas en eres 470 Utilization 2 ees 469 Structure of the Class Climate system 16 Study folder Generating a study folder 201 Subgroup reports 2 0 0 eee 480 Subgroups Combining multip
599. tion QA target value The meals in the refectory are always tasty gt 3 4 The meals in the refectory are always fresh gt 3 4 The meals in the refectory are always warm gt 3 4 The university is connected to the public transportation very well gt 3 4 The technical equipment of the university is excellent gt 3 4 got access to the technical resources computer centre etc very quickly gt 3 4 duly got introductions into all the necessary hardware and software components gt 3 4 Figure 427 QM Views Quality Details If a value is marked in red the quality guideline has not been met at all if the color is yel low the value is within the range of tolerance Other colors are not applied In order to open the complete report of the survey click on To the List and in the line of the survey you are interested in on IH to open the PDF report If an information icon appears in the first column beside the green and red circles then this means that data is available for this survey that has not yet been incorporated into the quality guidelines calculation This can be the case if for example the online survey data has been entered but the PDF report has not yet been opened Click the icon to cal Scantron Corporation 365 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM culate the quality guidelines for this survey The quality guidelines are
600. tion presents you with the possible questions which you could select as an appropriate counterpart Request preferred compilation Your choice Compilation name train_01 train_en Questionnaire train_01 train_en No of Surveys 38 No of completed questionnaires 631 The report gestion may take a moment Please wait until an ectnowledgment has been sent back from the server Create Choice Question Form Which gender do you belong to train en Fa male female a train_01 What is your age alien v 18 29 30 39 40 49 50 59 60 69 Older than 69 tee train 01 Figure 297 Report Creator Manual Questionnaire Comparison Here you can also define a base questionnaire at the end of the page 5 2 2 Creating Summary Reports The report creator has several options to process data One of them is the creation of summary reports This report creation is extremely flexible you can create reports according to all imaginable criteria summarizing these afterwards again and also taking the created reports apart again according to criteria defined by yourself You will see that in this way the report creator answers many questions and accommodates numerous requirements It is important to know that the reports of the report creator have the same properties as the reports which you are familiar with from the automatically generated PDF reports e The analyses on the single questions of your questionnaire look the same for exam
601. tionnaires raw data This means Once you create a survey with a particular questionnaire in Class Climate a file accu rately describing this form is generated and stored in a folder on the server form descrip tion file in XML format The VividForms Reader has access to this folder and therefore is familiar with those forms images that may be produced When receiving image files of scanned question naire batches the VividForms Reader verifies the form in question If the form is a famil iar one the VividForms Reader is informed by the form description file about the position of the checkmark boxes So it now can check to which degree each checkmark box has been blackened This is how it receives the survey s raw data This data is then transmitted to the Class Climate data base where it is in turn made available for further processing Thus if you look at the graphic again the data is processed like this In the case of paper surveys you scan filled in batches of questionnaires using the scanstation and a scanner In turn image files are produced and saved in a folder that is checked by the VividForms Reader at pre defined intervals By means of the form defini tions at hand the VividForms Reader recognizes the blackened checkboxes and trans mits this data to the data base The VividForms Reader cannot process the scanned questionnaires if these are not based on VividForms forms Should this be the case the image files a
602. tionnaires System Settings System Information asi ti j a Batch Events Class Climate Admin a Prnt Cover Sheets Forms Print PDF reports Administrator i Send Cover Sheets Forms Send PDF reports Archive POF reports and CSV raw data Send PDF reports as instructor profiles Subunits Hide surveys with documents which have already been sent 1 Subunit 2 Survey Period 3 Course Type 4 Questionnaire Business Studies z A Lecture j F C Computer Science Wes TOMI Seminar ECoTHeTECS 3 2 3 x 3 3 3 3 2 aa 2 __ Select program of study Central Evaluation a Tree Structure 3 Course s Print only master versions of cover sheets and questionnaires Create complete sets of questionnaires based on number of participants Default valua if enrollment information is missing Add senal number for automatic sorting Li Dapay Surveys x ge Delete Surveys B natructor s Optional Questing a Batch Evenis z ri d Request il G Batch Export Figure 160 Batch Events The following processes may be selected in batch mode Print Cover Sheets Forms For a selection of surveys the personalized cover sheets or questionnaires will be gener ated as a single PDF file It is possible to generate either a master copy or complete sets of questionnaires based on enrolment figures You can define the maximum number of pages in a batch event under System Settings Class Climate Settings VividForms Maxi
603. tions Settings Copy Delete Edit Preview Export Recognition Set x E H Bat pB Figure 196 Possible Actions in the Form Management of an Active Instructor If the active instructor copied a template in his form management he can edit it here This is only allowed within the limits the Subunit administrator has set If e g the administra tor created a template with three pages and 45 questions and the questionnaire already has two pages and 40 questions the instructor can only add one page and at the most five questions To add them to the template the active instructor clicks the paper and pencil icon in the column Edit The Known VividForms Editor opens but due to the limitations of the tem plate also indicated by the word Template in and above the header the active instruc tor must not change the existing elements All the question groups questions and further elements show the annex T i e they are unchangeable But the instructor may add additional elements as long as the maximum number of pages and questions is not exceeded Scantron Corporation 199 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model oi m Class Climate COURSE EVALUATION FEEDBACK SYSTEM DemoEva3 Sample Evaluation Form Template SUBUNIT SURVEY Class Climate Sample Evaluation Form Template ORGANIZATION AUTHOR Markasshown OBOOO MARK Correction OBORO CORRECTION 1
604. tly set as an RGB value or as an hexadecimal num ber tb Color Selection Dialogue ma i P San larainn Tala NWieaerTinne rot he sill at fol FOB ed AA ee eee l nk f m i fe n ry j VD i L 0 eh y Ho AE A foe Wd TUS SENA a 1 Personal Data ATAS Basic color 0054 fi Example preview Red Green gt 4 General Assessment Blue Brightness Mixed color Figure 539 Color Selection Dialog At the bottom of the dialog the brightness of the color is set Whilst the font and the back ground for question groups may have any color depth the color value for the background of the questions should not be too dark so as to ensure high readability when scanning Class Climate immediately checks the brightness of the selected color If too dark a color was selected the message A brighter color is required appears With the slider in the area Brightness the brightness can be increased Once the allowed minimum bright ness is reached the warning disappears The new color can be adopted by clicking on OK The following figure shows an example of a questionnaire with an adjusted color scheme 440 Scantron Corporation Copyright Electric Paper GmbH AY Class Climate Repair Form COURSE EVALUATION FEEDBACK SYSTEM 5 Questions about the studying conditions strongly disagree strongly agree n a The meals in the refectory are always warm Toe a a The
605. to create the fields in PDF The following figure shows you the cover letter of the PDF report Scantron Corporation 500 Copyright Electric Paper GmbH AN Class Climate Configuration Settings COURSE EVALUATION FEEDBACK SYSTEM Evaluation Results To Prof Dr Belmore as private confidential Result of a survey Dear Mr Prof Dr Belmore This email contains evaluation results for Human Resource Management train_en_1 The global indicators are listed first followed by the individual average values consisting of the following scales 2 Questions about the instructor 3 Questions about the course 4 Questions about the teaching material 5 Questions about the studying conditions In ya Ca part of the analysis the average values of all individual questions are listed Note Adobe Acrobat Reader must be installed on your computer in order to view the files Your Administrator Figure 606 Example of PDF Template Schematic Layout of Template A letter template is made up of a static part logo sender other text and a dynamic part which is filled out by Class Climate depending on the report For the dynamic part there are three different fields available e address This field is filled with data about the instructor e g name address etc A place holder determines which data appears The types of placeholders are described in Scantron Corporation 501 Copyright Electric Pape
606. to input the user data the most important being name email address login name and password In the third step the user can where necessary be assigned additional roles After clicking on Save the user is created and appears in the list of secondary administrators 2 3 2 Change the user type instructor Dean of Studies Dean See utilization statistics Module Report Creator Data Entry Assistant Hans Venfier Subunit Administrator Secondary Administrator 2 Change the attributes of the user Title First name John Last name Phone Email Address 2 Edit additional roles Language Default languag So beia ie iV Report creator New password seeeeeeeeee Additional roles w Data Entry Assistant Confirm new Wl Verifier ALLII ELLLI password l Back Save Figure 33 Creating Secondary Administrators Scantron Corporation 57 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Setting up a User Account Manually Users always belong to a subunit Go to the corresponding subunit to find the functions for adding new users i 5 T a i a i pi i laia Class Climate Subunits Questionnaires System Settings System Information Search es44 SAUL comets CURATION FLEMACE titim 7 ane users in subunit Business Studies aay ae i fe tm i 7
607. to view all questions sepa rately it is possible to calculate an average for the scaled questions of an entire question group the so called indicator The indicator in Class Climate thus forms a question group average Generally indicators can be regarded as kind of identification numbers which make a statement about the summarized items In Class Climate for example one question would correspond to one item This way the questioned values for example quality of the course are measurable and comparable Of course an indicator can only give an Scantron Corporation 257 Copyright Electric Paper GmbH lass Climate accurate over all statement when the single questions can actually make a contribution to the statement For the calculation of the indicator in Class Climate all results of the scaled questions are added The sum of them is divided by the number of responses Thus the already calcu lated averages of the single questions are not used for this This means that questions with a smaller number of valid responses for example with abstentions or invalid responses have a smaller influence on the indicator than questions with a higher number of valid answers Your questionnaire contains a question group Instructor with the following three scaled questions for clarity reasons fewer questions than displayed above are used Question 1 The instructor masters his field Question 2 The instructor openly takes on
608. tor Login System Settings Class Climate Settings Functions Minimal sur vey number report creator This way the message no longer appears and you can create the test reports Amongst the general information on the summary report you will find a listing of the ques tions of the related questionnaire Here you can deactivate selection boxes as required and thus exclude questions from the summary report When all properties are selected correctly you click on the button Create and the report is produced Please note that depending on the data quantity the processing may take up to several minutes After the creation of the subunit report the folder view appears again the list of the reports is however now complemented with the subunit report Reports in Folder Summary Reports 2011 Type Name Status Form Created Forms Del Report _ Export HTML Prof Development WS10 11 Data available train_en 05 18 2011 J046 choose pdf report CSV SPSS Figure 307 Report Creator Subunit Report in the Study Folder Program of Study Report In the same way you can produce a summary for a program of study a particular semes ter and selected course types and questionnaires Just a little reminder A program of study differs from the usual structure of the subunits and interviewer and or instructors Because it is positioned perpendicular to the subunits and allows you to assign courses that are created in a subunit addit
609. tor as a whole e Name The name of the report corresponds to the name which you assigned during creation e Status The status here always says Data available since in the report creator you can only summarize surveys for which data already exist and therefore only produce surveys meaning report with the status Data available e Form In the column Form you can call up the questionnaire sample and thus gain information as to which questionnaire this compilation is based on e Created Here you can see when this report was produced e Processed This column informs you of the number of returns filled in question naires in this case 131 e Del Red cross By clicking on the red cross you can delete the report Please observe the following details Class Climate does not hold any completed reports in memory The automatically generated PDF reports for single surveys are also produced on the fly when you click on PDF in the column Report The report creator combines this data according to your reports and keeps it ready When you click on PDF Class Climate produces the summarized report and dis plays it This means that here you only delete the compiled data however you can repro duce the compilation again from your surveys at any time x Delete Compilation Compilation to delete Prof Development W3S10 11 Warning Deleting a Compilation causes deletion of all correlative
610. tration of the manual s workflow Following that you will find notes on the system administration and consolidated settings some of which are mentioned in related chapters in the manual Explanations are visualized through illustrations In more complex windows red eclipses rectangles usually show which elements the comments in the text relate to Menu names are set in quotation marks menu name Buttons are set in angular brackets button Three symbols alert you to important elements in the manual Notes and iii information can be recognized by a salmon colored background eau which ee are ae with a light blue background All paths concerning the database are related to an installation with a MySQL database If you use an MS SQL database please ask your database administrator for the appropri ate path All paths concerning the Class Climate root folder are related to an installation using an Apache web server If you use an IIS Internet Information Server instead the standard path is C inetoub wwwroot classclimate 1 1 Manuals and Documentation In the following you receive an overview on the manuals and example files available for Class Climate and its special components 1 1 1 User Guide You now have the User Guide at hand There are some options of reading it e Asa PDF document you will find it in the administrator s access in the main menu System Information on the left side in the area
611. tric Paper GmbH thy AN Class CI mate Phase 4 Advanced Reporting COURSE 3S GH mat SYSTEM You can change the value of a criterion at any time here This means you can choose for example all male interviewees instead of all female ones To do this click on the arrow of the drop down menu for the value of your chosen question Question Operator Value Options Default criteria combination Which gender do you belong to 2 female i P 4 1 male Figure 339 Report Creator Changing Criteria from female to male Furthermore you can delete a selected criterion at any time by clicking under Options on the red cross You can also create a subgroup report for all male interviewees via a simple subgroup you do not need a criteria combination to do this You can however combine this criteria with others for example with the grade level In this way you can create a subgroup report for all male interviewees who have the grade level freshman As described above first select the criterion Gender with the value male In a second step select the criterion Main Subject with the value Business Studies Your Default criteria combination now contains two criteria Question Operator Value Options Default criteria combination Which gender do you belong to 1 male gt ee And Main subject w 5 Business Studies m t Figure 340 Report Creator Criteria Comb
612. tron Corporation 231 Copyright Electric Paper GmbH mate Philipp Belmore Managing and mantanna a ey lifestyle NA_1 V No of responses 15 Figure 240 The PDF Report Header The contents of the PDF report header can be adapted individually under System Set tings Text templates PDF report Header Indicators The indicators are an average made up out of the averages of scaled questions belong ing to the indicator As an aggregate value an overall indicator for all indicators is sup plied a 1 2 3 4 a 6 3 Global Index COC erp E she 1 2 3 4 5 6 2 Questions about the instructor 0 e nat Sa 1 2 3 4 5 E 3 Questions about the course i Mees 7 eam in 4 2 3 4 5 Bi 4 Questions about the teaching material C p wae 7 gs oe 2 3 4 5 6 5 Questions about the studying conditions Le ey Figure 241 PDF Report Indicators The calculation of the indicators is activated or deactivated at System Settings Report Settings Configuration Calculate indicators In addition these indicators must be defined in the questionnaire editor for the relevant questionnaire lf Calculation of Cronbach s Alphas has been activated then the calculated value of Cronbach s Alpha will be displayed behind the indicator names System Settings Report Settings Configuration Display Cronbach s Alpha This value is a measure of reliability and shows the internal consistence of the question group The value scale
613. tructor Access to Download Reports Scantron Corporation 253 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM After authentification of the instructor he can select the survey period and all the sur veys from this period are displayed with type name questionnaire creation date and number of returns For each survey the instructor can now download the PDF report if the questionnaire is multilingual then in a number of languages The passive instructor can change his access data by clicking on the menu point My profile a a i Class Climate Economics 14 Tea TANINAN PECMEATA FETITE Ti Cc TA Reports central Requesting central evaluation reports Survey Period s 508 smeralda Parker WS08 09 A 5509 Reload WS0s10 Central Evaluation evaluation Type Survey Status Form Created u Fons Regies System Settings Class Climate PL 3B ty Profie 2 Basics of Economics Lid Data available train 01 08 12 2008 3 por ma Class Climate Pl Log Off 2 Introduction into Economics id Data available train_01 08 12 2008 3 PDF Figure 265 Downloading Reports by Passive Instructors 254 Active Instructors Active instructors have in their menu view a link to the reports of the Central Evalua tion To set this up simply activate the link in Configuration Central Evaluation Active Instructor Download Reports from the Central Evaluat
614. ts To create an instructor profile choose the option Instructor Profile from the drop down list and click the button Next Create reports Summarized E structor Profile Reports Comparisons Batch Profile Lines Si Figure 312 Report Creator Creating an Instructor Profile 286 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM From the instructor list sorted according to subunits select an instructor and a survey period as well as the required course types and questionnaires Then you should enter a relevant name in the example Hernandez WS08 09 activate the usual options as per your wishes and click on Verify Create Instructor Report 1 Instructors 2 Survey Period 3 Type 4 Questionnaire 2 ssn z n Non_Anonym Sunny Narrow Quest_01 Professional Developme Prof Dr Philipp Beimore Carlos Hernandez _Data Eniry Demo Subunit Dennis Data Template forms Description Belmore WS 10 114 Question mapping of different questionnaires Automatic with text comparison Manual _ Include answers to open questions _ Combine surveys unweighted Please note For this combination the mean values of the single surveys are averaged veny Back Figure 313 Report Creator Instructor Profile Selection of Elements The window known from other report t
615. ts Coil Ohe demieg ani 3 Dear Mr Prof Dr Adam Smith as private and confidential Report Course Evaluation to the Teachers Dear Mr Prof Dr Smith This email contains evaluation results for History of liberalism train_01 The global indicators are listed first followed by the individual average values consisting of the following S Guality of The Instructor 3 Quality of The Course 4 Quality of The Teaching Matenal In the second part of the analysis the average values of all individual questions are listed Figure 230 PDF Letter Sample The Header of the Letter The address details in the header sender and recipient are defined at two different loca tions in Class Climate e Recipient s address The first two lines specified in the user data of the respective instructor are used as the recipient s address Scantron Corporation 225 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM In the following example Class Climate takes the address of Donna Harwood and inserts it below the user name 2 Change the attributes of the user Mr ka Title First name Philipp Last name Belmore Phone Email belmore example com Sample Av 123 543271 Democity Language Default language Login name belmore New password PEO CEE TTC TET Terry Confirm new z LEETE LELEILTITLETTITILITTTTIEIILTIITETITEE p
616. tte geben Sie dem der Lehrenden fiir diesen mangelhaft sehr gut k A Kurs eine Gesamtnote Figure 75 Languages Defining Texts Language Options in Online Surveys You can display a questionnaire s translated languages in the HTML online survey The questionnaire always appears in the main language after authentification through the PSWD procedure Beneath the header data you will see the logos that have been defined as questionnaire languages By clicking the logo you change languages There is also a drop down menu with the name of each language After clicking the logo or selecting the language in the drop down menu the survey is dis played in the desired language A further authentication is not necessary C Class Climate Dear Participant We are very interested in your opinion about the course as well as about the university in general Therefore we would like to ask you to take the time read the questionnaire thoroughly and complete it Only your own judgement is important you cannot give wrong Of course the data is completely anonymous 1 Questions about you What is your gender Please select Figure 76 Languages Selection in Online Survey Scantron Corporation 101 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM 2 4 4 Question Library The question library is centrally administered in the menu Questionna
617. ttings system Informalezy Display user ma Business Studies list fet bunt Class Climate Admin i me SAA Display user Eg Andrew AA Chemistry list for bunit Subunits ENF EE 7 Subunit Bennett Figure 4 Testing the Class Climate Interface with WAVE In order to ensure the highest possible accessibility high contrast color schemes can be used Scantron Corporation 19 Copyright Electric Paper GmbH Preparation and General Notes Class Climate COURSE EVALUATION FEEDBACK SYSTEM 3 Questions about the course attend the course check as many as apply because am interested in the topic Ez because need to earn the credit hours because the instructor is really good because it is important for my professional life for the preparation of my exam for other reasons The lead time of the course is adequate Strongly O O O E O Strongly agree disagree Figure 5 High Contrast Online Template When using special online survey templates the accessibility can be limited especially when using JavaScript elements For the best possible accessibility we recommend using our standard template If desired an even higher contrast presentation is possible using a customized online survey template i lass limate Subunits Questionnaires Sysiem information aaa i A Cla ss Cli miii pitii i Search ay iy Online Template Management HE BEG A Class Climate Adm
618. tus e Form e Created date e Processed date e Recorded number of returns Survey Status In Progress Cover Sheet Procedure ws10 11 a Managing and maintaining a healthy lifestyle NA_1 In Progress O Quest_01 Sion eaa FEF AE AER FR Send email with cover Display questionnaire Display personalized Delete sheet to instructor as PDF cover sheet survey Figure 87 Survey Status Cover Sheet Procedure In Progress Hard Copy Procedure 2 ssi _ a 2 Managing and maintaining a healthy lifestyle NA_1 In Progress Quest_01 Silly af Questionnaire ZT I Send email with questionnaire Display personalized Delete to instructor trainer questionnaire as PDF survey Figure 88 Survey Status Hard Copy Procedure In Progress Scantron Corporation 115 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Clim ate COURSE EVALUATION FEEDBACK SYSTEM Online Survey ss1 Wee Names Status Forms Processed Form Report Export Actions _ Organization and Management 02 P1236 In Progress OA Quest_01 Show PSWDs P amp Send emails with PSWDs to survey participants Show online Download Delete Send email with PSWD document to instructors survey preview PSWDs survey System Settings Class Climate Settings Email Functions amp Accounts Delivery method PSWDs 1 System Settings Class Climate Settings Email Functions amp Accounts Delivery method PSWDs
619. ty of survey participants who have already completed their questionnaire participants who in spite of their invitation have not yet used their PSWD can be identified by their email address In the menu System Settings ClassClimate Settings Survey Online Participation tracking online surveys Protection of anonymity you can define the minimum return The minimal return defined here must be reached in order for specific survey information on participation and non participation to be released To access participation tracking click in the menu Subunits on Participation Tracking A window opens automatically in which you can select any number of subunits survey periods course types questionnaires and courses Subsequently click on Request to trigger the participation tracking A Save as dialog appears Select a folder and click on Save Then open the saved CSV file to call up the information on participation and non participation Scantron Corporation 145 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate A B C D 1 Survey PSWD Email Participated 2 Organization and Management L4XVZ s pabriel example com No 3 Organization and Management 4768P m green example com Yes 4 Organization and Management WVWJ2E f hernandez example com No 5 Organization and Management 4DQLZ p townsend example com Yes 6 Organization and Management S54UGY l portman example com Yes
620. uation Process The Phase Model thy Class Cl imate Dear Amy Hardy This email entitles you to vote in an online survey Please click on the link below and enter the password to gain access to the survey The password NJAHC Survey location http 192 168 245_129 classclimate online Yours sincerely The Evaluation Office Note This survey is non anonymous If you take part in this survey with the above named PSWD your given answers can be associated with you Figure 186 Email for Amy Hardy Example PT As an alternative you can also use the placeholder PARTICIPANT SALUTATION2 to address the participants With this placeholder the complete address including a saluta tion Dear Mrs Dear Mr will be generated Processing Survey Participant Data The batch export function is available to create statistical reports on survey participants The data fields for the survey participants are added on the right hand margin to the raw data table relating to the respective surveys AO A j Ag AR mys AT ilio aA AV AW 1 Participant email address Participant Salutation Participant Title Participant First Name Participant Surame Participant Postal Address Custom 1 Custom 2 Custom 3 2 a hardy example com Ms Amy Hardy Business Studies 3 m brown example com Mr Michal Brown Computer Studies 4 s miller example com Mrs Samantha Miller Business Studies 5 j gabriel example com Ms Janet
621. uation y Group Questions This course was worth the effort involved a learned a lot in this course l learned more in this course than in others This course was extremely valuable to my education After taking this course am interested in taking others in this field This Was an excellent course This was one of the best courses have ever taken ie would recommend this course to my frends a This course has had a profound impact on me This course has given me a new direction in life Alphabetic Sorting Back Next Apply Cancel Figure 542 Question Library Selecting Questions 442 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Use of the Question Library with VividForms COURSE EVALUATION FEEDBACK SYSTEM By clicking on the magnifying glass symbol you can see a scaled down preview of the selected questions W Question Library Assistant Selected Question Preview learned a lot in this course Skrongiy Cieagiee ooooo Strongly Agree learned more in this course than in sarongly Omagree ooooo Songy Agree others After taking this course am eg feos use ooooo Strongly Agree interested in taking others in this field would recommend this course to my Strongly Disagree ooooo Strongly Agres frends Figure 543 Question Library Preview of the Selected Questions Please note that elements that are taken from the libra
622. ubgroups are automatically updated when the study folder is downloaded again Re calculation of dynamic subgroups Subgroup Subgroup Female from Graduate Survey 2011 is being re calculated 50 Cancel Figure 205 Updating Subgroups When recalculations are completed the updated reports are available immediately When a survey is to be deleted for which dynamic subgroups exist an inquiry appears as to what should happen to the subgroups The options are to either delete these reports or alternatively to retain these reports under lack of their dynamic characteristics x Delete Survey Survey to delete Graduate Survey 2011 The function Delete in two steps is activated in your system Only the survey results will be deleted in the system Note One ore more dynamic subgroup reports exist for this report Also delete dynamic subgroup reports Keep dynamic subgroup reports OK Cancel Figure 206 Deleting a Survey for which Dynamic Subgroups exist 204 Scantron Corporation Copyright Electric Paper GmbH X Class Climate 4 Phase 3 Capture and Instant Feedback When the first questionnaires have been returned the capture operations begin Make sure that the personnel who will be capturing the questionnaires are well trained in every aspect of the capture operation The scanning procedure is a critical moment in the processing of the questionnaire If the paper has been put in improperly
623. ubmission In this case the instructor will not receive information on activation or deactivation of the instructor s operational questions e Deactivate The Instructor s Optional Questions are deactivated and can no longer be accessed Optionally the dispatch of emails can also here be prevented by activating the option No email submission Activate O Remind Deactivate Figure 159 No Submission of Emails to the Instructor The text of the relevant emails can be edited in the menu System Settings Text Tem plates E MAIL Instructor s Optional Questions activated E MAIL Instructor s Optional Questions reminder and E MAIL Instructors Optional Questions deacti vated The administrator can edit the surveys where the Instructor s Optional Questions are acti vated by opening the list of surveys main menu Subunits there Display Surveys 3 2 9 Batch Events The batch events are located in the menu Subunits Batch Events They offer various process automation possibilities connected to the distribution of survey forms and survey reports Please observe that when selecting subunits survey periods course types and courses multiple selections can be made by pressing and holding down the Ctrl key 172 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM th Class Climate P iti Ques
624. uececueeuceueueuueeaseueeeuueaueeuaeeuuueaeeueeeueeaeeneess 452 6 1 DEFINING A TEMPLATE BY THE ADMINISTRATOR cccccccceccccceecseeceueeeeusuecsueueeueaueeueeeauuaueeneueess 452 6 2 USE OF TEMPLATES IN INSTRUCTOR ACCOUNTS ccccccccecceeseecseceueseuusueceueueeueeueeueeeeueueeeaeeeens 454 7 EDITING AND PASSING ON QUESTIONNAIRES u cccccccceccecsccseeeeueseeceuseuceeeeeeueeuseueeeueueaeeuaueaueeaeeneees 455 7 1 WRITE PROTECT MODE tncacetticuctenticdscnciesenitisccacesibiransecentunendenncdevacernactemedsdectemnadessalenmeaekentasnads 455 7 2 AUTOMATIC RECOGNITION SET MANAGEMENT ccccceceeceeeseeeeeeceuuseeceueceuuueuseuaeeeueeuueueueaeeas 457 7 3 IMPORT EXPORT OF VIVIDFORMS QUESTIONNAIRES cccceccceceecseeceeeseeceeseueeueeeuueeaeeeeseueeeneenes 457 D SYSTEM SETTINGS AND MANAGEMENT uu c cccccssssessecnesensseuseeeueeseneeeusesueuseenseeeueeneaeens 461 1 SYSTEM MANAGEMENT AND SUMMARY ccccccccecceesecseeceeeeeeuseeceueueeueaueeuueeeueuaeeueueaueueeueueaueaeeeauees 461 Mee Weg AIRE aa E E olan omens nese OAE OEA E E OE OR 461 1 1 1 SEARCHING FOR USERS ove bcencesssitacecimsctndcclinadtacancensddinsaudenteduclunitesesdauatebercuboatenudeacubuasd 462 1 1 2 SEARCH FOR COURSES u cecccccccccceccecseceeeeeueeeucseeceueeeuueeueeuueeuuueeusuuueueseuueueesauueausuueeaeueass 463 1 13 SEARCH FOR SURVEYS eee ee ee eee ne ere ee ane ee eee 464 1 1 4 SEARCH FOR DELIVERIES ccccccccecceccecseeceueeeeceeuceueeeucueuse
625. uestionnaire can be moved around The text also appears in online surveys and if desired in the PDF report too To activate this select the option Show text boxes in the menu System Settings Report Settings Con figuration 2 9 4 Page Break If a page becomes full VividForms Editor will automatically apply a page break to con tinue adding objects on the following page Page breaks can also be added manually at each phase of the questionnaire First mark an object by clicking on it with the left mouse button Now open the menu Add and select the option i Page Break Note Please do not write outside of the box Il Page Break Figure 528 Page Break in the Editor Preview The page break will be symbolized by a selectable row containing the text Page Break The next object added to the form will appear on the following page If the page break is deleted later the objects throughout the rest of the questionnaire will realign 432 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM 2 9 5 Line Height Font Size and Font Type Form Properties 1 Form Properties Layout settings Repair form Enable numbering Edit Pole Template Filter settings Validation Required questions Cross tabulation Change color scheme Picture Library Line 12 Height Font Size pt 10
626. uestionnaires In order to use the functionality of norm profile lines the option System Settings Report Settings Show norm values must be activated The option System Settings Report Settings Configuration Show recommendation text gives instructors the possibility to generate a recommendation document through a link in the PDF report In the details of a questionnaire you can choose in the drop down menu in the area Advanced Settings the option Norming After marking the option Norming click on the button Edit A sub window appears in which the norm value can be entered If there is not yet a norm ing for the questionnaire then a message will display with the button Activate Norming Norming for questionnaire train_en No norms are available for questionnaire train_en Course Evaluation Questionnaire Please make sure your questionnaire has active indicators before using norms Activate norming l Cancel Figure 401 Activate Norming 342 Scantron Corporation Copyright Electric Paper GmbH e Cla ss Climate Phase 5 Quality Management a tS ATN t Settings for norming of questionnaire train_en Edit norming types R Recommendation Report N Norming Text for above average A CE 1 Questions about you 2 Questions about the instructor Figure 402 Norming Details In the table displayed you can now set for all the dimensi
627. uestions activate the option Use these settings as default for scaled questions All scaled questions that you add afterwards receive these settings per default Scantron Corporation 409 Copyright Electric Paper GmbH Creating Questionnaires with VividForms thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM Mirroring of Individual Scaled Questions The VividForms Editor allows you to mirror individual scaled questions Using this method control questions can appear inverted in the survey but at the same time flow correctly into the calculation of the indicators On your questionnaire you can establish mirrored scaled questions in two different ways e by composing a question text in a negative way with the pole labels being consistent throughout the questionnaire e g The technical equipment is poor with the pole labels strongly agree left and strongly disagree right e by inverting the pole labels for a question while the phrasing of the question remains positive e g The technical equipment is excellent with the pole labels strongly dis agree left and strongly agree right This method is only apt for scaled questions with individual pole labels To create a mirrored scaled question click on the option Set this scaled question as a mirrored question whilst you are creating the scaled question In the VividForms Editor preview the scaled question is marked with a
628. uire access to QM views the user must be an active one Activation can be effected by clicking on the symbol i next to the user The symbol appears indicating that access has been granted The user type Dean is the exception to the rule because he also has access to the QM views as a passive user Open the profile data of the user by clicking on his name pe Please define the user rights QM Views No QM Views No QM Views Only own surveys Only own subunit Unrestricted access VividForms Editor Unrestricted access Figure 424 QM Views Authorizing Access Rights In the lower area next to the field QM views you can define access in four different authorization levels No QM Views The user has no access to QM views Only Own Surveys The user has only access to his own surveys These are surveys that have been regis tered by the administrator to the user s own user profile Only Own Subunit This option gives the user access rights to all surveys within his own subunit It is possible to access multiple subunits by selecting from the additional subunits list This can be done after the access level only own subunit has been selected Unrestricted Access This option grants authorization to access all existing surveys in the system Scantron Corporation 363 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBAC
629. ule These module sec tions are in this case viewed as general polls about the module If this function is deacti vated each instructor for a module section receives only their own report This option only affects the automatic delivery of reports directly after scanning and the delivery of reports using scheduled tasks Scantron Corporation 509 Copyright Electric Paper GmbH system Settings and Management AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM Email Dispatch of questionnaires for the coversheet procedure If activated with each email dispatch of a coversheet the corresponding questionnaire will be sent too Delete in two steps If this function is activated then when you delete a survey you will only be deleting the data The survey operation itself will be recorded in the system as proof Another deletion will then result in the complete removal of the survey If this function is deactivated then all survey data will be deleted immediately at the first deletion Method of calculating the response rate Here the method of calculating return rates can be set Methods available are calculation based on the generated PSWDs 0 PSWDs sent 1 and the number of participants of the course 2 To show return rates of paper based surveys the option 2 percentage of responses based on the course participants must be selected 2 5 3 Section Survey Online Highest permitted number of PSWDs per survey in
630. ule survey Class Cli mate generates a report for the module but also separate results for each module element This allows separate reporting based on each part of the module survey Scantron Corporation 369 Copyright Electric Paper GmbH gt Your Evaluation Process The Phase Model Class Climate Figure 435 Build up a Module Questionnaire 7 1 Setting up a survey with Module Evaluation To set up a survey with module evaluation several steps have to be taken e By default the possibility to conduct module surveys is already activated in the sys tem if the standard settings have been changed activate the general possibility to conduct module surveys in the Class Climate Settings Menu System Settings Class Climate Settings Central Evaluation Module e Create questionnaires you want to use to evaluate your single module courses e Link the module questionnaires to course types Menu System Settings Course Types in case of module surveys the course type has the function to assign ques tionnaires to courses e Create users user type Module e Create courses for the modules Select the course type the module questionnaire is linked to Enter a course ID which defines the order of the courses to be surveyed on the overall questionnaire Define a further report recipient who equals the instructor of the course and will receive the report e Generate survey switch to module evaluation
631. ults tor Human Resource Management ranen The global indicators are listed first fodawed by the individual average values consisting of the following scales 2 Questhons about the instructor 3 Questions about the course 4 Questions about the teaching material 5 Questons about the studying conditions In the second pan of the analysis ihe avenge Valles of all indinadual questions are listed Hois Adobe Acrobal Reader must be installed on VOur ampule in order io view Ue fies Your Adminsrator Figure 264 Designing an Individually Configured Letter for Sending Reports This special letter can either be used for all reports or defined only for special question naires You can limit it to a single questionnaire if you click on Text Templates in ques tionnaire details Questionnaires Questionnaire List Details 4 5 5 Download and Sending of Reports Manual Download of Evaluation Reports When the reports are not to be sent to the instructors by email Configuration Email Functions amp Accounts Attach PDF Report you can configure Class Climate so that instructors can login to the system and then manually download their PDF reports from the Central Evaluation e Passive Instructors Passive instructors automatically see their surveys from the Central Evaluation In order to allow this option activate the access in the menu System Settings Class Cli mate Settings Central Evaluation Passive Ins
632. ure the header of the questionnaire remains empty because it cannot be adapted to a single particular survey If you only want use a questionnaire in the cover sheet procedure you can avoid this issue by inserting static texts into the header instead of the placeholders If the questionnaire is to be used for non anonymous surveys personalized to individual participants other placeholders can be added For this simply select a placeholder from the shortlist in the lower area of the dialogue and click on the button marked The fol lowing placeholders are available for non anonymous survey PARTICIPANT FIRSTNAME Survey participant s first name PARTICIPANT LASTNAME Survey participant s last name PARTICIPANT IDENTIFIER Survey participant s ID 400 Scantron Corporation Copyright Electric Paper GmbH S m AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM PARTICIPANT SALUTATION Survey participant s salutation PARTICIPANT TITLE Survey participant s title PARTICIPANT ADDRESS Survey participant s address PARTICIPANT EMAIL Survey participant s email address PARTICIPANT CUSTOM1 Survey participant s first user defined field PARTICIPANT CUSTOM2 Survey participant s second user defined field PARTICIPANT CUSTOM3 Survey participant s third user defined field lf a placeholder is to extend across two columns click on the corresponding placeholder and activate t
633. urses according to programs of study activate the option Select program of study In addition to the existing selection fields subunit sur vey period course type questionnaire and course s the field Program of study appears in third place In this field you can select one or several programs of study 2 Survey Period 3 Program of Study 4 Course Type 5 Questionnaire Engineering SST Economics Lecture Evatt Professional Development WS 10 11 Engineering Seminar Non_Anonym _Data Entry Demo Subunit 510 Social Sciences Working Group WS09 10 Psychology 507 undefined WSOG 07 Computer Sciences 506 Comuter Sciences WSUS SOUS Figure 318 Report Creator Any Compilation Selecting the Program of Study Scantron Corporation 290 Copyright Electric Paper GmbH y a COURSE EVALUATION FEEDBACK SYSTEM When you click on Verify after selecting the elements a small overview of the question naire is provided or if there are several questionnaires as in this case an overview with a questionnaire comparison is provided Request preferred compilation Your choice Compilation name Report of Train_en Questionnaire train_en No of Surveys 19 No of completed questionnaires 241 The report creation may take a moment Please wait until an accnowledgment has been sent back from the server Greate Which gender do you belong to male female a Figure 319
634. urvey Scheduled Tasks Finish Data Collection Close Survey amp Restore Survey 3 Delete Survey Edit answers to open questions A Assign survey to substitute instructor Lid Edit Show notes 08 12 2008 at 12 56 41 pm 06 12 2008 at 01 02 33 pm 5 of 25 generated PSWDs Contingent of feedback 20 fa Results in HTML format Results in PDF format wy English i Raw data in SPSS format O E Raw data in CSV format O F Back Figure 95 Survey Details Survey Status Data available If your questionnaire is multilingual then you have the option in this view to display the form in the various languages Results in HTML format Results in PDF format ay English English Figure 96 Select Report Language 120 Scantron Corporation Copyright Electric Paper GmbH X Class Climate After scanning the questionnaires you can display the PDF report in the language of the questionnaire In the PDF report you will see the text of the letter or the legend in the linked system lan guage All of the questionnaire texts are produced in the selected language Number of Participants to Calculate the Response Rate By default the number of participants deposited in the properties of a course is used as the number of participants of the survey This is stated in the details of a survey It serves as the basis for calculating the response percentage of a survey if the mode of calcula tion in
635. urveys The subsequently generated PDF report of the survey does not contain any information on the survey participants If these are to be processed this can be done through the batch export on which you find information in the following two paragraphs paragraph on non anonymous surveys Implementing a Non anonymous Online Survey For online surveys it is possible to use information taken from the survey participant data for the personalization of the emails that are generated for the dispatch of participation codes The placeholders shown in the previous paragraph can also be used for the text tem plates It is advisable to use customized text templates for individual questionnaires and not to modify the standard template for the PSWD dispatch In this example the recipients of the PSWD emails are addressed personally by using the placeholders for first names and surnames of the survey participants Reference Online survey Mail text Dear PARTICPANI FIRSINAME PARTICIPANT LASTINAME gt This email entitles you to vote in an online survey Please follow the link and use the PSWD displayed as identification b The PSWD reads PSWD Voting under SERVER Yours Sincerely Figure 185 Personalized Questionnaire specific if possible Email Text The resulting email text in its personalized form looks like this Scantron Corporation 193 Copyright Electric Paper GmbH COURSE ss Cli FEEDBACK SYSTEM i Your Eval
636. urveys Then enter a name for the report and if necessary do some further settings such as text comparison etc Click the button Verify The questionnaire will be displayed in an over view Click on Create to finally create the report Scantron Corporation 295 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM Request preferred compilation Your choice Compilation name Prof Dev Economics Questionnaire train_01 train_en train_en_1 No of Surveys 25 No of completed questionnaires 345 The report estion may take a moment Please wait until an acgnowledgment has been sent back from the server Create Choice Question Form Which gender do you belong to train en male female i 4 Which gender do you belong to train_en_1 train_01 Figure 325 Report Creator Any Compilation Tree Structure Questionnaire Overview The report will be created and is shown as all other reports in the list within the study folder HTML 4 Prof Dev Economics Overall Report Data available train en 05 18 2011 345 Al choose pdf repot CSV SPSS Figure 326 Report Creator Any Compilation Tree Structure Report in the List of Reports Combinations and Subgroups The previous chapters show that the report creator allows the generation of reports according to very flexible criteria So far however only the compilation of data accord
637. uueeuueeeusuueeueueuueueeaeueausaueeaeueass 465 12 WRITING EMAIL sopisi nanara A AE nase cciaseneuioactia A E E E E 465 Sy DELNE R Y errian anA Aa A EAE AAE A NAA AATA 466 14 BATCH EXPORT sorrircnsan eea E A aat 467 w5 TIT ZATION STATISTICS ssc sce nae eE a EEEE ERE 469 1 6 EVALUATION STATISTICS w cccccccceccceccecceeceeceeeceeuseueeeseeeeesueueuaueueeaseuueeaeeeauseaeeueeeauueeeeaueeeuuuess 470 Nato SYSTEM INFORMATION soc gsancccecavececsascuasucseneeces e e a Oa a Eaa ea Sa E aD aai 471 1 8 LICENSE ADMINISTRATION cccccccceccecseescccsecseuseueeeuesaeeeeueeuueaeeueueacuauueueueueueuueueeeueueeueueusueuenss 472 1 8 1 OVERVIEW ON THE LICENSE ADMINISTRATION c cccccceceecsceceuuseecseseueseeueeueeuueueusaeeeaeeeaes 472 1 8 2 ADMINISTRATING USER ACCOUNTS cccccecceccecececsueceeceeuceuuseuueeeusaueueueeeueuueeuueeeeaeeeeeueess 474 1 9 PERFORMANCE CONSIDERATIONS cccccccceccececuceeeseeceeueeuuseeueeuueueueeueuueuueeusaueeaeeuaueeueeaueeeusaass 476 1 9 1 PERFORMANCE STATISTIC ccecsisdicwivscnnccsscentntnicsncsssemcbdeuneatuneaainesuneindsticensduakadvetondensemmeds 476 1 9 2 LIST OF ALL ACTIVE USERS LOGGED IN ooo cecccecceccceccecececeeeeeeueeeusuuseueeeeeeueeeaueeeusaeeeeeueees 477 1 9 3 DISPLAY OF ONLINE SURVEYS sesccesescciabewscans secteuete sucpnnsdanedz asiaaendeansauaobiaouvedeneemeehiessedabeste 478 1 9 4 MORE TIPS FOR AVOIDING SYSTEM OVERLOAD ceccecsceccecseeesueceueseeusuuceuueeeuseueeaueueneuees 478 gy 1 0 o
638. valuation Delivery of module sections with no instructor By default the option is activated i e the report is sent to all recipients automatically Scantron Corporation 381 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model Class Climate COURSE EVALUATION FEEDBACK SYSTEM 7 9 Further Settings By default on a module questionnaire the names of the module courses will be displayed below the title of the first question group of the corresponding questionnaire part so as your survey participants know which course has to be evaluated If you want the name of the corresponding instructor to be displayed as well there are two possibilities e You can integrate the name of the instructor in the course name for example Class Climate Basic Training Donna Harwood Thus the name of the instructor will be dis played on the questionnaire as well as in the course list and survey list and on the PDF report Please remember to add the instructor to the list of Further report recip ients as well because otherwise the instructor will not receive his her report when you choose to send them by email Edit course of John Doe F Course name Program of study Course ID 03 Samantha Miller Advanced Reporting Evaluation period Course Type Module Trainer continuous Figure 448 Module Evaluation Enter the Name of the Instructor in the Field for the Course Name In the
639. ve your changes by clicking the OK button Clicking the Cancel button closes the window without saving any changes You can delete the respective PDF report by click ing on the red cross in the delete column The second way is by restricting the content of the PDF report as well as defining the subreports and special report recipients If you have a questionnaire built up out of modules you can use report definitions to auto matically create PDF reports for each module These partial reports can also then be sent automatically to one or more recipients by email PDF report definitions are always defined for each questionnaire and then are valid for every survey created with this questionnaire Define Report Definitions Just choose the option PDF Reports in the drop down list in the details of the corre sponding questionnaire area Advanced Settings Subsequently click on Edit The fol lowing window opens automatically System Settings System Information ane 7 Standard PDF Report Class Chmate POF report Save Class Climate Admin ai Administrator A Questionnaires New PDF Report Definition Back Figure 257 Report Settings for a Specific Questionnaire In the area Standard PDF Report you can define the PDF report with which the corre sponding questionnaire will be displayed by default Select the corresponding PDF report in the drop dow
640. ven Jakes th Geoscience a A X Henry Darcy th Linguistics 224 X Roberta Lopez th Mathematics 22 4A 8 Bill Wayne AN Musics m2 t Tony Harper H V Physics 224 8 Eve Bloom Show all subunits ra Figure 24 Hide Subunit Scantron Corporation 47 Copyright Electric Paper GmbH N S In the case of instructor account licenses by using the option Assign user licenses the number of available licenses can be limited for each subunit For more information please see chapter D 1 8 2 Administrating User Accounts Handling handwritten texts Further information at Handling handwritten texts gives a comprehensive subunit rule for the handling of handwritten responses to open questions e Direct display default setting Handwritten responses to open questions are shown as an image box graphic file in the PDF HTML analysis This option guarantees that after collection of the data the instructor gets a complete feedback including responses to open questions e Display after manual collection In order to preserve anonymity handwritten responses to open questions are not dis played The report recipient can only access the results to the closed questions decentral or will be sent these Central Evaluation With the user type data entry assistant Section 5 2 3 a sequential manual entry of the handwritten comments can be accomplished Multiple selections are counted sorted and displayed according to
641. ves can also be included The hard copy procedure also allows all of the questionnaires to be numbered This is especially useful when the questionnaire contains more than two pages or when printed on both sides of the page on more than one page of paper This guarantees that the questionnaire sets are logically coherent even if they are mixed up when collected 108 Scantron Corporation Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Course Evaluation Gutsa Frol Dr Adam Smif TSI Aio Tc oooh eS hie ii sire OBROOO Padi tien 3 Rees pea et Fh hi gh Thi Bere wil be eed eter Darkar ODEO HLO Ffei bios Ha durghi chee d ma be aia bha i BiG Sean e mairg ribakt Fagl Hika armas nya Lag ng Wr yoa opar a boul the courne Fs a un pr hte ae a 2 we would bhe to ad iha gu sonnaine thoroughly ar 4 comei A Oriy you wen puja ani a important you canny oy Maine Ol con k ihe dala is com riy Ay 1 Questans about you What is your gander O mate O ieme Whal is your age Single Choa O ti ma O 30 35 a0 49 O S53 O 60 65 O Giger than gs Whal is your age Mas 0000000000 pp ppp0ppREG Wiat is he grade of your laa schod graduation A ch i i a y h OC 0 How many beme have you been studying so for Oi J 03 o4 Os g or m go C 10 O 11 CI More ethan ii kiin subeect O Angisincs O American Shudies O Apoded Informates m Automaton Enginaecing O Business Studies O Chemistry O Geigy D Geophysics C indannaics O Logat L A
642. well as online surveys with it 84 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli mat SYSTEM thy Class CI mate Phase 1 Preparation of a Survey Period 2 4 2 Management of Questionnaires and Detailed View The list of questionnaires is located in the main menu Questionnaires there in the sub menu Questionnaire List First you will see a list of all questionnaires The abbreviated name 5 to 10 characters the description and the status of activation are depicted Available Questionnaires Show all questionnaires of the Subunit Administrators Show deactivated questionnaires at the end of the listing including module questionnaires Quest_01 Evaluation Questionnaire 05 05 2009 VF Editor QPO Select 261 Quest3 Evaluation Questionnaire 64 29 2009 VF Editor af Select Copy aaa ran ea e 06 04 2009 VF Editor Select v 244 iran oz uae De ior 05 05 2009 VF Editor I Select v 245 train_en a S 08 28 2007 VF Editor 3 Select 251 train WB ile esi rl 05 05 2009 VF Editor 4 Select v 249 VF_DemoP faPerbased VimdForms 05 05 2009 VF Editor J Select 253 Workshop Workshop VividForms 11 08 2007 VF Editor Qs Select v Activates D Activated with restrictions see details J Deactivated Af Questionnaire is not in use and can be edited 4 The questionnaire is in use and allows oO The form contains versions ceated by instructors restricted edit
643. well as their courses will be generated unless they already exist Instructors already present will not be set up a second time so that you can always import the current list in order to keep the system updated A B i D E F G H l J R L 1 Instructor Mr Prof Dr Adam Smith user example com Introduction to Economics ECSO01 Economics Engineering 1 25 2 Instructor Mrs Dr Erica Miller user example com Legal Environments ECSO02 Economics 1 25 3 Instructor Mrs Dr Erica Miller user example com Legal Environments Il ECSOO03 Engineering 1 2 4 instructor Mr Prof Dr James McDonald user example com Time Management PDOO1 Economics 1 25 5 instructor Mr Prof Dr James McDonald wuser example com Human Resource Management PDOO2 Economics Engineering 1 25 6 Instructor Mr Prof Dr Peter Huddle user example com Web Design wog Economics i 25 7 instructor Mr Prof Dr Peter Huddle user example com Fire Walls and Access Control Lists WDOO7 Economics i 25 8 Instructor Mr Prof Dr Peter Huddle user example com Security Essentials W008 Engineering 1 amp 9 Instructor Mrs Or Maria Hernandez user example com Spanish for Beginners LALO39 Engineering i 25 10 Instructor Mrs Dr Maria Hernandez user example com Spanish Advanced LALLOAO Engineering 1 2 11 Instructor Mrs Or Maria Hernandez user example com Spanish Conversation LALJI Engineering 1 25 Figure 57 Example of a CSV File in Excel Using these text files which are independent of software application
644. will be displayed on the ques tionnaire as well as in the PDF report Module Evaluation Display of name of the secondary instructor in the heading of the question group lf activated the names of the secondary instructors are displayed on the aggregated questionnaire In this case in each first question group heading of a partial questionnaire the name of the relevant instructor is displayed This setting helps you to relate the questions to the instructors It only affects new surveys existing surveys are not concerned Activated w erl diate thia Arlan Hakla ta eink A a Make this option available to Subunit Administrators Figure 451 Activation of the Display of the Names of Instructors in the Class Climate Settings The following figure shows the display of the instructor name in an online and in a paper based survey with the option activated in the System Settings Questions concerning the Trainer Instructor Donna Harwood Introduction into Class Climate 2 1 How would you rate the trainer s overall teaching Excellent Poor methods 2 2 How would you rate the trainer s ability to set and meet Excellent w Poor the objectives for the course Figure 452 Display of the Instructor Name in an Online Survey 2 Questions concerning the Trainer Instructor Donna Harwood Introduction into Class Climate 2 1 How would you rate the trainer s overall teaching Excellent O OF O0 O UO
645. wing legend L Letter W Word Scantron Corporation 449 Copyright Electric Paper GmbH Creating Questionnaires with VividForms AN Class Climate COURSE EVALUATION FEEDBACK SYSTEM D Digit N Number A Alphanumeric digit or letter In addition there is the possibility of using square brackets to label a placeholder as optional In this way the following pattern D D D W means that only input consisting of a number of one to three digits a hyphen and a word in this order will be accepted As well as the common syntax for patterns there is also the possibility of using regular expressions on the basis of Perl syntax to formulate patterns Regular expressions are often used to recognize patterns and offer a high level of flexibility e Pattern regular expression The following template choices are available three digit number word underscore number serial number simple serial number complex email address 5 4 Required Questions Questions for which an answer is compulsory can be configured as required questions When submitting a questionnaire in an online survey the system checks if all required questions have been answered If this is not the case the survey cannot be submitted unless answers to the required questions have been given Required questions 7 Fi i Which gender do you belong to What s your age What is your age What is the grade of you
646. wn option Complete to browse option Per Chapter or accord ing to the page display in the VividForms Editor resp Designer option Per Page With the option Per Chapter each question group is displayed in online surveys as one page Scantron Corporation 95 Copyright Electric Paper GmbH j Class Climate Certificate of Participation If the survey participants need to receive a certificate of participation this option can be activated The options allow the display of a PDF document the submission of an email only available if the PSWDs were sent by email or both The certificates will be gener ated as soon as a participant has completed a survey The text of the email can be edited via the menu Text Templates option E Mail Certif icate of participation for online surveys If you want to display a PDF certificate in the browser directly after the participants have submitted the questionnaire you first have to take the following steps e Create a PDF template respectively choose the sample template Certificate for par ticipation in online surveys from the menu System Information Sample files e Upload the PDF template in the menu System Settings Documents area PDF tem plates Attach the PDF template to the text template PDF Certificate for participation in online surveys in the menu System Settings Text Templates global respectively in the
647. wn subunit Unrestricted Templates only No access Table 1 Necessary Information for a New User Account Remember that you will not be able to use again a login name you have already used in another profile The following figure shows exemplarily creating an instructor account Scantron Corporation Copyright Electric Paper GmbH 59 Your Evaluation Process The Phase Model thy Class Climate COURSE EVALUATION FEEDBACK SYSTEM 1 2 3 2 Change the user type B Instructor Dean of Studies 1 2 3 Dean See utilization sta Eon Change the attributes of the user Module Report Creator Mr n Data Entry Assistant Ver Title enfier Subunit Administrato First name Philipp lt lt Last name Belmore Cancel Phone Email belmore example com 1 2 3 Address 2 Change the user rights Language Default language QM Views No OM Views Login name belmore additional subunits for OM views New password PITTI titty 2 SEESE penal Confirm new 7 canetation Domo Sut i Prerry Tir tyT a 3 password ata Ent Cancel s 7 VmidForms Editor Unrestricted access Caneel ee Back ___ save __ Figure 35 Creating an Instructor Account three Steps Activating Deactivating User Profiles With this function you can activate or de activate a user profile Simply click on the icon directly next to the user name Icons with a portrait and a padlock stand for passive
648. word for the title is in the second column of the CSV file See chapter B 2 3 1 CSV Import within Subunits The configured title will be used for all emails or PDF reports which are delivered to the user The placeholder SALUTATION in the email text templates will be replaced by the con tents in this option area Scantron Corporation 43 Copyright Electric Paper GmbH S Your Evaluation Process The Phase Model Class Climate 2 2 Setting up the Organizational Structure The organizational structure in Class Climate consists of three levels which are arranged hierarchically e First Level Subunits e g departments faculties e Second Level Users e g instructors deans report creators etc e Third Level Courses they are only assigned to instructors and deans With the help of the course settings further intermediate levels can be inserted such as for example the program of study These further levels can later be used for filtering pur poses By dividing the system into subunits a clearly arranged survey administration can be established and workload can be shared Each subunit can be administrated by one or more subunit administrators so that work within the system can be distributed to more than one person On user level the role of the instructor is of special importance as only instructors can be assigned courses Without having created an instructor no course can be created nor surveyed To conduc
649. xample com Economics Maria Hernandez m hernandez example com Engineering Add Delete all Figure 175 List of the Non anonymous Participants Additionally you can add further participants To do this click on the button Add The following window will open 186 Scantron Corporation Copyright Electric Paper GmbH Class Climate Search for participants The email address of a participant has to be entered and verified before the data can be completed Email Search Details of the participants Course Human Resource Management Title First Name Last name Email Address Custom 1 Custom 2 Custom 3 Save Cancel Figure 176 Add Non anonymous Participants To add a new participant you must first enter the email address of the participant in the area Search for Participants Then click on Search Class Climate searches all existent participant data for this email address If the participant is already in the system for example for another non anonymous course Class Climate adopts all existing data in the area Details of the participants With exception of the email address you can change these details as and when required lf the given email address is not yet in the system Class Climate adopts this email address in the area Details of the participants and you can add all other information such as name address etc You can add further information on the particip
650. ximum Values are activated and Compari son lines and the two other options are deactivated Everything else remains the same The graphic contains only one course each in this example but the values of the others are taken into account clearly proven by the grayed zones Here you only see one profile line in this case for the first selected course The gray zones show however that the calculation of the minimum and maximum values includes further values Scantron Corporation 321 Copyright Electric Paper GmbH COURSE EVALUATION FEEDBACK SYSTEM Profile Subunit Professional Development T Name of the instructor Prof Dr Philipp Belmore Name of the course Management Strategies Name of the survey Min Max values of Management Strategies Organization and Management EEA E Gs The lead time of the course is adequate Strongly dis Strongly agree av 3 5 agree av 3 6 The focuse th i professional discussion ily dis av 2 8 course focuses on the current professional discussion Syon ae Strongly agree rir The course perfectly prepares me for my professional life Strongly dis Strongly agree avae Bw 3 agree Please grade the course altogether failure very good net 2 be ay Figure 371 Report Creator Profile Line Emails Options Comparative line deactivated with Minimum and Maximum Values If you activate the total profile line instead of the minimum and maximum values this pro f
651. xisting notes on surveys can be viewed or Data exis Edit display notes pended ge the identification of the sur Here you Can cnange E vey survey ID Attention Not availablein All i avail Survey ID Web verifier mode ow recognized form Here the recognized boxes of the Data avall Paper originals as PDF scanned questionnaires can be displayed able Table 7 Overview on the Actions Concerning a Survey 1 18 Scantron Corporation Copyright Electric Paper GmbH Class Climate Phase 2 Implementation of Surveys COURSE EVALUATION FEEDBACK SYSTEM At the top of the Detail Window you can see the header data for the survey In the lower left hand corner you can see a number of options relating to the survey and in the lower right hand corner you can select the evaluation report and export format In the following graphic you can see header data actions and the maintenance of an email merge survey There are not yet any data available for the survey You can only display the questionnaire here finish the data collection close survey delete the survey assign the survey to substitute instructor edit show notes and change the survey ID Survey Details 2 Survey Human Resource Management amp Instructor Carlos Hernandez J Course Human Resource Management 0 Survey Period SS11 D Type Paper survey cover sheet Questionnaire Quest_01 Status In progress ready for data 0 Survey Crea
652. y Line Height Font Size Size of the answer boxes Font Selection of line height size of answer boxes font size and type for the complete questionnaire Form Properties Online View Form properties Opens the properties of the questionnaire Repair form Recreates the questionnaire Enable numbering Toggles the numbering of questions and question groups Edit Pole Template Opens the dialog for the definition of pole labels Filter settings Validation Required questions Cross tabulations Opens the dialog for the definition of filters validation required questions cross tabulations Picture Library Opens the dialog for adding and removing pictures to from the picture library Online survey template Selection of the template used for the online view in the VividForms Editor Display Selection of the display mode for the online view in the VividForms Edi tor 390 Form P Line Height 13 pi Class Climate COURSE EVALUATION FEEDBACK SYSTEM perties Form Properties Layout settings Repair form Enable numbering Edit Pole Template Filter settings Validation Required questions Cross tabulation Change color scheme Picture Library Font Size lipt Size of the answer boxes amp pt a F Font Repair form Enable numbering Edit Pole Template Filter settings Validation Required questions Cross tabulation Picture Library Online survey templates Class Climate Onine Survey Te
653. y important in the question naire appears on the right side The technical equipment is i 2 E excellent O O poor m very important 0O O very unimportant ibi ak L i i i i i 1 a poar ral The technical equipment is mpata k w a F wary important dew 4 R z I i mot prepared E The kaini if Ahaya oa o very inp bait daw T Figure 490 Dual Scale Profile Line of the linked Scaled Questions in the PDF Report Apply settings to all other scaled questions You can if required apply the settings for a scaled question to all the scaled questions already available on the questionnaire For this activate the option Apply settings to all other scaled questions and click on the button Define settings A window will then open where you can determine which set tings should be applied and define if the selected settings should be applied for the com plete questionnaire or just for the current question group 412 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM tW Question Wizard m Settings iv Abstention V Check boxes V Individualize pole labels lv Type of Diagram V Mirroring Type of Diagram Histogram v Use these settings as default for scaled questions Set this scaled question as mirrored question l Combine to dual scale with previous question V Apply
654. y the instructor after the completion of the data entry with the button Send PDF report For this the corresponding function must be activated in the configuration Sys tem Settings Class Climate Settings Functions Data Entry Assistant Sending a report to the instructor Any single survey whose answers to open questions have already been entered by a data entry assistant is protected and cannot be simultaneously edited by others In this way disruptions caused by the unseen concurrent editing of data are avoided 4 5 Instant Feedback The PDF Report After scanning the questionnaires during which you may have verified unclear fields and entered open questions you can immediately view the evaluation results As soon as there is data available from at least one questionnaire there are two types of reports available the HTML and the PDF report If you wish to get an impression of a specific type of report for example whilst creating particular types of reports it suffices to create an online survey fill in a questionnaire and send it With this data alone reports can be created Class Climate supports the PDF A 1b Standard This standard ensures that your PDF reports are suitable for long term digital preservation and are clearly able to be repro duced It is important to remember that reports are never stored in the system As soon as you click on the respective buttons Class Climate creates the report based on the cur
655. ype Seminar Location Sem 03 Enrollment Participants data 3 i Anonymous Non anonymo english Central Campus Figure 171 Administrate Anonymous Non anonymous Participants 184 Scantron Corporation Copyright Electric Paper GmbH COURSE ss Cli FEEDBACK SYSTEM thy Class Cl imate Phase 2 Implementation of Surveys After you have activated the option Non anonymous survey participant panel click on the button Administrate participants In the following window you have the now familiar option of importing the data of your participants via CSV csv import of survey participant data Import the participant data Browse Figure 172 CSV Import of Participant Data The newly imported participants are added to the already existent participants of the course Editing Participant Data You have the possibility of editing the imported participant data in the properties of the corresponding course To do this click on the green pencil in the course list of an instruc tor Courses of Philipp Belmore Managing and 62 maintaining Saa aa NA_1 continuous Seminar Sem03 75 english Central Campus a healthy lifestyle ga Management Economics Engineering NA_2 continuous Seminar Sem 02 56 Central Campus a a are laced Strat 73 Resource EConemicsiEngineering Computer o gt 54937 continuous Seminar R P412 20 english Man lentes Greate new course Figure 173 Course List with
656. ypes opens for the overview of the report that you create Scantron Corporation 287 Copyright Electric Paper GmbH ae a COURSE EVALUATION FEEDBACK SYSTEM Request instructor profile Your choice instructor Prof Dr Philipp Belmore Compilation name Belmore WS 10 11 Questionnaire train_en train_en_1 Period WS10 11 2010 09 01 to 2011 02 28 No of Surveys 5 No of completed questionnaires 67 The report creation may take a moment Please wait until an acknowledgment has been sent back from the server Which gender do you belong to Which gender do you belong to male female male female Figure 314 Report Creator Instructor Profile Overview of the Selection made and the Question naire Here you deactivate the questions that you do not need in the instructor report and click on Create In turn this report also appears in the list HTML Prof Development WS10 11 Data available train_en 05 18 2011 2 046 88 choose pdf report CSV SPSS HTML Economics WS10 11 Data available F train_en 05 18 2011 21046 QB choose pat report CSV SPSS Figure 315 Report Creator Instructor Profile in the Report List Any Compilation The option Any Compilation is completely flexible you can freely select which elements you wish to combine Unlike the other report types it is therefore possible to make a mul tiple choice in the individual s
657. ys Legal references in Non anonymous Surveys Please note that when conducting non anonymous surveys you are processing the per sonal data of the participants The processing of personal data is subject to special stipu lations of the data protection act as well as possible regulations of other laws i e campus or labor legislation As a rule elements of these regulations state that when surveying by means of question naires forms Survey participants are informed of the data processing in particular e of the intended purpose of the data processing e of whether the details are voluntary or an obligation exists together with the conse quences of a refusal as the case may be e and of the possible recipients of the data The extent of the duty to inform as well as the admissibility of the data process itself depends significantly on the legal requirements under which your particular case is posi tioned This assessment depends on a number of factors which cannot be listed here You can normally get support from your data protection officer and or the data protection committee Scantron Corporation 181 Copyright Electric Paper GmbH E Your Evaluation Process The Phase Model thy Class Cl imate COURSE 3S UH FEEDBACK SYSTEM Class Climate provides reference texts for anonymous and non anonymous surveys You can find these reference texts under System Settings Text templates E MAIL Footnote for anonymous online
658. z recognition Characters Alphabetical Language English Figure 497 Open Question Selecting the Language Segmented v Format NNNN NN NN New format Style of segmented cm box Figure 498 Open Question Setting Segmentations Optional segmented fields can be formatted and displayed for handwriting recognition By segmenting handwritten entries appear more orderly and provide for considerably improved automatic reading Preset formats for date specification e g NN NN NNNN can be selected and stored as well as your own new formats such as for cus tomer numbers and the like 416 Scantron Corporation Copyright Electric Paper GmbH AN Class Climate Creating a Questionnaire in the VividForms Editor COURSE EVALUATION FEEDBACK SYSTEM The following options are available for own formats e N for numerical entries e L for alphabetical entries e A for alphanumerical entries as well as special characters To define your own format activate the option New format Click the buttons N L A to add the character types or type the text directly into the input field Please observe when creating your own templates the separator must be in inverted commas e g otherwise they cannot be recognized by Class Climate Lastly different styles for the segmentation can be selected The fields can be displayed closed at the top open at the top or half open Style o
659. zed to create new questionnaires edit the administra tors templates or can he only use central templates with which to create his sur veys For this purpose you set the respective rights in the mask for Creation Modify user data option VividForms Editor You have the options of Unrestricted access Extension of templates only No access Unrestricted access Unrestricted access Extension of templates only No access VividForms Editor Cancel Figure 188 A User s Access to the VividForms Editor The names are relevant and describe the above mentioned rights ls an active instructor upon completion of processing authorized to view to which degree his surveys meet the quality guidelines or even those of his subunit pos sibly those of additional subunits or even those of the entire system You also grant these rights in the mask that serves to create and change user data The following options can be chosen from No QM views Only own surveys Only own subunit Unrestricted access lf you wish to authorize access to one s own subunit or extend one or more accesses first select the option Own subunit only Then you can define further subunits by selecting Additional subunits in the gray area Scantron Corporation 195 Copyright Electric Paper GmbH Your Evaluation Process The Phase Model thy Class Clim COURSE 3S LH mate SYSTEM QM Views No QM Views No QM Views

Download Pdf Manuals

Related Search

Related Contents

Philips Satinelle Soft Epilator HP6512  Unisar BR149 User's Manual  Guia do Usuário  User Manual for Lava™ Lab Software 2.6 for Chairside Oral  Benutzeranleitung – Soundprozessor und Zubehör  PDF file - Sporting Designs  UltraTouch 10003-11315 Installation Guide  teacher handbook - Shaler Area School District  Governança Corporativa em Redes Sociais  

Copyright © All rights reserved. Failed to retrieve file