CAT User Manual for the NewsReader EU Project
Contents
1. 11 FIGURE TO IMPOR DUNG PAS LI 12 FIGURE 11 THE TASK SELECTION DROP DOWN BOX 12 FIGURE 12 THE DEFINE MARKABLE WINDOW 13 FIGURE 13 CHANGE THE ORDER OF THE ATTRIBUTE VALUES ieri 13 FIGURE 14 ICONS OF THE DIFFERENT TYPES OF ATTRIBUTES 1 enne 14 FIGURE 15 EXAMPLE OF AN ATTRIBUTE WINDOW WITH UNSAVED VALUES IN RED 16 FIGURE 16 EXAMPLE OF AN ATTRIBUTE WINDOW WITH SAVED VALUES IN BLACK 17 FIGURE 17 ASSIGNING THE VALUE TO A REFERENCE LINK ATTRIBUTE rn 17 FIGURE 18 CHOOSE THE MARKABLE TO nnne nnns 18 FIGURE 19 CHOOSE THE OF RELATION TO ANNOTPATE 4 erre 18 FIGURE 20 CREATE A NEW RELATION Gela ella 19 FIGURE 21 ADD SOURCE AND TARGET OF A RELATION 19 FIGURE 22 DRAG AND DROP THE SOURCE TO THE TARGET OF THE RELATION 19 FIGURE 23 SOURCE AND TARGET HIGHLIGHTED IN THE TEXT 20 FIGURE 24 DELETE ONE SOURCE OR ONE TARGET IN A RELATION irene 20 BIGURE 25 BMPTY TAGS cla 22 NewsReader ICT 316404 February 3 14 CAT User Manual 5 24 1 Introduction to CAT an Overview The Content Annotation Tool hereafter mentioned with the acronym is general purpose web based text annotation tool created by the Center for the Evaluation of Language and Communication Technologies CELCT and now maintaine2. eese nennen nnne nnne nnns 18 SIANO INGORE iue didt ation 18 3 9 1 Changing or Deleting the Source the Target of a Relation 20 2 9 2 Deleunp RelatloD acaso biben a ADM D 20 3 9 3 Arninotating Relation Attributes aa 21 DLO 4d nmnotatihg EMP Tiara iaia 21 od T Hiding Annotated teo 22 9 12 EO ie El UM ME 22 Sto 22 4 Calculating Inter Coder Agreement rin 23 5 List of Keyboard Shortcuts in Alphabetical Order 23 6 Updates from the previous version of the manual 24 References vc 24 NewsReader ICT 316404 February 3 14 CAT User Manual 4 24 List of Tables FIGURE 1 THE APPLICATION MENU BAR 6 FIGURE 2 WINDOW WITH THE NUMBER OF ANNOTATED MARKABLES IN A FILE 7 FIGURE 32 THE TEXT PANEE MENU Leila li LL 8 FIGURE 4A THE RELATION PANEL 8 PIGUR Ee Get eg adorate reg ade ev asc evo Co ze 9 BIGURA G CAT INTERPAQGE LELE LL LIA ss TUUS 9 FIGURE Z HIDEAUNHIDE THE CORPUS PANE ieri 10 FIGURE S HIDE UNHIDE THE RELATION PANE cani 10 FIGURE 9 WORKING ENVIRONMENT WITH A REDUCED WIDTH OF THE TEXT PANEL
3. NewsReader ICT 316404 February 3 14 CAT User Manual 6 24 3 Using CAT 3 1 Exploring the Interface The main window of CAT appears on the screen after the login The window is divided into three parts 1 2 3 the Corpus Panel on the top left corpora and files are listed here the list can be hidden clicking on the eye icon the Layer Panel on the bottom left annotation layers i e the list of available markables and empty tags if present are listed in two different tabs the large Text Panel on the right text to be annotated are shown here On the top of the main window the application menu bar is displayed fig 1 it contains File Edit Task Markable and Relation pull down menus which can be selected passing the mouse over the bar File Edit Task Markable Relation Statistics Help Figure 1 the application menu bar The File menu permits the following actions New Corpus creates a new corpus to be annotated files of the corpus are displayed in the Corpus panel Import imports raw texts or tokenized files in a corpus Import XML CAT file imports one or more files already annotated and formatted following the CAT XML format in a selected corpus Export as standoff XML exports the annotated corpus in the CAT XML standoff format Logout allows to exit from your CAT account The Edit menu permits the following actions Preferences opens up a Preferences window in which you can custo
4. Share prices the Egypt Exchange declined almost 9 5 percent GP Cairo_25 November 2012 iI midday 1000 Sundsy President Mohamed Morsi Egypt_stocks_plunge 25 51 Newsi KS txt type PERCENT assumed sweeping powers that sparked clashes and polarized the News2_KS txt E 4 m country s politics I _ lt _____ gt P P eo_o Y o comment The main EGX 30 index shed 9 49 percent to reach 4 923 19 points unsaved values 52 aan according to the Egyptian Exchange Dea ZI ENTITY_MENTION 4 The stock exchange suspended trading E half an hour RE V EVENT S3 intense investors source at the exchange Agence EVENT MENTION selling by 5 9 told 9 VISI WI SIGNAL France Presse V TIMEX3 WI VALUE The drop comes 88 Egyptians have been deeply split BY Morsi s CLINK Relations gt CLINK gt TLINK Y SLINK S3told lt gt SLINK lt gt S3 suspended HAS PARTICIPANT REFERS TO Figure 9 working environment with a reduced width of the Text Panel 3 2 Creating a Corpus 1 From the top Menu select File gt New Corpus A pop up window appears 2 Typein the name of the corpus 3 A new folder appears in the Corpus Panel on the left hand side of the interface To rename a corpus right click on the corresponding corpus folder 3 3 Adding Files to a Corpus There are 2 options 1 Import a plain text files encoded in UTF 8 on which CAT performs a simple tokenizat
5. rival rallies sparking ENTITY 54 V ENTITY MENTION violencein several major cities EVENT V EVENT MENTION The powerful Muslim Brotherhood has called nationwide demonstrations in support of Morsi s decree which has put him on a collision course with the V SIGNAL 55 m xx isi Laye r V judiciary and with many of the political forces that brought down Hosni 2011 popular uprising V VALUE Panel CLINK Relations gt CLINK gt TLINK SLINK S3 told lt gt SLINK lt gt S3 suspended gt HAS PARTICIPANT Figura 6 CAT Interface Relation Panel NewsReader ICT 316404 February 3 14 CAT User Manual 10 24 Please note that the default view of CAT can be partially changed lt gt hide unhide the Corpus Panel clicking on the icon or moving up the dark gray splitter bar above the Layer Panel File Edit Task Markable Corpus FBK Test 1 eecb txp txt Cairo 25 November 2012 Cairo 25 November 2012 Egypt stocks plunge 25 Newsi_KS txt News2_KS txt Spain s Pain Brings Ga NAACL Workshop Tsunami examp a NAACLEventsWorkshopTest ia NewsReader Test 4 FRI C SIGNAL ENTITY ENTITY MENTION EVENT EVENT MENTION SIGNAL TIMEX3 VALUE S S S S S S S S Figure 7 hide unhide the Corpus Panel hide unhide the Relation Panel pressing F1 or clicking on the dark gray bar a
6. belonging to the relevant markable If the token is part of more than one markable a window appears asking to choose the markable you are interested in e g SO Cairo Shares Plunge Zr Select a markable x my 1 Please select a markable to display i pol ENTITY MENTION Cairo ENTITY MENTION gt Cairo Shares s2 Ti Figure 18 choose the markable to modify Select the relevant markable and confirm the selection with OK A window appears showing the attributes whose values can be modified To delete an annotation right click on the relevant markable and select the option Delete Markable If the token is part of more than one markable a window appears asking to choose the markable you want to remove If a markable is involved in a relation i e is the source or a target of a relation a warning message appears asking you to delete the relation first 3 9 Annotating a Relation In order to set a relation 1 Visualize the Relation panel by pressing F1 or clicking on the dark gray bar at the bottom of the page 2 The Relation panel shows up 3 Select the relation type you want to annotate from the drop down menu shown in the Relation Panel CLINK GUNK HAS PARTICIPANT REFERS SUNK TUNK Figure 19 choose the type of relation to annotate NewsReader ICT 316404 February 3 14 CAT User Manual 19 24 4 Click on the icon to set a new relation A bar w
7. options are available Delete Attribute Modify Attribute and Rename Attribute To add an attribute click on one of the five possible types of controls namely text box element radio button element check box element dropdown combobox menu element reference link element At the moment it is not possible to rename or delete relations from a task 3 6 1 Modifying Markable and Relation Attributes After right clicking on an attribute and choosing the option Modify Attribute a pop up window appears in which it is possible to e change attribute name NewsReader ICT 316404 February 3 14 CAT User Manual 15 24 e change the type of control In a multi value type of control i e Radio Button or Combo Box you can delete and rename each value right clicking on it or add new values clicking on the icon Please note that if you change from a multi value type of control to a text box control the annotated values are maintained Vice versa if you change from a text box control to a multi value type of control to maintain the previously annotated values you have to add that value as a value of the new multi value attribute 3 7 Opening a File To open a file click on its name in the file list displayed in the Corpus Panel the text will appear in the Text Panel on the right 3 8 Performing Markable Annotation 3 8 1 Starting the annotation 1 Click on a corpus folder in the Corpus Panel on the left hand side 2 Click on th
8. CAT User Manual for the NewsReader EU Project Technical Report NWR 2014 5 Version FINAL Giovanni Moretti Rachele Sprugnoli Fondazione Bruno Kessler moretti sprugnoli fbk eu ewskeade OST HOC ERGO PROPTER 1 P RH COOPERATION BUILDING STRUCTURED EVENT INDEXES OF LARGE VOLUMES OF FINANCIAL AND ECONOMIC DATA FOR DECISION MAKING CAT User Manual 2 24 ICT 316404 NewsReader ICT 316404 February 3 14 CAT User Manual 3 24 Contents 1 Introduction to CAT an Overview rino 5 2 VER EE TRE E d 5 6 DI EXDIOGEIBO CHO abside 6 Su ZI COL US esa unc mn ea acm ed dc de des dc dcum ad accade dide 11 TUES OU 11 3 4 Importing the NewsReader Annotation Task entrent 12 3 5 am Existing e bte b pot tetto 12 3 0 MOOIUVING arm EXISCING RElQUON sea tt nto o te i net P CORR 14 3 6 1 Modifying Markable and Relation Attributes sss 14 La 15 3 8 Performing Markable rien 15 9 941 Starting the 15 5 90 27 AUMOLALING aia wal lO ina 15 3 8 3 Annotating attributes of a markable seen 16 3 8 4 Modifying deleting an annotation
9. anual Correction of the shortcut to be used to annotate non contiguous tokens References Lenzi V B Moretti G amp Sprugnoli R 2012 CAT the CELCT Annotation Tool In LREC pp 333 338 NewsReader ICT 316404 February 3 14
10. attributes and possible values can be also defined and modified The Statistics menu permits the following action Count markables in this file as shown in the image below Statistics x Statistics are computed only on saved markables Cairo_25 November 2012 Manuela Markable Occurences C SIGNAL 1 ENTITY 17 ENTITY_MENTION 27 EVENT 12 EVENT MENTION 17 SIGNAL 8 TIMEX3 5 VALUE 4 2 Figure 2 window with the number of annotated markables in file Distribution of attributes on this file Count markables on corpus Distribution of attributes on corpus Inter Coder Agreement at the moment it works only on the extent of annotated markables using the Dice coefficient metric and only between NewsReader ICT 316404 February 3 14 CAT User Manual 8 24 two corpora i e between the annotation performed by two annotators For more details see Section 4 The Help menu contains some information about the tool such as the license agreement and the reference to be cited in scientific papers and the user manual in pdf format On the top of the Text Panel the text panel menu bar is displayed see figure 2 af Confirm Markable Delete Selection Task Selection NewsReader Pd C SIGNAL al Q Q Figure 3 the Text Panel menu bar The bar offers specific actions for text annotation and manipulation Confirm Markable confirms that the selected portion of text is to be marked up Delete Select
11. click on the name of the attribute click on the Save icon on the bottom right of the attributes window Note that unsaved values are shown in red as specified in the caption unsaved values If default values are present they are displayed in the Markable Attributes pop up window Please note that also the default values must be saved After saving the attributes turn black 3 10 Annotating Empty Tags CAT allows to annotate empty tags that is tags with no textual content for every type of markable defined for a task For the NewsReader project two markables are defined as empty tags namely ENTITY and EVENT 1 Select the NewsReader annotation task from the Task Selection drop down box in the Text Panel menu bar Selectthe type of markable you want to annotate from the Markable drop down box in the Text Panel menu bar containing all the defined markables for the selected task Go to the Layer Panel below the Corpus Panel on the left side and choose the Empty Tags tab Click on the LJ icon to set a new empty tag for the selected type of markable all the empty tags have the same default name Empty_Mark To change the name of an empty tag right click on it and select the Rename option and follow the instructions This corresponds to the tag_descriptor attribute of the lt ENTITY gt and lt EVENT gt markables Names of empty markables should follow the rules defined in the annotation guideli
12. d and developed by Fondazione Bruno Kessler FBK The aim of the tool is to make the annotation activity as intuitive as possible supplying at the same time a rich set of features The main strengths of CAT are flexibility practical usability and customizability It also supports multi layer annotation in order to combine the annotation of several linguistic semantic layers it provides a standardized XML stand off output format to help convertibility Citation e Lenzi V B Moretti G amp Sprugnoli 2012 CAT the CELCT Annotation Tool In LREC pp 333 338 2 Running CAT No installation is required given that CAT runs in your browser you only need a supported browser see Table 1 and the Flash plugin properly installed http get adobe com it flashplayer To obtain access to CAT go to the following URL http dh fbk eu resources cat content annotation tool A local application has been development as well To obtain it please send an email to CAT support fbk eu The following table summarizes the current browser support for CAT functions Browser Editing ful R8 Firefox Full a Full some shortcuts are not properly working Explorer Notsupported Table 1 supported browser Please note that browsers often change their versions so some issues can arise the above table is based on testing with recent browser versions older or newer versions may not support the same features
13. drop comes Egyptians have been deeply split y Morsi s move to place his decisions beyond judicial scrutiny rival rallies 54 CLINK Relations v CLINK S4 move lt gt CLINK lt gt S4 split Figure 23 source and target highlighted in the text 8 In order to quickly find and highlight the argument of a relation within a text click on the magnifier icon Once you click on that icon the text scrolls to the point in which the argument is located and the relation is highlighted both in the Relation Panel and in the Text Panel in addition the background of the sentence containing the relation blinks in yellow 3 9 1 Changing or Deleting the Source or the Target of a Relation There are two ways to change the source or the target of a relation 1 select the relation and choose different markables with alt click and alt shift 2 select the relation and right click on it choose the Remove source or the Remove target command from the menu and choose different markables with alt click and alt shift In the case the relation has more than one source or more than one target only this second option is available To delete only one Source or one Target in a many to one one to many or many to many relation right click on the relation and choose the element to delete from the list of sources targets S4 Morsi S5 Morsi lt S5 him S1 Mohamed Morsi S1 President lt S4 his gt REFFRS gt Mahamad Ma
14. e name of the file you want to annotate 3 The text will be displayed in the Text Panel on the right 3 8 2 Annotating a markable 1 Select the NewsReader annotation task from the Task Selection drop down box in the Text Panel menu bar 2 Select the type of markable you want to annotate from the Markable drop down box in the Text Panel menu bar containing all the defined markables for the selected task 3 Select the portion of text i e one or more tokens to be annotated by pressing shift and clicking on the relevant token s To select non contiguous tokens as shown in the figure below press shift first token and ctri shifttother tokens on Mac shift first token and CMD shift other tokens 4 Confirm the annotation by pressing ctrl a or clicking the icon f Confirm Markable in the Text Panel menu bar Please note that the shortcut ctrl a works in Chrome and Safari but not in Firefox In order to see the options available on a markable e g deletion right click on it Options available on a markable are as follows Delete markable Change Markable Extent you can modify the extent of a markable right clicking on an already annotated markable and choosing this option The markable becomes highlighted with a dotted line select the new extent and ctrl a or confirm markable to change the extent If you change your NewsReader ICT 316404 February 3 14 CAT User Manual 16 24 mind and decide not to modify the exte
15. ill appear showing an empty relation CLINK Relations v CLINK Empty CLINK Markable Figure 20 create a new relation 5 Press alt click on the first markable Control Alt Click on Linux which is the source of the relation i e the left the markable is highlighted in the Text Panel If the relation requires more than one source element press alt click on all markables to be annotated as sources 6 Press alt shift on the second markable Control Alt Shift Click on Linux which is the target of the relation i e the right argument the markable is highlighted in the Text Panel If the relation requires more than one target element press alt shift on all markables to be annotated as targets CLINK Relations v CLINK S4 move lt gt CLINK lt gt 54 split Figure 21 add source and target of a relation In case of one to one relations you can create a new relation dragging dropping the source markable over the target markable to place his decisions beyond judicial scrutiny rival rallies The drop comes Egyptians have been deeply 54 sparking violence in several major cities Figure 22 drag and drop the source to the target of the relation 7 The relation is shown in the Relation panel when selected it is highlighted in dark grey and the corresponding source s and target s is are highlighted in the text NewsReader ICT 316404 February 3 14 CAT User Manual 20 24 The
16. ion cancels the selection of a portion of text copy and paste text important when adding the head of entity mentions select a portion text click on the icon and a window appears ctrl c to copy in the clipboard close the window and then ctrl v to paste into a textbox attribute Task selection drop down menu from which you can choose the annotation scheme V ists the set of available markables for the selected task af modify text panel width reducing its width Q increases and decreases text font size the Text Panel menu The Relation Panel fig 3 can be visualized pressing F1 or clicking on the dark gray bar at the bottom of the page When activated the Relations Panel is displayed under the Text Panel Through this panel it is possible to add delete or modify relations for every relation type in a task add modify and delete source and target for each relation ALINK z Relations CLINK TLINK 53 searching gt gt 53 hunting 53 hunting gt gt lt 52 gone 54 asleep gt TLINK gt gt 53 searching 55 awake gt TLIMK gt 54 asleep Figure 4 the Relation panel NewsReader ICT 316404 February 3 14 CAT User Manual 9 24 The Layer Panel has 2 tabs fig 4 Markables each type of markable annotated in the text and displayed in the Text Panel has a checkbox which enables and disables the visibility of that type in the Text Panel All annotations are visib
17. ion e Click on the folder corresponding to the Corpus you have created in order to select it e From the top Menu select gt File gt Import gt Text Files e Select one or more files and click Open 2 Adda tokenized file with a token per line format e Click on the folder corresponding to the Corpus you have created in order to select it e From the top Menu select gt File gt Import Tokenized Text Files e Select one or more files and click Open The imported files are listed in the selected folder NewsReader ICT 316404 February 3 14 CAT User Manual 12 24 In order to delete or rename an imported file right click on it Please note that it s not possible to import a file without having previously created a corpus 3 4 Importing the NewsReader Annotation Task The already defined annotation task for the project can be imported in CAT through the following steps 1 From the top menu select Task gt Import Task Edit Task Markable Relation Statistics Help Delet Corpus qu Define Task able Rename Selected Task Delete Selected Task 21 discussion EHE taa EG EEG RES E discussion FB ipa cuius l Import Task 3 discussion V Figure 10 importing a task 2 Browse in your folder and select the file named CAT_task_NewsReader xml The imported task will be shown in the Task Selection drop down box in the Text Panel menu bar Confirm Markable Delete Selection Task Selection Ne
18. le by default Empty tags lists the empty tags that is tags with no textual content C SIGNAL ENTITY ENTITY MENTION V EVENT V EVENT MENTION IV SIGNAL MW TIMEX3 IV VALUE Figure 5 the Layer Panel Figure 6 shows the main elements of CAT interface Application Menu Bar Task Markable Relation Statistics Help v x bad f Confirm Markable 6 Delete Selection Task Selection NewsReader 7 C SIGNAL af QQ Hide Unhid E agreement FBK Text Panel 0 agreement VUA e Co rpus Cairo_25 November 2012 Manuela discussion EHU menu bar Panel discussion FBK E discussion VUA 0 Cairo Shares Plunge 9 poitical Crisis Deepens 5 FBK Test 1 eecb txp txt Share prices on the Egypt Exchange declined almost 9 5 percent midday 1000 GMT 88 Sunday after President Mohamed Morsi Cairo_25 November 2012 51 Cairo_25 November 2012 assumed sweeping powers that sparked clashes and polarized the country s politics Egypt stocks plunge 25 C O rpu S Newsi KS txt S2 Themain EGX 30 index shed 9 49 percentto reach 4 923 19 points according to the Egyptian Exchange T ext P an el News2 KS txt P an el T The stock exchange suspended trading p half an hour itepintense selling by investors a source at the exchange told Agence France Presse C SIGNAL The drop comes 88 Egyptians have been deeply split GP Morsi 5 moveto place his decisions beyond judicial scrutiny
19. lease modify attribute Attribute Name typel Attribute Type Combo Box A li Values T DATE TIME DURATION SET Figure 13 change the order of the attribute values NewsReader ICT 316404 February 3 14 CAT User Manual 14 24 To add an attribute click on one of the five possible types of controls namely text box element radio button element check box element dropdown combobox menu element reference link element x PAS Anc la Figure 14 icons of the different types of attributes At the moment it is possible to rename markables from a task but not to delete them from an annotation task 3 6 Modifying an Existing Relation In order to modify an existing relation CAT requires the following steps 1 From the top menu select Relation gt Define Modify Relation or press Ctrl R 2 Anew window appears where you can load the existing relation you want to modify selecting the corresponding task i e NewsReader and relation and clicking the reload icon on the right 3 The type of relation can be modified from the Relation Type drop down box The options are one to one one to many one to many many to one many to many 4 The options Typified if the relation always involves a certain kind of markable and Directional if the relation holds in only one direction can be changed as well 5 Colors and attributes related to the selected relation appear and can be modified right clicking on them Three
20. mize some elements of CAT The Task menu permits the following actions Define Task allows to define the name of a new annotation scheme Rename Selected Task changes the name of an annotation task Delete Selected Task deletes an annotation task BE CAREFUL if you delete a task all the annotations made following that task are automatically deleted Export Selected Task exports a selected XML annotation scheme from CAT Import Task import an XML annotation scheme in CAT NewsReader ICT 316404 February 3 14 CAT User Manual 7 24 The Markable menu permits the following actions Define Modify Markable opens up a window in which you can define the markables to be used during the annotation in a specific annotation task For each markable it is possible to choose a label and an annotation highlight color attributes and possible values can be also defined and modified in this window Rename Selected Markable changes the name of a specific markable Delete Selection cancels the highlighted portion of text Add Markable confirms that the highlighted portion of text is to be marked up The Relation menu permits the following action Define Modify Relation opens up a window in which you can define relations among markables to be used during the annotation in a specific annotation task For each relation it is possible to choose a label and an annotation highlight color relation types source and target types directionality
21. n the Markables tab of the Layers Panel which enables and disables the visibility of the annotation in the Text Panel annotations are visible by default 3 12 Saving a File A file is automatically saved after every action performed by the annotator 3 13 Exporting a Corpus To export the annotated files of a corpus 1 Selectthe corpus folder you want to export in the Corpus Panel 2 Select the task NewsReader from the Task Selection drop down box in the Text Panel menu bar NewsReader ICT 316404 February 3 14 CAT User Manual 23 24 3 Select File gt Export as stand off XML and wait until the zip folder is downloaded Note that ALL the files of the selected corpus both annotated and non annotated will be exported The exported corpus can be imported again in CAT 1 Create a new corpus in CAT as explained in section 3 2 2 Select File gt Import XML CAT file and upload one or more files 4 Calculating Inter Coder Agreement CAT contains a built in functionality for the calculation of the Inter Coder Agreement on two corpora At the moment it works only on the extent of annotated markables using the Dice coefficient The 2 corpora should have different names but contain files with the same names in case the two corpora have files with different names the script calculates the agreement only on those files with the same name Procedure 1 Select Statistics gt Inter Coder Agreement 2 Awindow pops us drag and drop
22. nes of the project NewsReader ICT 316404 February 3 14 CAT User Manual 22 24 ine arop co Markables Empty Tags 54 ENTITY judiciary violence in 5 powerft 55 the judiciary many forces rallies person 111 forces Muslim Brotherhood Agence Frango Rianna Delete Egyptian Exc na Rename cities Remove link with related markable Egypt Cairo Shares EGX 30 index Cairo Figure 25 empty tags 5 To annotate attributes double click on the empty tag the attributes window opens up Fill in the form with correct values Please note that to assign the value to a reference link attribute drag and drop the corresponding markable that is to be used as a value for that attribute To delete the value of a link attribute right click on the name of the attribute Click on the Save icon on the bottom right of the attributes window 6 Note that unsaved values are shown in red as specified in the caption unsaved values If default values are present they are displayed in the Markable Attributes pop up window Please note that also the default values must be saved After saving the attributes turn black To delete an empty tag right click on it and select the option Delete An empty tag can be involved in a relation by adding it as source or target 3 11 Hiding Annotated Markables Annotations may be hidden from view using the Layers Panel Each type of markable has a checkbox i
23. nt ctrl z or delete selection to cancel the action when the markable is highlighted with a dotted line Modify token word you can edit the word on which you right clicked Define sub tokens you can annotate sub sections of a token Please note that this feature is not fully implemented yet sub sections of a token cannot take part in a relation Involved in lists all the relations having the markable as a source or a target If you click on one of the listed relations the source and the target become highlighted and the window with relation attributes opens 3 Delete Selection To remove the token selection click on the icon in the Text Panel menu bar or press ctrl z this shortcut works in Chrome Safari and Firefox Following the same method it s possible to annotate overlapping portions of text Overlapping annotated portions of text are highlighted in bold Note that a file is automatically saved after every action performed by the annotator 3 8 3 Annotating attributes of a markable 1 Clicking on a markable the Markable Attributes pop up window appears 2 Fill in the form with correct values following the annotation guidelines 3 Click save Note that unsaved values are shown in red as specified in the caption unsaved values e g Markable Attributes x Current Spain Extent Markable type ENTITY_MENTION head syntactic type NOM m comment Figure 15 example of an attribu
24. rs S4 Egyptians gt REFERS TO gt S Egyptians Delete Relation S4 several major cities gt REFERS TO gt cities Remove Sources S4 comes gt REFERS TO gt comes 54 Morsi S4 rival rallies gt REFERS TO gt S rallies es 2 ead S5 Hosni Mubarak gt REFERS TO gt Hosni Mubarak 1 Mohamed Morgi S5 The powerful Muslim Brotherhood gt REFERS TO gt Muslim Brotherhood 81 President S5 many ofthe political forces that brought down Hosni Mubarak in a 2011 popular uprising S4 his es S5 the judiciary gt REFERS TO gt judiciary Remove Targets S5 the political forces that brought down Hosni Mubarak a 2011 popular uprising gt REFEF Mohamed Morsi Figure 24 delete one source or one target in a relation 3 9 2 Deleting a Relation To delete a relation 1 select the relation to be deleted 2 click on the icon in the Relations Panel or right click on the relation and select the Delete Relation option NewsReader ICT 316404 February 3 14 CAT User Manual 21 24 3 9 3 Annotating Relation Attributes To annotate the attributes related to a relation 1 3 double click on the relation in the Relation Panel in order to open up the attributes window fill in the form with correct values To assign the value to a reference link attribute drag and drop the corresponding markable that is to be used as a value for that attribute To delete the value of a link attribute right
25. t the bottom of the web page Tra ope way AOT TUNE LU PIOUS PRD VOY UTI oui WIE rivar ramo 54 sparking violence in several major cities The powerful Muslim Brotherhood has called nationwide demonstrations in support of Morsi s decree which has put him on a collision C SIGNAL V ENTITY V ENTITY MENTION 55 V EVENT EVENT MENTION SIGNAL course with the judiciary and with many of the political forces that brought down Hosni Mubarak 2011 popular uprising V TIMEX3 V VALUE Figure 8 hide unhide the Relation Panel modify the height of the Relation Panel when it is open moving up and down the dark gray bar above the panel reduce the width of the Text Panel clicking on the iconin the Text Panel menu bar This option allows visualizing the Text Panel and the pop up attribute window one next to the other NewsReader ICT 316404 February 3 14 CAT User Manual 11 24 File Edit Task Markable Relation Statistics Corpus f Confirm Markable Delete Selection Task Selection NewsReader C SIGNAL agreement FBK E agreement VUA DEMO Markable Attributes x nae Cairo_25 November 2012 Manuela E discussion FBK Current 9 EI discussion VUA Extent 50 Cairo Shares Plunge 9 Crisis Deepens 5 FBK Test Markable VALUE 1 eecb txp txt type
26. te window with unsaved values in red If default values are present they are displayed in the Markable Attributes pop up window Please note that also the default values must be saved After saving the attributes turn black e g NewsReader ICT 316404 February 3 14 CAT User Manual 17 24 Markable Attributes x Current Spain Extent Markable type ENTITY_MENTION head Spain syntactic type NAM comment A Figure 16 example of an attribute window with saved values in black 4 To assign the value to a reference link attribute drag and drop the corresponding markable that is to be used as a value for that attribute To delete the value of a link attribute right click on the name of the attribute Markable Attributes Current Nulla consequat massa quis enim Extent Markable type Example_Markable Example Attribute Def value ncus First Example Radia Attribute second Third pien Example_check_Attribute 5 Example dropdown Attribute Second Example reference Attribute drag markable Unsaved values Figure 17 assigning the value to a reference link attribute 5 The Markable Attributes window does not close automatically after saving When finished close the window clicking on the icon NewsReader ICT 316404 February 3 14 CAT User Manual 18 24 3 8 4 Modifying deleting an annotation To modify an annotation click on a token
27. the two corpora in the window 3 Different measures appear in the window namely Overall results Micro and Macro average on all the files with the same name e Dice coefficient on markable extent for each type perfect overlap e Dice coefficient on markable extent for each type considering only the overlapping tokens Results for each single file e Dice coefficient on markable extent for each type considering a perfect overlap e Dice coefficient on markable extent for each type considering only the overlapping tokens 5 List of Keyboard Shortcuts in Alphabetical Order Confirm markable Ctrl A not working in Firefox Define anew markable Ctrl D minor issue in Firefox Define a new relation Ctrl R minor issue in Firefox Delete selection Ctrl Z Find in a text using the browser search feature Ctrl F Open up the Relation Panel FI Select portion of text to be annotated Shift Click Shift on text NewsReader ICT 316404 February 3 14 CAT User Manual 24 24 Select non contiguous tokens press shift first token and ctrl shift other tokens on Mac shift first token and CMD shift other tokens Select the source s of a relation in Windows and Mac Alt Click Select the target s of a relation in Windows and Mac Alt Shift Click Select the source s of a relation in Linux Control Alt Click Select the target s of a relation in Linux Control Alt Shift Click 6 Updates from the previous version of the m
28. wsReader 7 C SIGNAL bel e WOW Dirha FrameNet NewsReader NewsReader4 prova Terence 1 0 Workshop Figure 11 the Task Selection drop down box 3 5 Modifying an Existing Markable In order to modify an existing markable in the NewsReader task CAT requires the following steps 1 From the top menu select Markable gt Define Modify Markable or press Ctrl D 2 A new window appears where you can load the existing markable you want to modify selecting the corresponding task i e NewsReader and markable and clicking the reload icon on the right 9 3 Colors attributes related to the selected markable appears be modified right clicking on them Three options are available Delete Attribute Modify Attribute and Rename Attribute NewsReader ICT 316404 February 3 14 CAT User Manual 13 24 Define Markable x Select Task NewsReader TIMEX3 Color d ARC o le type DATE value functioninDocument NONE anchorTimelD draq markable here to link beginPoint drag markable here to link endPoint drag markable here to link comment e i4 Delete Attribute Modify Attribute Rename Attribute Figure 12 the Define Markable window The order of the attributes and the order of the values in a can be changed using a drag and drop Define Markable x Select Task NewsReader TIMEX3 Color d o it m Modify Attribute x P
Download Pdf Manuals
Related Search