click away - Consorzio Milano Ricerche
Contents
1. Notes Start 00 00 00 End 00 00 00 Your notes przes uchanie wiadka Justyny Radzik Annotations import ese ma Fig 16 User annotations control A user can set annotation start and end time using Set Current buttons User annotation can be also imported from atext file Document download While browsing trial folders on the trial details page user can choose a document to download A download document page will be displayed with some basic document information r Trial archive Q Search trials ee SIDIP E Document info File name OWU PZU pdf File format application pdf File size 124 908 bytes AA Download mete Fig 17 Document download To getthis document user should click on download button Search Trials Search trials page enables user to easily find trials and documents he is looking for User should provide a search phrase and optionally choose some narrow search options SAWA fey Trial archive Q Search trials JODI Logged in as Jumas User ee Quick Start LI q Q Search content Search phrase Search Narrow search Fig 18 Search trias ew Trial archive search trials sivie Logged in as Jumas User Quick Start J i ij O Search content Search phrase Search Narrow search Transcription Emotions Use expander User annotations GRO al Use ontologies Metadata Fig 112. Search trials Narrow search 3 2 JUMAS Process Manager user manual for system administrators Main Window Main window is divided on to three panels e SISIP trials SIDIP trials structure e Media Sessions Media sessions for selected hearings _ e Uploading list of currently uploading media files JU OC a Y or SHar atga eot A Media Session for hearing Court Procura di Naples Name Creation Date Insertion Date f Udi N 16 11 2007 Section of court Department of Economic sda zabic EHE Trials Naples 16 11 2007 jf 2007 11 16 09 00 2 Naples 07 11 2007 47 Naples 19 11 2010 Naples 06 02 2008 C media_lib JPC configuration Under Main menu Jumas Options you can find option window with 3 tabs JPM configuration Database connection Jumas portal JPM configuration tab On the JPM configuration tab you can set destination directory for uploaded media files Path for multimedia library folder If Use path for IIS streaming option is checked then video files prepared for IIS streaming are uploaded to directory specified in Path for IIS streaming otherwise are uploaded to directory specified in Path for multimedia library folder If Use temporary directory option is checked then results of video encoding for IIS streaming are stored in a directory specified in Path for temporary directory for streaming When encoding is completed they are moved to destination di
3. button New productionTokens will be generated and processes will be queued for execution 4 Check if JumasProcessExecutor service windows service is running figuration 0 Liskof Tasks VIEW m x esses Configuration Tasks lid v Media session Task pat start date End date add m M Ino a 25 Udienza Naples 16 WETEH 2010 11 0302 34 ge Bit rocura di Naples A Task process plan EDIT x A ej 7 Session IUdienza Naples 16 11 2007 Refresh Task pattern CMR ER TF MS E 0 emr er SINGLE AUDIO FINISHED gt S96 07 2010 1103 10 34 49 7563 ER eae an ee FINISHED Edit EJ 1 cmr tf SINGLE AUDIO FINISHED 2 5_96 DT 2010 11 03 10 34 50 2674 Naples 2007 11 i6 wav FINISHED s gt 2 cmr ms AUDIO VIDEO FINISHED iS 96 DT 2010 11 03 10 34 50 5694 Naples_2007_11_16 avi FIMISHED Refresh E b Close U Abort process 4 Demonstration activities 4 1 Polish Pilot Demonstration The final year of JUMAS project was when Polish Parliament changed the legislations of trial procedure in civil courts It has a critical influence to the interest of Polish Ministry of Justice PMJ lawyers prosecutors and private companies offering software and hardware solutions to the judicial sector For that reason from the very first days of first prototype its Polish demonstration phase started The system was ins
4. Jumas Portal Operating System Microsoft Windows Server 2008 Firewall windows firewall Services provided and corresponding ports e Application Server Jboss 80 Internet Information Services IIS 80 Internet Information Services IIS 443 Remote Desktop RD 3389 Oracle DB Expected network traffic between 50 MB Day and 20 GB Day according to the courtroom activity Jumas Process Manager Virtual Machine Name VM Jumas XP Operating System Microsoft Windows XP Professional Firewall windows firewall Services provided and corresponding ports Expected network traffic between 50 MB Day and 20 GB Day according to the courtroom size and activity Jumas Ubuntu Virtual Machine Name VM Jumas Ubuntu Operating System Ubuntu Firewall Services provided and corresponding ports e Application Server Jboss 1547 e File Transfer Service FTP 5521 e Secure Shell SSH 5522 e Remote software control VNC 6346 Expected network traffic between 50 MB Day and 20 GB Day according to the courtroom activity Table 2 Virtual Machines Description JUMAS SIDIP integration and security constraints The Jumas system has been designed in order to cooperate with any Court Management System CMS In particular integration with SIDIP system was implemented The Jumas system shares the physical database with it same schema and same instance The integration with SIDIP has been done at the database level the entities of the Jumas database which conc
5. Persion De Card Process EDT ELMR Deception deti CMR Template filling Module name RWTH Automatic Speech Recognition Foka Mode tas Refresh CERTH ITI Video Mor Multimedia format wade Params pattern Work groups Use this option to configure which Jumas Process works on which computer Work group means a computer os system where the Process is installed To add Work group you have to specify at last e Work group name e Multimedia directory root path directory in which the process can find media files to be processed e Max amount of running processes maximum number of processes which can be simultaneously executed in the work group To add Process for a work group you have to specify at last e Method process execution choose one of exe file http post e lLink Path address of the web service if http post method were specified or path to the executable file exe file method Tatas List of Work Groups VIEW me Meramautofnunmgpra gg PME windowsxp01 EP Juras Process Configuration ym linux01 i File Jumas Processes Ci Caid WOJE Gaup EDIT Wark group name Description virtual machine jumas dyndns org 5190 directory root path Choose cej Max amout of runing processes Section of court ProcessTag Process name Mews Lin Maxu cmr tf CMR Template filling exe file c Wu CMR Multimedia
6. The extracted annotations correctly describe deceptive 04 statements The extracted annotations correctly describe vague utterances The extracted annotations correctly describe negations can make use of information about the deceptive indications Adding tags to documents helped me to find and retrieve them later On The suggested tags are appropriate annotations for the video Adding tags and comments is a useful means of communication about a case with colleagues can make use of information about the deceptive indications 23 Ontological Query Expansion meres l a Agree y ree augment the initial quer f The query neoj O functionality needs to be customized according to my preferences l would like to provide a feedback refinement after a search result obtained with the must rewrite my query after a search result obtained with the query expansion functionality 4 3 Potential exploitation Due to the change of Polish Code of Civil Procedure all hearings in Commercial Courts should be recorded and made available for judges lawyers and other people involved to the trial It makes a great opportunity for jumas system because it meets most of the requirements Esaprojekt have attended several meetings with other companies to made one common solution that can be deployed as a commercial solution
7. Whenever make a mistake using the portal recover easily O and quickly s need website is easy to understand 15 helping me to complete my tasks 158 The organization of information on the web pages is clear 152 The web interface is pleasant The portal has all the E functionalities and capabilities 150 40 expect it to have Overall Fm satisfied with this web site 15 Keywords to describe the Jumas Portal m oromu Omeem Com Cana SECTION 2 Questions about functionalities 16 Emotion Annotation aan l l EE Agree no The set of considered The extracted Oo describe correctly the mood of the subject s o easily usable available os cc e about the emotional state 17 Multimedia Summarization The extracted key frames and the corresponding clips o 15 4 o represent relevant parts of the na hearing overestimated satisfactory kad 18 Video Annotations video annotations AR to interesting meaningful parts of the trial The video annotations provide useful information about the participants in the trial browsing the videos 19 Automatic Speech Transcription o How much the immediate at least the day after availability of the transcription of a judicial trial is important for your daily job Very important 18 L Important 3 L don t care Not important Not important at o lsa 100 accuracy of the automatic transcription necessary for your
8. about 10 courtrooms The total requested data amount is 32 TB per year Vertical scalability o Data Base 3 to 4 CPU at 3 2 GHz RAM 8 to 32 GB o AS 2 to 8 nodes 1 to 2 CPU at 3 2 GHz RAM 4 to 8 GB o VS 2 to 8 nodes 1 to 2 CPU at 3 2 GHz RAM 2 5 to 8 GB Fig 7 Infrastructure hypothesis for medium courts Large Courts Consider a large metropolitan law court dimension with about 30 courtrooms The total requested data amount is 100 TB per year Vertical scalability o DB cluster 4 to 10 nodes 3 to 4 CPU at 3 2 GHz RAM 8 to 32 GB o AS Infra cluster 4 to 10 nodes 2 to 4 CPU at 3 2 GHz RAM 8 to 12 GB o AS MT 4 to 10 nodes 2 to 4 CPU at 3 2 GHz RAM 3 to 12 GB o VS 4 to 10 nodes 2 to 4 CPU at 3 2 GHz RAM 3 to 12 GB a NI III Fig 8 Infrastructure hypothesis for large courts Setting up the courtroom infrastructure for audio video acquisition Table below presents the equipment used for trial recording done in Jumas Projet Name Type Manufacturer Touch screen TPMC 8T Crestron Driver CP2E Crestron RS 232 422 Module STI COM Crestron DVD HDD Recorder SR DVM700 JVS DVD Player DVD S511 Panasonic Microphone MX418D C Shure Microphone MX418 C Shure Microphone MX418E C Shure Audio mixer PRO RX1202FX Behringer Rack Microtech Camera EVI D70P SONY Plasma screen TH 42PS10 Panasonic Videoterminal PCS G70 SONY Table 3 courtroom infrastructure for audio video acquisition HEH WE A HR 2 3 Collectio
9. na rozprawie dziesi piece dwadzie cia przez dziesi z pusta syndyka masy upad o ci agro landis przeciw student sp ka za o stawili si zastano powodowa 00 00 55 prace oceniane zapracowa a kajaki syndyk masy upad o ci sp ki ja granic jan danuta bia ecka tak a mo e po jest eby prosili panowie eby korzysta z mikrofon w dobrze w trakcie zabierania g osu 00 01 13 dobrze i zostan pozwan 00 01 16 hanna zaraz denerwuje si dobrze by eby sta widzia em gdzie g os w nr z zaraz pe nomocnikom stron to jakie stanowisko a przez to prosz bytowe s d V Autoscroll 14 Fig 13 Hearing movie Movie User can play pause and scroll through the presented movie To control the audio video material a typical user interface is used While movie is being played the the results of emotional state and gestures recognitions are presented on the screen Emotional state NEUTRAL Gesture HAND_MOTION E 0 08 35 0 20 00 Fig 14 Play movie control Annotations At the bottom of page a list of annotations is presented The annotations are divided into three groups First one Transcription is a result of Automatic Speech Recognition module The second one is Automatic annotations which presents all annotations made by analytical modules The third group presents annotations manually added by user Clicking on each annotation moves a movie to the related time period Transcription Automa
10. portal user manual for law profeSsionals 2 2 ssxsss1ss21ss211s21ss21s2xss2nss21s21132 12 LOS diod CK ai a OG 12 MNOLATC NE Za ARA OWO RAE N 13 LEIALDEGQLUS zaawan OO loan nd 13 Hearn MOVi CG ai oc WARE GO Ada nip kai O AGE En A adi 15 Document downoad reen ease R AR A A RACE AE GA GE 18 SEKE LEMIS osi a GAR dd a R oO eee OO APG 18 3 2 JUMAS Process Manager user manual for system administrators 11111111111111111121 19 4 Polish Pilot Demon Sirali ol szat Taca EC aid rid wad 25 4 1 Meeting with PMJ in Wroclaw asisite aaaea eaa dE 26 4 2 Conference in Krakow zaczac zc dawano w Ea ceioccasadeneteadiventcs 26 4 3 Seminary in VV OCI AW esaa eaaa aa BOA r 26 1 Introduction 1 1 Deliverable objectives This document describes all the demonstration activities performed during the JUMAS project focused on the Polish Pilot site 1 2 Audience of the deliverable This deliverable is aimed at both an external and internal audience of interested users In particular this deliverable is targeted to all jumas consortium members and to potential end users 1 3 Structure of the deliverable First of all this deliverable describes the demonstration setup that was used for Polish pilot which involves the physical configuration and collection of audio video materials At next section the demonstration tool is presented with the detailed description of Jumas Process Configurator and Jumas Portal Last section is dedicated to Polish pi
11. summarization exe file c Ju Card Process installed EDIT vm windowsxpo 1 CMR Template filling 7 Method process execution Link Path c Jumas Procesess CMR_Procesess templfill working dir PN Worki directory Max amout of 1 X runing processes in group H p bk kk kp PDP Lol d Acton Cm edia_lib Is anonymous User name Password Media Sessions To associate media files with the given trial new Media session has to be created For the Media session you should define media channels We can distinguish three main types of channels e SINGLE_AUDIO create this channel to upload audio file for a trial e AUDIO_VIDEO create this channel to upload video audio video file e STREAMING create this channel to prepare streaming for Jumas Portal One media channel can contain only one file in specific format or multiple files each in different format Card Media Session EDIT Hearing date 2007 11 16 09 00 00 Udienza Naples 15 11 2007 J sure le name Destination fi Uploaded status Media session Udienza MNaples Channel AUDIO VIDEO 1 File avi Naples 2007 _11_16 avi Naples 2007 _11_i6 avi UPLOADED Naples 2007 _11_ 16 wayv Naples 2007_11_ 16 wav UPLOADED Naples 2007_11_16 wmy Naples 2007_11 16 ism UPLOADED To create streaming for Jumas Portal Streaming file for IIS option needs to be selected Card Media Fi
12. using the SIDIP functionalities the corresponding folder was available into the Jumas Process Configurator This allowed us to upload the media files and invoke the functionalities for populating the Portal with multimedia and semantic information The media sessions media channels and media files for the acquired material at the Tribunal of Wroc aw have been managed with the JPC for making available the multimedia and semantic contents on the JUMAS portal for the demonstration phase This management included the creation of media sessions the definition of media channels and the upload of media files Werte an zwani 254 ANAA bity Jmas racess LOL ration Seco A hemes uc aars RATEN E ia Fie Jumas Processes Configuration Tasks E QQ dumas Portal Court sad Okregowy we Wroclawiu f Section of court First Section Traial ID IXGC20 10 Hearing date Aji 1 2010 3 00 00 AM EHA Trials yl nc3 10 GHE mczp10 i ONA 123 32 Session name Rozprawa 1 EHE Ixeczo 10 iB 2010 01 11 09 00 Source file name Destination file Uploaded status E 2010 04 06 09 00 Media session Rozprawa 1 G l 11C888 291 laid Channel SINGLE_AUDIO sa 11C124 99 Channel VIREO Cela Wroclaw AUDIO GHE EC LUX2 Gq Wroclaw 17 02 EHA wroclaw 17 03 Hil Wroclaw 17 04 GEJ wroclaw 17 01 Realtive path courtroom O Gg Wroclaw 17 06 Ga Wroclaw 17 07 File
13. EC DG INFSO IST Programme DJD Information Society project grant n FP7 214306 Technologies jumas D 6 4 Demonstration to Polish Pilot DOCUMENT QUALITY CONTROL 1703 2011 16 03 2011 AUTHORS Maciej Kotok Krzysztf Kaminski TABLE OF CONTENTS 1 GOOUCNHOM A BGB O R EC aa A NSR 4 1 1 Deliverable ODJECNYES i RAR OE Adi dokad 4 1 2 Audience of he delyeraDle a ci aw a O cc lai aby ow dwa nnmnnn 4 1 3 Structure of the deliverable zai di Co cod aid wd w bc 4 2Demonstraton Set Upust wii ae a O iii ira 5 2 1 Localization of the Polish prototype sssssussusnunnunnnnnnnnnnunnunnunnunnnnnnnnnnnnnnnnnnnunnunnnnnnnnnnnnnnnnnnnnn 5 L calizatw rorhejJUMAS Doria wasiak wii Rica anka Eda aka 5 Localization of the JUMAS G mh ne isSawa cana ak E A And 5 Localization of the Jumas Process Configurator JPC ssessnsasasn saa saw aw aaa zwan sawnaasawaa 6 Fillings up tle Italian Jimas Portalowa aid O AE a AA a 6 2 2 The physical lay Out css Edi O W W d CO ninaapa nasii 7 JUMAS SIDIP integration and security constraintS 2 ansasasawananoa wawa an a na saa an aaa baw ann ansabace 8 SCala DI IGy HYPOTHESIS W iw AI a EO EEC 9 Setting up the courtroom infrastructure for audio video ACQUISITION 1 1111111111111 11 2 3 Collection of audio video material ssnssnsunnunnunnnnnnnnnnunnnnnunnunnunnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 11 3 Demonstration MOOSE EOG i p dE GEE 12 3 1 JUMAS
14. d number of trials made for presentation purpose To log in please provide following data Polish pilot Login KKK KKK K K OK Password kk gt k kk 2k kk k SAWA ie Trialarchive Q Search trials SIDIP i el LEE Login Login jumas Password 0000006 Login Fig 9 Login page Trial Archive After the user is logged in the trial archive is presented User can browse only trials that he is authorised to User is able to filter list of the trials by name or description SAWA i Trialarchive Q Search trials sivie Logged in as Jumas User JTA Quick start maj ff EE Trial archive Trial Wrodaw 17 07 Verbateam 17 07 Trial wroctaw 17 06 Verbateam 17 06 B Trial Wroc aw 17 03 Verbateam 17 03 B Trial Wroc aw 17 01 Verbateam 17 01 Trial EC LUX2 Lx2id B Trial IIC3 10 Rozprawa demonstracyjna Krak w Ka Pageiof2 gt se Fig 10 Trial archive To get the detailed information about particular trial user should click on the chosen item on presented list Trial Details The Trial Details page presents most important information related to the selected trial The page is divided into two tabs The first one presents information retrieved form CMS system The second one is related to one of Jumas system modules Multimedia Summarization Details This tab shows trial main data such as court name section the trial matter some short description and
15. daily job or could you tolerate some transcription errors i e substitution of words insertion of words deletion of words without affecting the meaning of what was uttered during the trial 100 accuracy is _ Necessary 16 Not necessary 5 o Suppose a 100 automatic transcription accuracy is possible Do you prefer to have at disposal the exact transcription i e including spontaneous phenomena all discourses and comments by the various actors of the trial etc or a not verbatim proceeding Exact transcription 21 Not verbatim proceeding o Suppose a 100 automatic transcription accuracy is not possible could you give a list of important errors that should not be done by the automatic system e g Names of person dates names of localities etc Dates 13 places 13 names 11 o Suppose a 100 automatic transcription is possible only for some of the actors of a trial judge prosecutor witness lawyer Could you order the list of actors according to the importance of their related automatic transcription _____ Lawyer ____ Witness ___ Judge ____ Prosecutor All 21 respodents indicated witness as the first on the list The second appears a judge Other actors were placed aqually 20 Information Retrieval po Irrelevant Relevant Emmi KA Nesey U6RWAD 1 1 _ 2 Very I haven t tried useful them The advanced search features 16 are 1 o 3 21 Deception Detection Agree Disagree
16. e that most people 5 would learn to use the Jumas O Portal very quickly found the website very cumbersome to use felt very confident using the web 7 a 7 7 site need to learn a lot about the PN Fa O f Pm Jumas Portal before could lt 16 4 1 effectively use it 24M A A 9 Overall Reaction to the Jumas Portal Te O O O1O O1O O16 O1O Wonder rasa store ototor Lose fa7 Reading characters on Organization Confusing of information Confusing m m my e m Consiste throughout SE J a a ar i F nt website Terminology Never is intuitive 14 Always Position of Inconsistent messages ODIOD O 13 on screen Website Never informs m m about its Z progress Learning to use the portal Performing tasks is UIUTU IULIUTU LU 17 Always straightforward Help messages Consiste on the screen t OIOI OIO O O 2 A a 1 13 Website capabilities Po oA 4 5 6 7 8 e NA Speed Too slow olo l1 rls lola 3 i O Fast O u 7 enough a peel iar Ora Never polololololololololo O levels of users U U U NUN NU NU N NU oaj oO tj Strongly Agree lm satisfied with how easy is to le use the Jumas Portal u m e O7 10 O p J O O work using this website Im able to complete my work 7 7 my 7 quickl Im able to effectively complete m m Ty a my work feel comfortable using the a Jumas Portal TOM
17. ern CMS data have been substituted with database views on SIDIP schema In this way changes performed in SIDIP are immediately available to JUMAS The authentication for the JUMAS portal is performed by using the User Interface available on the Jumas Portal instead of using the LDAP application protocol provided by SIDIP A pluggable component behind the User Interface abstracts the authentication from LDAP Note that all authorization information are stored in the database The JUMAS SIDIP integration is depicted in Fig 5 JUMAS Platform Fig 5 JUMAS SIDIP integration Scalability hypothesis Hypotheses of court infrastructure for future JUMAS installation can be defined according to the Court dimension Considering that in a single courtroom is 6 hours of hearings per day and all hearings need to be recorded with a single video channel 640x480 resolution and 24 fps and 4 audio channels 16 kHZ 192 kbps and 32 bit it is about 16 GB per day per courtroom A scalability hypothesis is described as follows Small Courts A law court of small dimension 1 5 courtrooms requires a total amount of space of 3 2 16 TB per year Vertical scalability o Data Base 2 3 CPU at 3 2 GHz RAM 4 to 32 GB o Audio Server 2 CPU at 3 2 GHz RAM 4 to 8 GB o Video Server 2 CPU at 3 2 GHz RAM 2 to 8 GB i l l I I l I i Fig 6 Infrastructure hypothesis for small courts Medium Courts Considering a medium law court of
18. in as Jumas User Quick start m II Es Trial details Details Storyboard Online summarization Generate Summarization Info Rozprawa 17 01 Info Rozprawa 17 01 manual manual auto Time 00 00 00 00 Time 00 00 00 20 Time 01 40 01 48 User annotated Info Rozprawa 17 01 fo Roz va 7 0 Info Rozprawa 17 01 auto manual auto Time 00 10 00 23 Time 00 10 00 23 Time 00 23 03 20 Time 00 23 03 20 Time 03 20 03 23 Time 03 20 03 23 Text postanowienie o Text postanowienie o Text ustne motywy Text ustne motywy Text zakonczenie Text zako czenie umorzeniu umorzeniu post powania ost powania Fig 12 Storyboard Hearing movie Browsing hearings on the Trial details page user can choose a hearing movie Audio video streaming page will be displayed Trialarchive Searchtrials o SIDIP Trial IXGC20 10 Trial IXGC20 10 Hearing date 1 11 2010 Related videos Uses Anman Emotional state Info Rozprawa 2 B 0 00 00 0 20 00 Subtitles Video annotations User annotations 00 00 05 dzie dobry prosz zaj miejsca 00 00 15 dobrze prosz pa stwa wszystkie tak chcia przynie pa stwo eby rozprawa odb dzie ma dyba a jest pa stwo mo ecie wyrazi zgod albo nie uprzedzam wi c nie jakie zdolnej sals tezy dozoru badawcza uderzenia b dzie wykorzystywane zarzut nie b dziemy wyst powa w telewizji wiczy 00 00 38 rozumiem e pa scy rodacy zgodne otwieram posiedzenie
19. ing this demonstration a teleconference with people form company MCX was organized MCX company equipped in the past some of Polish courts with teleconference equipment Possibility of usage of the hardware as the source of audio video signal was discussed The recordings performed with this equipment are available on JUMAS portal 4 1 2 Conference in Krakow The meeting was organized on 11th of June 2010 in Krakow during a PMJ conference dedicated to electronic protocol and changes in Polish regulations All presidents of Polish courts were invited to the conference and the Minister of PMJ was also a participant of the conference The total number of the participants was more than 100 One of the main events of the conference it was a demo trial organized by people from CoW ESAPROJEKT and NextiraOne this company provided audio video hardware for the presentation The recordings from this demo trial are available on JUMAS portal The presentation was very welcomed by the audience and very good opinions about JUMAS portal were spoken SIDIP was also presented on the conference as an example of the court management system used in Italy 4 1 3 Seminary in Wroclaw The meeting was organized during a seminary Praktyczne problemy transkrypcji e protoko u Eng Practical problems of e protocol transcription on 11th of December 2010 In Wroclaw The total number of participant was about 30 Representatives of PMJ including vice mini
20. le NEW Upload file Streaming file for IIS kie fe forma Path to fie T Taks Under Main menu Tasks you can find two options Task Patterns and Tasks Task Patterns In a Task pattern option we can configure a list of Jumas Processes that will be executed for media sessions Task pattern can be used to create Task for a particular media session see next chapter To add new Jumas Process to the task pattern you have to specify e Jumas Process e Position determines the order of execution of the process in the task If two processes have the same position it is mean that can be executed simultaneously e Multimedia type refers to the channel type required by the Process EP Jumas Process Configuration File Jumas Processes Configuration Tasks Card Task Pattern EDIT l Body maton 1 14 StandupSitdown AUDTO VIDEO AUDIO VIDEO Card Process Patter EDIT Task pattern Process Position Multimedia type ALIDO VIDEO EM 5ED Body motion ki AUDIO VIDEO CAmedia_lib Tasks To run Jumas Process for the given Media session following steps have be performed 1 Create an empty task Task button in the Media session panel JPC main window 2 Define Jumas Processes to be executed there are two ways to do it a Choose previously created task pattern b Add processes manually the same way as when creating task pattern 3 Accept task select created task in List of tasks window and press Accept
21. list of people involved in this trial L SAWA IE Trial archive Qa Search trials ee SIDIP Trial details Details Storyboard Court Sad Okregowy we Wroctawiu Judge Grzegorz Karas N R G IIC3 10 Prosecutor Waldemar Adamski Section First Section Clerk Wac aw Norud Matter krak w konferencja Lawyer Description Rozprawa demonstracyjna Krak w Accused Ewa Michalska First hearing 6 25 2010 date B Trial IIC3 10 Rozprawa demonstracyjna Krak w E B Hearings E Acts pre hearing B Decree ordering the trial Following acts by Gip Gup E word list E Appointments Revocation Disclaimers Defenders B Production outside the hearing Fig 11 Trial details At the bottom of this tab a trial folder is presented It contains a list of hearings and a list of documents related to the selected trial Storyboard The storyboard presents the two lists of movies The first one Summarization is a result of the Multimedia Summarization module The second one User annotated is a list of user annotations with corresponding part of a movie On the top of storyboard there is Online Summarization section In this section user can enter a query and generate multimedia summarization in a real time for this query To watch any of listed movie parts user has to click it The movie will start from the moment in time when the related annotation was assigned lew Trial archive Q Search trials SIDIP Logged
22. lot demonstrations which been done during the project to the Polish audience 2 Demonstration set up 2 1 Localization of the Polish prototype Localization of the JUMAS portal Jumas System consist of two main components Jumas Portal and Jumas Process Manager JPM Originally Jumas Portal was available only in English but the final prototype was adjust to Polish pilot and all text were translated according to Polish requirements Therefore the portal s local resources resx files and database dictionary table has been configured for the Polish language From the end user point of view in order to enable the Polish language an image representing the national flag on the portal s master page has been provided see Fig 1 Ba SAWA ij Trislarchive Search trink amr Fig 1 Jumas Portal Polish prototype By clicking the Polish flag image link the corresponding user id culture UICulture updates the Poral Language Configuration Table presented in Figure 2 dm Juma language comli guration PORTAL_LANGUAGES a xO UMN 2 key varhato Languagtoode washa Value warchan 1O0N Fig 2 Jumas portal language configuration table All demonstrations of Polish prototype were given in Polish language and concerned Polish trials Localization of the JUMAS components Some of the analysis modules developed for the Jumas system needed to be tuned for Polish pilot This were basically modules that operates on text and sound
23. n of audio video material During the project several recording sessions was done 1 Court of Wroclaw 12 03 2010 4 real trials was recorded Duration of trials lasted from 20 minutes to 2 hours 2 Court of Wroclaw 15 06 2010 1 demo trial was recorded This trial lasted about one hour 3 Court of Krakow 23 06 2010 1 demo trial was recorded It was a demo trial presented to the audience of all presidents of polish District Coutrs It lasted 30 minutes In the last part of project Court of Wroclaw has also make available about 10 recordings done in Verbateam project All of this hearings lasted less than one hour All recordings were uploaded and processed by jumas system and are available through the jumas Portal 3 Demonstration tools 3 1 JUMAS portal user manual for law professionals Jumas Portal is a web application that allows user to search and browse trials and documents related to them and to watch audio and video content with text annotations related to the recordings Jumas portal provides the metaerials as AV stream The latest versions of Polish pilot of Jumas Portal is available at the following address Polish pilot https jumasportal esaprojekt pl This version is related to Polish trials however it is available in three language versions Polish English and Italian Login The first thing user should do to get access to Jumas Portal is to log in There is a preset user account that has access to limite
24. name courtroom ism Manifest File size 0 Multimedia format Uploading L j Uploading status NO_UPLOADED Upload action You can upload new file Upload file Streaming file for IIS Multimedia file format C imedia_lib Path to file Fig 3 Management of media contents for filling up the Jumas Portal 2 2 The physical layout Jumas is a distributed system wich works on different platforms and operating systems It is also integrated with existing Court Management System which is Sidip in this case The whole physical architecture is presented on the figure below V Y 7 Recorder Jumas Proc ss Manager Publish video Web services Jumas Portal Jumas Ubuntu End user computer Fig 4 Jumas hardware configuration The Jumas end user has access to the system through Jumas Portal which is deployed on VM Jumas Portal virtual machine He also has access to Sidip system deployed on the same VM where trials and hearings can be managed All multimedia stored in Jumas system are kept in Media Library on the Jumas Process Manager machine The processes are run also on this VM Jumas Ubuntu is a linux server where web services are deployed The following configuration has been adopted in order to deliver the JUMAS demonstrator for the Polish Pilot Description Jumas Portal Virtual Machine Name VM
25. rectory Path for multimedia library folder Use path for II streaming Path for IIS streaming Use temporary directory Path for temporary directory for streaming Database connection tab In the Database connection tab you can specify database connection string parameters Options Jumas Portal tab Jumas Portal tab here you can change video streaming quality Options sem Configuration Database connection Jumas Portai Adres to Jumas Portal http jumasportal esaprojekt pl 392 x 560 bitrate 2056 768 x 432 bitrate 1427 592 x 336 bitrate 991 448 x 256 bitrate 688 368 x 208 bitrate 477 288 x 160 bitrate 331 224 x 128 bitrate 230 Process configuration Under Main menu Process configuration there are two options Jumas Processes and Work groups od Jumas processes Jumas Processes In this option user can configure a list of processes ASR Emotion Recognition etc responsible for analyzing media files and generating annotations To add new process user have to specify at last e Module name name of the process e Module tag short name of the process e Multimedia format input file format for the module Filed Work directory and Params pattern are unused List of Processes VIEW diene soat nimdsmi gg bm bm avi i Body motion 14 StandupSitdown st zd st ad avi Edit CMR Emotion Recogn cmr er er WAV CMR Multimedia sum cmr ms ms CERTH ITI
26. s in particular ontology information extraction emotion recognition automatic speech transcription and deception detection Localization of the Jumas Process Configurator JPC The Jumas Process Configurator is a standalone application that manages the execution of processes ranging from the upload of the multimedia material on the JUMAS portal to the invocation of multimedia analysis functionalities as speech recognition video annotation etc This component designed for system administrators has been customized for the Polish Pilot Most important parameters are presented in the table below Parameter Value Multimedia processing library path C media_lib Remote multimedia streaming library path 192 168 100 150 media_lib Temporary streaming path C media_lib_streaming_tmp Data base connection 192 168 100 150 JUMAS_JPM jumas SIDIP Jumas Portal address https jumasportal esaprojekt pl Table 1 Jumas Process Manager configuration for Polish pilot Filling up the Italian Jumas Portal Several multimedia contents have been acquired at the Court of Wroc aw and All these contents described in section 2 3 have been uploaded on the Polish Jumas Portal in order to demonstrate the potentiality of the developed system The acquired audio video material has been uploaded on the Jumas Portal by using the SIDIP and the localized Jumas Process Configurator described above Once the record for a given trial has been created by
27. s manager 2 8 Accessing information everywhere a AS 2 9 Completeness of information available 3 What will be the impact on your daily job if you will use JUMAS LJ High L Medium Low H 17 M 4 4 What is your global satisfaction High Medium _ Low H 17 M 4 If moderately or unsatisfied what didn t meet your need or expectation Automated transcription 6 5 Which semantic annotations and functionalities do you think are really useful for your job 5 1 Automatic Transcription 5 5 Multimedia Summarization 5 9 Process Manager igh 6 2 Videoannotation 6 3 Emotion Annotation 6 4 DeceptionDetection lt J 29 6 5 Multimedia Summarization 2 6 6 Template Filing Af l 67 Information Retrieval a T 6 8 UserGenerated annotations at 6 9 Process Manager af o 610 WebPortal Et 7 Do you think that JUMAS could be useful for the investigative pre trial phase L Yes L No Y 19 N 2 r Ma think would like to use this web 7 gt site frequent R eM Ie thought the web site was easy to use 8 Web Portal Usability Agree Disagree found the Jumas_ Portal unnecessarily complex 20 10 think would need Tech Support my a O to be able to use the Jumas Portal km 1x 2 found the various functions well mh m integrated m eM thought there was too much a inconsistency in the Jumas Portal would imagin
28. ster judges and IT personnel of court of Wroclaw took part of in the seminary There were also representatives of private companies interested in Polish judicial sector i e NextiraOne Unikkon przepisywanie pl JUMAS portal was presented to the participants during the open session and it was one of the topics of dissociation during formal and informal meetings of the seminary ESAPROJEKT and CoW collected all the feedback of the participants Some of the suggestions were immediately implemented into the system 4 2 Jumas Questionnaire SECTION 1 Questions about the overall jumas system 1 Information quality for retrieval and consultation purposes ee 1 1 Automatic Transcription J 2 19 1 2 Video annotation 2 19 1 3 Emotion Annotation 2 109 1 4 Deception Detection W 1 19 1 5 Multimedia Summarization 1 2 188 16 Template Filingltems 2 EE 1 7 User Generated annotations Af 1 2 The JUMAS AUAA a A is useful for Medium Low _ amem a 2 2 2 2 Sharing information 2 2 Sharing information 2 3 Reducing the time costs between the recording and the availability of the transcriptions 2 4 2 4 Reducing the time for the retrieval process the time for the retrieval 2 4 Reducing the time for the retrieval process 2 5 Enhancing the consultation process pg fa 2 6 Supporting your decision process 028 2 7 Managing the backoffice of the proceedings pt proces
29. talled on servers located in ESAPROJEKT promises and provided https JUMASportal esaprojekt pl to the potential end users with proper access privileges System was fed with audio video recordings performed in court of Wroclaw and demo trials recorded in Krakow In the end of year 2010 there was a PMJ internal project Verbateam that was run also in Wroclaw During that project a nice set of recordings was performed all of them were uploaded to JUMAS portal in audio and audio video format For each of Verbateam recording not only automatic speech recognition was done but also manual transcription in cooperation with portal http przepisywanie pl lt http przepisywanie pl gt Accept the continuous demonstration of the portal on the web and group of individual meetings of consortium representatives with the end users there were organized a couple of official events with judicial sector 4 1 1 Meeting with PMJ in Wroclaw The meeting was organized on 1st and 15t of June 2010 in Court of Wroclaw CoW The meeting was organized by President of CoW with participation of Vice Minister of PMJ Director of Polish courts in PMJ and Chief of IT department of PMJ JUMAS project was presented to the audience After the presentation a long discussion about JUMAS project and portal took a place Not only the research and development aspects of the projects were mentioned but also a possible commercial usage of the system was discuss as well Dur
30. tic annotations User annotations 00 00 00 lecz nie spotkali my sie k cii powt rzy rozpozna spraw wp do pana b aszczykowski szybko pan micha kiedy pan dalszy pow d osobi cie stawi si jego pomocnikiem to 00 00 20 tak mi m wia pani jego micha owska o wietnie si wok radka prawda poczty grupa rybak w pr bowa przepraszam ame szanowni pa stwo wielokrotnym przede wszystkim si spotkanie na kt r spotkalismy si w s dzie na pierwszej rozprawie sad przeprowadzi wszystkie dowody dokument w jak r wnie sprawie zosta przeprowadzony dow d z opinii bieg ego w tej sprawie si warto poinformowa rozprawa odb dzie rejestrowana drogowcy mia jaki do zwi zku z tym pouczano akwaparku umo liwiy kraty poprzez ubolewa si do mikrofonu sobie przez strony przez petnomocnikow jak 00 01 03 mieszkam wiadk w przedstawiciel odniesienie wiadkowie pani radzi pakietem si pan wybuchami nen 6190 czrammiusmi mzricbum rru nrza d nrzuctamianiam dm mrzachirhama GwisdleAw i Autoscroll Fig 15 Annotations When a deception is detected then transcription is highlighted in different colour User Generated Annotations On the right site of the page a user annotation control is presented It allows user to add his own annotations to the presented movie Related videos User annotations Tags smile gwa t O i tag rabun pobic morde umowa i
Download Pdf Manuals
Related Search