Home

VibraImage 7.5 Manual Eng - Elsys

1. vio A skip frames vi 10210 02 28 Graph s global Period s Diff time s Hist time s Hist C smooth s Hist H smooth s Hist S smooth s Hist A HC function sin t 2 pi n Stat period s Base period s Lie threshold Audio sens s LD mode Audio Manual Auto Compare filter Aggression Stress Tension Suspicious EEE PEPE LLP EEE Pid ibid Macro mode t ee ee Fig 141 Lie detector switch on and operation 156 view settings Acton Toolbar Info bar Buttons Graphs Frequency analysis s results BioTester results Video window Status window LD window Mode d VI AN AR w LE Fig 142 Menu View Preset image area mode Option of operation in lie detection mode LD mode is made in information column in a 1j mode The system has the following options 1 2 audio Calculation of lie level is done when the level of audio signal exceeds the setting level and stops when the level of audio signal becomes less than the setting level On graphs the moment of the beginning of data accumulation is displayed by a vertical green line the moment of end a vertical red line That mode is the basic recommended for use at lie detection manual Accumulation of the preliminary information is done in Base period interval Calculation of a lie level is done
2. RU Pa qi one uerit irure RU M daille d or A T i dun 4 2006613400 3 2006 1 2006 BESUERSEEEGSIzFSAHZ XRASSERSEREESEREGG Fig 5 Certificate on official registrations Fig 6 Diploma of international exhibition of Software Vibralmage 6 0 in Russian software inventions and innovations Brussels Eureka database 2002 US00734622782 a United States Patent Patent No US 7 346 227 B2 2 Minkin et al 45 Date of Patent Mar 18 2008 The Director of the United States Patent and Trademark Office 54 METHOD AND DEVICE FOR IMAGE 56 References Cited Has received an application for a patent for a RAE U S PATENT DOCUMENTS new and useful invention The title and descrip 75 Inventors Viktor Albertovich Minkin 5 047 854 90991 Iwabuchi et al ee Saint Petersburg RU Alexandr Diich tion of the invention are enclosed The require Shtam Saint Petersburg RU Cont
3. VI 2 A 5 01 25 Fast processing Base processing Video timer 01 25 Info 15 1 00 2 00 640 1 00 480 Statistics IntegratedN Am 78157 IntegratedN F 75582 Anger Sress Tension VI 10 12 01 25 Fig 128 Normal calm passengers on ticket control 139 Vibraimage lt 20080528113113 avi gt File View Settings Action A avi AV ARLD am F R 859 1 viz vs Frame rate VI 2 A 5 01 38 In Fast processing Base processing Video timer IntegratedN Am IntegratedN F Anger Sress Tension Audio Level VI 10 F142 01 33 VIN 15 01 38 Vibraimage lt 20080521101151 avi gt File View Settings Action AV ARED Am F ST iD ck SM Frame rate VI 2 A 5 01 13 In Fast processing Base processing Video timer Info Statistics IntegratedN Am 1 97007 IntegratedN F 06666 Anger Sress 0 0 Tension E uu VI 10213 04 13 Fig 130 Normal calm passengers on the luggage control 140 Fi Vibraimage lt 20080521101151 avi gt File View Settings Action bend 25 Am 5 5 ST D GR 2 Frame rate 1 VI 2 A 5 00 45 TUM Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Ang
4. 2008 06 17 15 01 16 src F A CNN Am p 2008 06 17 15 01 16 vii A n 2008 06 17 15 01 19 src x y 2008 06 17 15 01 19 vii A 6 uu 2008 06 17 15 04 05 src F ri 2008 06 17 15_04_05_vil_A 2008 06 17 15_04_09_src_F 2008 06 17 15 04 09 vii A 2008 06 17 15 04 12 src 2008 06 17 15 04 12 vii A 2008 06 17 15 04 27 src F 2008 06 17 15 04 27 vi2 F i 2008 06 17 15 04 33 src F d 4 UU 2008 06 17 15 01 13 2008 06 17 15 01 13 2008 0 17 15 01 16 F 2008 06 17 15 04 33 2 vb CAN Um i rz Karpov Evgeniy 23 02 1950 2008 06 17 15_01_165_ 1_ 2008 06 17 15 O4 OS Kiselev Dmitriy 14 09 1975 Martynov Oleg 18 12 1970 A 1 Ue Fig 66 Main window of printing module ViPrinter exe The persons list a column at the left displays the list of archive images records and a choice of record for viewing and print Current record choice is allocated with the cursor corresponding to it vibraimages and the demographic information displayed in the printing area 104 The printing area field the right displays vibraimages and the demographic information corresponding to the current record of the persons list 4 1 Printing For print out vibraimages and the demographic data the command Print Ctrl P menu File is intended Before a call of a command Print Ctrl P it is necessary to cho
5. accumulated frames depends on camera frequency for example for 15f s user stands N 15 or for 30f s user stands N 30 There is no sense to stand difference between base processing and fast processing frequency for macromovements registration For micromovement analysis was recommended to stand base processing frequency lower than fast processing because head micromovement is practically invisible for time period less than 0 1 second But for macro hand movement or body movement it is not so and when person 1 active or aggressive 1 moves very fast so it 15 recommended to stand base processing frame rate between 15 30 f s Also for macromovements analysis is recommended to set frame number N 2 5 because standard 2 frames accumulation gives more red color for any movement tired operators eyes and use this window in amplitude or frequency mode For N 10 and N 15 30 used frequency mode Changes in Information Table settings between default mode microvibrations registration and macromovements shown on Fig 122 VI ST M LD GR VI ST M LD GR 35 Frame rate Frame rate Fast processing E Fast processing 0 0 Base processing Base processing 15 0 FPS proc period FPS proc period 2 00 Downrate Downrate 0 Main Main N 2 N 2 5 N 10 10 E N 15 K 1 00 L 150 00 Parallelization Parallelization 0 Filters Filters Single points Single points Yes Extended Extended 8 Extended fast Extended fast 8 Stretch Stretch No Max speed contou
6. dangerous 2 Auto capture image 5 If set non zero value than the image of dangerous object at his detection will be automatically save in an external file Fig 127 The chosen value of 134 the given parameter determines in seconds the period of saving the pictures in a file Simultaneously the image dangerous will be displayed Video windows 3 Show N image If set value N distinct from 0 in Video windows will be displayed at once N images of the dangerous people which have been found out for the specified interval Auto capture image s If set value N 1 that for the specified interval in Video windows will be displayed only one image and we can pass other dangerous person Note attention at work in the given mode Video windows should be preliminary open 6 2 2 Face detection mode Switch on Face detection mode is made in the same section of the information panel E If Face detection Yes face detection mode is used No without face detection ST M LD GR 5 Z5 Macro mode level L level 5 aura mode macro mode Face detection Detection quality 1 4 Min size Max size config draw Alerts Critical level Auto captute image 5 Show M image Fig 126 Macro mode basic settings Yes 150 Yes No 300 All 60 00 If parameter Draw No not draw rectangle around face If Draw Yes draw rectangle
7. LD rR b vitri us cd VI AV AR Fig 24 Change the catalogue number may be also processing by toolbar buttons 33 If in the image area you have switch on some windows with video data for example open 3 window Fig 25 submenu Capture channel allows to choose from what window video data will be saved video file Vibraimage lt v2 avi EXC File View 1050 Action Help 77 r Rie in Ei Language AA om om Record group gt Video mask Capture channel Base proce Skype mood Video timer 10 F VI IntegratedN Am ES IntegratedN F MN Fri0C 0031 Suspect Aggression Sress Tension Fig 25 Submenu Capture channel If in the field of supervision there 15 an additional mobile object which prevents measurements of the basic object submenu Video mask Fig 26 allows to edit video data In Edit mode you can cover black mask on addition object image Fig 27 Also you can reset current mask Reset Video mask mode save mask in external picture file Export Video mask mode and load external mask Load Video mask mode 34 Video 4 Audio EI Language Record group d a Video mask Load video mask Capture channel Reset video mask Skins Export video mask Skype mood Edit mode Fig 26 Submenu Video mask 71
8. 1 3 2 Digital web camera requirements e Sensor e Resolution pixel e USB compatible e Frame speed f s more than e Microphone e Exposition control e Color mode e Flicker mode CCD or CMOS Sensor From 640 x 480 till 1280 x 1024 USB 1 0 USB 2 0 10 external auto and manual color and B W switch Flicker 50Hz and 60Hz 1 3 3 System requirements for local module Operation System Processor RAM HDD DVD ROM USB port PCI slot Video capture Audio Network Windows XP Prof Vista with DirectX 9 0 or later PC with Pentium Core Duo2 2000 or better 1024MB or better 100GB or more free space DVDRW 2 free USB ports version USB 2 0 free slot option WDM compatible video device audio capture device support 16 bit data and 44100Hz stream frequency LAN 100Mb s or better 11 1 3 4 System requirements for terminal module network monitoring Operation System Windows XP Prof Vista with DirectX 9 0 or later Processor PC with Pentium IV 2400 or better RAM 256MB or better HDD or better Monitor Resolution 1024 x 768 or better On desktop must be free area don not cover other software windows with size 300 x 80 point or better Video capture WDM compatible video device Audio audio capture device and speaker Network LAN 100MB s or better Server Local Network Fig 9 Example of construction Vibralmage system a network monitoring mode with vari
9. Behavior Detection System Vibralmage Version 7 5 Manual ELSYS Corp Saint Petersburg 2011 Introduction 5 1 Useful information 0 1 1 Basic applications 9 1 2 Operation conditions 9 1 3 Specifications 9 1 3 1 Vibralmage system data 9 1 3 2 Digital web camera requirements 10 1 3 3 System requirements for local module 10 1 3 4 System requirements for terminal module network monitoring 1 1 4 Package contents 12 1 5 Basic functions 13 2 Before you begin 14 2 1 Information and Precautions 14 2 1 1 Power supplies requirements 14 2 1 2 Light exposure requirements 14 2 1 3 Camera vibration requirements 14 2 1 4 Settings Vibraimage recommendations 15 2 2 Getting started 15 2 2 1 Digital camera driver installation 15 2 2 2 Guardant dongles driver installation 16 2 2 3 Vibralmage installation 16 2 3 Manual installation 17 2 4 Auto Installation 18 2 5 First testing of vibraimage system 3 Vibralmage module 21 3 1 Multifunction window 21 3 2 24 3 2 1 File menu 25 3 2 2 View menu 26 3 2 3 Settings menu 30 3 2 4 Action menu 37 3 2 5 Help menu 4 3 3 Image area 42 3 3 1 Graphs 43 3 3 2 Graph analyze 46 3 3 3 Image area control from preset 50 3 3 4 Submenu mode 54 3 4 Toolbar 63 service and service regulations Intro
10. from the keyboard ES 0 o 1 Reset Pause Start LD block Start LD compare block Reset timers dcs Measurement Graph analyse Y Markers 1 2 3 4 5 5 d Question Question C Question G Fig 34 Menu marker set Each marker will be present in the field of parameters graphs by the unique color Fig 35 or by the number symbol with unique color 41 Vibraimage lt td avi OX File View Settings Action Help 25 10 gt LC Eg cr VI ST M LD GR AA A AK Ir DE FPS proc period 1 4 8 CQ 1 GC 3 1 GQ 2 Downrate 9 4 4 1 p i TIRE ia aa a N 2 10 22 0 1 SUI 90 2 am D m ol gt 5 472 Parallelization 4 JRO B CG 9 0 1 BCQ1 8 GOT 6022 RO 9 1 9 50 1 602 POI 8 0 1 9 60 1 60 2 Fig 35 Markers samples 3 2 5 Help menu Help menu Fig 36 contains following items Help About vibraImage Help Fig 36 Menu Help Use About Vibralmage command to view the information about software version license type and registered user name Use Help command to call the help system 42 3 3 Image area Vibraimages images and external vibraimages auras are displayed in the image
11. F2 53 786 0 000 0 000 17 390 0 000 0 000 F4 77 222 0 000 0 000 5 fast 0 175 0 000 0 000 F5 0 346 0 000 0 000 3 424 0 000 0 000 0 268 0 000 0 000 4 138 0 000 0 000 0 170 0 000 0 000 0 117 0 000 0 000 0 162 0 000 0 000 6 049 0 000 0 000 RI ee Wl IntegratedN F 3 20 20 321 t 3 20 20 0 31 t 3 20 20 0 50 t 3 20 20 0 42 Fig 40 Graphs position adjustment 46 3 3 2 Graph analyze Choice of item Graph analyse will open submenu gathering of frequency distribution information in vibraimage Fig 41 Histogram of frequency distribution will be showed in area of images Fig 42 Reset Pause Start LD black Start LD compare block Reset timers Fle Measurement Graph analyse Start H Markers d Start 105 Starts Start 5 10s Start T Start T 105 Fig 41 Start frequency analyze menu Items Start H 10s and Start H are intended for accumulation and viewing of the frequency information Command Start H 10s gathering information for 10 seconds and the window of frequency information viewing is showed automatically after 10 seconds Time of data accumulation for command Start H is defined by the user and the window of frequency information viewing 1
12. Info e N Number of the frames for accumulation Selected by user e Gain Factor Selected by user e Palette Threshold Defines a threshold in the displayed image value of brightness less threshold is considered black Selected by user Width and Height Displays the current video camera or avi file resolution Statistics e ntegratedN Am Average frame amplitude vibraimage intensity processed for the N frames e ntegratedN F Average frame frequency vibraimage intensity processed for frames e Suspect Calculated level of suspect for object in frame Anger Calculated level of anger for object in frame e Stress Calculated level of stress for object in frame e Tension Calculated level of tension for object in frame e Level current level of audio signal VI sT iD 8 Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Tension Audio Level Fig 66 VI table from information panel 68 3 5 2 ST table ST table Fig 67 shows the following information e Current values of based processed Vibralmage parameters 1 4 1 8 51 57 P1 P19 e Current values of fast processing Vibralmage parameters A1 fast A4 fast F1 fast F5 fast e Current audio level and audio threshold ST table columns meaning parameter current value
13. IntegratedN F Suspect Aggression Sress Tension Fig 14 Multifunction window of Vibralmage exe module 3 2 Main menu The main menu contains the following items File View Settings Action e Help 25 3 2 1 File menu File menu Fig 15 contains following items View Settings Action Open Saveimageas Fz Save settings as Load settings Database folder Ctrl F2 New record Fe Print Ctrl F Print preview Print setup AVI Start capture F5 Image capture F7 Exit Fig 15 Menu File Open for viewing and printing the saved file of XML format with parameters of system for the supervision interval Save image as saving the current frame of a window in BMP JPG PNG or GIF file Item Save settings as it is intended for saving of the current system settings to the external file Item Load settings it 15 intended for loading before saved the system settings from an external file Database folder changing folder where archive data 1s kept If the database folder 15 not specified record of AVI or BMP files is blocked New Record Create a new record in archive folder Print printing the current frame from image area Print Preview printing preview of current frame from image area Print Setup set printing options AVI Start Capture start record AVI file If the database f
14. Tension v Audio Level MagicDisc sdb ici Call phones wr F t4 Directo 5 h e classic bigstockpho bike Garminques Fig 28 For example Skype Vibralmage programs teamwork 36 The item Skins allows to model under orders of the user the interface for results display see Fig 29 For creation of the new interface in the catalogue where Vibralmage program has been installed subdirectory Skins is created In it 2 files are placed face png a picture of screen appearance and config xml in which the arrangement of areas for parameters show 1 set State of Mind and Mood Analysis for e Health Communications Anger Stress Tension Critical ELSYS Fig 29 An example of the new interface of a working window created under the order of the user 37 3 2 4 Action menu Action menu Fig 30 contains following items E 1 Reset Fause Start LD block Start LO compare block Reset timers 12 Measurement Graph analyse d Markers Fig 30 Menu Action Reset reset all saved up information and statistics about frames and start new cycle collection of information Pause stop last accepted frame of data image area of windows Start LD block or toolbar button H begin calculation of
15. amp Frame rate In Video mask Fast proce 2884 zc 5553 Base processing Video timer VI 2 Am Info Width VI N Am Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Tension Audio Level Fig 87 Select Capture channel for video recording for example from SRC channel 102 3 6 3 Save of results and settings files Vibralmage program allows to save in an external file results of measurement and processing of integrated intensity of image pulsation for some time interval Saving of values sequence for integrated vibraimage characteristics received for the certain time in a file of the report 15 carried out automatically at record of video file The user can define type and a format of a file in which reports will be made Fig 85 e extension xml viewing of file contents report 15 carried out by program Microsoft Excel e extension txt an ordinary text file which contains the same information file XML only in the other format of representation In a XML file are save changes in time of every parameter which numerical values can be observed in mode ST GR of the information panel NOTE that save of parameters carries events character 1 e as soon as value of parameter 1s calculated by system it save the name in a file therefore sequence of parameters records in a file 1s not fixed as some parameters demand more often calculation
16. cMin minimal parameter value during past stat period only in LD mode cMax maximal parameter value during past stat period only in LD mode bMin minimum threshold value of parameter only in LD mode during past stat period bMax maximum threshold value of parameter only in LD mode during past stat period 69 Vibraimage lt 2009 07 01 13_03_49a avi gt File View Settings Action cr V i Vig A A VI ST M E F e im VI E gt A1 fast KPAI 2 amp E P A4 fast 8 A4 gt F1 fast amp NF 1 amp bF2 8 gt 4 F5 fast PFS F7 8 244 8 54 8 25 8 56 57 amp bP1 2 amp 4 0 273 1 947 57 977 27 696 0 448 0 598 0 034 0 119 13 572 38 898 150 817 0 355 0 282 0 160 0 049 0 180 4 108 0 286 0 156 0 116 21 638 39 961 28 144 2 612 1 016 0 011 1 426 5 361 0 014 20 270 27 281 0 013 0 043 0 002 53 941 38 832 124 642 0 356 0 219 0 152 0 033 0 414 0 214 0 116 24 436 38 271 26 951 0 320 0 955 0 255 2 038 6 738 11 235 26 220 0 130 0 685 0 006 94 941 2 267 171 082 7 327310 67 674 0 795 0 598 0 095 0 2 102 298 127 995 36 367 45 134 65 823 123 844 156 509 345 101 0 203 0
17. i i i 4 2 0 096047 Height 480 i Statistics IntegratedN Am 3 91590 IntegratedN F 5 38778 Anger Stress Tension Fig 32 The frequency histogram for a normal condition of the person E Pressing on button Load the user can load earlier saved data and to compare them with just received For printing received results choose a command Print menu File For removing the received graph of the frequency analysis 15 necessary to bring the mouse pointer to the chosen diagram press the right mouse button and to choose item Delete 40 Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action 25 27 Sy VI AVARLD Am F R Hig S10 VI ST GR EST s H Integrated2 m 11 18 Show N Diff mode HeT gMin 0 00 T 3 1 f 1 gMax 10 00 2008 04 29 14 39 49 i i 1 i i i M 1 990257 i i i i i i i 5 0 936038 E H H B E 201 i i i i i i D d 876170 Ow eT i 1 Diff mode Het gMin 0 00 9 20 00 IntegratedN Am 45 67 Show Diff mode 9 0 00 gMax 50 00 Fig 33 Frequency histogram for person differs from a normal state Choice of item Markers will open submenu for input of 10 markers Fig 34 To enter markers it 1s possible also buttons 0 9
18. port 5221 UDF port 5222 Fig 149 Network monitoring mode Information panel For adjustment of network parameters for the terminal it 1 required to start the program VINetStatus exe In the appeared window it is necessary to press the right button of a mouse and to choose item Settings Fig 150 165 ViNetStatus English settings Fig 150 Main window VINetStatus exe started on terminal PC In the opened window Settings Fig 151 it 1s necessary to specify same numbers of ports UDP and TCP ports of the terminal on which program VINetStatus is started and TCP port of the local module on which program Vibralmage 15 started as has been adjusted on the local module and as the network address to set IP address of the local module If both programs Vibralmage exe and VINetStatus exe are started on one computer at adjustments of a network in programs it is necessary to specify the same network address TCP port Local TCP port UDP port Alerts Sounds Images Critical level Frame rate In Fast processing Base processing Info Height Statistics IntegratedN Am InitegratedN F Anger Sress Tension Audio Level Fig 151 Settings window of VINetstatus exe started on terminal module 166 NOTE that if adjustment of a network is not made or and on the local module the basic program Vibralmage exe 1 not started than at start of
19. 1 window Mode d v AN AF Fig 45 Menu View Preset image area mode Item Presets menu View designed to choice one basic mode image area In VI mode Vibralmage mode displays vibraimage of person Color for every image pixel depends on its amplitude or frequency of vibrations Fig 46 47 In AV mode Aura Vibraimage mode external vibraimage aura allocated around the internal vibraimage or simple vibraimage Aura line size depends on medium line vibration amplitude Aura line color depends on maximum line vibration frequency inside vibraimage contour Fig 48 49 In AR mode Aura on the Real image the aura of the person 15 shown around his real image Fig 50 51 In LD mode Lie Detector mode image area shows real object image selected graphs Fig 52 53 NOTE Selected graphs depend on Graphs switch position which sets graphs time dependences of chosen parameters Fig 46 53 Fi Vibraimage 2008 04 22 15 31 38 AVI File View Settings Action VIAVARID Am FOR 885425 ST LD GR e e lad AA Frame rate VI N A 100 00 39 In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Anger lt Fig 46 mode t Vibraimage 2008 04 22 15 31 38 AVI File View Setti
20. Action bel 9 VI AV ARLD Am F R 375 2 LD GR 5 M n Frame rate In Fast processing Base processing Video timer Info Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress lt Fig 61 Vertical center of vibraimage lines on image The item Mouse fn is reserved later version of Vibralmage 62 Item AVI timer and Title displays in the left top corner in each of visible windows with images the name of a processing mode which 1 used for the given window and time from the beginning of viewing AVI file Fig 62 Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action v 1 Am F R 815104 VI GR 18 874 0 000 16 694 0 000 A4 fast 0 006 E 44 0 026 fast 0 001 0 009 0 000 0 000 0 000 64 810 0 000 24 631 0 000 170 452 0 000 0 176 0 000 0 315 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 AF e dme LU MS VI N A 100 00 50 Fig 62 Title of image and video time for AVI file 63 3 4 Toolbar The toolbar Fig 63 duplicates correspondingly the following menu items Save Image File menu Print Image File men
21. Vibraimage VIDEO Look 1320 V2 File View Settings Action 4 VIAVARLD Am F R w I sT LD GR 25 wi vvv VIA A GBA Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Suspect Mask Macka Fig 27 For example edit mask in Video mask mode 35 The item Skype mood can be used if at you a computer Skype program is install At teamwork of Skype and Vibraimage programs you can observe current psycho emotion parameters of the interlocutor Fig 28 0 2 VIL 4 9 1 p652 large GARMIN C mj lt 5 Vibraimage lt VIDEO Eye 3110 gt File View Settings Action Help CESE 2 9 AVARLD Am 810510 E e MI ST LD etm ww um V VI Skype Contacts Call View Tools Help cS Flag F 5 la V Video timer Info Mozilla Firefox Unlimited calls to landlines More New v 5 Contacts Groups and Conversation Topics fh Width 7 Contacts Conversations Sight recompressot v avarme 5 29 Statistics lt Echo Sound Test Service Integratedfit m 1 76162 IntegratedN F 8 76085 Hes Total Suspect commander Anger Sress
22. Vibraimage settings in external XML file Item Load settings menu File is used for load saving Vibraimage settings in program 161 View Settings Action Open save image as Fe Save settings as Load settings Database folder cCtrl F2Z New record F4 Print Ctrl F Print preview Print setup Image capture Fi Exit Fig 147 Menu File NOTE For choice of the catalogue where the all Vibraimage system file will be saved is intended a command Database folder menu File Fig 147 or a line DB folder an H information panel in DB table Fig 148 The list of objects the information about which 1 in the specified catalogue displays as the list in the bottom of an information panel Filling of field Selected record is made at choice of corresponding line in the list of a database Item New records it 1s intended for input of new record in a database The further saving of files in archive will be made in a folder with a name of the entered record 6 3 8 Saving the lie detection results Vibraimage system records the lie detection file with the whole information about settings and detected lie You need to stand Save LD Yes in DB information panel Fig 148 and press M Capture button on the toolbar for start file capturing and press Capture button off the finishing file recording Note record of a videofile is necessary for carrying out even
23. Width Height Statistics lt 02 58 50 100 1 00 2 00 640 480 e fad e Fig 59 Vertical and horizontal brightness lines on image In Sym line mode to the field of information display are added two areas in vertical area displays sums of frame difference lines of the visible image in horizontal sums of frame difference columns of the visible image Blue dashed lines on cuts display position of the mouse pointer Fig 60 61 Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action oz j P VIAVARLD Am R v 3252 x VI sT LD GR E 9 Yio Yio A A 38 438 0 000 0 000 VIN A 100 00 41 16 340 0 000 0 000 0 0 E 4 fast 0 010 0 000 0 000 A4 0 077 0 000 0 000 0 002 0 000 0 000 0 016 78 799 0 000 0 000 24 433 0 000 0 000 141 819 0 000 0 000 0 203 0 000 0 000 0 394 0 000 0 000 46 080 0 0 11 501 0 0 0 000 4 427 0 0 0 000 0 524 0 0 0 000 0 287 0 000 0 000 0 115 0 000 0 000 20 346 0 000 0 000 0 000 D D 0 Fig 60 Frame difference Sum lines on the image In Centre mode to the field of information display are added 3 vertical lines blue line displays vibraimage center for N 2 green line displays vibraimage center for N 10 red line displays vibraimage center for N 100 Fig 61 Vibraimage lt VIDEO Look 1320 V2 gt File View Settings
24. a server computer cam_ 1 cam 2 2 cam 3 1 cam 1 cam n 2 1 1 1 2 cam 8 1 cam 8 2 1 1 34 2 157 Shared network folder Command line for start of the Vibraimage exe program on PC2 PC7 Vibralmage exe copy XX camera Y format 352 288 cstart 30 noaudio Where XX the name of a folder where the video archive from the selected camera 1s stored Y a serial number of the camera on this computer cstart 30 to begin record of video through 30 seconds after loading system 173 Computer PC1 works as a server of system On a server in an automatic mode two programs are started VINetServer exe the network application of Vibraimage system e VIFaceMatcher exe the program for the person identification at check on a suspected persons database Note the software for work with a database is not included into the basic Vibralmage installation complete set and demands installation on a computer the additional software for persons identification The server receives from local computers and displays for operator the following information e Video from the cameras e The message on a danger threshold e frame with the image of the person which danger level has exceeded the set limit At reception from a local computer the signal about suspected person detection the server gives warning sound signal will write corresponding record in the list of
25. an information column in mode m Changes of the parameters marked by a G symbol are displayed on graph To choose parameter it is necessary to click the mouse left button when the mouse pointer is above the letter G the chosen parameter The parameters marked by displayed Vibraimage lt 2009 07 01 13_03_49a gt File View Settings Action 2 VIE AV Am FOR 15 IN A Em ww VI ST M LD GR E 9 e fad VS AA A ANE Diff mode vi10 F 10 00 36 aMin 9 HF flt Peoi EL ET PEL EL EL EL EL oes EEE EE EEE 555 adpage oe Fig 140 Graph example 154 Operation in lie detectiom mode is recommended to indicate parameters as much as possible covering all types of general activity Al fast 52 P2 P5 lie and F6 and also a level of a sound for the first testing Note at switching of system parameters in a Lie detection mode executed by double click by the left mouse button above line of LD default in the information panel automatically in working window of the program will be displayed all necessary graphs Fig 144 It is necessary to note that calculation of quantitative factor of change psycho physiological parameter P20 is carried out on a lot of parame
26. area The basic window of the base module Vibralmage exe can be configured for surveillance in several operating modes The choice of an operating mode is made in item View of the main menu Fig 37 e The subitem Preset defines type of the display image the real image mode LD vibraimage mode VI aura on the real image mode AR and aura on vibraimage mode AV e The subitem Mode defines additional adjustments and quantity of windows with the image displayed in image area e The subitem Graphs defines an opportunity to display simultaneously on the screen graphs of parameters changes in time View Settings Action Settings Action Toolbar VI AV AR Toolbar Info bar Info bar Buttons Graphs Frequency analysis s results BioTester results Video window Frequency analysis s results BioTester results Video window Buttons d Graphs window Status window LD window LE window Mode 2 Toolbar ORC VI VI 2 Am d AV VI 2 FY d AR VI 10 Am v LD 10 F VI M Am VI M F DELTA Am d DELTA F d View Mode DELTA View Mode DELTA FB mode Am mode F Mouse fn Mouse line Sum line Centre AVI timer Tite Fig 37 Menu View for mode selection 43 3 3 1 Graphs Choice of item Graphs the menu View Fig 16 makes switch on off display in the field of image the graph of change in time of the set
27. axis corresponded to full length of video file If in section Graphs of the information panel to set value of Hist time gt parameter distinct from 0 than in the graphs field additional will displayed the frequency histogram of parameter change for the specified interval Fig 39 At value 0 the histogram in graphs area is not displayed IntegretedN Am 3 53 50 19000 85 139 3549 ij poo d A4 fast t 3 53 50 i 1 00 Fig 39 Example display on graphs area NOTE It is possible to playback recorded information from AVI files with graphs on the screen in image area For this purpose it is necessary to execute the following actions Switch ON Graphs To bring the mouse pointer to interesting time an time axis and twice to click the left mouse button 45 Graphs position on in image area adjusts according to user s needs For this purpose it is necessary to bring the mouse pointer to the top or left border of area of graphs Fig 40 and to change an arrangement of these borders Fi Vibraimage 2008 04 22 15_31_38 AVI DER File View Settings Action Help 2 VIAVARLD Am FOR 1195115 VI sT LD GR 5 e Vio Vi 2 15 111 0 000 0 000 0 p TETTE 11 412 0 000 0 000 gt Ad fast 0 005 0 000 0 000 A4 0 017 0 000 0 000 Fi fast 0 001 0 000 0 000 0 008
28. for aggressive state and have not any correlation with EEG when person is still That means that head motion depends on minds when person have high internal energy level or high emotion activity level and head motion does not depend on mind activity when person is still low energy and have not strong minds 6 1 7 Samples of human aura visualization Normal and top emotional state Normal condition characterized by aura color and form uniformity around the head relevant monochrome color in the middle of suggested color scale Activity level is about 0 3 0 6 Stress level is about 0 2 0 5 Tension level is not more than 0 4 Every emotion level measured in the range from 0 till 1 0 and minimal value coordinates with minimal emotion intensity Frequency distribution histogram 1s near normal Gauss distribution and spectrum of high speed vibraimage signals 1s near exponential distribution 127 Aura photos samples for normal condition of person are on Fig 118 below Figs 118 Aura photos samples for normal condition of persons Stress state Stress state characterized by amount gaps in aura form and greatly aura colors non uniformity Aura includes every scale colors and sharp color transfer like red color could transfer to blue Fig 119 Stress level more than 0 7 Aggression or activity level is low not more than 0 5 and tension level is high and usually more than 0 4 Frequency distribution histogram has several modes and
29. high speed vibraimage signals spectrum presents superposition of exponential and uniform distributions Figs 119 Aura photos samples for stress condition of person 128 Aggressive and or tension state Aggressive state 15 not every time coordinates with tension and tension state 15 not always coordinates with aggression But often these two emotions accompany each other Aggressive state obligatory characterized by high frequency vibrations and red colors in aura Aura size 1s more than normal and gaps could absent but color and form non uniformity must present Fig 120 Stress level could be low less than 0 3 Anger level more than 0 7 and tension level more than 0 4 Frequency histogram distribution has maximum in right part of the range and distribution has amount dispersion High speed signals spectrum envelope looks like uniform distribution J L Y Figs 120 Aura photos samples for aggression condition of persons 129 6 2 Macro mode The control of people condition crowd Vibralmage system allows controlling macromovements macrovibrations as microvibration Controlled vibration range depends only from the camera lens angle camera object distance and movement amplitude of person Head microvibration informatively expressed reflex movements Vestibular Emotional Reflex but it s well known that human body macromovements expressed behavior and emotions too Macromovements control has powerf
30. it is more than the condition is better On axis X in a Kcal minute energy of the person is displayed 49 At repeated pressing of the button or a choice of corresponding menu item will be made new accumulation of the information and in graph area the following result of frequency distribution will be displayed Fig 44 To save the received graph it is necessary to bring the mouse pointer to the chosen diagram to press the right mouse button and to choose item Save as i Vibraimage VIDEO Eye 311Q gt File View Settings Action pum H10 10 T10 gt lt 5 LD REC T 52 ME VI AV ARED Am R 819510 ST M LD GR EE 8 AA A Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Suspect Aggression Sress Tension Audio Level Fig 44 Old and new human state 50 3 3 3 Image area control from preset In the field of the image area Fig 46 50 depending on the chosen mode Fig 45 the user can see the real video image vibraimage external vibraimage aura or graphs time dependences for control in LD mode or any other mode settings Acton Toolbar X Info bar Buttons d Graphs Frequency analysis s results BioTester results Video window Status window
31. level S aura mode macro mode Face detection draw Alerts Critical level 96 Auto captute image s Sound Susp Sound Sound S Sound T marker s beep reset beep Fig 124 Macro mode settings Specially for adjustment of display modes at work in Macro mode in a field of an information column are added number of parameters Fig 124 Macro mode If mode Yes than danger level calculation is made on the basis of values of parameters P13 P14 P15 the description of parameters is see lower In Micro mode danger level calculation is made on the basis of the analysis of values of aggression P7 stress P6 and tension parameters Level L sets a palette threshold at danger level calculation Vibraimage points which brightness less than the specified threshold are considered black and are not used at calculation of a danger level The vibraimage point is considered active if its brightness more than the set threshold Level L Parameter P15 defines the relation between the area of active vibraimage points to the area of all frame Level S defining the area of active vibraimage points If the area of points in which value of brightness is more than value Level L is less than value Level S than danger level value displayed in status window equally 0 So if in the frame it is not a lot of active points the level of danger is not calculated Param
32. m Fig 134 The minimum value of input audio signal corresponding to silence 146 M ID GR 94 E E 8 B Fig 135 The maximum value of input audio signal corresponding to voice Threshold value setup equal 7 P Additional parameter Audio sens in an information column sets in seconds how many seconds after the person answer finished are accepted to analyze of lie detection 6 3 3 information panel settings 1 Note for stable work in a Lie detection mode in section Filters of the information panel it is necessary to set parameter FPS filter YES 147 The parameter FPS filter provides stability of input video frame stream frequency due to resources of a computer If the parameter FPS filter No than parameter Downrate in M information panel sets factor of division of input frame frequency FPS for all processing mode base and fast If the parameter FPS filter Yes than parameter Downrate sets factor of division of input frame frequency only for base processing mode If Downrate 0 than division factor calculated by system automatically If input video frame stream frequency not stability than additional parameter Stream errors in information panel displayed quantity of entrance frequency failures VI ST M LD
33. made in view of frequency of the input frames Base processing frequency and computing capacity of a computer Note Canceling of parameter calculation is use for increase calculation speed of other parameters Canceling of points fluctuation amplitudes calculation Canceling of points fluctuation frequencies calculation Canceling of 2 frames parameters fast calculation Canceling of 10 frames parameters calculation Canceling of 2 frames parameters calculation Canceling of Fast Fourier Transformation frequency processing Canceling of Entropy processing Motion detection Motion detector Level Auto reset Skip frames Periods Diff time Histogram s Hist C smooth Hist H smooth Hist S smooth Hist A HC function sin t 2 pi n 87 Filter of movement Delete emotion calculation for object with motion amount less than threshold Threshold level of Integrated10 for emotion calculation Reset emotion calculation for macro movement Skip frames with the frame difference more than threshold Graphs global Graphs visualized period in seconds on the screen Time in seconds for calculation of an average level parameter values In the field of a graph the frequency histogram of parameter change will be displayed in addition see Fig 78 At value 0 the histogram in graph area is not displayed Time in seconds for upper histograms accumulation top graph on fig 79 Time in seconds for middle
34. of input audio signal procedure of adjustment see above The moment when the person starts to speak is used by system for the analysis start of the data in Audio mode Vibraimage parameters during speaking Stat period are compared to the data received earlier Base period for example when the person was silent Therefore it 15 necessary to adjust preliminary a Audio level so that the surrounding level of a sound was below threshold and the level of a sound at the task of a question and reception of the answer was higher threshold 145 Before operating in Lie Detection mode adjust the level of audio signal Changes of audio signal input options are made in corresponding fields of an information panel in ST mode Fig 134 Level of audio signal down red strip 1s necessary to stand so that it was on the average position between the minimal value of a input signal which corresponds to silence in a room position of green strip on Fig 134 and the maximal value which corresponds to a voice sound of a person in front of the camera Fig 135 Audio mode is preferable for lie detection in vibraimaging if video and audio data of person were captured with high quality Position of a red strip stands by click of the left mouse button and input of a new value of a level ST M LD GR ie 35 P17 CS 69 18 19 St 0 382 oe mi omi mi omi T gt Audio Level 1 2 Th 30 0
35. of the person The maximal value of parameter for a normal condition of the person Note values of cMin eMax parameter are displayed only when measurement mode M has been began and the information for the specified period of time 15 saved up GR E 44 M MIN 29 000 25 000 4 200 cMin 702435 7 005 4 934 50 000 40 000 40 000 50 000 100 000 100 000 50 000 100 000 25 000 50 000 0 000 0 000 0 000 0 000 0 000 0 000 37 237 36 601 50 072 33 750 91 294 90 5098 16 950 92 684 53 390 115 920 11 259 156 485 261 716 46 402 5 590 5 044 115 Fig 102 mode of information table Note after ending of the information accumulation some lines of an information column can be allocated by color parameters which values less than the set limits are allocated parameters which values more than the set limits are allocated Note in Fig 103 frequency of input frame from the camera FPS less than the set limits and is allocated by color For correct diagnostics psycho emotion conditions of the person speed of data input from the camera should be within the limits of 25 30 frame second 116 Preview and printing mode results After the ending of information accumulating mode Measurement the user can see results of research and print them At a choice of item Print preview menu File in a working window of the basic program will be dis
36. parameters Fig 38 The choice what change of parameters will be displayed on graphs is made in an information column in mode GR Fig 38 Changes of the parameters marked by a G symbol are displayed on graph To choose parameter it 1 necessary to click the mouse left button when the mouse pointer 15 above the letter the chosen parameter The parameters marked by 8 on graph are not displayed Vibraimage lt v2 avi gt File View Settings Action Help 2 amp 2 imu wem _ VIE EH Integrated2 Am 0 90 S EN Show No Diff mode No gMin 0 gMax 10 HF fit 96 0 LF fit 96 0 G H Integratedi0 Am 13 4 29 Show Yes Diff mode No gMin 0 gMax 20 fit 96 0 LA fit 0 EH IntegratedN Am Show Diff mode gMin gMax HF fit F fit v Integrated 0 Am t 01 00 a ami i L IntegratedN Am 01 00 Fig 38 Graph example 44 The scale of each separate graph on axis on a vertical is set with parameters gMin and eMax to information panel GR The scale of all graphs on an axis X is on a horizontal set in section Graphs of the information panel e Parameter Period 5 sets in seconds time of display of a graph part on screen T 0 e Note at viewing video file double click by mouse on the button changes value Period so that on the screen the time
37. parameters of a lie level in a manual mode It is necessary to press this button again to stop calculation in a manual mode The moment of start calculation in a manual mode will be noted by a vertical green line the moment of stop calculation by red line At work in a lie mode in an information table is set the Base interval during which the system collects the data on object of research that then to use these data for comparison during Stat interval In a base mode this interval directly precedes the moment of the lie analysis beginning But the system gives an opportunity to make gathering of the initial information on object at any time REC At a choice of the menu item Start LD compare block or corresponding toolbar item EM start of the information gathering interval will be made For end of an parameters gathering interval it 1 necessary to press repeatedly the same button or to choose the same menu item Now at the lie analysis the condition of object will be compared from the information saved up beforehand 1 0 Reset timer F12 or toolbar button reset to 0 all timers video file timer graph timer The conclusion video and construction of graph begins all over again 38 At a choice of item Measurement or corresponding toolbar button the system makes accumulation averaging and a display of parameters for the specified time period The results display is made in the information panel in a mode In
38. person are stable in time Parameters of vibration change only after change of an emotional condition Statistically defined norms corresponding to the person normal condition for controllable psycho emotional parameters Aggression Stress Tension Suspect Balance Charm Energy Self regulation Inhibition Neuroticism resulted in a Fig 102 in NMax columns It is necessary to note that each parameter has the range of normal values and a deviation for example Aggressions below set level 20 it 15 considered a deviation from norm The offered approach to measurement of emotional conditions is based that each emotion has the quantitative value in any condition of the person Even the extremely excited person has the certain Balance value and visually absolutely quiet person possesses the certain level of Aggression The measured print of ten emotions characterizes set of psycho emotional person conditions and these set measured psycho emotional parameters allows to analyze with high accuracy any change of the person condition deviation from statistical norms Only Vibralmage system analyzes various parameters of micromovements and impellent activity of the person head at a level of physiology connected with psycho emotional condition 6 1 1 M mode In a mode I an information column Fig 102 allows to control average for the period parameters value of psycho emotional person conditions and their deviation from the esta
39. person stands with the head in a balanced vertical position continuously and reflexively performing three dimension micromovements or vibrations The dependence between head vibration parameters and emotional state characterized by the vestibular emotional reflex VER or vestibular energy reflex Vibraimage technology is the realization of medicine psychology modern computers and television sciences for human emotion recognition Vibraimage plans to do human emotion control so precise like physics measurements Vibralmage software is designed to achieve the following goals e Cognitive control of emotions e aw enforcement e Aggressive and crime persons detection e Passengers remote surveillance e Psychological and medical monitoring e Lie detection e Research of weak response to humans e Training and relax control for fitness and sport applications e Meditation and aura control e Live and recorded video processing Vibralmage7 software includes 4 correlated programs Main module Vibralmage exe Printing module VlIPrinter exe LogViewer module LogViewer exe and NetMonitoring module VINetStatus exe VibraImage system realizes remote and auto monitoring of emotions levels such as stress aggression and tension and detects lie in a real time mode Vibralmage also allows to register and analyze human activity characteristics from recorded video files AVI format and to analyze medical psychological and emotional human
40. save of visible images in files in format BMP according to the entered demographic data e Print out the kept images and the corresponding demographic data 14 2 Before you begin 2 1 Information and Precautions Notice concerning privacy Do not use this system for purpose of person privacy irregularity Note that simply being in possession of material that was digitally copied or reproduced by means of a scanner digital camera or other device may be punishable by law NOTE Disposal of this product is acceptable only in accordance with Local and National Disposal Regulations 2 1 1 Power supplies requirements Power supply depends on your location and power supply of you computer and camera For low noise and reliable system action the monitor power units of cameras should be connected to an electric network through the special sockets having additional ground contact the socket of a class 1 For reliable maintenance system the equipment included in complex and the equipment taking place in direct near should be certificated on electromagnetic compatibility according to requirements 2 1 2 Light exposure requirements Natural illumination of object can be used only if speed of natural light exposure changes of object does not exceed Lx s Illumination of object by fluorescent lamps with illumination in a range 400 600 Lx plane of object is preferable 2 1 3 Camera vibration requirements The television cam
41. state for different applications The method system and the device of said Vibralmage technology are protected by the patents of Russian Federation RU 2187904 Fig 3 RU2289310 Fig 4 Software Registration N2006614137 Fig 5 United States Patent US 7346227 Fig 7 8 and awarded with Gold medal on the international exhibition of inventions and innovations Brussels Eureka 2002 Fig 6 e 3 F L 2289310 2187904 D XX EORR ER EROR ER EROR ER RR RR EX ORT ER EX ER RR EX RR EX RR EX EX EX XX EX EX XR EX EX EX EX EX XX XX LER EX ER BE ER EX EX EX ER EX EX E EX XR ROM Fig 3 Patent of Russian Federation Fig 4 Patent of Russian Federation RU 2187904 RU 2289310 0 2006614137 DIPLOMA MINE P Vel STAM Vibralmage 6 0 lt
42. than others In addition the user can save in file with extension set system settings at the moment of the beginning of information gathering In addition the user can save in a external file with extension xml system settings at the moment of the beginning of the information analization Item Save settings as the menu File is intended for saving the current system settings to external XML file Item Load settings is intended for loading before saving settings from external XML file Note if in an DB information column Fig 85 will be set item Save LD Yes the system save in external separate TXT file with results of lie detector work Look section LD mode in more detail 103 4 Printing module Printing module VIPrinter exe is designed to print saved personal data and Images Main window of printing module Fig 88 consists of the following parts e main menu e persons list e printing area e toolbar e status bar Didenko Tatiana 01 01 1958 ViPrinter File View Help Akimov Valera 31 12 1980 Didenko Tatiana 01 01 1958 Didenko Tatiana 01 01 1958 2008 06 17 15 00 06 src F 2008 06 17 15 00 06 vil 2008 06 17 15 00 10 src 2008 06 17 15 OO 10 vil aiu v anle t iiie 2008 06 17 15 00 51 6 17 15 00 06 41 20606 17 15 00 51 2008 06 17 15 00 54 src F 2008 06 17 15 00 54 vi2 2008 06 17 15 01 13 src F 2008 06 17 15 01 13 vil
43. with chosen terminal IP network address of terminal computer on which program VINetStatus exe 1s started port TCP UDP port UDP port Ports for software of terminal through which it changed by information with the computer on which started program Vibralmage exe Through UDP port goes an exchange by short messages Through TCP port goes an issue video data VI ST M ID GR amp 35 Network service No Critical level 60 00 Full video stream No Compression 1 Local TCP port 5220 Remote host 1 enable No IP 127 0 0 1 port 5221 port 5222 Fig 84 Network table 98 3 6 Save of measurements results NOTE the way to the catalogue of a archive database where video files files of images and files of statistics will be save is specified in a field DB folder The list of objects the information about which is in the specified catalogue displays as the list in the bottom of an information panel Fig 85 For choice of the catalogue where the video file will be kept is intended a command H Database folder menu File or a line DB folder an information panel DB table Fig 85 Input and save of the demographic data in a file db info 1s carried out in information panel of DB table Fig 94 at filling corresponding fields of New record Name Birth date and Comments After filing the demographic data in a field New record will appea
44. 0 1 2 99402 5 0 58154 2 3 20000 Fig 112 Normal state M12 74453 Print 5 0 28551 2 0 55000 M1 7 52094 5 1 42633 p 2 8 65000 Fig 113 Abnormal state 124 6 1 5 Spectrum analysis Spectrum analysis of time dependence high speed vibraimage signals also could informative reflects person emotions Person in normal conditions has in several times more low frequency square in vibration spectrum than person in tension or aggression On Fig 114 we see the sample of normal person state on up graphic and tension frequency spectrum on the down graphic M1 3 50694 5 3 42425 mr 2 0 20000 A Pu ut y Amr am erm m ae nm e m T m a i T ca n Load 125 12986 5 3 45410 0 95000 v A v wr Dif Fig 114 Normal state of person shown on up graphic and tension spectrum on the down graphic 1 2 3 4 b f 8 9 10 Hz 6 1 6 EEG Vibralmage testing EEG 1 well known and informative brain activity testing of course we adjusted and tested vibraimage system by comparative EEG testing Vibralmage signals recorded analogical EEG signals by developed VibraEEG system Program menu with recorded information cite on Fig 115 125 amp VIDbView File View Edit Graphs Help El x gt on 7 2006 11 30 13x47x35 22222 MM 2006 12 04 12x58x06 2006
45. 1 3 before lie detector mode start ATTENTION It is preferable to study vibraimage method and system principals given in patent US 7346227 before start Vibralmage operation First steps for person emotion control could be the following Place the person opposite to camera Focused camera on person face with maximum facial size on frame Wait while person will calm down for example ask him to make in mind the account from 1 up to 100 Measure a level of aggression Measure a level of stress Measure a level of tension Measure a level of potential danger Compare the results with norms from this document 22 For network monitoring mode please execute the next actions 1 Connect a local network computer to the local module and terminal or server 2 It s necessary to resolve work of Vibralmage applications if you have Firewall to protect your system 3 Run Vibralmage exe on local module Run VINetStatus exe on terminal 4 Read about Network monitoring parameters in Network Monitoring section see part 3 9 later 5 Adjust operating settings of Vibralmage system and a video camera for the local module according to the recommendations specified in items 2 4 of this Manual 6 Adjust the sound notification and a threshold of operation on the terminal in program VINetStatus according to the recommendations specified in section 3 9 7 Start operation with Vibralmage system in a network monitoring mode 23 3 Vi
46. 12 04 13x02x05 in MA M 2006 12 04 13x05x58 2006 12 08 12x32x26 aa Este mirerri 2006 12 08 12x38x44 Ready Fig 115 VibraEEG window Was calculated correlation between EEG signals and Vibralmage signals in theta frequency range 4 8 Hz for person in still state Fig 116 and aggressive state Fig 117 Analyzer Channel EEG1 EEG2 EEG3 EEG4 EEGS EEG6 EEG EEG8 EEG9 EEG10 11 EEG12 EEG13 EEG14 EEG15 EEG16 EEG17 EEG18 C EEG19 EEG20 21 EEG22 EEG23 Al F1 Abs O Custom Custom LF 10 00 D 0 1 3 5 Treshold A 8 13 13 30 B 13 30 FPS imt Fig 116 Vibraimage and EEG correlation for calm human state 126 Channel EEG1 EEG2 24 gt lt a EEG4 i ug Yon wee FEGS S 7 7 WA v 6 f EEG7 t 24 EEG8 EEG9 EEG10 11 EEG12 EEG13 EEG14 EEG15 EEG16 EEG17 EEG18 EEG19 EEG20 EEG21 EEG22 Abs Rel Custom Custom LF HF Ob 0 1 3 5 Ob 0 1 3 5 1 4 7 5 4 7 5 Treshold 50 Pow 1 00 Oa 8 13 OA 8 13 OB 13 30 OB 13 30 Ires ini Fig 117 Vibraimage and EEG correlation for aggressive human state Corresponding to Fig 116 117 Vibralmage parameters has strong correlation with EEG parameters
47. 4 Frame difference between two consecutive frames Frame difference accumulated in 10 consecutive frames Frame difference accumulated in N consecutive frames Value of parameter A1 filtered on 10 frames The group of parameters F1 F9 registers frequency of vibrations amount of changing points 1 2 4 5 F6 F7 F8 F9 Calculated value of changed signal pixels amount in 2 consecutive frames Averaged value of changed signal pixels amount in 10 consecutive frames Average value of elements quantity which have changed for the period of N frames Changed pixels maximum frequency during N processed frames Ratio of high frequency density to low frequency for parameter Fl Characterized tension parameter F5 current tension level Average value of the F1 parameter period in seconds determined during readout FON Value of parameter F6N 15 set in section Filters an information column in a mode and defines quantity of the frame processed in Fast Processing mode F6 Inhibition parameter Root mean square deviation for F6 parameter Not average current value of F6 parameter in seconds showing the current time period of F1 parameter changing Neuroticism parameter The group of parameters S1 S7 registers symmetry of vibrations between left and right parts of person body Sl 52 53 S4 S5 S7 Ratio symmetry of amplitude left t
48. 461 0 140 0 302 0 135 0 171 0 030 0 085 1 1b 5 620 0 480 1 000 0 186 0 269 0 171 0 016 89 533 21 509 0 409 0 312 0 176 0 097 123 833 123 833 85 100 22 17 109 17 109 15 046 14 709 12 174 2 IE 0 153 0 092 0 001 6 727 28 392 68 308 47 414 25 212 30 699 30 926 1 815 3 364 8 753 0 789 1 394 1 640 Fig 67 The explanatory to parameters bMax bmin cMax cMin for parameter S2 Rate 0 NOTE values of parameter cMin bMin and bMax displays only when the LD mode 15 switch on In other modes in these fields will be show 0 for example see Fig 68 ST parameters color marks indication v Green shows parameters indicated as graphs Does not show graph parameter in image area Value of parameter considered for level of lie calculation Value of parameter doesn t considered for level of lie calculation GR 25 0 133 1 575 67 371 44 042 0 289 0 594 0 01 0 090 40 092 29 822 160 732 0 106 F5 lie P7A and PF str PGF sir F5 tens PBA er FSF en POF H 1 11 P1iF 12 5 F13 14 15 P16 EIUS Com E E amp amp amp E amp amp E E amp amp amp Audio Level Th m Fig 66 ST table 71 The group of parameters A1 A4 registers amplitude of vibrations 1 2
49. 5 134 65 823 KP 4 150 817 124 642 123 844 156 509 345 101 amp F5 fast 0 355 0 356 i 0 461 8 0 282 0 219 0 302 0 160 0 152 0 171 F7 0 049 0 033 0 030 0 085 0 097 0 180 g 00 B33 6 4 17 109 17 109 15 046 14 709 12 174 I 4 I 1b 2 0 0 414 0 480 1 000 0 153 0 214 0188 0 269 002 0 116 0 171 0 016 0 001 21 638 24 436 89 533 21 509 6 77 Baseperiod Stat t period 39 961 38 277 28 392 68 308 47 414 28 144 26 951 25 212 30 699 30 926 2 612 0 320 1 815 3 364 8 753 1 016 0 955 0 789 1 394 1 640 for parameter 52 Rate 0 Fig 138 No difference between Stat period and Base period for indicated parameter 52 152 Vibraimage 2009 07 01 13_03_49a avi gt File View Settings Action Avian VI AV Am S19 110 e 14 ibe Sm MA OE Km m 52 t 36 00 for parameter 52 Rate2 2 Fig 139 Significant changes of the one level of parameter between Stat period and Base period for indicated parameter S2 153 6 3 5 Graphs settings in GR information panel Choice of item Graphs the menu View makes switch on off display in the field of image the graph of change time of the set parameters Fig 140 The choice what change of parameters will be displayed on graphs is made in
50. 8 51 57 P1 P19 e Current values of fast processing Vibralmage parameters fast A4 fast F1 fast F5 fast e Speed of input frame from the camera FPS 1n speed of frame processing for a base processing mode FPS BP and speed of frame processing for a fast processing mode FPS e Basic parameters describing psycho emotional condition of the person Aggression Stress Tension Anxiety Suspect Balance Charm Energy Self regulation Inhibition Neuroticism M table columns meaning The value of the parameter average for the set period root mean square deviation of parameter cMin The minimal value of parameter for the period The maximal value of parameter for the period NMin The minimal value of parameter for a normal condition of the person NMax The maximal value of parameter for a normal condition of the person 76 Note values of cMin cMax parameter are displayed only when measurement mode has been began and the information for the specified period of time is saved up GR amp M MIn chin 49 000 49 000 7005 4534 Fig 71 mode of information table 50 000 40 000 40 000 50 000 100 000 100 000 50 000 100 000 25 000 50 000 0 000 0 000 0 000 0 000 0 000 0 000 33 237 36 601 50 022 33 750 91 294 90 609 16 950 92 684 H3 390 116 920 11 259 156 485 261 716 46 282 5 590 5 044 Note after ending
51. Commander 7 7 96 vbramage Video window LD window Status window Main window Fig 18 Example of Video Status and LD windows 30 3 2 3 Settings menu Settings menu Fig 19 contains the following items Settings Video Audia Language d Record group Video mask Capture channel Skype mood Fig 19 Menu Settings System Vibralmage allows to process live video signal coming from a video camera and video data recorded before and saved as AVI file On default the system works with a signal from a video camera Submenu Video contains options of video modes Its can differ depending on connected devices For example this menu contains the following items Fig 20 You can choose as video source one from many installing in PC video devices or load external video file ETT Acton IP Camera 1 Video 4 Audio Video Capture Filter Language Video Capture Format Record group ROBS compressor Video mask d Capture channel AVT File F3 Skype mood AVI File no sound Ctri F3 Eve 3110 Fig 20 Submenu Video The subitem Disconnect allows to disconnect all videocamera or videofile Video Capture Filter by pressing the window of video device setting contrast exposition brightness opens Each device has the especial window of settings Video Capture Format change video capture f
52. Fig 58 It 1s additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 58 In Delta Am the button A of the toolbar and Delta F the button A of the toolbar modes display frame difference on the basis of amplitude Am and frequency F vibration analysis in base processing mode It 15 additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 58 In View mode Delta FA the button 2 of the toolbar and View mode Delta FA the button of the toolbar modes display frame difference on the basis of amplitude Am and frequency F vibration analysis in fast processing mode It 1s additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 58 In mode Am visualization and calculation of object parameters processed by pixel vibration amplitude 60 e mode visualization and calculation of object parameters processed by pixel vibration frequency e In Mouse line mode the field of information displays vertical and horizontal brightness lines of the image Fig 59 for mouse position Vibraimage VIDEO Look 1320 V2 gt File View Settings Action VIAVARLD Am F R 810581055 t F Vio M VI ST LD GR 5 Frame rate In Fast processing Base processing Video Timer Info
53. GR LO s global Enable Stat period 5s Hase period Lie threshold Audio sens s Opposite mode LD made Audio Manual Auto Compare Fig 136 Lie detector parameters settings 2 At work in a lie detector mode in information column the Base periods interval in seconds is set during which the system collects the data on object of research accumulates the information for definition maximal and a minimum level of the current parameters values that then at lie detection to define abnormal change of values of some parameters Then at Lie detection during of Stat periods the system define abnormal change of values of separate parameters of object In a base variant that Base periods interval directly precedes the moment of the beginning of the lie analysis But the system gives an opportunity to make accumulation of the initial information about object at any time At a choice of item Start LD compare block the REC menu of Action Fig 143 or corresponding toolbar item will be made start of the beginning of an accumulation interval during any time For end of an interval it is necessary to press repeatedly the same button or to choose the same menu item Now at the lie analysis the condition of object will be compared from the information saved up beforehand 148 Parameter Compare an information column defines what way of accumulation of the test information is chosen Val
54. LD window is made through item LD window the View menu or pressing of the toolbar button with more long red strip and high indicated value Higher lie level corresponds For operation in lie detection mode with audio starting needs to switch the system in an LD operating mode by double click of the mouse left button above line LD default in the information panel Fig 144 158 VI ST M LD GR Critical level Auto captute image 5 Show M image Sound Susp Sound A Sound 5 Sound T marker s reset Vibra sound disable std sound no sound Indication Micro default Macro default LO default Fig 144 Switch on LD mode 159 7 P i Vibraimage lt 2008 04 22 15_31_38 avi gt Settings Action Help Toolbar ARID Am H10 10 0 Info bar x _ 3 F mod maf E AA z m F Buttons 8 de ge VIS VI VID VIL s Fram Graphs I n Frequency analysis s results Fas Video window Status window p VEA info l K Preset L Te Width Height Statistics IntegratedN Am 1 33508 d commander H VIPririter 7 FingerCard Fig 145 Example of LD window At work the special
55. N Gigabit Ethernet Fig 156 System structure The multichannel behavior detection system Vibralmage version Gallery is constructed on the basis of 7 personal computers PC1 PC7 and 12 television cameras K1 K12 Computers configuration processor Intel 17 e870 2 93GHz memory 4Gb RAM 2 HDD disks on 500Gb motherboard Asus P7P55LX power source 500Wt with additional fan 172 Note Based on Vibralmage 7 5 program user could configured any system structure for example for 100 cameras used the same principals described in this document All computers are connected to the local network Gigabit Ethernet which constructed on basis of 8 port local network switch D Link DGS 1008D Each computer has own IP address Each computer has own IP address Network settings of all computers make in configuration files config xml and modules xml located in a folder VibraImage7 Vins For the general control from one single keyboard and for display the information to the single monitor all computers PC1 PC7 are connected through 8 port switch D Link DKVM 8E 12 television cameras are connected to 6 personal computers PC2 PC7 on 2 cameras to computer On each of computers in an automatic mode it 15 started two programs Vibralmage 7 4 working in Macro mode which carry out the basic video data processing Record of videofiles from each camera 1 carried out in an automatic mode Folders with results of work are open for access from a desktop of
56. ND became less than the set base minimum bMin Visualization using for calculation of P5 parameter Calculation using for calculation of P20 parameter In determines on how many the parameter value should exceed the settings limits that the system considered this change as significant LD parameters graphic value shows b Value of parameter is considered for LD detection 1 Value of parameter doesn t considered for LD detection 150 GR fast Calc Ratel V Rate V Ratel C Rate Level 1 Calc Rate1 V Rate V Ratel C Rate C Fig 137 LD mode of information panel Below are show 3 examples which explain a principle of information accumulation No difference between Stat period and Base period shown on Fig 138 Significant changes of the two levels of parameter between Stat period and Base period shown on Fig 139 151 ri Vibraimage lt 2009 07 01 13 03 49 gt File View Settings Action ll 2 VI AV ARLD fie Donec 8 M LD R a A1 fast 0 273 0 011 PAI 1 947 0 014 725g 2 57 977 20 270 71 236 27 696 27 281 26 220 amp gt A4 fast 0 448 0 013 0 130 4 0 598 0 043 0 685 fast 0 034 0 002 0 006 EEF 0 119 73 572 53 941 94 941 102 298 127 995 38 898 38 832 36 367 4
57. No disable std sound No no sound Yes C CH HG HR SG SR Vl Device No Indication Micro default Set Macro default Set LD default Set Fig 101 Select mode 113 6 1 Micro mode Emotions definition The Vibralmage method registers micromovements and spatial fluctuations of object by definition of vibration parameters frequency and amplitude for each element pixel of the researched image With the help of this method it was possible to define that Vibralmage parameters reflect quantitatively characterize emotions and a physiological condition of the person organism Movements and microfluctuations of the person head of in the space classically determined by vestibular system and touch physiology are studied and discussed in comparison to display of vestibular reflexes The person head which is taking place in balance and not making the realized movements can be considered as balance thermodynamic system and the certain part of internal energy changing balance by this closed system is spent for movement as mechanical fluctuations vibration Each emotional condition is characterized by a certain power consumption and the work which is carried out by that system will be transformed to microvibrations if the person stands or sits without movement Parameters of a head vibration frequency in a range of 0 1 10 0 Hz and amplitude within the limits of 10 1000 microns for a stable emotional condition of the
58. Stress and Tension levels YES danger level calculated on base of P13 P14 and P15 parameters values Threshold of a palette for danger calculation only not for displayed image threshold of displayed image define parameter L Value of less brightness considers as black and not used in danger calculation Threshold of a area 1n from full frame square Defines area of active brightness pixels If area of pixels in Vo which brightness more than Level L value less than Level S value than danger parameters in Status window equal 0 Reserved for future use Face detection Detection quality Min size Max size Draw Config Critical level Auto capture image Show N image Sound Susp Sound A Sound S Sound T Maker s beep Reset beep XI X5 90 Face detection Yes face detection mode is used No without face detection Quality of face capture 1 capture one large person face in the frame loading of the processor 1 minimal 4 search of all even small persons face in the frame loading of the processor is maximal Sets in pixels the size of rectangle for search of persons No not draw rectangle around face Yes draw rectangle around more danger single person draw rectangle for all person in frame For non danger person rectangle draw green color but if person suspect level more than Critical level than rectangle draw red color The prog
59. U R e V VI ST ID GR 5 Frame rate In Fast processing Base processing Video Timer Width Height Statistics Fig 50 AR mode SB Vibraimage 2008 04 22 16_16_47 File View Settings Action gt j Me VIS H10 S 10 lt mal mal EX Help D 4 VI Am ws VI ST LD GR 5 Frame rate In Fast processing Base processing Video Timer e Fig 51 AR mode with graphs s 5 Vo AA 1 IntegratedN F t 02 50 02 250 24 T eme t 02 50 PTF 02 50 53 3 3 4 Submenu mode Item Mode Fig 52 selects additional settings of information in image area settings Acton Toolbar Info bar Buttons Graphs Frequency analysis s results Bio Tester results Video window Status window LD window Made 2 Toolbar Preset d Le V d YI c2 d vI 2 d vI 10 Am d VI CIG F d VI M Am d VI M F d DELTA Am d DELTA d View Mode DELTA FA View Mode DELTA mode Am mode F Mouse fn Mouse line Sum line Centre AVI timer Title Fig 52 Menu View Submenu Mode 54 25 Toolbar switches on off toolbar Every item of the given menu for conven
60. a condition of lie NDI For such cases for increase of reliability of lie detection results the parameter Opposite mode Yes it is a mode is recommended for experienced users For the majority of cases it is recommended to use a mode Opposite mode NO but thus the decision on that lies the person whether or not to accept on the basis of the analysis and changes of parameter P5 lie and change of parameter P20 value is deduced in a LD window the Lie indicator and as to supervise changes other important parameters of a condition of the person during the specified time moments Values of system options recommended by default for work in a lie detection mode Stat period 10 s Base period 5 s Lie Threshold 0 Opposite mode No Audio sens 2 s N 100 149 6 3 4 LD information panel settings If you have a sufficient operational experience with a lie detector you can independently make adjustment of numerical values for parameters from Al up to P19 having opened corresponding menu of the information panel Fig 137 LD table columns meaning V Calc Ratel R2 Rate2 R2V RIV R2C RIC Level Current value of parameter Yes LD detection on No LD detection off Weight of parameter if its current value became more than the set base maximum bMax OR became less than the set base minimum bMin Weight of parameter if its current value became more than the set base maximum bMax A
61. ads to load earlier saved data and to compare them with just received In a window with the frequency histogram Fig 42 switch determines will be the histogram of amplitude 15 showed whether or not the diagram 15 show by red color Switch N determines will be the histogram of frequency is showed whether not the diagram 15 show by green color SB Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action o 5 Ay VI AV Am F 810510 73 VI ST LD GR E e vij Vig Vig Frame rate In Fast processing Base processing Video timer i 2008 04 29 12 41 43 Mi 1 798427 i i i i 0 637576 Info i i i i 2 0 408 03 2008 04 29 12 41 43 i i i i 0 378143 i i i i i 5 0 309915 Width i b E 5 Di0 098047 Height i i Statistics IntegratedN Am 3 91590 IntegratedN F 6 38778 Anger 4381 Stress 773 Tension 12 31 Fig 42 Frequency histogram of the person state Each histogram is characterized by the following parameters e the center of weights of frequency distribution average value of microvibrations frequency e root mean square deviation of frequency distribution e a dispersion of frequency distribution 48 To print out the received results user choose a command Print menu File To remove the rec
62. age control shows on Figs 134 138 Figs 128 and 129 captured by the one camera on the ticket control in the same conditions and differ by several minutes It 1s clear visible that one person on Fig 129 differs by colors from everybody persons on Fig 128 and Fig 129 Furthermore this person has more frequency colors in every vibraimage window captured with different accumulation frames number N 5 10 15 This three vibraimage windows give comparative information about person movement amount in different time periods as 0 3 0 65 1 0 second Experimentally it was selected as optimal time interval for informative characterizing of human behavior through macromovements However 138 sometimes specialist with own experience changed this intervals according the concrete conditions and aims It concerns others settings too Profiler or security staff view person during limited time period about 30s in real ticket control and provided testing showed that this time period 15 enough for conclusion Anger stress or nervous person has constantly higher movement activity and differs from the others passengers practically during whole time period Such person could not be so calm and poor color as staff which 1 practically invisible in vibraimaging or other normal passengers Vibraimage lt 20080528113113 avi gt File View Settings Action lt gt VIAN ARD am FOR OYE ST LD ak O
63. arkers have been set VI ST M LD GR Capture max length s purge old files timer stop in Start at stop at Srt save extra info Save XML save XT save save LD Set markers RQ markers COQ markers DB folder Selected record Mew record Fig 63 DB table 55 55 55 Yes No No No 0 Yes No C default Kiselev Dmitry 10 08 1971 Akimoy Valera 12 09 1979 Kiseley Dmitry 10 09 1971 Oleg 18 05 1957 Minkin Viktor 05 04 1959 96 97 3 5 8 Network NW table Network NW table information panel Fig 84 adjusts network monitoring mode and shows the following information Network service sanction of information transfer to network between a computer on which program VibraImage exe 15 started and the terminal Critical level the Threshold psycho emotional conditions of the person at which excess on the removed terminal the warning message will be given and the picture of danger object 1f parameter Full video stream is sent or the video information if parameter Full video stream Y ES will be transferred Local port Vibralmage exe program interrogates the given port for data exchange with the terminal Remote host name of the removed terminal Enable sanction of work with the terminal When system works with several terminals possible to forbid exchange
64. around more danger single person Draw All draw rectangle for all person in frame For non danger person rectangle draw green color but if person suspect level more than Critical level than rectangle draw red color Fig 127 The parameter Detection quality defines quality of persons face capture 1 capture only one large person in the frame loading of the processor is minimal 4 search of all face even small persons in the frame loading of the processor is maximal 135 Parameters Mines size size set the sizes of rectangular in pixels for persons face searching The given parameter is necessary for set depending on concrete medium sized people on the computer screen The parameter Config is intended for loading new algorithms of persons search At installation of Vibraimage program on your computer in the catalogue Vibralmage7 will be created the subdirectory Ocv V in which files of various algorithms of persons search settle down For loading new algorithm it 1 necessary to execute the following actions To stop process of persons search Face detection No 2 In File menu select first item Open Then open folder Vibralmage7 Ocv and choose new algorithm for calculation 3 In line Config appear path to selected file Restart person search process Face detection Yes Vibraimage 2009 10 02 16 49 17 avi OX File View Settings Action He
65. ary to stop record of videofiles For this purpose it is necessary to press the button of the toolbar At end of record and closing of a videofile the button will change 4 color E H10 10 cx LD REC T 0 aw eng S908 EN 4 A VI ARLD Fig 158 Toolbar 3 Then it is necessary to close each of two programs Vibralmage exe 4 Then to make program power off of a computer 5 Items 1 4 repeat for each of 6 computers PC2 PC7 6 Switched to computer 1 If PC2 PC7 have been switched off in windows of VINetServer program there are no images from cameras 7 Close the VINetServer exe program 8 Close the VIFaceMatcher exe program 9 Then to make program power off a computer 10 Switch off the monitor 11 Switch off the switch of computers management Attention the fast power off mode of computers PC1 PC7 15 possible Computers power off is made by unitary pressing of button Power on the obverse panel of computers system blocks 175 7 4 4 The system operating procedure After power on the server computer PC1 in an automatic mode two programs are started VINetServer exe the network application of Vibralmage system e VIFaceMatcher exe the program of the person identification at check on a database of suspected persons The basic working program is the NetServer exe Fig 159 On the screen of the monitor the following infor
66. ation of a 3 dimensial object fluctuation based on vibration parameters can thus be correlated to various mental states such as anger tension ageression etc as well as mood normal states and subconscious reflections Vibraimage can be characterized as one of primary images as visible spectrum such as infrared x ray MRI or ultrasound imaging Vibraimage technology is currently being tested in areas such as terrorist recognition emotional recognition interpersonal video dating interactions as well as for personal use Visualization of every pixels vibration became possible only in 21st century with the development of digital cameras and high power computers Long ago past scientists such as Aristotle had realized that biological object movement parameters characterize emotions thus vibraimage technology is a potential realization of this goal Physiology of movements The direct link between reflex movement and brain activity was discovered in 1863 by the famous Russian physiologist Ivan Sechenov in his publication Reflexes of Brain Charles Darwin in his book The expression of the emotions in man and animals 1872 also declared that reflex movements associated with emotions Nobel laureate and the famous researcher of aggression Konrad Lorenz claims that amplitude and intensity of reflex movements characterized the ageression On Aggression 1966 According to the action of vestibular system functions and mechanical movement
67. ation table For this purpose it is necessary to bring the mouse pointer to the chosen field and twice to click the left button of a mouse In the bottom part of information panel displays three windows with results of the frequency analysis Fig 65 In the first window the frequency analysis vibraimage on the whole frame by red color amplitude green color frequency of vibration pixels is displayed In the second window the frequency and amplitude histograms for external vibraimage aura and in the third spectrums of the frequency analysis with application of FFT of two parameters selected GR submenu of the information panel are displayed 66 15 65 Histograms window 3 5 1 VI table VI table Fig 66 displays the following information Frame rate In Number of the frames per second received from the video source Fast processing Maximum number of the processed frames per second used for calculation Selected by user Base processing Number of the processed frames per second used 1 base algorithm Selected by user Video Timer For camera mode displays time of supervision For recorded video time of current video file record For viewing a video file time from the file beginning Stream errors The counter of mistakes which increases if time between the next accepted frame astably This mistake can arise 1f productivity of a computer suffices or poor quality video 1s loaded 67
68. ator in real time mode a video information and the data on a danger level Note before start of VINetServer program it is necessary to configure system in Config xml and Modules xml files the example 15 resulted below Attention for correct system work in network monitoring mode it is necessary to make adjustment of computers network connections correctly having set them IP addresses 7 1 Network monitoring mode adjustment Before the beginning of operation in a network monitoring mode it 15 necessary to connect a local network computers of local module and the terminal and also to make adjustment of network parameters NOTE if Firewall system of protection is established on a computer it 1s necessary to enable of Vibralmage programs complex Adjustment of local module network parameters is made in the program Vibralmage exe in NW table of information panel Fig 149 It 1 necessary for start l To enable transfer of the information on a network between a computer on which the program Vibralmage exe is started and the removed terminal Item Network service set value of Full video stream parameter If parameter Full video stream NO at detection of the dangerous person which level of danger exceeds the set Critical level limit then on a server will open Video window in which image danger person will be showed In 30 seconds Video window will be automatically closed If parameter Ful
69. attention should be given changes of a signal on the graph of parameter 5 lie which define the most suspicious moments reaction of the person Each question answer it is desirable shared by a time interval not less than 10 seconds is characterized by the level of change psycho physiological parameters of the interrogated person This level 15 characterized by two integrated parameters 5 Fig 146 on graph and parameter P20 in a LD window which states the most quantitative estimation of reaction of the person on a question The above the level of this parameter P20 the 1s more probability of lie at the answer 160 Fi Vibraimage lt 2010 05 19 10_57_28 avi gt m x File View Settings Action Help VE AV ARID Am IPIE Vist AA RAN Frame rate In Fast processing Base processing Video timer 03 10 Info N 100 K 1 00 L 2 00 Width 640 Height 480 Statistics IntegratedN Am 0 40535 IntegratedN F 1 31674 Suspect Aggression Sress Tension Audio UM STL Aa Mene eA IBS Level 0 1 461 70 00 Fig 146 The sample of vibraimage lie detector operation On questions 3 4 5 6 7 system detects lie 6 3 7 Save and load Vibralmage program settings Item Save settings as menu File is used for save of the current
70. blished norm The basic applicability of the given mode is use of vibraimage system for medical diagnostics and psychological researches 114 Value of the averaging period is set in seconds in a field Duration Start of beginning of information accumulation is made by a choice of item Measurement the menu Action or pressing of the toolbar button After start of a accumulation and averaging mode in top of an information column there is a running line Progress displaying a course of data accumulation process M table Fig 102 shows the following information Current values of based processed Vibralmage parameters A1 A4 F1 F8 51 57 P1 P19 Current values of fast processing Vibralmage parameters Al fast A4 fast F1 fast F5 fast e Speed of input frame from the camera FPS 1 speed of frame processing for a base processing mode FPS BP and speed of frame processing for a fast processing mode FPS e Basic parameters describing psycho emotional condition of the person Aggression Stress Tension Anxiety Suspect Balance Charm Energy Self regulation Inhibition Neuroticism M table columns meaning The value of the parameter average for the set period S root mean square deviation of parameter cMin The minimal value of parameter for the period cMax The maximal value of parameter for the period NMin The minimal value of parameter for a normal condition
71. bralmage module Vibralmage module gathers records processes and analyzes electronic images of biological and mechanical moving objects with various frequency and amplitude of vibration fluctuations Main module Vibralmage exe is designed for achieving central Vibralmage software goals Printing of screens is possible from the main menu of Vibralmage module on default printer Printing of personal data and images 15 function of VIPrint module For viewing the recorded LOG files use VILogViewer module Network monitoring is function of VINetStatus module After software installation you will see the image on the monitor fig 14 if you connected camera to PC and adjusted it on person face 3 1 Multifunction window Multifunction window Fig 14 consists of the following parts e main menu e image area e toolbar e information window In heading of the basic window the following information 15 deduced e of video source Video camera or AVI file e model of video source Video camera model or AVI file name e Name of running Vibralmage module 24 Vibraimage 2008 04 22 15 31 38 gt File View Settings Action H10 10 T 1 DD VI AV AR LD Am F R NEN NEN ST LD GR 35 2 Visi Vi A amp E Frame rate In Fast processing Base processing Video timer IntegratedN Am
72. ceeded a limit will be displayed 7 4 4 1 Windows of camera From each of 12 television cameras 1n a separate window the video information the camera name installation position and the current value of a suspected level Fig 160 Depends on suspected level value the color scale can have the different color If the suspected level has exceeded the set limit color of a scale will be red and the image from the camera will be captured in one of capture windows and in the list of events corresponding record will be made Fig 160 Window of camera 177 Fig 161 Capturing suspected person For each camera the operator can change a mode of a information presentation For this purpose it is necessary to bring the mouse pointer to the chosen window to press the right button and to choose corresponding menu item Fig 162 Language Mode Fig 162 Menu for each camera The item Language defines a working language of system The item Lock position fixes an arrangement of a window from the given cameras in the given place of the screen The item Save position save in an external file the coordinate of windows arrangement from the selected camera in the given place of the screen 178 The item Exit is intended for an exit from the program The item Mode defines a mode of video information presentation SRC video without processing see Fig 6 SRC F video from the camera with an overlay freque
73. d Ld k VI M Am d k F k view Mode DELTA FB gt mode Am mode Mouse fn Centre AYI Omer Title Fig 57 VIF mode option A F n VI 10 Am the button lio of the toolbar and VI 10 F the button w of the toolbar modes display vibraimage processed during 10 frames Fig 58 and constructed on the basis of amplitude Am and frequency F vibration analysis It is the additional possibility to change color of a background image and to add aura to vibraimage The same result is possible to receive if to bring the mouse pointer to a window of the chosen image and to press the right button of a mouse Fig 58 P vibr 59 aimage 2008 04 22 15 18 28 avi gt File View Settings Action 2 VIAVARLD Am F R 050 510 sT LD GR 5 a J Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am B 04942 Fig 58 Image area SRC VI IO A and VI N A are switch on For image VI N A additional menu indication A F In VI the button n of the toolbar and VI N F the button n of the toolbar modes display vibraimage processed during frames and constructed on the basis of amplitude Am and frequency F vibration analysis The number of frames corresponding to parameter is set information panel
74. d acts either from a microphone or from a video file Off Audio modulation of vibration If one of these items 15 chosen VibraSound sound will be switch on and will be modulated by curves of signal change in one of frequency distribution windows Fig 87 Letters C H S define from what window the signal for sound will be used C the first window H the second S the third Letters G and R show what color of graph will define modulation of a sound G green color R red color Audio modulation of vibration used green upper histogram frequency vibraimage Audio modulation of vibration used red upper histogram amplitude vibraimage Audio modulation of vibration used green middle histogram frequency aura Audio modulation of vibration used red middle histogram amplitude aura Audio modulation of vibration used green down histogram selected signal spectrum Audio modulation of vibration used red down histogram selected signal spectrum Since Vibralmage 7 2 version at installation of the software are Indication Micro defaults Macro defaults LD defaults 92 simultaneously installed the driver of virtual videodevice VIDeviceCapture Use of this virtual videodevice allows to build vibraimage in any program using video signal from the camera and to see reaction of the interlocutor for example at negotiations on Skype system If to start program Vibralmage and to set in it VI
75. d stabilized detection results Double click on button fixed graphs time equal to the video file period Note for stable work in a Lie detection mode in section Filters of the information panel Bea it is necessary to set parameter FPS filtem YES Note at repeated viewing the same videofile the deviation in repeated values the same parameters up to 5 is acceptable because live video is the same as live object error rate less than 5 is normal For stable work in a Lie detector mode is recommended use personal computer CoreDuo2 3GHz not less than 4Gb RAM or more powerful At such computer speed of input frame from the camera should be equal speed of fast parameters processing FPS in FPS_fast gt 25 30frame s Lie detection in a manual mode usually use if quality of the alive or sound of video unsatisfactorily and it is impossible to separate on a level of a sound questions and answers from extraneous sounds Calculation of a lie level in this mode is made only after a choice of item Start LD block the menu of Action Fig 143 or LD corresponding button of toolbar For end of an interval of lie calculation it is necessary to press repeatedly the same button or to choose the same item of the menu The moment of start on the graph will be marked by a vertical green line the ending of calculation red 6 3 2 Audio level settings in ST information panel NOTE Vibralmage system requests correct adjustment
76. d successfully INSTDRV will display a corresponding message and then return to the main window 4 If the driver installation 15 successful a message box 1s displayed 5 Click OK to continue 6 Close INSTDRV application 7 Restart the system 8 Connect video capture device and dongle to PC 9 Run Vibralmage exe 2 2 3 Vibralmage installation There are two possible types of vibraimage installation manual and auto User could select any type of it 17 2 3 Manual installation It is necessary to execute the following actions for installation of Vibralmage program on your computer 1 Run Soft Vibraimage7Setup msi from CD to install Vibralmage 7 x application Follow to the instructions setup dialog Click Close after installation complete 2 Press button Next the appeared window of the beginning installation 3 Accept the license agreement and to press button Next the appeared window 4 In the appeared window specify a way to the catalogue where files of the program will be written down then to press button Next 5 Press button Next in the appeared window allows installation of software files on your computer 6 Press button Close at the end of installation 7 Vibralmage program pictograms appears after the end of installation in system menu and on desktop of your computer 8 To reboot a computer 9 Install Guardant driver from DVD before start Vibralmage 7 x Co
77. device Yes and to choose device VIDeviceCapture as a source of video signal in the standard program it 1s possible to see in a window of the standard program real vibraimage Fig 81 If in addition to set Indication Yes in a window of the standard program it is possible to see the histogram of change of the basic emotional parameters of the person A aggression S stress T tension D the general suspect level of emotional conditions Fig 82 Switch on Micro mode Use for single men mode Switch on Macro mode Use for multi men mode Vibraimage on real image mode Switch on Lie Detection mode Use for reset users settings and load special settings for lie detection mode File Mal Options Capture Help VIDevice Capture Look 1320 V2 SoundMAX HD Audio I 93 Fig 61 The example a choice of VIDeviceCapture device program AmCap allows to see vibraimage 94 5 Skype Options General Video settings Set up your webcam 8 General settings Audio settings Select webcam vIDevice Capture A Sounds Quem UN Privacy Notifications gt Calls IM amp SMS Advanced Take a video snapshot Webcam settings Automatically receive video from Show that I have video to anyone 8 people in my Contact list 8 only people in my Contact list one one Save Cancel Fig 82 An example supervision of the interlocuto
78. duction Welcome to the Vibralmage World Thank you for your purchase of Vibralmage system This manual is written to help you enjoy vibraimaging and open new features in well known objects Vibralmage technology registers micromovement vibration of person by standard digital web or television cameras and image processing Human head microvibration 15 linked with the vestibular emotional reflex VER of a person and reflects emotions levels Vibralmage system detects human emotions by the control of three dimension 3D head neck movements and fluctuations accumulated in several frames Fig l Amplitude vibraimage of the person Fig 2 External vibraimage around the frequency vibraimage Vibralmage is a new image type and so primary as original color image thermo image or x ray image Each image type gives new and unique information about the object Every pixel of vibraimage reflects vibration parameters frequency or amplitude Fig 1 of vibration One frame visualization of vibration frequency and amplitude named external vibraimage and looks like aura of person Fig 2 Typically external vibraimage colors linked with vibration frequency and external vibraimage dimension linked with vibration amplitude In medical imaging and biometrics Vibralmage 15 a recent psycholgically based emotional recognition visual imaging technology that measures pixels microvibration in terms of digital frequency and amplitude parameters The visualiz
79. easurement txt a text file with results of parameters measurements for the specified period e 2010 06 16 15 42 30 measurementH png a graphic file with the histogram of frequency distribution see Fig 106 saved up for 10 seconds e 2010 06 16 15 42 30 measurementT png a graphic file with graph of person psycho energy conditions changes for the specified period see Fig 107 The circle on the graph shows a point of the information accumulation for calculation of the frequency distribution histogram e 2010 06 16 15 42 30 measurement xml file with results of parameters measurements for the specified period To open a file for viewing and printing the parameters graph and histograms it is possible having chosen item Open menu File 119 Akimov Valera 2010 06 16 15 41 30 2 6 5792 1 5 0 751513 D 0 564772 Fig 107 Change person psycho energy conditions for the chosen period 120 6 1 2 Vibraimage parameters Amplitude and frequency of human head vibrations differs every point of space and total processing of this every point meaning could present integral movement parameter of person Some vibraimage pictures of one person reflects amplitude Fig 108 and frequency Fig 109 space distribution of vibrations are showed below visualized by color scale Fig 110 Fig 108 Frequency vibraimage Fig 109 Amplitude vibraimage Fig 110 Color scale Ba
80. ed frames By default 2 Average number of accumulated frames By default 10 Maximum number of accumulated frames By default 100 Gain factor Threshold of a palette Defines a threshold of displayed image value of less brightness considers as black Parallel number of processing multi core systems Default 0 for Core 2 Duo Filters Removes single points surrounded by black It is intended for reduction of noise of a video camera Delete video noise in bit By default 8 This filter 1s important when the object is motionless and values changed because of camera noise Delete video noise for fast processing Scale normalization filter to a range 0 255 after its trimming by filter Extended At the included mode calculation fast parameters are made only inside of aura contour at switched off on the whole frame Multiplication factor used for vibraimage visualization in a amplitude mode Reduce vibraimage on borders of motionless contrast objects Frame difference D x y is multiplied by the factor K 1 SV MB 100 Color image Crop X Crop Y F6 HF F6 LF F6N FPS filter E Monster 85 where SV parameter of the filter the maximal difference between levels of brightness of a point x y and the next points in the initial image Note Switching off filters accelerate the computer functionality Advanced user could switch filters from default settings Attention sw
81. eived graph of the frequency analysis it is necessary to bring the mouse pointer to the chosen diagram to press the right mouse button and to choose item Delete H10 At a choice of item Start H 10s Start H or pressing of the button simultaneously with accumulation the frequency analysis information is made testing psycho energetic conditions of the person And a mode of viewing of testing of the person condition results Fig 43 is switched on off by the button or a choice of menu item BioTester results The user can be switched between windows with results of testing emotional conditions and windows with results of the frequency analysis The mode of viewing of frequency analysis graph 1 switched on off by the button or a choice of menu item Frequency analysis results i Vibraimage VIDEO Eye 311Q gt File View Settings Action H10 S10 T10 LD Cie gt La Am F R Ww mad mad 7 mae ST M LD GR 5 T gt A ALA A Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Suspect Aggression Sress Tension Audio Level Fig 43 BioTester results view mode Initial state The point on the graph displays the current psycho energy condition of the person On axis Y the mental condition of the person 15 displayed in 96 if
82. er Sress Tension Fig 131 Suspicious aggressive passenger on luggage control It doesn t mean that vibraimage macromovements control is absolutely simple and every red person in vibraimage pictures is potential danger On the Fig 132 shows staff that moves fast and of course looks red on the fast vibraimage window with accumulation frame number equal 5 141 Vibraimage lt 20080528113113 avi gt File View Settings Action avi gt AV ARLD am 8259 0 DER eM wl A A Frame rate VI 2 A 5 01 18 In Fast processing Base processing Video timer Info N K Height Statistics IntegratedN Am IntegratedN F Anger Sress VI 10 F 19 01 13 Fig 132 Fast moving person looks red in the fast vibraimage window Usually it is not very hard task don t pay attention for the fast moving personal but sometimes fast moving people could trouble crowd control In difficult situation it is possible to pay attention to standard parameters calculated by vibraimage system and described for microvibration analysis Anger level calculated for Fig 132 shows only 55 it is lower than in any other shown figs Every team of specialists in profiling or aviation security develops own instructions for operation with vibraimage system corresponding to their aims Operation statistics of vibraimage system application in airports calculates that about 10 of passengers diffe
83. era used for surveillance and or object on which the camera 1 established should be motionless and have no vibrations more than 1 mkim s Vibraimage and processing parameters depend on camera vibrations so unstable camera position could have influence on and gives errors in processing results 15 2 1 4 Settings Vibraimage recommendations For adequate registration person vibraimage is recommended to take into account the following factors 1 The object person should be well and uniformly illuminating also preferably black and white image of the person should be precise and contrast As vibraimage depends on microvibration registration so reflected light optical flares glare and low light exposure of object can deform received result dramatically 2 This version of the software is designed for visualization of external vibraimage aura only for one object in the frame therefore the moving objects which are taking place near to the basic object of research can essentially influence and deform aura of the basic object Vibraimage visualization 15 carried out without high dependence from quantity of objects in the frame 3 There is a certain delay between vibraimage parameters of the person and visualization of live video on monitor The time of this delay basically 15 defined by chosen time of frame averaging For example if real speed of system 5 f s and chosen time of accumulation of 50 frame the objective vibraimage
84. erson 127 Brief aura form analysis e Any aura asymmetry form color characterized deviation from mental or physiological norms e Any breaks in aura uniformity characterized deviation from mental or physiological norms e Ideal aura has mono color symmetrical and uniform Any real aura differs from ideal and the question of interpretation 1s to characterized real aura deviations Note This brief aura interpretation correspond default vibraimage system settings and based on main rules for right vibraimage scanning uniform and stable object illumination high quality and low nose camera application frontal plane object before camera maximum facial image size on monitor mechanical stabilization of camera Detail description of recommended vibraimage adjusting includes in previous parts of this document 6 1 4 Frequency histogram Frequency histogram shows head movement frequency distribution for every pixel and for accumulated time period default time period 1s equal 20 seconds Some real samples histograms coordinated with emotions and energy levels are printed in this point Figure 112 shows distribution histogram for person normal conditions both graphics approximately looks like normal Gaussian distribution On Fig 113 we see un normal human states up graphic shows person with low energy level very tired and down graphic shows high energy emotions anger 123 1 4 69426 5 1 13303 Mz2 4 6500
85. es frequencyA fast A4 fast F1 fast F5 fast Test signal sin 2 P1 nt Audio level for last seconds and audio level 25 fps for 1 25 seconds Vibralmage parameters X1 X5 which calculation 1s set by the user GR table columns meaning Ve Show Current value of parameter Show graph Yes delete graph No Diff mode Choice of this mode Y ES graph will show difference between current value of parameter and its average level for Diff time Choice of this mode NO graph will show current value of parameter gMin Defines the minimal value of parameter shown on the screen gMax Defines the maximum value of parameter shown on the screen HF flt The filter of high frequencies on Battervort Frequency of a cut is set in from entering graph frequency LF flt The filter of low frequencies on Battervort Frequency of a cut is set in from entering graph frequency GR table graphs color marks indication 81 Graph shows in image area For convenience of observing a line of parameter will be marked by rose color Fig 75 Graphs doesn t show in image area Selected parameter displays in down spectrum histogram by green graph Fig 74 5 Selected parameter displays down spectrum histogram by red graph Fig 74 Parameter doesn t displayed by graphs Fig 74 Selected parameters spectrum VI ST LD Diff made gMin Diff mode gMin gMax ll inteorated am Sh
86. eter P14 defines in excess of 133 the area of active vibraimage points above the set threshold of active point Level S So if the number of active points grows value of this parameter too grows also a level of danger increase Parameter P13 characterizes shift of the histogram to the right in area of high frequencies So that parameter defines primary color of active points of vibraimage Vibraimage 2009 10 02 16 49 17 avi File View Settings Action AV Am E SSS M VI ST M D GR Audio Manual Auto Compare AVG filter Aggression Stress Tension Suspicious Macro mode level L level 5 aura mode macro mode Face detection draw Alerts Critical level Auto captute image s Sound Susp Sound Sound S Sound T marker s beep reset beep X1 x2 un VI VIS VII VIS VIE E gt Yes 3 SRC F 00 18 No No Off 10 10 10 10 Yes 150 5 No Yes Yes Yes 60 00 0 No 0 0 0 Fig 125 Work of system in mode Suspect level of person more than Critical level For convenience of the operator section Alerts of the panel Fig 125 the following additional parameters are entered 1 Critical level sets a threshold of danger level at which excess the person is considered
87. eters and research results are below 121 This item gives some recommendations and samples for human emotion control realized by vibraimage system Note Default system settings coordinate with the following human parameters for normal state e Level of aggression Vo no more 75 e gt Level of stress no more 80 e Level of tension no more 60 e Level of potential danger no more 60 e Level of lie no more 30 Recommendations for human emotion recognition are given below 6 1 3 Vibraimage visual interpretation Vibralmage system gives different technical possibilities for emotion recognition but typical users prefer to characterize person by external vibraimage or aura on real image Aura based on vibraimage allows clearly and visually demonstrate emotions and physiological state of human being Short interpretation of aura colors and forms follows below This short information does not limited but only gives to user the main directions of person analysis Every user after application experience could greatly diversify extend and intensify knowledge about mental and aura of individual Red activity and aggression color 25 on Yellow trouble and tension color Green normal activity and top condition color Blue rest and calm color Violet tiredness color Fig 111 Brief aura color interpretation Aura colors irregularity and non uniformity characterized unbalanced state and character of p
88. events and display the image of suspected person in a control window Viewing of pictures of all people captured by system during work can be executed in a folder Logs displayed on a server computer desktop Note All slipping mode on computers must be switch off 7 4 2 The order of system starting At power on system it is required to execute the following order of actions 1 Switch turn to power 2 By turns to power on computers PC2 PC7 3 Power on the monitor 4 After 30 seconds to power on server computer 5 From the keyboard to enter the password 00000000 for access to the switch then press button Enter 174 6 To see on the monitor screen occurrence the images from television cameras K1 12 7 4 3 The order of power off System power off is done consistently for each of computers On the screen of the monitor it is possible to display the information from each of 7 personal computers For switching between computers on a circle from PCI to PC7 or on the inversion from PC7 to PCT it is necessary to press quickly consistently the following buttons of the keyboard Scroll Lock Scroll Lock or For system power off it 1s required to execute the following order of actions 1 Being switched between computers to display the monitor the information from one of 6 computers PC2 PC7 2 On each computer 2 Vibralmage exe programs are started In each of programs it 1s necess
89. fast change with the switch on filters F6 HF and F6LF Averaging of changes of the Flfast Alfast signal period is made in interval F6N frames 39 Note items menu Start 10s Start T 10s and Start S 10s have corresponding buttons the Toolbar NOTE each time when the window with frequency histograms is caused the system forms a text file with extension hist in which for each value of parameter on line X from 0 up to 255 enters the name corresponding values of amplitudes of graph of distribution of amplitude and frequency and also results of mathematical processing of these data The user has an opportunity independently to define the catalogue where these data will be stored In a window with the frequency histogram Fig 32 switch determines will be the graph of amplitude histogram is showed or not the graph is painted by red color Switch N determines will be the histogram of frequency is showed whether or not the graph is painted by green color Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action o H10 10 LD CNN VI AV Am mm vi ST D e Frame rate In Fast processing Base processing Video timer 09 14 Info 100 P i H P 1 00 i 2008 0429 12 41 43 2 00 i i 0 378443 z i i i i i i 1 E 10 309915 Width 640 4
90. frequency histogram and low meaning of this parameter usually indicates normal state so high meaning of this parameter could be correlated with lie P5 indicates Lie level auto calculated for selected parameters in Default settings for Lie indication need to have significant changes at least in 8 vibraimage parameters typically in Lie detection system registers significant changes in 12 or more parameters given in Lie Report It 1s impossible to register lie only by one or two parameters changes this 1 like fingerprint biometric identification only totality of several parameters give reliable lie detection Audio level directly does not use in lie detection but the selection of Audio threshold formats time level for start and finish of lie detection in Audio mode so it is enough important for visualization and correction by expert P20 Quantity indicator of a degree of change psycho physiological parameters in view of various factors of the importance of measured parameters since the part of parameters 1s accelerated and others are slowed down during one reaction 155 6 3 6 Lie detector begining General switch on of a lie detectom mode is made through item Enable the information panel or with the help of button on toolbar or with item Preset of View menu Vibraimage lt avi gt File View Settings Action avian VI Am F 230 T0 72 y VI ST M LD GR
91. g Fig 151 the flag Sounds is established than occurrence of a window with the image will be accompanied by a sound signal NOTE that the operator working on the computer terminal can remotely change network adjustments of the Vibralmage exe program started on a local computer For this purpose in a window of Setting Fig 151 it 15 necessary to choose a line of parameter which numerical value is allocated by green color and double click of a mouse to pass in editing mode of parameter value Thus the user can change values of parameters number of the averaging frames N factor of amplification K and a threshold of palette L 169 Firewall Kell Uvisions Hobe HOOD Acrobat Ae 40 791 A FAR manager DC USB Devices Microsoft Word EN 6 2 Fig 154 Emotional danger level exceeded the threshold limit equal for example 40 The additional window displays 170 7 3 IP camera support Vibralmage system allows to receive the videodata and from network IP cameras The reference to IP camera goes through HTTP request as http User Password Host Port Url For example http user 12345 192 168 0 20 80 mjpeg cgi Therefore before the beginning of work with IP camera it is necessary for you to address to the your local network administrator and to obtain from him the following data on the camera which is connected in your net
92. hange LD parameters graphic value shows b Value of parameter 15 considered for detection Value of parameter doesn t considered for LD detection 77 VI GR ET gt A1 fast Calc Ratel Rate2 Level Calc Ratel Rate2 Level p 2 Calc Ratel Rate2 Level p Calc Ratel Rate2 Level p gt A4 Fast Calc Ratel Rate2 Level p A4 Calc Ratel Rate2 Level gt F1 fast Calc Ratel Rate2 Level Calc Ratel Fig 72 LD mode of information panel 78 Vibraimage 2009 07 01 13_03_49 avi gt File View Settings Action AVI aN DD AV ARID Am F R br VEM AES N EZ T9 Wf VI ST M LD GR 6 E Rate2 Level gt 51 Calc Rate1 Rate2 Level 52 Rate1 Rate2 gt 53 Calc Rate1 Rate2 Level gt 54 Rate1 Rate2 Level gt 55 Calc Rate1 Rate2 Level 2 00 0 00 Yes 1 00 2 00 e Mig MY t gt 1 TEE 52 t 36 00 bM x ze Stat period for parameter S2 Rate2 2 Fig 73 The explanatory to parameters R1 R2 79 80 3 5 5 GR table m GR table Fig 75 displays the following information Vibralmage parameters A1 A4 1 8 51 57 P1 P19 Total frame difference accumulation without filters for 2 10 and N the frames Integrated Parameters Vibralmage parameters with maximum fram
93. he level of audio signal red strip and change of input audio signal options in a corresponding field of information column in ST mode Fig 140 141 Level of audio signal the red strip 1s necessary to stand so that it was on the average position between the minimal value of a input signal which corresponds to silence in a room see position of green strip on Fig 140 and the maximal value which corresponds to a voice sound of a person in front of the camera Fig 141 24 NOTE System Vibralmage correctly works in a lie detection mode only when adjustment of input audio signal procedure of adjustment see above 1s made The moment when the person started to speak is used by system for the beginning analysis of the data Vibraimage parameters during speaking are compared to the data received earlier for example when the person was silent The menu Language contains the list of supported languages Fig 22 Sige Acton Video d Audio d Language 2 Engish Record group d Video mask d Capture channel Skype mood Fig 22 Submenu Language Submenu Record group Fig 23 allows to choose the number of the catalogue where video files will saved NOTE The direction to the catalogue should be set beforehand Settings Acton Video Audio Language d Record group 2 v Default Video mask 1 Capture channel 2 3 Skype mood 4 Fig 23 Submenu Record group
94. histograms accumulation Time in seconds for down histograms spectrums accumulation fig 79 Reserved for future use Define histogram calculate mode in two top fields of a histograms window see Fig 79 The user can compare the frequency distribution of vibraimage to one of base distribution laws 0 Work mode histogram calculate on base of real video image analysis 1 displayed EXP law of distributions 2 the normal law of distributions 3 the uniform law of distribution 4 single peaks 5 SIN signal Factor n defining period of Sin graph generated 88 Integrated Amn 3 53 50 50 00 35430 135189 i i 1 000 fast t 3 53 50 io 10 00 78 Graph and mmi mode Fig 79 Histogram window Lie detection Enable Enable LD mode Stat periods Time period of normal person condition before LD testing Compare periods If the user has not executed start of accumulation of the information during the period of comparison than after beginning of a lie detection mode the system as the period of comparison will use the information saved up for the specified number of seconds directly till of the moment of lie detection beginning Lie threshold Threshold for the detection of lie level in view of every calculated parameters and their weights Audio sens s After the ending of answer the system continues to expect calculation during
95. ience of user are duplicated in the additional panel of toolbar Fig 53 A F A F A F A F A F Vo 9 Fig 53 Additional toolbar NOTE Pressed buttons in toolbar correlated with windows the area of images The maximum number of windows equal 13 Fig 54 To delete a window with the set image processing it 1s enough to let off the corresponding button the of toolbar panel Vibraimage VIDEO Look 1320 V2 File View Settings Action 4 VI ST LD GR Fast processing Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Fig 54 Simultaneous output of several windows with the different image processing 56 NOTE In the left top corner of a window could be indicated the Title of the given image processing mode Fig 55 ri Vibraimage lt VIDEO Look 1320 V2 File View Settings Action Help o H10 S 10 LD mi 5 Sg Am 1953172 QD TER FX Au ti LI EK VI ST LD GR ge e lad VI V V V A Frame rate In Fast processing Base processing Video Timer 03 07 00 Info Width Height Statistics 5 Fig 55 Several images simultaneously presented in image area Modes of SRC Aura and VI 2Am are switched on 57 SRO mode the button of the panel of toolbar shows sou
96. in that case when as a source of the information is external AVI a file Simultaneously with record of a new videofile the text file with lie detection results and system settings will be generated ST M LD GR Capture max length s purge old files timer stop in Start at stop at Save src save extra info XML save XT DIF LD DB folder Selected record Mew record 30 Yes No HH MM SS HH MM SS HH MM SS 0 Yes default Kiselev Dmitry 10 09 Akimoy Valera 12 09 1979 Didenko Tatiana 01 01 1958 Kiseley Dmitry 10 09 1971 Martynav Oleg 18 05 1857 Minkin Viktor 05 04 1959 Fig 148 DB information panel 162 Note The detailed analysis and technique of work the psycho physiological lie detector with the help of Vibralmage system leads in the special supplement to the given description 163 7 Network monitoring In Vibralmage system the opportunity of a network monitoring mode complex is realized The basic program Vibralmage exe 15 started on the local computer with the connected video camera On the terminal the module VINetStatus exe or VINetServer exe are started which informs the operator of the terminal about the objects controlled by local PC 1 The VINetStatus exe module informs the operator only if the system has fixed excess of the set threshold values of suspect dangers 2 The VINetServer exe module gives the oper
97. indow Status window LD window Mode Preset v v v v v v mace as Print Image capture AVI Start capture File VIDEO Pause VI AM AR LD mode Am mode F Reset Graphs start H 105 Start 5 10s start T 105 Frequency analysis s results BioTester results Start LD block Start LD compare block Reset timers Measurement Question R Question C Question G Fig 17 Submenu Buttons 28 29 x LER 9 Am F 275225 ST LD GR e fad Me Frame rate In Fast processing Base processing Video timer 2 A 2 aid Info PrOTeSSII 2 3 ii 2 2 Width AGIODO 18101150 Height 480 5 es ternet SOSIE EBONE 52 W Gc Paint Microsoft Word DCTest 00 The Bat Total DAEMON Tools
98. inued i ments of law have been complied with and it 73 Assignee 000 MP ELSYS Saint Petersburg FOREIGN PATENT DOCUMENTS uL has been determined that a patent on the in RU di Ra GRE vention shall be granted under the law Notice Subject to any disclaimer the term of this 0488721 Al 61992 patent is extended or adjusted under 35 ure ates eo Therefore this U S C 154 b by 653 days RU 1 0 United States Patent 22 PCT Filed 14 2001 dictionary of IEEE Grants to the person s having title to this patent 86 PCT No PCT RUO1 00545 aiii rd M 0 tic 0 the right to exclude others from making using 371 74 Attorney Agent or Firm Birch Stewart Kolasch amp offering for sale or selling the invention 2 4 Date Feb 20 2004 Birch LLP throughout the United States of America or im 9 PCT Pub No woowsiiss 57 ABSTRACT porting the invention into the United States of and America for the term set forth below subject PCT Pub Date Jun 27 2002 tyding imaga of Slag inks to the payment of maintenance fees as provided 65 Prior Publication Data provided The Biometry detects the objects which produce insignificant periodical oscillations thereby making it pos by law US 2004 0131275 Al lul 8 2004 sible to receive and analyze the images of the objects on a If this application was filed prior to June 8 30 Foreign Application Pri
99. iple of zones of comparison entered C Bakster it 15 simple enough for understanding and allows each person to precisely enough define the truth and lie even at presence of the minimal experience in work with Vibralmage system Vibraimage system makes measurement and the analysis in time more than 40 independent parameters describing an emotional condition of the person The standard method of definition of lie 1 based on an estimation of emotional reaction of the person on the put question In an operating time the operator marks on graph CQ questions Control Question RQ questions Relevant Question and GQ questions General Question pressing on the same buttons RQ GQ on the toolbar at time of the given questions After the ending of the test the operator can check results of work in a special created file At work in a lie detection mode in an information column 15 set the interval Base periods in seconds during which the system collects the data on object of research accumulates the information for definition of allowable limits of current parameters values change that then at lie detection to define abnormal change of separate parameters If value of parameter during time of Stat period exceeds the set limits it is taken into account at lie level calculation with the certain factor weight Rate the given parameter 6 3 1 Before starting For correct PDD lie detection by Vibraimage system 1s reco
100. itching off below parameters calculation could automatically stop calculation and sets of other characteristics which used values of the switched off parameter No Black and white real image image area Yes color image image area If real image size more than 640x480 pixels than will be use only 640x480 pixels from centre part of image Sets in frequency of a cut for the filter of high frequencies at processing F1 fast parameter sets 9o frequency of a cut for the filter of low frequencies at processing F1 fast parameter Number of averaging frame at calculation of F6 parameter It is used for exact synchronization with a binding to the concrete frame at work with Avi files Frequency of the input frame from the camera divided on set Base processing frequency and for processing will undertake each N frame Switch to the E monster mode The program opens the person face deformed by latent emotions though externally he can constrain these emotions If the emotional condition of the person 1 like to normal then the the program image 15 like to real video Accordingly than more emotions overflows the person then more especially deformed his image in Monsters Detector mode E Monster Auto downrate Disable Am Disable F Disable 2x Fast Disable VI 10 Disable VI 2 Disable FFT Disable Entropy Disable Audio 86 Fig 77 Face E monster mode Automatic calculation of Downrate parameter is
101. l video stream Yes Video window a server video from the camera 15 continuously displayed 164 3 To set type of video information compression by transfer on a network If the parameter Compression is equal are transferred JPG format picture 2 PNG format picture 4 To enter a name of the removed terminal Item Remote host 5 To enable work with the chosen terminal The item Enable 6 To establish the network address of a computer of the removed terminal on which the program VINetStatus exe is started Item IP 7 To specify number of port through which the application of Vibralmage system started on the local module and the terminal will communicate Local TCP port the program Vibralmage exe will interrogate the given port for data exchange with the terminal TCP port UDP port ports for software of terminal through which it 15 changed by information with the computer on which started program Vibralmage exe Through UDP port goes an exchange by short messages Through TCP port goes an issue video data 8 To establish Critical level emotional threshold state of the person at which excess the warning message will be given out on the removed terminal and the picture of object of research is sent VI ST M LD GR amp 35 Network service No Critical level 96 60 00 Full video stream No Compression 1 Local port 5220 Remote host 1 enable No IP 127 0 0 1
102. lp e H10 10 110 LD AEC T 0 9 Mi MVEA ARID Am 0000 m 08 VI ST M LD GR 6 m ET e VIV MN AA A A m Audio SRC 01 09 Manual Auto Compare AVG filter Aggression Stress Tension Suspicious Macro mode level L level S aura mode macro mode Face detection draw Alerts Critical level 96 Auto captute image s Sound Susp Sound A Sound S Sound T marker s beep reset beep x1 x2 Status a working window with Source video mode 136 c Pp B 2 Ns b saving information about interesting person in BMP file Fig 127 Recommendation for working mode 6 2 3 First start and settings determination Control status level window during the statistics period Based on the aims of Vibraimage Macro Mode change or leave default settings for levels L and levels S in macro mode settings Standard aim of vibraimage macro mode control is to indicate situation with movement value in frame more than threshold For example we control entrance of 100 persons through controlled place 50 persons has status level during macro mode control less than 50 80 persons have status level less than 55 90 person has status level less than 60 and only 10 persons have status level more than 60 That means if we want to indicate 10 of crowd differs from middle in this case default settings with alarm threshold 60 are ok B
103. mation is displayed e From each of 12 television camera displayed video and the current danger level A window of the control The list of events Photos last 4 found out people which danger level was exceeded with the set limit Real video from 12 TV cameras lt pl Cam 7 Moskov 1 lt X S Cam_4_Ligovka_1 0 0 2 8 Moskov 2 H f 7 10 LEURS UELUT am 3 Ligovka 11 05 20 11 34 40 P m HSS Cam 4 Ligovka 11 05 20 11 27 09 am 4 Ligovka 11 05 20 11 34 12 t am 4 Ligovka 11 05 20 11 21 20 m NES T Ww f gt 4 ja 4 gt Cam 11 Lift 1 15 Cam 1 out 0 0 Cam 12 Lif 2 tc VIF aceMatcher un A Control window List of events 4 capture window Fig 159 VINetServer main window 176 In the Control window the following information be displayed e The video data from one of the 12 cameras For this purpose it is necessary to bring the mouse pointer to a window of the chosen camera and to click the left mouse button e Detection of suspected person in a control window the picture of last captured person 1s automatically displayed e For monitoring procedure the operator can choose record of one of the registered events in list of events to click above it the left mouse button and in control window the photo of the person which danger level has ex
104. mended to use a Source video viewing mode Fig 127 a then if suspect level of person excess Critical level and value of Auto capture image parameter not equal 0 an external file in the specified catalogue the image will be saved Fig 127 b allowing to identify the person 8 Control more colored person by the other means if status level is more than stand threshold and program gives alarm signal 6 2 4 Crowd control After software adjusting user need to select right camera and lens view for crowd control It is recommended to place camera so that every controlled person stands approximately on one distance from camera That means inadmissible to compare people stands on m and 10 m before camera but distance from 10 till 15 m 1s admissible for control Vibraimage shows movement amount and person with more high movement amount marks by the warm colors based on standard vibraimage scale from more still around Vibraimage 7 x software window allows observe persons in different mode on one display so specialist could analyze person behavior with source image and several vibraimages that greatly raise informative of psychological analysis Of course staff needs to receive some experience of manual analyzing because it 15 necessary to compare people performing equal movements for example standing with standing giving ticket with giving ticket moving luggage with moving luggage and so on Several pictures from tickets and lugg
105. mmended to take into account the following factors and conditions 1 The image of the person should be high quality the maximal facial size preferable and face position must be in the center of the screen For camera horizontal resolution across 640 pixels the person face should be not less than 200 pixels In Fig 1 shows the example of correct person position frame is displayed 2 The object person should be well and stable illuminated also black and white preferable or color the image of the person should be precise and contrast As lie detection depends on detection of the microvibrations and the object micromovements fixed in reflected from object light therefore poor light exposure of object can increase error rates On example of Fig 133 brightness of a background 143 1 is uniformly and contrast to person Brightness of person face 2 1s also uniform from left to the right Natural illumination of object can be used if speed of natural light changes does not exceed 1 lux sec Illumination of object by fluorescent lamps with illumination in the range 400 600 Lux in object plane is preferable ax 1 Vibraimage lt v2 avi gt File View Settings Action 2 1 AV ARID Am Hib 810 5 DOM Fy 0 VI ST M LD GR function sin t 2 pi n LD s global Enable Stat period s Base period s Lie th
106. n an additional window of Settings Fig 151 the operator can observe as parameters of system vary in time e In Number of the frame in a second received from the video device e Fast processing Number of the processed frames in a second for calculation of fast parameters e Base processing Number of the processed frames in a second e N Current value of parameter number of the frame for averaging User can change this value e Current value of parameter factor of amplification gain Intensity of a point is multiplied on K 10 User can change this value e Current value of parameter threshold of a palette Defines a threshold in the displayed image value of brightness less considered black User can change this value 168 e Width and Height displays the current resolution of video camera e IntegratedN Am Average frame amplitude vibraimage intensity processed for the N frames e IntegratedN F Average frame frequency vibraimage intensity processed for the N frames e Anger Level of anger e Stress Level of stress e Tension Level of tension level e Level current level of audio signal Additional window with person real image appears on terminal screen if an established parameters limit 1s excesses Fig 154 This window will be automatically closed in 5 seconds but only if the flag Images 15 set up NOTE that if in a window of Settin
107. ncy vibraimage Fig 163 VI N F it is displayed on a black background Cam_6_Moskov_0 0 0 Fig 163 Frequency vibraimage 7 4 4 2 The list of events and captured windows If the person s suspected level fixed by one of camera exceeds the set limit then the following actions are automatically done 1 The photo of the person 15 fixed in Control Window The suspected person is allocated with a red rectangular 2 The photo of the person 15 added in top of four Capture Windows 3 In List of events record which contains the information 15 added what camera and when the dangerous person has been found out 4 If check of a photo of the suspected person on the Database has come to the end successfully in List of events the additional information about identified the person will in be displayed Fig 164 179 11 05 19 12 55 56 Akinov VA 11 05 19 12 55 25 Fig 164 The object is identified 180 7 4 5 System configuration Attention systems configuration is authorized only to advanced users Casual changes in a configuration can break serviceability of system The configuration of system 15 set in config xml and modules xml files taking place in catalogue VINS All changes in files are made before start of VINetServer program If configuration files are not present at start program VINetServer by default displayed the single wind
108. ngs Action Gs p VIAVARLD Am 55775 VI ST LD GR e A A Frame rate In Integrated N F t 3 55 50 Fast processing i o bw i i Base processing m Video timer Info 100 1 00 2 00 Width 640 Height 480 Statistics IntegratedM Am 8 75422 IntegratedN F 9 60600 4 0 00 i Anger cl NNNM lt t23 55 50 P7F t 3 55 50 Fig 47 VI mode with graphs Fi Vibraimage lt VIDEO Look 1320 V2 gt DEAR File View Settings Action 10 10 LD VIAVARLD Am FO 854 4 2 VI ST LD GR 5 e me e V V VIS Frame rate VI N A 100 In Fast processing Base processing Video Timer Info Width Height Statistics Fig 48 AV mode Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action e H10 S10 gt LD E52 9 VIAVARLD Am 11951072 VI ST LD GR E e C VIZ VS A A Frame rate E E IntegratedN F t 08 00 Fast processing 143 2 Base processing 51 Video Timer Tr Info L a i t 08 00 Width Height Statistics Fig 49 AV mode with graphs ti Vibraimage 2008 04 22 16 16 47 File View Settings Action o E
109. nnect dongle to USB port of computer and start Vibralmage exe Note Auto installation for every system component is made according to the recommendations specified in section 2 4 of this description 18 2 4 Auto Installation 1 Check System Requirements NOTE check the version of DirectX software on your computer 2 Close other applications 3 Insert your DVD Vibralmage7 x into DVD ROM The file of installation autorun exe will be automatically started If the file has not been started start it manually 4 Choose language of installation in appeared window Fig 10 Fig 10 Language selection for installation procedure 5 Further in the appeared window will be offered to begin installation or to read the system documentation Vibralmage 7 SHE Install Software Back Exit Fig 11 Installation window 19 6 You can read system documentations in Information window Fig 12 Vibralmage 7 EXE Articles _ 9 lt Documentation Presentations lt References gt Video C Highlights gt Back Exit Fig 12 Information about Vibralmage 7 It 1 necessary to execute installation of 3 components for system installation Fig 13 Digital camera drivers It is not necessary if you use your own preinstalled digital camera Guardant Driver to install this driver you need have the rights of administrator Vib
110. nt Number of the pictures simultaneously displayed in capture windows 7 4 6 Work with a database Note the software for work with a database is not included into the basic Vibralmage installation complete set and demands installation on a computer the additional software for persons identification Therefore before the beginning of work it is necessary for user manually to create structure of database catalogues and also to copy in the catalogue Vibralmage7 additional files for persons recognition For updating a database of suspected persons it 1 necessary to execute the following steps 1 2 To transform an initial file with a photo to a graphic file of JPG format To rename a file having specified in a name of a file a surname of the dangerous person ONLY English letters and without blanks To copy a file in the catalogue Face Base To start the program VIFaceMatcher exe At successful processing a photo file in the specified catalogue the system automatically will add a new file with expansion TMP and the file with expansion JPG will be automatically removed Attention if the given actions will not be executed by system then the initial file with a photo 15 unsuitable for its add in a database and demands replacement of a photo All correctly processed JPG files move to subdirectory Pass Files which are unsuitable for recognition move to subdirectory Fail 183 8 Maintenance service and service regulati
111. ntains a specific application file for complete search history 6 Claims 4 Drawing Sheets reference to an earlier filed application or ap plications under 35 U S C 120 121 or 365 c al 1 the term of the patent is twenty years from the date on which the earliest application was filed subject to any statutory extensions WD ate Director of the United States Patent and Trademark Office AM M M Fig 7 United States Patent US 7346227 Fig 8 United States Patent US 7346227 1 page 1 Useful information 1 1 Basic applications Human emotions control system further system Vibralmage intends for registration analysis control and research of human emotion state for different applications in the fields of security biometrics psychology medicine electronics and human life Vibraimage is a new technology so welcome to be the first and to discover new pages in vibraimaging and human emotions 1 2 Operation conditions The system provides serviceability in conditions of influence of external factors Do not store or use the system any of the following locations Humidity above 90 at temperature above 35 Exposed temperature below 10 or above 40 1 3 Specifications 1 3 1 Vibralmage system data Resolution TVL more than 400 Noise level of Vibralmage bit less than 0 1 e Frame speed frame sec more than 12 e Frequency range Hz more than 0 1 10 10
112. nter 15 active if its brightness move than Level L value Compatibility for 2 person Calculated on frequency histogram analysis concurrence with normal distribution Fig 69 70 Compatibility for 2 person Calculated on aura symmetry analysis Average compatibility Suspect level Quantity indicator of a degree of change psycho physiology parameters view of 74 various factors of the measured parameters importance since the part of parameters is accelerated and others are slowed down during one reaction Fig 70 Incorrect position of people at check of compatibility 75 3 5 3 table In a mode an information column Fig 71 allows to control average for the period parameters value of psycho emotional person conditions and their deviation from the established norm The basic applicability of the given mode is use of vibraimage system for medical diagnostics and psychological researches Value of the averaging period is set in seconds a field Duration Start of the beginning of information accumulation is made by a choice of item Measurement the menu Action or pressing of the toolbar button After start of accumulation and averaging mode in top of an information column there is a running line Progress displaying a course of data accumulation process M table Fig 71 shows the following information Current values of based processed Vibralmage parameters 1 4 F1 F
113. o the right changed pixels inside the object in 2 consecutive frames Difference between the left and right average amplitude of object vibration in 10 frames Difference between the left and right average amplitude of object vibration in N frames Ratio of the changed pixels quantity in the left part of object to the changed pixels in the right part in 2 consecutive frames Ratio of the changed pixels quantity in the left object part to the changed pixels quantity in the right object part calculated in 10 frames Ratio of the changed pixels quantity in the left object part to the changed pixels quantity in the right object part calculated in N frames Difference between the maximal frequency of vibrations of the left and right object parts in N frames The group of parameters P1 P20 registers features of mathematical Processing of vibrations 72 P1 2 P3 P4 P5 P6 P9 10 PII P12 P14 15 P16 P17 P18 P19 P20 Dispersion of vibration density for frequency distribution at 10 processing frames Dispersion of vibration density for frequency distribution at N processing frames Center density distribution displacement of frequency at 10 processing frames Center density distribution displacement of frequency at N processing frames Level of lie Level of stress P6A calculation of parameter 15 executed on vibration amplitude P6F on vib
114. of the beginning place of viewing it is necessary double click by the mouse left button to note this place On the chosen place the marker a vertical line of green color Fig 94 will be established and the system will pass to a mode Pause Start of system is carried out by button Play 108 5 1 menu Menu File Fig 95 consists of the following items View Acton Open Print Print preview Print setup 1 2008 04 2215 18 28 2 2008 06 17 14 18 41 Exit Fig 95 Menu File The item Open is intended for a choice and opening of results file It also can be replaced by the corresponding button of the toolbar The item Print prints out graphs from area of supervision The item Print Preview used for preliminary viewing listing The item Print setup used for a choice of the printer and settings printing parameters The item Exit used for exit from the program Menu View Fig 96 consists of the following items rm Action Toolbar Zoom out Ctrl Zoomin English Fig 96 Menu View Toolbar switch on off the toolbar Language select current interface and help language Use items Zoom In Ctrl or Zoom Out Ctrl to zoom in zoom out the image in the printing area for example compare scale of graphs see Fig 94 and Fig 97 Items also can be replaced by the corresponding toolbar b
115. of the information accumulation some lines of an information column can be allocated by color parameters which values less than the set limits are allocated parameters which values more than the set limits are allocated Note in Fig 71 frequency of input frame from the camera FPS in less than the set limits and is allocated by color For correct diagnostics psycho emotion conditions of the person speed of data input from the camera should be within the limits of 25 30 frame second 3 5 4 LD table LD LD table Fig 72 shows the following information e Current values and LD rates of based processed Vibralmage parameters 1 4 8 51 57 P1 P19 e Current values and LD rates of fast processing Vibralmage parameters 1 fast A4 fast F1 fast F5 fast LD table columns meaning V Calc Ratel R2 Rate2 R2V RIV R2C RIC Level Current value of parameter Yes LD detection on No LD detection off Weight of parameter if its current value became more than the set base maximum bMax OR became less than the set base minimum bMin Weight of parameter if its current value became more than the set base maximum bMax AND became less than the set base minimum bMin Visualization use in P5 parameter calculation Calculation use in P20 parameter calculation In 9o determines on how many value of parameter should exceed the set limits that the system considered this c
116. older is not specified record of AVI files is blocked AVI Stop Capture stop record AVI file 26 Image capture saving the current frame from image area in selected archive folder as BMP files Exit exit from program 3 2 2 View menu View Fig 16 defines visible the basic window information and contains the following items View settings Action Toolbar Info bar Buttons d Graphs Frequency analysis s results BioTester results Video window Status window LD window Preset Fig 16 Menu View Toolbar switch on off the toolbar Info bar switch on off the information panel Buttons switch on off buttons on the toolbar Fig 16 Graphs show hide graphs of the set parameters Fig 38 Frequency analysis s results show hide histogram of frequency analysis of the set values Fig 32 BioTester results show hide window with biotester analysis results Fig 44 Video windows switch on off the small windows with real image Fig 18 the button a of the toolbar Status windows switch on off the windows with current suspect level Fig 18 the button of the toolbar 27 LD window switch on off the windows with current lie level Fig 18 the button 1 of the toolbar setings Acton Toolbar Info bar Buttars Graphs Frequency analysis s results Bio Tester results Video w
117. only after a choice of item Start LD block the Action menu Fig 143 or corresponding toolbar item aj For end of an interval of lie parameters calculation it is necessary to press repeatedly the same button or to choose the same menu item The moment of start on the graphs will be marked by a vertical green line the ending of calculation red line That mode is recommended to be used when the researched person gives long spatial answers to the put questions for example during interview or with the poor sound recording where Audio mode is difficult to apply 157 ES Reset Pause Start LO block Start LD compare block Reset timers F12 Measurement Graph analyse Markers Fig 143 Menu Action 3 auto Calculation of a lie level is made constantly the current values of parameters compared to values saved up for the previous period Stat periods This mode also is used for poor audio recording for files without audio at all and for comparative testing After done adjustments the Vibralmage system is ready to operate and capable to detect lie in person testing which image indicates in the basic program window Fig 145 The lie indicator is change of numerical values and the sizes of the histogram against a line P5 lie in an information column in ST mode or value which will be displayed in a window LD window Fig 145 in that window displayed P20 parameter value The call of a
118. ons Maintenance service and service regulations of Vibralmage system is carried out according to this Manual and instructions of used hardware maintenance a computer the camera etc Contact your regional dealer if you have questions or problems operation Attention Information in this document is subject to change without notice and does not represent the commitment on the part of Elsys Corp No part of this manual maybe reproduced or transmitted in any form or by any means electronic or mechanical for any purpose without written permission of Elsys Corp The software described in this document is furnished under license agreement and maybe used only accordance with the terms of the license agreement It 1s against the law to copy the software or any other medium except as specifically allowed license agreement The licensee may make one copy of vibraimage software for backup purposes Copyright 2001 2011 Elsys Corp All rights reserved Version Vibraimage 7 5 June 2011 Licensed users could download the latest version of Vibralmage software by the link http www elsys ru index_e php Updates and questions on www elsys ru Russia 194223 Saint Petersburg Toreza 68 ph fax 7 812 552 67 19 e mail elsys infopro spb su www elsys ru
119. ority Data background of stationary and moving objects Successive 1995 the term of this patent is the longer of Dec 19 2000 RU 2000132334 to picture differences are evaluated and a sum of differences Seventeen years from the date of grant of this of at two snc on am oi during the processing E thereof is accumulated biometry comprises a photo patent or twenty years from the earliest effec GO6K 9 36 2006 01 sensitive multielement transducer 1 and means for pro tive US filing date of the application subject HO4N 7 18 2006 01 cessing the images of the picture to picture difference which to any statutory extension 06 9 00 2006 01 contain an exposure memory 2 3 a unit for evaluating the s 52 US 382 276 382 107 382 118 picture to picture 4 differ If this application was filed on or after June 8 382 130 382 181 348 32 348 77 summator 5 and control registers 6 The device ig is twe 58 Field of Classification Search 348 32 accumulates the sum of the exposure differences detected by 1995 the ferm of this patent is twenty years from en 348 77 155 430 431 699 382 107 109 photosensitive multielement transducer the US filing date subject to any statutory ex 382 115 118 130 181 218 219 294 307 tension If the application co
120. ormat Mode AVI File no sound use for load AVI files without audio support This mode designed for work with VibraSound mode 31 The subitem 8 compressor are intended for management of videofile record format If this item is chosen that for economy of a space on a hard disk the videofile saved in a black and white format The subitem IP camera 1 allows to set network parameters for access to IP camera Note that value of parameters Host Port User and Password it is necessary to receive at the your local network administrator Pause Start of the current video image 1 carried out with the help of a command Stop Pause menu Action or with the help of the corresponding button of the toolbar Submenu Audio Fig 21 allows to choose the audio source device and to adjust its parameters which are necessary for operate in Lie Detector mode For example this menu contains the following items NOTE The content of the given menu items can differ depend on your audio device Settings Action video Audio Settings Language F Audio Capture Filter Record group d 4 SoundMAX HD Audio I video mask I gt _ Capture channel Skype mood Fig 21 Submenu Audio Before operation in lie detector mode select menu Settings Audio Settings Audio Devices Before using Vibralmage in this mode you may also control t
121. ose required record in the list of persons Thus in the field of a print the corresponding demographic data and vibraimages will be displayed NOTE that at data recording in archive all images which at the moment of record were open in the field of images are saving For remove files of superfluous images use Explorer Windows or the similar program For preliminary viewing listing Fig 89 use the command Print Preview menu File Didenko Tatiana 01 01 1958 ViPrinter Fig 89 Preview window 105 For choice of the printer and adjustment printing parameters use the command Print Setup menu File 4 2 Main menu e File e View e Help Menu File Fig 90 contains the following commands View Help Set archive folder Print Ctrl F Print preview Print setup Delete Del Exit Fig 90 Menu File Use Set archive folder command to change the archive folder in which the data of images archive are store The given way can not coincide with the way established in the base module It enables to work with different vibraimages archives Use Print Ctrl P command to print personal data and vibraimages This command may be executed with Ctrl P or toolbar Use Print Preview command to print preview Use Print setup command to change the printer and printing options Use Delete command to remove of the chosen record from the
122. ous variants of used television cameras 1 4 Package contents 1 Vibralmage DVD disc with software and Guardant 1 dongle User manual Digital USB camera options Microphone options A 92 N Personal computer options 12 13 1 5 Basic functions Software specification Vibralmage software is the part of vibraimage system and located on DVD than installed to user s computer for electronic images processing Image processing analyzing pixel movements fluctuations and vibration of various frequency and the amplitude performs by any part of object and preferably by human head Hardware specification Vibralmage hardware includes two basic parts a digital video web camera for person image input and personal computer for processing of the received images Software functions Vibralmage software solves the following technical tasks e Emotional levels recognition and detection e Lie detection e Monitoring of person physiological parameters e Creation and the analysis of digital videos of files in format AVI e Surveillance in real time vibraimage e Surveillance in real time images of aura e Save the visible image in a file in format BMP e Measurement in real time integrated characteristics of vibraimage e Recording of integrated characteristics vibraimage received for certain time in a LOG file e Input and save the demographic data in a file in format TXT e The structured
123. ow Diff mode gMin gMax 0 03 Show Yes Diff made No gMin 0 00 gMax 10 00 Hai 5 93 Show Diff made gMin gMax 67 25 Show Yes Diff made No gMin 0 00 gMax 100 00 18 48 Show Yes Diff mode No gMin 0 00 Aa 4n AM Fig 75 GR table 82 83 3 5 6 Information table Information table E Fig 76 allows adjusting vibraimage parameters and displays the following information VI ST LD GR 9 Frame rate Fast processing Base processing FPS proc period Downrate Main N 2 N 10 Parallelization Filters Single points Extended Extended fast Stretch Max speed contour Am scale Space color image crop X crop Y disable Am disable F disable 2x fast disable VI 10 disable VI 2 disable FFT disable Entropy Fig 76 Upper part of Information table Fast processing Base processing FPS proc period Downrate N 2 N 10 N K L Parallelization Single points Extended Extended fast Stretch Max speed contour Am scale Space 84 Frame Rate Settings Frequency fps for processing fast parameters of vibraimage noted by a word fast Frequency fps for processing base parameters of vibraimage noted by a word base Frequency of the frames fps during calculation period Reduce input frame rate At value 3 will be processed every third frame Main settings Minimum number of accumulat
124. ow from video from one of camera and single status line Fig 165 Single camera window The config xml file sets a position of windows on the screen the sizes of windows and other information for server operation see SSCS Path to libraries of persons recognition SDK Format of a displayed the message on person identification path The name of the catalogue in which databases are stored and in which results of checks on bases are saved A path by default 181 D Elsys Vibralmage7 Face Base a database of photos Face a picture from cameras with captured dangerous people Found the found concurrences on a database Notfound dangerous persons which photos are not present in a database Section lt Frame gt main window lt X cameras windows lt FrameLog gt list of the events lt FrameLogImg gt captured window The modules xml file sets parameters for configuration of local computers module id Sets name of the camera which is used for identification of the camera in a local network Network address of a camera log delay Only for servicemen log path Path to a folder where the videofiles from the chosen camera will be stored The maximal number of stored records of events and the captured pictures Switch off the sound signal at detection of potentially dangerous person Name of events list Name of capture window cou
125. parameters of the person can process not earlier than in 10 seconds after processing start 4 The developed version of system 1 sensitive to the certain object macromovements even at the switching Moving Filter therefore for reception of objective vibraimage parameters person must 1n the natural and stable state standing or sitting Note The correct analysis of person emotion levels and lie detection is possible only at detail execution of the recommendations stated in the given document and by processing of high quality vibraimage 2 2 Getting started 2 2 1 Digital camera driver installation Note Auto installation of system components is made according to the recommendations specified in section 2 3 of the description Install drivers for video capture device like web cam according to it manual Note Restart the system after driver installation 16 2 2 2 Guardant dongles driver installation Note administrative rights are required to install the XP Vista driver 1 Close all other applications to avoid file sharing errors 2 Run INSTDRV EXE application from Guardant drivers folder Soft Guardant2eng 3 When the utility is started 1t will check the presence of Guardant driver in the system If the driver is not found only Install driver button will be available the main window To install or update Guardant driver click on Install driver or Reinstall driver button If installation 1s complete
126. persons list Use Exit command to quit the application 106 Menu View Fig 91 contains the following items Help 4 Toolbar Status Bar English Fig 91 Menu View Toolbar switch on off the toolbar Status Bar switch on off the status bar Language change current interface and help language Menu Help contains the following items e About Vibralmage command to view information about software version 4 3 Toolbar and status bar The toolbar Fig 92 duplicates accordingly the following items menu e Delete delete selected record from persons list Fig 92 Toolbar The status bar Fig 93 displays the current information on the chosen menu item and the button of the control panel Ready Fig 93 Status bar 107 5 LogView module LogView module VILogViewer exe is designed for viewing and the analysis results of Vibralmage program operation Main window of LogView module Fig 94 consists of the following parts e main menu e nformation panel display parameters e Area of graph result supervision e toolbar D 2008 04 22 15 18 28 ViLogViewer File View Action 2 pil 9 P bb t 1 866045 v 0 181049 Fig 94 window of LogView module NOTE supervision of a video file can be made both from the beginning of a file and from any chosen place For a choice
127. played 3 pages of results Fig 103 105 On the first page it 1s displayed researched vibraimage and data on it levels of Aggression Stress and Tension on the second page values of the measured parameters and on the third the histogram of frequency distribution and graph of change psycho energy conditions for the specified period of researches Vibraimage lt v2 avi OX VI ST M LD GR Next Page Prev Page Two Zoom In Zoom Close v2 avi Duration s D amp 4deo ME v2 2vi Fagression Sess Tersion Lie Aggression Stress Tension Anxiety Suspect Balance Charm Energy Self regulation Inhibition Neuroticism Al fast A4 fast A4 psymaker com Fig 103 Viewing of researches results mode Page 1 117 Vibraimage lt v2 avi gt OX VI ST M LD GR 5 Prev Page Two Page Zoom In Close Fig 104 Viewing of researches results mode Page 2 118 Vibraimage lt v2 avi OX VI ST M LD GR 5 Print Two Page Zoom In Close 12 434 12 518 5 079 100 12 518 39 3 29 1 Tension Anxiety 33 5 33 8 73 9 77 5 http Jwww psyrraker com Fig 105 Viewing of researches results in M mode Page 3 Simultaneously in the database catalogue fixed for researched person 3 files will be generated for example e 2010 06 16 15 42 30 m
128. program VINetStatus the window with the error message Fig 152 displays ViNetStatus Fig 152 Error message 167 7 2 Operation a network monitoring mode For operation in a network monitoring mode it 1s necessary to execute the following actions 1 To start on the local computer the program Vibralmage exe and on the terminal VINetStatus exe 2 To adjust parameters of a network 3 To make adjustment of an operating conditions for Vibralmage system and a video camera for the local module 4 On the terminal PC in program VINetStatus to open a window of Settings Fig 151 establish flags Sounds and Images if you need the visual notice of the terminal operator and sound signal notice 15 required also And also to stand value Critical Level at which excess to the operator warnings messages will be given out In a normal operating mode of system when emotion parameters of the observable person do not exceed the established threshold emotion danger on the screen of the terminal only window VINetStatus will be display Fig 153 in which the current level emotion dangers will be show NOTE that for improvement of operator visual perception the levels of scale 15 divided on 5 parts distinguished by color Fig 150 153 By pressing button Reset it 1s possible to reset the saved up values and to begin a new processing results lt gt ViNetStatus Fig 153 NW window started on the terminal Ope
129. r Max speed contour No Am scale Am scale 16 00 Space Space 4 00 color image color image No crop X crop X 0 crop Y crop Y 0 FB 0 F6 LF F6 LF 10 FB N FBN 100 FPS filter FPS filter No E Monster E Monster No Auto downrate Auto downrate No micromovements control Fig 122 Default settings After changing settings user need to control CPU usage and make sure that it 15 less than 100 preferable less than 60 lt b macromovements control 131 At the next step user need to control camera real output frequency and make sure that in VI table frame rates In Fast Processing and Base Processing show approximately equal meanings near set Base Processing frequency 15 f s Fig 123 ST M LD GR Frame rate In Fast processing Hase processing Video timer Stream errors Info N 15 1 00 L 150 00 Width 640 Height 480 Statistics integrated Am 0 01390 IntegratedN F 21 913985 Suspect 0 00 Aggression Sress Tension Level 0 0 Fig 123 VI table indication for macromovements control 132 Vibraimage 2009 10 02 16 49 17 avi File View Settings Action H10 10 T10 LD REC Am F R 10 S10 T10 REC 50 NT VI ST M LD GR em 25 e vi Vig amp Audio Yes SRC F 01 42 Manual No Auto No Compare Off AVG filter Aggression Stress Tension Suspicious Macro mode level L
130. r an inscription Create to save the data in archive it 1s necessary to bring the mouse pointer and twice click the left button of a mouse Filling of field Selected record is made at choice of corresponding line in the list of a database VI ST M LD GR 5 Capture max length s 0 View Settings Acton purge old files No timer No Open stop in HH MM SS Save image as F2 Start at HH MM SS stop at 55 setings as Load settings Save src Yes save extra info Database folder Ctrlt F2 XML No eave No Mew record F4 DIF 0 save LD Yes Print Ctrl F Print preview Set markers RQ markers Print setup CO markers AVI Start capture F5 DB folder defaulti Selected record Kiselev Dmitry 10 09 1971 Image capture F Mew record Exit Akimov Valera 17 09 1979 Kiselev Dmitry 10 09 1971 Martynav Oleg 18 05 1857 Minkin Viktor 05 04 1959 Fig 65 Created database of persons 99 3 6 1 Save of current images Save of the current image in format BMP file is carried out with the help of a command Save image menu File or toolbar The structured store of observable images in format BMP files according to the entered demographic data 15 carried out with the help of a command Image capture menu File or the corresponding button of the toolbar NOTE in archive as separate BMP files will be wri
131. r from others by macromovements analysis and could account as suspicious person Ten times narrowing of Suspicious person makes easer work of profilers because specialists are working in limited time for solution and technical prompting from vibraimage system is very important Sure it does not mean that 10 of passengers are terrorists but it show that this passengers have some behavior and psychology characteristics differs them from others Some of them only have flight fear others have prohibited goods in luggage others are late for the flight and so on 6 3 LD mode Lie detection The program of psycho physiological lie detection allows to reveal verbal and nonverbal lie in the automatic automated and manual modes The program allows to fix and compare psycho 142 physiological parameters of the person during the various moments of time at use of various modern techniques of interrogation All means existing now lie detector register changes various psycho physiological parameters of the person thus it 1s considered that essential change psycho physiological parameters is observed when the person worries 15 excited and speaks a lie In a still condition of person his psycho physiological parameters and emotions vary less considerably in time hence having compared a known still condition with the answer interesting us it 1 possible to define when the person speaks the truth and when speaks lie Basis technical lie detection is the princ
132. r psycho emotional conditions through Skype program 95 3 5 7 Data base DB table DataBase table Fig 83 adjusts parameters of recorded video information and shows the following information DB folder Way to the database folder for written video files and files of statistics Capture max length s Defines the maximal length in seconds for recorded video file After file limit finished and closed a new file creates Capture purge old files Defines system action when the empty space on a hard disk will finish YES the oldest video files will be removed Timer The system can begin record at the appointed time Save extra information save TXT save XML define in what format the information on system settings and on system parameters change for the period of Supervision will be saved Save SRC images of dangerous people will be written to separate BMP files Save LD save in a external file the report of lie detector work and system settings Selected record Data on current object of research New record Name Birth date Comments The demographic information on object of research Set markers it is used in a lie detection mode for set on graphs RQ and CQ markers In fields RQ marker and CQ marker will be displayed time from the beginning of experiment or from the beginning of a videofile when these m
133. raging of parameters for the certain period RQ GQ Are used in Lie detection mode and serve for installation markers on graphs at the time of certain type questions H10 10 cx LD T 0 w ad ad aF pe EN M te gy VI ARL Fig 63 Toolbar 65 3 5 Information panel Indication of information column Fig 64 depends on using mode VI ST M LD GR Fig 64 Information panel tables menu VItablel Displays information about adjustments of system and results of data vibraimage processing e ST table Displays statistics of LD parameters and stands audio threshold e M table m It is displayed the average values of vibraimage parameters which have been calculated and are average for the certain period LD e LD table Displays and stands settings for LD parameters oP e GR table BH Displays and stands vibraimage parameters selected for graphs e Information table Displays and stands settings for vibraimage processing parameters e DB aid Data base table Input and selection of the demographic information and a folder for archive storage 55 e NW ad Network table Adjustment of local network parameters for operation a network monitoring mode NOTE values of parameters fields which are allocated by a green font can be changed by the user see Fig 66 parameters N K L it 1s possible to change in Inform
134. ralmage Software Vibralmage 7 Install Guardant Driver Install Vibralmage Back Exit Fig 13 Main Install window of Vibralmage components 8 Reboot your computer after this steps procedure 9 On desktop you can see Vibralmage software pictograms 10 Connect USB camera to free USB port 11 Connect Guardant dongle to the free USB port 12 Read Vibralmage manual 20 13 Run Vibralmage 14 In Vibralmage applications select working directory for store video capture file and protocol files see part 3 5 of this manual Note Manual installation for every system component is made according to the recommendations specified in section 2 2 of this description 21 2 5 First testing of vibraimage system It is necessary to test vibraimage system technical parameters before start human emotions control Focused on test pattern for example EIA 1956 and control resolution of used television web camera Measured resolution must be more than 400 television lines TVL in the frame centre Measure the noise level of used television camera before emotions control Noise level indicates IntegratedA parameter 3 5 1 item from this document it value must be less 0 1 Approximately the image of focused test pattern must be black in VI mode acceptable to have only several color pixels Make a choice of the audio source channel and adjust its parameters according to the recommendations specified in section 3
135. ram gives the user an opportunity of loading the new algorithms of person search In the given line the path to a file of new search algorithm 1 displayed In more detail procedure of loading of new algorithm 1s described in section 6 2 Macro Mode Alerts Stands critical level of emotion parameters for alarm signals At excess of the set level psycho emotion danger in the specified catalogue will automatically saved BMP files of the dangerous person from display screen Record will be made 1 time for the specified quantity of seconds At work in Macro mode in Video window will be consistently displayed images of dangerous objects for example if for the specified interval of time has passed some suspicious objects Defines the sound signal will be used at work in network monitoring mode whether or not Level for sound of a audio signal at excess of aggression stress or suspect levels the setting limits On Off maker s beep in LD mode On Off reset sound beep In version Vibralmage 7 0 the user can form itself formulas for calculation of new parameters of vibraimage using any Disable std sound No sound CG CR HG HR SG SR CG CR HG HR SG SR VI device 91 parameters on GR item For example Fig 80 1 4 4 55 Fig 60 User s formula for parameter X1 calculation Vibra sound YES VibraSound mode 1 switch on NO VibraSound mode 15 switched off the soun
136. rameter in the field of images Defines the minimal value of parameter shown on the screen Defines the maximum value of parameter shown on the screen Parameter graphic values shows E Indication parameter in image area For convenience of observing a line of parameter will be chosen by rose color Fig 99 Selected parameter is not shown in image area 5 3 Toolbar The toolbar Fig 100 duplicates accordingly the following items menu e Open Menu File e Play Menu Action e Pause Menu Action e Zoom In Ctrl Menu View e Zoom Out Ctrl Menu View Fig 100 Toolbar 111 112 6 Vibralmage system operations Vibralmage system have 3 basic operation mode 1 Micro mode it is intended for supervision research and the analysis psycho emotional conditions of the unique person in the frame 2 Macro mode it is intended for supervision research and the analysis psycho emotional conditions of the people in crowd 3 Lie detector or LD mode it is intended for lie detection of the unique person in the frame center The user can choose a system operating mode having set options by default having chosen a corresponding line in the information panel and twice having clicked above it the mouse pointer Fig 101 VI ST M LD GR Sound Susp Sound 96 Sound 5 0 Sound T 0 marker s beep No reset beep
137. ration frequency Level of anger P7A calculation of parameter 15 executed on points vibration amplitude P7F on points vibration frequency Level of energetic P8A calculation of parameter 15 executed on points vibration amplitude P8F on points vibration frequency Level of information entropy on base of Shannon theory P9A calculation of parameter is executed on points vibration amplitude P9F on points vibration frequency Entropy index 1 calculation of parameter is executed on points vibration amplitude P10F on points vibration frequency Antikurtosis Information theory parameter characterized density distribution form Level of classic thermodynamics entropy on base of Helmholtz theory P12A calculation of parameter is executed on points vibration amplitude PI2F on points vibration frequency Characterizes shift of the histogram in the right part high frequencies Thus parameters define color of active vibraimage pointer Vibraimage pointer is active if its brightness move than Level L value Control parameter Define relation between area of active vibraimage pointer for install threshold of active vibraimage pointer Level S parameters Thus if the number of active points grows than the parameter value increases and danger level also increases Control parameter Define relation between area of active vibraimage pointer for full frame square Vibraimage poi
138. rce video from camera without processing Fig 56 It is additional possibility to display the aura on the real image of person constructed on the analysis of pixels vibration amplitude the button toolbar View settings Acton v Toolbar Info bar Buttons j of the toolbar or pixels vibration frequencies the button a of the Graphs Frequency analysis s results Video window Status window 2 Toolbar Preset d 2 Without Aura VI 2 Am Aura vI 2 F gt AuraF VI 10 Am YI 10 F V VI M Am YIN F DELTA DELTA F view Mode DELTA FA View Mode DELTA FB mode Am mode F Mouse fn Centre X AVI timer Tite Fig 56 Select mode of processing image 58 VI e n VI 2 Am the button of the toolbar and VI 2 the button 2 7 of the toolbar modes display vibraimage processed during 2 frames Fig 57 and constructed on the basis of amplitude Am and frequency F analysis of vibration It is additional possibility to change color of background image and to add aura to vibraimage setings Acton Toolbar Info bar Buttons j Graphs Frequency analysis s results Video window Status window Preset d 2 Toolbar SAC VI 2 Aura White background WI 10 Am 4 Show vI 10 F VT M F DELTA Am DELTA F View Mode DELTA k Ld L
139. reshold Audio sens s LD mode Audio Manual Auto Compare filter Aggression Stress Tension Suspicious iMacro mode level L Fig 133 Correct person position for lie detector mode In a video camera options it 1s necessary to switch on a mode of fluorescent lamps noise suppression Flicker mode 50Hz and 60Hz In camera options it is recommended to use black and white image mode Presence of the other people taking place in the frame near to the researched object can influence and increase error rates of lie detection The video camera used for surveillance and or object on which the camera 1 fixed should be motionless and have no vibrations The vibration or movement of camera can increase error rates of lie detection Speed of input frame from the camera should be not less than 25 30 frame per second at resolution not less 640x480 pixels After start of Vibraimage program and person vibraimage displaying on the screen loading of the computer central processor power must be less than 60 10 11 12 13 14 144 The set of a microphone is recommended to use external not built in in the camera or notebook At work with videofiles it 1 recommended to use files in length of 5 10 minutes and for exact lie diagnostics it is recommended to analyze the same file repeatedly some times Press button before next lie detection of the same file button works as reset an
140. sed on these two primary images are calculated about 40 integral vibraimage parameters reflects different types of movement and vibration divided into 4 main groups A amplitude parameters B frequency parameters S symmetry parameter P space and time processing parameters Head movements in space classically associated with vestibular system are studied and discussed in relation to the status of vestibular reflexes 1 e the vestibuloocular vestibulocollic and cervicoocular reflexes But it 1s possible to look on head movements according to the vibraimage system and technology We supposed that head balance for person without consciously movements could be considered as isolated thermodynamic system and any emission of internal energy would change the balance of this isolated system and realized by movements or vibrations Every emotional state characterized by specific energy conversation and work done by the system transfers to micro vibrations if the person forced to stand or seet still The head vibtration parameters frequency in range 0 1 10 Hz and amplitude are stable time for stable emotional state of person Parameters of vibrations changed only after emotional state alteration Vibralmage technolgy allows to contactless register of person vibration parameters and calculates emotions according to accomulated statistics of comparitive testing with EEG skin galvanic reaction and psychological testing Vibralmage technics param
141. showed only after a choice of item Stop Fig 41 The analysis of the frequency spectrum after its processing with the help of Fast Fourier Transformation FFT commands Start S 10s and Start S shows vibration spectrum Items Start T 10s and Start T are intended for accumulation and viewing of the information about change time F6 and F8 parameters Parameters F6 and F8 define the average and current period of parameter Flfast Alfast change with the switch on filters F6 HF and F6 LF Averaging of changes of the Fl fast Al fast signal period 15 made in interval F6N frames Parameter F6 is parameter of person inhibition For the concentrated person the maximum of frequency distribution of Flfast signal period changes falls at value of 0 1 seconds for weakened 0 2 seconds Presence of several maxima frequency distribution shows that during researches the person on something distracted Note that changing value of F6N parameter we change a step of digitization at construction of the histogram 47 Note items menu Start 10s Start T 10s and Start S 10s have corresponding buttons the Toolbar The user also has an opportunity of viewing previously saved results of the frequency analysis For this purpose it is necessary to chose the item Frequency analysis s results menu View to pass in a mode of viewing of the frequency histogram in the area of image and then having pressed button Lo
142. ters than displayed on fig 140 As a basis of calculation and the analysis use lie algorithms of the professional version Vibraimage PRO analyzing 28 psycho physiological information statistical parameters of micromovement of the person head Results of the carried out tests showed 95 concurrence of the data automated lie detection received by Vibraimage PRO with results received on a standard contact polygraph For visualization psycho physiological changes in the program the following parameters are used 1 shows maximum fast reaction of person for question or situation so it changes before any other VI parameters but go down also immediately as it changed This parameters shows macro movement and sometimes used for deleting artifacts from the lie detection process F3 shows general mental energy level of examinee in default settings this parameter calculates for time period of 20 seconds so it 1s slowly changing parameter reflects psycho physiological state High level of this parameter indicates high level of exciting aggression or activity so it could be correlated with lie F6 shows inhibition of person and also correlated with respiratory tracing or breathing activity because it is physiology linked with inhibition process S2 shows asymmetrical of movements in middle time period so it includes left right hemisphere activity components and it high changes usually indicates lie P2 shows Mean Square Deviation MSD of
143. the same place in seconds value of the averaging period Duration is set At a choice of item Graph analyze it will be open submenu gathering of the information about frequency distribution in vibraimage Fig 31 Histogram of frequency distribution appears in area of images Fig 32 Reset Fause Start LD black Start LD compare block Reset timers Fi Measurement Graph analyse Start H Markers d Start H 105 Start 5 Start 5 105 Start Start T 105 Fig 31 Menu for information accumulation about frequency distribution Items Start H 10s and Start are intended for accumulation and viewing of the frequency information Start of command Start H 10s gathering of information is made for 10 seconds and the window of frequency information viewing is showed automatically after 10 seconds After start of command Start H the time of data accumulation is defined by the user and the window of viewing of the frequency information is showed only after a choice of item Stop Fig 31 The analysis of the frequency information after its processing with the help of Fast Fourier Transformation FFT commands Start S 10s and Start S shows frequency spectrum Items Start T 10s and Start T are intended for accumulation and viewing of the information about change in time F6 and F8 parameters Parameters F6 and F8 define the average and current period of parameter F1fast Al
144. the specified time interval Opposite mode Alternative method of lie level calculation LD mode Selection of mode for lie detection audio Calculation of lie level starts when the level of entrance audio Anger Stress Tension Suspicious Macro mode Level L Level S Aura mode manual auto Compare 89 signal exceeds the established threshold LD calculation stops when the level of audio signal becomes less than the established threshold Accumulation of the information is made time Base periods Calculation of lie level 15 made only after pressing button Start LD end of processing after pressing button Reset Calculation of a lie level works constantly current values of parameters are compared to values processed for previous Stat period Off at the analysis of lie as test the interval Stat periods directly till the moment of started lie detection 1 used On at the analysis of lie as test the interval Stat periods which has been marked by the user beforehand 15 used When the user includes accumulation the preliminary information this field value Capture AVG filter Number of frames for aggression level averaging Number of frames for stress level averaging Number of frames for tension level averaging Number of frames for suspect level averaging Macro mode Define on base of which formula danger level calculated NO danger level calculated on base of Anger
145. tten down images from all open windows in the field of supervision For example Fig 86 in the field of supervision 3 windows with processing image are open SRC and VI and in archive result 3 files of images will be kept e 2008 05 13 11 48 51 src A bmp e 2008 05 13 11 48 51 vil A bmp e 2008 05 13 11 48 51 vin A bmp NOTE simultaneously with the specified files of images in archive 3 more files in which settings of Vibralmage system will be kept at the moment of removal images will be created e 2008 05 13 11 48 51 src A set e 2008 05 13 11 48 51 vil A set 2008 05 13 11 48 51 A set 100 Vibraimage Didenko Tatiana 01 01 1958 2008 04 22 15_18_28 avi gt File View Settings Action VI ST LD GR A A default TES 46 E 5 Se maxlength s 0 i P e Pi sachs purge old files No eec TEX Selected record Didenko Tatiana 01 01 1958 New record Akimov Valera 31 12 1980 Didenko Tatiana 01 01 1958 Karpov Evgeniy 23 02 1950 Kiselev Dmitriy 14 09 1975 Martynov Oleg 18 12 1970 Fig 66 Saving images in archive For viewing of saved data archive the special program the Print Module of vibraimage VIPrinter exe is used 3 6 2 Save of video file Save of the current image which appears in the basic window in format AVI file is carried out with the help of a command AVI Start Capture men
146. u 2 Save current image to the archive File menu M AVI start record File menu For stop AVI files recording needs push on this button again load AVI file Settings menu Camera image from camera E Stop Start Action menu VI mode View menu AV AV mode View menu AR mode View menu LD mode View menu Amplitude analyze View menu Frequency analyze View menu Reset all accumulated information about frame difference Start accumulation again after reset Action menu Mouse Histogram View menu H10 Frequency analysis 10s gathering of information for 10 seconds Action menu 10 Frequency Fourier analysis 10s gathering of information for 10 seconds its processing by Fast Fourier Transformation Menu Action T10 Gathering and averaging of the information for 10 seconds Menu Action 64 Results of the frequency analysis switching a mode of frequency analysis graph display Switching in mode of testing psycho energy condition graph display to begin data processing for a Lie detector mode Menu Action REC e Manual switch on off of a preliminary data gathering mode for Lie detector Menu Action reset timer of video files to 0 Menu Actiom M mode of accumulation and ave
147. u File The stop of record process of AVI file is carried out on a command AVI Stop Capture menu File File The same actions can be executed with the help of the corresponding button un of the toolbar Fig 86 NOTE that in the specified catalogue will be written down 3 files e video file with expansion avi e file with the current adjustments of system with expansion set e and if it necessary a file with the report of changes of parameters with expansion xml 101 For increase of video files recording reliability designed the field Capture max length s records in seconds Fig 85 If record lasts over the specified interval current AVI the file will be closed and save on a disk and record will be continued in a new file At filling the whole disk if the switch Capture purge old files record of new video files will be made atop of old The first oldest will leave by date of creation video files The user can set time of the beginning and the ending of record fields Timer If in the image area you have switch on some windows with video data for example open 3 window Fig 87 submenu Settings Capture channel allows to choose from what window video data will be saved in video file Vibraimage VIDEO Look 1320 V2 File View 23242 Action i A F w VI ST LE Language MZ gt Als
148. ue Off at the analysis of lie as test 1s used an interval Period of processing directly till the moment started lie detection Value On at the analysis of lie as test 1s used an interval Period of processing which has been marked by the user beforehand When the user includes accumulation of the preliminary information in this field value Capture 3 Additional parameter Audio sens s in an information column sets in seconds how many after the person answer ending still to continue to analyze his condition 4 The parameter Lie threshold an information column sets in a threshold for the indicator of a lie level in view of all designed parameters and their weight At excess settlement value of this threshold a lie level is registered and displayed 5 Each person differently reacts to lie by virtue of the psycho physiological features The part of people when lie worries also their reaction value of parameter P5 lie on the important questions RQ questions exceeds reaction to control questions CQ questions and the system registers a condition of lie DI For such people parameter Opposite mode NO it is a mode by default And the part of people on the contrary internally is clamped strains and their reaction value of parameter P5 lie on the important questions RQ questions less reactions to control questions CQ questions and the system does not register
149. ul advantage compared with microvibrations it permits crowd control Microvibration control has powerful advantage compared with macromovements it allows auto control Both of them are realized by Vibraimage system with different settings Vibraimage Macro Mode control allows to indicate a suspected person with the other movement value than other persons in crowd The typical movement value for normal persons in frame shows statistics range for changes in status window for some time period Vibraimage lt 2009 10 02 16 49 17 gt File View Settings Action 2 p RS awe DM VI ST M LD GR e 8 ANI A SRC F 00 49 X1 X2 gt 281 1 Vibra sound disable std sound no sound VI Device Indication Micro default Macro default Status Fig 121 Set Macro mode by double click of left mouse button Note that in a macromovements analysis mode the Status window will be automatically displayed Fig 121 in which the current level of danger will be displayed 130 6 2 1 Vibraimage Macro Mode Settings for different aims Accumulation period for macromovements registration is smaller than for microvibration registration It mostly determines by the speed of human body movement and do not suppose movement accumulation and movement repetition Typical accumulation period for macromovements covers 1 second and maximum setting
150. ut if we have that 100 entering persons have status level less than 30 that means we need to change alarm threshold or better levels L and S in macro mode settings from default Standing less L and S levels we increase the sensitivity of Suspected status indication so we could change default settings for L 1 S 1 Control status level window with changed settings during the statistic period With new settings we will see the other of Status for the same recorded or live video Supposed that for L 1 S 1 settings we will see that 100 persons have status level less than 5596 That means we need to change again settings for achievement alarm threshold 60 137 4 Based on the aims of Vibraimage Macro Mode change or leave next settings for levels L and S macro mode settings So we change settings to L 1 and S 0 1 5 Do the same steps till status level statistics will satisfy aims of Vibraimage Macro Mode For this settings L 1 and S 0 1 we have 90 persons status less than 60 and for 10 persons more than 60 We could fixed this settings if we have aim to indicate 10 of people with movement amount more than stand threshold 6 Stand requested non zero level for Auto capture image s in Alerts settings based on Vibraimage Macro Mode aims for storage images of suspected persons on the hard disc Stand other Alerts settings according to control aims 7 Now control status level window on the screen For work it is recom
151. uttons 109 2008 04 22 15 18 28 ViLogViewer Fie View Action gt 9 E Integrated2 Am Settings Period 10 0000 IB Integrated2 Am 0 93 Show Yes gMin 0 00 gMax 50 00 Integrated10 Am Show gMin gMax IntegratedN Am Show gMin gMax Fig 97 Increased graph scale Menu Action Fig 98 consists of the following items The choice of item Play makes start of video file viewing and calculation of graph vibraimage parameters changes It also can be replaced by the corresponding button of the toolbar Item Pause stops viewing a video file and calculation of graph It also can be replaced by the corresponding button of the toolbar Menu Help consists of the following items e About VILogViewer information about program version 5 2 Information panel 110 The information panel Fig 99 displays basic parameters of the recorded results Functional purpose of information panel is similar to purpose of information panel of the basic module Vibralmage exe in GR mode Al fast Show gMin amp A1 Show gMin Show gMin gMax Show 0 03 0 00 0 50 0 19 No 0 00 1 00 BA 56 29 Yes 0 00 200 00 23 42 No Fig 99 LogViewer information panel LogViewer parameters indication Va Show gMin gMax Current value of parameter Switch defines will be show or not selected pa
152. work 1 2 3 Host IP address or a domain name of the camera Port Network port of the camera User and Password set login and the password of access to the network camera HTTP user registration record for access to IP camera Url a path to a virtual file on the camera which corresponds to video stream in MJPEG format The name of a file can depend on model of the IP camera Than in Vibralmage program it 1s necessary to choose the Subitem IP camera 1 the Settings Video menu and to make settings of network parameters for access to network IP camera Fig 155 The field FPS sets number of the frame in a second which will be given out IP camera in a network NOTE that the number of the frame in a second which will reach your computer depends on throughput and congestion of a local network And if for example it 1s set FPS 15 but on a network the frame come with smaller speed the missing frame in the program will be added by copies of the previous accepted frame IP Camera Host Port User 192 168 0 20 80 user Password 12345 Url FPS mjpeg 5 15 Cancel Fig 155 For example IP camera model D Link DCS 910 settings 171 7 4 Multichannel behavior detection system 7 4 1 System structure Computer Camera PC2 Camera K12 Monitor and Computer keyboard PCS PC6 Camera K10 Computer Camera K11 PC7 LA

VibraImage 7.5 Manual Eng - Elsys

Contents

Download Pdf Manuals

Related Search

Related Contents