Home

Download

1. 5123 tps 5 Fig 29 The frequency histogram for a normal condition of the person 2 Pressing on button Load the user can load earlier saved data and to compare them with just received For printing received results choose a command Print menu File For removing the received graph of the frequency analysis 1s necessary to bring the mouse pointer to the chosen diagram press the right mouse button and to choose item Delete C Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action 9 E H10 S10 c LD 25 3 AV x VI AV ARLD Am F Ro W 31552 Em al A F A F A F A F VI ST LD GR 35 e 1 M VIS Vio VIS Yiu Vin A A E H H Integrated2 m 11 18 Show Her M N Diff mode HeT i gMin 0 00 I i gMax 10 00 i 2008 04 29 14 39 19 i i i i i i i i i M 7 990287 i E H H Integratedio am 7 01 ise Show Her qt Diff mode HeT gMin 0 00 gMax 20 00 I DE H H IntegratedN Am 45 67 Show Her Diff mode Her gMin 0 00 gMax 50 00 Fig 30 The frequency histogram for person differs from a normal state aT Choice of item Markers will open submenu for input of 10 markers Fig 31 To enter markers it is possible also buttons 0 9 from the keyboard Pause Start LD black Start LD compare block Reset timers FL2 Graph analyse d Markers il E 3 A 5 E 7 B 3 Fig 31 Menu marker set
2. Fig 17 34 NYCK ee DCTest 2 DAEMON Tools m Ne LL e E Video window LD window Status window Main window Example of Video Status and LD windows 3 2 3 Settings menu Settings menu Fig 18 contains the following items Video Audio Language Record group Video mask 28 Capture channel Skype mood gu ACTON Video Audio Language Record group Video mask Capture channel Skype mood T or F Fr s F Y Fig 18 Menu Settings Submenu Video contains options of video modes Its can differ depending on connected devices For example this menu contains the following items Fig 19 You can choose as video source one from many installing in PC video devices or load external video file Settings Action IP Camera 1 Audio F Yideo Capture Filter Language d Video Capture Format Record group H w ROES compressor Video mask d B Capture channel aS ANT File Fa Skype mood r AVI File no sound Ctri F3 e Look 1320 v2 Fig 19 Submenu Video The subitem Disconnect allows to disconnect all videocamera or videofile Video Capture Filter by pressing the window of video device setting contrast exposition brightness opens Each device has the especial window of settings Video Capture Format change video capture format Mode File no
3. d To enter a name of the removed terminal Item Remote host In the current version Vibralmage 7 2 system works only with one terminal to which transfers the information on a local network Further the version will be stipulated an opportunity of work at once with several terminals 3 To enable work with the chosen terminal The item Enable 4 To establish the network address of a computer of the removed terminal on which the program VINetStatus exe is started Item IP 5 To specify number of port through which the application of Vibralmage system started on the local module and the terminal will communicate Local TCP port the program Vibralmage exe will interrogate the given port for data exchange with the terminal TCP port UDP port ports for software of terminal through which it is changed by information with the computer on which started program Vibralmage exe Through UDP port goes an exchange by short messages Through TCP port goes an issue video data 6 To establish Critical level emotional threshold state of the person at which excess the warning message will be given out on the removed terminal and the picture of object of research is sent 106 vist wo af Network service Local TCP port Remote host enable IP TCP port UDP port Fig 96 Network monitoring mode Information panel For adjustment of network parameters for the terminal it 1s required to start the prog
4. Behavior Detection System Vibralmage Version 7 2 Manual ELSYS Corp Saint Petersburg 2009 CONTENT Introduction 4 1 Useful information 8 1 1 Basic applications 1 2 Operation conditions 8 1 3 Specifications 8 1 3 1 Vibralmage system data 8 1 3 2 Digital web camera requirements 9 1 3 3 System requirements for local module 9 1 3 4 System requirements for terminal module network monitoring 10 1 4 Package contents 10 1 5 Basic functions 11 2 Before you begin 12 2 1 Information and Precautions 12 2 1 1 Power supplies requirements 12 2 1 2 Light exposure requirements 12 2 1 3 Camera vibration requirements 12 2 1 4 Settings Vibraimage recommendations 13 2 2 Getting started 13 2 2 1 Digital camera driver installation 13 2 2 2 Guardant dongles driver installation 14 2 2 3 Vibralmage installation 14 2 3 Manual installation 15 2 4 Auto Installation 16 2 5 First testing of vibraimage system 19 3 Vibralmage module 21 3 1 Multifunction window 21 3 2 Main menu 22 3 2 1 File menu 23 3 2 2 View menu 24 3 2 3 Settings menu 2r 3 2 4 Action menu 33 3 2 5 Help menu 38 3 3 Image area 39 3 3 1 Graph analyze 40 3 3 2 Image area control from preset 43 3 3 3 Submenu mode 49 3 3 4 Lie detector settings 58 3 4 Toolbar Ci Introduction We
5. and Start S 10s have corresponding buttons in the Toolbar The user also has an opportunity of viewing previously saved results of the frequency analysis For this purpose it is necessary to chose the item Frequency analysis s results menu View to pass in a mode of viewing of the frequency histogram in the area of image and then having pressed button Loads to load earlier saved data and to compare them with just received In a window with the frequency histogram Fig 37 switch N determines will be the histogram of amplitude is showed whether or not the diagram is show by red color Switch N determines will be the histogram of frequency is showed whether or not the diagram is show by green color C Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action Os 192 y 4 avia O VI AV ARED Am F R Iwo 70 10 bp VI ST LD GR 5 e E e M M Fi Vig UN Y Ya A A Frame rate B hn E NN Fast processing Base processing Video timer 2008 0429 12 41 43 Mi 1 708827 810 627576 Info D 0 406503 2008 04 29 12 41 43 Mt 0 378443 5 0 309915 Width Di0 006047 Height i y Statistics IntegratedN amp m 3 91590 IntegratedN F 5 38778 Anger 4381 Stress SON Tension 12 31 M ME ei i i elt PA AAA ut ua 8l23 fps 1 5 Fig 37 Frequency histogram of the person state 42 To print out the received results user choose a
6. e Help Menu File Fig 85 contains the following commands e Set archive folder e Print Ctrl P e Print Preview e Print Setup e Delete e Exit View Help Set archive folder Print Ctrl F Print preview Print setup Delete Ciel Exit Fig 65 Menu File Use Set archive folder command to change the archive folder in which the data of images archive are store The given way can not coincide with the way established in the base module It enables to work with different vibraimages archives Use Print Ctrl P command to print personal data and vibraimages This command may be executed with Ctrl P or toolbar Use Print Preview command to print preview Use Print setup command to change the printer and printing options Use Delete command to remove of the chosen record from the persons list Use Exit command to quit the application Menu View Fig 86 contains the following items e Toolbar e Status Bar e Language mm Help Toolbar e Status Bar e English Pech Fig 86 Menu View Toolbar switch on off the toolbar Status Bar switch on off the status bar Language change current interface and help language Menu Help contains the following items e About Vibralmage command to view information about software version 96 97 4 3 Toolbar The toolb
7. Each marker will be present in the field of parameters schedules by the unique color Fig 32 Vibraimage lt v2 avi gt aax File View Settings Action Help Ai O VI AV ARID Am F RM LD VI ST LD Es o E 25 is as E VI uM UM UM uM LM N N 20 00 Integrated2 Am t 02 20 10 00 ntegratedN Am 2 42 Show Yes Diff mode No gMin 0 00 gMax 50 00 ef H A1 Fast T 3 EH HAL 0 20 00 how No Diff mod No 1 t ak mW b Integrated10 Am t 02 20 gMax 10 00 EH Hae 30 81 Show No Diff mode No gMin 0 00 gMax 100 00 BH Mas 21 55 Show Mo Diff mode Mo gMin 0 00 Pt gMax 100 00 1 85 i 1 1 1 214 m EC e IntegratedN Am t 02 20 Diff mode No 4 gMin 0 00 gMax 100 00 EH HA 0 08 Show No Diff mode No gMin 0 00 gMax 100 00 E H H Integrated2 F 3 39 AT fast t 02 20 0 01 Fig 32 Markers samples 3 2 5 Help menu Help menu Fig 33 contains following items e About Vibralmage e Help F1 Help About Vibralmage Help Fig 33 Menu Help 38 Use About Vibralmage command to view the information about software version license type and registered user name Use Help command to call the help system 39 3 3 Image area Vibraimages images and external vibraimages auras are displayed in the image area The basic window of the base module Vibralmage exe can be configured for surveillance in several operating modes T
8. Language Video Capture Format Record group ROBS compressor Video mask d a A Capture channel ees AMT File F3 Skype mood r AVI File no sound Chri F3 v Look 1320 V2 Fig 35 Select video source Pause Start of the current video image is carried out with the help of a command Stop Pause menu Action or with the help of the corresponding button of the toolbar 3 3 1 Graph analyze Choice of item Graph analyse will open submenu gathering of frequency distribution information in vibraimage Fig 36 Histogram of frequency distribution will be showed in area of images Fig 37 Pause Start LD block Start LD compare block Reset timers PIE Graph analyse Start H Markers d Start H 10s o Starts Start 5 lus Fig 36 Start frequency analyze menu Items Start H 10s and Start H are intended for accumulation and viewing of the frequency information Command Start H 10s gathering information for 10 seconds and the window of frequency information viewing is showed automatically after 10 seconds Time of data 41 accumulation for command Start H is defined by the user and the window of frequency information viewing is showed only after a choice of item Stop Fig 37 The analysis of the frequency spectrum after its processing with the help of Fast Fourier Transformation FFT commands Start S 10s and Start S shows vibration spectrum Note items menu Start H 10s
9. NOTE in archive as separate BMP files will be written down images from all open windows in the field of supervision For example Fig 81 in the field 89 of supervision 3 windows with processing image are open SRC VI and VIy and in archive result 3 files of images will be kept e 2008 05 13 11 48 51 src A bmp e 2008 05 13 11 48 51 vil A bmp e 2008 05 13 11 48 51 vin A bmp NOTE simultaneously with the specified files of images in archive 3 more files in which settings of Vibralmage system will be kept at the moment of removal images will be created e 2008 05 13 11 48 51 src A set e 2008 05 13 11 48 51 vil A set e 2008 05 13 11 48 51 vin A set T Vibraimage Didenko Tatiana 01 01 1958 2008 04 22 15 18 28 avi File View Settings Action 4H oom o l F R be dp rs vi ST Lo GR E ho AA C default max length s 0 purge old files No Selected record Didenko Tatiana 01 01 1958 New record Akimov Valera 31 12 1980 Didenko Tatiana 01 01 1958 Karpov Evgeniy 23 02 1950 Kiselev Dmitriy 14 09 1975 Martynov Oleg 18 12 1970 Fig 81 Saving images in archive For viewing of saved data archive the special program the Print Module of vibraimage VIPrinter exe Fig 83 1s used 90 3 6 2 Save of video image Save of the current image which appears in the basic window in format AVI file is carried out with the help of a command AVI Start Capture menu File The stop of record
10. T 0 66 3 5 Information panel Indication of information column Fig 64 depends on using mode YI ST LD GR amp El E Fig 64 Information panel tables menu e VItablel Displays information about adjustments of system and results of data vibraimage processing e ST table H Displays statistics of LD parameters and stands audio threshold e LD table l Displays and stands settings for LD parameters m e GRtable EI Displays and stands vibraimage parameters selected for graphs e Information table 2 Displays and stands settings for vibraimage processing parameters e DB aid X Data base table Input and selection of the demographic information and a folder for archive storage 3 e NW asd E Network table Adjustment of local network parameters for operation in a network monitoring mode NOTE values of parameters in fields which are allocated by a green font can be changed by the user see Fig 66 parameters N K L it 1s possible to change in Information table For this purpose it 1s necessary to bring the mouse pointer to the chosen field and twice to click the left button of a mouse In the bottom part of information panel displays three windows with results of the frequency analysis Fig 65 In the first window the frequency analysis vibraimage on the whole frame by red color amplitude green color frequency of vibration pixels 1s displayed In the second window the frequency and amplitude histogr
11. To delete a window with the set image processing it is enough to let off the corresponding button the of toolbar panel i Vibraimage lt VIDEO Look 1320 V2 File View Settings Action H F A ve VI ST LD R O 35 Frame rate In Fast processing Base processing Video timer Info Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress lt Fig 49 Simultaneous output of several windows with the different image processing 51 NOTE In the left top corner of a window could be indicated the Title of the given image processing mode Fig 50 Fi Vibraimage lt VIDEO Look 1320 V2 EBR File View Settings Action Help o H10 S 10 lt LD mi 5 Sg ama VIAVARLD Am FR v 1953172 as TER FX Au ti LI M EK VI ST LD GR O SE e lad dE VI V V V Yin Y n A A Frame rate P In Fast processing Base processing Video Timer 03 07 00 Info Width Height Statistics 5 Fig 50 Several images simultaneously presented in image area Modes of SRC Aura and VI 2Am are switched on 52 e n SRO mode the button g of the panel of toolbar shows source video from camera without processing Fig 51 It is additional possibility to display the aura on the real image of person constructed on the analysis of pixels vibration amplitude the button toolbar View settings Action v Toolbar we Info bar Buttons j E of the toolbar or pixels vibration fre
12. aggressive passenger on ticket control 125 126 E vibraimage lt 20080521101151 avi gt File View Settings Action SD Avi O VI AV ARLD Am F Rw 959 5 25 VI 2 A 5 01 13 Fast processing Base processing Video timer Info Statistics IntegratedN Am 97007 IntegratedN F 06666 Anger geo oo uum 0 0 kl au VI 10 F 19 01 13 j VI N F 15 01 13 Fig 124 Normal calm passengers on the luggage control E Vibraimage lt 20080521101151 avi gt File View Settings Action 1299 ssi O VI AV ARLD Am FOR v 225503 MI ST LD GR O El Y on n va vols va Mw AA Frame rate y VI 2 A 5 00 45 E Base processing Video timer Info 15 1 00 2 00 640 480 Statistics IntegratedN Am 17585 IntegratedN F 0 19303 Anger Sress Tension VI 10 F 19 00 45 Fig 125 Suspicious aggressive passenger on luggage control 127 It doesn t mean that vibraimage macromovements control is absolutely simple and every red person in vibraimage pictures is potential danger On the Fig 126 shows staff that moves fast and of course looks red on the fast vibraimage window with accumulation frame number equal 5 E Vibraimage lt 20080528113113 avi gt File View Settings Action bel P Ay v VIA ARID Am FOR v 252555 m VI ST LD GR 5 E T v2 viz vig Vra Vra A A Frame rate VI 2 A 5 01 18 In Fast processing Base processing Video timer
13. 112 Color scale Based on these two primary images are calculated about 20 integral vibraimage parameters reflects different types of movement and vibration divided into 4 main groups A amplitude parameters B frequency parameters S symmetry parameter P space and time processing parameters 8 3 2 Frequency histogram Frequency histogram shows head movement frequency distribution for every pixel and for accumulated time period default time period 1s equal 20 seconds Some real samples histograms coordinated with emotions and energy levels are printed in this point Figure 109 shows distribution histogram for person in normal conditions both graphics approximately looks like normal Gaussian distribution On Fig 113 we see un normal human states up graphic shows person with low energy level very tired and down graphic shows high energy emotions anger 118 M1 4 89426 5 1 13303 M2 4 65000 Mi z 99402 5 0 58184 M2 3 20000 Fig 113 Normal state NEM oca A Print Load M12 74405 5 0 20551 M2 0 55000 M1 7 52094 5 21 42633 p M2 5 65000 Fig 114 Abnormal state 8 3 3 Spectrum analysis Spectrum analysis of time dependence high speed vibraimage signals also could informative reflects person emotions Person in normal conditions has in several times more low frequency square in vibration spectrum than person in tension or aggression On Fig 115 we see the sample of normal person s
14. 9 0 or later PC with Pentium Core Duo2 2000 or better 1024MB or better 100GB or more free space DVDRW 2 free USB ports version USB 2 0 free slot option WDM compatible video device audio capture device support 16 bit data and 44100Hz stream frequency LAN 100Mb s or better 10 1 3 4 System requirements for terminal module network monitoring Operation System Windows XP Prof Vista with DirectX 9 0 or later Processor PC with Pentium IV 2400 or better RAM 256MB or better HDD IGB or better Monitor Resolution 1024 x 768 or better On desktop must be free area don not cover other software windows with size 300 x 80 point or better Video capture WDM compatible video device Audio audio capture device and speaker Network LAN 100MB Ss or better 1 4 Package contents l Vibralmage DVD disc with software and Guardant 1 dongle User manual Digital USB camera options Microphone options un BB UC N LA Personal computer options 11 1 5 Basic functions Software specification Vibralmage software is the part of vibraimage system and located on DVD than installed to user s computer for electronic images processing Image processing analyzing pixel movements fluctuations and vibration of various frequency and the amplitude performs by any part of object and preferably by human head Hardware specification Vibralmage hardware includes two basic parts a digital video web camera
15. IntegratedN Am IntegratedN F Anger Sress Tension VI 40 F112 01 13 o j VI N F 15 01 18 Fig 126 Fast moving person looks red in the fast vibraimage window Usually it is not very hard task don t pay attention for the fast moving personal but sometimes fast moving people could trouble crowd control In difficult situation it 1s possible to pay attention to standard parameters calculated by vibraimage system and described for microvibration analysis Anger level calculated for Fig 126 shows only 55 it is lower than in any other shown figs Also histogram analysis doesn t show any danger for Fig 126 in contrast to Fig 123 and Fig 125 Of course this part describes only the main recommendations for suspicious people control in crowd Example of the other program display variant gives on Fig 127 considering graphs information Some specialists could prefer graphs info instead of vibraimages VI version 7 0 gives enough possibilities for research and operation Every team of specialists in profiling or aviation security develops own instructions for operation with vibraimage system corresponding to their aims Operation statistics of vibraimage system application in airports calculates that about 1096 of passengers differ from others by macromovements analysis and could account as suspicious person Ten times narrowing of suspicious person makes easer work of profilers because specialists are working in limited time for soluti
16. OS M1 Kiselev Dmitriy 14 09 1975 Martynov Oleg 18 12 1970 A EA 1 Ue Fig 63 Main window of printing module ViPrinter exe The persons list a column at the left displays the list of archive images records and a choice of record for viewing and print Current record choice is allocated with the cursor corresponding to it vibraimages and the demographic information displayed in the printing area 94 The printing area field on the right displays vibraimages and the demographic information corresponding to the current record of the persons list 4 1 Printing For print out vibraimages and the demographic data the command Print Ctrl P menu File is intended Before a call of a command Print Ctrl P it is necessary to choose required record in the list of persons Thus in the field of a print the corresponding demographic data and vibraimages will be displayed NOTE that at data recording in archive all images which at the moment of record were open in the field of images are saving For remove files of superfluous images use Explorer Windows or the similar program For preliminary viewing listing Fig 84 use the command Print Preview menu File Didenko Tatiana 01 01 1958 ViPrinter Fig 84 Preview window 95 For a choice of the printer and adjustment printing parameters use the command Print Setup menu File 4 2 Main menu e File e View
17. QA 8 13 A 8 13 OB 13 30 B 13 30 FPS i Fig 117 Vibraimage and EEG correlation for calm human state 121 Analyzer Channel EEG1 EEG2 EEG3 EEG4 EEGS EEG6 EEG EEG8 EEG9 EEG10 EEG11 EEG12 EEG13 EEG14 EEG15 EEG16 C EEG17 C EEG18 C EEG19 C EEG20 C EEG21 EEG22 Abs Rel Custom Custom LF Ob 0 1 3 5 QD 0 1 3 5 1 4 7 5 Q1 4 7 5 Treshold QA 8 13 QA 8 13 OB 13 30 OB 13 30 Ires in Fig 116 Vibraimage and EEG correlation for aggressive human state Corresponding to Fig 117 118 Vibralmage parameters has strong correlation with EEG parameters for aggressive state and have not any correlation with EEG when person is still That means that head motion depends on minds when person have high internal energy level or high emotion activity level and head motion does not depend on mind activity when person is still low energy and have not strong minds 127 8 4 Macromovements control in crowd Vibralmage system allows controlling macromovements macrovibrations as microvibration Controlled vibration range depends only from the camera angle camera object distance and movement amplitude of person Head microvibration informatively expressed reflex movements Vestibular Emotional Reflex but it s well known that human body macromovements expressed behavior and emotions too Macromovements control has powerful advantage compared with microvibrations it
18. analysis s results show hide histogram of frequency analysis of the set values Fig 22 Video windows switch on off the small windows with real image Fig 17 the button EH of the toolbar Status windows switch on off the windows with current suspect level Fig 17 the button a of the toolbar LD window switch on off the windows with current lie level Fig 17 the button E of the toolbar settings Acton v Toolbar O VIAVARID we Info bar Buttons save Image as Print Graphs Frequency analysis s results Video window Status window Image capture AVI Start capture ANT File VIDEO Mode d Preset d Pause VI AM AR LO mode Am made F Reset Graphs Start H 105 Start 5 105 Frequency analysis s results Start LD block Reset timers LE A AR A AR A A A KA RR RA A X A AAR ER AR DR X A E oo M e Fig 16 Submenu Buttons 26 D P SW Gerente GMCTEma HPNBIK ANA bralmage SeTebble MO AGODe ACTODarL ROB3MHa Protessii a m AGODe SNA IO TOS tes amcar 12 is id ALIS I ISI EOL Manager IS v Te TUR APABIK ANA putty af iy 27 O VIAVARID Am F R 2722575 Be Fs Ni st LD GR 35 9 ias ar Mi MV MM VTA Al A MAA Frame rate In jl j Fast processing Base processing DI TEI ANA MioKeYvi laker Video timer Info Paint Microsoft Word E ana The Bat Commander
19. command Print menu File To remove the received graph of the frequency analysis it is necessary to bring the mouse pointer to the chosen diagram to press the right mouse button and to choose item Delete 43 3 3 2 Image area control from preset In the field of the image area Fig 39 46 depending on the chosen mode Fig 38 the user can see the real video image vibraimage external vibraimage aura or graphs time dependences for control in LD mode or any other mode m settings Acton v Toolbar x 4 Info bar 1 Buttons d Graphs Frequency analysis s results Video window Status window LD window Mode E VI AN v AR LO Fig 36 Menu View Preset image area mode Item Presets menu View designed to choice one basic mode in image area In VI mode Vibralmage mode displays vibraimage of person Color for every image pixel depends on its amplitude or frequency of vibrations Fig 39 40 In AV mode Aura Vibraimage mode external vibraimage aura allocated around the internal vibraimage or simple vibraimage Aura line size depends on medium line vibration amplitude Aura line color depends on maximum line vibration frequency inside vibraimage contour Fig 41 42 In AR mode Aura on the Real image the aura of the person is shown around his real image Fig 43 44 e In LD mode Lie Detector mode image area shows real object
20. dialog Click Close after installation complete 2 Press button Next in the appeared window of the beginning installation 3 Accept the license agreement and to press button Next in the appeared window 4 In the appeared window specify a way to the catalogue where files of the program will be written down then to press button Next 5 Press button Next in the appeared window allows installation of software files on your computer 6 Press button Close at the end of installation 7 Vibralmage program pictograms appears after the end of installation in system menu and on desktop of your computer 8 To reboot a computer 9 Install Guardant driver from DVD before start Vibralmage 7 0 Connect dongle to USB port of computer and start Vibralmage exe Note Auto installation for every system component is made according to the recommendations specified in section 2 4 of this description 16 2 4 Auto Installation 1 Check System Requirements NOTE check the version of DirectX software on your computer 2 Close other applications 3 Insert your DVD Vibralmage7 0 into DVD ROM The file of installation autorun exe will be automatically started If the file has not been started start it manually 4 Choose language of installation in appeared window Fig 9 Fig 9 Language selection for installation procedure 5 Further in the appeared window will be offered to begin installation or to
21. earliest effec GO6K 9 36 2006 01 sensitive multielement transducer 1 and means for pro tive US filing date of the application subject HO4N 7 18 2006 01 cessing the images of the picture to picture difference which to any statutory extension G06K 9 00 2006 01 contain an exposure memory 2 3 a unit for evaluating the s 52 US Cl sss 382 216 382 107 382 118 picture to picture grap 4 a miele pietre differ If this application was filed on or after June 8 382 130 382 181 348 32 348 77 ence summator 5 and control registers 6 The device ig is twe 58 Field of Classification Search 348 32 accumulates the sum of the exposure differences detected by 1995 the ferm of this patent is twenty years from en S 348 77 155 430 431 699 382 107 109 the photosensitive multielement transducer the US filing date subject to any statutory ex 382 115 118 130 181 218 219 294 307 tension If the application contains a specific Sec application file for complete search history 6 Claims 4 Drawing Sheets reference to an earlier filed application or ap plications under 35 U S C 120 121 or 365 c al 1 the term of the patent is twenty years from the date on which the earliest application was filed subject to any statutory extensions WD ate Director of the United States Patent and Trademark Office AM M M Pm e Fig 7 United States Patent US 7346227 Fig 8 United States Patent US 7346227 1 pa
22. for person image input and personal computer for processing of the received images Software functions Vibralmage software solves the following technical tasks e Emotional levels recognition and detection e Lie detection e Monitoring of person physiological parameters e Creation and the analysis of digital videos of files in format AVI e Surveillance in real time vibraimage e Surveillance in real time images of aura e Save the visible image in a file in format BMP e Measurement in real time integrated characteristics of vibraimage e Recording of integrated characteristics vibraimage received for certain time in a LOG file e Input and save the demographic data in a file in format TXT e The structured save of visible images in files in format BMP according to the entered demographic data e Print out the kept images and the corresponding demographic data 12 2 Before you begin 2 1 Information and Precautions Notice concerning privacy Do not use this system for purpose of person privacy irregularity Note that simply being in possession of material that was digitally copied or reproduced by means of a scanner digital camera or other device may be punishable by law NOTE Disposal of this product is acceptable only in accordance with Local and National Disposal Regulations 2 1 1 Power supplies requirements Power supply depends on your location and power supply of you computer and camera For low noi
23. image and selected graphs Fig 45 46 NOTE Selected graphs depend on Graphs switch position which sets graphs time dependences of chosen parameters Fig 39 46 44 Fi Vibraimage 2008 04 22 15 31 38 AVI File View Settings Action Gs bel D 2 ma O VIAVARID Am FOR v S527 23 a VI ST LD GR 9 fad ae VI VI VIL VIS uM AA Frame rate VI N A 100 00 39 In Fast processing Base processing Video timer Info 100 1 00 2 00 Width 640 Height 480 Statistics IntegratedN Am 8 75422 IntegratedN F 9 60600 Anger lt Fig 39 VI mode SB Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action W 92 ma O VIAVARDD Am FOR v 17527 a VI ST LD GR E 9 fa e VI VI VS VS VAYA NA F t d LI i I y A IntegratedN F 3 55 50 Fast processing E M pn 5 i i i i Base processing y Video timer Info 100 1 00 2 00 E o width 640 A P5 nox t 3 55 50 Height 480 OW zx unn Statistics IntegratedM Am 8 75422 IntegratedN F 8 60600 4 0 00 Anger Lo Ea lt PBA crpecc t 3 55 50 P7F arpeccua t 3 55 50 Fig 40 VI mode with graphs Fi Vibraimage lt VIDEO Look 1320 V2 gt DEAR File View Settings Action Os H10 810 0 LD W 92 ma O VIAVARLD Am FO RW Msi VI ST LD GR O E e me e V2 V V Y MN AA Frame rate VI N A 100 In Fast processing Base processing Video Timer In
24. it 1s possible to look on head movements according to the vibraimage system and technology We supposed that head balance for person without consciously movements could be considered as isolated thermodynamic system and any emission of internal energy would change the balance of this isolated system and realized by movements or vibrations Every emotional state characterized by specific energy conversation and work done by the system transfers to micro vibrations if the person forced to stand or seet still The head vibtration parameters frequency in range 0 1 10 Hz and amplitude are stable in time for stable emotional state of person Parameters of vibrations changed only after emotional state alteration Vibralmage technolgy allows to contactless register of person vibration parameters and calculates emotions according to accomulated statistics of comparitive testing with EEG skin galvanic reaction and psychological testing Vibralmage technics parameters and research results are below 117 8 3 1 Vibraimage parameters Amplitude and frequency of human head vibrations differs in every point of space and total processing of this every point meaning could present integral movement parameter of person Some vibraimage pictures of one person reflects amplitude Fig 110 and frequency Fig 111 space distribution of vibrations are showed below visualized by color scale Fig 112 Fig 110 Frequency vibraimage Fig 111 Amplitude vibraimage Fig
25. permits crowd control Microvibration control has powerful advantage compared with macromovements it allows auto control Both of them are realized by Vibraimage system with different settings Accumulation period for macromovements registration 1s smaller than for microvibration registration It mostly determines by the speed of human body movement and do not suppose movement accumulation and movement repetition Typical accumulation period for macromovements covers 1 second and maximum setting N accumulated frames depends on camera frequency for example for 15f s user stands N 15 or for 30f s user stands N 30 There is no sense to stand difference between base processing and fast processing frequency for macromovements registration For micromovement analysis was recommended to stand base processing frequency lower than fast processing because head micromovement is practically invisible for time period less than 0 1 second But for macro hand movement or body movement it is not so and when person is active or aggressive it moves very fast so it is recommended to stand base processing frame rate between 15 30 f s Also for macromovements analysis 1s recommended to set frame number N 2 5 because standard 2 frames accumulation gives more red color for any movement tired operators eyes and use this window in amplitude or frequency mode For N 10 and N 15 30 used frequency mode Changes in Information Table settings between default mode micr
26. process of AVI file is carried out on a command AVI Stop Capture menu File File The same actions can be executed with the help of the corresponding button of the toolbar Fig 63 For choice of the catalogue where the video file will be kept is intended a command Database folder menu File Fig 14 or a line DB folder an information panel in DB table Fig 78 NOTE that in the specified catalogue will be written down 3 files video file with expansion avi file with the current adjustments of system with expansion set and a file with the report of changes of parameters with expansion xml For increase of video files recording reliability designed the field Capture max length s records in seconds Fig 80 If record lasts over the specified interval current AVI the file will be closed and save on a disk and record will be continued in a new file At filling the whole disk if the switch Capture purge old files record of new video files will be made atop of old The first oldest will leave by date of creation video files The user can set time of the beginning and the ending of record fields Timer If in the image area you have switch on some windows with video data for example open 3 window Fig 82 submenu Settings Capture channel allows to choose from what window video data will be saved in video file 91 Fi Vibraimage VIDEO Look 1320 V2 gt File View
27. record in archive folder Print printing the current frame from image area Print Preview printing preview of current frame from image area Print Setup set printing options File View Settings Action Save image as Fe Database folder Ctrl F2 New record F4 Print Print preview Print setup AVI Start capture F5 Image capture icErl F5 Exit Fig 14 Menu File 24 AVI Start Capture start record AVI file If the database folder is not specified record of AVI files is blocked AVI Stop Capture stop record AVI file Image capture saving the current frame from image area in selected archive folder as BMP files Exit exit from program 3 2 2 View menu View Fig 15 defines visible in the basic window information and contains the following items e Toolbar e Info bar e Buttons e Graphs e Frequency analysis s results e Video window e Status window e Mode e Presets View setoinds Acton e Toolbar X4 Info bar Buttons Graphs Frequency analysis s results video window Status window LO window Mode Preset a Fig 15 Menu View 25 Toolbar switch on off the toolbar Info bar switch on off the information panel Buttons switch on off buttons on the toolbar Fig 16 Graphs show hide graphs of the set parameters Fig 44 45 Frequency
28. sound use for load AVI files without audio support This mode designed for work with VibraSound mode The subitem RGB8 compressor are intended for management of a videofile record format If this item 1s chosen that for economy of a space on a hard disk the videofile saved in a black and white format 29 The subitem IP camera 1 allows to set network parameters for access to IP camera Note that value of parameters Host Port User and Password it is necessary to receive at the your local network administrator Submenu Audio Fig 20 allows to choose the audio source device and to adjust its parameters which are necessary for operate in Lie Detector mode For example this menu contains the following items NOTE The content of the given menu items can differ depend on your audio device ETT Action Video 1 EN 7r 4X7 nr Audio Settings Language d Audio Capture Filter Record group d 4 SoundMAX HD Audio I Video mask Oo nm Capture channel Skype mood F ig 20 Submenu Audio Before operation in lie detector mode select menu Settings Audio Settings Audio Devices Before using Vibralmage in this mode you may also control the level of audio signal red strip as shown in figs 58 60 Change of input audio signal options in a corresponding field of information column in ST mode Fig 59 60 Level of audio signal the red strip 1s necess
29. time interval for informative characterizing of human behavior through macromovements However sometimes specialist with own experience changed this intervals according the concrete conditions and aims It concerns others settings too Profiler or security staff view person during limited time period about 30s in real ticket control and provided testing showed that this time period 1s enough for conclusion Anger stress or nervous person has constantly higher movement activity and differs from the others passengers practically during whole time period Such person could not be so calm and poor color as staff which is practically invisible in vibraimaging or other normal passengers E Vibraimage lt 20080528113113 avi gt File View Settings Action WY d Ay OVI AV ARD am e R 2525 c5 s VI 2 A 5 01 25 visti GR O El E oR ua viz vo ee Va AT NN Fast processing Base processing Video timer Info Height Statistics IntegratedN Am IntegratedN F Anger Sress VI 10 F119 01 25 Fi vibraimage lt 20080528113113 avi gt File View Settings Action ld 23 avi OVI AV ARID Am FOR M SUS um VI sT iD GR O El Y E dae an Me viz MM VM A A Frame rate SRC 01 3 In Fast processing Base processing Video timer VI 2 A 5 01 38 Info Height Statistics IntegratedN Am IntegratedN F Anger Sress Tension VI 40 F112 01 33 VI N F 15 01 38 Fig 123 Suspicious
30. transfer like red color could transfer to blue Fig 106 107 Stress level more than 0 7 Aggression or activity level is low not more than 0 5 and tension level is high and usually more than 0 4 Frequency distribution histogram has several modes and high speed vibraimage signals spectrum presents superposition of exponential and uniform distributions Figs 106 107 Aura photos samples for stress condition of person 116 Aggressive and or tension state Aggressive state is not every time coordinates with tension and tension state is not always coordinates with aggression But often these two emotions accompany each other Aggressive state obligatory characterized by high frequency vibrations and red colors in aura Aura size 1s more than normal and gaps could absent but color and form non uniformity must present Fig 108 109 Stress level could be low less than 0 3 Anger level more than 0 7 and tension level more than 0 4 Frequency histogram distribution has maximum in right part of the range and distribution has amount dispersion High speed signals spectrum envelope looks like uniform distribution Figs 108 109 Aura photos samples for aggression condition of persons 8 3 Emotion recognition Head movements in space classically associated with vestibular system are studied and discussed in relation to the status of vestibular reflexes 1 e the vestibuloocular vestibulocollic and cervicoocular reflexes But
31. 00 0 000 0 000 K Pb s4 0 367 0 000 0 000 0 000 0 000 rss 0 009 0 000 0 000 0000 0 000 EP S6 0 050 0 000 0 000 0000 0 000 GPs 26 612 0 000 0 000 0000 0 000 PPI 56 599 0 000 0000 0 000 0 000 Bh P2 31477 0 000 0 000 0 000 0 000 amp RbP3 1 679 0 000 0 000 0000 0 000 E PPa 1 138 0 000 0 000 0 000 0 000 PS lie P7A ang P7F ang PGA str X mig gm mi mi mu mu mu ARA TU gt D Audio E Level Th Fig 60 The minimum value of input audio signal corresponding to silence 61 chin bMin cMax bma 0 133 0 000 1 000 0 000 O OO 1 575 0 000 0 000 0 000 OO 57 3 1 0 000 0 000 0 000 0 000 44 042 0 000 0 000 0 000 0 000 0 289 0 000 0 000 0 000 1 000 0 594 0 000 0 000 0 000 DO O00 0 01 0 000 0 000 0 000 0 000 0 090 70 0392 0 000 0 000 0 000 0 000 29042 0 000 0 000 0 000 0 000 160 32 0 000 0 000 0 000 0 000 0 106 pODO 0 000 0 000 0 000 0 404 0 006 0 000 0 000 0 000 142 433 0 000 0 000 0 000 0 000 7 507 0 000 0 000 0 000 0 000 0 321 0 000 0 000 0 000 0 000 1 36 7 0 000 0 000 0 000 0 000 0 0043 0 000 GOO 0 000 0 000 0 050 0 000 GOO 0 000 0 000 46612 0 000 0000 0 000 0 000 96 999 O F000 0 000 0 000 0 000 319 000G 0000 0 000 0 000 amp P3 1 673 pOODDO GOO 0 000 0 000 E lb Pa 1 138 0 000 0 000 0 000 0 000 P5 lie PRA and PF ang PEA str PEF str F5 teris PSA en FEF en PSA H PSF H P1IOA A PIO A P114 amp PliF P12A 5 EIE F13 P14 P15 F16 ER P1i Cs Fis Com om oe mi ooo ooo Audio
32. 3 786 0 000 0 000 gt FS 17 390 0 000 0 000 F4 77 222 0 000 0 000 FS fast 0 175 0 000 0 000 F5 0 346 0 000 0 000 3 424 0 000 0 000 0 268 0 000 0 000 4 138 0 000 0 000 0 170 0 000 0 000 0 117 0 000 0 000 0 162 0 000 0 000 6 049 0 000 0 000 vw ue tu RI ee 0 000 000 0000 E wvvxsvwxsvws GNR IntegratedN F t 3 20 20 321 PBA crpecc t 3 20 20 0 31 PZA arpeccua t 3 20 20 0 50 PZF arpeccua t 3 20 20 0 42 Fig 46 Graphs position adjustment 3 3 3 Submenu mode Item Mode Fig 47 selects additional settings of information in image area view Settings Action e Toolbar we Info bar Buttons Graphs Frequency analysis s results Video window Status window LD window Mode Preset Fig 47 Menu View Submenu Mode d wv Toolbar V4 SRC VI 2 Am VI 2 F YI 10 Am VI 10 F vI M Am VI N F DELTA Am DELTA F View Mode DELTA FA view Mode DELTA FB mode Am mode F Mouse fn Mouse line Sum line Centre e AVI timer w Tite Toolbar switches on off toolbar 49 Every item of the given menu for convenience of user are duplicated in the additional panel of toolbar Fig 48 A F A F A F A F A F Vi ur Vo Vo un A A A A A E Fig 48 Additional toolbar 50 NOTE Pressed buttons in toolbar correlated with windows in the area of images The maximum number of windows equal 13 Fig 49
33. A Level 15 4 T Mo Fig 61 The maximum value of input audio signal corresponding to voice Threshold value setup equal 7 If you have a sufficient operational experience with a lie detector you can independently make adjustment of numerical values of parameters from Al up to P4 having opened corresponding menu of the information panel Fig 70 62 After described adjustments Vibralmage system is ready for operation and is able to analyze the emotions of person and to detect lie for any person which image you observe in the basic window of the program Fig 13 The indicator of lie shows changes of values and the sizes of the histogram in line P5 lie of information column in mode ST Fig 60 61 Greater lie level of person verbal or nonverbal corresponds with more red strip size and bigger P5 value After the made adjustments the Vibralmage system 1s ready to work and capable to find out lie in any person which image you see in the basic program window Fig 13 The lie indicator 1s change of numerical values and the sizes of the histogram against a line P5 lie in an information column in ST mode Fig 67 or value which will be displayed in a window LD window Fig 62 The call of a LD window is made through item LD window the View menu Fig 62 or pressing of the toolbar button inadequately to the behavior than more red strip The more the person speaks lie or thinks The parameter Lie thre
34. A4 Fast Calc Ratel Rate2 Level p 44 Calc Ratel Rate2 Level p gt Fl Fast Calc Ratel Rate2 Level HF Calc Ratel 0 00 Yes 1 00 2 00 100 00 0 75 Yes 1 00 2 00 100 00 59 63 Yes 1 00 2 00 100 00 18 09 Yes 1 00 2 00 100 00 0 05 Yes 1 00 2 00 100 00 0 72 Yes 1 00 2 00 100 00 0 00 Yes 1 00 2 00 20 00 0 06 No 1 00 Fig 70 LD mode of information panel 3 5 4 GR table t GR table Fig 72 displays the following information Vibralmage parameters A1 A4 F1 F5 S1 S7 P1 P18 Total frame difference accumulation without filters for 2 10 and N the frames Integrated Parameters Vibralmage parameters with maximum frames frequencyA fast A4 fast Fl fast F5 fast Test signal sin 2 P1 nt Audio level for last seconds and audio level 25 fps for 1 25 seconds Vibralmage parameters X1 X5 which calculation is set by the user 75 76 GR table columns meaning V Current value of parameter Show Show graph Yes delete graph No Diff mode Choice of this mode YES graph will show difference between current value of parameter and its average level for Diff time Choice of this mode NO graph will show current value of parameter gMin Defines the minimal value of parameter shown on the screen gMax Defines the maximum value of parameter shown on the screen GR table graphs color marks indication G Graph shows in image area For convenience of obs
35. BeGuigeem Action Ll e O VIAVARID Am F R 8 5973 Ta MI ST Lt Language ok MZ V 2 VES iu AKA B Frame rate RECO In Video mask Base processing Video timer VI 2 Am Info Width VI N Am Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Tension Audio Level Fig 82 Select Capture channel for video recording for example from SRC channel 3 6 3 Save of Log files Vibralmage program allows to save in an external file results of measurement and processing of integrated intensity of image pulsation for some time interval Saving of values sequence for integrated vibraimage characteristics received for the certain time in a file of the report 1s carried out automatically at record of video file The user can define type and a format of a file in which reports will be made Fig 80 e extension xml viewing of file contents report is carried out by program Microsoft Excel e extension txt an ordinary text file 92 In a file are save changes in time of every parameter which numerical values can be observed in mode ST GR of the information panel NOTE that save of parameters carries events character 1 e as soon as value of parameter is calculated by system it save the name in a file therefore sequence of parameters records in a file 1s not fixed as some parameters demand more often calculation than others In addition the user can save in file with exten
36. PA 0 000 Eb A4 fast 0 000 amp b A4 l 0 000 E P F1 fast 0 000 MFI amp bF2 0 000 PFS 0 000 EP F4 0 000 X FS fast 0 000 amp bFS l 0 000 KSI 0 000 Ph S2 0 000 853 0 0 000 Eb s4 0 000 PSS 0 0 000 Ph S6 amp KE KE KE KE amp KE amp amp amp KE KE KE amp KE amp K amp amp KE KE amp P18 Com Audio E Leve Th Fig 59 Information panel in ST mode Level of audio signal down red strip 1s necessary to stand so that it was on the average position between the minimal value of a input signal which corresponds to silence in a room position of green strip on Fig 60 and the maximal value which corresponds to a voice sound of a person in front of the camera Fig 61 Position of a red strip stands by click of the left mouse button and input of a new value of a level vi ST Lp GRO E f Name cMin bMin cMax bMax EPA fast 0 133 0 000 0000 0000 0 000 EPA 1 575 0 000 0 000 0 000 0 000 Eh A2 67 371 0 000 0 000 0 000 0 000 PA 44 042 0 000 0 000 0000 0 000 Eb A4 fast 0 289 0 000 0 000 0000 0 000 Eb A4 0 594 0 000 0 000 0000 0 000 EP F1 fast 0 017 0 000 0 000 0 000 0 000 MFI 0 090 E P F2 70 092 0 000 0 000 0 000 0 000 EP F3 29 822 0 000 0 000 0000 0 000 Eb F4 160 732 0000 0000 0000 0 000 E b F5 fast 0 106 0 000 0 000 0 000 0 000 E PFS 0 404 0 000 0 000 0 000 0 000 EPsi 142 433 0000 0000 0000 0 000 EP S2 7 587 0 000 0 000 0000 0 000 GPrs3 0 321 0 000 0 0
37. VIAVARLD Am F R v 3252 x Em VI sT LD GR El 9 B ad V2 VIZ Yio Ma VIV NA 38 438 0 000 0 000 VIN A 100 00 41 16 340 0 000 0 000 DO O E Pe 44 fast 0 010 0 000 0 000 E A4 0 077 0 000 0 000 0 002 0 000 0 000 0 016 78 799 0 000 0 000 24 433 0 000 0 000 141 819 0 000 0 000 0 203 0 000 0 000 0 394 0 000 0 000 46 080 0 0 11 501 0 0 0 000 4 427 0 0 0 000 0 524 0 0 0 000 0 287 0 000 0 000 0 115 0 000 0 000 20 346 0 000 0 000 0 000 O O O O Fig 55 Frame difference Sum lines on the image In Centre mode to the field of information display are added 3 vertical lines blue line displays vibraimage center for N 2 green line displays vibraimage center for N 10 red line displays vibraimage center for N 100 Fig 56 TA lt VIDEO Look 1320 V2 gt OR Fie View Settings Action 4 p 2 v O VI AV ARLD Am F R w 375 o re VI sT LD GR 5 coke UN va M s M uM A A n AK a Frame rate In Fast processing Base processing Video timer Info Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress lt Fig 56 Vertical center of vibraimage lines on image The item Mouse fn is reserved for later version of Vibralmage 57 Item AVI timer and Title displays in the left top corner in each of visible windows with images the name of a processing mode which is used for the given window and time from the beginning of viewing AVI fil
38. a 3 User and Password set login and the password of access to the network camera HTTP user registration record for access to IP camera 4 Url a path to a virtual file on the camera which corresponds to video stream in MJPEG format The name of a file can depend on model of the IP camera Than in Vibralmage program it is necessary to choose the Subitem IP camera 1 the Settings Video menu and to make settings of network parameters for access to network IP camera Fig 102 The field FPS sets number of the frame in a second which will be given out IP camera in a network NOTE that the number of the frame in a second which will reach your computer depends on throughput and congestion of a local network And if for example it 1s set FPS 15 but on a network the frame come with smaller speed the missing frame in the program will be added by copies of the previous accepted frame 112 IP Camera ES Host 192 168 0 20 Port at User User Password 12345 Url mipeg cgi FPS 15 Cancel Fig 102 For example IP camera model D Link DCS 910 settings 113 8 Vibralmage system operations This item gives some recommendations and samples for human emotion control realized by vibraimage system 8 1 Vibraimage processing norms Note Default system settings coordinate with the following human parameters for normal state e Level of aggression Vo no more 75 e Level of stress
39. active vibraimage pointer for full frame square Vibraimage pointer is active if its brightness move than Level L value Compatibility for 2 person Calculated on frequency histogram analysis concurrence with normal distribution Fig 68 69 Compatibility for 2 person Calculated on aura symmetry analysis Average compatibility 72 je f im Fig 69 Incorrect position of people at check of compatibility 73 74 3 5 3 LD table Lo LD table Fig 70 shows the following information e Current values and LD rates of based processed Vibralmage parameters A1 A4 FI F5 S1 S7 P1 P18 e Current values and LD rates of fast processing Vibralmage parameters Al fast A4 fast F1 fast F5 fast LD table columns meaning V Current value of parameter Calc Yes LD detection on No LD detection off R1 Ratel Weight of parameter if its current value became more than the set base maximum bMax OR became less than the set base minimum bMin R2 Rate2 Weight of parameter if its current value became more than the set base maximum bMax AND became less than the set base minimum bMin LD parameters graphic value shows gt Value of parameter is considered for LD detection O Value of parameter doesn t considered for LD detection VI STD GR O E P Al fast Calc Ratel Rate2 Level pal Calc Ratel Rate2 Level p A2 Calc Ratel Rate2 Level p A3 Calc Ratel Rate2 Level gt
40. ams for external vibraimage aura and in the third spectrums of the frequency analysis with application of FFT of two parameters selected in GR submenu of the information panel Fig 72 are displayed 67 Fig 65 Histograms window 3 5 1 VI table VI table Fig 66 displays the following information Frame rate In Number of the frames per second received from the video source Fast processing Maximum number of the processed frames per second used for calculation Selected by user Base processing Number of the processed frames per second used in base algorithm Selected by user Video Timer For camera mode displays time of supervision For recorded video time of current video file record For viewing a video file time from the file beginning Info N Number of the frames for accumulation Selected by user K Gain Factor Selected by user L Palette Threshold Defines a threshold in the displayed image value of brightness less threshold is considered black Selected by user Width and Height Displays the current video camera or avi file resolution 68 Statistics e IntegratedN Am Average frame amplitude vibraimage intensity processed for the N frames e IntegratedN F Average frame frequency vibraimage intensity processed for the N frames e Suspect Calculated level of suspect for object in frame e Anger Calculated level of anger for object in frame
41. aph scale Menu Action Fig 93 consists of the following items e Play Acton Pause Integrated2 Am OX 102 The choice of item Play makes start of video file viewing and calculation of graph vibraimage parameters changes It also can be replaced by the corresponding button of the toolbar Item Pause stops viewing a video file and calculation of graph It also can be replaced by the corresponding button of the toolbar Menu Help consists of the following items e About VILogViewer information about program version 5 2 Information panel 103 The information panel Fig 94 displays basic parameters of the recorded results Functional purpose of information panel is similar to purpose of information panel of the basic module Vibralmage exe in GR mode see section 3 5 E Al fast Show gMin gMax amp A1 Show gMin gMax Show gMin gMax E a3 Show 0 50 0 19 No 0 00 1 00 BA 56 29 Yes 0 00 200 00 23 42 No Fig 94 LogViewer information panel LogViewer parameters indication Va Show gMin gMax Current value of parameter Switch defines will be show or not selected parameter in the field of images Defines the minimal value of parameter shown on the screen Defines the maximum value of parameter shown on the screen Parameter graphic values shows E Indication parameter in image area For convenie
42. ar Fig 87 duplicates accordingly the following items menu e Delete delete selected record from persons list Fig 87 Toolbar 4 4 Status bar The status bar Fig 88 displays the current information on the chosen menu item and the button of the control panel Ready Fig 88 Status bar 5 LogView module LogView module VILogViewer exe is designed for viewing and the analysis results of Vibralmage program operation Main window of LogView module Fig 89 consists of the following parts e main menu e nformation panel display parameters e Area of graph result supervision e toolbar D 2008 04 22 15 18 28 ViLogViewer File View Action S pil gt lt megdteiim P bb db ib bbb bi t 1 866045 v 0 181049 Fig 89 Main window of LogView module NOTE supervision of a video file can be made both from the beginning of a file and from any chosen place For a choice of the beginning place of viewing it is necessary double click by the mouse left button to note this place On the chosen place the marker a vertical line of green color Fig 86 will be established and the system will pass to a mode Pause Start of system is carried out by button Play 99 5 1 Main menu File View Action Help Menu File Fig 90 consists of the following items e Open e Print e Print Preview e Print Setup e Recent files
43. ary to stand so that it was on the average position between the minimal value of a input signal which corresponds to silence in a room see position of green strip on Fig 59 and the maximal value which corresponds to a voice sound of a person in front of the camera Fig 60 NOTE System Vibralmage correctly works in a lie detection mode only when adjustment of input audio signal procedure of adjustment see above is made The moment when the person started to speak is used by system for the beginning analysis of the data Vibraimage parameters during speaking are compared to the data received earlier for example when the person was silent 30 The menu Language contains the list of supported languages Fig 21 Settings Action video Audio M VI e English FOCK k k Language d Record group i k k Video mask Capture channel Skype mood F ig 21 Submenu Language Submenu Record group Fig 22 allows to choose the number of the catalogue where video files will saved NOTE The direction to the catalogue should be set beforehand Sige Action Video Audio L VI Language j Record group e Default Video mask Ji Capture channel 2 Skype mood 3 A Fig 22 Submenu Record group If in the image area you have switch on some windows with video data for example open 3 window Fig 23 submenu Capture channel allows to choose from what window v
44. ble DataBase table Fig 78 adjusts parameters of recorded video information and shows the following information DB folder Way to the database folder for written video files and files of statistics Capture max length s Defines the maximal length in seconds for recorded video file After file limit finished and closed a new file creates Capture purge old files Defines system action when the empty space on a hard disk will finish YES the oldest video files will be removed Timer The system can begin record at the appointed time Save extra information save XML save TXT define in what format the information on system settings and on system parameters change for the period of supervision will be saved Selected record Data on current object of research New record Name Birth date Comments The demographic information on object of research VI ST LD GR amp sl Capture max lengths O purge old files Mo timer Mo stop in HH MMS start at HH MIMSS stop at HH MM SS save extra info ho save AML ho save TXT ho DB folder C default Selected record Hew record Akimov Valera 12 09 1973 Didenko Tatiana 01 0 1 1958 Kiseley Dmitry 10 09 1971 Martynov Oleg 18 06 1987 Minkin viktor 05 04 1953 Fig 78 DB table 87 3 5 7 Network NW table Network NW table information panel Fig 79 adjusts network monito
45. can deform received result dramatically 2 This version of the software is designed for visualization of external vibraimage aura only for one object in the frame therefore the moving objects which are taking place near to the basic object of research can essentially influence and deform aura of the basic object Vibraimage visualization is carried out without high dependence from quantity of objects in the frame 3 There is a certain delay between vibraimage parameters of the person and visualization of live video on monitor The time of this delay basically is defined by chosen time of frame averaging For example if real speed of system 5 f s and chosen time of accumulation of 50 frame the objective vibraimage parameters of the person can process not earlier than in 10 seconds after processing start 4 The developed version of system is sensitive to the certain object macromovements even at the switching Moving Filter therefore for reception of objective vibraimage parameters person must in the natural and stable state standing or sitting Note The correct analysis of person emotion levels and lie detection is possible only at detail execution of the recommendations stated in the given document and by processing of high quality vibraimage 2 2 Getting started 2 2 1 Digital camera driver installation Note Auto installation of system components is made according to the recommendations specified in section 2 3 of
46. ction window Fig 13 consists of the following parts e main menu e image area e toolbar e information window In heading of the basic window the following information is deduced e type of video source Video camera or AVI file e model of video source Video camera model or AVI file name e Name of running Vibralmage module 22 rs Vibraimage 2008 04 22 15_31_38 avi gt OX File View Settings Action Help o a H10 S10 lt 7 LD REC T 0 W P cmo W VIAVARID Am FOR OY S a E VI ST LD GRO 2 OK MEM MV vBVI A A A A Bg m om Frame rate y In lt Fast processing Base processing Video timer x A PP ua AAA ji T IntegratedN Am IntegratedN F Suspect Aggression Sress Tension Fig 13 Multifunction window of Vibralmage exe module 3 2 Main menu The main menu contains the following items e File o View o Settings o Action e Help 3 2 1 File menu File menu Fig 14 contains following items Save image as Database folder New Record Print Print Preview Print Setup AVI Start Capture AVI Stop Capture Image capture Exit 23 Save image as saving the current frame of a window in BMP JPG PNG or GIF file Database folder changing folder where archive data is kept If the database folder is not specified record of AVI or BMP files is blocked New Record Create a new
47. culation gH v g Value of parameter doesn t considered for level of lie calculation GR e Es 0 133 1 575 67 371 44 042 0 209 0 594 0 017 0 090 70 092 29 022 160 732 0 106 PS lie P7A ana PF ang FEA str PEF sir F5 tens PBA er PEF en PSA H POF H P 10A A POF A P114 P11F amp P124 5 PIES F13 P14 F15 P16 CM EIUS P16 Com E E E E E E E amp E E amp E amp E E E E E amp E amp E Audio Level Th m Fig 67 ST table 71 The group of parameters A1 A4 registers amplitude of vibrations A1 A2 A3 A4 Frame difference between two consecutive frames Frame difference accumulated in 10 consecutive frames Frame difference accumulated in N consecutive frames Value of parameter A1 filtered on 10 frames The group of parameters F1 F5 registers frequency of vibrations amount of changing points Fl F2 F3 FA FS Calculated value of changed signal pixels amount in 2 consecutive frames Averaged value of changed signal pixels amount in 10 consecutive frames Average value of elements quantity which have changed for the period of N frames Changed pixels maximum frequency during N processed frames Ratio of high frequency density to low frequency for parameter Fl Characterized tension parameter ES tens current tension level The group of parameters S1 S7 registers symmetry of vibrations between left and right parts
48. e Exit View Acton Open Print Print preview Print setup EA 2008 04 22 15 18 28 06 1 14 18 41 2 20106 Exit Fig 90 Menu File The item Open is intended for a choice and opening of results file It also can be replaced by the corresponding button of the toolbar The item Print prints out graphs from area of supervision The item Print Preview used for preliminary viewing listing The item Print setup used for a choice of the printer and settings printing parameters The item Exit used for exit from the program 100 101 Menu View Fig 91 consists of the following items e Toolbar e Zoom In Ctrl e Zoom Out Ctrl e Language rm Action v Toolbar Zoom out Ctrl Zoomin Ctrl e English PYCCELAM Fig 91 Menu View Toolbar switch on off the toolbar Language select current interface and help language Use items Zoom In Ctrl or Zoom Out Ctrl to zoom in zoom out the image in the printing area for example compare scale of graphs see Fig 89 and Fig 92 Items also can be replaced by the corresponding toolbar buttons De 2008 04 22 15 18 28 ViLogViewer Fie View Action s PH 0 E Settings Period s E Integrated2 Am Show gMin gMax E Integrated10 Am Show gMin gMax KE IntegratedN Am Show gMin gMax 10 0000 0 93 Yes 0 00 50 00 Fig 92 Increased gr
49. e Fig 57 Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action HS D ama O VIAVARLD Am F R 957077 VI ST LD GR E Y 18 874 0 000 16 694 0 000 0 006 0 000 0 026 0 000 0 001 0 000 0 009 64 810 0 000 24 631 0 000 170 452 0 000 0 176 0 000 0 315 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 H10 S 10 7 LD ANAIE Aw F A nae A AF e E E M LPS Vlo LL MU Y n A A VI N A 100 00 50 Fig 57 Title of image and video time for AVI file 58 3 3 4 Lie detector settings It is necessary to stand special adjustments of Vibralmage system for operation in lie detector mode concerning audio and video devices For operation in lie detector mode the choice of the channel of a audio source is carried out through the window of the settings caused with the help submenu Settings Audio for example a microphone Fig 58 Settings Action Video HH am AXT nx Settings Audio Language Audio Capture Filter Record group l 4 SoundMAX HD Audic I Video mask Ld k k k k Capture channel Skype mood F ig 58 Audio source channel select Before working in Lie Detection mode adjust the level of audio signal Changes of audio signal input options are made in a corresponding fields of an information panel in ST mode Fig 59 59 vi ST LD GR 5 Name cMin Eb A1 fast 0 000 PAL 0 000 KPA 0 000 E
50. e Stress Calculated level of stress for object in frame e Tension Calculated level of tension for object in frame e Level current level of audio signal Vi ST LD GR El Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Tension Audio Level Fig 66 VI table from information panel 69 3 5 2 ST table ST table Fig 67 shows the following information e Current values of based processed Vibralmage parameters A1 A4 F1 F5 S1 S7 P1 P18 e Current values of fast processing Vibralmage parameters A1 fast A4 fast F1 fast F5 fast e Current audio level and audio threshold ST table columns meaning V parameter current value cMin minimal parameter value during past stat period only in LD mode cMax maximal parameter value during past stat period only in LD mode bMin minimum threshold value of parameter only in LD mode during past stat period bMax maximum threshold value of parameter only in LD mode during past stat period NOTE values of parameter cMin cMax bMin and bMax displays only when the LD mode is switch on In other modes in these fields will be show 0 for example see Fig 67 ST parameters color marks indication Green G shows parameters indicated as graphs Does not show graph parameter in image area Value of parameter considered for level of lie cal
51. ed person stands approximately on one distance from camera That means inadmissible to compare people stands on 1 m and 10 m before camera but distance from 10 till 15 m 1s admissible for control Vibraimage shows movement amount and person with more high movement amount marks by the warm colors based on standard vibraimage scale from more still around Vibraimage 7 2 software window allows observe persons in different mode on one display so specialist could analyze person behavior with source image and several vibraimages that greatly raise informative of psychological analysis Of course staff needs to receive some experience of manual analyzing because it 1s necessary to compare people performing equal movements for example standing with standing giving ticket with giving ticket moving luggage with moving luggage and so on Several pictures from tickets and luggage control shows on Figs 122 125 Figs 122 and 123 captured by the one camera on the ticket control in the same conditions and differ by several minutes It is clear visible that one person on Fig 123 differs by colors from everybody persons on Fig 122 and Fig 123 Furthermore this person has more frequency colors in every vibraimage window captured with different accumulation frames number N 5 10 15 This three vibraimage windows give comparative information about person movement amount in different time periods as 0 3 0 65 1 0 second Experimentally it was selected as optimal
52. erving a line of parameter will be marked by rose color Fig 71 Graphs doesn t show in image area Selected parameter displays in down spectrum histogram by green graph Fig 72 EH B Selected parameter displays in down spectrum histogram by red graph Fig 72 H H Parameter doesn t displayed by graphs Fig 71 Selected parameters spectrum VI ST LD Show Diff made gMin Diff made gMin gMax R H ll integrated Am Show Diff mode gMin gMax GH HAL fast 0 08 Show Diff made gMin gMax 10 00 EM Hat 5 93 Show No Diff mode No gMin 0 00 gMax 10 00 GH HAZ 67 25 Show Yes Diff made No gMin 0 00 Diff mode gMin gMax BH H A4 Fast Show Diff mode gMin Fig 72 GR table 71 78 3 5 5 Information table Information table Fig 74 allows adjusting vibraimage parameters and displays the following information Fast processing Base processing Frame Rate Settings Frequency fps for processing fast parameters of vibraimage noted by a word fast Frequency fps for processing base parameters of vibraimage noted by a word base FPS proc period Frequency of the frames fps during calculation period Downrate Reduce input frame rate At value 3 will be processed every third frame Main settings N 2 Minimum number of accumulated frames By default 2 N 10 Average number of accumulated frames By default 10 N Maximum number of accumulated fra
53. es Time in seconds for upper histograms accumulation top graph on fig 73 Time in seconds for middle histograms accumulation Time in seconds for down histograms spectrums accumulation fig 73 Reserved for future use Define histogram calculate mode in two top fields of a histograms window see Fig 73 The user can compare the frequency distribution of vibraimage to one of base distribution laws 0 Work mode histogram calculate on base of real video image analysis 1 displayed EXP law of distributions 2 the normal law of distributions 3 the uniform law of distribution 4 single peaks 5 SIN signal Factor n defining period of Sin graph generated 81 Fig 73 Histogram window Enable Stat periods Lie threshold LD mode Anger Stress Tension Suspicious audio manual auto Lie detection Enable LD mode Time period of normal person condition before LD testing Threshold in for the detection of lie level in view of every calculated parameters and their weights Selection of mode for lie detection Calculation of lie level starts when the level of entrance audio signal exceeds the established threshold LD calculation stops when the level of audio signal becomes less than the established threshold Accumulation of the information 1s made in time Stat periods Calculation of lie level is made only after pressing button Start LD end of processing after pres
54. ferent applications The method system and the device of said Vibralmage technology are protected by the patents of Russian Federation RU 2187904 Fig 3 RU2289310 Fig 4 Software Registration N2006614137 Fig 5 United States Patent US 7346227 Fig 7 8 and awarded with Gold medal on the international exhibition of inventions and innovations Brussels Eureka 2002 Fig 6 PCC AS ILI A LoT 7 B A HA H3OBPETEHME Ne 2289310 vei ces DA DATO e epa ee a X X ES ES D D D YA 34 X yal X X X X X pS pS pS X X 34 X X amp X D 34 Xx p 34 X pS X ES D X D x K X X D 34 X M4 G A o IA RA EX ER ER XR ee EX EY EX EX EX XR XR E XX EX XR EX EX EX RE K EY EX EY Gd Fig 3 Patent of Russian Federation Fig 4 Patent of Russian Federation RU 2187904 RU 2289310 CBH IETEJIbCTBO 06 o pxuunmabHo perucrpauuu nporpaMMbi aia DBM Ne 2006614137 DIPLOMA MINE P eto STAM Blanda lt IIporpamMa AMCTAHUMOHHOTO CCKOHTAKTHOTO CKAaHHpOBAHHsI H MACHTHQAKAUIMH NCHXOPA3HONOTMYIECKOTO COCTOAHUA YENOBEKA gt lt Vibralmage 6 0 IIpasoo6zazarezb OOwecm o c oepanuuenno omeemcmeennocmoio lt Mnozonpopunvnoe npednpuamue Iacuc gt RU Pa qi dee poor corse uerit irure Asrop si Munxun Buxmop Aav epmoeuu Axumos Banepu Aaexcanapoeuu RU M daille d or A h T i dun s 3aaska No 2006613400 Hara nocrynnenua 3 OKTA PA 2006 r 3aperncrpu
55. fo Width Height Statistics Fig 41 AV mode UU Vibraimage VIDEO Look 1320 V2 File View Settings Action e H10 S10 c LD E D ma VIAVARLD Am R 222172 Qa VI ST LD GR O E e lad C V2 VIZ VS VIS Via Yin A A Frame rate E E IntegratedN F t 08 00 Fast processing 143 lt gt S amp S Base processing 51 Video Timer Tr Info L a i i PBA crpecc t 08 00 Width Height Statistics Fig 42 AV mode with graphs Fi Vibraimage 2008 04 22 16_16_47 Eel File a Settings Action Help G amp o s VIAVARLD Am FOR 122225 VE ST U Ope Woo 8 fag qa V2 VI 2 j Mig Me Y I vl N IAA Frame rate In Fast processing Base processing Video Timer Height Statistics Fig 43 AR mode Fi Vibraimage 2008 04 22 16 16 47 ER File View Settings Action Help E D 2 ma O VIAVARID am R 4 52572 m2 VI ST LD GR El 9 dad e VIS V VS VL WAYNIA A Frame rate In Fast processing Base processing 51 Video Timer 1 LI LI Li IntegratedN F t 02 50 Info PSA Gi ecc t 02 250 Width Height Statistics 0284 i ob ob i i i aoo T PZA E t 02 50 M PTF MINA RAND t 02 50 Fig 44 AR mode with graphs 46 47 NOTE It is possible to playback recorded information from AVI files with graphs on the screen in image area For this purpose it 1s necessary to execute the following actions Switc
56. g 63 duplicates correspondingly the following menu items Save Image File menu 97 Print Image File menu Save current image to the archive File menu y I AVI start record File menu For stop AVI files recording needs push on this button again load AVI file Settings menu Camera image from camera E Stop Start Action menu VI mode View menu AV AV mode View menu AR mode View menu LD mode View menu Amplitude analyze View menu Frequency analyze View menu Reset all accumulated information about frame difference Start accumulation again after reset Action menu Mouse Histogram View menu H10 Frequency analysis 10s gathering of information for 10 seconds Action menu 10 Frequency Fourier analysis 10s gathering of information for 10 seconds and its processing by Fast Fourier Transformation Menu Action baz Results of the frequency analysis switching in a mode of frequency analysis graph display to begin data processing for a Lie detector mode Menu Action REC o Manual switch on off of a preliminary data gathering mode for Lie detector Menu Action 1 0 o reset timer of video files to 0 Menu A ction H ay av a MO VI AV AR LD Fig 63 Toolbar AW H10 810 LD AEC we wo Ses D ME _ 65
57. ge 1 Useful information 1 1 Basic applications Human emotions control system further system Vibralmage intends for registration analysis control and research of human emotion state for different applications in the fields of security biometrics psychology medicine electronics and human life Vibraimage is a new technology so welcome to be the first and to discover new pages in vibraimaging and human emotions 1 2 Operation conditions The system provides serviceability in conditions of influence of external factors Do not store or use the system in any of the following locations e Humidity above 90 at temperature above 35 C e Exposed temperature below 10 C or above 40 C 1 3 Specifications 1 3 1 Vibralmage system data e Resolution TVL more than 400 e Noise level of Vibralmage bit less than 0 1 e Frame speed frame sec more than 12 e Frequency range Hz more than 0 1 10 1 3 2 Digital web camera requirements e Sensor e Resolution pixel e USB compatible e Frame speed f s more than e Microphone e Exposition control e Color mode e Flicker mode CCD or CMOS Sensor From 640 x 480 till 1280 x 1024 USB 1 0 USB 2 0 10 external auto and manual color and B W switch Flicker 50Hz and 60Hz 1 3 3 System requirements for local module Operation System Processor RAM HDD DVD ROM USB port PCI slot Video capture Audio Network Windows XP Prof Vista with DirectX
58. h ON Graphs To bring the mouse pointer to a bottom of image area under graph The emerging strip of scrolling the right bottom corner of a window on Fig 45 will appear With the mouse to move the index of scrolling strip back on the set interval t Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action Oe H10 10 c LD ES D 2 ma O VIAVARLD Am F Ra Ht S10 75 t5 a A F A F F A F VI ST LD GR 35 e ta Tie Mi MS Vig Vie Y MA A A MILL AOI i i i I i 1 i 1 i Frame pie e IntegratedN F t 3 57 30 5000 Fast processing ae ae kre amp 4 Base processing ue Ww Ed Dd E 1s Video Timer Nobb i Info din EL a d Lb 3x rl i amp Bd SE i PS noxb t3 57 30 Width Height Statistics Io y gt PBA crpecc t 3 57 30 Fig 45 Scrolling emerging strip indication 48 NOTE Graphs position on in image area adjusts according to user s needs For this purpose it is necessary to bring the mouse pointer to the top or left border of area of graphs Fig 46 and to change an arrangement of these borders Fi Vibraimage 2008 04 22 15_31_38 AVI DER File View Settings Action Help bel 2 9 2 ma O VIAVARLD Am FOR v 17252 m VI ST LD GR 5 e vij vi vo Vi vig VI A A P A2 15 111 0 000 0 000 0 p TETTE Pas 11 412 0 000 0 000 f Ad fast 0 005 0 000 0 000 P Ad 0 017 0 000 0 000 Fi fast 0 001 0 000 0 000 ari 0 008 F2 5
59. he choice of an operating mode is made in item View of the main menu Fig 34 e The subitem Preset defines type of the display image the real image mode LD vibraimage mode VI aura on the real image mode AR and aura on vibraimage mode AV e The subitem Mode defines additional adjustments and quantity of windows with the image displayed in image area e The subitem Graphs defines an opportunity to display simultaneously on the screen graphs of parameters changes in time Ql sto eon e 4 TED hs BE VIAVARII v Toolbar v Info bar ign Vi enin v Info bar Buttons Graphs Frequency analysis s results Graphs Video window Frequency analysis s results Status window Video window LD window Status window Mode d v Toolbar LD window Preset v SRC Mode UTE VI 2 Am d YI oum i WI 10 F gt ed VI N Am LD VI M F gt DELTA Am d DELTA F d View Mode DELTA FA View Mode DELTA FE F v mode Am mode F Mouse fri Mouse line Sum line Centre e AVI Omer Title Fig 34 Menu View for mode selection 40 Use menu Settings Video to select a video source System Vibralmage allows to process live video signal coming from a video camera and video data recorded before and saved as AVI file On default the system works with a signal from a video camera Use menu Settings Video File to select AVI file Fig 35 Settings Acton IP Camera 1 Audio Video Capture Filter
60. he toolbar and View mode Delta FA the button A of the toolbar modes display frame difference on the basis of amplitude Am and frequency F vibration analysis in fast processing mode It 1s additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 53 55 e In mode Am visualization and calculation of object parameters processed by pixel vibration amplitude e In mode F visualization and calculation of object parameters processed by pixel vibration frequency e In Mouse line mode the field of information displays vertical and horizontal brightness lines of the image Fig 54 for mouse position Fi Vibraimage VIDEO Look 1320 V2 DER File View Settings Action Help ES amp 2 ma O VIAVARLD Am F Ry 5173 t VI ST LD GR 5 e v5 Vl Vig VL uM uM A N Frame rate d In Fast processing Base processing Video Timer 02 58 50 Info 100 1 00 2 00 Width 640 Height 480 Statistics lt Fig 54 Vertical and horizontal brightness lines on image In Sym line mode to the field of information display are added two areas in vertical area displays sums of frame difference lines of the visible image in horizontal sums of frame difference columns of the visible image Blue dashed lines on cuts display position of the mouse pointer Fig 55 56 ti Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action oz j z bel P hama O
61. ic data in a file db info 1s carried out in information panel of DB table Fig 80 at filling corresponding fields of New record Name Birth date and Comments After filling the demographic data in a field New record will appear an inscription Create to save the data in archive it 1s necessary to bring the mouse pointer and twice click the left button of a mouse NOTE the way to the catalogue of a archive database where video files files of images and files of statistics will be save is specified in a field DB folder The list of objects the information about which is in the specified catalogue displays as the list in the bottom of an information panel Fig 80 VI ST LD GR amp 2l Capture max lengths O purge old files ho timer ho stop in HH MImS SS start at HH MIM SS stop at HH MM SS save extra info ho save AML Ho save TXT ho DB folder CA default selected record Mew record Akimov Valera 12 03 1973 Didenko Tatiana 01 01 1958 Kisele Dmitry 10 09 1971 Martynov Oleg 18 06 1986 7 Minkin viktor 05 04 1953 Fig 60 Created database of persons Filling of field Selected record is made at choice of corresponding line in the list of a database The structured store of observable images in format BMP files according to the entered demographic data is carried out with the help of a command Image capture menu File or the corresponding button of the toolbar
62. ideo data will be saved in video file 31 t Vibraimage lt v2 avi gt OX Fie View MeziugeE Action Help Vid H10 810 lt LD REC T eis VIA VARO MN F R sta REG Teo Language e 2 E va vl E uM uM A A amp A a A 110 FC 003 Record group Video mask Capture channel Base proc Skype mood Video timer Info VI 10 F Height VI NF Statistics IntegratedN Am E IntegratedN F MIN FCICC 0031 Suspect Aggression Sress Tension Fig 23 Submenu Capture channel If in the field of supervision there is an additional mobile object which prevents measurements of the basic object submenu Video mask Fig 24 allows to edit video data In Edit mode you can cover black mask on addition object image Fig 25 Also you can reset current mask Reset Video mask mode save mask in external picture file Export Video mask mode and load external mask Load Video mask mode 32 age lt v2 avi gt settings Video Audio d Language d Record group dia video mask Load video mask Capture channel Reset video mask Skype moad Export video mask CN v Edit mode Fig 24 Submenu Video mask Vibraimage VIDEO Look 1320 V2 File View Settings Action Ll ES gy M Avi as VI AV ARLD Am FIRM oa VI ST LD GR O 5 Ok vi Vi M Vy Vin My Frame rate In Fast processing Base processing Video timer Info Width Height Statistic
63. ings Attention switching off below parameters calculation could automatically stop calculation and sets of other characteristics which used values of the switched off parameter No Black and white real image in image area Yes color image in image area If real image size more than 640x480 pixels than will be use only 640x480 pixels from centre part of image Note Canceling of parameter calculation is use for increase calculation speed of other parameters Canceling of points fluctuation amplitudes calculation Canceling of points fluctuation frequencies calculation Canceling of 2 frames parameters fast calculation Canceling of 10 frames parameters calculation Canceling of 2 frames parameters calculation Disable FFT Disable Entropy Motion detector Level Auto reset Skip frames Periods Diff time Hist C smooth Hist H smooth Hist S smooth Hist A HC function Sin t 2 p1 n 80 Canceling of Fast Fourier Transformation frequency processing Canceling of Entropy processing Motion detection Filter of movement Delete emotion calculation for object with motion amount less than threshold Threshold level of Integrated10 for emotion calculation Reset emotion calculation for macro movement Skip frames with the frame difference more than threshold Graphs global Graphs visualized period in seconds on the screen Time in seconds for calculation of an average level parameter valu
64. interval it is necessary to press repeatedly the same button or to choose the same menu item Now at the lie analysis the condition of object will be compared from the information saved up beforehand At a choice of item Graph analyze it will be open submenu gathering of the information about frequency distribution in vibraimage Fig 28 Histogram of frequency distribution appears in area of images Fig 29 35 Pause Start LD block Start LD compare block Reset timers Graph analyse Start H Markers d Start H 10s o Starts Starts 105 Fig 28 Menu for gathering of information about frequency distribution Items Start H 10s and Start H are intended for accumulation and viewing of the frequency information Start of command Start H 10s gathering of information is made for 10 seconds and the window of frequency information viewing is showed automatically after 10 seconds After start of command Start H the time of data accumulation is defined by the user and the window of viewing of the frequency information is showed only after a choice of item Stop Fig 28 The analysis of the frequency information after its processing with the help of Fast Fourier Transformation FFT commands Start S 10s and Start S shows frequency spectrum Note items menu Start H 10s and Start S 10s have corresponding buttons in the Toolbar NOTE each time when the window with frequency histogra
65. is furnished under license agreement and maybe used only in accordance with the terms of the license agreement It 1s against the law to copy the software or any other medium except as specifically allowed in license agreement The licensee may make one copy of vibraimage software for backup purposes Copyright 2001 2009 Elsys Corp All rights reserved Version Vibraimage 7 2 November 2009 Licensed users could download the latest version of Vibralmage software by the link http www elsys ru index_e php Updates and questions on www elsys ru Russia 194223 Saint Petersburg Toreza 68 ph fax 7 812 552 67 19 e mail elsys infopro spb su www elsys ru
66. lcome to the Vibralmage World Thank you for your purchase of Vibralmage system This manual is written to help you enjoy vibraimaging and open new features in well known objects Vibralmage technology registers micromovement vibration of person by standard digital web or television cameras and image processing Human head microvibration is linked with the vestibular emotional reflex VER of a person and reflects emotions levels Vibralmage system detects human emotions by the control of three dimension 3D head neck movements and fluctuations accumulated in several frames Fig 1 Amplitude vibraimage of the person Fig 2 External vibraimage around the frequency vibraimage Vibralmage is a new image type and so primary as original color image thermo image or x ray image Each image type gives new and unique information about the object Every pixel of vibraimage reflects vibration parameters frequency or amplitude Fig 1 of vibration One frame visualization of vibration frequency and amplitude named external vibraimage and looks like aura of person Fig 2 Typically external vibraimage colors linked with vibration frequency and external vibraimage dimension linked with vibration amplitude In medical imaging and biometrics Vibralmage is a recent psycholgically based emotional recognition visual imaging technology that measures pixels microvibration in terms of digital frequency and amplitude parameters The visualization of a 3 di
67. local module and terminal or server 2 It s necessary to resolve work of Vibralmage applications if you have Firewall to protect your system 3 Run Vibralmage exe on local module Run VINetStatus exe on terminal 4 Read about Network monitoring parameters in Network Monitoring section see part 3 9 later 5 Adjust operating settings of Vibralmage system and a video camera for the local module according to the recommendations specified in items 2 4 of this Manual 6 Adjust the sound notification and a threshold of operation on the terminal in program VINetStatus according to the recommendations specified in section 3 9 7 Start operation with Vibralmage system in a network monitoring mode 21 3 Vibralmage module Vibralmage module gathers records processes and analyzes electronic images of biological and mechanical moving objects with various frequency and amplitude of vibration fluctuations Main module Vibralmage exe is designed for achieving central Vibralmage software goals Printing of screens is possible from the main menu of Vibralmage module on default printer Printing of personal data and images 1s function of VIPrint module For viewing the recorded LOG files use VILogViewer module Network monitoring is function of VINetStatus module After software installation you will see the image on the monitor fig 13 if you connected camera to PC and adjusted it on person face 3 1 Multifunction window Multifun
68. mensial object fluctuation based on vibration parameters can thus be correlated to various mental states such as anger tension aggression etc as well as mood normal states and subconscious reflections Vibraimage can be characterized as one of primary images as visible spectrum such as infrared x ray MRI or ultrasound imaging Vibraimage technology is currently being tested in areas such as terrorist recognition emotional recognition interpersonal video dating interactions as well as for personal use Visualization of every pixels vibration became possible only in 21st century with the development of digital cameras and high power computers Long ago past scientists such as Aristotle had realized that biological object movement parameters characterize emotions thus vibraimage technology is a potential realization of this goal Physiology of movements The direct link between reflex movement and brain activity was discovered in 1863 by the famous Russian physiologist Ivan Sechenov in his publication Reflexes of Brain Charles Darwin in his book The expression of the emotions in man and animals 1872 also declared that reflex movements associated with emotions Nobel laureate and the famous researcher of aggression Konrad Lorenz claims that amplitude and intensity of reflex movements characterized the ageression On Aggression 1966 According to the action of vestibular system functions and mechanical movement person stands
69. mes By default 100 K Gain factor L Threshold of a palette Defines a threshold of displayed image value of less brightness considers as black Parallelization Parallel number of processing in multi core systems Default 0 for Core 2 Duo Filters single points Removes single points surrounded by black Extended It is intended for reduction of noise of a video camera Delete video noise in bit By default 8 This filter is important when the object is motionless and values changed because of camera noise Extended fast Delete video noise for fast processing Stretch scale normalization filter to a range 0 255 after its trimming Max speed contour by filter Extended At the included mode calculation fast parameters are made only Am scale Space Color image Crop X Crop Y Disable Am Disable F Disable 2x Fast Disable VI 10 Disable VI 2 79 inside of aura contour at switched off on the whole frame Multiplication factor used for vibraimage visualization in a amplitude mode Reduce vibraimage on borders of motionless contrast objects Frame difference D x y 1s multiplied by the factor K K 1 SV MB 100 where SV parameter of the filter MB the maximal difference between levels of brightness of a point x y and the next points in the initial image Note Switching off filters accelerate the computer functionality Advanced user could switch filters from default sett
70. motely change network adjustments of the Vibralmage exe program started on a local computer For this purpose in a window of Setting Fig 98 it 15 necessary to choose a line of parameter which numerical value 1s allocated by green color and double click of a mouse to pass in editing mode of parameter value Thus the user can change values of parameters number of the averaging frames N factor of amplification K and a threshold of palette L 110 5 o Om i j e m WA w In ui a t D O p Ch ZAS el arcus 115 y Console FE A Rell EE ITO p 40 91 ApNbik ANA usbview y 8 Paint Calculator FAR manager DC USB Jevic Ices Kop3HHa Microsoft W or d ED SEED CEDENS toco W Net ub gt Fig 101 Emotional danger level exceeded the threshold limit equal for example 40 The additional window displays 111 7 IP camera support Vibralmage system allows to receive the videodata and from network IP cameras The reference to IP camera goes through HTTP request as http User Password l a Host Port Url For example http user 12345 192 168 0 20 80 mjpeg cgi Therefore before the beginning of work with IP camera it is necessary for you to address to the your local network administrator and to obtain from him the following data on the camera which 1s connected in your network 1 Host IP address or a domain name of the camera 2 Port Network port of the camer
71. ms is caused the system forms a text file with extension hist in which for each value of parameter on line X from 0 up to 255 enters the name corresponding values of amplitudes of graph of distribution of amplitude and frequency and also results of mathematical processing of these data The user has an opportunity independently to define the catalogue where these data Fig 78 will be stored In a window with the frequency histogram Fig 29 switch N determines will be the graph of amplitude histogram is showed or not the graph is painted by red color Switch N determines will be the histogram of frequency is showed whether or not the graph is painted by green color 36 Fi Vibraimage lt VIDEO Look 1320 V2 File View Settings Action Os s Y H10 S10 lt LD d 9 y Avia VI AV ARLD Am F R 15 su os mm F A F A F A F A F VI ST LD GR 35 s lad a VI VI VI VIS VIS Yin AA Frame rate In Fast processing Base processing i i i i i i Video timer 09 14 E P E sl i E ET d 3 2009 04 28 12 41 43 i i i Mi 1 798427 10 637578 D 0 405503 100 S oF E E 1 P E d ol 1 00 1 1 1 5 i 2908 04 29 12 41 43 gt Mi 0 378443 2 00 i i 520 309915 640 i y i t i 1 i D30 096047 480 i i i i IntegratedN Am 5 91590 IntegratedN F 5 38778 Anger 4381 Stress SESS Tension 12 31 Statistics M EEIILLE TI 11113
72. nce of observing a line of parameter will be chosen by rose color Fig 91 Selected parameter is not shown in image area 5 3 Toolbar The toolbar Fig 95 duplicates accordingly the following items menu Open Menu File Play Menu Action Pause Menu Action Zoom In Ctrl Menu View Zoom Out Ctrl Menu View gt Ho Fig 95 Toolbar 104 105 6 Network monitoring In Vibralmage system the opportunity of a network monitoring mode complex is realized The basic program Vibralmage exe 1s started on the local computer with the connected video camera On the terminal the module VINetStatus exe is started which informs the operator of the terminal about the objects controlled by local PC 6 1 Network monitoring mode adjustment Before the beginning of operation in a network monitoring mode it is necessary to connect a local network computers of local module and the terminal and also to make adjustment of network parameters NOTE if Firewall system of protection is established on a computer it 1s necessary to enable of Vibralmage programs complex Adjustment of local module network parameters is made in the program Vibralmage exe in NW table of information panel Fig 96 It is necessary for start l To enable transfer of the information on a network between a computer on which the program Vibralmage exe is started and the removed terminal Item Network service
73. network monitoring mode it 1s necessary to execute the following actions 1 To start on the local computer the program Vibralmage exe and on the terminal VINetStatus exe 2 To adjust parameters of a network 3 To make adjustment of an operating conditions for Vibralmage system and a video camera for the local module 4 On the terminal PC in program VINetStatus to open a window of Settings Fig 95 establish flags Sounds and Images 1f you need the visual notice of the terminal operator and sound signal notice 1s required also And also to stand value Critical Level at which excess to the operator warnings messages will be given out In a normal operating mode of system when emotion parameters of the observable person do not exceed the established threshold emotion danger on the screen of the terminal only window VINetStatus will be display Fig 100 in which the current level emotion dangers will be show NOTE that for improvement of operator visual perception the levels of scale is divided on 5 parts distinguished by color Fig 97 100 By pressing button Reset it is possible to reset the saved up values and to begin a new processing results lt gt ViNetStatus Fig 100 NW window started on the terminal Open an additional window of Settings Fig 98 the operator can observe as parameters of system vary in time e In Number of the frame in a second received from the video device e Fast p
74. new parameters of vibraimage using any parameters on GR item For example Fig 74 A1 44 P4 55 Fig 74 User s formula for parameter X1 calculation Vibra sound Off Audio modulation of vibration Audio modulation of vibration used green upper histogram frequency vibraimage CR HG HR SG SR VI device Indication Micro defaults Macro defaults 83 Audio modulation of vibration used red upper histogram amplitude vibraimage Audio modulation of vibration used green middle histogram frequency aura Audio modulation of vibration used red middle histogram amplitude aura Audio modulation of vibration used green down histogram selected signal spectrum Audio modulation of vibration used red down histogram selected signal spectrum Since Vibralmage 7 2 version at installation of the software are simultaneously installed the driver of virtual videodevice VIDeviceCapture Use of this virtual videodevice allows to build vibraimage in any program using video signal from the camera and to see reaction of the interlocutor for example at negotiations on Skype system If to start program Vibralmage and to set in it VI device Yes and to choose device VIDeviceCapture as a source of video signal in the standard program it is possible to see in a window of the standard program real vibraimage Fig 76 If in addition to set Indication Y es in a window of the standard program it 1s p
75. no more 80 e Level of tension no more 60 e Level of potential danger no more 60 e Level of lie no more 30 Recommendations for human emotion recognition are given below 8 2 Vibraimage visual interpretation Vibralmage system gives different technical possibilities for emotion recognition but typical users prefer to characterize person by external vibraimage or aura on real image Aura based on vibraimage allows clearly and visually demonstrate emotions and physiological state of human being Short interpretation of aura colors and forms follows below This short information does not limited but only gives to user the main directions of person analysis Every user after application experience could greatly diversify extend and intensify knowledge about mental and aura of individual Brief aura color interpretation is shown on Fig 103 Hz Red activity and aggression color Yellow trouble and tension color Green normal activity and top condition color Blue rest and calm color Violet tiredness color Fig 103 Brief aura color interpretation 114 Aura colors irregularity and non uniformity characterized unbalanced state and character of person Brief aura form analysis e Any aura asymmetry form color characterized deviation from mental or physiological norms e Any breaks in aura uniformity characterized deviation from mental or physiological norms e Ideal aura has mono color symmetrical and unif
76. of person body S1 Ratio symmetry of amplitude left to the right changed pixels inside the object in 2 consecutive frames S2 Difference between the left and right average amplitude of object vibration in 10 frames S3 Difference between the left and right average amplitude of object vibration in N frames S4 Ratio of the changed pixels quantity in the left part of object to the changed pixels in the right part in 2 consecutive frames 55 Ratio of the changed pixels quantity in the left object part to the changed pixels quantity in the right object part calculated in 10 frames S6 Ratio of the changed pixels quantity in the left object part to the changed pixels quantity in the right object part calculated 1n N frames S7 Difference between the maximal frequency of vibrations of the left and right object parts in N frames The group of parameters P1 P7 registers features of mathematical Processing of vibrations Pl P2 ps P4 pss P6 pus P8 P9 P10 Pll P12 P13 P14 P15 P16 P17 P18 Dispersion of vibration density for frequency distribution at 10 processing frames Dispersion of vibration density for frequency distribution at N processing frames Center density distribution displacement of frequency at 10 processing frames Center density distribution displacement of frequency at N processing frames Level of lie Level of stress P6A calculati
77. on and technical prompting from vibraimage system 1s very important Sure it does not mean that 1096 of passengers are terrorists but it show that this passengers have some behavior and 128 psychology characteristics differs them from others Some of them only have flight fear others have prohibited goods in luggage others are late for the flight and so on E Vibraimage lt 20080521100345 avi gt l loj x File View Settings Action 5 09 5 O vi w aR LD lan Bs 0 ale na ae SU o Ss ed VIN F 8 0C 24 Fast processing Base processing Video timer 00 24 Info Statistics IntegratedN Am 435 IntegratedN F 8 A1 fast t 1 01 40 3 93 P1 t 1 01 40 Fig 127 Macromovements control with graphs 129 9 Maintenance service and service regulations Maintenance service and service regulations of Vibralmage system is carried out according to this Manual and instructions of used hardware maintenance a computer the camera etc Contact your regional dealer if you have questions or problems in operation Attention Information in this document is subject to change without notice and does not represent the commitment on the part of Elsys Corp No part of this manual maybe reproduced or transmitted in any form or by any means electronic or mechanical for any purpose without written permission of Elsys Corp The software described in this document
78. on of parameter 1s executed on vibration amplitude P6F on vibration frequency Level of anger P7A calculation of parameter is executed on points vibration amplitude P7F on points vibration frequency Level of energetic PSA calculation of parameter is executed on points vibration amplitude P8F on points vibration frequency Level of information entropy on base of Shannon theory P9A calculation of parameter is executed on points vibration amplitude P9F on points vibration frequency Entropy index PIOA calculation of parameter is executed on points vibration amplitude P10F on points vibration frequency Antikurtosis Information theory parameter characterized density distribution form Level of classic thermodynamics entropy on base of Helmholtz theory P12A calculation of parameter is executed on points vibration amplitude PI2F on points vibration frequency Characterizes shift of the histogram in the right part high frequencies Thus parameters define color of active vibraimage pointer Vibraimage pointer is active if its brightness move than Level L value Control parameter Define relation between area of active vibraimage pointer for install threshold of active vibraimage pointer Level S parameters Thus if the number of active points grows than the parameter value increases and danger level also increases Control parameter Define relation between area of
79. orm Any real aura differs from ideal and the question of interpretation 1s to characterized real aura deviations Note This brief aura interpretation correspond default vibraimage system settings and based on main rules for right vibraimage scanning e uniform and stable object illumination high quality and low nose camera application frontal plane object before camera maximum facial image size on monitor mechanical stabilization of camera Detail description of recommended vibraimage adjusting includes in previous parts of this document 8 2 1 Samples of human aura visualization Normal and top emotional state Normal condition characterized by aura color and form uniformity around the head relevant monochrome color in the middle of suggested color scale Activity level is about 0 3 0 6 Stress level 1s about 0 2 0 5 Tension level 1s not more than 0 4 Every emotion level measured in the range from 0 till 1 0 and minimal value coordinates with minimal emotion intensity Frequency distribution histogram 1s near normal Gauss distribution and spectrum of high speed vibraimage signals 1s near exponential distribution Aura photos samples for normal condition of person are on Fig 104 105 below 115 Figs 104 105 Aura photos samples for normal condition of persons Stress state Stress state characterized by amount gaps in aura form and greatly aura colors non uniformity Aura includes every scale colors and sharp color
80. ossible to see the histogram of change of the basic emotional parameters of the person A aggression S stress T tension D the general suspect level of emotional conditions Fig 77 Switch on micro mode Use for single men mode Switch on macro mode Use for multi and single men mode Vibraimage on real image mode about parameters see part 7 4 VI ST LD GR le E Frame rate Fast processing Base processing FPS proc period Downrate Main N 2 N 10 N K L Parallelization Filters single points Extended Extended fast Stretch Max speed contour Am scale Space color image crop X crop Y disable Am disable F disable 2x fast disable VI 10 disable VI 2 disable FFT disable Entropy ba AMCAP File Options Capture Help e VIDevice Capture Look 1320 V2 SoundMAX HO Audio I 84 Fig 76 The example a choice of VIDeviceCapture device in program AmCap allows to see vibraimage 85 5 Skype Options A Enel Yideo settings Set up your webcam 8 General settings AY Audio settings Select webcam Device Capture V Take a video snapshot Webcam settings Automatically receive video from Show that I have video to O anyone 3 people in my Contact list only people in my Contact list 5 no one C no one Save Cancel Fig 77 An example supervision of the interlocutor psycho emotional conditions through program Skype 86 3 5 6 Data base DB ta
81. ovibrations registration and macromovements shown on Fig 119 and Fig 120 123 VI ST LD R O El VI ST LD GR O E Frame rate Frame rate Fast processing Fast processing Base processing Base process FPS proc period oe pe Downrate Main N 2 N 10 Parallelization Parallelization Toma Single points Filters Extended Single points Extended fast Extended Stretch Extended fast Max speed contour Stretch ane pace Max speed contour color image Am scale Space disable Am color image disable F disable 2x fast disable Am mv disable F se v2 disable 2x fast disable VI 10 Motion detector disable VI 2 level disable FFT auto reset Fig 119 Default settings Fig 120 Settings for macromovements control After changing settings user need to control CPU usage and make sure that it 1s less than 100 preferable less than 60 At the next step user need to control camera real output frequency and make sure that in VI table frame rates In Fast Processing and Base Processing show approximately equal meanings near set Base Processing frequency 15 f s Fig 121 124 VI ST LD GR SE Fast processing Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Anger Sress Fig 121 VI table indication for macromovements control After software adjusting user need to select right camera and lens view for crowd control It is recommended to place camera so that every controll
82. pogano B Peecrpe nporpamm mia IBM 1 dexabpa 2006 e Pyxoeodumenv Dedepanmno cayac vt no unmennexmyanono co cmaeunocmu namenmam U moOBapubim 3naxam B II Cumonoe BESUERSEEEGSIzFSAHZ XRASSERSEREESEREGG Fig 5 Certificate on official registrations Fig 6 Diploma of international exhibition of Software Vibralmage 6 0 in Russian software inventions and innovations Brussels Eureka database 2002 US00734622782 a United States Patent uo Patent No US 7 346 227 B2 z Minkin et al 45 Date of Patent Mar 18 2008 The Director of the United States __ _ _ _ Patent and Trademark Office 54 METHOD AND DEVICE FOR IMAGE 56 References Cited Has received an application for a patent for a A U S PATENT DOCUMENTS new and useful invention The title and descrip 15 Inventors Viktor Albertovich Minkin 047 854 A 9 1991 Iwabuchi et al ee yA Saint Petersburg RU Alexandr Diich tion of the invention are enclosed The require Shtam Saint Petersburg RU Continued i ments of law have been complied with and it 73 Assignee 000 MP ELSYS Saint Petersburg FOREIGN PATENT DOCUMENTS NL has been determined that a patent on the in RU di Ra GRE vention shall be granted under the law Notice Subject to any disclaimer the term of this EP 0488721 Al 6 1992 patent is extended or adjusted under 35 RU ure ates a eo Therefore this U S C 154 b by 653 days RU
83. quencies the button a of the Graphs Frequency analysis s results Video window Status window d e Toolbar Preset d S Without Aura e VI 2 Am how Aura A VI 2 F AuraF VI 10 Am YI 10 F e VI M Am vI N F DELTA Am DELTA F view Mode DELTA FA View Mode DELTA FB rr F F vr ovr o vr Y mode Am mode F Mouse fn Centre X AVI timer we Tite Fig 51 Select mode of processing image 53 VI e n VI 2 Am the button ut of the toolbar and VI 2 F the button of the toolbar modes display vibraimage processed during 2 frames Fig 52 and constructed on the basis of amplitude Am and frequency F analysis of vibration It is additional possibility to change color of background image and to add aura to vibraimage Fig 53 view setings Action F N Toolbar Info bar Buttons j Graphs Frequency analysis s results Video window Status window Preset d A se Toolbar e SRC VI 2 Am Aura e White background WI 10 Am 4 Show vI 10 F VT M F DELTA Am DELTA F View Mode DELTA FA Ld Ld Ld e VI M Am d k k view Mode DELTA FB gt mode Am mode F Mouse fn Centre AYI Omer we Title Fig 52 VIF mode option A F e n VI 10 Am the button o of the toolbar and VI 10 F the button o of the toolbar modes display vibraimage processed during 10 frames Fig 53 and const
84. ram VINetStatus exe In the appeared window it is necessary to press the right button of a mouse and to choose item Settings Fig 97 ViNetStatus SEE English PYCKE Settings Fig 97 Main window VINetStatus exe started on terminal PC In the opened window Settings Fig 98 it is necessary to specify same numbers of ports UDP and TCP ports of the terminal on which program VINetStatus is started and TCP port of the local module on which program Vibralmage is started as has been adjusted on the local module and as the network address to set IP address of the local module If both programs Vibralmage exe and VINetStatus exe are started on one computer at adjustments of a network in programs it 1s necessary to specify the same network address Module IP TCP port Local TCP port UDP port Alerts Sounds Images Critical level Frame rate In Fast processing Base processing Info Width Height Statistics IntegratedN Am InitegratedN F Anger Sress Tension Audio Level Fig 96 Settings window of VINetstatus exe started on terminal module 107 NOTE that if adjustment of a network is not made or and on the local module the basic E ViNetStatus Fig 99 Error message program Vibralmage exe 1s not started than at start of program VINetStatus the window with the error message Fig 99 displays 108 6 2 Operation in a network monitoring mode For operation in a
85. read the system documentation Vibralmage 7 SHE Install Software Back Exit Fig 10 Installation window 17 6 You can read system documentations in Information window Fig 11 Vibralmage 7 PARUS C Articles gt lt Documentation C Presentations gt E G Video C Highlights gt O Back Exit Fig 11 Information about Vibralmage 7 It is necessary to execute installation of 3 components for system installation Fig 12 Digital camera drivers It is not necessary if you use your own preinstalled digital camera Guardant Driver to install this driver you need have the rights of administrator Vibralmage Software Vibralmage 7 Install Guardant Driver Install Vibralmage Back Exit Fig 12 Main Install window of Vibralmage components 8 Reboot your computer after this steps procedure 9 On desktop you can see Vibralmage software pictograms 10 Connect USB camera to free USB port 11 Connect Guardant dongle to the free USB port 12 Read Vibralmage manual 18 13 Run Vibralmage 14 In Vibralmage applications select working directory for store video capture file and protocol files see part 3 5 of this manual Note Manual installation for every system component is made according to the recommendations specified in section 2 2 of this description 19 2 5 First testing of vibraimage system It i
86. ring mode and shows the following information Network service sanction of information transfer to network between a computer on which program Vibralmage exe is started and the terminal Critical level threshold emotion level of person at which the warning message will be given out on the removed terminal and the picture of research object is sent Local TCP port Vibralmage exe program interrogates the given port for data exchange with the terminal Remote host name of the removed terminal Current version Vibralmage system works only with one terminal Enable sanction of work with the terminal When system works with several terminals possible to forbid exchange with chosen terminal IP network address of terminal computer on which program VINetStatus exe 1s started TCP port TCP port UDP port UDP port Ports for software of terminal through which it changed by information with the computer on which started program Vibralmage exe Through UDP port goes an exchange by short messages Through TCP port goes an issue video data VI ST LD GR Elsa Network service Local TCP port TCP port LIDP port Fig 79 Network table 88 3 6 Save of measurements results 3 6 1 Save of current images Save of the current image in format BMP file is carried out with the help of a command Save image menu File or toolbar Input and save of the demograph
87. rocessing Number of the processed frames in a second for calculation of fast parameters e Base processing Number of the processed frames in a second e N Current value of parameter number of the frame for averaging User can change this value e K Current value of parameter factor of amplification gain Intensity of a point is multiplied on K 10 User can change this value e Current value of parameter threshold of a palette Defines a threshold in the displayed image value of brightness less considered black User can change this value 109 e Width and Height displays the current resolution of video camera e IntegratedN Am Average frame amplitude vibraimage intensity processed for the N frames e IntegratedN F Average frame frequency vibraimage intensity processed for the N frames e Anger Level of anger e Stress Level of stress e Tension Level of tension level e Level current level of audio signal Additional window with person real image appears on terminal screen if an established parameters limit 1s excesses Fig 101 This window will be automatically closed in 5 seconds but only if the flag Images is set up NOTE that if in a window of Setting Fig 98 the flag Sounds is established than occurrence of a window with the image will be accompanied by a sound signal NOTE that the operator working on the computer terminal can re
88. ructed on the basis of amplitude Am and frequency F vibration analysis It is the additional possibility to change color of a background image and to add aura to vibraimage The same result is possible to receive if to bring the mouse pointer to a window of the chosen image and to press the right button of a mouse Fig 53 54 P Vibraimage 2008 04 22 15 18 28 avi gt BE r RUE as 3 vi v AN EE A PN Fast processing Base processing Video timer Info Height Statistics IntegratedN Am B 04942 Fig 53 Image area SRC VI 10 A and VI N A are switch on For image VI N A additional menu indication n F e In VI N Am the button ur of the toolbar and VI N F the button n of the toolbar modes display vibraimage processed during N frames and constructed on the basis of amplitude Am and frequency F vibration analysis The number of frames corresponding to parameter N is set in information panel Fig 53 It 1s additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 53 A F e n Delta Am the button A of the toolbar and Delta F the button A of the toolbar modes display frame difference on the basis of amplitude Am and frequency F vibration analysis in base processing mode It is additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 53 e In View mode Delta FA the button A of t
89. s IntegratedN Am IntegratedN F Suspect Mask Macka Fig 25 For example edit mask in Video mask mode The item Skype mood can be used if at you on a computer Skype program is install At teamwork of Skype and Vibraimage programs you can observe current psychoemotion parameters of the interlocutor Fig 26 33 DENM 2 G SWiSHma Kopobka VI PHCVHOK4 ana COMI Untitled 1 p652 large GARMIN C L copy A z s 272 05 Skyt B Vibraimage VIDEO Eye 3110 Loe File View Settings Action Help bl 5 92 VIAVARLD Am r R 2922 i l i 18 MI sT iD GR O El Y OPINA AMADA a Video timer Personalize Info E C Unlimited calls to landlines More A New v J 5earch Contacts Groups an AI i sleet l Contacts Conversations eight AVI o gee recompressor avarme 5 55 statistics V Echo Sound Test Service Integratedhtcam 1 76162 LU IntegratedN F 8 76085 Total lt a Suspect ommander Anger Sress Tension of Ej Audio Level 2 16 782 455 people online MagicDisc Call phones wr j Di 2B 4 Directory Mor copo a Shop KOMNBHOTEp G amp amp G PHevHoK classic lie a biastockpho bike Garminques CeTeBoe OKpyXeHHe Puc 26 For example Skype and Vibralmage programs teamwork 3 2 4 Action menu Action menu Fig 27 contains following items e Reset e Pause e Start LD block e S
90. s necessary to test vibraimage system technical parameters before start human emotions control Focused on test pattern for example EIA 1956 and control resolution of used television web camera Measured resolution must be more than 400 television lines TVL in the frame centre Measure the noise level of used television camera before emotions control Noise level indicates IntegratedA parameter 3 5 1 item from this document it value must be less 0 1 Approximately the image of focused test pattern must be black in VI mode acceptable to have only several color pixels Make a choice of the audio source channel and adjust its parameters according to the recommendations specified in section 3 1 3 before lie detector mode start ATTENTION It is preferable to study vibraimage method and system principals given in patent US 7346227 before start Vibralmage operation First steps for person emotion control could be the following Place the person opposite to camera Focused camera on person face with maximum facial size on frame Wait while person will calm down for example ask him to make in mind the account from 1 up to 100 Measure a level of aggression Measure a level of stress Measure a level of tension Measure a level of potential danger Compare the results with norms from item 7 1 from this document 20 For network monitoring mode please execute the next actions 1 Connect a local network computer to the
91. se and reliable system action the monitor power units of cameras should be connected to an electric network through the special sockets having additional ground contact the socket of a class 1 For reliable maintenance system the equipment included in complex and the equipment taking place in direct near should be certificated on electromagnetic compatibility according to requirements 2 1 2 Light exposure requirements Natural illumination of object can be used only 1f speed of natural light exposure changes of object does not exceed 1 Lx s Illumination of object by fluorescent lamps with illumination in a range 400 600 Lx in a plane of object is preferable 2 1 3 Camera vibration requirements The television camera used for surveillance and or object on which the camera is established should be motionless and have no vibrations more than 1 mkm s Vibraimage and processing parameters depend on camera vibrations so unstable camera position could have influence on and gives errors in processing results 13 2 1 4 Settings Vibraimage recommendations For adequate registration person vibraimage is recommended to take into account the following factors 1 The object person should be well and uniformly illuminating also preferably black and white image of the person should be precise and contrast As vibraimage depends on microvibration registration so reflected light optical flares glare and low light exposure of object
92. shold in an information column in ST mode sets in a threshold for the indicator of a lie level in view of all designed parameters and their weight At excess settlement value of this threshold a lie level 1s registered and displayed Recommendation Customer could study a short course for Vibraimage lie detection in Elsys Corp or contact your regional dealer NOTE The facial image of the person must have a good quality biggest possible size in frame and be in the middle of the screen Presences of other people in the frame and low image quality have influence to emotion analyze and gives errors in lie detector functions 63 P Vibraimage lt 2008 04 22 15_31_38 avi gt OX elecin pre Seren nee Bist File MUT settings Action H10 S10 c ID REC T 0 Al ER eoe D REC Te bl HS y Info bar Bass DES Vi Buttons s la ad Vi Wiel vis vis iwi wl AY AT AY A Help iire Google lem Fram Graphs I n Frequency analysis s results i Video window Vid Status window s 7 Y LD window Ap Ve Info IG N Mo de 3 K Preset x L Width 640 Height Statistics IntegratedN Am 1 33508 SDTIBIMITH ana IIS View j crosoft 7 ml f pes La EESTI TH vidcap32 St Total commander 5 Vlicrosoft Word YIPrinter O FingerCard Fig 62 Example of LD window 64 3 4 Toolbar The toolbar Fi
93. sing button Reset Calculation of a lie level works constantly current values of parameters are compared to previous values processed for Stat period AVG filter Number of frames for aggression level averaging Number of frames for stress level averaging Number of frames for tension level averaging Number of frames for suspect level averaging Macro mode Macro mode Level L Level S Aura mode Critical level Sound anger Maker s beep Reset beep XI X5 Disable std sound No sound CG 82 Define on base of which formula danger level calculated NO danger level calculated on base of Anger Stress and Tension levels YES danger level calculated on base of P13 P14 and P15 parameters values Threshold of a palette for danger calculation only not for displayed image threshold of displayed image define parameter L Value of less brightness considers as black and not used in danger calculation Threshold of a area in from full frame square Defines area of active brightness pixels If area of pixels in Vo which brightness more than Level L value less than Level S value than danger parameters in Status window equal 0 Reserved for future use Alerts Stands critical level of emotion parameters for alarm signals On Off sound alarm signal On Off maker s beep in LD mode On Off reset sound beep In version Vibralmage 7 0 the user can form itself formulas for calculation of
94. sion set system settings at the moment of the beginning of information gathering 93 4 Printing module Printing module VIPrinter exe is designed to print saved personal data and Images Main window of printing module Fig 83 consists of the following parts e main menu e persons list e printing area e toolbar e status bar 3 Didenko Tatiana 01 01 1958 ViPrinter File View Help X Akimov Valera 31 12 1980 Didenko Tatiana 01 01 1958 Didenko Tatiana 01 01 1958 Pm 2008 06 17 15_00_06_src_F 2008 06 17 15 O0 O6 vil amp 2008 06 17 15 00 10 src F 2008 06 17 15 OO 10 vil 4 le aiu v ML anle i UL t iiie 2008 06 17 15 DO 51 vi2 A 5 17 15 00 06 41A 20606 17 15 00 51 42_A 2008 06 17 15 O0 54 src F 2008 06 17 15 DO 54 vi2 A 2008 06 17 15 01 13 src F 2008 06 17 15 D1 13 vil A 2008 06 17 15 01 16 src F A CNN Am p 2008 06 17 15 O1 16 vii A n i aos 2008 06 17 15 01 19 src F x y Zu 2008 06 17 15 01 19 vii A MEO i uu 2008 06 17 15 04 D5 src F ri 2008 06 17 15_04_05_vil_A 2008 06 17 15_04_09_src_F 2008 06 17 15 04 09 vii A 2008 06 17 15 04 12 src F 2008 06 17 15 04 12 vii A 2008 06 17 15 04 27 src F 2008 06 17 15 04 27 vi2 F s d i i 2008 06 17 15_04_33_src_F d i Dus et 4 A M I UU 2008 06 17 15 01 13 c F 2009 06 17 15 01 13 M1 4 2008 0 17 15 01 16 rc F 4 2008 06 17 15_04_33_vi2_F vb CAN Pod o i rz Karpov Evgeniy 23 02 1950 2008 06 17 15_01_16_M ILA 2008 06 17 15 O4
95. tart LD compare block e Reset timer F12 e Graph analyze e Markers 34 LI Pause Start LD block Start LD compare block Reset Omers Fle Graph analyse gt Markers e Fig 27 Menu Action Reset reset all saved up information and statistics about frames and start new cycle collection of information Pause stop last accepted frame of data in image area of windows Start LD block or toolbar button al begin calculation of parameters of a lie level in a manual mode It is necessary to press this button again to stop calculation in a manual mode The moment of start calculation in a manual mode will be noted by a vertical green line the moment of stop calculation by red line TJ Reset timer F12 or toolbar button Ol reset to 0 all timers video file timer graph timer The conclusion video and construction of graph begins all over again At work in a lie mode in an information table is set the interval during which the system collects the data on object of research that then to use these data for comparison In a base mode this interval directly precedes the moment of the lie analysis beginning But the system gives an opportunity to make gathering of the initial information on object at any time At a choice of the REC menu item Start LD compare block or corresponding toolbar item start of the information gathering interval will be made For end of an parameters gathering
96. tate on up graphic and tension frequency spectrum on the down graphic 119 M1 3 50694 S 3 42425 M2 0 20000 l 1 AM fl Pu lu Te AAA O a e nm e am m T e ac a ra i oe 1 5 12986 5 3 45410 M2 0 95000 A 1 2 3 4 h b f 4 10 11 Hz j W Dif Fig 115 Normal state of person shown on up graphic and tension spectrum on the down graphic 8 3 4 EEG and Vibralmage testing EEG is well known and informative brain activity testing of course we adjusted and tested vibraimage system by comparative EEG testing Vibralmage signals recorded analogical EEG signals by developed VibraEEG system Program menu with recorded information cite on Fig 116 120 VIDbView File View Edit Graphs Help mx strony nm 2006 11 30 13x47x35 2006 12 04 12x58x06 2006 12 04 13x02x05 2006 12 04 13x05x58 2006 12 08 12x32x26 2006 12 08 12x38x44 Ready Fig 116 VibraEEG window Was calculated correlation between EEG signals and Vibralmage signals in theta frequency range 4 8 Hz for person in still state Fig 117 and aggressive state Fig 118 Analyzer Channel EEG1 EEG2 EEG3 EEG4 EEGS EEG6 EEG EEGS EEG EEG10 EEG11 EEG12 EEG13 EEG14 EEG15 EEG16 C EEG17 EEG18 C EEG19 C EEG20 C EEG21 EEG22 C EEG23 Al F1 Abs O Custom Custom LF se D 0 1 3 5 y T 4 7 5 Treshold
97. the description Install drivers for video capture device like web cam according to it manual Note Restart the system after driver installation 14 2 2 2 Guardant dongles driver installation Note administrative rights are required to install the XP Vista driver 1 Close all other applications to avoid file sharing errors 2 Run INSTDRV EXE application from Guardant drivers folder Soft Guardant2eng 3 When the utility is started it will check the presence of Guardant driver in the system If the driver is not found only Install driver button will be available in the main window To install or update Guardant driver click on Install driver or Reinstall driver button If installation is completed successfully INSTDRV will display a corresponding message and then return to the main window 4 If the driver installation 1s successful a message box 1s displayed 5 Click OK to continue 6 Close INSTDRV application 7 Restart the system 8 Connect video capture device and dongle to PC 9 Run Vibralmage exe 2 2 3 Vibralmage installation There are two possible types of vibraimage installation manual and auto User could select any type of it ES 2 3 Manual installation It is necessary to execute the following actions for installation of Vibralmage program on your computer 1 Run Soft Vibraimage7Setup msi from CD to install Vibralmage 7 0 application Follow to the instructions in setup
98. with the head in a balanced vertical position continuously and reflexively performing three dimension micromovements or vibrations The dependence between head vibration parameters and emotional state characterized by the vestibular emotional reflex VER or vestibular energy reflex Vibraimage technology is the realization of medicine psychology modern computers and television sciences for human emotion recognition Vibraimage plans to do human emotion control so precise like physics measurements Vibralmage software is designed to achieve the following goals e Cognitive control of emotions e aw enforcement e Aggressive and crime persons detection e Passengers remote surveillance e Psychological and medical monitoring e Lie detection e Research of weak response to humans e Training and relax control for fitness and sport applications e Meditation and aura control e Live and recorded video processing Vibralmage7 software includes 4 correlated programs Main module Vibralmage exe Printing module VIPrinter exe LogViewer module LogViewer exe and NetMonitoring module VINetStatus exe Vibralmage system realizes remote and auto monitoring of emotions levels such as stress aggression and tension and detects lie in a real time mode Vibralmage also allows to register and analyze human activity characteristics from recorded video files AVI format and to analyze medical psychological and emotional human state for dif
99. y O United States Patent 22 PCT Filed Dec 14 2001 un iuh dictionary of IEEE Grants to the person s having title to this patent 86 PCT No PCT RUO1 00545 lard aiii rd M 0 tic 0 the right to exclude others from making using 371 XQ 74 Attorney Agent or Firm Birch Stewart Kolasch amp offering for sale or selling the invention 2 4 Date Feb 20 2004 Birch LLP throughout the United States of America or im 9 PCT Pub No WO02 51154 57 ABSTRACT porting the invention into the United States of an and America for the term set forth below subject PCT Pub Date Jun 27 2002 tyding esroslc imaga of Slag inks M a to the payment of maintenance fees as provided 65 Prior Publication Data provided The Biometry detects the objects which produce insignificant periodical oscillations thereby making it pos by law US 2004 0131275 Al lul 8 2004 sible to receive and analyze the images of the objects on a If this application was filed prior to June 8 Go Foreign Application Priority Data background of stationary and moving objects Successive 1995 the term of this patent is the longer of ag a rather oeae eA A Dec 19 2000 RU 5 2000132334 to picture differences are evaluated and a sum of differences seventeen years from the date of grant of this G BrO of at sm two snc on am oi during the processing i y E thereof is accumulated biometry comprises a photo patent or twenty years from the

Download

Contents

Download Pdf Manuals

Related Search

Related Contents