Home

VibraImage 7.3 Manual Eng

1. i Take a video snapshot Webcam settings Automatically receive video from Show that I have video to anyone 8 people in my Contact list 8 only people in my Contact list C no one Q no one Save Cancel Fig 91 An example supervision of the interlocutor psycho emotional conditions through program Skype 101 3 5 6 Data base DB table DataBase table Fig 92 adjusts parameters of recorded video information and shows the following information DB folder Way to the database folder for written video files and files of statistics Capture max length s Defines the maximal length in seconds for recorded video file After file limit finished and closed a new file creates Capture purge old files Defines system action when the empty space on a hard disk will finish Y ES the oldest video files will be removed Timer The system can begin record at the appointed time Save extra information save XML save TXT save XML define in what format the information on system settings and on system parameters change for the period of supervision will be saved Selected record Data on current object of research New record Name Birth date Comments The demographic information on object of research YI ST LD GR amp sl Capture max lengths purge old files Mo timer Mo stop in HH MMS start at HH MIMSS stop at
2. saving the current frame of a window in BMP JPG PNG or GIF file Database folder changing folder where archive data is kept If the database folder is not specified record of AVI or BMP files is blocked New Record Create a new record in archive folder Print printing the current frame from image area Print Preview printing preview of current frame from image area Print Setup set printing options AVI Start Capture start record AVI file If the database folder is not specified record of AVI files is blocked AVI Stop Capture stop record AVI file Image capture saving the current frame from image area in selected archive folder as BMP files Exit exit from program 25 3 2 2 View menu View Fig 15 defines visible in the basic window information and contains the following items Vien Settings Action X4 Toolbar v Info bar Buttons d Graphs Frequency analysis s results BioTester results video window Status window LD window Mode Preset Fig 15 Menu View Toolbar switch on off the toolbar Info bar switch on off the information panel Buttons switch on off buttons on the toolbar Fig 16 Graphs show hide graphs of the set parameters Fig 38 Frequency analysis s results show hide histogram of frequency analysis of the set values Fig 31 BioTester results show hide windo
3. Camera image from camera E Stop Start Action menu VI mode View menu AV AV mode View menu AR mode View menu LD mode View menu Amplitude analyze View menu Frequency analyze View menu Reset all accumulated information about frame difference Start accumulation again after reset Action menu Mouse Histogram View menu H10 Frequency analysis 10s gathering of information for 10 seconds Action menu 510 Frequency Fourier analysis 10s gathering of information for 10 seconds and its processing by Fast Fourier Transformation Menu Action T10 Gathering and averaging of the information for 10 seconds Menu Action me Results of the frequency analysis switching in a mode of frequency analysis graph display 71 Switching in a mode of testing psycho energy condition graph display LD to begin data processing for a Lie detector mode Menu Action REC e Manual switch on off of a preliminary data gathering mode for Lie detector Menu Action TD e reset timer of video files to 0 Menu Action M A mode of accumulation and averaging of parameters for the certain period H10 510 T10 cx LD REC T 0 F R w rac ad ad HOF pe EN M ake Fig 70 Toolbar 72 3 5 Information panel Indication of information column Fig 71 depends on using mode VI
4. Fig 94 Created database of persons Filling of field Selected record is made at choice of corresponding line in the list of a database The structured store of observable images in format BMP files according to the entered demographic data is carried out with the help of a command Image capture menu File or the corresponding button of the toolbar NOTE in archive as separate BMP files will be written down images from all open windows in the field of supervision For example Fig 95 in the field 104 of supervision 3 windows with processing image are open SRC VI and VI and in archive result 3 files of images will be kept e 2008 05 13 11 48 51 src A bmp e 2008 05 13 11 48 51 vil A bmp e 2008 05 13 11 48 51 vin A bmp NOTE simultaneously with the specified files of images in archive 3 more files in which settings of Vibralmage system will be kept at the moment of removal images will be created e 2008 05 13 11 48 51 src A set e 2008 05 13 11 48 51 vil A set e 2008 05 13 11 48 51 vin A set T Vibraimage Didenko Tatiana 01 01 1958 2008 04 22 15 18 28 avi gt File View Settings Action my p m O VIAVARLD Am F R HID S10 y VI ST LD GR E ok ev VAA C default J vr S e maxlength s 0 A d VERE k SSG purge old files No 27 728 x RA Selected record Didenko Tatiana 01 01 1958 New record Akimov Valera 31 12 1980 Didenko Tatiana 01 01 1958 Karpov Evgeniy 23 02 19
5. In AV mode Aura Vibraimage mode external vibraimage aura allocated around the internal vibraimage or simple vibraimage Aura line size depends on medium line vibration amplitude Aura line color depends on maximum line vibration frequency inside vibraimage contour Fig 46 47 In AR mode Aura on the Real image the aura of the person is shown around his real image Fig 48 49 In LD mode Lie Detector mode image area shows real object image and selected graphs Fig 50 51 NOTE Selected graphs depend on Graphs switch position which sets graphs time dependences of chosen parameters Fig 44 51 48 Fi Vibraimage 2008 04 22 15 31 38 AVI File View Settings Action Gs bel P 3 avi O VIAVARID Am FOR v S527 03 a VI ST LD GR 9 fad ae VI VI VIL VIS uM AA Frame rate VI N A 100 00 39 In Fast processing Base processing Video timer Info 100 1 00 2 00 Width 640 Height 480 Statistics IntegratedN Am 8 75422 IntegratedN F 9 60600 Anger lt Fig 44 VI mode ri Vibraimage 2008 04 22 15 31 38 AVI File View Settings Action bel P A av VI AVARID Am FOR v 17527 em VI ST LD GR E 9 fa e VI VI VS VS ML AA F t d LI i I i IntegratedN F 1 3 55 50 Fast processing i PR 5 i i i i Base processing y Video timer Info 100 1 00 2 00 E o width 640 A P5 nox t 3 55 50 Height
6. Macro mode If Makpo mode Yes than danger level calculation is made on the basis of values of parameters P13 P14 P15 the description of parameters is see lower In Micro mode danger level calculation is made on the basis of the analysis of values of aggression P7 stress P6 and tension parameters Level L sets a palette threshold at danger level calculation Vibraimage points which brightness less than the specified threshold are considered black and are not used at calculation of a danger level The vibraimage point is considered active if its brightness more than the set threshold Level L Parameter P15 defines the relation between the area of active vibraimage points to the area of all frame Level S defining the area of active vibraimage points If the area of points in which value of brightness is more than value Level L is less than value Level S than danger level value displayed in status window equally 0 So if in the frame it is not a lot of active points the level of danger is not calculated Parameter P14 defines in excess of the area of active vibraimage points above the set threshold of active point Level S 137 So if the number of active points grows value of this parameter too grows also a level of danger increase Parameter P13 characterizes shift of the histogram to the right in area of high frequencies So that parameter defines primary
7. use for load AVI files without audio support This mode designed for work with VibraSound mode 29 The subitem RGB8 compressor are intended for management of a videofile record format If this item 1s chosen that for economy of a space on a hard disk the videofile saved in a black and white format The subitem IP camera 1 allows to set network parameters for access to IP camera Note that value of parameters Host Port User and Password it is necessary to receive at the your local network administrator Submenu Audio Fig 20 allows to choose the audio source device and to adjust its parameters which are necessary for operate in Lie Detector mode For example this menu contains the following items NOTE The content of the given menu items can differ depend on your audio device Settings Action Video FE il T TE ALT Audio Settings Language F Audio Capture Filter Record group d SoundMAX HD Audio I r Capture channel Skype mood Fig 20 Submenu Audio Before operation in lie detector mode select menu Settings Audio Settings Audio Devices Before using Vibralmage in this mode you may also control the level of audio signal red strip as shown in figs 66 68 Change of input audio signal options in a corresponding field of information column in ST mode Fig 67 68 Level of audio signal the red strip 1s necessary to stand so th
8. 68 After described adjustments Vibralmage system is ready for operation and is able to analyze the emotions of person and to detect lie for any person which image you observe in the basic window of the program Fig 13 The indicator of lie shows changes of values and the sizes of the histogram in line P5 lie of information column in mode ST Fig 67 68 Greater lie level of person verbal or nonverbal corresponds with more red strip size and bigger P5 value After the made adjustments the Vibralmage system is ready to work and capable to find out lie in any person which image you see in the basic program window Fig 13 The lie indicator 1s change of numerical values and the sizes of the histogram against a line P5 lie in an information column in ST mode Fig 67 or value which will be displayed in a window LD window Fig 69 The call of a LD window is made through item LD window the View menu Fig 69 or pressing of the toolbar button inadequately to the behavior than more red strip The more the person speaks lie or thinks The parameter Lie threshold in an information column in ST mode sets in a threshold for the indicator of a lie level in view of all designed parameters and their weight At excess settlement value of this threshold a lie level 1s registered and displayed Recommendation Customer could study a short course for Vibraimage lie detection in Elsys Corp or contac
9. Fig 140 Fast moving person looks red in the fast vibraimage window Usually it is not very hard task don t pay attention for the fast moving personal but sometimes fast moving people could trouble crowd control In difficult situation it 1s possible to pay attention to standard parameters calculated by vibraimage system and described for microvibration analysis Anger level calculated for Fig 138 shows only 55 it 1s lower than in any other shown figs Also histogram analysis doesn t show any danger for Fig 138 in contrast to Fig 139 Of course this part describes only the main recommendations for suspicious people control in crowd Example of the other program display variant gives on Fig 141 considering graphs information Some specialists could prefer graphs info instead of vibraimages VI version 7 x gives enough possibilities for research and operation Every team of specialists in profiling or aviation security develops own instructions for operation with vibraimage system corresponding to their aims Operation statistics of vibraimage system application in airports calculates that about 1096 of passengers differ from others by macromovements analysis and could account as suspicious person Ten times narrowing of suspicious person makes easer work of profilers because specialists are working in limited time for solution and technical prompting from vibraimage system is very important Sure it does not mean that 1096 of passengers are t
10. P4 T IV J ew o R IV 3 table 8 4 4 Crowd control 142 9 Maintenance service and service regulations 148 Introduction Welcome to the Vibralmage World Thank you for your purchase of Vibralmage system This manual is written to help you enjoy vibraimaging and open new features in well known objects Vibralmage technology registers micromovement vibration of person by standard digital web or television cameras and image processing Human head microvibration is linked with the vestibular emotional reflex VER of a person and reflects emotions levels Vibralmage system detects human emotions by the control of three dimension 3D head neck movements and fluctuations accumulated in several frames Fig 1 Amplitude vibraimage of the person Fig 2 External vibraimage around the frequency vibraimage Vibralmage is a new image type and so primary as original color image thermo image or x ray 1mage Each image type gives new and unique information about the object Every pixel of vibraimage reflects vibration parameters frequency or amplitude Fig 1 of vibration One frame visualization of vibration frequency and amplitude named external vibraimage and looks like aura of person Fig 2 Typically external vibraimage colors linked with vibration frequency and external vibraimage dimension linked with vibration amplitude In medical imaging and biometri
11. directly till the moment of started lie detection is used On at the analysis of lie as test the interval Stat periods which has been marked by the user beforehand is used When the user includes accumulation the preliminary information in this field value Capture AVG filter Number of frames for aggression level averaging Number of frames for stress level averaging Number of frames for tension level averaging Number of frames for suspect level averaging Macro mode Define on base of which formula danger level calculated NO danger level calculated on base of Anger Stress and Tension levels YES danger level calculated on base of P13 P14 and P15 parameters values Threshold of a palette for danger calculation only not for displayed image threshold of displayed image define parameter L Value of less brightness considers as black and not used in danger calculation Threshold of a area in from full frame square Defines area Aura mode Macro mode Face detection draw Critical level Auto capture image sound Susp Sound A Sound S sound T Maker s beep Reset beep XI X5 97 of active brightness pixels If area of pixels in Vo which brightness more than Level L value less than Level S value than danger parameters in Status window equal 0 Reserved for future use Yes if also face detection mode is used than suspect level calculation base on a
12. e Ideal aura has mono color symmetrical and uniform Any real aura differs from ideal and the question of interpretation 1s to characterized real aura deviations Note This brief aura interpretation correspond default vibraimage system settings and based on main rules for right vibraimage scanning e uniform and stable object illumination high quality and low nose camera application frontal plane object before camera maximum facial image size on monitor mechanical stabilization of camera Detail description of recommended vibraimage adjusting includes in previous parts of this document 8 2 1 Samples of human aura visualization Normal and top emotional state Normal condition characterized by aura color and form uniformity around the head relevant monochrome color in the middle of suggested color scale Activity level is about 0 3 0 6 Stress level 1s about 0 2 0 5 Tension level 1s not more than 0 4 Every emotion level measured in the range from 0 till 1 0 and minimal value coordinates with minimal emotion intensity Frequency distribution histogram 1s near normal Gauss distribution and spectrum of high speed vibraimage signals 1s near exponential distribution Aura photos samples for normal condition of person are on Fig 118 below 128 Figs 118 Aura photos samples for normal condition of persons Stress state Stress state characterized by amount gaps in aura form and greatly aura colors non uniformity Aura
13. 3 3 0 00 At fast t 3 53 50 1 11 11000 MP ne Puc 86 Graph and ibis mode Fig 87 Histogram window Lie detection Enable Enable LD mode Stat periods Time period of normal person condition before LD testing Compare periods If the user has not executed start of accumulation of the information during the period of comparison than after beginning of a lie detection mode the system as the period of comparison will use the information saved up for the specified number of seconds directly till of the moment of lie detection beginning Lie threshold Threshold in for the detection of lie level in view of every LD mode Anger Stress Tension Suspicious Macro mode Level L Level S audio manual auto Compare 96 calculated parameters and their weights selection of mode for lie detection Calculation of lie level starts when the level of entrance audio signal exceeds the established threshold LD calculation stops when the level of audio signal becomes less than the established threshold Accumulation of the information 1s made in time Stat periods Calculation of lie level is made only after pressing button Start LD end of processing after pressing button Reset Calculation of a lie level works constantly current values of parameters are compared to previous values processed for Stat period Off at the analysis of lie as test the interval Stat periods
14. Behavior Detection System Vibralmage Version 7 3 Manual ELSYS Corp Saint Petersburg 2010 CONTENT Introduction 5 1 Useful information 9 1 1 Basic applications 9 1 2 Operation conditions 9 1 3 Specifications 9 1 3 1 Vibralmage system data 9 1 3 2 Digital web camera requirements 10 1 3 3 System requirements for local module 10 1 3 4 System requirements for terminal module network monitoring 11 1 4 Package contents 11 1 5 Basic functions 12 2 Before you begin 13 2 1 Information and Precautions 13 2 1 1 Power supplies requirements 13 2 1 2 Light exposure requirements 13 2 1 3 Camera vibration requirements 13 2 1 4 Settings Vibraimage recommendations 14 2 2 Getting started 14 2 2 1 Digital camera driver installation 14 2 2 2 Guardant dongles driver installation 15 2 2 3 Vibralmage installation 15 2 3 Manual installation 16 2 4 Auto Installation 17 2 5 First testing of vibraimage system 20 3 Vibralmage module 22 3 1 Multifunction window 22 3 2 Main menu 23 3 2 1 File menu 24 3 2 2 View menu 25 3 2 3 Settings menu 28 3 2 4 Action menu 35 3 2 5 Help menu 39 3 3 Image area 40 3 3 1 Graph analyze 43 3 3 2 Image area control from preset 47 3 3 3 Submenu mode 53 3 3 4 Lie detector settings 62 3 4 Toolbar 70 ra i Ly ane e XY ALICELE II DOING 4 X7T 4 1411 po n y A E L VO iw LLL UL table_ y J N Je e fe kJ AK F A
15. DELTA F gt View Mode DELTA FA View Mode DELTA FB X4 mode Am mode F Mouse fn Mouse line Sum line Centre w AVI timer Title Fig 52 Menu View Submenu Mode 53 54 Toolbar switches on off toolbar Every item of the given menu for convenience of user are duplicated in the additional panel of toolbar Fig 53 A F A F A F A F A F vi M Vo Vo un Vl A A E Fig 53 Additional toolbar NOTE Pressed buttons in toolbar correlated with windows in the area of images The maximum number of windows equal 13 Fig 54 To delete a window with the set image processing it 1s enough to let off the corresponding button the of toolbar panel t Vibraimage VIDEO Look 1320 V2 File View Settings Action O VI ST LD GR Fast processing Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Suspect Anger Sress lt Fig 54 Simultaneous output of several windows with the different image processing 25 NOTE In the left top corner of a window could be indicated the Title of the given image processing mode Fig 55 ri Vibraimage VIDEO Look 1320 V2 EBR File View Settings Action Help o H10 S 10 lt LD mi 5 Sg Hawa VIAVARLD Am F R v 1953172 QD TER FX Au ti LI M EK VI ST LD GR O amp e lad dE VI V V V MAA Frame rate P In Fast processing Base processing Video Timer 03 07 00 Info Width
16. N determines will be the histogram of amplitude is showed whether or not the diagram is show by red color Switch N determines will be the histogram of frequency is showed whether or not the diagram is show by green color Ei Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action o H10 S 10 ex LD 18G D 4 Avis VI AV ARILD Am F R v 11051053 05 a F A F A F A F A F VI ST LD GR E 8 is gas Vl Vl Vi Vlo VI Vi A A Frame rate In Fast processing Base processing Video timer E p AME e P amp 3 2008 0429 12 41 43 i i i i i i i hi 1 798827 i i i i i i i i 510 637676 Info i i i i i i i i D 0 406503 2008 04 28 12 41 43 M 0 378443 i i i 10 309915 Width i i Di0 098047 Height i i i i i i i i i i i Statistics CAE 3 s 3 3 4 5 3 IntegratedN Am 3 91590 i i i IntegratedN F 6 38778 Anger 4381 1 Stress 3733 Tension 12 31 5123 fps 5 Fig 40 Frequency histogram of the person state Each histogram is characterized by the following parameters e M thecenter of weights of frequency distribution average value of microvibrations frequency e S root mean square deviation of frequency distribution e D a dispersion of frequency distribution To print out the received results user choose a command Print menu File To remove the received graph of the frequency analysis it
17. Status Bar switch on off the status bar Language change current interface and help language Menu Help contains the following items e About Vibralmage command to view information about software version 4 3 Toolbar and status bar The toolbar Fig 101 duplicates accordingly the following items menu e Delete delete selected record from persons list Fig 101 Toolbar The status bar Fig 102 displays the current information on the chosen menu item and the button of the control panel Ready Fig 102 Status bar 112 5 LogView module LogView module VILogViewer exe is designed for viewing and the analysis results of Vibralmage program operation Main window of LogView module Fig 103 consists of the following parts e main menu e nformation panel display parameters e Area of graph result supervision e toolbar D 2008 04 22 15 18 28 ViLogViewer File View Action S PI gt lt megdteiim P bb db ib bli id t 1 866045 v 0 181049 Fig 103 Main window of LogView module NOTE supervision of a video file can be made both from the beginning of a file and from any chosen place For a choice of the beginning place of viewing it is necessary double click by the mouse left button to note this place On the chosen place the marker a vertical line of green color Fig 103 will be established and the system will pass to a mode Pause Start of system is c
18. Height Statistics 5 Fig 55 Several images simultaneously presented in image area Modes of SRC Aura and VI 2Am are switched on 56 e n SRO mode the button g of the panel of toolbar shows source video from camera without processing Fig 56 It is additional possibility to display the aura on the real image of person constructed on the analysis of pixels vibration amplitude the button toolbar View Settings Acton v Toolbar vw Info bar Buttons j E of the toolbar or pixels vibration frequencies the button a of the Graphs Frequency analysis s results Video window Status window d e Toolbar Preset d S Without Aura w VI 2 Am how Aura VI 2 F AuraF VI 10 Am VI 10 F VI M Am VI N F DELTA Am DELTA F view Mode DELTA FA View Mode DELTA FB rr F vr ovr o vr Y mode Am mode F Mouse fn Centre X AVI timer Title Fig 56 Select mode of processing image 57 VI e n VI 2 Am the button ut of the toolbar and VI 2 F the button of the toolbar modes display vibraimage processed during 2 frames Fig 57 and constructed on the basis of amplitude Am and frequency F analysis of vibration It is additional possibility to change color of background image and to add aura to vibraimage Fig 53 view setings Action F N w Toolbar v Info bar Buttons k Graphs Frequency analysis s results Vi
19. VS VL VAA Frame rate In Fast processing Base processing 51 Video Timer J LI I LI Li IntegratedN F t 02 50 Info PGA Gi ecc t 02 250 Width Height Statistics 0284 i GP ob i i i aoo T PTA E t 02 50 r PTF AMT IL t 02 50 Fig 49 AR mode with graphs 50 5 NOTE It is possible to playback recorded information from AVI files with graphs on the screen in image area For this purpose it is necessary to execute the following actions Switch ON Graphs To bring the mouse pointer to a bottom of image area under graph The emerging strip of scrolling the right bottom corner of a window on Fig 50 will appear With the mouse to move the index of scrolling strip back on the set interval ri Vibraimage 2008 04 22 15_31_38 AVI File View Settings Action e H10 S 10 MF LD Ll 5 p ae VI AVARLD Am F R w 11051013 t5 a A F A F F A F VI ST LD GR 3 Ti Tie Mi MS Vig Vie vg Vi A A SMALL AOI i i i I i 1 i 1 i Frame pie e IntegratedN F t 3 57 30 5000 Fast processing km 6 k amp Base processing ue Ww Ed Dd E 1s Video Timer Nobb i Info din ae a d pp rl i amp Bd PT P5 nox 1 3 57 30 Width Height Statistics Io Ea wa PBA crpecc t 3 57 30 Fig 50 Scrolling emerging strip indication 52 NOTE Graphs position on in image area adjusts
20. i 2 ACIDS TIBET THE ternet ei mere pilsinis e slt ISD v Ie V APOK Bi HpBIK ANA putty W Gc C Paint Microsoft Word ApnNbik ANA DCTest 9 The Bat Total DAEMON Tools Commander elv I E d nyok 068 mp Fi vbramage Video window LD window Status window Main window Fig 17 Example of Video Status and LD windows 28 3 2 3 Settings menu Settings menu Fig 18 contains the following items ETT Action Video Audio Language d Record group video mask Capture channel Skype mood Fig 18 Menu Settings Submenu Video contains options of video modes Its can differ depending on connected devices For example this menu contains the following items Fig 19 You can choose as video source one from many installing in PC video devices or load external video file ETT Acton IP Camera 1 Ld Audio d Video Capture Filter Language F video Capture Format Record group ROBS compressor video mask d Capture channel EE AMT File F3 Skype mood AVI File ino sound Ctrl F3 v Eve 5110 Fig 19 Submenu Video The subitem Disconnect allows to disconnect all videocamera or videofile Video Capture Filter by pressing the window of video device setting contrast exposition brightness opens Each device has the especial window of settings Video Capture Format change video capture format Mode AVI File no sound
21. signal in the standard program it 1s possible to see in a window of the standard program real vibraimage Fig 90 If in addition to set Indication Yes in a window of the Indication a standard program it is possible to see the histogram of change of the basic emotional parameters of the person A aggression S stress T tension D the general suspect level of emotional conditions Fig 91 Micro defaults Switch on micro mode Use for single men mode Macro defaults Switch on macro mode Use for multi and single men mode Vibraimage on real image mode about parameters see part 7 4 VI ST LD GR 6 S Frame rate Fast processing Base processing FPS proc period Downrate Main N 2 N 10 Parallelization Filters Single points Extended Extended fast Stretch Max speed contour Am scale Space color image crop X crop Y disable Am disable F disable 2x fast disable VI 10 disable VI 2 disable FFT disable Entropy Fig 89 Upper part of Information table 100 Options Capture Help v VIDevice Capture Look 1320 V2 v SoundMAX HD Audio I Fig 90 The example a choice of VIDeviceCapture device in program AmCap allows to see vibraimage S Skype Options JJ General Video settings Set up your webcam B General settings AM Audio settings A Sounds Eu GE Privacy gt Notifications wW Calls Q IM amp SMS re Advanced Select webcam vIDevice Capture
22. the frequency and amplitude histograms for external vibraimage aura and in the third spectrums 73 of the frequency analysis with application of FFT of two parameters selected in GR submenu of the information panel Fig 72 are displayed Fig 72 Histograms window 3 5 1 VI table VI table Fig 73 displays the following information Frame rate e n Number of the frames per second received from the video source e Fast processing Maximum number of the processed frames per second used for calculation Selected by user e Base processing Number of the processed frames per second used in base algorithm Selected by user e Video Timer For camera mode displays time of supervision For recorded video time of current video file record For viewing a video file time from the file beginning Info e N Number of the frames for accumulation Selected by user e K Gain Factor Selected by user 74 e L Palette Threshold Defines a threshold in the displayed image value of brightness less threshold is considered black Selected by user e Width and Height Displays the current video camera or avi file resolution Statistics e IntegratedN Am Average frame amplitude vibraimage intensity processed for the N frames e ntegratedN F Average frame frequency vibraimage intensity processed for the N frames e Suspect Calculated level of suspect for object in frame e Anger C
23. 480 SA zx unn Statistics IntegratedM Am 8 75422 IntegratedN F 8 60600 4 0 00 Anger 50 23 59 lt PBA crpecc t 3 55 50 P7F arpeccua t 3 55 50 Fig 45 VI mode with graphs Fi Vibraimage lt VIDEO Look 1320 V2 DEAR File View Settings Action Os H10 810 lt LD ml 5 0 VIAVARLD Am FO R y 405013 2 VI ST LD GR 5 e me e V2 V V VIS MN A A Frame rate A VI N A 100 In Fast processing Base processing Video Timer Info Width Height Statistics Fig 46 AV mode SB Vibraimage lt VIDEO Look 1320 V2 gt File View Settings Action e H10 S10 lt F LD E52 P avi VIAVARLD Am R 19903 22 VI ST LD GR E e lad C V2 VIZ VS VIS Via Yin A A Frame rate E E IntegratedN F t 08 00 Fast processing 143 lt gt ADS i Base processing 51 Video Timer 15 48 Info L a i i PBA crpecc t 08 00 Width Height Statistics Fig 47 AV mode with graphs ri Vibraimage 2008 04 22 16 16 47 E Je File a Settings Action Help G amp o s O VIAVARLD am FOR 19003 VE ST U Ope Woo 8 fag qa V2 VI 2 j Mig Me I vl N AA Frame rate In Fast processing Base processing Video Timer Height Statistics Fig 48 AR mode Fi Vibraimage 2008 04 22 16 16 47 ER File View Settings Action Help bel 2S avi VIAVARID Am F R f 19903 m2 VI ST LD GR B 5 9 dad e VIS V 12
24. 93 where SV parameter of the filter MB the maximal difference between levels of brightness of a point x y and the next points in the initial image Note Switching off filters accelerate the computer functionality Advanced user could switch filters from default settings Attention switching off below parameters calculation could automatically stop calculation and sets of other characteristics which used values of the switched off parameter No Black and white real image in image area Yes color image in image area If real image size more than 640x480 pixels than will be use only 640x480 pixels from centre part of image Sets in frequency of a cut for the filter of high frequencies at processing F1 fast parameter Sets in 9o frequency of a cut for the filter of low frequencies at processing F1 fast parameter Number of averaging frame at calculation of F6 parameter Note Canceling of parameter calculation is use for increase calculation speed of other parameters Canceling of points fluctuation amplitudes calculation Canceling of points fluctuation frequencies calculation Canceling of 2 frames parameters fast calculation Canceling of 10 frames parameters calculation Canceling of 2 frames parameters calculation Disable FFT Disable Entropy Motion detector Level Auto reset Skip frames Periods Diff time Histogram s Hist C smooth Hist H smooth Hist S smooth Hist A H
25. ARID Am F R v 5 ls VI ST LD cR ss s lm e V VI V VIS vA AA DER H Integrated2 amp m 11 18 JE N m Show Het Diff mode Her gMin 0 00 i i i gMax 10 00 E o3 EE E amp PF d 20080426 14 20 16 i i i i M j 990287 7 s d 93603b IR HH IA 7 01 D 0 876170 Show er Diff mode Het gMin 0 00 gMax 20 00 DE H H IntegratedN Am 45 67 Show HeT Diff mode HeT gMin 0 00 gMax 50 00 Fig 32 The frequency histogram for person differs from a normal state Choice of item Markers will open submenu for input of 10 markers Fig 33 To enter markers it is possible also buttons 0 9 from the keyboard ctor i Reset Fause Start LD block Start LD compare black Reset timers Fle Measurement Graph analyse d Mark il 2 3 5 5 7 z 3 Fig 33 Menu marker set Each marker will be present in the field of parameters schedules by the unique color Fig 34 Vibraimage lt v2 avi gt JEg File View Settings Action Help A Men Q VI AV ARID Am F Ro Si E Ts mm LD VI ST LD sa amp E 25 is as EE VI VI UM UM uM LM N N 20 00 Integrated2 Am t 02 20 10 00 ntegratedN Am 2 42 Show Yes Diff mode No gMin 0 00 gMax 50 00 ef H A1 Fast T 3 BA HA 0 20 00 how No Diff modi No 1 9 ak b Integrated10 Am t 02 20 gMax 10 00 BH Hae 30 81 Show No Diff mode No gMin 0 00 gMax 100 00 BH Mas 21 55 Show Mo Diff mode Mo gMi
26. Pa qi dee pour corse urt suge Asrop si Munxun Buxmop A106epmoeuu Axumoe Banepuii Aaexcanapoeuu RU M daille d or A h Ft dun Sasska No 2006613400 Tava nocrynnenua 3 OKTA OPA 2006 r Japerncrpuposano B Peecrpe nporpamm mia IBM 1 dexabpa 2006 2 Pyxoeodumeno Pedepanvnoit cuyoc vi no uumenaekmyaaono co cmaeunocmu namenmam U mobapibim 3HAKAM B II Cumonoe BESUERSEEEGSIzFSAHZ XRASSERSEREESEREGG Fig 5 Certificate on official registrations Fig 6 Diploma of international exhibition of Software Vibralmage 6 0 in Russian software inventions and innovations Brussels Eureka database 2002 US00734622782 a United States Patent ao Patent No US 7 346 227 B2 z Minkin et al 45 Date of Patent Mar 18 2008 The Director of the United States __ Patent and Trademark Office 54 METHOD AND DEVICE FOR IMAGE 56 References Cited Has received an application for a patent for a RAE U S PATENT DOCUMENTS new and useful invention The title and descrip 75 Inventors Viktor Albertovich Minkin 047 854 A 9 1991 Iwabuchi et al ee yA Saint Petersburg RU Alexandr Diich tion of the invention are enclosed The require Shtam Saint Petersburg RU Continued i ments of law have been complied with and it 73 Assignee 000 MP ELSYS Saint Petersburg FOREIGN PATENT DOCUMENTS NU has been determined that a patent on the in RU di Ra GRE vention shall be granted under the law Notice Subject to any dis
27. a network monitoring mode For operation in a network monitoring mode it 1s necessary to execute the following actions I To start on the local computer the program Vibralmage exe and on the terminal VINetStatus exe 2 To adjust parameters of a network 3 To make adjustment of an operating conditions for Vibralmage system and a video camera for the local module 4 On the terminal PC in program VINetStatus to open a window of Settings Fig 112 establish flags Sounds and Images if you need the visual notice of the terminal operator and sound signal notice is required also And also to stand value Critical Level at which excess to the operator warnings messages will be given out In a normal operating mode of system when emotion parameters of the observable person do not exceed the established threshold emotion danger on the screen of the terminal only window VINetStatus will be display Fig 114 in which the current level emotion dangers will be show NOTE that for improvement of operator visual perception the levels of scale is divided on 5 parts distinguished by color Fig 111 114 By pressing button Reset it 1s possible to reset the saved up values and to begin a new processing results lt gt ViNetStatus Fig 114 NW window started on the terminal Open an additional window of Settings Fig 112 the operator can observe as parameters of system vary in time e In Number of the frame in a
28. and contrast As vibraimage depends on microvibration registration so reflected light optical flares glare and low light exposure of object can deform received result dramatically 2 This version of the software is designed for visualization of external vibraimage aura only for one object in the frame therefore the moving objects which are taking place near to the basic object of research can essentially influence and deform aura of the basic object Vibraimage visualization is carried out without high dependence from quantity of objects in the frame 3 There is a certain delay between vibraimage parameters of the person and visualization of live video on monitor The time of this delay basically is defined by chosen time of frame averaging For example if real speed of system 5 f s and chosen time of accumulation of 50 frame the objective vibraimage parameters of the person can process not earlier than in 10 seconds after processing start 4 The developed version of system is sensitive to the certain object macromovements even at the switching Moving Filter therefore for reception of objective vibraimage parameters person must in the natural and stable state standing or sitting Note The correct analysis of person emotion levels and lie detection is possible only at detail execution of the recommendations stated in the given document and by processing of high quality vibraimage 2 2 Getting started 2 2 1 Digit
29. color of active points of vibraimage Macro mode If Makpo mode Yes and also face detection mode is used than suspect level calculation base on analyze of single more danger person In other case suspect level calculation base on analyze all people in frame Face detection If Yes face detection mode is used No without face detection If draw No not draw rectangle around face If draw Yes draw rectangle around more danger single person draw All draw rectangle for all person in frame For non danger person rectangle draw green color but if person suspect level more than Critical level than rectangle draw red color Fig 132 i Vibraimage 2009 10 02 16 49 17 avi gt File View Settings Action lt ie M VIAVARID am FOR W OY ISN eo OM VI ST M iD GR O E e mlm VV VU AA A AS UBI S m Audio Yes SRC F 00 18 Dem Manual No Auto No Compare Off AVG filter Aggression 10 Stress 10 Tension 10 Suspicious 10 Macro mode Yes level L 150 level S 5 aura mode No macro mode Yes Face detection Yes draw Yes Alerts Critical level 96 60 00 Auto captute image s 0 Sound Susp No Sound A 0 96 Sound S 0 96 Sound T 0 96 marker s beep No reset beep No X1 x2 Fig 132 Work of system in mode Maxpo Suspect level of person more than Critical level 138 8 4 1 Vibraimage Macro Mode Control Quick Guide First start and sett
30. in time of every parameter which numerical values can be observed in mode ST GR of the information panel NOTE that save of parameters carries events character 1 e as soon as value of parameter is calculated by system it save the name in a file therefore sequence of parameters records in a file 1s not fixed as some parameters demand more often calculation than others In addition the user can save in file with extension set system settings at the moment of the beginning of information gathering 108 4 Printing module Printing module VIPrinter exe is designed to print saved personal data and Images Main window of printing module Fig 97 consists of the following parts e main menu e persons list e printing area e toolbar e status bar Didenko Tatiana 01 01 1958 ViPrinter File View Help X Akimov Valera 31 12 1980 Didenko Tatiana 01 01 1958 Didenko Tatiana 01 01 1958 2008 06 17 15_00_06_src_F 2008 06 17 15 00 06 vil 2008 06 17 15 00 10 src F 2008 06 17 15 OO 10 vil i aiu v ML anle i UL t hr 2008 06 17 15 00 51 vi2 ST 15 00 06 41A 2008 05 17 15 00 51 M2 2008 06 17 15 00 54 src F 2008 06 17 15 00 54 vi2 2008 06 17 15 01 13 src F 2008 06 17 15 01 13 vil 4 2008 06 17 15 01 16 src F A CNN Am p 2008 06 17 15 01 16 vii A n i aos 2008 06 17 15 01 19 src F x y Go rek 2008 06 17 15 01 19 vii A MEO i uu 2008 06 17 15 04 05 src F ri 2008 06 17 15_04_05_vil_A 2008 06
31. normal person state on up graphic and tension frequency spectrum on the down graphic M1 3 50694 5 3 42425 IM mr M2 0 20000 i A Pu ut y Amr am erm m ae nm e m m T m a gg A n a Load Ml 5 12906 5 3 45410 M2 0 95000 v A w F v wr Dif Fig 126 Normal state of person shown on up graphic and tension spectrum on the down graphic 1 2 3 4 5 b f i 9 10 11 Hz 8 3 4 EEG and VibraImage testing EEG is well known and informative brain activity testing of course we adjusted and tested vibraimage system by comparative EEG testing Vibralmage signals recorded analogical EEG signals by developed VibraEEG system Program menu with recorded information cite on Fig 127 133 amp VIDbView File View Edit Graphs Help k x2 2 29 55 nm 2006 11 30 13x47x35 2006 12 04 12x58x06 2006 12 04 13x02x05 2006 12 04 13x05x58 2006 12 08 12x32x26 2006 12 08 12x38x44 Ready Fig 127 VibraEEG window Was calculated correlation between EEG signals and Vibralmage signals in theta frequency range 4 8 Hz for person in still state Fig 128 and aggressive state Fig 129 Analyzer Channel EEG1 EEG2 EEG3 EEG4 EEGS EEG6 EEG EEGS EEG EEG10 EEG11 EEG12 EEG13 EEG14 EEG15 EEG16 EEG17 EEG18 C EEG19 C EEG20 C EEG 21 EEG22 C EEG23 Al F1 Abs O Custom Custom LF se D 0 1 3
32. of parameter considered for level of lie calculation gH v g Value of parameter doesn t considered for level of lie calculation GR amp E 9 0 133 1 575 67 371 44 042 0 269 0 594 0 017 0 090 70 092 29 022 160 732 0 106 F5 lie P7A and PF ang FEA str PGF sir F5 tens PGA er FSF en P34 H POF H F10A A FIOFA P1iA PllF amp F124 5 FIFE F13 P14 F15 F16 CM EIUS P16 Com E amp EK amp EK amp E amp amp E amp EK amp E amp E amp EK amp EK amp K Audio Level Th m Fig 74 ST table 71 The group of parameters A1 A4 registers amplitude of vibrations A1 A2 A3 A4 Frame difference between two consecutive frames Frame difference accumulated in 10 consecutive frames Frame difference accumulated in N consecutive frames Value of parameter Al filtered on 10 frames The group of parameters F1 F8 registers frequency of vibrations amount of changing points FI F2 F3 FA F5 F6 FT F8 Calculated value of changed signal pixels amount in 2 consecutive frames Averaged value of changed signal pixels amount in 10 consecutive frames Average value of elements quantity which have changed for the period of N frames Changed pixels maximum frequency during N processed frames Ratio of high frequency density to low frequency for parameter Fl Characterized tension parameter F5 tens current tension le
33. old The first oldest will leave by date of creation video files The user can set time of the beginning and the ending of record fields Timer If in the image area you have switch on some windows with video data for example open 3 window Fig 96 submenu Settings Capture channel allows to choose from what window video data will be saved in video file 106 ri Vibraimage VIDEO Look 1320 V2 File View Bauge Action m 5 GO VIAVARID Am F R MISS MI ST LE Language fog MZ V me iu AKA B Frame rate RE In Video mask Base processing Video timer VI 2 Am Info Width VI N Am Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Tension Audio Level Fig 96 Select Capture channel for video recording for example from SRC channel 3 6 3 Save of Log files Vibralmage program allows to save in an external file results of measurement and processing of integrated intensity of image pulsation for some time interval Saving of values sequence for integrated vibraimage characteristics received for the certain time in a file of the report 1s carried out automatically at record of video file The user can define type and a format of a file in which reports will be made Fig 92 e extension xml viewing of file contents report is carried out by program Microsoft Excel e extension txt an ordinary text file 107 In a file are save changes
34. operator working on the computer terminal can remotely change network adjustments of the Vibralmage exe program started on a local computer For this purpose in a window of Setting Fig 112 it 15 necessary to choose a line of parameter which numerical value is allocated by green color and double click of a mouse to pass in editing mode of parameter value Thus the user can change values of parameters number of the averaging frames N factor of amplification K and a threshold of palette L 123 5 o Om va e Nu w In ui a t D O p Ch ZAS 2 arcus 114 y Console FE al Rell EE ITO p 40 91 APNbIK ANA usbview jJ 3 Paint Calculator FAR manager DC USB Jevic Ices Kop3HH Microsoft Ww or d ED SEED CEDENS 31 W Net EN da Fig 115 Emotional danger level exceeded the threshold limit equal for example 40 The additional window displays 124 T IP camera support Vibralmage system allows to receive the videodata and from network IP cameras The reference to IP camera goes through HTTP request as http User Password Host Port Url For example http user 12345 192 168 0 20 80 mjpeg cgi Therefore before the beginning of work with IP camera it is necessary for you to address to the your local network administrator and to obtain from him the following data on the camera which is connected in your network 1 Host IP address or a domain name of the
35. second received from the video device e Fast processing Number of the processed frames in a second for calculation of fast parameters e Base processing Number of the processed frames in a second e N Current value of parameter number of the frame for averaging User can change this value e K Current value of parameter factor of amplification gain Intensity of a point is multiplied on K 10 User can change this value e Current value of parameter threshold of a palette Defines a threshold in the displayed image value of brightness less considered black User can change this value 127 e Width and Height displays the current resolution of video camera e IntegratedN Am Average frame amplitude vibraimage intensity processed for the N frames e IntegratedN F Average frame frequency vibraimage intensity processed for the N frames e Anger Level of anger e Stress Level of stress e Tension Level of tension level e Level current level of audio signal Additional window with person real image appears on terminal screen if an established parameters limit 1s excesses Fig 115 This window will be automatically closed in 5 seconds but only if the flag Images is set up NOTE that if in a window of Setting Fig 112 the flag Sounds is established than occurrence of a window with the image will be accompanied by a sound signal NOTE that the
36. stands on 1 m and 10 m before camera but distance from 10 till 15 m 1s admissible for control Vibraimage shows movement amount and person with more high movement amount marks by the warm colors based on standard vibraimage scale from more still around Vibraimage 7 x software window allows observe persons in different mode on one display so specialist could analyze person behavior with source image and several vibraimages that greatly raise informative of psychological analysis Of course staff needs to receive some experience of manual analyzing because it 1s necessary to compare people performing equal movements for example standing with standing giving ticket with giving ticket moving luggage with moving luggage and so on Several pictures from tickets and luggage control shows on Figs 136 140 143 Figs 136 and 137 captured by the one camera on the ticket control in the same conditions and differ by several minutes It is clear visible that one person on Fig 137 differs by colors from everybody persons on Fig 136 and Fig 137 Furthermore this person has more frequency colors in every vibraimage window captured with different accumulation frames number N 5 10 15 This three vibraimage windows give comparative information about person movement amount in different time periods as 0 3 0 65 1 0 second Experimentally it was selected as optimal time interval for informative characterizing of human behavior through macromovements Howev
37. 0 4 054 Fig 77 M mode of information table Note after ending of the information accumulation some lines of an TT can be allocated by color 50 004 40 000 40 000 SO OO 100 000 100 000 50 000 100 000 25 000 50 000 0 000 0 000 0 000 0 000 0 000 0 000 information column Fig e parameters which values less than the set limits are allocated parameters which values more than the set limits are allocated j 23 36 601 S0 022 33 750 ol 294 30 509 156 950 De bod H3 390 115 920 11 2539 156 485 251 716 46 402 5 gu o 044 Note in Fig 77 frequency of input frame from the camera FPS in less than the set limits and is allocated by color For correct diagnostics psycho emotion conditions of the person speed of data input from the camera should be within the limits of 25 30 frame second 83 Preview and printing M mode results After the ending of information accumulating in a M mode Measurement the user can see results of research and print them At a choice of item Print preview menu File in a working window of the basic program will be displayed 3 pages of results Fig 78 80 On the first page it 1s displayed researched vibraimage and data on it levels of Aggression Stress and Tension on the second page values of the measured parameters and on the third the histogram of frequency distribution and graph of change psycho energy conditions for the specified p
38. 151 avi gt File View Settings Action ml P 2 avi VI AV ARED Am F R 498003 12 VI TD ck O EE amp E dan an MS viz SM VIR A A Frame rate VI 2 A 5 01 13 In Fast processing Base processing Video timer Info Statistics IntegratedN Am 1 97007 IntegratedN F 06666 Anger Sress 0 0 Tension E uu VI 10 F 19 04 13 Fig 138 Normal calm passengers on the luggage control 145 Fi Vibraimage lt 20080521101151 avi gt File View Settings Action bend 25 avi VI AV AR ID Am FR o 19803 us ST D GR O E S ons E n vz wo va Mw ANN Frame rate 1 VI 2 A 5 00 45 TUM Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Anger Sress Tension Deg c nd zr Fig 139 Suspicious aggressive passenger on luggage control It doesn t mean that vibraimage macromovements control is absolutely simple and every red person in vibraimage pictures is potential danger On the Fig 140 shows staff that moves fast and of course looks red on the fast vibraimage window with accumulation frame number equal 5 146 Fi Vibraimage lt 20080528113113 avi gt File View Settings Action bel 59 9 Ay av VI AV ARID am F R w 105003 2 MN s tis n vi vu A A Frame rate VI 2 A 5 01 18 In Fast processing Base processing Video timer Info N K Height Statistics IntegratedN Am IntegratedN F Anger Sress VI 10 F12 01 13
39. 17 15_04_09_src_F 2008 06 17 15 04 09 vii A 2008 06 17 15 04 12 src F 2008 06 17 15 04 12 vil A 2008 06 17 15 04 27 src F 2008 06 17 15 04 27 vi2 F EE i 2008 06 17 15_04_33_src_F d i Dus zt 4 F UU 2008 06 17 15 01 13 c F 2006 06 17 15 01 13 M1 4 2008 06 17 15 01 16 rc F 2008 06 17 15 04 33 via F vb CAN mnn Um i rz Karpov Evgeniy 23 02 1950 2008 06 17 15_01_16_M ILA 2008 06 17 15 O4 OS M1 Kiselev Dmitriy 14 09 1975 Martynov Oleg 18 12 1970 A en 1 Ue Fig 97 Main window of printing module ViPrinter exe The persons list a column at the left displays the list of archive images records and a choice of record for viewing and print Current record choice is allocated with the cursor corresponding to it vibraimages and the demographic information displayed in the printing area 109 The printing area field on the right displays vibraimages and the demographic information corresponding to the current record of the persons list 4 1 Printing For print out vibraimages and the demographic data the command Print Ctrl P menu File is intended Before a call of a command Print Ctrl P it is necessary to choose required record in the list of persons Thus in the field of a print the corresponding demographic data and vibraimages will be displayed NOTE that at data recording in archive all images which at the moment of record were open in the field of images
40. 3 m mW Hm mn qn Qn Gn SSE TD 2 D Audio amp Level Th Fig 67 The minimum value of input audio signal corresponding to silence 67 chin bMin cMax bvlax 0 133 0 000 1 000 0 000 1 000 1 575 0 000 0 000 0 000 000 57 3 1 0 000 0 000 0 000 0 000 44 042 0 000 0 000 0 000 0 000 0 289 0 000 0 000 0 000 1 000 0 5394 0 000 0 000 0 000 DO O00 OLOF Goog 0 000 0 000 0 000 0 090 70 0392 0 000 0 000 0 000 0 000 29042 0 000 0 000 0 000 0 000 160 732 0 000 0 000 0 000 0 000 1 106 pODO 0 000 0 000 0 000 0 404 0 000 0 000 0 000 0 000 142 433 0 000 0 000 0 000 0 000 2 587 0 000 0 000 0 000 0 000 0 321 0 000 0 000 0 000 0 000 1 36 7 0 000 0 000 0 000 0 000 0 0043 0 000 GOO 0 000 0 000 0 050 0 000 GOO 0 000 0 000 46612 0 000 Q000 0 000 0 000 96 999 O F000 0 000 0 000 0 000 314 77 000G Q000 0 000 0 000 APPS 1 673 pOODDO GOL 0 000 0 000 AP P4 1 138 0 000 0 000 0 000 0 000 P5 lie PA ang PF ang FSA str FSF str F5 teris PSA en FEF en FSAH PSF H F1O0AA PIOF FliA PliF P12A 5 EIE F13 F14 F15 FIE ON F1 C5 Fis Com om oe mi ooo ooo Audio B Level 15 4 Ti Bo Fig 68 The maximum value of input audio signal corresponding to voice Threshold value setup equal 7 If you have a sufficient operational experience with a lie detector you can independently make adjustment of numerical values of parameters from Al up to P19 having opened corresponding menu of the information panel Fig 74
41. 30 Menu for information accumulation about frequency distribution Items Start H 10s and Start H are intended for accumulation and viewing of the frequency information Start of command Start H 10s gathering of information is made for 10 seconds and the window of frequency information viewing is showed automatically after 10 seconds After start of command Start H the time of data accumulation is defined by the user and the window of viewing of the frequency information is showed only after a choice of item Stop Fig 30 The analysis of the frequency information after its processing with the help of Fast Fourier Transformation FFT commands Start S 10s and Start S shows frequency spectrum Items Start T 10s and Start T are intended for accumulation and viewing of the information about change in time F6 and F8 parameters Parameters F6 and F8 define the average and current period of parameter Flfast change with the switch on filters 27 Note items menu Start H 10s Start T 10s and Start S 10s have corresponding buttons in the Toolbar NOTE each time when the window with frequency histograms is caused the system forms a text file with extension hist in which for each value of parameter on line X from 0 up to 255 enters the name corresponding values of amplitudes of graph of distribution of amplitude and frequency and also results of mathematical processing of these data The user has
42. 5 y T 4 7 5 Treshold QA 8 13 A 8 13 OB 13 30 B 13 30 FPS i Fig 126 Vibraimage and EEG correlation for calm human state 134 Analyzer Channel EEGI EEG2 EEG3 EEG4 EEGS EEG6 EEG EEG8 EEG9 EEG10 EEG11 EEG12 EEG13 EEG14 EEG15 EEG16 C EEG17 C EEG18 C EEG19 C EEG20 C EEG21 EEG22 Abs Rel Custom Custom LF Ob 0 1 3 5 QD 0 1 3 5 1 4 7 5 Q1 4 7 5 Treshold QA 8 13 QA 8 13 OB 13 30 OB 13 30 Ires in Fig 129 Vibraimage and EEG correlation for aggressive human state Corresponding to Fig 128 129 Vibralmage parameters has strong correlation with EEG parameters for aggressive state and have not any correlation with EEG when person is still That means that head motion depends on minds when person have high internal energy level or high emotion activity level and head motion does not depend on mind activity when person is still low energy and have not strong minds 135 8 4 Macromovements control in crowd Vibralmage system allows controlling macromovements macrovibrations as microvibration Controlled vibration range depends only from the camera lens angle camera object distance and movement amplitude of person Head microvibration informatively expressed reflex movements Vestibular Emotional Reflex but it s well known that human body macromovements expressed behavior and emotions too Macromovements control has po
43. 50 Kiselev Dmitriy 14 09 1975 Martynov Oleg 18 12 1970 Fig 95 Saving images in archive For viewing of saved data archive the special program the Print Module of vibraimage VIPrinter exe Fig 97 1s used 105 3 6 2 Save of video image Save of the current image which appears in the basic window in format AVI file is carried out with the help of a command AVI Start Capture menu File The stop of record process of AVI file is carried out on a command AVI Stop Capture menu File File The same actions can be executed with the help of the corresponding button of the toolbar Fig 95 For choice of the catalogue where the video file will be kept is intended a command Database folder menu File Fig 14 or a line DB folder an information panel in DB table Fig 94 NOTE that in the specified catalogue will be written down 3 files e video file with expansion avi e file with the current adjustments of system with expansion set e anda file with the report of changes of parameters with expansion xml For increase of video files recording reliability designed the field Capture max length s records in seconds Fig 94 If record lasts over the specified interval current AVI the file will be closed and save on a disk and record will be continued in a new file At filling the whole disk if the switch Capture purge old files record of new video files will be made atop of
44. C function Sin t 2 p1 n 94 Canceling of Fast Fourier Transformation frequency processing Canceling of Entropy processing Motion detection Filter of movement Delete emotion calculation for object with motion amount less than threshold Threshold level of Integrated10 for emotion calculation Reset emotion calculation for macro movement Skip frames with the frame difference more than threshold Graphs global Graphs visualized period in seconds on the screen Time 1n seconds for calculation of an average level parameter values In the field of a graph the frequency histogram of parameter change will be displayed in addition see Fig 86 Time 1n seconds for upper histograms accumulation top graph on fig 87 Time in seconds for middle histograms accumulation Time in seconds for down histograms spectrums accumulation fig 87 Reserved for future use Define histogram calculate mode in two top fields of a histograms window see Fig 87 The user can compare the frequency distribution of vibraimage to one of base distribution laws 0 Work mode histogram calculate on base of real video image analysis 1 displayed EXP law of distributions 2 the normal law of distributions 3 the uniform law of distribution 4 single peaks 5 SIN signal Factor n defining period of Sin graph generated 95 IntegratedN Am t 3 53 50 50 00 3651399 i i i i i i iow 139 3 3 3
45. Calc Ratel Rate2 Level Al Calc Ratel Rate2 Level p 42 Calc Ratel Rate2 Level p A3 Calc Ratel Rate2 Level p gt A4 Fast Calc Ratel Rate2 Level p A4 Calc Ratel Rate2 Level gt F1 fast Calc Ratel Rate2 Level NF Calc Ratel Fig 83 LD mode of information panel 88 89 3 5 5 GR table m GR table Fig 85 displays the following information Vibralmage parameters A1 A4 F1 F8 S1 S7 P1 P19 Total frame difference accumulation without filters for 2 10 and N the frames Integrated Parameters Vibralmage parameters with maximum frames frequencyA1 fast A4 fast F1 fast F5 fast Test signal sin 2 P1 nt Audio level for last seconds and audio level 25 fps for 1 25 seconds Vibralmage parameters X1 X5 which calculation 1s set by the user GR table columns meaning Ve Show Current value of parameter Show graph Yes delete graph No Diff mode Choice of this mode Y ES graph will show difference between current value of parameter and its average level for Diff time Choice of this mode NO graph will show current value of parameter gMin Defines the minimal value of parameter shown on the screen gMax Defines the maximum value of parameter shown on the screen HF flt The filter of high frequencies on Battervort Frequency of a cut is set in from entering graph frequency LF flt The filter of low frequencies on Battervort Frequency of
46. F Rv 375 2 re VI sT LD GR 5 coke IZ vi M Vig M Vi A A n FN a Frame rate In Fast processing Base processing Video timer Info Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress lt Fig 61 Vertical center of vibraimage lines on image The item Mouse fn is reserved for later version of Vibralmage 61 Item AVI timer and Title displays in the left top corner in each of visible windows with images the name of a processing mode which is used for the given window and time from the beginning of viewing AVI file Fig 62 Vibraimage 2008 04 22 15 31 38 AVI File View Settings Action LJ 2 vm VI AV ARID Am F R 957077 VI ST LD GR A 25 18 874 0 000 16 694 0 000 0 006 0 000 0 026 0 000 0 001 0 000 0 009 64 810 0 000 24 631 0 000 170 452 0 000 0 176 0 000 0 315 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 0 000 H10 S 10 7 LD ANAIE A aa F PT A AF e ime ue M LPS Vlo LL MU Y n A A VI N A 100 00 50 Fig 62 Title of image and video time for AVI file 62 3 3 4 Lie detector settings At work in a lie detection mode a choice of a way of the beginning of lie level calculation LD mode is made in an information column in a 1j mode Fig 89 The system uses the next ways of the calculation beginning 1 audio Calculation of a lie level is made when the level of en
47. HH MM SS save extra info ho save AML ho save TXT ho DB folder C default Selected record hew record Akimov Valera 12 09 1979 Didenko Tatiana 01 0 1 1958 Kiselev Dmitry 10 09 1971 Martynov Oleg 18 06 1967 Minkin viktor 05 04 1959 Fig 92 DB table 102 3 5 7 Network NW table Network NW table information panel Fig 93 adjusts network monitoring mode and shows the following information Network service sanction of information transfer to network between a computer on which program VibraImage exe is started and the terminal Critical level threshold emotion level of person at which the warning message will be given out on the removed terminal and the picture of research object is sent Local TCP port Vibralmage exe program interrogates the given port for data exchange with the terminal Remote host name of the removed terminal Current version Vibralmage system works only with one terminal Enable sanction of work with the terminal When system works with several terminals possible to forbid exchange with chosen terminal IP network address of terminal computer on which program VINetStatus exe 1s started TCP port TCP port UDP port UDP port Ports for software of terminal through which it changed by information with the computer on which started program Vibralmage exe Through UDP port goes an exchange by short messages Through TCP port g
48. ST M LD GR 75 Fig 71 Information panel tables menu e VItablel Displays information about adjustments of system and results of data vibraimage processing e ST table i Displays statistics of LD parameters and stands audio threshold e Mtable m It is displayed the average values of vibraimage parameters which have been calculated and are average for the certain period ID e LD table Displays and stands settings for LD parameters GR e GR table BH Displays and stands vibraimage parameters selected for graphs e Information table 2 Displays and stands settings for vibraimage processing parameters e DB aid 2 Data base table Input and selection of the demographic information and a folder for archive storage 55 I e NW ad E Network table Adjustment of local network parameters for operation in a network monitoring mode NOTE values of parameters in fields which are allocated by a green font can be changed by the user see Fig 73 parameters N K L it is possible to change in Information table For this purpose it is necessary to bring the mouse pointer to the chosen field and twice to click the left button of a mouse In the bottom part of information panel displays three windows with results of the frequency analysis Fig 72 In the first window the frequency analysis vibraimage on the whole frame by red color amplitude green color frequency of vibration pixels 1s displayed In the second window
49. Start frequency analyze menu Items Start H 10s and Start H are intended for accumulation and viewing of the frequency information Command Start H 10s gathering information for 10 seconds and the window of frequency information viewing is showed automatically after 10 seconds Time of data accumulation for command Start H is defined by the user and the window of frequency information viewing is showed only after a choice of item Stop Fig 39 The analysis of the frequency spectrum after its processing with the help of Fast Fourier Transformation FFT commands Start S 10s and Start S shows vibration spectrum Items Start T 10s and Start T are intended for accumulation and viewing of the information about change in time F6 and F8 parameters Parameters F6 and F8 define the average and current period of parameter Flfast change with the switch on filters Note items menu Start H 10s Start T 10s and Start S 10s have corresponding buttons in the Toolbar The user also has an opportunity of viewing previously saved results of the frequency analysis For this purpose it 1s necessary to chose the item Frequency analysis s results menu View to pass in a mode of viewing of the frequency histogram in the area of image and then 44 having pressed button Load l to load earlier saved data and to compare them with just received In a window with the frequency histogram Fig 40 switch
50. a cut is set in from entering graph frequency GR table graphs color marks indication E Graph shows in image area For convenience of observing a line of parameter will be marked by rose color Fig 85 Graphs doesn t show in image area Selected parameter displays in down spectrum histogram by green graph Fig 84 Selected parameter displays in down spectrum histogram by red graph Fig 84 H H Parameter doesn t displayed by graphs Fig 84 Selected parameters spectrum I 35 Diff mode No gMin 0 00 gMax 10 00 GU Hintegratediofam 19 72 Show Yes Diff mode No gMin 0 00 gMax 20 00 KE lintearatedw Am 4 72 E Show Mo Diff mode No gMin 0 00 gMax 50 00 GH HAG 0 03 Show Yes Diff mode No gMin 0 00 gMax 10 00 EAH A 5 93 Me Show No Diff mode No gMin 0 00 gMax 10 00 BY Yah 67 25 Show Yes Diff made No gMin 0 00 gMax BY Yay 18 48 Show Yes Diff mode Na gMin 0 00 Fig 85 GR table 90 91 3 5 6 Information table Information table Fig 89 allows adjusting vibraimage parameters and displays the following information Fast processing Base processing FPS proc period Downrate N 2 N 10 N K L Parallelization Single points Extended Extended fast Stretch Max speed contour Am scale Space 92 Frame Rate Settings Frequency fps for processing fast parameters of vibraimage noted by a word fast Frequency fps fo
51. according to user s needs For this purpose it is necessary to bring the mouse pointer to the top or left border of area of graphs Fig 51 and to change an arrangement of these borders Fi Vibraimage 2008 04 22 15 31 38 AVI DER File View Settings Action Help ml 2 4 av O VIAVARLD Am FOR 17252 m VI ST LD GR 5 e vij vi Vio Vi vig VI A A P A2 15 111 0 000 0 000 0 p TETTE Pas 11 412 0 000 0 000 P Ad fast 0 005 0 000 0 000 P Ad 0 017 0 000 0 000 Fi fast 0 001 0 000 0 000 ari 0 008 F2 53 786 0 000 0 000 PF3 17 390 0 000 0 000 F4 77 222 0 000 0 000 F5 fast 0 175 0 000 0 000 F5 0 346 0 000 0 000 3 424 0 000 0 000 0 268 0 000 0 000 4 138 0 000 0 000 0 170 0 000 0 000 0 117 0 000 0 000 0 162 0 000 0 000 6 049 0 000 0 000 vw ue tu RJ ee mn nn mn sn mm YYVYVYVY GAAR IntegratedN F t 3 20 20 1321 PBA crpecc t 3 20 20 0 31 PA farpeccua t 3 20 20 0 50 PZF arpeccua t 3 20 20 0 42 Fig 51 Graphs position adjustment 3 3 3 Submenu mode Item Mode Fig 52 selects additional settings of information in image area View settings Acton v Toolbar X Info bar Buttons Graphs Frequency analysis s results BioTester results video window Status window LO window Mode v Toolbar Preset _ SPEC VI 2 Am VI 2 F VI 10 Am VI 10 F VI N Am VI N F DELTA Am
52. al camera driver installation Note Auto installation of system components is made according to the recommendations specified in section 2 3 of the description Install drivers for video capture device like web cam according to it manual Note Restart the system after driver installation 15 2 2 2 Guardant dongles driver installation Note administrative rights are required to install the XP Vista driver 1 Close all other applications to avoid file sharing errors 2 Run INSTDRV EXE application from Guardant drivers folder Soft Guardant2eng 3 When the utility is started it will check the presence of Guardant driver in the system If the driver is not found only Install driver button will be available in the main window To install or update Guardant driver click on Install driver or Reinstall driver button If installation is completed successfully INSTDRV will display a corresponding message and then return to the main window 4 If the driver installation is successful a message box is displayed 5 Click OK to continue 6 Close INSTDRV application 7 Restart the system 8 Connect video capture device and dongle to PC 9 Run Vibralmage exe 2 2 3 Vibralmage installation There are two possible types of vibraimage installation manual and auto User could select any type of it 16 2 3 Manual installation It is necessary to execute the following actions for installation of Vibralmage
53. alculated level of anger for object in frame e Stress Calculated level of stress for object in frame e Tension Calculated level of tension for object in frame e Level current level of audio signal VI ST LD GR E Frame rate In Fast processing Base processing Video timer Info Width Height Statistics IntegratedN Am IntegratedN F Suspect Anger Sress Tension Audio Level Fig 73 VI table from information panel 75 3 5 2 ST table ST table Fig 74 shows the following information e Current values of based processed Vibralmage parameters A1 A4 F1 F8 S1 S7 P1 P19 e Current values of fast processing Vibralmage parameters A1 fast A4 fast F1 fast F5 fast e Current audio level and audio threshold ST table columns meaning V parameter current value cMin minimal parameter value during past stat period only in LD mode cMax maximal parameter value during past stat period only in LD mode bMin minimum threshold value of parameter only in LD mode during past stat period bMax maximum threshold value of parameter only in LD mode during past stat period NOTE values of parameter cMin cMax bMin and bMax displays only when the LD mode is switch on In other modes in these fields will be show 0 for example see Fig 74 ST parameters color marks indication Green G shows parameters indicated as graphs Does not show graph parameter in image area Value
54. am in the right part high frequencies Thus parameters define color of active vibraimage pointer Vibraimage pointer is active if its brightness move than Level L value Control parameter Define relation between area of active vibraimage pointer for install threshold of active vibraimage pointer Level S parameters Thus if the number of active points grows than the parameter value increases and danger level also increases Control parameter Define relation between area of active vibraimage pointer for full frame square Vibraimage pointer is active if its brightness move than Level P16 P17 P18 P19 L value Compatibility for 2 person Calculated on frequency histogram analysis concurrence with normal distribution Fig 75 76 Compatibility for 2 person Calculated on aura symmetry analysis Average compatibility Suspect level 79 Fig 76 Incorrect position of people at check of compatibility 80 81 3 5 3 M table In a mode o an information column Fig 77 allows to control average for the period parameters value of psycho emotional person conditions and their deviation from the established norm The basic applicability of the given mode is use of vibraimage system for medical diagnostics and psychological researches Value of the averaging period is set in seconds in a field Duration Start of the beginning of information accumulation is made by a choice of item Measurement
55. an opportunity independently to define the catalogue where these data Fig 92 will be stored In a window with the frequency histogram Fig 31 switch N determines will be the graph of amplitude histogram is showed or not the graph is painted by red color Switch N determines will be the histogram of frequency is showed whether or not the graph is painted by green color Ei Vibraimage VIDEO Look 1320 V2 File View Settings Action Bs HIO S10 x7 LD C E Avi O VI AV ARLD Am F Row a su cr m VI ST D GR E S s m6 mY VS Vo Y a Yn A A F t Jl rame rate E NN Fast processing Base processing Video timer Info 2008 04 29 12 41 43 a B K 8 S 0 300945 Width i i 4 i i i i i Di0 088047 Height i H 4 i i i i i i f Statistics Integrated Am 3 91590 IntegratedN F 5 38778 Anger 4381 Stress 3733 Tension 12 31 Fig 31 The frequency histogram for a normal condition of the person lg Pressing on button Load the user can load earlier saved data and to compare them with just received For printing received results choose a command Print menu File For removing the received graph of the frequency analysis 1s necessary to bring the mouse pointer to the chosen diagram press the right mouse button and to choose item Delete 38 Fi Vibraimage lt VIDEO Look 1320 V2 File View Settings Action Gs ar G 5 haa Q VI AV
56. apture image s parameter 3 Control status level window on the screen For work it is recommended to use a Source video viewing mode Fig 133 a then if suspect level of person excess Critical level and value of Auto capture image parameter not equal 0 in an external file in the specified catalogue the image will be saved Fig 133 b allowing to identify the person 4 Control more colored person by the other means if status level is more than stand threshold and program gives alarm signal 5 Close Vibraimage program after control finishing i Vibraimage 2009 10 02 16 49 17 avi File View Settings Action ms p gt vier MO VIAVARID Am F R H10 S10 T10 cx eod eod od of VI ST M LO GR E Audio Manual Auto Compare AVG filter Aggression Stress Tension Suspicious Macro mode level L level S aura mode macro mode Face detection draw Alerts Critical level 96 Auto captute image s Sound Susp Sound A Sound S Sound T marker s beep reset beep X1 x2 Status Yes I SRC 01 09 No No Off 10 10 10 10 Yes 150 5 No Yes Yes Yes 60 00 0 No 0 96 0 96 0 96 No No a working window with Source video mode P a b saving information about interesting person in BMP file E Fig 133 Recommendation for working mode 140 dE oo wr ea m 141 8 4 2 Vibraimage Macro Mode Settings for different aims Accumulation p
57. ar Info bar Buttons d Graphs Frequency analysis s results BioTester results video window Frequency analysis s results BioTester results Video window Buttons d Graphs nds window Status window LD window LE window Mode S e Toolbar Mode 5 ORC VI VI 2 Am d AV VI 2 FY d AR VI 10 Am LD VI 10 F VI M Am VI NF DELTA Am d DELTA F d View Mode DELTA FA View Mode DELTA FB v mode Am mode F Mouse fn Mouse line Sum line Centre AVI timer Tite Fig 36 Menu View for mode selection 41 Use menu Settings Video to select a video source System Vibralmage allows to process live video signal coming from a video camera and video data recorded before and saved as AVI file On default the system works with a signal from a video camera Use menu Settings Video File to select AVI file Fig 37 E Acton Video IP Camera 1 Audio video Capture Filter Language H Video Capture Format Record group Fi ROES compressor Video mask Capture channel E ONSE ANT File F3 skype mood AVI File no sound Ctri F3 v Eye 3110 Fig 37 Select video source Pause Start of the current video image is carried out with the help of a command Stop Pause menu Action or with the help of the corresponding button of the toolbar Choice of item Graphs the menu View see Fig 15 makes switch on off display in the field of image the
58. are saving For remove files of superfluous images use Explorer Windows or the similar program For preliminary viewing listing Fig 98 use the command Print Preview menu File Didenko Tatiana 01 01 1958 ViPrinter Fig 98 Preview window 110 For a choice of the printer and adjustment printing parameters use the command Print Setup menu File 4 2 Main menu e File e View e Help Menu File Fig 99 contains the following commands view Help Set archive folder Print Ctrl F Print preview Print setup Delete Del Exit Fig 99 Menu File Use Set archive folder command to change the archive folder in which the data of images archive are store The given way can not coincide with the way established in the base module It enables to work with different vibraimages archives Use Print Ctrl P command to print personal data and vibraimages This command may be executed with CtrH P or toolbar Use Print Preview command to print preview Use Print setup command to change the printer and printing options Use Delete command to remove of the chosen record from the persons list Use Exit command to quit the application 111 Menu View Fig 100 contains the following items E Help 4 Toolbar Status Bar English FOCK Fig 100 Menu View Toolbar switch on off the toolbar
59. arried out by button Play 113 5 1 Main menu e File e View Action e Help Menu File Fig 104 consists of the following items View Acton Print Print preview Print setup LEN 2008 04 22 15 18 28 2 4006 06 17 14 18 41 Exit Fig 104 Menu File The item Open Is intended for a choice and opening of results file It also can be replaced by the corresponding button of the toolbar The item Print prints out graphs from area of supervision The item Print Preview used for preliminary viewing listing The item Print setup used for a choice of the printer and settings printing parameters The item Exit used for exit from the program 114 Menu View Fig 105 consists of the following items v Toolbar Zoomin Ctrl Zoom out Ctrl English PYCCELAM Fig 105 Menu View Toolbar switch on off the toolbar Language select current interface and help language Use items Zoom In Ctrl or Zoom Out Ctrl to zoom in zoom out the image in the printing area for example compare scale of graphs see Fig 103 and Fig 106 Items also can be replaced by the corresponding toolbar buttons Ka 2008 04 22 15 18 28 ViLogViewer File View Action s po gt E f Integrated2 Am Settings Period s 10 0000 IB Integrated2 Am 0 93 Show Yes gMin 0 00 gMax 50 00 E Integrated10 Am 2 27 Show NO
60. art of object and preferably by human head Hardware specification Vibralmage hardware includes two basic parts a digital video web camera for person image input and personal computer for processing of the received images Software functions Vibralmage software solves the following technical tasks e Emotional levels recognition and detection e Lie detection e Monitoring of person physiological parameters e Creation and the analysis of digital videos of files in format AVI e Surveillance in real time vibraimage e Surveillance in real time images of aura e Save the visible image in a file in format BMP e Measurement in real time integrated characteristics of vibraimage e Recording of integrated characteristics vibraimage received for certain time in a LOG file e Input and save the demographic data in a file in format TXT e The structured save of visible images in files in format BMP according to the entered demographic data e Print out the kept images and the corresponding demographic data 13 2 Before you begin 2 1 Information and Precautions Notice concerning privacy Do not use this system for purpose of person privacy irregularity Note that simply being in possession of material that was digitally copied or reproduced by means of a scanner digital camera or other device may be punishable by law NOTE Disposal of this product is acceptable only in accordance with Local and National Disposal Reg
61. ase processing Base processing FPS proc period FPS proc period uc Downrate Main Main N 2 N 2 N 10 N 10 Parallelization Parallelization Fiters Single points Filters Extended Single points Extended fast Extended Stretch Extended fast Max speed contour Stretch Am scale Space Max speed contour color image Am scale Space disable Am color image disable F disable 2x fast disable Am disable VI 10 disable F ee va disable 2x fast disable VI 10 itu dandus disable VI 2 level disable FFT auto reset a micromovements control b macromovements control Fig 134 Default settings 142 After changing settings user need to control CPU usage and make sure that it 1s less than 100 preferable less than 60 At the next step user need to control camera real output frequency and make sure that in VI table frame rates In Fast Processing and Base Processing show approximately equal meanings near set Base Processing frequency 15 f s Fig 135 VI ST LD GR E Frame rate In Fast processing Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Anger Fig 135 VI table indication for macromovements control 8 4 4 Crowd control After software adjusting user need to select right camera and lens view for crowd control It is recommended to place camera so that every controlled person stands approximately on one distance from camera That means inadmissible to compare people
62. at it was on the average position between the minimal value of a input signal which corresponds to silence in a room see position of green strip on Fig 66 and the maximal value which corresponds to a voice sound of a person in front of the camera Fig 67 NOTE System Vibralmage correctly works in a lie detection mode only when adjustment of input audio signal procedure of adjustment see above 1s made The moment when the person started to 30 speak is used by system for the beginning analysis of the data Vibraimage parameters during speaking are compared to the data received earlier for example when the person was silent The menu Language contains the list of supported languages Fig 21 Sige Actor Video d Audio d Language d English Record group d FOCK video mask d F Capture channel Skype mood Fig 21 Submenu Language Submenu Record group Fig 22 allows to choose the number of the catalogue where video files will saved NOTE The direction to the catalogue should be set beforehand E Acton Video Audio Language kJ Record group d v Default video mask 1 Capture channel 2 3 Skype mood FR sues es INN Fig 23 Change the catalogue number may be also processing by toolbar buttons 3l If in the image area you have switch on some windows with video data for example open 3 window Fig 24 submenu Capture channel allows to choose from what window
63. be made new accumulation of the information and in graph area the following result of frequency distribution will be displayed Fig 42 46 To save the received graph it is necessary to bring the mouse pointer to the chosen diagram to press the right mouse button and to choose item Save as T Vibraimage VIDEO Eye 311Q gt File View Settings Action max M VI AV ARD Am FOR SY DSM mmm M fog uw viv vat AV A AL AA om M Fast processing Base processing Video timer Info Height Statistics IntegratedN Am IntegratedN F Suspect Aggression Sress Tension Fig 42 Old and new human state 47 3 3 2 Image area control from preset In the field of the image area Fig 44 49 depending on the chosen mode Fig 43 the user can see the real video image vibraimage external vibraimage aura or graphs time dependences for control in LD mode or any other mode view setings Acton v Toolbar X Info bar Buttons d Graphs Frequency analysis s results BioTester results video window Status window LD window Mode d v AN AR v LD Fig 43 Menu View Preset image area mode Item Presets menu View designed to choice one basic mode in image area In VI mode Vibralmage mode displays vibraimage of person Color for every image pixel depends on its amplitude or frequency of vibrations Fig 44 45
64. camera 2 Port Network port of the camera 3 User and Password set login and the password of access to the network camera HTTP user registration record for access to IP camera 4 Url a path to a virtual file on the camera which corresponds to video stream in MJPEG format The name of a file can depend on model of the IP camera Than in Vibralmage program it 1s necessary to choose the Subitem IP camera 1 the Settings Video menu and to make settings of network parameters for access to network IP camera Fig 116 The field FPS sets number of the frame in a second which will be given out IP camera in a network NOTE that the number of the frame in a second which will reach your computer depends on throughput and congestion of a local network And if for example it 1s set FPS 15 but on a network the frame come with smaller speed the missing frame in the program will be added by copies of the previous accepted frame 125 IP Camera ES Host 192 168 0 20 Part at User USEF Password 12345 Url mipeg cgi FPS 15 Cancel Fig 116 For example IP camera model D Link DCS 910 settings 126 8 Vibralmage system operations This item gives some recommendations and samples for human emotion control realized by vibraimage system 8 1 Vibraimage processing norms Note Default system settings coordinate with the following human parameters for normal state e evelof agg
65. change default settings for L 1 and S 1 Control status level window with changed settings during the statistic period With new settings we will see the other of Status for the same recorded or live video Supposed that for L 1 and S 1 settings we will see that 100 persons have status level less than 55 That means we need to change again settings for achievement alarm threshold 60 Based on the aims of Vibraimage Macro Mode Control change or leave next settings for levels L and S in macro mode settings So we change settings to L 1 and S 0 1 Do the same steps till status level statistics will satisfy aims of Vibraimage Macro Mode control For this settings L 1 and S 0 1 we have 90 persons status less than 60 and for 10 persons more than 60 We could fixed this settings if we have aim to indicate 10 of people with movement amount more than stand threshold 139 10 Stand requested level for Auto capture image s in Alerts settings based on Vibraimage Macro Mode Control aims for storage images of suspected persons on the hard disc Stand other Alerts settings according to control aims 11 Select Save Mode 12 Stand Save Mode settings base on aims of Vibraimage Macro Mode control Close Vibraimage program for saving fixed settings Next Vibraimage starts in Macro Mode and suspected persons status operation control 1 Run Vibraimage program Select I IV button for storage information 2 Set non zero value for Auto c
66. claimer the term of this EP 0488721 Al 6 1992 patent is extended or adjusted under 35 RU ure ates 4 eo Therefore this U S C 154 b by 653 days RU 3 0 United States Patent 22 PCT Filed Dec 14 2001 EE un kr dictionary of IEEE Grants to the person s having title to this patent 86 PCT No PCT RU01 00545 lard arie rd M 0 tic 0 the right to exclude others from making using 371 XQ 74 Attorney Agent or Firm Birch Stewart Kolasch amp offering for sale or selling the invention 2 4 Date Feb 20 2004 Birch LLP throughout the United States of America or im 9 PCT Pub No woowsiiss 52 ABSTRACT porting the invention into the United States of die an and America for the term set forth below subject PCT Pub Date Jun 27 2002 tyding esroslc imaga of Slag inks M a to the payment of maintenance fees as provided 65 Prior Publication Data provided The Biometry detects the objects which produce insignificant periodical oscillations thereby making it pos by law US 2004 0131275 Al Jul 8 2004 sible to receive and analyze the images of the objects on a If this application was filed prior to June 8 Go Foreign Application Priority Data background of stationary and moving objects Successive 1995 the term of this patent is the longer of rir le Dec 19 2000 RU 5 2000132334 to picture differences are evaluated and a sum of differences seventeen years from the date of grant of this G r of at s
67. coocular reflexes But it 1s possible to look on head movements according to the vibraimage system and technology We supposed that head balance for person without consciously movements could be considered as 1solated thermodynamic system and any emission of internal energy would change the balance of this isolated system and realized by movements or vibrations Every emotional state characterized by specific energy conversation and work done by the system transfers to micro vibrations if the person forced to stand or seet still The head vibtration parameters frequency in range 0 1 10 Hz and amplitude are stable in time for stable emotional state of person Parameters of vibrations changed only after emotional state alteration Vibralmage technolgy allows to contactless register of person vibration parameters and calculates emotions according to accomulated statistics of comparitive testing with EEG skin galvanic reaction and psychological testing Vibralmage technics parameters and research results are below 130 8 3 1 Vibraimage parameters Amplitude and frequency of human head vibrations differs in every point of space and total processing of this every point meaning could present integral movement parameter of person Some vibraimage pictures of one person reflects amplitude Fig 121 and frequency Fig 122 space distribution of vibrations are showed below visualized by color scale Fig 123 Fig 121 Frequency vibraimage Fig 122 Amp
68. cs Vibralmage is a recent psycholgically based emotional recognition visual imaging technology that measures pixels microvibration in terms of digital frequency and amplitude parameters The visualization of a 3 dimensial object fluctuation based on vibration parameters can thus be correlated to various mental states such as anger tension aggression etc as well as mood normal states and subconscious reflections Vibraimage can be characterized as one of primary images as visible spectrum such as infrared x ray MRI or ultrasound imaging Vibraimage technology is currently being tested in areas such as terrorist recognition emotional recognition interpersonal video dating interactions as well as for personal use Visualization of every pixels vibration became possible only in 21st century with the development of digital cameras and high power computers Long ago past scientists such as Aristotle had realized that biological object movement parameters characterize emotions thus vibraimage technology is a potential realization of this goal Physiology of movements The direct link between reflex movement and brain activity was discovered in 1863 by the famous Russian physiologist Ivan Sechenov in his publication Reflexes of Brain Charles Darwin in his book The expression of the emotions in man and animals 1872 also declared that reflex movements associated with emotions Nobel laureate and the famous researcher of aggression K
69. d period see Fig 82 The circle on the graph shows a point of the information accumulation for calculation of the frequency distribution histogram e 2010 06 16 15 42 30 measurement xml a file with results of parameters measurements for the specified period To open a file for viewing and printing the parameters graph and histograms it is possible having chosen item Open menu File 86 Akimov Valera 2010 06 16 15 41 30 BI cr PR RES PDA 0 751513 D 0 564772 Fig 62 Change person psycho energy conditions for the chosen period 87 3 5 4 LD table ID LD table Fig 83 shows the following information e Current values and LD rates of based processed Vibralmage parameters A 1 44 F1 F8 S1 S7 P1 P19 e Current values and LD rates of fast processing Vibralmage parameters A1 fast A4 fast F1 fast F5 fast LD table columns meaning V Current value of parameter Calc Yes LD detection on No LD detection off R1 Ratel Weight of parameter if its current value became more than the set base maximum bMax OR became less than the set base minimum bMin R2 Rate2 Weight of parameter if its current value became more than the set base maximum bMax AND became less than the set base minimum bMin LD parameters graphic value shows Value of parameter is considered for LD detection 1 Value of parameter doesn t considered for LD detection VI ST LD GR O ET pe A1 fast
70. deo window Status window Preset d ow Toolbar w SAC VI 2 Am Aura White background VI 10 Am 4 Show vI 10 F VT M F DELTA Am DELTA F View Mode DELTA FA k Ld Ld Ld k VIN Am d k F k view Mode DELTA FB gt mode Am mode F Mouse fn Centre AYI Omer Title Fig 57 VIF mode option A F e n VI 10 Am the button lio of the toolbar and VI 10 F the button w of the toolbar modes display vibraimage processed during 10 frames Fig 58 and constructed on the basis of amplitude Am and frequency F vibration analysis It is the additional possibility to change color of a background image and to add aura to vibraimage The same result is possible to receive if to bring the mouse pointer to a window of the chosen image and to press the right button of a mouse Fig 58 58 P Vibraimage 2008 04 22 15 18 28 avi gt BE r RUE Ta Vi vi KJK vi A PN Fast processing Base processing Video timer Info Height Statistics IntegratedN Am B 04942 Fig 56 Image area SRC VI 10 A and VI N A are switch on For image VI N A additional menu indication n F e In VI N Am the button ur of the toolbar and VI N F the button n of the toolbar modes display vibraimage processed during N frames and constructed on the basis of amplitude Am and frequency F vibration analysis The number of frames corresponding to paramet
71. e threshold Audio sens s LD mode Audio Manual Auto Compare AVG filter Aggression Fig 64 Lie detector mode beginning At work in a lie detector mode in an information column the Stat periods interval in seconds is set during which the system collects the data on object of research accumulates the information for definition maximal and a minimum level of the current parameters values that then at lie detection to define abnormal change of values of some parameters In a base variant that interval directly precedes the moment of the beginning of the lie analysis But the system gives an opportunity to make accumulation of the initial information about object at any time At a choice of item Start LD compare block the menu of Action see Fig 63 or corresponding toolbar item E will be made start of the beginning of an accumulation interval during any time For end of an interval it is necessary to press repeatedly the same button or to choose the same menu item Now at the lie analysis the condition of object will be compared from the information saved up beforehand 64 Parameter Compare an information column see Fig 89 defines what way of accumulation of the test information is chosen Value Off at the analysis of lie as test is used an interval Period of processing directly till the moment started lie detection Value On at the analysis of lie as test is used an inter
72. ed under license agreement and maybe used only in accordance with the terms of the license agreement It 1s against the law to copy the software or any other medium except as specifically allowed in license agreement The licensee may make one copy of vibraimage software for backup purposes Copyright 2001 2010 Elsys Corp All rights reserved Version Vibraimage 7 3 June 2010 Licensed users could download the latest version of Vibralmage software by the link http www elsys ru index_e php Updates and questions on www elsys ru Russia 194223 Saint Petersburg Toreza 68 ph fax 7 812 552 67 19 e mail elsys infopro spb su www elsys ru
73. edes the moment of the lie analysis beginning But the system gives an opportunity to make gathering of the initial information on object at any time At a choice of the REC menu item Start LD compare block or corresponding toolbar item start of the information gathering interval will be made For end of an parameters gathering interval it is necessary to press repeatedly the same button or to choose the same menu item Now at the lie analysis the condition of object will be compared from the information saved up beforehand T Reset timer F12 or toolbar button DO reset to 0 all timers video file timer graph timer The conclusion video and construction of graph begins all over again 36 At a choice of item Measurement or corresponding toolbar button ER the system makes accumulation averaging and a display of parameters for the specified time period The results display is made in the information panel in a mode M In the same place in seconds value of the averaging period Duration is set At a choice of item Graph analyze it will be open submenu gathering of the information about frequency distribution in vibraimage Fig 30 Histogram of frequency distribution appears in area of images Fig 31 Reset Pause Start LD black Start LD compare block Reset timers Fi Measurement Graph analyse Start H Markers d Start H 10s l Start S Starts 105 Start T Start T 105 Fig
74. either from a microphone or from a video file Off Audio modulation of vibration If one of these items is chosen than VibraSound sound will be switch on and will be modulated by curves of signal change in one of frequency distribution windows Fig 87 Letters C H S define from what window the signal for sound will be used C the first window H the second S the third Letters G and R show what color of graph will define modulation of a sound G green color R red color Audio modulation of vibration used green upper histogram frequency vibraimage Audio modulation of vibration used red upper histogram amplitude vibraimage Audio modulation of vibration used green middle histogram frequency aura Audio modulation of vibration used red middle histogram amplitude aura Audio modulation of vibration used green down histogram selected signal spectrum Audio modulation of vibration used red down histogram selected signal spectrum since Vibralmage 7 2 version at installation of the software are simultaneously installed the driver of virtual videodevice VIDeviceCapture Use of this virtual videodevice allows to build vibraimage in any program using video signal from the camera and to see reaction of the interlocutor for example at negotiations on Skype system If to start program Vibralmage and to set in it VI device Yes and to choose device VIDeviceCapture as a source of video 99
75. emoved terminal Item Network service d To enter a name of the removed terminal Item Remote host In the current version Vibralmage 7 3 system works only with one terminal to which transfers the information on a local network Further the version will be stipulated an opportunity of work at once with several terminals 3 To enable work with the chosen terminal The item Enable 4 To establish the network address of a computer of the removed terminal on which the program VINetStatus exe is started Item IP 5 To specify number of port through which the application of Vibralmage system started on the local module and the terminal will communicate Local TCP port the program Vibralmage exe will interrogate the given port for data exchange with the terminal TCP port UDP port ports for software of terminal through which it is changed by information with the computer on which started program Vibralmage exe Through UDP port goes an exchange by short messages Through TCP port goes an issue video data 6 To establish Critical level emotional threshold state of the person at which excess the warning message will be given out on the removed terminal and the picture of object of research is sent 119 vist wo BE Network service Local TCP port Remote host enable IP TCP port UDP port Fig 110 Network monitoring mode Information panel For adjustment of network parameters for the t
76. er sometimes specialist with own experience changed this intervals according the concrete conditions and aims It concerns others settings too Profiler or security staff view person during limited time period about 30s in real ticket control and provided testing showed that this time period 1s enough for conclusion Anger stress or nervous person has constantly higher movement activity and differs from the others passengers practically during whole time period Such person could not be so calm and poor color as staff which is practically invisible in vibraimaging or other normal passengers Fi Vibraimage lt 20080528113113 avi gt File View Settings Action bl d A av x O VI Av ARID am FR 203 s I sT LD GR E E a E V2 v ve Mie VV A AY VI 2 A 5 01 25 Fast processing Base processing Video timer 01 25 Info 15 1 00 2 00 640 1 00 Height 480 Statistics IntegratedN Am 78157 IntegratedN F E Anger Sress Tension VI 10 F112 01 25 VI N F 15 01 25 Fig 136 Normal calm passengers on ticket control 144 Fi Vibraimage lt 20080528113113 avi gt File View Settings Action ll 2 A av O VI AV AR ID am F R 859 52 BOG Beef vei apa AA Frame rate VI 2 A 5 01 38 In Fast processing Base processing Video timer IntegratedN Am IntegratedN F Anger Sress Tension Audio Level VI 10 F 19 01 33 VIN F 15 01 38 Fi vibraimage lt 20080521101
77. er N is set in information panel Fig 58 It 1s additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 58 A F e n Delta Am the button A of the toolbar and Delta F the button A of the toolbar modes display frame difference on the basis of amplitude Am and frequency F vibration analysis in base processing mode It is additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 58 e In View mode Delta FA the button of the toolbar and View mode Delta FA the button of the toolbar modes display frame difference on the basis of amplitude Am and frequency F vibration analysis in fast processing mode It is additional possibility to change color of background image and to add aura to vibraimage similar menu Fig 58 59 e In mode Am visualization and calculation of object parameters processed by pixel vibration amplitude e In mode F visualization and calculation of object parameters processed by pixel vibration frequency e In Mouse line mode the field of information displays vertical and horizontal brightness lines of the image Fig 59 for mouse position Fi Vibraimage VIDEO Look 1320 V2 DER File View Settings Action Help km amp 2 ae VIAVARLD Am F R 5173 t vi ST LD GR 5 e v5 vi Vig VL uM uM A N Frame rate In Fast processing Base processin
78. eriod for macromovements registration is smaller than for microvibration registration It mostly determines by the speed of human body movement and do not suppose movement accumulation and movement repetition Typical accumulation period for macromovements covers I second and maximum setting N accumulated frames depends on camera frequency for example for 15f s user stands N 15 or for 30f s user stands N 30 There is no sense to stand difference between base processing and fast processing frequency for macromovements registration For micromovement analysis was recommended to stand base processing frequency lower than fast processing because head micromovement is practically invisible for time period less than 0 1 second But for macro hand movement or body movement it is not so and when person is active or aggressive it moves very fast so it is recommended to stand base processing frame rate between 15 30 f s Also for macromovements analysis is recommended to set frame number N 2 5 because standard 2 frames accumulation gives more red color for any movement tired operators eyes and use this window in amplitude or frequency mode For N 10 and N 15 30 used frequency mode 8 4 3 Vibraimage Macro and Micro Mode Changes in Information Table settings between default mode microvibrations registration and macromovements shown on Fig 134 VI ST LD GR E VI ST LD GR O E Frame rate Frame rate Fast processing Fast processing B
79. eriod of researches ri Vibraimage v2 avi E DX VI ST M LD GR Fe Print NextPage Prev Page Two Page Zoom In Zoom Qut Close v2 avi Duration s D amp 4deo ece ME v2 2vi Fagression Sess Tersion Le Aggression Stress Tension Anxiety Suspect Balance Charm Energy Self regulation Inhibition Neuroticism A1 fast A4 fast A4 iS http www psymaker com Fig 76 Viewing of researches results in M mode Page 1 84 T Vibraimage lt v2 avi gt E DX VI ST M LD GR 5 i Prev Page Two Page Zoom In Out Close Fig 79 Viewing of researches results in M mode Page 2 85 i Vibraimage lt v2 avi E DX VI ST M LD GR 5 Print i j Two Page Zoom In Close 12 434 12 518 5 079 100 12 518 39 3 29 1 Tension Anxiety 33 5 33 8 73 9 77 5 ht pi dy psyrraker com Fig 80 Viewing of researches results in M mode Page 3 Simultaneously in the database catalogue fixed for researched person 3 files will be generated for example e 2010 06 16 15 42 30 measurement txt a text file with results of parameters measurements for the specified period e 2010 06 16 15 42 30 measurementH png a graphic file with the histogram of frequency distribution see Fig 81 saved up for 10 seconds e 2010 06 16 15 42 30 measurementT png a graphic file with graph of person psycho energy conditions changes for the specifie
80. erminal it 1s required to start the program VINetStatus exe In the appeared window it is necessary to press the right button of a mouse and to choose item Settings Fig 111 ViNetStatus SEE English Fyccak4 Settings Fig 1 11 Main window VINetStatus exe started on terminal PC In the opened window Settings Fig 112 it 1s necessary to specify same numbers of ports UDP and TCP ports of the terminal on which program VINetStatus is started and TCP port of the local module on which program Vibralmage is started as has been adjusted on the local module and as the network address to set IP address of the local module If both programs Vibralmage exe and VINetStatus exe are started on one computer at adjustments of a network in programs it 1s necessary to specify the same network address Module IP TCP port Local TCP port UDP port Alerts Sounds Images Critical level Frame rate In Fast processing Base processing Info Width Height Statistics IntegratedN Am InitegratedN F Anger Sress Tension Audio Level Fig 112 Settings window of VINetstatus exe started on terminal module 120 NOTE that if adjustment of a network is not made or and on the local module the basic E ViNetStatus Fig 113 Error message program Vibralmage exe 1s not started than at start of program VINetStatus the window with the error message Fig 113 displays 121 6 2 Operation in
81. errorists but it show that this passengers have some behavior and psychology characteristics differs them from others Some of them only have flight fear others have prohibited goods in luggage others are late for the flight and so on 147 Fi Vibraimage lt 20080521100345 avi gt T OJ x File View Settings Action Help HY Pb meS vavanip ier ni mz mad maf oF NENN sr iD cR O HSB s ee Frame rate In i VIN F 5 0C 24 Fast processing Base processing Video timer 00 24 Info p i ta Statistics IntegratedN Am 435 IntegratedN F 8457 Anger Sress Tension A fast t 1 01 40 3 93 P41 t 1 01 40 Fig 141 Macromovements control with graphs 148 9 Maintenance service and service regulations Maintenance service and service regulations of Vibralmage system is carried out according to this Manual and instructions of used hardware maintenance a computer the camera etc Contact your regional dealer if you have questions or problems in operation Attention Information in this document is subject to change without notice and does not represent the commitment on the part of Elsys Corp No part of this manual maybe reproduced or transmitted in any form or by any means electronic or mechanical for any purpose without written permission of Elsys Corp The software described in this document is furnish
82. eter in image area For convenience of observing a line of parameter will be chosen by rose color Fig 108 AR Selected parameter 1s not shown in image area 5 3 Toolbar The toolbar Fig 109 duplicates accordingly the following items menu e Open Menu File e Play Menu Action e Pause Menu Action e Zoom In Ctrl Menu View e Zoom Out Ctrl Menu View 5 PI OD Fig 109 Toolbar 118 6 Network monitoring In Vibralmage system the opportunity of a network monitoring mode complex is realized The basic program Vibralmage exe is started on the local computer with the connected video camera On the terminal the module VINetStatus exe 1s started which informs the operator of the terminal about the objects controlled by local PC 6 1 Network monitoring mode adjustment Before the beginning of operation in a network monitoring mode it is necessary to connect a local network computers of local module and the terminal and also to make adjustment of network parameters NOTE if Firewall system of protection is established on a computer it 1s necessary to enable of Vibralmage programs complex Adjustment of local module network parameters is made in the program Vibralmage exe in NW table of information panel Fig 110 It is necessary for start l To enable transfer of the information on a network between a computer on which the program Vibralmage exe is started and the r
83. formation panel in ST mode Level of audio signal down red strip 1s necessary to stand so that it was on the average position between the minimal value of a input signal which corresponds to silence in a room position of green strip on Fig 67 and the maximal value which corresponds to a voice sound of a person in front of the camera Fig 68 Position of a red strip stands by click of the left mouse button and input of a new value of a level vi ST Lp GRO E f Name cMin bMin cMax bMax Bh AL fast 0 133 0 000 0 000 0 000 0 000 Br Al 1 575 0 000 0 000 0 000 0 000 Eh A2 67 371 0 000 0 000 0 000 0 000 PA 44 042 0 000 0 000 0 000 0 000 BP A4 fast 0 289 0 000 0 000 0 000 0 000 BP A4 0 594 0 000 0 000 0 000 0 000 P F1 fast 0 017 0 000 0 000 0 000 0 000 MFI 0 090 E P F2 70 092 0 000 0 000 0 000 0 000 EP F3 29 822 0 000 0 000 0 000 0 000 E P F4 160 732 0 000 0 000 0 000 0 000 BP FS fast 0 106 0 000 0 000 0 000 0 000 RFS 0 404 0 000 0 000 0 000 0 000 Pr S1 142 433 0 000 0 000 0 000 0 000 Rbs2 7 587 0 000 0 000 0 000 0 000 GPrs3 0 321 0 000 0 000 0 000 0 000 K PS4 0 367 0 000 0 000 0 000 0 000 PSS 0 009 0 000 0 000 0 000 0 000 KP S6 0 050 0 000 0 000 0 000 0 000 GPs 26 612 0 000 0 000 0 000 0 000 PPI 56 599 0 000 0 000 0 000 0 000 Bh P2 31477 0 000 0 000 0 000 0 000 amp RbP3 1 679 0 000 0 000 0 000 0 000 BP P4 1 138 0 000 0 000 0 000 0 000 PS lie P7A ang P7F ang P6A str X mig gm mi mi mu mu mu mu mu m
84. g Video Timer 02 58 50 Info 100 1 00 2 00 Width 640 Height 480 Statistics lt Fig 59 Vertical and horizontal brightness lines on image In Sym line mode to the field of information display are added two areas in vertical area displays sums of frame difference lines of the visible image in horizontal sums of frame difference columns of the visible image Blue dashed lines on cuts display position of the mouse pointer Fig 60 60 Fi Vibraimage 2008 04 22 15 31 38 AVI File View Settings Action oz j z bel P hama Q VIAVARLD am F R v ONO x Em VI sT LD R E 9 B ad MM Yio Yio Vig Yu A A 38 438 0 000 0 000 VIN A 100 00 41 16 340 0 000 0 000 0 0 amp P A4 fast 0 010 0 000 0 000 DE o A4 0 077 0 000 0 000 0 002 0 000 0 000 0 016 78 799 0 000 0 000 24 433 0 000 0 000 141 819 0 000 0 000 0 203 0 000 0 000 0 394 0 000 0 000 46 080 0 0 11 501 0 0 0 000 4 427 0 0 0 000 0 524 0 0 0 000 0 287 0 000 0 000 0 115 0 000 0 000 20 346 0 000 0 000 0 000 D D Fig 60 Frame difference Sum lines on the image In Centre mode to the field of information display are added 3 vertical lines blue line displays vibraimage center for N 2 green line displays vibraimage center for N 10 red line displays vibraimage center for N 100 Fig 61 Ui Vibraimage lt VIDEO Look 1320 V2 gt OR Fie View Settings Action bel 2 4 avlen OG VI AV ARLD Am
85. gMin 0 00 gMax 20 00 8 IntegratedN Am 4 07 Show No gMin 0 00 gMax 20 00 Fig 106 Increased graph scale 115 Menu Action Fig 107 consists of the following items E Play Pause Fig 107 Menu Action The choice of item Play makes start of video file viewing and calculation of graph vibraimage parameters changes It also can be replaced by the corresponding button of the toolbar Item Pause stops viewing a video file and calculation of graph It also can be replaced by the corresponding button of the toolbar Menu Help consists of the following items e About VILogViewer information about program version 116 5 2 Information panel The information panel Fig 108 displays basic parameters of the recorded results Functional purpose of information panel is similar to purpose of information panel of the basic module Vibralmage exe in GR mode see section 3 5 E Al fast Show gMin gMax amp A1 Show gMin 0 00 gMax 1 00 m 56 29 Show Yes gMin 0 00 gMax 200 00 83 23 42 Show No Fig 108 LogViewer information panel LogViewer parameters indication V Current value of parameter Show Switch defines will be show or not selected parameter in the field of images gMin Defines the minimal value of parameter shown on the screen gMax Defines the maximum value of parameter shown on the screen Parameter graphic values shows G Indication param
86. graph of change in time of the set parameters see Fig 38 The choice what change of parameters will be displayed on graphs is made in an information column in mode GR Fig 38 Changes of the parameters marked by a G symbol are displayed on graph To choose parameter it 1s necessary to click the mouse left button when the mouse pointer is above the letter G the chosen parameter The parameters marked by E on graph are not displayed C Vibraimage v2 avi LOK File View Settings Action Help il gt j AVI ao il VI AV AR ID Am F REN em oM CET DER m vinn viv AA KE Mmm X H H Integrated2 Am 0 90 Show No Diff mode No gMin 0 gMax 10 HF fit 96 0 LF fit 96 0 GH H Integratedio am 4 29 Show Yes Diff mode No gMin 0 gMax 20 F fit 0 LIS fit 0 EH A IntegratedN Am Show Diff mod gMin gMax HF fit F fit v Integrated 10 Am t 01 00 a a ee See gt n TEE 0 00 insoraled Am t 01 00 Fig 38 Graph example 43 3 3 1 Graph analyze Choice of item Graph analyse will open submenu gathering of frequency distribution information in vibraimage Fig 39 Histogram of frequency distribution will be showed in area of images Fig 40 Eug Reset Pause Start LD block Start LD compare block Reset timers File Measurement Graph analyse Start H Markers d Start H 105 Start S Start S 105 Start T Start T 105 Fig 39
87. ig 9 Fig 9 Language selection for installation procedure 5 Further in the appeared window will be offered to begin installation or to read the system documentation Vibralmage 7 SHE Install Software Back Exit Fig 10 Installation window 18 6 You can read system documentations in Information window Fig 11 Vibralmage 7 ene C Articles gt Documentation C Presentations gt 3 Video C Highlights gt O Back Exit Fig 11 Information about Vibralmage 7 It is necessary to execute installation of 3 components for system installation Fig 12 Digital camera drivers It is not necessary if you use your own preinstalled digital camera Guardant Driver to install this driver you need have the rights of administrator VibraImage Software Vibralmage 7 Install Guardant Driver Install Vibralmage Back Exit Fig 12 Main Install window of Vibralmage components 8 Reboot your computer after this steps procedure 9 On desktop you can see Vibralmage software pictograms 10 Connect USB camera to free USB port 11 Connect Guardant dongle to the free USB port 12 Read Vibralmage manual 19 13 Run Vibralmage 14 In Vibralmage applications select working directory for store video capture file and protocol files see part 3 5 of this manual Note Manual installation for every system componen
88. ill see the image on the monitor fig 13 if you connected camera to PC and adjusted it on person face 3 1 Multifunction window Multifunction window Fig 13 consists of the following parts e main menu e image area e toolbar e information window In heading of the basic window the following information is deduced e type of video source Video camera or AVI file e model of video source Video camera model or AVI file name e Name of running Vibralmage module 25 Fi Vibraimage 2008 04 22 15 31 38 avi gt E DX File View Settings Action Help o H10 S10 lt 7 LD REC T 0 W P me W VIAVARID Am FOR OY EDD VI ST LD GR 2 DISK viv va A A A A Bg m om Frame rate J In lt Fast processing Base processing Video timer x EE ji T IntegratedN Am IntegratedN F Suspect Aggression Sress Tension Fig 13 Multifunction window of Vibralmage exe module 3 2 Main menu The main menu contains the following items e File View Settings o Action e Help 24 3 2 1 File menu File menu Fig 14 contains following items View Settings Acton Open Save image as Fz Database folder Ctrl F2 New record F4 Print Ctrl F Print preview Print setup Image capture F7 Exit Fig 14 Menu File Open for viewing and printing the saved file of XML format with parameters of system for the supervision interval Save image as
89. includes every scale colors and sharp color transfer like red color could transfer to blue Fig 119 Stress level more than 0 7 Aggression or activity level is low not more than 0 5 and tension level is high and usually more than 0 4 Frequency distribution histogram has several modes and high speed vibraimage signals spectrum presents superposition of exponential and uniform distributions Figs 119 Aura photos samples for stress condition of person 129 Aggressive and or tension state Aggressive state 1s not every time coordinates with tension and tension state 1s not always coordinates with aggression But often these two emotions accompany each other Aggressive state obligatory characterized by high frequency vibrations and red colors in aura Aura size 1s more than normal and gaps could absent but color and form non uniformity must present Fig 120 Stress level could be low less than 0 3 Anger level more than 0 7 and tension level more than 0 4 Frequency histogram distribution has maximum in right part of the range and distribution has amount dispersion High speed signals spectrum envelope looks like uniform distribution Figs 120 Aura photos samples for aggression condition of persons 8 3 Emotion recognition Head movements in space classically associated with vestibular system are studied and discussed in relation to the status of vestibular reflexes 1 e the vestibuloocular vestibulocollic and cervi
90. ings determination Connect camera to PC and select requested view Run Vibraimage program select Settings mode table Fig 130 132 Double click mouse on Macro default Set line Fig 130 Control status level window during the statistics period Based on the aims of Vibraimage Macro Mode Control change or leave default settings for levels L and levels S in macro mode settings Vibraimage Macro Mode control allows to indicate a suspected person with the other movement value than other persons in crowd The typical movement value for normal persons in frame shows statistics range for changes in status window for some time period Standard aim of vibraimage macro mode control is to indicate situation with movement value in frame more than threshold For example we control entrance of 100 persons through controlled place 50 persons has status level during macro mode control less than 50 80 persons have status level less than 55 90 person has status level less than 60 and only 10 persons have status level more than 60 That means 1f we want to indicate 10 of crowd differs from middle in this case default settings with alarm threshold 60 are ok But if we have that 100 entering persons have status level less than 30 that means we need to change alarm threshold or better levels L and S in macro mode settings from default Standing less L and S levels we increase the sensitivity of Suspected status indication so we could
91. is necessary to bring the mouse pointer to the chosen diagram to press the right mouse button and to choose item Delete 45 H10 At a choice of item Start H 10s Start H or pressing of the button simultaneously with accumulation the frequency analysis information is made testing psycho energetic conditions of the person And a mode of viewing of testing of the person condition results Fig 41 1s switched on off by the button or a choice of menu item BioTester results The user can be switched between windows with results of testing emotional conditions and windows with results of the frequency analysis The mode of viewing of frequency analysis graph is wg switched on off by the button E or a choice of menu item Frequency analysis results i Vibraimage lt VIDEO Eye 311Q gt File View Settings Action 29 D Sy i M VIAVARED Am FOR ro HST TS ee s VI ST M LD GR ES Sma SV MN AAA A Fast processing Base processing Video timer Info Statistics IntegratedN Am IntegratedN F Suspect Aggression Sress Tension Fig 41 BioTester results view mode Initial state The point on the graph displays the current psycho energy condition of the person On axis Y the mental condition of the person is displayed in 96 if it is more than the condition is better On axis X 1n a Kcal minute energy of the person is displayed At repeated pressing of the button or a choice of corresponding menu item will
92. l P2 P3 P4 poe P6 pz P8 p9 P10 Pll P12 P13 P14 P15 Dispersion of vibration density for frequency distribution at 10 processing frames Dispersion of vibration density for frequency distribution at N processing frames Center density distribution displacement of frequency at 10 processing frames Center density distribution displacement of frequency at N processing frames Level of lie Level of stress P6A calculation of parameter 1s executed on vibration amplitude P6F on vibration frequency Level of anger P7A calculation of parameter 1s executed on points vibration amplitude P7F on points vibration frequency Level of energetic P8A calculation of parameter is executed on points vibration amplitude P8F on points vibration frequency Level of information entropy on base of Shannon theory P9A calculation of parameter is executed on points vibration amplitude P9F on points vibration frequency Entropy index PIOA calculation of parameter is executed on points vibration amplitude P10F on points vibration frequency Antikurtosis Information theory parameter characterized density distribution form Level of classic thermodynamics entropy on base of Helmholtz theory P12A calculation of parameter is executed on points vibration amplitude PI2F on points vibration frequency Characterizes shift of the histogr
93. litude vibraimage Fig 123 Color scale Based on these two primary images are calculated about 20 integral vibraimage parameters reflects different types of movement and vibration divided into 4 main groups A amplitude parameters B frequency parameters S symmetry parameter P space and time processing parameters 8 3 2 Frequency histogram Frequency histogram shows head movement frequency distribution for every pixel and for accumulated time period default time period 1s equal 20 seconds Some real samples histograms coordinated with emotions and energy levels are printed in this point Figure 124 shows distribution histogram for person in normal conditions both graphics approximately looks like normal Gaussian distribution On Fig 125 we see un normal human states up graphic shows person with low energy level very tired and down graphic shows high energy emotions anger 131 M1 4 89426 5 1 13303 M2 4 65000 Ml 2 99402 5 01 581654 M2 3 20000 Fig 124 Normal state Ml 0 74433 NEM oca a Print 5 0 20551 M2 0 55000 Ml 7 52094 5 1 42633 p M2 8 65000 Fig 125 Abnormal state 132 8 3 3 Spectrum analysis Spectrum analysis of time dependence high speed vibraimage signals also could informative reflects person emotions Person in normal conditions has in several times more low frequency square in vibration spectrum than person in tension or aggression On Fig 126 we see the sample of
94. m item 7 1 from this document 21 For network monitoring mode please execute the next actions 1 Connect a local network computer to the local module and terminal or server 2 It s necessary to resolve work of Vibralmage applications if you have Firewall to protect your system 3 Run Vibralmage exe on local module Run VINetStatus exe on terminal 4 Read about Network monitoring parameters in Network Monitoring section see part 3 9 later 5 Adjust operating settings of Vibralmage system and a video camera for the local module according to the recommendations specified in items 2 4 of this Manual 6 Adjust the sound notification and a threshold of operation on the terminal in program VINetStatus according to the recommendations specified in section 3 9 7 Start operation with Vibralmage system in a network monitoring mode 22 3 Vibralmage module Vibralmage module gathers records processes and analyzes electronic images of biological and mechanical moving objects with various frequency and amplitude of vibration fluctuations Main module Vibralmage exe is designed for achieving central Vibralmage software goals Printing of screens is possible from the main menu of Vibralmage module on default printer Printing of personal data and images is function of VIPrint module For viewing the recorded LOG files use VILogViewer module Network monitoring is function of VINetStatus module After software installation you w
95. m two snc on am oi during the processing i j E thereof is accumulated biometry comprises a photo patent or twenty years from the earliest effec GOSK 9 36 2006 01 sensitive multielement transducer 1 and means for pro tive US filing date of the application subject HO4N 7 18 2006 01 cessing the images of the picture to picture difference which to any statutory extension G06K 9 00 2006 01 contain an exposure memory 2 3 a unit for evaluating the s 52 US Cl sss 382 216 382 107 382 118 picture to picture grap 4 a miele pietre differ If this application was filed on or after June 8 382 130 382 181 348 32 348 77 ence summator 5 and control registers 6 The device ig is twe 58 Field of Classification Search 348 32 accumulates the sum of the exposure differences detected by 1995 the ferm of this patent is twenty years from en S 348 77 155 430 431 699 382 107 109 the photosensitive multielement transducer the US filing date subject to any statutory ex 382 115 118 130 181 218 219 294 307 tension If the application contains a specific Sec application file for complete search history 6 Claims 4 Drawing Sheets reference to an earlier filed application or ap plications under 35 U S C 120 121 or 365 c al 1 the term of the patent is twenty years from the date on which the earliest application was filed subject to any statutory extensions WD ate Director of the United States Pa
96. n 0 00 Pt gMax 100 00 1 85 D i 1 1 1 DE m EC e IntegratedN Am t 02 20 Diff mode No 4 gMin 0 00 gMax 100 00 WKH HA 0 08 Show Mo Diff mode No gMin 0 00 gMax 100 00 X amp H H Integrated2 F 3 39 A fast 1 02 20 D 01 Fig 34 Markers samples 3 2 5 Help menu Help menu Fig 35 contains following items e About Vibralmage e Help F1 Help About vibralmage Help Fig 35 Menu Help 39 Use About Vibralmage command to view the information about software version license type and registered user name Use Help command to call the help system 40 3 3 Image area Vibraimages images and external vibraimages auras are displayed in the image area The basic window of the base module Vibralmage exe can be configured for surveillance in several operating modes The choice of an operating mode is made in item View of the main menu Fig 36 e The subitem Preset defines type of the display image the real image mode LD vibraimage mode VI aura on the real image mode AR and aura on vibraimage mode AV e The subitem Mode defines additional adjustments and quantity of windows with the image displayed in image area e The subitem Graphs defines an opportunity to display simultaneously on the screen graphs of parameters changes in time View Settings Action Settings Action Toolbar VI AV AR v Toolbar Info b
97. nalyze of single more danger person No suspect level calculation base on analyze all people in frame Yes face detection mode is used No without face detection No not draw rectangle around face Yes draw rectangle around more danger single person All draw rectangle for all person in frame For non danger person rectangle draw green color but if person suspect level more than Critical level than rectangle draw red color Alerts Stands critical level of emotion parameters for alarm signals At excess of the set level psycho emotion danger in the specified catalogue will automatically saved BMP files of the dangerous person from display screen Record will be made 1 time for the specified quantity of seconds Defines the sound signal will be used at work in network monitoring mode whether or not Level for sound of a audio signal at excess of aggression stress or suspect levels the setting limits On Off maker s beep in LD mode On Off reset sound beep In version Vibralmage 7 0 the user can form itself formulas for calculation of new parameters of vibraimage using any parameters on GR item For example Fig 88 Al Ad P4 55 Fig 88 User s formula for parameter X1 calculation Disable std sound No sound CG CR HG HR SG SR CG CR HG HR SG SR VI device 98 Vibra sound YES VibraSound mode is switch on NO VibraSound mode is switched off the sound acts
98. odule Operation System Processor RAM HDD DVD ROM USB port PCI slot Video capture Audio Network Windows XP Prof Vista with DirectX 9 0 or later PC with Pentium Core Duo2 2000 or better 1024MB or better 100GB or more free space DVDRW 2 free USB ports version USB 2 0 I free slot option WDM compatible video device audio capture device support 16 bit data and 44100Hz stream frequency LAN 100Mb s or better 11 1 3 4 System requirements for terminal module network monitoring Operation System Windows XP Prof Vista with DirectX 9 0 or later Processor PC with Pentium IV 2400 or better RAM 256MB or better HDD IGB or better Monitor Resolution 1024 x 768 or better On desktop must be free area don not cover other software windows with size 300 x 80 point or better Video capture WDM compatible video device Audio audio capture device and speaker Network LAN 100MB Ss or better 1 4 Package contents I Vibralmage DVD disc with software and Guardant 1 dongle User manual Digital USB camera options Microphone options un Q N LA Personal computer options 12 1 5 Basic functions Software specification Vibralmage software is the part of vibraimage system and located on DVD than installed to user s computer for electronic 1mages processing Image processing analyzing pixel movements fluctuations and vibration of various frequency and the amplitude performs by any p
99. oes an issue video data VI ST LD GR g Network service Local TCP port TCP port UDP port Fig 93 Network table 103 3 6 Save of measurements results 3 6 1 Save of current images Save of the current image in format BMP file is carried out with the help of a command Save image menu File or toolbar Input and save of the demographic data in a file db info 1s carried out in information panel of DB table Fig 94 at filling corresponding fields of New record Name Birth date and Comments After filing the demographic data in a field New record will appear an inscription Create to save the data in archive it 1s necessary to bring the mouse pointer and twice click the left button of a mouse NOTE the way to the catalogue of a archive database where video files files of images and files of statistics will be save is specified in a field DB folder The list of objects the information about which is in the specified catalogue displays as the list in the bottom of an information panel Fig 94 VI ST LD GR amp 2l Capture max lengths O purge old files Mo timer ho stop in HH MImS SS start at HH MIM SS stop at HH MM SS save extra info ho save AML Ho save TXT No DB folder C default Selected record Hew record Akimov Valera 12 09 1979 Didenko Tatiana 01 01 1958 Kisele Dmitry 10 09 1971 Martynov Oleg 18 06 1967 Minkin viktor 05 04 1959
100. onrad Lorenz claims that amplitude and intensity of reflex movements characterized the aggression On Aggression 1966 According to the action of vestibular system functions and mechanical movement person stands with the head in a balanced vertical position continuously and reflexively performing three dimension micromovements or vibrations The dependence between head vibration parameters and emotional state characterized by the vestibular emotional reflex VER or vestibular energy reflex Vibraimage technology is the realization of medicine psychology modern computers and television sciences for human emotion recognition Vibraimage plans to do human emotion control so precise like physics measurements Vibralmage software is designed to achieve the following goals e Cognitive control of emotions e aw enforcement e Aggressive and crime persons detection e Passengers remote surveillance e Psychological and medical monitoring e Lie detection e Research of weak response to humans e Training and relax control for fitness and sport applications e Meditation and aura control e Live and recorded video processing Vibralmage7 software includes 4 correlated programs Main module Vibralmage exe Printing module VIPrinter exe LogViewer module LogViewer exe and NetMonitoring module VINetStatus exe Vibralmage system realizes remote and auto monitoring of emotions levels such as stress aggression and tension and detect
101. play see Fig 28 For creation of the new interface in the catalogue where Vibralmage program has been installed subdirectory Skins is created In it 2 files are placed face png a picture of screen appearance and config xml in which the arrangement of areas for parameters show Is set State of Mind and Mood Analysis for e Health Communications Anger Stress Tension Critical IUCN ELSYS Fig 26 An example of the new interface of a working window created under the order of the user 35 3 2 4 Action menu Action menu Fig 29 contains following items E 1 Reset Pause Start LD block Start LD compare block Reset timers F12 Measurement Graph analyse d Markers d Fig 29 Menu Action Reset reset all saved up information and statistics about frames and start new cycle collection of information Pause stop last accepted frame of data in image area of windows Start LD block or toolbar button H begin calculation of parameters of a lie level in a manual mode It is necessary to press this button again to stop calculation in a manual mode The moment of start calculation in a manual mode will be noted by a vertical green line the moment of stop calculation by red line At work in a lie mode in an information table is set the interval during which the system collects the data on object of research that then to use these data for comparison In a base mode this interval directly prec
102. program on your computer 1 Run Soft Vibraimage7Setup msi from CD to install Vibralmage 7 x application Follow to the instructions in setup dialog Click Close after installation complete 2 Press button Next in the appeared window of the beginning installation 3 Accept the license agreement and to press button Next in the appeared window 4 In the appeared window specify a way to the catalogue where files of the program will be written down then to press button Next 5 Press button Next in the appeared window allows installation of software files on your computer 6 Press button Close at the end of installation 7 Vibralmage program pictograms appears after the end of installation in system menu and on desktop of your computer 8 To reboot a computer 9 Install Guardant driver from DVD before start Vibralmage 7 x Connect dongle to USB port of computer and start Vibralmage exe Note Auto installation for every system component is made according to the recommendations specified in section 2 4 of this description 17 2 4 Auto Installation 1 Check System Requirements NOTE check the version of DirectX software on your computer 2 Close other applications 3 Insert your DVD Vibralmage7 x into DVD ROM The file of installation autorun exe will be automatically started If the file has not been started start it manually 4 Choose language of installation in appeared window F
103. r processing base parameters of vibraimage noted by a word base Frequency of the frames fps during calculation period Reduce input frame rate At value 3 will be processed every third frame Main settings Minimum number of accumulated frames By default 2 Average number of accumulated frames By default 10 Maximum number of accumulated frames By default 100 Gain factor Threshold of a palette Defines a threshold of displayed image value of less brightness considers as black Parallel number of processing in multi core systems Default 0 for Core 2 Duo Filters Removes single points surrounded by black It is intended for reduction of noise of a video camera Delete video noise in bit By default 8 This filter 1s important when the object is motionless and values changed because of camera noise Delete video noise for fast processing Scale normalization filter to a range 0 255 after its trimming by filter Extended At the included mode calculation fast parameters are made only inside of aura contour at switched off on the whole frame Multiplication factor used for vibraimage visualization in a amplitude mode Reduce vibraimage on borders of motionless contrast objects Frame difference D x y is multiplied by the factor K K 1 SV MB 100 Color image Crop X Crop Y F6 HF F6 LF F6N Disable Am Disable F Disable 2x Fast Disable VI 10 Disable VI 2
104. ression Vo no more 75 e gt Level of stress no more 80 e Level of tension no more 60 e Level of potential danger no more 60 e Level of lie no more 30 Recommendations for human emotion recognition are given below 8 2 Vibraimage visual interpretation Vibralmage system gives different technical possibilities for emotion recognition but typical users prefer to characterize person by external vibraimage or aura on real image Aura based on vibraimage allows clearly and visually demonstrate emotions and physiological state of human being Short interpretation of aura colors and forms follows below This short information does not limited but only gives to user the main directions of person analysis Every user after application experience could greatly diversify extend and intensify knowledge about mental and aura of individual Brief aura color interpretation is shown on Fig 117 Hz Red activity and aggression color Yellow trouble and tension color Green normal activity and top condition color Blue rest and calm color Violet tiredness color Fig 117 Brief aura color interpretation 127 Aura colors irregularity and non uniformity characterized unbalanced state and character of person Brief aura form analysis e Any aura asymmetry form color characterized deviation from mental or physiological norms e Any breaks in aura uniformity characterized deviation from mental or physiological norms
105. s lie in a real time mode VibraImage also allows to register and analyze human activity characteristics from recorded video files AVI format and to analyze medical psychological and emotional human state for different applications The method system and the device of said Vibralmage technology are protected by the patents of Russian Federation RU 2187904 Fig 3 RU2289310 Fig 4 Software Registration N2006614137 Fig 5 United States Patent US 7346227 Fig 7 8 and awarded with Gold medal on the international exhibition of inventions and innovations Brussels Eureka 2002 Fig 6 IFOCCH TIC AS ILI ALLA LoT 7 B A HA H3OBPETEHME Ne 2289310 vei ae hI N aapna ee a X X D D D 5 X X yl X X X X X x K Xa X X Be X X amp X D 5 Xx p X X p X X D X D x K X X D X X La G A o IA RA EX ER ER XR KA KA XX RA BA RA EX EX EY EX EX EX XR XR E XX EX XR EX EX EX RE K EY EX EY Gd Fig 3 Patent of Russian Federation Fig 4 Patent of Russian Federation RU 2187904 RU 2289310 CBH IETEJIbCTBO 06 ogpnyumanbHoli perucrpauuu nporpaMMbi aia DBM Ne 2006614137 DIPLOMA MINE P Var STAM Aarandn I porpamma ZWCTAaHIIHOHHOTO ECKOHTAKTHOFO CKAaHHpOBAHHsI H HJEHTHPKKANKN ICHXOPHIKONOFUYECKOFO COCTOAHUA YEJIOBEKA Vibralmage 6 0 Ipasoo6razarer m OOwecm o c oepanuuenno omeemcmeennocmoio Mnozonpodusonoe npednpuamue Iacuc gt RU
106. t your regional dealer NOTE The facial image of the person must have a good quality biggest possible size in frame and be in the middle of the screen Presences of other people in the frame and low image quality have influence to emotion analyze and gives errors in lie detector functions 69 P Vibraimage lt 2008 04 22 15 31 38 avi gt E DX elecin pre Seren nee Bist File BUEN Settings Action H10 S10 lt F ID REC T 0 EIDBE ER eoe D REC Te bl HS y Info bar Bass Boe ida Vi Buttons s la ad Vi Wiel vis vis viv AY NAA MB Help iire Google s Fram Graphs I n Frequency analysis s results i Video window Vid Status window s LD window A A Info N E VIG Mode K Preset L Width 540 Height Statistics IntegratedN Am 1 33508 SDTIBIMITH ania IIS View cr s ft Er ml f pes tome EESTI TH vidcap32 Ste Total commander 53 Vlicrosoft Word VIPrinter 7 O FingerCard Fig 69 Example of LD window 70 3 4 Toolbar The toolbar Fig 70 duplicates correspondingly the following menu items Save Image File menu oy Print Image File menu Save current image to the archive File menu M I AVI start record File menu For stop AVI files recording needs push on this button again load AVI file Settings menu
107. t is made according to the recommendations specified in section 2 2 of this description 20 2 5 First testing of vibraimage system It is necessary to test vibraimage system technical parameters before start human emotions control Focused on test pattern for example EIA 1956 and control resolution of used television web camera Measured resolution must be more than 400 television lines TVL in the frame centre Measure the noise level of used television camera before emotions control Noise level indicates IntegratedA parameter 3 5 1 item from this document it value must be less 0 1 Approximately the image of focused test pattern must be black in VI mode acceptable to have only several color pixels Make a choice of the audio source channel and adjust its parameters according to the recommendations specified in section 3 1 3 before lie detector mode start ATTENTION It is preferable to study vibraimage method and system principals given in patent US 7346227 before start Vibralmage operation First steps for person emotion control could be the following Place the person opposite to camera Focused camera on person face with maximum facial size on frame Wait while person will calm down for example ask him to make in mind the account from 1 up to 100 Measure a level of aggression Measure a level of stress Measure a level of tension Measure a level of potential danger Compare the results with norms fro
108. t mask in Video mask mode 32 33 The item Skype mood can be used if at you on a computer Skype program is install At teamwork of Skype and Vibraimage programs you can observe current psycho emotion parameters of the interlocutor Fig 27 0 2 ae G G Kopobka VIL PMcydok4 ana GeMpemeeUntitled 1 p652 large GARMIN C _ copy mj ji s cis i Vibraimage lt VIDEO Eye 3110 gt Joey File View Settings Action Help CESE ml A avlen VI AVARLD Am FR w Hes E e VI ST LD cm etm ww um V VI vr Skype Contacts Call View Tools Help cS F Flag F yy til 5 Oe M i Mle Vig Ma Vi Video timer EE Info Mozilla Firefox Kopo B Unlimited calls to landlines More I New v Search Contacts Groups and Conversation Topics AL Width Contacts Conversations Sight recompressot v avarme AiG 7o Statistics SG Echo Sound Test Service Integratedfit m 1 76162 KE IntegratedM F B 76085 Hes Total Co Suspect commander Anger Sress Tension v Audio Level MagicDisc sdb ici OR Call phones wr F t4 Directo a 2 ry oH lt opo El S h 0 p KOMNMbHTEP e CeTeBoe OKPYXKEHHE Ann PHACYHOKT classic lie a bigstockpho bike Garminques Lad Fig 27 For example Skype and Vibralmage programs teamwork 34 The item Skins allows to model under orders of the user the interface for results dis
109. tent and Trademark Office AM M M ee Fig 7 United States Patent US 7346227 Fig 8 United States Patent US 7346227 I page 1 Useful information 1 1 Basic applications Human emotions control system further system Vibralmage intends for registration analysis control and research of human emotion state for different applications in the fields of security biometrics psychology medicine electronics and human life Vibraimage is a new technology so welcome to be the first and to discover new pages in vibraimaging and human emotions 1 2 Operation conditions The system provides serviceability in conditions of influence of external factors Do not store or use the system in any of the following locations e Humidity above 90 at temperature above 35 C e Exposed temperature below 10 C or above 40 C 1 3 Specifications 1 3 1 Vibralmage system data e Resolution TVL more than 400 e Noise level of Vibralmage bit less than 0 1 e Frame speed frame sec more than 12 e Frequency range Hz more than 0 1 10 10 1 3 2 Digital web camera requirements e Sensor e Resolution pixel e USB compatible e Frame speed f s more than e Microphone e Exposition control e Color mode e Flicker mode CCD or CMOS Sensor From 640 x 480 till 1280 x 1024 USB 1 0 USB 2 0 10 external auto and manual color and B W switch Flicker 50Hz and 60Hz 1 3 3 System requirements for local m
110. the menu Action or pressing of the toolbar button After start of a accumulation and averaging mode in the top of an information column there is a running line Progress displaying a course of data accumulation process M table Fig 77 shows the following information e Current values of based processed Vibralmage parameters A1 A4 F1 F8 S1 S7 P1 P19 e Current values of fast processing Vibralmage parameters Al fast A4 fast F1 fast F5 fast e Speed of input frame from the camera FPS 1n speed of frame processing for a base processing mode FPS BP and speed of frame processing for a fast processing mode FPS FP e Basic parameters describing psycho emotional condition of the person Aggression Stress Tension Anxiety Suspect Balance Charm Energy Self regulation Inhibition Neuroticism M table columns meaning V The value of the parameter average for the set period S root mean square deviation of parameter cMin The minimal value of parameter for the period cMax The maximal value of parameter for the period NMin The minimal value of parameter for a normal condition of the person NMax The maximal value of parameter for a normal condition of the person 82 Note values of cMin cMax parameter are displayed only when measurement mode M has been began and the information for the specified period of time is saved up GR amp E M Min chin 40 000 FO23 29 000 7 005 4 0
111. trance audio signal exceeds the setting level and stops when the level of audio signal becomes less than the setting level On graphs the moment of the beginning of data accumulation is displayed by a vertical green line the moment of end a vertical red line 2 manual Accumulation of the preliminary information is made in Stat periods interval Calculation of a lie level is made only after a choice of item Start LD block the Action menu Fig 63 or corresponding toolbar item For end of an interval of lie parameters calculation it is necessary to press repeatedly the same button or to choose the same menu item The moment of start on the graphs will be marked by a vertical green line the ending of calculation red line Acton Reset Pause Start LD block Start LD compare block Reset timers Fiz Measurement Graph analyse d Markers Fig 63 Menu Action 3 auto Calculation of a lie level is made constantly the current values of parameters are compared to values saved up for the previous period Stat periods General switch on of a lie detector mode is made through item Enable the information panel or with the help of LD button on toolbar Fig 64 63 ri Vibraimage v2 avi k OX Fie View Settings Action Help bed SS 2 A t i UU VI AV ARLD Am F R sass 2 io mem v vr vi vi NN A LI us HM row E Aig 6 I odd Stat period s Base period s Li
112. ulations 2 1 1 Power supplies requirements Power supply depends on your location and power supply of you computer and camera For low noise and reliable system action the monitor power units of cameras should be connected to an electric network through the special sockets having additional ground contact the socket of a class 1 For reliable maintenance system the equipment included in complex and the equipment taking place in direct near should be certificated on electromagnetic compatibility according to requirements 2 1 2 Light exposure requirements Natural illumination of object can be used only if speed of natural light exposure changes of object does not exceed 1 Lx s Illumination of object by fluorescent lamps with illumination in a range 400 600 Lx in a plane of object is preferable 2 1 3 Camera vibration requirements The television camera used for surveillance and or object on which the camera is established should be motionless and have no vibrations more than I mkim s Vibraimage and processing parameters depend on camera vibrations so unstable camera position could have influence on and gives errors in processing results 14 2 1 4 Settings Vibraimage recommendations For adequate registration person vibraimage is recommended to take into account the following factors 1 The object person should be well and uniformly illuminating also preferably black and white image of the person should be precise
113. val Period of processing which has been marked by the user beforehand When the user includes accumulation of the preliminary information in this field value Capture It is necessary to stand special adjustments of Vibralmage system for operation in lie detector mode concerning audio and video devices For operation in lie detector mode the choice of the channel of a audio source is carried out through the window of the settings caused with the help submenu Settings Audio for example a microphone Fig 65 ETT Action Video Audio Settings Language Audio Capture Filter Record group l 4 SoundMAX HD Audic I Video mask t Capture channel Skype mood F ig 65 Audio source channel select Before working in Lie Detection mode adjust the level of audio signal Changes of audio signal input options are made in a corresponding fields of an information panel in ST mode Fig 66 65 vi ST LD GR 5 Name cMin X Ph A1 fast 0 000 APA 0 000 KPA 0 000 EPA 0 000 BP A4 fast 0 000 amp b A4 l 0 000 E P F1 fast 0 000 MFI amp bF2 0 000 amp PF3 0 000 E P F4 0 000 X P F5 fast 0 000 amp bFS l 0 000 amp PS1 0 000 amp PS2 0 000 853 0 0 000 R PS4 0 000 PSS 0 0 000 Ph S6 amp K amp E amp amp amp amp amp amp E amp E amp E amp K amp amp K amp amp P18 Com Audio amp Leve Th Fig 66 In
114. vel Average value of the F1 parameter period in seconds determined during readout F6N Value of parameter F6N is set in section Filters an information column in a mode E and defines quantity of the frame processed in Fast Processing mode Root mean square deviation for F6 parameter Not average current value of F6 parameter in seconds showing the current time period of F1 parameter changing The group of parameters S1 S7 registers symmetry of vibrations between left and right parts of person body S1 Ratio symmetry of amplitude left to the right changed pixels inside the object in 2 consecutive frames S2 Difference between the left and right average amplitude of object vibration in 10 frames S3 Difference between the left and right average amplitude of object vibration in N frames S4 Ratio of the changed pixels quantity in the left part of object to the changed pixels in the right part in 2 consecutive frames S5 Ratio of the changed pixels quantity in the left object part to the changed pixels quantity in the right object part calculated in 10 frames S6 S7 78 Ratio of the changed pixels quantity in the left object part to the changed pixels quantity in the right object part calculated in N frames Difference between the maximal frequency of vibrations of the left and right object parts in N frames The group of parameters P1 P19 registers features of mathematical Processing of vibrations P
115. video data will be saved in video file Vibraimage v2 avi oX File View eius Action Help HW VI AV ARLD AS F R 2527 S uma Audio Language 9 a a Vv Me Me VIVIS AA AA o f 110 Fi 0 003 Record group Video mask Capture channel Base proc Skype mood Video timer Info Height Statistics IntegratedN Am Ls IntegratedN F VIN FoCC 0031 Suspect Aggression Sress Tension Fig 24 Submenu Capture channel If in the field of supervision there is an additional mobile object which prevents measurements of the basic object submenu Video mask Fig 25 allows to edit video data In Edit mode you can cover black mask on addition object image Fig 26 Also you can reset current mask Reset Video mask mode save mask in external picture file Export Video mask mode and load external mask Load Video mask mode Settings Acton Video a Audio a Language KE Record group j Video mask Load video mask Capture channel Reset video mask Skins Export video mask Skype mood 4 Edit mode Fig 25 Submenu Video mask Vibraimage VIDEO Look 1320 V2 File View Settings Action ml 4 iO VIAVARLD Am FOR TNS VI ST LD GR E DIKER KK Frame rate In t Fast processing Base processing Video timer Info width Height Statistics IntegratedN Am IntegratedN F Suspect Mask Macka Fig 26 For example edi
116. w with biotester analysis results Fig 42 Video windows switch on off the small windows with real image Fig 17 the button B of the toolbar Status windows switch on off the windows with current suspect level Fig 17 the button H of the toolbar LD window switch on off the windows with current lie level Fig 17 the button 1 of the toolbar settings Acton Toolbar Info bar Buttons 7 Save image as v Print Graphs en pie uen analysis s results Image capture EE PE w AVI Start capture video window fee SEN window ANI Fie LE window VIDEO Mode plar os Preset w Pause ce v VI v AN v AF w LD uem 4 mode Am v mode F T w Reset das 4 Graphs v Start H 105 v Starts 105 v Start T 105 v Frequency analysis s results BioTester results ies 4 Start LD block Start LO compare block T v Reset timers ise 1 2 3 vw Measurement Fig 16 Submenu Buttons 26 27 ma P SES x AP NBS TA SGT LER FTO Ce V IIS balls ml amp mia VIAVARLIDAm F R y MN m e w e 2 VI ST LD GR e fad MME MS Me vA A AY JPNBIK ANA ibraimage eee Frame rate In Fast processing Base processing Video timer SHIC Tema Ee SeTebble NO A 2 aid RUOPE AGNOPAat ROPSKHHa APNBIK ANA Info PrOTeSSII VISKEYVMAKEr 2 ig posott p pr Li ad LE Width AGIODO ESKE SACMA Height 480 ri niese amcar KO
117. werful advantage compared with microvibrations it permits crowd control Microvibration control has powerful advantage compared with macromovements it allows auto control Both of them are realized by Vibraimage system with different settings ri Vibraimage 2009 10 02 16 49 17 avi gt File View Settings Action bl 2 AVI zu OD VI AV ARID Am F Biwi e LD REC TOM MT LE m ee Me MM AA TALCE MI SRC F 00 49 x1 Vibra sound disable std sound no sound CG CR HG HR SG SR VI Device Indication Micro default Macro default Status Fig 130 Set Macro mode by double click of left mouse button Note that in a macromovements analysis mode the status window will be automatically displayed Fig 130 in which the current level of danger will be displayed 136 Specially for adjustment of display modes at work in Macro mode in a field of an information column are added a number of parameters Fig 131 T Vibraimage 2009 10 02 16 49 17 avi File View Settings Action k p 32m VI AV ARILD Am F R w 110810 Tes JO eS COM VI ST M LD GR e ES s tan i v2 Vu WM MI A ALA A Ee Audio _ MI SRC F 01 42 Auto Compare AVG filter Aggression Stress Tension Suspicious Macro mode level L level S aura mode macro mode Face detection draw Alerts Critical level Auto captute image s Sound Susp Sound A Sound S Sound T marker s beep reset beep Fig 131 Macro mode settings

VibraImage 7.3 Manual Eng

Contents

Download Pdf Manuals

Related Search

Related Contents