Home

Slides

1. Contact Quality Detection EmoState Contact Quality Detection Grease Sensor Details ch Rs ians E CQ Status Ig 0 60 5 Overall Skil 0 60 Affectiv Excitement 0 60 Time 34 secs 0 47 Long Term Engagement Boredom 0 20 V Auto Reset Training Results b EmoEngine Log Cognitiv 70 Reply with error code 71 Request GET OPTIMIZATION DA 72 Rey with error code 0 73 Request GET OPTIMIZATION PA Expressiv 74 Reply with errar code 0 Emotiv SDK Tools EmoComposer usage Interactive mode f EmoComposer e co EmoState Interval 0 25 2 se V Auto Repeat EmoState Interval 0 25 2 sec 7 Auto Repeat EmoState Time 34 m 3 different SS SE output types ML z un Request ne ongtem 2 37 E Reply CogResult or ExpResult eeng n E ques 6 E PTIMZAION en Reply 73 ZEEE OPTIMIZATION PA Emotiv SDK Tools ce a gt gt Loro EmoComposer usage The multitude of API functions are translated to roughly a w dozen different strings intended to allow the Emotiv SDK developer to see that an API function call has been serviced These strings include PROFILE ADD USER PROFILE CHANGE USER PROFILE REMOVE USER PROFILE
2. int state EE EngineGetNextEvent eEvent New event needs to be handled if state EDK OK EE Event t eventType EE EmoEngineEventGetType eEvent EE EmoEngineEventGetUserId eEvent amp userID Log the EmoState if it has been updated if eventType EE EmoStateUpdated New EmoState from user EE EmoEngineEventGetEmoState eEvent eState Log the new EmoState logEmoState ofs userID eState writeHeader writeHeader false Listing 2 Buffer creation and management Programming with the Emotiv SDK Before the end of the program EE_EngineDisconnect is called to terminate the connection with the EmoEngine and free up resources associated with the connection The user should also call EE_EmoStateFree and EE EmoEngineEventFree to free up memory allocated for the EmoState buffer and EmoEngineEventHandle ee ek Loi o EE EngineDisconnect EE EmoStateFree eState EE EmoEngineEventFree eEvent A Listing 3 Disconnecting from the EmoEngine References http emotiv com store sdk edition sdklite SDKLite developers will download the compressed file Emotiv_SDKLite_v1 0 x exe which contains both the SDKLite Snare and the User Manual Previous presentation
3. EEG Control a 1 I UL J Rocio Alegre Marzo November 25th 2011 Glossary Affectiv Suite emotional state Cognitiv Suite conscious thoughts Expresiv Suite facial expressions Emotiv SDKLite A version of the Emotiv SDK that uses neuroheadset emulation to allow integration with new and existing software Software developed will be compatible with the Emotiv EPOC headset Glossary nis ww ww ww ww EmoComposer An Emotiv EmoEngine emulator for development EmoKey Tool to translate EmoStates into signals that emulate traditional input devices such as keyboard EML EnoComposer Markup Language an XML based syntax that can be interpreted by EmoComposer to playback predefined EmoState values EmoScript A text file containing EML which can be interpreted by EmoComposer to automate the generation of predefined EmoStates Parts of the API Emotiv Control Panel Emotiv Control Panel 1 0 0 0 Application Connect Help ENGINE STATUS USER STATUS Emotiv Engine is ready Headset j E SSE vo Battery Meter Detected Add User Expressiv Suite Affectiv Suite Cognitiv Suite Status No signal Parts of the API Emotiv Control Panel ce a gt gt Loro Provides a GUI graphical user interface that interfaces with Emotiv EmoEngine through the Emotiv A
4. gt Parts of the API Affectiv Suite Ao real time changes in the subjective emotions experienced by the user CA ek Loro Offers 5 distinct Affectiv detections Engagement Boredom Frustation Instantaneous Excitement Meditation Long Term Excitement That characteristics are universal in nature and don t require an explicit training or signature building step on the part of the user It is very important that a new user profile is selected when a new user puts on the neuroheadset Parts of the API Affectiv Suite A emoi ConseiPone0800 An Application Connect Help USER STATUS ENGINE STATUS Emotiv Engine is ready 171 625 Good Battery Meter Detected Affectiv Suite Detection Name red Engagement Boredom ue e instantaneous Eten Display Length 30 Seconds Detection Name Show n m mi omen E Instantaneous Excitement v Long Term Excitement Seconds Display Length 150 Parts of the API Affectiv Suite Detection Details o Excitement is characterized by activation in the sympathetic nervous system which results in a range of physiological responses including pupil dilation eye widening sweat gland stimulation heart rate and muscle tension increases blood diversion and digestive inhibition o Engagement is characterized by increased physiological arousal and beta waves along with attenuated
5. duration of the training period currently 8 seconds Ee lo e j user X o a o 7 Add User Remove User Save User 90 Training Advanced Current Action Neutral Detection Status Active Difficulty Level Overall Skill Rating ff 0 Trained Action Skill Rating M Push 0 v Disappear 0 ob Add Remove Edit You are now ready to control the cube with your mind Each action skill rating reflects how well you can do the action More training would increase your cognitive ability Parts of the API Cognitiv Suite Emotiv Control Panel 1 0 0 0 LITE Application Connect Help T q System Status e A System Up Time os 1 Wireless Signal em ze Battery Power Pr icis Headset Setup Expressiv Suite Affectiv Suite Cognitiv Suite Some users will find it easier to maintain the necessary mental focus if the cube is automatically animated to perform the intended action as a visualization aid during training Select the Move cube according to training action checkbox 7 Headset User ae o Y o lo user X y E m Add User Remove User Save User o 90 Training Advanced Current Action Neutral Detection Status Active Difficulty Level Overall Skill Rating ff 0 Trained Action Skill Rating M Push 0 v Disappear 0 ob Add Remove Edit You are now ready
6. ngineGetNextEvent Q For near real time responsiveness should poll for new EmoStates at least 10 15 times per second Before your application terminates the connection to EmoEngine should be explicitly closed by calling EE EngineDisconnect Open a connection to EmoEngine Some Code Blocks New EmoEngine Event INIT Code to handle the EmoEngine Event MAIN LOOP Continue Close the connection to EmoEngine Figure 21 Using the API to communicate with the EmoEngine TERMINATION Programming with the Emotiv SDK 3 main categories of EmoEngine events cc gt gt Loro o Hardware related events when users connect or disconnect Emotiv input devices to the computer e g EE_UserAdded o New EmoState events changes in the user s facial cognitive and emotional state retrieve the updated EmoState by calling EE_EmoEngineEventGetEmoState e g EE_EmoStateUpdated gt Suite specific events training and configuring the Cognitiv and Expressiv detection suites e g EE_CognitivEvent NOTE A complete list of all EmoEngine events can be found in Appendix 3 User Manual Programming with the ce gt gt Loro Emotiv SDK gt Scenarios Supported by EE EngineRemoteConnect in place of EE EngineConnect Developing with Emotiv SDKLite not include an Emotiv headset so all Emotiv API function calls communicate with EmoComposer It listens on port 1726 so an applic
7. especially games are sensitive to the timing of key presses Emotiv SDK Tools EmoKey Saving Rules to an EmoKey Mapping file o EmoKey allows you to save the current set of rule definitions to an EmoKey Mapping file o Example d Enable Keystrokes Enabled Player Target Application Weis e E e ens TT Trigger Conditions of lt Rule 1 gt Enabled Action Trigger Value Bo m 0 emt 0000030 Emotiv SDK Tools x EmokKey rulel ekm lt EmoMappingModel mappingName ruleT ekm gt NAME lt EmoMapping enabled 7 name Rule 1 keys PA sendOnce 1 sendTofocus 1 targetApp WHICH APPLICATION WINDOW sendHotKeys 0 ctriKey 0 altKey 0 shiftKey 0 winKey 0 hotKey 0 holdKey 0 holdTime 20 triggerDela e 20 VARIABLES pla yer 0 gt lt EmoStateCondition gt TRIGGER enabled value 1 gt action value 7 gt Smile threshold type double value 1 gt actionRule value 0 0 is equal to lt EmoStateCondition gt lt EmoMapping gt lt EmoMappingModel gt Emotiv SDK Tools KH EmoComposer usage Allows you to send user defined EmoStates to Emotiv Control Panel EmoKey or any other application that makes use of the Emotiv API Two modes nteractive mode o EmoScript mode w SDKLite users will rely on EmoComposer to simulate the behavior of Emotiv EmoEngine and Emotiv neuroh
8. ian EN Y a e Emotiv Control Panel 1 0 0 0 LITE DEM eee Gs Headset User o 9 e W Z2 1 i A k 4 d System Up Time Aas lo X user v y m nf Battery Power 0000 Add User Remove User Save User 3 Ze o TC r Headset Setup Expressiv Suite Affectiv Suite Cognitiv Suite Action i Training Advanced A ctio n ta b Action Control Current Action Neutra D S A ay S Detection Status Active information a about the current Qe Trained Action Skill Rating State of the lv Push es 2 Y Disappear o Cognitiv detection and allows the user to define the odd E C u r re n t S et of You are now ready to control the cube with your mind Each action skill rating reflects how well you can do the action More training would increase your cognitive ability actions Parts of the API Cognitiv Suite Emotiv Control Panel 1 0 0 0 LITE Application Connect Help Headset Setup Expressiv Suite ENGINE STATUS EmoComposer connected 225 169 Good High Cognitiv Suite Action Control Current Action Detection Status Difficulty Level Overall Skill Rating Trained Skill Rating Y m 0 2 0 You are now ready to control the cube with your mind Each action skill rating reflects how well you can do the action More training would increase your cognitive abi
9. no expression detected high level a maximum level of expression detected The graph level will increase or decrease depending on the level of expression detected Parts of the API Expressiv Suite Interpreting graphs gt Right Smirk Left Smirk share a common graph line A center level no smirk low level a left smirk high level a right smirk o Laugh low level no expression detected high level a maximum level of expression detected The graph level will increase or decrease depending on the level of expression detected Parts of the API Expressiv Suite Sensitivity Adjustment Panel e This is controlled through sliders to the right of corresponding graph o For each facial expression check the performance of the detection If you feel that the Expressiv detection is not responding readily to a particular expression then increase the sensitivity for that expression _ Parts of the API Expressiv Suite gt Training Panel gt Requires the user to train the system by performing the desired action before it can be detected o Trained Signature the system will only detect actions for which the user has supplied training data gt Not all Expressiv expressions can be trained In particular eye and eyelid related expressions i e blink wink look left and look right can not be trained and always rely on the Universal Signature
10. 249 Es Goo If all is all right click at the button Start change to Stop e Parts of the API Expressiv Suite gt One example Look right and smile Parts of the API Expressiv Suite One example Look right and smile Can see the mouth movement at the cartoon and signal changing Parts of the API a Expressiv Suite gt aor di graphs Blink low level non blink state high level a blink o Right Wink Left Wink share a common graph line Center level no wink low level left wink high level 2 right wink e Look Right Left share a common graph line and a single sensitivity slider control A center level looking straight ahead low level looking left high level looking right o Raise Brow low level no expression detected high level maximum level of expression detected The graph level will increase or decrease depending on the level of expression detected Parts of the API Expressiv Suite ced ek Loi o Interpreting graphs o Furrow Brow low level no expression detected high level a maximum level of expression detected The graph level will increase or decrease depending on the level of expression detected e Smile low level no expression detected high level a maximum level of expression detected The graph level will increase or decrease depending on the level of expression detected o Clench low level
11. Power Displays an approximation of the remaining charge in the neuroheadset s built in battery IF ww ww ww y ENGINE STATUS as i amp ready d gt Na Battery Meter Detected Parts of the API Emotiv Control Panel Although the EmoEngine supports up to two real simultaneously connected neuroheadsets Emotiv Control Panel only displays status information and detection results for a single neuroheadset at a time Accurate detection results on good sensor contact and EEG signal quality This display is a visual representation of the current contact quality of the individual neuroheadset sensors cc gt gt Loro No signal Red Very poor signal Orange Poor signal Yellow Fair signal Good signal Parts of the API Expressiv Suite One example Look right and smile EmoComposer connected x 7 Put the Lower face action Smile value values from O to 1 Parts of the API Expressiv Suite One example Look right and smile H SER gt gt SDK EmoComposer connected DB EmoComposer 234 279 L0 0 04ITE Good Application H Put the Eye action Look Right Affecty Excitement Parts of the API Expressiv Suite One example Look right and smile Parts of the API Expressiv Suite One example Look right and smile D SER S gt S EmoComposer connected A Emo DK
12. alpha waves The opposite pole of this detection is referred to as Boredom Parts of the API ccd gt gt Loro Cognitiv Suite The Cognitiv detection suite evaluates a user s real time Y y brainwave activity to discern the user s conscious intent to perform distinct physical actions on a real or virtual object Is designed to work with up to 13 different actions 6 directional movements push pull left right up and down and 6 rotations clockwise counter clockwise left right forward and backward plus one additional action that exists only in the realm of the user s imagination disappear NOTE allows the user to choose ONLY up to 4 actions that can be recognized at any given time Parts of the API A Cognitiv Suite E e 1 II x motiv Control Panel 1 0 0 0 LITE a i E a E Application Connect Help e i i um EE Headset User D o0 o W System Up Time SCH E 0000 ee y y gt L F i SC Battery Power 0000 Add User Remove User Save User S L I d i ee Uses a virtual 3D cube to display an animated representation of the Cognitiv detection output Sa Add Remove Edit You are now ready to control the cube with your mind Each action skill rating reflects how well you can do the action More training would increase your cognitive ability Parts of the API AM Cognitiv Suite E gt 4 one A
13. to control the cube with your mind Each action skill rating reflects how well you can do the action More training would increase your cognitive ability Parts of the API Cognitiv Suite gt Training Neutral The Neutral action refers to the user s passive mental state one that isn t associated with any of the selected Cognitiv actions Typically this means engaging in passive mental activities such as reading or just relaxing Advanced tab It is strongly recommended that you only change these settings with the guidance of i Emotiv personnel Parts of the API Cognitiv Suite Tips o Most users typically achieve their best results after training each action several times o Overtraining can sometimes produce a decrease in accuracy this may also indicate a lack of consistency and mental fatigue o If it becomes hard for you to return to neutral try refreshing your mental state by momentarily shifting your focus away from the screen and relaxing Emotiv SDK Tools EmokKey ce gt gt Loro Translates Emotiv detection results to predefined sequences of keystrokes according to logical rules defined by the user through the EmoKey user interface Can be saved for later reuse Communicates with Emotiv EmoEngine in the same manner as would a third party application by using the Emotiv API exposed by edk dll in Emotiv SDK Tools Emokey Conne
14. LIST USER PROFILE GET CURRENT USER PROFILE LOAD PROFILE SAVE EXPRESSIV GET EXPRESSIV SET AFFECTIV GET AFFECTIV SET COGNITIV SET and COGNITIV GET Emotiv SDK Tools EmoComposer usage EmoScript Mode gt EmoScript files are written in EML EmoComposer Markup Language EML documents are XML documents that can be interpreted by EmoComposer o Note that these EmoScript values are not interactive and can not be modified by the user use the Interactive mode for this instead _ Programming with the ce gt gt Loro Emotiv SDK w w Vv vy Program in C and compiled with Microsoft Visual Studio 2005 Visual Studio 2008 is also supported The Emotiv API is exposed as an ANSI C interface that is declared in 3 header files edk h EmoStateDLL h edkErrorCode h and implemented in 2 Windows DLLs edk dl and edk_utils dll Applications simply include edk h and link with edk dll Emotiv API functions that modify or retrieve EmoEngine settings are prefixed with EE An EmoState is an opaque data structure that contains the current state of the Emotiv detections which in turn reflect the user s facial emotional and cognitive state ES Programming with the Emotiv SDK Programming with the KH Emotiv SDK Must establish a connection to the EmoEngine by calling EE_EngineConnect or EE EngineRemoteConnect Events that can be retrieved by calling
15. PI Interface showcases the EmoEngine s capabilities to decipher brain signals and present them in useful forms using Emotiv s detection suites _ Parts of the API Emotiv Control Panel ENGINE STATUS USER STATUS Emotiv Engine is ready 0 This is the EmoEngine Status Pane Displays indicators that provide real time information status and neuroheadset sensor contact quality It also exposes user profile management controls in Parts of the API a Emotiv Control Panel May connect to EmoComposer emulator tool from the Connect menu SDKLite Developers you will need to change this menu setting and connect to EmoComposer EmoComposer should be launched prior to selecting this option in Control Panel rex Emotiv SEN Panel 1L0 0 0 LITE n Application Help To EmoEngine Ctrl Alt F1 To EmoComposer Ctrl Alt F2 Host 127 0 0 1 No Signal Ctrl Alt R 0 Reconnect Port 3008 Headset Setup Expressiv Suite Affectiv Suite Cognitiv Suite Status No signal Parts of the API Emotiv Control Panel ee EE Loro System Status A summary of the general EmoEngine status System Up Time The timestamp in seconds attached to the most recently received Wireless Signal This displays the quality of the connection between the neuroheadset and the Emotiv wireless USB receiver connected to your machine Battery
16. ation that wishes to connect to an instance of EmoComposer running on the same computer must call EE EngineRemoteConnect 127 0 0 1 1726 Testing application s behavior the same connection Developer wants to speed the development process by beginning his application integration with the EmoEngine and the Emotiv headset without having to construct all of the Ul and application logic required Emotiv Control Panel can act as a proxy for either the real headset integrated EmoEngine or EmoComposer Control Panel listens on port 3008 so must call EE EngineRemoteConnect 127 0 0 1 3008 Programming with the Emotiv SDK print some instructions std string input std getline std cin input n option atoi input c_str switch option case 1 if EE_EngineConnect EDK_OK throw exception Emotiv Engine start up failed break case 2 std cout lt lt Target IP of EmoComposer 127 0 0 1 std getline std cin input n if input empty input gtid obring 127 0 0 1 if EE EngineRemoteConnect input c str 1726 EDK_OK throw exception Cannot connect to EmoComposer break default throw exception Invalid option break Listing 1 Connect to the EmoEngine Programming with the Emotiv SDK EmoEngineEventHandle eEvent EE EmoEngineEventCreate EmoStateHandle eState EE EmoStateCreate unsigned int userID 0 while
17. cting EmoKey to Emotiv EmoEngine By default EmoKey will attempt to connect to Emotiv Control Panel when the application launches Can also be connected to EmoComposer Useful when creating and testing a new EmoKey Mapping in Emotiv SDK Tools EmoKey gt Configuring EmoKey Rules EmoKey 0 8 0 0 Default Emotiv SDK Tools EmoKey gt Configuring EmoKey Rules Translate Laugh events generated by Emotiv s Expressiv Suite to Enabled Action Trigger Trigger Conditions of lt LOL gt Laugh is greater than Emotiv SDK Tools EmoKey EmoKey 0 8 0 0 Default gt Configuring EmoKey Rules to the text LOL defined in Key s Emotiv SDK Tools EmoKey EmoKey 0 8 0 0 Default gt Configuring EmoKey Rules Application Connect Help Keystrokes 7 Enable Keystrokes Enabled Player 7 Send Once As long as the Affectiv Suite s Instantaneous Excitement LC n xus detection is also reporting a aa score gt 0 5 P is greater than Emotiv SDK Tools EmoKey gt Configuring EmoKey Rules Add trigger conditions to the selected rule Emotiv SDK Tools EmoKey r EVA EmoKey 0 8 0 0 Default XT gt Configuring EmoKey Rules Applicat
18. eadsets Emotiv SDK Tools EmoComposer usage Interactive mode E EmoComposer MEA X 4 EmoComposer En X Player EmoState Interval 0 25 2 sec Auto Repeat player 0 EmoStatelnterval 0 25 3 sec E Auto Repeat Contact Quality Detection General Settings Re DO rted E contact CO Status fa quality for each sensor Overall Skil 0 50 Affectiv Excitement 60 t Long term 0 37 Engagement Boredom Upperface Raise Brow x 0 00 Lovet E gt BEE Training Results EmoEngine Log Cognitiv 70 Reply with error code 71 Request GET OPTIMIZATION PA 72 Realy wth error code 0 73 Request GET LOFUMIZATION_RAL 74 Reply with error code 0 Emotiv SDK Tools EmoComposer usage Interactive mode E EmoComposer E x ec Player 0 EmoStateinterval 0 25 2 sec 7 Auto Repeat Player y EmoState Interval 0 25 2 sec Auto Repeat Interactively control EmoState detection values and training result values Emotiv SDK Tools EmoComposer usage Interactive mode 3 EmoComposer cpi Help T EmoComposer Help Application Application Interactive Player o y EmoState Interval 038 7 sec V Auto Repeat EmoState Interval 0 25 2 7 Auto Repeat
19. ion Connect Help Keystrokes Enable Keystrokes Enabled Player Name 7 Send Once Trigger Key Keystroke sequence to be sent to divine ain the Windows input queue Ge Edit by double clicking on the cell Emotiv SDK Tools EmoKey gt Configuring EmoKey Rules Behavior Checkbox to control whether Ces the key sequence is sent only once or is greater than repeatedly each time an EmoState s greater thar update satisfies the rule conditions r EVA EmoKey 0 8 0 0 Default XT Application Connect Help Keystrokes Enable Keystrokes Enabled Player Behavior 7 Send Once Emotiv SDK Tools EmoKey Configuring EmoKey Rules o Emulates a Windows compatible keyboard and sends keyboard input to the Windows operating system s input queue The application with the input focus will receive the emulated keystrokes or other window you define gt EmoKey is run in the background Emotiv SDK Tools Emokey gt Configuring EmoKey Rules r T A Keys QU e Son Hot keys or special keyboard keys any combination of Send specific keystroke s LOL C Send hot keys these and another keystroke ta Shift Vin Key hold time 20 ms gt Key trigger delay time 20 ms cnc Key press duration and delay times some applications
20. lity Parts of the API Cognitiv Suite Emotiv Control Panel 1 0 0 0 LITE ian ile Application Connect Help f a Ce SA System Status BY E 1T d System Up Time da ESCH Wireless Signal oooo g Battery Power o00o s Sei icis Headset Setup Expressiv Suite Affectiv Suite Cognitiv Suite d Training process consists of three steps First select an action from the dropdown list 7 Headset User 95 o0 e lo user X y E m Add User Remove User Save User Training Advanced Current Action Neutral Detection Status Active Difficulty Level Overall Skill Rating ff 0 Trained Action Skill Rating M Push 0 v Disappear 0 ob Add Remove Edit You are now ready to control the cube with your mind Each action skill rating reflects how well you can do the action More training would increase your cognitive ability Parts of the API Cognitiv Suite Emotiv Control Panel 1 0 0 0 LITE Application Connect Help T q System Status e A System Up Time os 1 Wireless Signal em ze Battery Power Pr icis Headset Setup Expressiv Suite Affectiv Suite Cognitiv Suite Next begin imagining or visualizing the action you wish to train press the Start Training button During the training process it is Very important to maintain your mental focus for the

Slides

Contents

Download Pdf Manuals

Related Search

Related Contents