D2.1 Preliminary non Integrated Prototype Realization
Contents
1. 19 Figure 18 Recharging of the data 3l Figure 19 Format Factory 1 32 Figure 20 Conversion of audio 33 Fic ure 21 SANO CONVO ON 33 Page 5 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Executive Summary Within the context of WP2 of the project SPLENDID the two main objectives of Task 2 1 have been the selection or the design of a sensor capable of detecting chewing events and of an activity sensor During the first stage of the project a preliminary non integrated prototype of chewing sensors has been realized The prototype consists of two microphone based acoustic sensors and an optical sensor associated with its data logger A series of measurements have been carried out at CSEM in order to assess whether the signals acquired by the developed sensors are good enough to be used to extract useful information on mastication The prototype will be delivered in July to Wageningen University for the first validation study which 1s planned to be executed from July 28 to August 15 2014 within the context of Task T6 2 and T6 3 The sensors will be evaluated and the comfort of wearing of sensors will be tested as well A specific activity sensor previously d2. Peer Review Date Reviewed By 19 June 2014 Eirini Lekka 26 June 2014 Monica Mars Eirini Lekka Copyright Copyright 2014 CSEM SA This document has been produced within the scope of the SPLENDID Project The utilization and release of this document is subject to the conditions of the contract within the 7 Framework Programme grant agreement no 610746 Please use a new number for each new version of the deliverable Use 0 for Draft and Peer Reviewed x for Submitted and Approved where x gt 1 Add the date when this version was issued and list the items that have been added or changed A deliverable can be in one of these stages Draft Peer Reviewed Submitted and Approved 3 Only for deliverables that have to be peer reviewed Page 2 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Table of contents DOCUMENT HIS TORY epe EI UPPER 1 TABEEOPRCONIENUDS 3 ABBREVIATIONS ng eb EHI eei PO CE EHE UI Dir rie HIER 4 TABER OOP TG WRG 5 EXECUTIVE SUMMARY oss Ier nnn 6 I INTRODU TION EE 7 1 1 IVE ODO OG 7 1 2 Ibo e Rn IE NE ts 8 1 3 IDOCUMPBNT SIRU OR 8 2 USERMANUAL THE FIRST SENSOR PROTOTYPE FOR THE VALIDA HON STUDY ec 9 2 1 iyu OD
3. where Ppg is a vector containing the desired PPG signal Fs is a scalar containing the sampling frequency PathToCSVfile and CSVfile should be strings containing respectively the path and the name of the CSV file to be imported with its extension The source code of the readPPGsignal function is provided in Annex Error Reference source not found Page 34 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders 4 Conclusion The main objectives of Task 2 1 are to design a sensor which allows detecting mastication events and to select or design an activity sensor During the first stage of the project a preliminary non integrated chewing sensor prototype has been developed Research on adequate commercial off the shelf headsets which could physically support either the acoustic sensors or the optical sensor has been carried out A series of recordings using the designed sensors in a fully controlled environment have been done As mentioned above detailed description of design and verification of the current prototype will be given in the next deliverable D2 2 The prototype will be delivered in July to Wageningen University for the first validation study which will be executed from July 28 to August 15 2014 within the context of Task T6 2 and T6 3 The sensors will be evaluated on subjects and a data base will thus be obtained The comfort
4. eesin E E R E 9 2 2 ACO FIC SENSORS 10 200 SETUPOF TH AUDIO MODULE nner ene EUIS 10 2 2 2 CONNECTION MICROPHONES TO THE AUDIO MODULE eene 13 2 2 9 WEARING OF THE MICROPHONES 13 2 24 SIGNALACOUDLITION E ieee ON EM DRIN Mme 15 2 3 OPTI CAE TN 15 2 3 1 PAIRING OF THE DATA LOGGER TO THE 15 2 3 2 WEARING THE PPG SENSOR cccccccsssesssssseecceeeceaaeesseeccceeseseaeeseeeeeeeesesaaaeseeseeees 19 2 3 3 SIGNAL ACQUISITION WITH 19 2 4 BATTERY RECHARGING OF THE DATA LOGGER 31 3 HANDLING OF DATA ACQUIRED BY THE SENSORS e eee eee een nues 32 3 ACOUSTIC SENS ORG E H 32 SML DATON TIN MATLA D E 32 3 2 PESEN OR e E E E E E 34 RE ESEE EE 35 REPBRENCESG 36 Page 3 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Abbreviations DOW Description of Work Technical Annex to Grand Agreement with EC WP Work Package PDA Personal Digital Assistant Page 4 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorde
5. for the Prevention of Obesity and Eating Disorders Device Som Port Device information Param 19 16 Param 20 8 Param 22 10 Param 47 270 Param 40 381 Session 0200000010 Start Time 25 06 2014 09 18 08 Start To check the resting internal memory execute index 10 Session duration 270s End page index 381 Check of Session 000000010 downloaded Advanced gt Custom cmd gt 13 available Seg Nr 60 Response Type Response Class Memory Opcode 10 Param Wem MemoryStatus The percentage of available La 282 Param 5 255 Daram 263 d memory is displayed Page 29 of 36 SPLEND D Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders FP7 610746 D2 1 Version 1 0 Advanced Port COM Seq Nr 60 Response Type Response Class Memory Opcode 10 Param 1 382 Param 9 255 Param 41 65535 Available memory 15288kB 9990 erase the recorded sessions from the atad erasing Erase the l Memory er 14 memory internal memor y click erase button The Seq Nr 68 Response Type Response Class Memory Opcode 10 Param available memory should be now 10090 1 0 Param 9 256 Param 41 65535 Available memory 1 amp 384kB 10096 15 Disconnect To disconnect the Bluetooth link click Bluetooth Disconnect Exit er 16 close the application click Exit Commander 17 Turn off the To turn o
6. Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders To verify if the sensor is well connected and positioned in the ear it 15 recommended to enter into streaming mode to view waveform of PPG signal Click stream button as shown in the previous figure PPG signals are Streamed and can be seen in a new window as shown in the upper figure Only Ppg 3 represents the captured signal by the PPG sensor Verify the waveform of 15 somehow like what is shown in the lower figure PPG signal streaming 624442 00 hb MTM ee FAM TIT Close the streaming window by clicking the 6 red X button on the top right corner of the display window Page 23 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Port COM7 Disconnect C S Device information Param 19 18 Param 20 33 Param 22 0 Param 47 6 Param 40 9 session Ox0Q00000F Start Time 23 06 2014 09 19 33 Start page Click record button to launch a recording at Gs End page index 9 wn a Verify that Record started is displayed in the interface window Start recording Page 24 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Ea
7. a manner that rapid data acquisition could be performed to facilitate notably the work of WP3 At the same time designs on future integrated version of the system have also been carried out in parallel 1 2 Document audience The intended audience is all the SPLENDID partners among which WP3 WP4 and WP6 partners are especially addressed 1 3 Document structure The document is organized as follows an executive summary is given at the beginning of the document The user manual of the prototype is described in Section 2 Handling of acquired raw data for further processing 15 presented 1n Section 3 Conclusion will be drawn at the end of the document Page 8 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders 2 User manual of the first sensor prototype for the validation study 2 1 Introduction In this section the use of the non integrated prototype of chewing sensors 15 presented The current section will serve as the User Manual dedicated to the first validation study which will be performed at Wageningen University in July 2014 Separated and independent modules will be used for the first evaluation and data base campaign During this phase there is no need of large integration Additionally up to 9 electrodes for EMG acquisition for validation purposes will be used and attached to the subjects Two microphone based acous
8. of wearing of sensors will be tested as well During the further work more effort will be done on mechanical design in order to build fashionable ear worn sensors Aiming at the first integrated version V1 of the prototype the next step of the development consists in continuing the on going work of designing an analog front end for the acoustic sensor a more robust optical sensor and the data logger New experiments have already been planned and signal quality assessment will be again carried out Meanwhile a new activity sensor based on the one delivered to Mando and AUTH will be directly embedded into the future data logger Page 35 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders References 1 SPLENDID Consortium Grant agreement for Collaborative project Annex Description of Work pp 7 9 2013 Page 36 of 36
9. sensors 3 11 Data import in MATLAB The present section details how the raw data acquired by the various sensors can be imported in MATLAB for further processing The raw audio file for both the bone and air microphone is a WMA file when using Sound Recorder as recording application The following two step procedure is proposed to import the data to be handled in MATLAB 1 The WMA file should first be converted to a Waveform Audio File Format WAV wav extension file To do so the use of the free software Format Factory available at http www pcfreetime com index html 15 suggested The installation file will be provided jointly to this document The procedure for converting a WMA file into a WAV file using Format Factory 15 detailed hereunder a In the Audio tab on the left click on the gt WAV button 47 FormatFactory 3 3 5 eer o x Task Skin Language Help 65 EA P woes Output Folder Option En x Video Source Size Convert State Output F2 P 44 Audio E 1 x B v v AMR M4R T 71 OGG WavPack gt 2 Picture Mobile M Cam FOF Device ROM Device DVDXCDUSO CA lt z Facto Advanced Ed n Elapsed Time 00 00 00 After Conve D FFOutput v Use Multi Threads Figure 18 Format Factory interface b In the new window as shown in Figure 19 add the WMA file using
10. through electrical cables A green LED has been integrated to indicate the presence of the power supply when it 1s lighted 2 2 Acoustic sensors 2 2 1 Setup of the audio module The Alesis audio interface 102 EXPRESS 15 a plug and play device which means that no additional drivers need to be installed to use it with the PC as shown in Figure 2 Page 10 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Figure 2 Audio recording interface device and associated USB cable To enable the 102 EXPRESS to receive audio to the PC follow the instructions below Windows7 1 Use the provided USB cable to connect the 102 EXPRESS to the PC Once the cable 15 plugged a green LED 15 lighted just on the black rectangle screen on the device indicating that the device 1s power on 2 Goto Start menu gt Control Panel gt Hardware and Sound gt Sound 3 Click the Recording tab and select Microphone 102 as the default device as shown in Figure 3 Internal Microphone Conexant 20585 SmartAudio HD Ready Microphone 2 UN Default Device Figure 3 Audio recording interface device and associated USB cable 5 Photos taken from http www alesis com 1o2express Page 11 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders 4
11. 0 20140625 093917 Ppg 3 dat _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 rawdata dat _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Step counter Qi dat _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Step counter dat Page 28 of 36 Date modified 11 06 2014 09 45 25 06 2014 09 03 23 06 2014 09 18 21 02 2014 01 22 10 04 2014 16 39 14 05 2014 10 53 14 05 2014 10 49 14 05 2014 10 53 14 05 2014 10 53 14 05 2014 10 56 25 06 2014 09 04 Date modified Type 25 06 2014 09 39 25 06 2014 09 39 25 06 2014 09 25 06 2014 09 39 25 06 2014 09 39 25 06 2014 09 25 06 2014 09 25 06 2014 09 25 06 2014 09 25 06 2014 09 25 06 2014 09 9 25 06 2014 0 25 06 2014 09 39 DAT Fi 25 06 2014 25 06 2014 25 06 2014 25 06 2014 25 06 2014 25 06 2014 09 39 DAT Fi 09 39 DAT File 25 06 2014 25 06 2014 09 39 DAT Fi 25 06 2014 09 39 DAT Fi 09 39 DAT Fi 09 39 Microsoft Excel C 09 39 DAT Fi 09 39 DAT Fi 09 39 DAT Fi 25 06 2014 09 39 DAT Fi 39 DAT Fi 2 2 39 DAT Fi x 99 PI P 22 39 39 39 39 39 39 P my m 90 90 90 1 1 1 1 KB 1KB 1KB 1KB 1KB 1KB 1 1 KB 1 1 90 90 90 0 KB 1 KB 1 KB SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour
12. 2255 000000010 20140625 093917 Activity counter dat 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Activity integral dat data of different Sessions are stored under the _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Band pass subband 1 acc dat 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Band pass subband 2 acc dat Datab i ld In t ind Explorer 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Band bband 3 acc dat atabase folder In the Windows Ore 091608 Pulsear2255 093917 Band pass subband 3 acc da 20140625 091608 Pulsear2255 000000010 20140625 093917 Band pass subband 4 acc dat 99 the column Data mo dified can be us ed to 20140625 091608 Pulsear2255 000000010 20140625 093917 Energy expenditure Qi dat _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Energy expenditure dat distinguish the files related to each session In 1 20140625 091608 Pulsear2255 000000010 20140625 093917 Heart rate delay dat 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Heart rate Qi dat fact the showed date and time to _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Heart rate dat th e recor din g ti me H 20140625 091608 Pulsear2255 0x00000010 20140625 093917 info csv _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Ppg 1 dat _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Ppg 2 dat _ 20140625 091608 Pulsear2255 0x0000001
13. 4 05 2014 10 56 Application 1 601 KB fal Sigma DefaultSerialPortConfig 11 06 2014 00 52 Microsoft Access 1 KB Page 18 of 36 Figure 15 Installation folder SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders 2 3 2 Wearing the PPG sensor Wearing of the PPG sensor is shown in Figure 16 Ensure that the photodiode is positioned so that it 1s faced towards the LED The LED 15 integrated into the red soft foam cushion that 15 inserted in the ear canal It might be necessary to use scotch in order to fixate the sensor Figure 16 Position of the PPG sensor 2 3 3 Signal acquisition with Commander The PC application Commander developed by CSEM allows to stream and display signals captured by the PPG sensor and to download recorded sessions from the embedded memory into PC The following instructions listed in Table 1 should be followed to record Page 19 of 36 SPLEND D EE SEVENTH FRAMEWORK Personalised Guide for Eating and Activity Behaviour PROGRAMME for the Prevention of Obesity and Eating Disorders Table 1 Instructions for recording with application Commander Turn on the Turn on the PPG sensor data logger by data logger pressing the red pushbutton a X Ae n Device Sigma COMS CSe Y Device informatio Welcome to the CSEM commander Launch the Double cli
14. Click the Playback tab and keep your default device Click Properties in the lower right hand corner 6 In the new window click the Advanced tab and select 2 channel 24 bit 44100 Hz Studio Quality as the default format d X Microphone Properties Advanced Default Farmat Select the sample rate and bit depth to be used when running in shared mode 2 channel 24 bit 44100 Hz Studio Quality Exclusive Mode Allow applications to take exclusive control of this device Give exclusive mode applications priority Figure 4 Audio recording interface device and associated USB cable 7 Uncheck both boxes under Exclusive Mode 8 Click the Levels tab and set the slide to 50 9 Click OK to close the Properties window 10 Click OK to close the Sound control panel Windows XP 1 Usethe provided USB cable to connect the 102 EXPRESS to the PC 2 Goto Start Menu Control Panel Sounds and Audio Devices 3 Click the Audio tab 4 Under Sound Recording select USB Audio Codec as the default device 5 Click OK 6 Photos taken from http www alesis com 1o2express Page 12 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders MAC 1 Usethe provided USB cable to connect the 102 EXPRESS to the PC 2 Goto Applications gt Utilities gt Audio MIDI setup 3 In the Audio Devices tab under Systems Settings select USB Audio Codec as
15. Figure 13 The data logger successfully paired to the PC 7 Right click on the icon and click the Services tab Note down the communication port number as shown in Figure 14 Page 17 of 36 SPLEND D Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders FP7 610746 D2 1 Version 1 0 3 SPLENDID n1 Properties This Bluetooth device offers the following services To use a service select the check box Bluetooth Services Serial port SPP Serial port Figure 14 Communication port number of the connected device 2 3 1 2 Installation of the PC application CSEM Matlab Viewer 1 Install the Matlab Runtime Environment 2 Decompress the executable file Sense2 pkg exe into a known folder 3 Check the contents of the created installation folder as listed in Figure 15 E Name Date modified Type Size di Database 11 06 2014 09 45 File folder di Sense mcr 11 06 2014 09 45 File folder Ls default 11 06 2014 10 04 Microsoft Access 1 DefaultSettingsViewerSigma 11 06 2014 10 02 Microsoft Access 1 cm MCRInstaller R2014aWin32 exe 21 02 2014 01 22 Application 550 062 KB cam PC Loader exe 10 04 2014 16 39 Application 874 KB Lj readme txt 14 05 2014 10 53 Text Document 2 KB Ex Sense bat 14 05 2014 10 49 Windows Batch File 1 KB _ Sense ctf 14 05 2014 10 53 CTF File 906 KB af Sense exe 14 05 2014 10 53 Application 380 KB 181 Sense pkg 20140514 R2014aWin32 exe 1
16. SPLEND D SEVENTH FRAMEWORK Personalised Guide for Eating and Activity Behaviour PROGRAMME for the Prevention of Obesity and Eating Disorders Seventh Framework Programme CallFP7 ICT 2013 10 Project Acronym SPLENDID Grant Agreement N 610746 Project Type COLLABORATIVE PROJECT Small or medium scale focused research project STREP Project Full Title Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders D2 1 Preliminary non integrated prototype realization P R Report P Prototype O Other Version WP number and Title Author s Contributor s Status Submitted Draft Peer Reviewed Submitted Approved Dissemination Level PU CO Confidential PU Public WMermionf 10 0 0 0 0 0 0 0 0 0 0 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Document History Versio Issue Date Status Content and changes 16 June 2014 First draft to be reviewed by Eirini Lekka and Monica Mars 0 5 25 June 2014 Draft Changed title Dissemination level changed from CO to PU according to DoW Deleted sections describing detailed design of sensors to be out in the next D2 2 0 9 30 June 2014 Updated after the review of Eirini Lekka and Monica Mars 30 June 2014 Submitted Final formatting Peer Review History
17. ck the batch file Sense bat 2 application Wait a while before the Commander ec 2a Commander window appears record download stream SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Device ID 1 Plateform SPLENDID Hardware version a Firmware version 0 3 build number 164 Connection of l Device status idle the data Click Connect and when the data logger is outed eee ae eae eae successfully paired the next window appears Device clock has been updated from computer clock logger to PC Memory usage 99 free Page 21 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Advanced Por COM csem Device information Firmware version 0 3 build number 154 Device status idle If the clock displayed in the window 15 not the Device date and time 25 06 2014 09 04 14 current clock Set clock by executing Device clock has been updated from computer clock Set date and Memory usage 10096 free time LE Advanced gt Custom cmd gt SetClockTime To display the current date and time execute Advanced gt Custom cmd gt GetClockTime Nr 7 Response Type Response Class System Opcode 4 Page 22 of 36 SPLEND D FP7 610746 D2 1 Version 1 0
18. device capable of acquiring enhancing and processing the sensor signals transmitting the extracted parameters wirelessly to Smartphone PDA equivalent equipment Task 2 1 1s the first task of WP2 One of the goals of Task 2 1 has been the selection or the design of a sensor capable of detecting chewing events with a recall and precision good enough WP1 for the application that is at the same time small and smart enough to be integrated together with the loudspeaker of an earphone set 1 During the first stage of the project a preliminary non integrated prototype of chewing sensors has been realized The prototype consists of two microphone based acoustic sensors and an optical sensor associated with its data logger A series of measurements have been carried out at CSEM in order to assess whether the signals acquired by the developed sensors are good enough to be used to extract useful information on mastication The design of the prototype will be presented in detail in the next deliverable D2 2 entitled Complete architecture of Sensing equipment Hardware and Software This prototype will be delivered as set of two units to Wageningen University WP6 leader for the first validation study within the context of tasks T6 2 and T6 3 Another goal of Task 2 1 has been the selection of an activity sensor A specific activity sensor previously developed by CSEM has been sent in Month 3 to Mando and AUTH for their evaluation f
19. eveloped by CSEM has been sent in Month 3 to Mando and AUTH for their evaluation for tasks T6 2 and T3 1 respectively This sensor 1s capable of indicating either user s different activities such as resting walking running or the user presence or absence It allows Mando and AUTH to extract raw data of the accelerometer in three directions It has been assessed by the two partners with measurements at different positions on subjects A new activity sensor based on the delivered one will be probably embedded into the future data logger The design of the prototype will be detailed in the next deliverable D2 2 entitled Complete architecture of Sensing equipment Hardware and Software in Month 18 The current document aims at giving a step by step description on use of the prototype dedicated to the validation study which will be carried out in Wageningen University in July 2014 The way the data acquired by the chewing sensors 15 converted to be further processed 1n Matlab 15 described as well Page 6 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders 1 Introduction Based on the user requirements health evaluation protocols and the complete system design the work package 2 WP2 in the project SPLENDID mainly involves the definition of the measurement techniques the choice or design of the necessary sensors the design of an electronic
20. ff the data logger press the red data logger pushbutton and hold more than 3 seconds Page 30 of 36 SPLEND D Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders T T SEVENTH FRAMEWORK PROGRAMME 2 4 Battery recharging of the data logger If the data logger is running on low battery the red and green LEDs will be slowly blinking And if the battery is nearly empty only the red LED will be fast blinking and the green is OFF In these cases the battery of the device needs to be recharged using a USB cable with a mini B plug connected to a PC or a laptop During recharging the green LED 15 always ON and the red LED blinks as shown in Figure 17 Figure 17 Recharging of the data logger When the battery 15 completely recharged the green LED will remain ON and the red LED turns OFF Remove the USB cable and press again the pushbutton SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders 3 Handling of data acquired by the sensors For further digital processing of recorded data in Matlab the raw data need to be converted into acceptable data format In this section the procedure of data conversion 15 described Note that the information provided in the section is particularly addressed to the WP3 team who will carry out signal processing 3 1 Acoustic
21. or tasks T6 2 and T3 1 respectively This sensor is capable of indicating either user s different activities such as resting walking running or the user presence or absence It allows Mando and AUTH to extract raw data of the accelerometer in three directions It has been assessed by the two partners with measurements at different positions on subjects The present document serves as supplementary material to the chewing sensor prototype that has been realized within the context of Deliverable D2 1 entitled Preliminary non integrated prototype realization It aims at providing a consistent description on how to use the chewing sensor prototype and on how to handle the data acquired by the developed chewing sensors to be further processed in Matlab 1 1 Methodology Task T2 1 has been carried out in the following procedure e study of the state of the art of the mentioned sensors in the field of dietary monitoring definition of the sensor system requirements development of the sensors electronics experiences and recordings e assessments of the recorded data e development in parallel of the future data logger Page 7 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders During this first stage of the project the emphasis has been put following the DoW on the choice and then on the design of prototypes of sensors in such
22. r Web Services 251PC11 SPLEMDID ni Bluetooth 1 Bluetooth Desktop computer Other What if Windows doesn t find my device Figure 11 Selection of SPLENDID 1 to add as a Bluetooth device Page 16 of 36 SPLEND D Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders FP7 610746 D2 1 Version 1 0 5 Click the second option Enter the device s pairing code and type 2002 to pair the device as shown in Figure 12 r f Add a device Add a device Select a pairing option Enter the pairing code for the device This will verify that you are connecting to the correct device gt Create a pairing code for me The device has a keypad 004 The code is either displayed on your device or in the information that came with the device SPLENDID ni SPLENDID ni gt Enter the device s pairing code The device comes with a pairing code Check for one on the device or in the device manual gt Pair without using a code This type of device such as a mouse does not require a secure connection How can I tell if my device has a pairing code What if I can t find the device pairing code Figure 12 Paring of the SPLENDID 1 device to the PC 6 The icon of the data logger is shown in the Bluetooth Device window Figure 13 e gt Control Panel Add a device Add a printer 4 Devices 1 SPLENDID ni
23. ram 17 25 Param 18 9 Param 19 16 Param 20 8 Param 22 10 Param 47 270 Param 40 Successful Select recorded sessions to be downloaded and 381 10 download of then click Download Verify the message sessions Session 0x0000xx downloaded 15 displayed Page 27 of 36 FP7 610746 11 12 Folder containing the downloaded sessions Downloaded files in the Database folder D2 1 Version 1 0 S PL E N D D Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders fa default Lis DefaultSettingsViewerSigma CI MCRInstaller R2014aWin32 exe Loader exe The downloaded files are put into the folder Database automatically generated during the installation of the viewer which is located in the installation folder E readme txt Sense bat Sense ctt al Sense exe Sense pkg 20140514 R2014aWin32 exe fal Sigma DefaultSerialPortConfig Name 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Acc x dat _ 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Acc y dat 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Acc z dat 20140625 091608 Pulsear2255 0x00000010 20140625 093917 Activity class Qi dat For each recordin g Ses sion a total of 23 files 120140625 091608 Pulsear2255_0x00000010_20140625_093917_Activity class dat containin raw data are gener ated All recorded 20140625 091608 Pulsear
24. rs Table of figures Figure 1 Overview of the chewing sensors 10 Figure 2 Audio recording interface device and associated USB cable 11 Figure 3 Audio recording interface device and associated USB cable 11 Figure 4 Audio recording interface device and associated USB cable 12 Figure 5 Volume setting of the audio 13 Figure 6 Headphone with two microphones essen nnne 14 Figure 7 Wearing of two microphones Left air microphone right bone conduction BVI CO NO Ce sae cuni sae cate MMC UIN ENIM EE 14 Figure 9 Sound Recorder under Windows 7 sse enne eene eene nns 15 Figure 10 Installation of Bluetooth dongle seen 15 Figure 11 Add a Bluetooth 16 Figure 12 Selection of SPLENDID 1 to add as a Bluetooth device 16 Figure 13 Paring of the SPLENDID 1 device to the 17 Figure 14 The data logger successfully paired to the 17 Figure 15 Communication port number of the connected device sss 18 Figure 16 Installation folder ccc cccccccccccccccesesssssssseseeeeccceeeeeeeesessaauaaeesssseeeeeeeeeeeeeees 18 Fic ure L7 Fositon of Ihe PPG
25. th Radio Ready to use Bluetooth Device RFCOMM Protocol 15 Ready to use Microsoft Bluetooth Enumerator Ready to use Bluetooth Device Personal Area Network 15 wf Ready to use Standard Serial over Bluetooth link 16 Ready to use Standard Serial over Bluetooth link COM wf Ready to use Standard Serial over Bluetooth link COMMS Ready to use Standard Serial over Bluetooth link COM26 Ready to use Figure 9 Installation of Bluetooth dongle Page 15 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders e Paring of Bluetooth device Turn on the data logger by pressing the red pushbutton The green LED will be blinking slowly 2 Click the icon of Bluetooth 3 Click Add a device as shown in Figure 10 Add a Device Allow a Device to Connect Send a File Receive a File Join a Personal Area Network Open Settings Remove Icon X E O s 86 Customize 09 11 ns B NE ER zz MIELE MP Figure 10 Add a Bluetooth device 4 Select SPLENDID n1 then click Next Figure 11 Select device to add to this computer Windows will continue to look for new devices and display them here liseron HP Laserlet P3010 Series sew 016 Web Services Bluetooth Printer Other HR OTRBT V4 10 5 gentiane HP Color LaserJet Bluetooth CP6015 Othe
26. the Add File button then specify an output folder for the WAV file with the Change button Page 32 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Figure 19 Conversion of audio format c Click OK The new window closes To start the conversion process either click the Start button at the top or at the bottom Convert State WAV Figure 20 Start of conversion d The WAV file is now available in the specified output folder 2 The so obtained WAV file can then be read via MATLAB s command Page 33 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Signal Fs wavread Filename where Signal is a two column matrix containing the desired audio signal in the first column Fs is a scalar containing the sampling frequency and Filename should be a string containing the name with its full path and extension of the WAV file to be imported 3 2 PPG sensor The raw data obtained from the PPG data logger 15 a Comma Separated Values file CSV csv extension and a collection of Data files DAT dat extension All these files should be kept together in the same folder The following command is proposed to import the data they contain in MATLAB Ppg Fs readPPGsignal PathToCSVfile CSVfile
27. the Default Input 4 Close the window 2 2 2 Connection of microphones to the audio module 1 In any case care must be taken to insure that no signal saturation occurs Adjust the volume gain of the audio device in the middle position Figure 5 Volume setting of the audio module Connect the two microphones to the audio module by cables with XLR connector Select 48 V Select Stereo Connect the audio module to a PC or a laptop by plugging the provided USB cable The greed LED will be lighted D ee Du 2 2 3 Wearing of the microphones A headphone from AfterShokz is used as support on which the air microphone and the bone conduction microphone are fixed On the same headphone two types of microphones are fixed as shown in Figure 6 Page 13 of 36 7 610746 D2 1 Version 1 0 S PL E N D D Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders ir microphone Figure 6 Headphone with two microphones The headphone 15 worn in a normal way as shown in Figure 7 Ensure that the microphone 15 inserted into a deep position in the ear canal in order to have a minimal influence of ambient noise Figure 7 Wearing of two microphones Left air microphone right bone conduction microphone Page 14 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Ea
28. tic sensors and one optical sensor will be used in parallel at the same time Two sets of materials will be provided to Wageningen University for the validation study Each set is composed of the following modules audio module Alesis 102 EXPRESS 2 power and polarization boards air microphone FG 23329 connected to an audio cable with XLR audio connector bone conduction microphone BU 21771 000 connected to an audio cable with XLR audio connector PPG sensor with its data logger e 1 Bluetooth USB dongle e Software CSEM Matlab viewer Commander The whole prototype of chewing sensors 15 shown in Figure 1 4 Primarily found on professional audio XLR connectors are available from a number of manufacturers and are covered by an international standard for dimensions IEC 61076 2 103 Page 9 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders its datalogger Figure 1 Overview of the chewing sensors prototype The main feature of the specifically designed circuits for powering and polarize the two types of microphone is its capability of driving and converting the Phantom power of 48 V delivered from the audio module This results in easy manipulation of the users since no additional power supply will be needed for recordings Each of the two PCB very small in dimension is connected to the audio module
29. ting Disorders 2 2 4 Signal acquisition For an easy utilization the proposed software for sound recording is Sound Recorder under Windows It can be found under Start Menu gt Programs gt Accessories gt Sound Recorder The application 1s shown in Figure 8 Start Recording 00 00 00 Figure 8 Sound Recorder under Windows 7 The user has to ensure that the correct audio input is selected This can be checked under Control Panel gt Hardware and Sound gt Sound under the Recording tab A recording can be started by clicking the Start Recording button which turns into a Stop Recording button while recording When the Stop Recording button 1s pressed a window automatically pops up and allows the user to save the recording as a Windows Media Audio WMA wma extension file 2 3 Optical sensor 2 3 1 Pairing of the data logger to the PC 2 3 1 1 Installation of Bluetooth dongle The data logger is wirelessly communicating to the PC by Bluetooth It is necessary to pair the device to the PC If no Bluetooth dongle is plugged in the PC please insert the provided Bluetooth dongle and proceed to its installation If the installation is successful a message window like Figure 9 will appear If the installation 15 failed re install the Bluetooth dongle until the message Y our device is ready to use appears Driver Installation Your device is ready to use Generic Bluetoo
30. ting Disorders Advanced Device Sigme COMT Device information index 0 duration 65 End page index 9 Download aborted Seq 12 Response Type Response Class System 10 Param 18 1 Param 19 0 Param 20 0 Sto Click stop button to stop the recording Record started ein Verify that Record stopped is displayed in ee ee ee e the interface window Page 25 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders index 0 Session duration 6s End page index 9 Seg Hr 12 Response Type Response Class System Opcode 10 Param 18 1 Param 19 0 Param 20 0 Record started Seq 13 Response Type Response Class System Opcode 10 Param 18 0 Param 19 0 Param 20 0 Record stopped Download Click download button A list of recorded Sessions sessions 15 then displayed in a new window Start time Duration s Selected 23 06 2014 09 19 33 0000 6 25 06 2014 09 16 00 270 Go on sons Page 26 of 36 SPLEND D FP7 610746 D2 1 Version 1 0 Personalised Guide for Eating and Activity Behaviour for the Prevention of Obesity and Eating Disorders Device Sic Device information index 0 Session duration 6s End page index 9 Seg Nr 16 Response Type Response Class Memory 14 Param 39 16 Param 15 2014 Param 16 6 Pa
Download Pdf Manuals
Related Search