user manual - MikroElektronika
Contents
1. 0 ACTIVATE S Length Index Description D Assigned actions The SpeakUp is a speech recognition click board You can set it up to recognize over 200 different voice commands and have the on board MCU carry them out instantly E MikroElektronika DEVELOPMENT TOOLS COMPILERS BOOKS want to express my thanks to you for being interested in our products and for having confidence in MikroElektronika The primary aim of our company is to design and produce high quality electronic products and to constantly improve the performance thereof in order to better suit your needs Nebojsa Matic General Manager The STM32 and Windows logos and product names are trademarks of ST microelectronics and Microsoft in the U S A and other countries Table of Contents 1 Introduction 2 Applications 3 Package Contains 4 How to use it 5 Tech Specs 6 Schematics 7 How It Works SpeakUp Firwmware Algorithm 8 Configuration Through Software 8 1 Typical Workflow NOURA 10 11 12 13 8 2 Getting Started 8 3 Creating a new project 8 4 New Voice Command 8 5 Configuring Project Settings 8 6 Assigning An Action 8 7 Uploading Project 8 8 Exporting Constants 9 Direct Configuration 10 Recording Tips 11 Examples 14 15 16 18 20 23 24 25 26 1 Introduction 6 T CY mgogo Sey lps 5 9 The SpeakUp is a spe2. Audio Codec Microcontroller VS1053 EE STM32415RG Signal LEDs oe DE Push buttons LR mikroBUS 1 connector JTAG connector 25 40 mm 1000 mils Along with its key components the SpeakUp packs other useful bits like two buttons for recording or deleting voice commands manually while three signal LEDs give recognition feedback and indicate power Page 8 6 Schematics VCC 3 3V VCC 3 3V alp 100nF 100nF 100nF 100nF 100nF 2 2uF VCC 3 3V 1 EM rMs swpio 3 6 AP7331 ADJ VCC USB 1 2 3 VCC 1 8V uL AP7331 ADJ in 9 C7 VCC 3 3V RST Na 9 1 8 1 107 2 VCC 3 3V HD1 1 1 1 1025 105 8 5i 106 9 ce XO Ui UNG VCC 3 3V VCC 3 3V VCC 3 3V A R25 10K R39 4R28 mikro SW1 PB10 10K a BUS C20 LD2 PC12 NRST ior TNT 100nF LD1 PB2 NSPI1 CS SPILSCLK cx ix 102 4 1 1 MISO SCL VCC 3 3V gt A 5 11 51 i DA R2 R1 LJ 3 3V 5V 10K 4K7 4K7 C44 LJ GND GND Li 1007F MIKROBUS DEVICE CONN SW2 PD2 100nF iH MP3 MISO j C15 Di VCC 3 3V PMEG3010ER 3 3nF eg kook R5 10 R6 470 D RIGHT J C38 10uF S E 1 2 LEFT L1 L1 C39 10uF 3 R9 10 N R10470 HD3 gie js C9 R11 3 3nF 100K mM alle SL fs l le C10
3. 11 12 47nF 10nF 10nF VCC 3 3V R16 K CN2 C14 100pF VCC 3 3V VCC 3 3V XDCS BSYNC I o Noise ER PA2 1 ANDUAWNE xi swi 12 288MHz 18 C19 18pF 18pF VCC 3 3V C40 C22 C23 C24 C25 C26 C27 10uF 100nF 100 100 100 100 100nF VCC 1 8V MICN 100 C42 Cl6 100 SEE R20 10uF i SJ 43516 SMT R21 A zi L 1 LL 2 MICROPHONE VCC USB R26 220 USB DET ERI USB D_P USB ID c21 5_ O 100nF USB MINIB VCC 3 3V R3 2K2 LD3 7 How It Works What gives the SpeakUp its speech recognition capabilities is the firmware we developed for the on board MCU It s based on the DTW algorithm which makes it decisive it turns your talk into action almost instantly Sound is received through an on board microphone There s also a 3 5mm jack for ut connecting an external microphone Between the mic and the MCU sits a VS1053 IC with a built in stereo audio codec to process the raw signal lt n utp ut After the processed sound has been forwarded to the STM32F415RG MCU that interprets the voice command there are two output options which can be utilized at the same time or separately STANDALONE MODE CLICK MODE On board MCU directly controls Sends index of the m
4. words that are uttered with short pauses are recognized Speaker dependent reference patterns are constructed for a single speaker Template matching algorithm is a form of pattern recognition It represents speech data as sets of feature parameter vectors called templates Each word or phrase in an application is stored as a Separate template The input speech is then compared with stored templates and the stored template most closely matching the incoming speech pattern is identified as the input word or phrase The SpeakUp software configuration tool is a free PC application for configuring the SpeakUp click board With it you can configure the board to recognize over 200 different voice commands and have the on board MCU carry them out instantly You can download the software from the following link The software is designed with ease of use and simplicity in mind The UI is based on tabs and drop down menus requiring no programming skills to use Still it has all the essential features and options that give you full control of the set up process R YF e ACTIVATE gt Length 1 index Description Assigned actions 8 1 Typical workflow Create a new New project created First time you launch the app a new project is project or open or last one loaded created automatically Otherwise the last project existing manually automatically you were working on will open Add or m vo
5. In the General Settings you can configure the SpeakUp s functionality Acceptance threshold This is the parameter you should adjust to define Pin Aliases how closely your delivery has to match your pre recorded command At lower values you ll have to deliver the command precisely the way you recorded it At higher values the matching doesn t have to be so precise but this increases the probability that the SpeakUp will pick up irrelevant speech and interpret it as a command You should be able to reach the sweet spot value through some trial amp error Recording timeout Timeframe in which the SpeakUp click board expects recording input after the record button is being pressed User can choose between 5 10 and 15 seconds timeframes Word Length Length of the voice command being recorded in seconds Can be 1 1 5 2 2 5 and 3 seconds Noise level Minimal sound volume level that can trigger voice command recognition Lower values require quieter pronunciation resulting in higher noise hiss sensitivity On the contrary higher level values require louder pronounciation and they are less sensitive to noise hiss We recommend that you keep auto detection enabled That way the SpeakUp Click board will measure the noise level and perform noise calibration automatically Auto detection can last a bit longer usually around 10 seconds Sudden Pin Aliases And Initial Pin States Pin Aliases Relay 1 In this section yo
6. aker dependent speech is Wf Play movie recognition click board with standalone c capabilities You can set it up to recognize over Lights on 200 voice commands and have the onboard STM32F415RG MCU carry them out It works by matching sounds with pre recorded commands Sound is received through an onboard microphone and then processed by a VS1053 IC with a built in stereo audio codec The SpeakUp comes with a dedicated software tool for easy configuration The board is lined with 12 user programmable GPIOs for standalone functionality It also carries a Standard mikroBUS host socket Standalone o Ov Easy Over 200 mu Ultra fast mE configuration es commands operation Page 4 2 Applications Wouldn t you rather issue verbal commands and have your machines comply instead of pressing keys pushing buttons and flipping Switches all the time There s a wide range of applications for the SpeakUp X Command your lights doors and home appliances L Create voice commanded remotes for TVs or media centers Reduce complexity and cost of control interfaces When doing something with both hands and voice command is the only option 3 Package Contains Package dimensions L 70mm W 60mm H 30mm Box Package weight C amp k BOARD User manual www mikroe com bk AR ikr ea end olo olo Efo Q os o 1E fon
7. ar eee After it s done an appropriate message will be displayed in the Status Bar Assigned actions PIN Alias Each recorded voice command is given an index number which is sent to the host MCU You can export voice command names and their indexes as constants The exported document will be in the form of a source file in any of the three languages as shown below mikroC 1 ve const VCMD TURN ON PROGRAM A const VCMD TURN ON PROGRAM B II Export Constants 9 Direct Configuration You can perform some basic configuration directly on the SpeakUp without using the software Different combinations of button presses will allow you to record re record or erase commands You ll get feedback from the on board LEDs However you won t be able to assign specific actions with this method On board push buttons Use push buttons to operate the board Push button 1 To record your voice command press and hold the button while speaking You must stay within the time limit for each command default settings 1 second You can also record multiple commands at once by pronouncing them one by one while keeping the button pressed Just make sure to wait for the red LED to flash between pronouncing subsequent commands Proceed in this way for as many commands as you need command will be assigned a unique index Push button 2 If you press it for more than 2 seconds al
8. atched voice external devices using 12 user command to a selectable interface programmable GPIOs USB or UART SpeakUp Firmware Algorithm The main goal of a speech recognition system is to substitute a human listener although it is very difficult for an artificial system to achieve the flexibility offered by human ear and human brain The work principle of speech recognition systems is roughly based on the comparison of input data to prerecorded patterns These patterns can be arranged in the form of phoneme or word By this comparison the pattern to which the input data is most similar is accepted as the symbolic representation of the data It is very difficult to compare raw speech signals directly Because the intensity of speech signals can vary significantly a preprocessing on the signals is necessary This preprocessing is called Feature Extraction First short time feature vectors are obtained from the input speech data and then these vectors are compared to the patterns classified prior to comparison The feature vectors extracted from speech signal are required to best represent the speech data to be in size that can be processed efficiently and to have distinct characteristics The SpeakUp Firmware uses Dynamic Time Warping DTW algorithm word based isolated word speaker dependent and template matching algorithm Inthe word based speech recognition the smallest recognition unit is a word Inthe isolated word recognition
9. c lt gt p 3 g 5 J 1x8 headers Es ZEEUER Recycle Bin document SpeakUp click board Page 6 4 How To Use It Before using your click board on your target platform make sure to solder 1x8 male headers to both left and right side of the board Two 1x8 male headers are included with the board in the package 1 Prepare it Turn the board upside down so that the bottom side is facing you upwards Place shorter pins of the header into the appropriate soldering pads Turn the board upward again Make sure to align the headers so that they are perpendicular to the board then solder the pins carefully 2 Configure it Now you need to train your SpeakUp to obey your commands Plug in the board to your PC through USB cable Configure it using the free software see page 12 Alternatively you can configure the board directly using the on board buttons see page 24 3 Use it The SpeakUp now understands your commands Connect relays motors or other electronic actuators directly to SpeakUp s GPIO pins Alternatively plug the SpeakUp into any board or shield carrying a mikroBUS socket You can now control your devices with your voice 5 Tech Specs Line out pads 10 30 mm 405 50 mils 2 L gt Microphone USB connector amr a Audio jack 12 GPIOs user programmable by be rar
10. gs menu as soon as you create a project by checking the appropriate box 100 Untitled spk New Project Name iB SpeakUp 1 0 0 Untitled spk New Voice Command New Voice Command New Voice Command START HERE RECORD RECORD RECORD gt gt Clic Recording 04 04 Got it Playback 00 28 Save amp Close To record a new voice A New Voice Comand dialog length of the recording The recorded command will be command press the Add New window will appear Press the 15 set in the Project Settings played back automatically so Voice Command button Record button window see page 18 you can make sure it s OK New Voice Command RECORD Satisfied Name it then save it Save amp Close If you re satisfied with the recording enter name for your command and click the Save amp Close button SpeakUp 1 0 0 Relay Test spk ke 5 5 2 Length The recorded command will appear as a new tab You can play it back edit or delete it anytime New Voice Command New Voice Command RECORD RECORD If the SpeakUp fails to detect a voice command your surrounding might be too noisy Try again by speaking a bit louder If it still doesn t work launch Settings and adjust the Noise treshhold 1 SpeakUp 1 0 0 Relay Test spk To configure project settings press the Open Settings Window button and the aoe Settings window will open
11. ice commands Everything OK Adjust Settings Page 13 8 2 Getting Started Connect the SpeakUp click board to the computer via the USB cable It will be recognized as a USB Human Interface Device HID in the Device Manager of the Control Panel Once you connect the SpeakUp to your computer you re just a few clicks away from configuring it The set up process is dead simple Launch the application and it will lead you through the initial steps of recording and assigning commands Ambient Noise Detection Detecting ambient noise sw L FM ent plete Please keep silent while SpeakUp device detects ambient noise levels After the successful connection the SpeakUp click board will perform ambient noise detection and calibrate itself The process lasts about 10 seconds It s done when the red signal LED turns off After that the board is ready for recording voice commands You can set custom calibration parameters for any subsequent usage in the Project Settings see page 18 To create a new project press the Create New Project button from the main toolbar of the SpeakUp software A new window will open where you can enter your project s name and destination folder if the destination folder doesn t exist the software will prompt you to create it To finish project creation after inputting the required information press the Create button Alternatively you can choose to open the settin
12. l recorded voice commands will be erased If both push buttons are pressed for more than 2 seconds the SpeakUp click board will reset On board LEDs Two indicator LEDs provide the following signals 9 Amber LED the board is ready for recording or listening e Red LED the board is perfoming an operation When the voice command is recognized both LEDs are lit for a half a second P Nc EI Standalone mode default settings RST cs Acceptance Threshold 15 Recording Timeout 5s Word Length 1s Noise Level Auto Notify Master USB ATCP slick Page 24 10 Recording Tips Here are some general recording Tips For better recording results it is necessary to provide conditions with lowest amounts of ambient noise and speaker distance from the microphone in the range from 10 to 20cm fthere are problems with the voice command detection please record it several times due to the pronounciation diversity 1115 mandatory to play back the recorded voice command in order to hear if some ambient noise was recorded also Because of this itis recommended that the SpeakUp click board is placed on a surface that doesn t transfer mechanical vibrations This is a speaker dependent system If there are more users each person should record voice commands separately due to the pronounciatio
13. n diversity Number of voice commands that can be recorded depend on their lengths typically more than 200 for the voice command length of 1 second Please keep in mind that the recording is performed by the SpeakUp click board not the computer so there is no need to connect an external microphone to the computer 11 Examples SpeakUp has a world of applications It s up to your imagination to come up with the coolest ideas Here s a hint or two Use SpeakUp on top of the Pi click Shield to command XBMC Replace your lamp switch with a SpeakUp click and a relay Home Media Center on Raspberry Pi It s a great a replacement Tell your light to turn ON or OFF if your hands are busy doing for a mouse and a keyboard something important Page 26 DISCLAIMER All the products owned by MikroElektronika are protected by copyright law and international copyright treaty Therefore this manual is to be treated as any other copyright material No part of this manual including product and software described herein may be reproduced stored in a retrieval system translated or transmitted in any form or by any means without the prior written permission of MikroElektronika The manual PDF edition can be printed for private or local use but not for distribution Any modification of this manual is prohibited MikroElektronika provides this manual as is without warranty of any kind either expressed or implied including but not limited t
14. o the implied warranties or conditions of merchantability or fitness for a particular purpose MikroElektronika shall assume no responsibility or liability for any errors omissions and inaccuracies that may appear in this manual Inno event shall MikroElektronika its directors officers employees or distributors be liable for any indirect specific incidental or consequential damages including damages for loss of business profits and business information business interruption or any other pecuniary loss arising out of the use of this manual or product even if MikroElektronika has been advised of the possibility of such damages MikroElektronika reserves the right to change information contained in this manual at any time without prior notice if necessary TRADEMARKS The MikroElektronika name and logo the MikroElektronika logo the click boards are trademarks of MikroElektronika All other trademarks mentioned herein are property of their respective companies All other product and corporate names appearing in this manual may or may not be registered trademarks or copyrights of their respective companies and are only used for identification or explanation and to the owners benefit with no intent to infringe Copyright O 2014 MikroElektronika All Rights Reserved If you want to learn more about our products please visit our website at www mikroe com If you are experiencing some problems with any of our products or just need additi
15. onal information please place your ticket at www mikroe com support If you have any questions comments or business proposals do not hesitate to contact us at office mikroe com
16. to logical low state upon voice command matching TOGGLE When this option is selected a corresponding GPIO pin state will be toggled upon voice command matching PULSE When this option is selected a train of pulses will be sent to the corresponding GPIO pin upon voice command matching IB SpeakUp 1 0 0 Relay Test spk R Turn On Program A M Length Index Description Assigned actions PIN Alias 101 The pulse parameters be set in the Pulse Parameters window click on the Edit pulse parameters icon Edit pulse parameters to open it Aperiod T is the time it takes for a signal to complete a single cycle sum of the high state and low state time periods Duty ratio D is the percentage of T in which a signal is active i e ratio of the high state period and a complete period N is the number of times the pulse is repeated Thus a 6096 duty cycle means the signal is ON 6096 of the time period but OFF 4096 of the time period Assigned actions PIN Alias PULSE parameters 245 annm D 100 Total N T T period D duty ratio 50 N repeat 0 times Total duration FOREVER 1 SpeakUp 1 0 0 Relay Test spk Turn On Program A When you re finished recording and configuring voice commands it is time to upload the project to the SpeakUp click board This is done via the Upload Project button Bend Index You can monitor the upload process in the Toolb
17. u can rename GPIO pins according TE to your needs and set their starting conditions The Relay 3 Relay 4 Relay 5 new GPIO pin aliases will be applied in the main window too Set the corresponding initial GPIO pin State in the Initial Pin States section Condition can be either low logical 0 or high logical 1 106 changes in sound levels will lengthen the time of calibration and will result in improper sound level values Notify master Notifies the master MCU or PC when the voice command is recognized by sending a 16 bit index number of voice command via chosen communication interface UART or USB Data rate Sets the speed used for sending data to the master MCU or PC Initial Pin States 9 X FINT pun JE SEC lo OIO 0757000 8 LJ O Hg 0151515 olo When a new command is recorded it is time to assign it an action The action will be performed when the voice command is recognized Also a 16 bit index number of the voice command will be sent via chosen communication interface UART or USB There are five types of action that can be assigned NONE When this option is selected no action will be performed on the corresponding GPIO pin upon voice command matching ON When this option is selected a corresponding GPIO pin will be set to logical high state upon voice command matching OFF When this option is selected a corresponding GPIO pin will be set
Download Pdf Manuals
Related Search