Home

Speakeasy User Guide

1. 2 Chapter 2 Using the Grammar File Manager _ 0 0000222 e cee cece cee cee cee eee eee cece cece cee eeeeeeeees 3 Launching the Grammar File Manager ssssssssssssslllllllllll sss se lel emeeeeeeIIl 4 Importing and Exporting Grammar Files 2 222 222 2002 2 ee eee eee cece eee eee eee eee cece n Ile nioa 4 Editing a Grammar File 2 eel ee eae doe adele ell teks eee a EEAS 5 Grammar File Structure 2 22 2 2 002 ene en lrrlrlmmllIIMm3lzl1m322l1m2222123222 6 Adding Terms toa Grammar File 2 24 eere esee idide Ic ev Rv e eos osse drop Le ee eee eed 7 Using Alternate Return Values e cele pelolI il cp eere eus ete eo iUppIe Shas Monee cd de cog ken to o cQeDbpop mevors 8 Enabling Voice Training for New Terms ssssullllllllllllllllsllss ss n eee eee e eee eeeeeeeeeeeeeeeeee 9 Moditying User Prompts dune ouededeececo AB sods Xie i ea eb ete ERU EIE ele eee ot ndn 10 Specifying Voice Profile Training Options ssssssssssssssslllllllllll sls eee eee eee ence eee rnn 10 Chapter 3 Using Speakeasy with the Screen Reformatter 2 00 0 ccc cece cece e eee cece cece ess e eeneeeenneeees 13 Adding Text to Speech in the Reformatter sssssssssssssssslllllllll ssl Itl 13 Adding Speech to Text in the Reformatter sssssssssssssssssllllllllls sss e eIMeeeeeeeIIl 14 Adding Scripts to Reformatted Screens
2. Parameters Use R to pass the Speech Result Verify Result Delay Speech to Text to avoid feedback Speech to Text Settings to use stt threshold 4500 Speech to Text options 2 Select the Speech to Text Grammar to use from the drop down menu Or Enable the Use more than one grammar option and choose the desired grammars from the list box NOTE The screen reformatter also supports dynamic grammar generation In addition to or instead of using an existing grammar file type a list of words or phrases separated by a pipe character to generate a dynamic grammar See Using the Grammar File Manager on page 3 for more information on grammar files 3 Select the action to perform with the result Chapter 3 Using Speakeasy with the Screen Reformatter 19 4 Ifyou are not using a headset microphone enable the Delay Speech to Text to avoid feedback checkbox This will ensure that the microphone ignores input while text to speech actions are happening 5 If you want to use a speech setting in the Speech to Text action enter the setting in the Speech to Text Settings to use text box NOTE Each setting must start with stt and use the format setting value Multiple settings can be specified and should be separated by commas If a value is not a number then the Speech to Text engine will use the value closest to the value text description provided The complete list of settings is available in the Termi
3. Chapter 7 Speakeasy Settings Speech to Text Settings 39 stt_accuracy stt_adjust_gain stt_beep_threshold stt_calibrate stt_calibration_silence stt_confidence stt_expanded stt_fx_detect_start stt_fx_microphone stt_fx_min_duration This value affects the trade off between CPU load memory requirements and accuracy This feature allows the engine to automatically increase and decrease the microphone input volume If the confidence value for a result is below this value then a negative acknowledgement beep will not be played Opens the microphone calibration wizard Sets how long the user is expected to remain silent during a quick microphone calibration Indicates the minimum difference in confidence required between the top two speech to text results for the top result to be accepted Use this to get the confidence value along with the speech to text result Indicates the action the speech engine should take before attempting to determine what the user is saying Tells the speech engine the distance between the user and the microphone Indicates the minimum duration in ms of speech before speech detection is activated stt_fx_sensitivity Indicates the speech detection sensitivity stt_fx_silence stt_fx_threshold Indicates the milliseconds of silence used to indicate the user is done speaking Indicates the amount of energy the microphone input must have before the speech
4. You can increment or decrement the speeds or set to the normal rate of 1 You can say three voices Jill Samantha amp Tom Yet ve eve eje Fe Fe Fe Fe Fe Fe je Fe Fe Wee Fe Fe Fe e Ve Fe Fe Fe Fe Fe Fe ve Fe Fe e Fe Pe e Fe Fe Ve e Ve Fe Fe V e V Fe Ve Fe Fe e Fe We Fe je Fe Pe Fe Fe V Ve Fe Fe Fe Fe Fe Pe Fe ve Fe Ve ve Fe e Re f grammar voiceSpeed start Speech speech slower faster normal address description repeat again 3i11 Samantha Tom Example of a Grammar File In this example the words and phrases listed between Speech andthelast arethe terms Speakeasy will recognize Each word or phrase must be separated by an symbol Terms may be listed all on the same line or aligned vertically for easier editing To improve recognition use longer and more distinct phrases For example rather than use the similar terms faster and fastest replace them with the terms go faster and warp speed Once you have defined the words in a grammar file use a script or the screen reformatter to define what happens when each word or phrase is recognized Then deploy the grammar file and any other necessary files to the devices Using Alternate Return Values You may want to have a grammar file return a value other than the exact phrase that the user says This may be useful when you want to use phrases rather than words or if you want different phrases to return the same result Using phrases rather
5. 4 Click OK The Text to Speech Text dialog box closes and your text appears in the Supporting Actions section of the Descriptive View It doesn t show up on the emulation screen 5 If desired right click on the Modified Screen View and select Add Text Add the text to the modified screen To use existing text for text to speech 1 Inthe screen reformatter click and drag the mouse over the text you want to copy When you release the left mouse button a context menu appears 2 Select Text to Speech Copy The Text to Speech Copy dialog box appears 3 If you want to change the current settings type the desired text to speech settings in the Persistent Text to Speech Settings to use and or the Temporary Text to Speech Settings to use text boxes NOTE Each setting must start with tts and use the format setting value Multiple settings can be specified and should be separated by commas The complete list of settings is available in the Terminal Emulation Scripting Reference Guide The Text to Speech action appears in the Supporting Actions section of the Descriptive View Adding Speech to Text in the Reformatter You can add a speech to text action to the modified screen This action converts the user s speech into text that will be processed according to the grammar file or files specified It can print the text to the screen as keyboard data or perform an action associated with the command The General tab in the Speech to Tex
6. 2 2 2 2222 cece ee cee cece cece eee eee cece cece ce aeeai 20 Ordering Screen ACHONS o ticc teswnestse peel dhdnusedeta x ce eR hed add nac E E RAeENRDUDISO ara E e cel bee gud sese 20 Deploying Reformatted Screens zeregi pureed ierde nne ee a nE EEEE i eie rne Eare Ai EEEE 21 Chapter 4 Speakeasy and Scripting 0000000000000000000000000 0000000000000000 aeaaeae aaeoa aoaaa aaaea 22 Creating Scripts dunes dear orra a ae eaae o aae a eee EE ERDRE eE 22 f ve die Isigras unio Tb 22 draussen 23 Prom Another Script 2s seso acs cee bebhnactieeapehiecsegeeehenseed dey a denotes emeebea le r aaret 23 On Key Combination 22222232252 a a srblieeeesg ih oie oh eee Re Le ee 23 When Session Connects 0 Locis e eee cos ERE BR Ite ak et eae ae Peete chaebol hee ae 23 On Barcode MSR or REID Scant vies sceceedananetaeasnebseeessduaesneceadivenssaqceaxae E EEEIEE N Sese RH ES 23 OniSereen Update T E 5 24 From the Screen Reformatter 2222222 22 eee cece cece e eee cece eee eee e eee ee eee 24 Hbro BU MEET CER 24 Chapter 5 Installation and Licensing lisse 3E De do I p ace lpbDcss dis edelcPpPpPoebissbprs 25 Installation Req irements ceo oll i eepx oce rme esis pad ta bien pce c td d ecolcpuERbordeetuseddUcc sep Er bre dais 25 Installing Speakeasy Using Avalanche 22 22222222222 cece cece cece III III III 26 Installing Speakeasy Using ActiveSync 00000 cece eee e
7. NOTE Wavelink supports some third party installation applications For more information about supported installation options for your device please see the Wavelink Web site If you choose to use a third party application to configure and install Speakeasy please see the documentation for that application Installation Requirements This section lists the hardware software and memory requirements that Speakeasy requires for best performance Mobile device with headset microphone with a signal to noise ratio SNR better than 20 dBA e 128 MB RAM or 64 MB RAM with an SD card or 64 MB RAM with 128 MB Flash Memory Wavelink Terminal Emulation Client version 7 0 or newer for best performance Wavelink recommends TE client version 7 3 59 or later If you are using Speakeasy with a desktop TE Client Speakeasy requires Q e Windows XP or later Chapter 5 Installation and Licensing 26 Minimum of 2 GB disk space If you want to be able to save your voice profiles and distribute them using Wavelink Avalanche you will also need e Avalanche Mobility Center or Avalanche Site Edition You must use a mobile device server that is version 5 2 or newer e Wavelink Avalanche Enabler version 5 0 10 or newer Installing Speakeasy Using Avalanche When you install Speakeasy on a device using Avalanche each device that will be using Speakeasy either speech to text or text to speech must receive the Speech Registration package
8. Speech is divided into subsections to make it easier to manage the terms In the example fragment below the terms are divided so that the s1ot command will only apply to some of the terms start Speech slot lt YesNo gt Speech lt YesNo gt Maybe lt YesNo gt yes no Maybe maybe In this example the Speech rule includes the lt YesNo gt and the Maybe rules so the engine will listen for all the terms in both the lt YesNo gt rule and the Maybe rule However only the terms in the lt YesNo gt rule are included in the slot command and used for voice training For more information about using the slot command see Enabling Voice Training for New Terms on page 9 Adding Terms to a Grammar File A grammar file determines the words and phrases that the Speakeasy engine listens for To add words or phrases to a grammar file add it to an existing rule such as lt Speech gt and separate it from the other terms with a symbol also known as an OR symbol or a pipe The following example is the grammar file VoiceSpeed bnf viewed in Notepad Chapter 2 Using the Grammar File Manager 8 Cesena C M File Edit Format View Help BNF EM V1 1 N90 e de dee e Teo eee fee egeo qe e dee fee egeo defe de e ee deje fede eje doge defe eee defe deeds GRAMMAR VoiceSpeed bnf Description This grammar file lets the user change the voice and voice speed quit what Can I Say
9. After you start talking this bar should be to the right of the white line When you speak one of the words or phrases included in the grammar selected in step 4 the phrase appears in the box underneath the Signal to Noise Ratio This box also displays the confidence value 8 Click Next Q Chapter 6 Using Speakeasy 34 The Other Settings dialog box appears The Speech Detection State indicates whether the speech engine detects the user s speech When the user is not speaking the state should be red When the speech engine detects something that may be speech the state turns yellow When the speech engine is certain it is detecting speech the state turns green Speech Detection State MOS Speech Detection State 9 Use the Absolute Threshold and Sensitivity sliders to adjust the speech detection settings The Absolute Threshold value indicates the minimum amount of sound required to indicate when speech begins Adjust this value so that the user s speech causes the state to turn yellow immediately but any background noise causes the state to remain red The Sensitivity value determines when the speech engine begins detecting a user s speech A higher sensitivity value means the speech engine will react more easily a lower value means the speech engine will pick up less background noise 10 Click Next The Record Playback dialog box appears If you want to check the confidence values for a recording against a grammar f
10. Change Setting tts language short Speech Find Setting Value tts language short enu FALSE Speech Change Setting stt language short Speech Find Setting Value stt language short enu FALSE Comment Acquire Pick Quantity via Speech To Text Comment Initialize Speech To Text variables bSpeechStarted FALSE bSpeechDone FALSE Comment Initialize confidence value Speech uttered with confidence values below this value will be rejected Speech Change Setting stt threshold 4500 Comment Start Speech To Text if not already started Comment This is needed so we start Speech To Text again if nothing was stated before it times out If Not bSpeechStarted Speech From Text Enter Quantity TRUE Comment With this Speech To Text function the script waits for voice input until stt timeout value is reached if nothing is stated sooner bSpeechStarted Speech To Text No Wait bSpeechDone strSpeechResult sapqty four digits Chapter 8 Sample Speakeasy Scripts 47 Comment Wait For Screen Update waits for speech as well Wait For Screen Update End If If bSpeechDone Comment If sSpeechResult is not empty it signifies that we received a speech result Comment Command and Control is handled here as well If Not String Empty strSpeechResult If String Equal strSpeechResult repeat 0 TRU GI Comment Set bRepe
11. FIFTY 5 FIFDY 5 Chapter 8 Sample Speakeasy Scripts 49 SIXTY 6 SIXDY 6 SEVENTY 7 SEVENDY 7 EIGHTY 8 EIGHDY 8 NINETY 9 NINEDY 9 lt ExactThreeDigits gt NonZeroDigit gt HUNDRED AND lt Teens gt lt CombinedTens gt lt NonZeroDigit gt 1 2 lt Tens gt lt NonZeroDigit gt O 1 1 4 se A lt NonZeroDigit gt HUNDRED 1 00 lt NonZeroDigit gt lt Teens gt lt CombinedTens gt lt NonZeroDigit gt 1 2 lt Tens gt 1 2 lt Teens gt O 1 lt CombinedTens gt NonZeroDigit O 1 2 Tens O 1 Digit 00 1 lt FourDigits gt lt NonZeroDigit gt THOUSAND AND lt ExactThreeDigits gt 1 4 lt NonZeroDigit gt HU 1 2 lt Tens gt DRED AND lt Teens gt lt CombinedTens gt lt NonZeroDigit gt O NonZeroDigit THOUSAND 1 000 NDRE NonZeroDigit G8 O 1 1 4 NonZeroDigit HUNDRED 1 00 lt NonZeroDigit gt lt Teens gt lt CombinedTens gt lt NonZeroDigit gt 1 2 lt Tens gt 1 2 lt Teens gt CombinedTens NonZeroDigit 8 1 2 lt Tens gt repeat Digit previous 1 1 4 lt Com
12. OK The Scripting Support dialog box closes and the script is added to the Supported Actions listed in the Descriptive View Ordering Screen Actions When you have multiple actions on the modified screen you can determine the order in which the actions occur The actions are listed in the Descriptive View in the Supported Q Chapter 3 Using Speakeasy with the Screen Reformatter 21 Actions section Supported screen actions are Speakeasy and scripting actions You should list the text to speech actions before any speech to text actions To arrange actions in the desired order In the Descriptive View right click the item that you want to modify and select one of the following options Make First Action to designate the current action as the first action to be performed e Make Next Action to designate the current action as the next action in the list e Make Previous Action to designate the current action as the previous action in the list Make Last Action to designate the current action as the last action to be performed e Delete Action to remove the current action Deploying Reformatted Screens Once you have finished modifying your screens click Save to save your screens and exit the screen reformatter The TE Client will update with the new screens the next time the device syncs Chapter 4 Speakeasy and Scripting 22 Chapter 4 Speakeasy and Scripting Use the Terminal Emulation Script Editor to create
13. SpeechToText Support Grammar File Manager To launch the Grammar File Manager for an ActiveSync installation 1 Create an ActiveSync connection to the device 2 Click Start Programs Wavelink SpeechToText ActiveSync Support Install to Device 3 The Windows Speech to Text Installer appears Click Grammar File Manager Importing and Exporting Grammar Files Grammar files must be imported exported using the Grammar File Manager in order to be modified or copied to a different package When you export a grammar file from the Grammar File Manager it is exported as a text file with a bnf extension The bnf file can be copied or edited using a text editor such as Notepad The file is then imported back into the Grammar File Manager so that it can be available for download to the device To import a bnf file into the Grammar File Manager 1 Launch the Grammar File Manager 2 Click Import 3 The Import Grammar dialog box appears Navigate to the location where the grammar file is saved select it and click Open Q Chapter 2 Using the Grammar File Manager 5 4 The Select Languages dialog box appears Select all the languages from the list that the grammar will be used with and click OK 5 The Edit Item dialog box appears Type a description for the grammar file in the Description text box and click OK NOTE You can also edit the description for the grammar file after it has been added by selecting the file from the lis
14. add a Global Action that lists available commands when the user says help If there is a screen where not all the commands are available use a Local Action to override the Global Action with a list of commands specific to that screen The following options are available for Local and Global Actions Speech to Text Result Replace the result with this text Perform a key press Start a script Perform an IDA action The word or phrase you want to perform a specific action for The speech to text result must be an exact match in order for the action to be performed Speech to text results are case sensitive Replaces the speech to text result with the provided text When this replacement is made the Keypress after result value of the General tab is not used so if you want to use an additional key press you should include it here For instructions on determining the value of a key press see Performing a Keyboard Test in the TE Client User Guide Use followed by the 4 digit hexadecimal number to specify a Telnet key press and U followed by the 4 digit hexadecimal number to specify a Unicode character If you want to actually output a backslash character use For example to replace the result euro with followed by a VT Enter key press use this value U20ac 000d Replaces the speech to text result with a key press You can use the name of the key such as F3 or Enter or the hexadecimal numb
15. can be edited to fit your environment The Grammar File Manager allows you to manage the following speech to text options Specify which grammar files are installed on your device Speakeasy comes with several grammar files that you can use You can use them as provided edit them or create your own grammar files Speakeasy allows you to deploy as many grammar files as you want to the device and you can use up to ten grammar files simultaneously during a script or while on a screen that has been modified using the screen reformatter Specify the prompts Speakeasy uses during calibration and user training You can create different prompts for each language you use with Speakeasy The prompts are used when calibrating the microphone when the user is creating a voice profile and when voice profiles are being archived or retrieved from the Avalanche server Specify which words or phrases each user should train on before they begin using Speakeasy If there are words that the engine has trouble recognizing you can have each user create a voice profile When a user creates a voice profile he speaks the words specified and Speakeasy stores the results and uses them to increase positive results NOTE After you make changes in the Grammar File Manager you will need to deploy the changes to the mobile device If you are using a Windows TE Client you do not need to deploy the changes This section includes the following tasks for using the
16. detection is activated Chapter 7 Speakeasy Settings 40 stt idle timeout stt language long stt language short stt logging stt logging audio stt logging engine stt preserve stt priority stt processing stt reset stt reset session delay stt result sound stt save increase stt save session delay Indicates the total milliseconds for the engine to continue collecting results following the last result or timeout Displays the full name of the language currently being used Displays the three letter abbreviation of the language currently being used Creates a Speech to Text log file in the root folder of the device Sets the engine to log speech to text attempts as wav files If set to 1 the speech to text engine will create a log file in the root folder of the device Causes the speech engine to save the current engine state for use later Determines how aggressively the microphone input is collected and speech analysis is performed Indicates the action the speech engine should take when returning a grammar result Modifies engine adaptation speed and or saved engine information Indicates the total milliseconds for the speech engine to wait for a valid response before reverting back to the last saved state Causes a sound to play for result recognition Increases the threshold for saving a new engine state as time progresses Indicates the total milliseconds for the spee
17. file that will recognize a four digit number This grammar file is used with the Acquiring a Pick Quantity script example BNE AM V1 0 RR RR KR RR KK KKK OK KK IK RK KK KK ORK RK KK KK KK KK OK GRAMMAR sapqty four digits bnf Description This is a grammar that recognizes a four digit number 0 to 9999 It also recognizes the commands repeat back quit and clear What Can I Say You can say any number from 0 to 9999 You can also speak two three or four separate digits Kk kk ck kk kk koe kk ke kk kk kk kk ck Ck kc k kc k kc k kc k kc k kc k kc k k ck k ck kckck ck kckck ck ck ckck kckckck ck kk grammar sapqty four digits start Speech Speech edit change quantity FourDigits 2 Command NonZeroDigit 1 2 3 141511611718 9 lt Digit gt 0 0 7 OH 8 0 lt NonZeroDigit gt lt Teens gt 11 12 13 14 15 16 17 18 19 lt Tens gt TEN 10 TWENTY 20 TWENY 20 THIRTY 30 THIRDY 30 FORTY 40 FORDY 40 FIFTY 50 FIFDY 50 SIXTY 60 SIXDY 60 SEVENTY 70 SEVENDY 70 EIGHTY 80 EIGHDY 80 NINETY 90 NINEDY 90 lt CombinedTens gt TWENTY 2 TWENY 2 THIRTY 3 THIRDY 3 FORTY 4 FORDY 4
18. from the context menu Q Chapter 6 Using Speakeasy 37 3 The Speech to Text Indicator Light dialog box appears Select Yes from the drop down menu and click OK When you use the Client to connect a session that uses speech to text the listening indicator will appear whenever the Client is waiting for verbal input Chapter 7 Speakeasy Settings 38 Chapter 7 Speakeasy Settings This section lists settings supported by Speakeasy These settings can be modified using the screen reformatter or a script some of them are modified using the microphone calibration or text to speech configuration For detailed descriptions and value ranges see the Speakeasy Settings section of the Terminal Emulation Scripting Reference Guide Text to Speech Settings Opens the speaker volume calibration wizard tts_external_speaker_setting Speaker setting for use on Motorola Symbol mobile devices Indicates the sampling frequency tts_language_long Displays the full name of the language currently being used tts_language_short Displays the three letter abbreviation of the UT eis ee O currently being used tts Iuspih sd Indicates the Indicates the pitch level of spoken text level of spoken text indicates the speed evel tts readmode Indicates how text should be separated tts voice Indicates the name of the voice that is currently selected Indicates the sound lve tts_waitfactor Indicates the length of the pause between messages
19. grammars define which words the speech to text engine will recognize For more information on grammar files see Using the Grammar File Manager 6 Apply the software profile to the locations where you want the packages to be distributed and enable the profile 7 Perform a synchronization 8 If desired from the Enabler interface on the mobile device click File gt Connect to immediately connect to the mobile device server download the packages and install them NOTE For more information on performing tasks from the Avalanche Console refer to the Avalanche User Guide Installing Speakeasy Using ActiveSync Speakeasy can be installed on a mobile device using Microsoft ActiveSync or the Windows Mobile Device Center There are separate installation files for speech to text and text to speech Use the package labeled for ActiveSync if you are using the Windows Mobile Device Center If you are planning to use speech to text you will need the following package e Speech to text ActiveSync installation package If you are planning to use text to speech you will need the following package e Text to speech Vocalizer packages Choose the package or packages specific to the languages you will be using You should have the Terminal Emulation Client installed before installing Speakeasy on the device To install speech to text using ActiveSync 1 Download the applicable packages from the Wavelink Web site 2 Establish a connection wi
20. the microphone to optimize the speech detection in your current environment The microphone settings that you select will become the default values for future speech to text processing on the mobile device It is recommended that you calibrate the microphone before initial use You can perform a quick calibration that automatically sets values according to your speaking voice and the background noise or you can perform a full calibration manually setting the values using slider bars Before you begin calibration ensure that your headset is connected and working properly When the speech to text engine hears input it tries to match it to the expected phrases in the available grammar files The degree to which the spoken phrase and an expected response match is called the confidence value A higher confidence value indicates a better match If the confidence value is too low the input is rejected NOTE You do not have the option of a quick calibration unless Text to Speech is installed To perform a quick calibration 1 From the Client Options menu select Configure Microphone 2 The Options dialog box appears Click Quick Calibration 3 The Language dialog box appears Select the language you want to use from the drop down list and click OK Q Chapter 6 Using Speakeasy 32 The voice prompts will guide you through a prompt for speaking and a prompt for silence When the calibration is complete the new settings are applied and be
21. Add a separate entry for back if you want the engine to listen for it too Enabling Voice Training for New Terms When you add words or phrases to a grammar file you can specify if they should be available for voice training The slot command in a grammar file specifies which words and phrases should be available for voice training While you are adding terms to a grammar file you separate the words you want to have available for user training from those you want to exclude from user training Decide which terms you want to use for voice training then separate them by creating a rule for each group Then specify that both of the new rules belong to the main rule Speech In the example below the highlighted line shows that the rules YesNo and Cancel are included in the main rule Speech Then each term in the rules is defined on the last two lines grammar YesNoCancel start Speech slot lt YesNo gt lt YesNo gt yes no Chapter 2 Using the Grammar File Manager 10 lt Cancel gt cancel Notice that the start command specifies the main rule Speech Since Speech includes YesNo and Cancel this grammar file means the engine will listen for all the terms in both those rules Yes no and cancel After the terms have been grouped use the slot command on the line following the start command the third line in the example above When you use the slot command specify the rule that you want to use for trai
22. Agree The Choose Installation Location screen appears Click Browse to select a different installation location or click Install to use the default location The text to speech files are installed locally When the Completing the Setup Wizard screen appears ensure that the Run Wavelink Text to Speech ActiveSync Support checkbox is enabled and click Finish The wizard will close and the Text to Speech Vocalizer Installer will launch From the Languages list select the languages you will be using Click Install to install text to speech on the device When the files are finished installing the Installation Successful screen appears Click OK Installing Speakeasy on a PC Speakeasy can be installed on a Windows PC that has the Windows TE Client installed Depending on your organization s needs you may choose to install only speech to text or only text to speech Download the files from the Wavelink Web site and copy them to the computer where the TE Client is installed To install speech to text 1 Double click the Speech to Text executable The Wavelink SpeechToText Support Setup Wizard appears Q Chapter 5 Installation and Licensing 29 2 Follow the instructions in the Speech to Text Support Setup Wizard to complete the installation 3 When the installation is complete click Finish to exit the Wizard To install text to speech 1 Double click the Text to Speech Vocalizer executable The Wavelink TextToSpeech V
23. Chapter 2 Using the Grammar File Manager 12 4 When you have selected a grammar the words and phrases associated with that grammar appear in the Terminals list Enable the checkboxes for the terms that you want to use for training NOTE If you know the word or phrase is in the grammar file but it doesn t show up in the Terminals list you need to edit the grammar file to use the slot command for that word or phrase 5 When you have selected all the terms you want to use for training click OK The terms will be available for training when a voice profile is created or when a grammar is used that a user has not yet trained for For information on creating voice profiles see Creating a Voice Profile on page 35 Chapter 3 Using Speakeasy with the Screen Reformatter 13 Chapter 3 Using Speakeasy with the Screen Reformatter The TE Client screen reformatter allows you to modify the appearance of Telnet emulation screens You can create a screen layout that includes items you want the mobile device user to see and excludes items that should not be visible to the user The screen reformatter also allows you to add Speakeasy actions or scripts to a screen This section lists tasks for the screen reformatter that are used with Speakeasy For a full description of options available from the screen reformatter see the Terminal Emulation Client User Guide This section provides information about the following e Adding Text to Speech in t
24. Grammar File Manager 2 Select the grammar file you want to edit and click Edit or create a new grammar file by clicking Create New Grammar 3 The Grammar Editor appears Make changes to the file and then validate them by clicking the Parse the grammar button If the compiler sees issues in the grammar file the errors will appear in the pane at the bottom of the window Q Chapter 2 Using the Grammar File Manager 6 4 Click Save 5 Close the Grammar Editor The TE Client will update with the new grammar files the next time the device syncs The following sections provide information on how to edit grammar files Grammar File Structure Adding Terms to a Grammar File Using Alternate Return Values Enabling Voice Training for New Terms Grammar File Structure The following example is a basic grammar file the grammar file VoiceSpeed bnf viewed in Notepad wer ee LUE es File Edit Format View BNF EM V1 1 3 Ye Ye Ye Ye Ve Ye Ye Ye Ye ve Ye Ye Ye ve Ye Ye Ve ve Ye Ye Ye Ve ve Ye Ye e ve Ye Ye Ve Ve Ye Ye Ye Ve ve Ye Ye Ve ve Ye Ye Ve ve ve Ye Ve ve ve Ye Ve Ve ve ve ve Ve ve ve Ye Ve ve ve ve Ye Ve ve ve ve Ve ve ve Ve Ve ve ve ve Ye ve v GRAMMAR VoiceSpeed bnf Description This grammar file lets the user change the voice and voice speed quit what Can I Say You can increment or decrement the speeds or set to the normal rate of 1 You can say three voices Jill Samantha amp Tom FeFe ye eve ve e veve v
25. Grammar File Manager Launching the Grammar File Manager Importing and Exporting Grammar Files Editing a Grammar File Modifying User Prompts Specifying Voice Profile Training Options NOTE In previous versions grammar files were considered either engine mode or attribute mode Starting with version 2 0 5 of Speakeasy all grammar files are considered engine mode grammar files Q Chapter 2 Using the Grammar File Manager 4 Launching the Grammar File Manager If you are using Wavelink Avalanche the Grammar File Manager can be accessed through the Avalanche Console after you have the speech to text package added to a profile If you are using ActiveSync to install or if you are using a Windows TE Client then you can access the Grammar File Manager through the Windows Start menu after you have installed Speakeasy on a PC Wavelink recommends you use the Windows TE Client for developing and testing grammar files scripts and reformatted screens To launch the Grammar File Manager from the Avalanche Web Console 1 From the Profiles tab select the software profile that has the speech to text base package 2 Find the speech to text base package in the Software Packages panel and click Configure 3 The Configure Software Package dialog box appears Click Next 4 Select Grammar File Manager from the list and click Launch Config To launch the Grammar File Manager for the Windows TE Client Click Start Programs Wavelink
26. If you are planning to use speech to text you will also need the following packages e Speech to text Base package e Speech to text Language packages Choose the package s specific to the language s you will be using If you are planning to use text to speech you will need the following packages e Text to speech Base package e Text to speech Vocalizer packages Choose the package s specific to the language s you will be using You should have the Terminal Emulation Client installed before installing Speakeasy on the device NOTE The following instructions are for installing Speakeasy using the Avalanche Web Console For instructions on installing using the Java Console see the Avalanche Java Console User Guide To install Speakeasy using Avalanche 1 Download the applicable packages from the Wavelink Web site 2 If desired use Avalanche to create a new software profile for the Speakeasy packages 3 Add the Speakeasy packages to the software profile and navigate to the Software Profile Details page 4 If you want to specify where on the device you want the Speakeasy packages installed configure the registration package You should install the packages in a location with sufficient memory that is cold boot persistent Q Chapter 5 Installation and Licensing 27 5 If you are using speech to text configure the speech to text base package Use the grammar file manager to configure the grammars the device will need The
27. Speakeasy Wavelink Speakeasy Reference Guide Version 2 45 Revised 04 12 2012 Copyright 2012 LANDesk Software Inc and its affiliates All rights reserved LANDesk and its logos are registered trademarks or trademarks of LANDesk Software Inc and its affiliates in the United States and or other countries Other brands and names may be claimed as the property of others Email customerservice wavelink com Website http www wavelink com LANDesk does not warrant that this document is error free and retains the right to make changes to this document or related product specifications and descriptions at any time without notice LANDesk does not assume any obligation to update the information contained herein This document is provided AS IS and without any guaranty warranty or license express or implied including but not limited to fitness for a particular purpose merchantability non infringement of intellectual property or other rights of any third party Any LANDesk products referenced in this document are not intended for use in medical life saving or life sustaining applications Third parties may have intellectual property rights relevant to this document and the technologies discussed herein iii Table of Contents Chapter 1 Introduction to Speakeasy seco ete ei roo d oblicuu c iiDnedirecsc bers s Ua ePi pas 1 speakeasy Features RU 1 Implementing Speakeasy f
28. ToText Support Or e To uninstall text to speech support click Start gt Programs gt Wavelink TextToSpeech Vocalizer Support gt Uninstall TextToSpeech Vocalizer Support To uninstall Speakeasy ActiveSync Support from a PC e To uninstall speech to text ActiveSync support click Start gt Programs gt Wavelink SpeechToText ActiveSync Support gt Uninstall SpeechToText ActiveSync Support Or To uninstall text to speech ActiveSync support click Start gt Programs gt Wavelink TextToSpeech ActiveSync Support gt Uninstall TextToSpeech ActiveSync Support Q Chapter 6 Using Speakeasy 31 Chapter 6 Using Speakeasy Once Speakeasy is installed on the device the TE Client has tools to optimize Speakeasy You can calibrate the microphone or text to speech options create a voice profile or enable the Speakeasy listening indicator to show when speech to text is listening When you create voice profiles each person can create his own profile in order to optimize results If you are using Speakeasy in conjunction with Avalanche voice profiles can be stored on the mobile device server and distributed to devices as needed Otherwise each user will need to create a voice profile on each device he plans to use Calibrating the Microphone Configuring the Text to Speech Options e Creating a Voice Profile Using the Speakeasy Listening Indicator Calibrating the Microphone On some mobile devices you can calibrate
29. View and select Edit Speech to Text Adding Scripts to Reformatted Screens Use the screen reformatter to launch Speakeasy scripts when the modified screen is first displayed The script can provide additional functionality to the modified screen To add a script from the screen reformatter 1 Click Edit gt Add Scripting Support Or In the Initial Screen View right click and select Add Scripting Support from the context menu The Scripting Support dialog box appears 2 Select the desired script from the Script to launch drop down menu If you want to pass specific parameters to the script type them in the Parameters text box separated by commas NOTE The Script to launch drop down menu only displays scripts that have been saved in the Script Editor For more information about Terminal Emulation scripting see the Wavelink Terminal Emulation Scripting Reference Guide 3 Select how the screen reformatter will handle the script If you want to ensure that the script does not run multiple times enable the Don t launch the script if it is already running checkbox If you want the script to abort when the modified screen is no longer in use enable the Stop the script when reformatting changes option If you want the screen reformatter to wait until the script has completed before it proceeds to the next action for the screen enable the Wait for the script to finish before performing the next supporting action 4 Click
30. and execute scripts that automate Speakeasy processes such as selecting the right voice profile or changing the speed of text to speech A script can be started using the Screen Reformatter a key combination or scan input calling it from another script or a web page or from the TE Client by clicking Options gt Scripting gt Execute Script You also have the option of launching a script when the session connects or when the screen updates NOTE When using text to speech and scripting you must convert an integer variable to a string variable in order for text to speech to read it This section provides overview information for the following topics Creating Scripts e Activating Scripts For examples of Speakeasy scripts see Sample Speakeasy Scripts on page 42 Creating Scripts The following steps provide an overview of how you manually create a Speakeasy script For more detailed information about these steps or scripting actions refer to Wavelink Terminal Emulation Scripting Reference Guide 1 Name the script 2 Select an activation method 3 Build the script code In the Actions tab create the code line by line that describes how you want the script to perform NOTE For actions specific to Speakeasy refer to Speakeasy Settings on page 38 4 Create any variables that you need for your script in the Boolean Variables Number Variables or String Variables tabs 5 Assign host profiles that can perform the script Acti
31. atPrompts so that the script sapRepeatPrompts will be called bRepeatPrompts TRUI strSpeechResult Speech To Text Cancel Return End If If String Equal strSpeechResult back 0 TRUE Gl Comment Press F2 key Comment Keypress Key VT220 F2 Ask OK F2 Key Pressed Back Function bBackFunction TRUE strSpeechResult Speech To Text Cancel Return B End If If String Equal strSpeechResult clear 0 TRUI Comment Call clearFields javascript function Web Scripting javascript clearFields strSpeechResult Return End If If String Equal strSpeechResult quit 0 TRUE Comment Disconnect session Speech To Text Cancel Disconnect Return End If If String Equal strSpeechResult help 0 TRUE Comment Annunciate help list Speech To Text Cancel Speech From Text Help list annunciates this list TRUE Speech From Text Repeat prompts repeats prompts and data TRUE Speech From Text Go back moves to the previous screen TRUE Speech From Text Clear fields clears target bin material batch and pick quantity fields TRUE Speech From Text Quit SAP disconnects the session TRUE strSpeechResult Return End If End If End If LH Speech To Text Cancel Return Chapter 8 Sample Speakeasy Scripts 48 Acquiring Pick Quantity Grammar File The following is an example of a grammar
32. b page first loads lt title gt TE70 Testl Launch Telnet Scripts lt title gt meta http equiv OnStartup content wls WebAuto gt Executing Scripts from Web Pages Example 2 This example launches a script called WebClick when a user clicks the hyperlink here on the web page lt p gt Click a href wls WebClick gt here lt a gt to launch the amp quot WebClick amp quot script lt p gt Chapter 5 Installation and Licensing 25 Chapter 5 Installation and Licensing Speakeasy consists of multiple packages in addition to the Terminal Emulation Client that must be deployed to the mobile device You can install Speakeasy packages on the mobile device using Wavelink Avalanche or Microsoft ActiveSync You can also install Speakeasy packages for the Wavelink TE Client for Windows To improve speech recognition and positive results Speakeasy speech to text uses grammar files to define expected input If you are using speech to text you should use the Grammar File Manager to modify and select the grammar files you plan to use before you install speech to text on the device The Grammar File Manager is available whether you are installing via Avalanche or ActiveSync This section provides the following information on installing Speakeasy Installation Requirements Installing Speakeasy Using Avalanche Installing Speakeasy Using ActiveSync Installing Speakeasy on a PC e Licensing Uninstalling Speakeasy
33. ch engine to wait before saving the next current state Chapter 7 Speakeasy Settings 41 stt save threshold Directs the speech engine to save the state if the result confidence is greater than the result confidence for stt threshold and stt save threshold combined stt server timeout When uploading or downloading user training data the value for this setting is how long in seconds the Client will wait for a response from the Avalanche server Displays the size of the speech to text engine being used stt special sounds Indicates how the speech engine should interpret special sounds stt threshold Indicates the minimum amount of confidence for the most likely result that will be accepted stt timeout Indicates the total milliseconds ms for the system to wait before responding to the speaker stt use jumpback Sets a buffer to check if the engine is processing speech stt use word ids Enables support for Word IDs the id directive in grammar files stt volume Indicates the current volume of the microphone input Chapter 8 Sample Speakeasy Scripts 42 Chapter 8 Sample Speakeasy Scripts This section contains example scripts that perform various Speakeasy functions You can use the Script Editor to modify and customize scripts as desired For more information on scripting or the Script Editor see the Terminal Emulation Scripting Reference Guide Using a Voice Profile e Reading the Screen Aloud Displayin
34. come the defaults for the device For information on modifying the calibration prompts using the Grammar File Manager see Modifying User Prompts on page 10 To perform a full calibration 1 From the Client Options menu select Configure gt Microphone 2 The Test Settings dialog box appears Click Full Calibration 3 From the Language drop down menu select the language you will be using for speech to text conversion 4 From the Grammar drop down menu select the grammar you will be using for speech to text conversion 5 If you have a session currently connected you can use the speech to text settings for that session instead of the default settings Select the session from the Session drop down menu 6 Click Next The Microphone Volume dialog box appears Chapter 6 Using Speakeasy 33 8 Microphone Volume Eneray Level Signal to Noise Ratio no thank you gt no Confidence 4619 Microphone Volume 40 Min Microphone Volume Dialog Box 7 Use the Microphone Volume slider to adjust the Energy Level The Energy Level indicates how much the microphone input is currently changing The top bright green bar is the current energy level and it should fall between the two white bars when the user is speaking The darker bar underneath is the maximum level reached within the past 5 seconds The Signal to Noise Ratio bar shows the quality of the microphone and device audio processing
35. e Microphone 3 The Options dialog box appears Click User Training 4 The Language dialog box appears Select the language you want to use from the drop down menu and click OK 5 The User Name dialog box appears Type the user name in the text box and click OK 6 The User Training dialog box appears Speakeasy vocally prompts you to say the words and phrases selected for user training when the grammar files were configured You are prompted to say each word or phrase twice After all the selected terms have been recorded the profile is saved If you only want to train for some of the available terms stop the training and select the checkboxes next to the terms you want to train for Then click Start NOTE If you create a voice profile and later add a grammar file that requires additional training you must use this process again in order to complete the training Using the Speakeasy Listening Indicator The Speakeasy listening indicator appears as a small icon on the TE Client screen whenever the speech to text engine is listening for input The indicator is enabled or disabled from the emulation parameters for the TE Client To enable the Speakeasy listening indicator 1 Access the Configuration Manager for the TE Client For information on how to access the Configuration Manager see the Terminal Emulation Client User Guide 2 In the Indicators section right click the option Speech to Text Listening Indicator and select Edit
36. e ve FEFEFE veve SESE FE SE FE SEFE FEFE TRL FE FEFEFE FE FE LIAL FE FE FE FE IAAL FE ve ve ye e FE FE FE ve ve ye FE FE Fe ye FE FE ASAI AAA ASEAN Fe Ye FERE grammar VoiceSpeed start lt Speech gt lt Speech gt slower faster normal address description repeat again Jill Samantha Tom Example of a Grammar File Each grammar file must begin with a statement such as BNF EM V1 1 that identifies how Speakeasy should handle the grammar file You do not need to modify this line Chapter 2 Using the Grammar File Manager 7 To create comments information ignored by the engine you can begin a line with or enclose text in and markers You can edit the Description and the What Can I Say sections to describe changes you make to the grammar file If you change the name of the grammar file the command grammar must use the new file name For example if the name of the file was changed to VoicePick bnf the command would read grammar VoicePick The start command specifies which terms in the grammar will be available when the grammar is in use In the above example the engine will listen for all of the terms in the Speech rule The words and phrases listed between Speech andthe last are the terms the grammar will accept Each word or phrase must be separated by an OR symbol Terms may be listed all on the same line or aligned vertically for easier editing In some grammar files the main rule
37. ee eee e eee eeeeeeeeeees 27 Installing Speakeasy ona PG x 2252 ies ideS sees ele eL Liber bebe i Ri adea eed ddebdctan ESOR 28 ISICONSING MEC rE neice snnseecesnen ca seeteadecss a a ti oe Saat cucsepeewicemeaeeeeeas 29 Uninstalling Speakeasy 2 2 2 2 22222222 cece cece een I I I I eee eee eee EEEE EEEIEE Erranen e 29 Uninstalling Speakeasy from a Mobile Device 0000000ceeeeee eee eet eee n 29 Uninstalling Speakeasy from aPC 5o cies need i sane RR eee eee babe eee E tee acdsee te 30 iv Chapter 6 Using Speakeasy u casccntccesuusrestiadoguneciicceeotensacogeunks ei iaai 31 Calibrating the Microphone 2 222222 22 2202222 c cece cece cece e I I I II I eee eee e eee e teen tee EEE EA DEES 31 Configuring the Text to Speech Options 2 2 2 2 cece cece cece eee eee ee eee e e se e e e e el rrr elle lll 34 Creating a Voice Profile 2 2222 uecsers alec ecwabenn oco n each saben wade ddd ane cman eerde e eebe deete dia 35 Using the Speakeasy Listening Indicator 00 ceceeeeeecee cece cece e ee n eee e n e e e emen 36 Chapter 7 Speakeasy Settings uuuuuuuuuuuuuuuslllllllllllllssssssse Ress eee eee cence ence ees eeeceeeeseeeees 38 Text to Speech Settings M 38 speech to Text Settings E tected sete cenes east Madge sie bas need Eig Lee ene Be pled eR ee ead reee e Eai 39 Chapter 8 Sample Speakeasy Scripts uus ccdeds nace ceeeeacccseacagic
38. er Replaces the result with a script Use an existing script or click Edit Scripts to launch the Script Editor Assign initial values to the variables in the script by using a comma delimited list inside of parentheses following the script name For example to run the script DoItNow and set the string variable User to lucky and the number variable Position to 17 you would type this DoItNow User lLucky Position 17 Replaces the result with the a standard action Many of these actions are also available other ways such as by writing a script or using a key press value Q Chapter 3 Using Speakeasy with the Screen Reformatter 17 Seta Speech to Text or Text to Speech setting Standard Beep Error Beep Restart the supporting actions for this screen Cancel the Speech to Text Do Nothing Replaces the result by changing the Speakeasy settings for the Client Each setting must start with stt or tts and use the format setting value If a value is not a number then the engine will use the value closest to the value text description provided The complete list of settings is available in the Terminal Emulation Scripting Reference Guide You can change multiple settings with a comma delimited list no spaces The list must contain only Speech to Text settings or only Text to Speech settings You cannot mix the two types of settings If you need to do that then create and call a script instead of using this o
39. g Speech Results in a Dialog Box e Speech Demo Script Changing Text to 5peech Modes e Acquiring a Pick Quantity in the Industrial Browser Using a Voice Profile The following example script asks the user for his username and then switches to the voice profile associated with that username Script Set Speech User String sSpeechToTextUserName True Activate Connection Comment If the persistent variable doesn t have a value the default is the username the Speech to Text engine is using If String Empty sSpeechToTextUserName sSpeechToTextUserName Speech To Text Get User Nam End If Comment Ask the user the username to use The last username used will be the default sSpeechToTextUserName Ask String Lowercase What is your Speech Username Speech 1 100 sSpeechToTextUserName Comment Tell the Speech to Text engine the usernam Speech To Text Change User Name sSpeechToTextUserName Return Reading the Screen Aloud The following example script converts the current TE Client screen into speech that the user can hear nNumRows Get Screen Rows nCurrentRow 1 While Number Less Than Or Equal nCurrentRow nNumRows Speech From Text Get Screen Text nCurrentRow 1 FALSI nCurrentRow Number Plus nCurrentRow 1 End While Return AY Chapter 8 Sample Speakeasy Scripts 43 Displaying Speech Results in a Dialog Box The fol
40. he Reformatter e Adding Speech to Text in the Reformatter e Adding Scripts to Reformatted Screens Ordering Screen Actions Deploying Reformatted Screens NOTE The Screen Reformatter does not work with Web emulation Adding Text to Speech in the Reformatter You can add text to the modified screen that will be converted into speech and played back to the mobile device user This can be text from the host screen or text added just for the modified screen Multiple text to speech actions will be processed without a pause if they are adjacent You can also use the screen reformatter to set text to speech settings To add text to speech from the screen reformatter 1 Click Edit gt Add Text to Speech Text Or In the Initial Screen View right click and select Add Text to Speech from the context menu The Text to Speech Text dialog box appears 2 Type your text in the Text to be spoken text box This box can be left empty if you only want to change the text to speech settings 3 Type the desired text to speech settings in the Persistent Text to Speech Settings to use and or the Temporary Text to Speech Settings to use text boxes Q Chapter 3 Using Speakeasy with the Screen Reformatter 14 NOTE Each setting must start with tts and use the format setting value Multiple settings can be specified and should be separated by commas The complete list of settings is available in the Terminal Emulation Scripting Reference Guide
41. icdstuendassecesssediceaccence 42 Using a Voice Profile oe coon tan ioeie ILI RIpel0nle ite Rip Suosetde bras as suwen dee eases haan tek e eaae 42 Reading th Sareen Aloud ropise are a e dso RN Rie teehee ded dedre a Ea ates 42 Displaying Speech Results in a Dialog Box 222222 22222222222 eee eee eee ence eee III 43 Speech Demo Script MEE 43 Changing Text to Speech Modes 2 2 2 2 c ebecsegdeceteenebs s e cede hosed sane a cbesciece Ie ie Eines s ier assed ees 44 Acquiring a Pick Quantity in the Industrial Browser ssssssulllllllllllllllllll e e nn Ihe hr 46 Acquiring a Pick Quantity Script asas co olllsespuce co el uuo le ls Edolcce c E rece ee Ed rre roc EE ecce T M ETT 46 Acquiring Pick Quantity Grammar File 2 2 2 2 0 0022222 cc cece eee eee eee cece eee e eee s reme rn nenne 48 Javascript Function clearFields 22225222 2520626ectiinseete D e eI RD RA E in Mose i dd dei eee ete 49 Wavelink Contact Information 25su355esosso tco oe docet Scene cg e eet eu edie ash eh Uu AM LR CI ASA EE Lue teenie 51 Chapter 1 Introduction to Speakeasy 1 Chapter 1 Introduction to Speakeasy Wavelink Speakeasy is a verbal communication system that facilitates real time voice communication between the host computer and the mobile device user It is available to use with the Wavelink Terminal Emulation TE Client 7 0 and newer versions Speakeasy can be easily implemented from the Screen Reformatter or you ca
42. ile you can use the options on this dialog box to record and play back microphone input as a wav file This option is helpful if you have words that the engine has a hard time recognizing Record someone saying the words in a wav file and check the confidence levels using the playback Modify the grammar files and then check back to see if your changes have increased recognition higher confidence values 11 Click Finish The microphone calibration wizard disappears and the new microphone settings are applied These settings will be the defaults for the device Configuring the Text to Speech Options On some mobile devices you can configure the speaker volume and speed settings The speaker settings that you select will become the default values for future text to speech processing on the mobile device To configure text to speech options 1 From the TE Client click Options gt Configure gt Speaker Volume Q Chapter 6 Using Speakeasy 35 lii Headset Speaker Volume Language English USA Voice Tom Headset Speaker Volume 100 Min Speech Rate 100 Min Sample T ext This is some sample text Speaker Settings The Headset Speaker Volume dialog box appears 2 From the Language and Voice drop down menus select the desired language and voice The options that appear in the Voice drop down menu are dependent on the language selected 3 Use the sliders to set the volume and how fast the tex
43. lementsByName strFieldNameClear value strFieldValueClear var arrayFieldNameClear document getElementsByName strFieldNameClear arrayFieldNameClear 0 value strFieldValueClear Clear Pick qty field var strFieldNameClear s4000 qty 1 var strFieldValueClear document getElementsByName strFieldNameClear value strFieldValueClear var arrayFieldNameClear document getElementsByName strFieldNameClear arrayFieldNameClear 0 value strFieldValueClear Wavelink Contact Information 51 Wavelink Contact Information If you have comments or questions regarding this product please contact Wavelink Customer Service E mail Wavelink Customer Support at CustomerService Wavelink com For customers within North America and Canada call the Wavelink Technical Support line at 801 316 9000 option 2 or 888 967 9283 For Europe Middle East and Africa hours are 9 AM 5 PM GMT For all other customers hours are 7 AM 7 PM MST
44. lowing example script prompts the user for a number converts the spoken number into text and displays it in a dialog box on the mobile device This script requires the connected digits grammar file String sResult Speech From Text Say a number FALSE Speech To Text sResult connected digits Ask OK sResult Number Returned Return T In this example the number is treated as a string because both the functions Speech_To_Text and Ask_OK require a string However it could be converted to a number if needed by using the following line nResult String_To Number Decimal sResult Speech Demo Script The following example script creates the four buttons on the screen Digits State Play Screen and Done The Digits and State buttons allow the user to input a verbal response which is then displayed on the screen The Play Screen button causes the mobile device to read back all the text on the screen and the Done button allows the user to exit the script While Not bExit If Not bButtonsVisible Button Create View Digits 999 1 6 bGetDigits Button Create View State 999 16 5 bGetState Button Create View PlayScreen 1000 1 11 bPlayScreen Button Create View Done 1000 13 4 bExit End If Wait For Screen Update If bPlayScreen bPlayScreen FALSE Button Remove All bButtonsVisible FALS Delay 1 Gl nNumRows Get Screen Rows nCurrentRow 1 B While Number Less Than Or Equal nCu
45. lue Comment Annunciate Pick Quantity prompt Speech From Text strPromptQuantity TRU Gl Comment Annunciate Pick Quantity Value Speech From Text strPromptQuantityValue TRUE Return Chapter 8 Sample Speakeasy Scripts 46 Acquiring a Pick Quantity in the Industrial Browser The following example script is designed to work with the Wavelink Industrial Browser and allows the user to speak a number 0 9999 referred to as the pick quantity ask for help go back disconnect the session or clear the field This script requires that text to speech speech to text and a custom grammar file named sapqty four digits bnf is installed The script also calls a JavaScript function clearFields The text of the grammar file and the JavaScript function are included below NOTE This script calls another Wavelink script in order to repeat the information on the screen The script sapRepeatPrompts isincluded in Changing Text to 5peech Modes on page 44 Acquiring a Pick Quantity Script Comment This function acquires the Pick Quantity via voice Comment Ensure Speakeasy support has been installed If Not Speech To Text Available Ask OK Speech to Text is not available Error Return End If If Not Speech From Text Available Ask OK Text to Speech is not available Error Return End If Speech To Text Cancel Comment The Speech to Text and Text to Speech languages are Specified Speech
46. mand gt repeat prompts repeat go back back quit sap quit clear fields clear help list 8 help JavaScript Function clearFields The following JavaScript function is an example of a function that will clear the fields in the Wavelink Industrial Browser This is used with the Acquiring a Pick Quantity script example KR KR KR RR KK KK KK KK KK KR KK KK KKK KK KK KK This function is called to clear the fields when the clear command and control command is spoken There are no inputs provided when this function is called HK RR kCk k kc k k kc k RR kck ck kck ck kck ck RK KK KK function clearFields Clear target Bin field var strFieldNameClear s4000 binp 1 W Chapter 8 Sample Speakeasy Scripts 50 var strFieldValueClear document getElementsByName strFieldNameClear value strFieldValueClear var arrayFieldNameClear document getElementsByName strFieldNameClear arrayFieldNameClear 0 value strFieldValueClear Clear target Material field var strFieldNameClear s4000 matnrp 1 var strFieldValueClear document getElementsByName strFieldNameClear value strFieldValueClear var arrayFieldNameClear document getElementsByName strFieldNameClear arrayFieldNameClear 0 value strFieldValueClear Clear target Batch field var strFieldNameClear s4000 chargp 1 var strFieldValueClear document getE
47. n create scripts to customize how Speakeasy is used Speakeasy provides the ability to translate data from the host computer into spoken directions that the user is able to hear text to speech The user s spoken response can then be transcribed and sent back to the host computer speech to text You can install both text to speech and speech to text or just the component that fits your company s needs This introduction provides a list of Speakeasy features guidelines for implementing Speakeasy and document assumptions and conventions e Speakeasy Features Implementing Speakeasy Speakeasy Features Speakeasy has a variety of features that make using voice with terminal emulation easy and practical e Client side processing All Speakeasy processing is performed on the mobile device reducing bandwidth usage and eliminating the need for middleware servers and host modifications Powerful scripting engine The Wavelink TE Client includes a scripting utility which can capture and manipulate screen data launch secondary processes provide audible warning and screen messages and automate repetitive tasks and data entry Scripts can be triggered by screen data unique key combinations or can be called from the reformatter e WYSIWYG configuration with the Screen Reformatter Speakeasy options are available in the Terminal Emulation Screen Reformatter making it easy to add speech to text and text to speech to screens Use the Sc
48. nal Emulation Scripting Reference Guide Once a setting has been changed that value will be used for future Speech to Text actions until it is changed again 6 If you want to configure local or global actions for the screen select the appropriate tab and click Add The Result Action dialog box appears f Se Speech to Text Result Final Action Text stop action wls CandC Action to Perform Replace the result with this text Perform an IDA action IDA SESSION DISCONNECT Perform a key press Set a Speech to Text or Text to Speech setting Start a script 5 Standard Beep CandC i i Error Beep E Restart the supporting actions for this screen Cancel the Speech to Text Do Nothing Ignore the result Pause Speech to Text while the script is running Result Action for Speech to Text 7 Configure the options to perform the action for the result The Final Action Text box will display the text that represents the action and will be displayed on the Local Actions or Global Actions tab Click OK to save the changes and return to the Speech to Text dialog box 8 When you have configured speech to text for the modified screen click OK The Speech to Text dialog box closes and the speech to text action is added to the modified screen Chapter 3 Using Speakeasy with the Screen Reformatter 20 If you need to modify the speech to text action right click the action in the Descriptive
49. nges The prompts will be used when you perform calibration or voice profile training Specifying Voice Profile Training Options Speakeasy allows users to create personalized voice profiles which can improve the positive results when you are using speech to text When you create a voice profile you speak a set of selected words to train the engine to recognize your voice and pronunciation The words used Q Chapter 2 Using the Grammar File Manager 11 for voice profile training come from the grammar files available on the device and are selected from the Grammar File Manager When you are selecting words and phrases to use for training focus on terms that are short or that the engine may have trouble understanding If you have two words that may sound similar or words that are only one syllable you may want to include these in the training Before a word or phrase can be selected for voice training you must define possible voice training words in the grammar file For information on enabling voice training for words or phrases see Enabling Voice Training for New Terms on page 9 To specify the words used for voice profile training 1 Launch the Grammar File Manager 2 Click Training Settings sio User Training Settings dialog box 3 The User Training Settings dialog box appears From the Grammar list select at least one grammar that has words or phrases that you want to use for training
50. ning The example above will enable voice training for the terms in the rule YesNo NOTE The slot command only works for rules that contain simple terms such as words phrases and alternate terms It doesn t work for rules that contain other rules such as Speech in the above example or complex commands You cannot use the slot command for groups that contain repeat or Once you have put the terms in a rule and used the slot command to specify the rule use the Grammar File Manager to select the terms for training before the package is deployed to the device See Specifying Voice Profile Training Options on page 10 for information on selecting terms for user training Modifying User Prompts Speech to text uses several prompts during calibration and voice profile training These prompts default to English values but you can modify the prompts for each language used with Speakeasy If you are using a language other than English there are no default values and you must configure the prompts in order to perform user training To modify the user prompts 1 Launch the Grammar File Manager 2 Click User Prompts 3 The User Prompts dialog box appears Select the language from the Language drop down menu that the prompts will be available for and modify the prompts as desired If you are not using Avalanche to store and distribute voice profiles you do not need to change the Training Data Archiving options 4 Click OK to save your cha
51. ocalizer Support Setup Wizard appears 2 Follow the instructions in the Text to Speech Vocalizer Support Setup Wizard to complete the installation 3 When the installation is complete click Finish to exit the Wizard Licensing Speakeasy requires a separate license in addition to the standard Terminal Emulation licenses You can use Speakeasy without a license but you will be limited to the demo version Speakeasy licenses can be distributed using the same method as other TE licenses For information on licensing methods or distributing licenses see the Terminal Emulation Client User Guide To obtain licenses please contact Wavelink Customer Service Uninstalling Speakeasy Speakeasy can be uninstalled from the PC you used to install or from the mobile device Uninstalling Speakeasy does not uninstall the TE Client Uninstalling Speakeasy from a Mobile Device Uninstalling Speakeasy from a PC Uninstalling Speakeasy from a Mobile Device Speakeasy is installed on a mobile device using Avalanche or ActiveSync To uninstall Speakeasy from a mobile device use the same application that you used to install NOTE The following instructions are for uninstalling Speakeasy from all devices You can also uninstall Speakeasy from a specific device or region by changing how you want the Speakeasy software profile applied To uninstall Speakeasy using Avalanche 1 From the Avalanche Console navigate to the profile containing the Speakeasy
52. on Activate the script by pressing the specified key combination The script will run if it is currently possible for a script to run When Session Connects The script activates when a session connects using the specified host profile On Barcode MSR or RFID Scan The script activates with each barcode MSR or RFID scan W Chapter 4 Speakeasy and Scripting 24 On Screen Update The script activates if activation is allowed every time the text on the emulation screen changes This includes updates from the host or when the user presses a key and the key value appears on the screen From the Screen Reformatter A Wavelink script can be launched for a specific screen using the screen reformatter When a script is added for a screen in the reformatter it is considered a screen action When the correct screen appears on the device screen actions including speech to text and text to speech actions are performed in the order they appear in the Descriptive View For information on adding a script to a screen using the screen reformatter see Adding Scripts to Reformatted Screens on page 20 From Web Pages Activate the script for the Industrial Browser from a web page using the wls type followed by the script name If you plan to launch a script from a web page do not select a script activation method when you create the script Executing Scripts from Web Pages Example 1 This example launches a script called WebAuto when the we
53. packages 2 Select the Speakeasy packages and click Delete 3 Perform a synchronization When a package is deleted from the Avalanche Console the package on the device is considered orphaned You can delete orphaned packages from Q Chapter 5 Installation and Licensing 30 devices using a mobile device profile or by using the Update Now option on the Avalanche Console To uninstall Speakeasy using ActiveSync 1 Create an ActiveSync connection to the device 2 From the PC click Start gt Programs gt Wavelink SpeechToText ActiveSync Support gt Install to Device to uninstall the speech to text files Or From the PC click Start gt Programs gt Wavelink TextToSpeech ActiveSync Support gt Install to Device to uninstall the text to speech files 3 The Wavelink Installer appears In the Installation Location drop down menu select the location where the files were originally installed 4 Ensure that all the languages are deselected and click Install 5 The files are removed from the device Uninstalling Speakeasy from a PC Speakeasy can be used for a Windows TE Client or deployed from a PC to a mobile device via ActiveSync or Avalanche If you used Avalanche to install you do not need to uninstall the ActiveSync support files from the PC To uninstall Speakeasy for a Windows TE Client from a PC To uninstall speech to text support click Start gt Programs gt Wavelink SpeechToText Support gt Uninstall Speech
54. peech Change Setting tts readmode nReadMode Comment Annunciate Material prompt Speech From Text strPromptMaterial TRUE Comment Change to character mode to annunciate material nReadMode Speech Find Setting Value tts readmode character FALSE Speech Change Setting tts readmode nReadMode Comment Annuciate Material Speech From Text strPromptMaterialValue TRUE Comment Change to sentence mode to annunciate batch prompt nReadMode Speech Find Setting Value tts readmode sentence FALSE Speech Change Setting tts readmode nReadMode Comment Annunciate Batch prompt Speech From Text strPromptBatch TRUE Comment Change to character mode to annunciate Batch nReadMode Speech Find Setting Value tts readmode character FALSE Speech Change Setting tts readmode nReadMode Comment Annuciate Batch Speech From Text strPromptBatchValue TRUE Comment Change to sentence mode to annunciate pick quantity nReadMode Speech Find Setting Value tts readmode sentence FALSE Speech Change Setting tts readmode nReadMode Comment Extract quantity value left of the period strSearchString nlIndex String Find First strPromptQuantityValue strSearchString TRUE strPromptQuantityValue String Left strPromptQuantityValue nIndex strPromptQuantityValue String Trim Spaces Start strPromptQuantityVa
55. ptBinValue String strPromptMaterial String strPromptMaterialValue String strPromptBatch String strPromptBatchValue String strPromptQuantity String strPromptQuantityValue String strSearchString Number nReadMode Number nIndex Comment This function repeats the prompts when called from Command and Speech To Text Cancel Comment The Speech to Text and Text to Speech languages are specified Speech Change Setting tts language short Speech Find Setting Value tts language short enu FALSE Speech Change Setting stt language short Speech Find Setting Value stt language short enu FALSE Chapter 8 Sample Speakeasy Scripts Comment Ensure read mode is in sentence mode nReadMode Speech Find Setting Value tts readmode sentence FALSI Speech Change Setting tts readmode nR adMode Comment Annunciate Bin prompt Speech From Text strPromptBin TRUE Comment Change read mode to character mode to annunciate bin number nReadMode Speech Find Setting Value tts readmode character Speech Change Setting tts readmode nReadMode Comment Annuciate Bin number Speech From Text strPromptBinValue TRUE 45 GI FALSI Gl Comment Change read mode back to sentence mode to annunciate material prompt nReadMode Speech Find Setting Value tts readmode sentence FALSE S
56. ption Replaces the result with a standard TE beep If the beep has been modified in the emulation parameters the modified beep will be used Replaces the result with a TE error beep If the beep has been modified in the emulation parameters the modified beep will be used Replaces the result with a restart of the supporting actions for the screen Any text to speech actions and script actions will be repeated Interprets the result as a command to stop the Speakeasy listening engine while the user is on the current screen The engine will begin listening again when the user changes screens Ignores the result This option is useful if a grammar is being used that can return results that don t apply to the current screen For each Speech to Text result received the Local Actions are tested first If no Local Actions match then the Global Actions are tested If no Global Actions match the result will be treated as keyboard data and use the settings configured in the General tab To add speech to text from the screen reformatter 1 Click Edit Add Speech to Text Or In the Initial Screen View right click and select Add Speech to Text from the context menu The Speech to Text dialog box appears Q Chapter 3 Using Speakeasy with the Screen Reformatter 18 Speech to Text Grammar s to use digitHetters_lower yes_no use more than one grammar Print To Screen Keypress after result Run Script M Edit
57. reen Reformatter to change Speakeasy settings select the grammar files available or perform specific functions for a speech to text result Microphone calibration tools Speakeasy has built in calibration tools that use Speakeasy settings to improve microphone performance There is a quick calibration that uses a few verbal prompts and responses for calibration or a full calibration that provides tools for the user to change settings manually Wide range of available languages Speakeasy works with a variety of languages and dialects For a current list of languages supported by Speakeasy refer to the Wavelink Web Q Chapter 1 Introduction to Speakeasy 2 site To use Speakeasy with languages other than English install the language a k a international build of the TE Client Integration with Avalanche When used with Wavelink Avalanche Speakeasy client side application and configuration files can be easily deployed updated and archived wirelessly Avalanche insures that when a mobile device starts it has the latest application and configuration files Implementing Speakeasy Speakeasy is software installed on a mobile device that can read text aloud to a device user or accept voice commands as text entry It is designed to be used with the Wavelink Terminal Emulation TE Client Use the following steps to set up Speakeasy 1 Decide which emulation processes can be streamlined and made more efficient using either speech
58. rrentRow nNumRows Speech From Text Get Screen Text nCurrentRow 1 FALS nCurrentRow Number Plus nCurrentRow 1 End While End_If Gl If bGetDigits bGetDigits FALSE Button Remove All bButtonsVisible FALSE Chapter 8 Sample Speakeasy Scripts Message Say 1 or more digits 0 szResult Speech To Text szResult connected digits Message Clear szResult String Strip Characters szResult FALSI Keypress String szResult End If GI If bGetState bGetState FALSE Button Remove All bButtonsVisible FALSE Message Say a USA state 0 szResult Speech To Text szResult usa states Message Clear Keypress String szResult End If End While Button Remove All Return Changing Text to Speech Modes 44 When you use text to speech the mode determines if it reads character strings as words or pronounce each letter separately The text to speech mode is configured using the tts readmode setting The following example script demonstrates how to change the text to speech mode working in a voice picking environment The following script also repeats picking information from the screen when the user requests it This scriptis named sapRepeatPrompts and is designed to work with the script available in Acquiring a Pick Quantity in the Industrial Browser on page 46 Script sapRepeatPrompts String strPromptBin String strProm
59. t dialog box allows you to set the grammar files that Speakeasy should listen for when the user is on this screen It also has the options for what Speakeasy should do with the result when it recognizes a word or phrase from any of the specified grammars The actions include w Chapter 3 Using Speakeasy with the Screen Reformatter 15 Print To Screen Run Script Parameters Verify Result Delay Speech to Text to avoid feedback Speech to Text settings to use Displays the result as text on the screen Keypress after result sends a keypress after the result is printed on the screen Instead of displaying the result on a screen Speakeasy will start the specified script Click Edit if you want to launch the script editor Passes the specified parameters to the script when it begins Asks the device user if the result is correct before printing it to the screen If you enable this checkbox the Verify tab appears in the Speech to Text dialog box Use the options on the Verify tab to configure the verification question e Enter a question in the Verification Question text box Use R to represent the speech to text result Enter a grammar name in the Verification Grammar to use text box Enter a response in the Grammar Response if Right text box Enter a response in the Text to Speech if Right text box Enter a response in the Text to Speech if Wrong text box Enter a number in seconds in the Timeout te
60. t in the Grammar File Manager and clicking Edit The grammar file is imported into the Grammar File Manager and you can select it to be downloaded to the device To export a grammar file from the Grammar File Manager 1 Launch the Grammar File Manager 2 Select the grammar file you want to export and click Export 3 The Save As dialog box appears Navigate to the location where you want to save the file and click Save The file is saved as a text file with a bnf extension and can be modified with a text editor or imported using a different Grammar File Manager Editing a Grammar File Grammar files define which words and phrases the Speakeasy engine will recognize To edit a grammar file launch the Grammar File Manager and use the Grammar Editor to make changes Or if you want to edit the grammar file using a text editor such as Notepad export it from the Grammar File Manager perform your edits and import it back into the Grammar File Manager The Grammar File Manager comes with several grammars but you can edit grammar files to contain the words you will use to perform tasks For example if you want to use a voice command to increase the speed of text to speech add the term faster to a grammar file Then use the screen reformatter to run a script for the speech to text result faster that increases the tts rate setting When the user says faster the text to speech speed increases To edit a grammar file 1 Launch the
61. t to speech is pronounced 4 If desired type sample text in the Sample Text box and click Play Sample to check your settings 5 When you have configured the settings click Done The speaker settings wizard disappears and the new speech settings are applied Creating a Voice Profile A voice profile provides the Speakeasy engine with speech samples in order to get more positive results during speech to text You can create a voice profile from the TE Client after Speakeasy is installed Before you create a voice profile you should have the grammar files configured When you configure grammar files you select the specific words and phrases that users will train on to Q Chapter 6 Using Speakeasy 36 create voice profiles For more information on selecting the terms for voice profiles see Specifying Voice Profile Training Options on page 10 Once you have created a voice profile you can use a script to implement the profile For an example script that allows you to enter the username and use a voice profile see Using a Voice Profile on page 42 If you are using an Avalanche Enabler and mobile device server voice profiles are archived on the mobile device server If you enter the same username on a different device the TE Client will automatically retrieve the voice profile from the mobile device server and use it To create a voice profile 1 Ensure that your headset is connected 2 From the TE Client click Options Configur
62. th the device 3 Launch the ActiveSync installation speech to text package by double clicking on the file 4 The Setup Wizard appears Click Next 5 The License Agreement appears Accept the agreement by clicking I Agree 6 The Choose Installation Location screen appears Click Browse to select a different installation location or click Install to use the default location The Speech to text files are installed locally Q Chapter 5 10 Installation and Licensing 28 When the Completing the Setup Wizard screen appears ensure that the Run Wavelink Speech to Text ActiveSync Support checkbox is enabled and click Finish The wizard will close and the Speech to Text Installer will launch From the Languages list select the languages you will be using To choose the grammars that will be installed on the device click Grammar File Manager For more information on managing grammar files see Using the Grammar File Manager on page 3 Click Install to install speech to text on the device When the files are finished installing the Installation Successful screen appears Click OK To install text to speech using ActiveSync 1 2 3 Download the applicable packages from the Wavelink Web site Establish a connection with the device Launch the ActiveSync installation text to speech package by double clicking on the file The Setup Wizard appears Click Next The License Agreement appears Accept the agreement by clicking I
63. than single syllable words improves recognition An example of using an alternate return value could be that when the user says repeat prompts the Speakeasy engine can act like it hears repeat You can also use more than one word or phrase to return the same result This may be especially helpful in a multilingual environment For example you could have an English Chapter 2 Using the Grammar File Manager 9 grammar file that listens for yes and a Dutch grammar file that listens for ja but either grammar would return the result yes Then the script or reformatted screen would only have to be programmed for one result To use an alternate return value list the word or phrase the engine should listen for and then result where result is the alternate return value The following example is the grammar file sapDeliveryEntryCmdAndCtrl bnf viewed in Notepad P sapDeliveryEntryCmdAndcCtrl bnf Notepad File Edit Format View Help BNF EM V1 0 Accepts and returns a repeat back quit and clear value rammar sapbeliveryEntrycmdAndCtr anguage American English E lt Speech gt lt Speech gt fel prompts repeat go back b puit sap clear fields help list help Example of a Grammar File In this example if the user said go back Speakeasy would return the text back However if the user said back it would not match the terms the engine is listening for
64. to text or text to speech Ensure you have the appropriate hardware such as headphones and voice enabled devices Obtain the desired licenses speech to text packages and text to speech packages from Wavelink Install the TE Client and the Speakeasy files on a development computer If you are using speech to text create the list of words or phrases that the device users will need Include the words and phrases in a grammar file If you want to use voice training specify in the grammar files which terms you want to train with Use the screen reformatter and TE scripting to handle the speech elements This may include having the screen read aloud to the user text to speech or using voice commands to return text execute actions and change settings speech to text Install the Speakeasy packages grammar files and scripts on the mobile devices and distribute the licenses to the devices If you implement voice training users will be prompted to perform training when they start to use Speakeasy Chapter 2 Using the Grammar File Manager 3 Chapter 2 Using the Grammar File Manager In order to use speech to text you must configure the grammar files Grammar files define what the Speakeasy engine will recognize For example the digit bnf grammar file allows the engine to recognize when the speaker says any number zero through nine yes please or no thank you Speakeasy comes with several default grammar files that
65. vating Scripts When a script is created it has an activation method assigned that specifies how it is activated Scripts are only available when a session is connected You can have more than one script running at a time This section provides information about activating scripts using each of the Q configurable activation methods Chapter 4 Speakeasy and Scripting 23 NOTE If you plan to call a script from another script a web page or from the screen reformatter you do not need to select an activation method for the script in the Script Editor Select From Menu Activate the script from the Options or Term menu of the TE Client From the Options menu of the TE Client select Scripting gt Execute Script If more than one script is available for the current host profile select which script you want to use from the list Disconnect Session 1 3179 Scripting Execute Script Cancel Script Configure View Start Capture Stop Capture Verify Screen Contents Save Cursor Position E Exit Options Executing Scripts from the Menu From Another Script To use a script to call another script use the following format Call Name of the script argument1 argument2 arugment3 argument4 The arguments are optional and you cannot use more than four of them They can be variables strings Booleans or numbers If the argument is a string it must have quotation marks around it On Key Combinati
66. xt box This is how long the screen reformatter will wait for verification that it repeated the correct result If no verification is received the speech result is discarded and no action is performed Ensures that the microphone ignores input while text to speech actions are happening Enable this option if the device user is not using a headset microphone Changes a speech to text setting Each setting must start with stt and use the format setting value Multiple settings can be specified and should be separated by commas If a value is not a number then the Speech to Text engine will use the value closest to the value text description provided The complete list of settings is available in the Terminal Emulation Scripting Reference Guide Once a setting has been changed that value will be used for future Speech to Text actions until it is changed again The Local Actions and Global Actions tabs in the Speech to Text dialog box allow you to assign actions to specific Speech to Text results A Local Action s settings only apply to the W Chapter 3 Using Speakeasy with the Screen Reformatter 16 current screen Global Actions are shared among all the screens so changing a Global Action for one Speech to Text support action will change the action for all the screens Because the Local Actions take priority over Global Actions you can override a Global Action by creating a Local Action for the same result value For example you could

Speakeasy User Guide

Contents

Download Pdf Manuals

Related Search

Related Contents