Eiiiii |zSRUnPlxil`lY 112
Contents
1. 634 is one component used to connect the motherboard to a POTS telephone system Alternatively modules can interface the motherboard to a cellular or similar telephone system or to a voice over IP US 2012 0056713 Al VoIP system One suitable module is a WMV34 0 TSM 100 from Analog Devices This serial socket modem provides complete worldwide support An Analog Devices serial socket modem features a solid state DAA that supports inter national operation with compliance to international tele phone standards The modem module can be plugged on the carrier board by means of board to board connectors and will be interfaced to the additional serial port available on the motherboard header The socket modem module is powered by 3 3V DC supply and the interfacing signals are in the 3 3V LVTTL level The socket modem module has the connections for a telephone line This connection will be terminated to a RJ11 jack 635 on the carrier board for this purpose The serial port signals in the motherboard are terminated to header COM2 which is in RS232 level A RS232 transceiver inter faces 631 to the modem 634 0248 A standard off the shelf 802 11g WLAN module 632 is available module with USB interface The module can be connected to the USB port available on the mother board header An external antenna may be positioned at the rear panel of the host system for maximum sensitivity Some suitable modules include the Linksys WUSB54GP and Ne2. In the byte mode the given date is displayed as raw data which allows the user to design their own shapes X and Y position coordinates indicate the row and column position on the LCD 0232 The remote control can duplicate the visual opera tion of an on screen display generated by a controlled device using a display on the remote The on screen display interface is designed to provide easy smooth seamless operation of the device However most remotes provide an array of buttons and much different interface than the on screen display Sometimes the array of buttons anticipates that no screen will be available for display Other times the manufacturer over builds the remote control They attempt to expose all of the functionality of the host device through individual keys on the remote The sheer number of keys sometimes pushes con trolled devices into states of operation that are surprising confusing and difficult to undo A high resolution display on the remote control can enhance the user interface For devices that accept keyboard or joystick mouse responses to an on screen display the remote can substantially duplicate the look and feel of the on screen display In this instance substan tially means to the extent allowed by the form factor of the remote display For instance the same HTML code may be differently rendered to the on screen display and the remote display given the different dimensions of the displays 0233 An
3. hope control and receiver transmitter slot timing 0191 The external bus interface includes 0192 8 16 bit data bus 0193 23 bit address bus 0194 Support for 2 memory banks Each bank supports up to 16 Mbytes flash and SRAM with independent timing control for each bank 0195 GPIO can function as additional interrupts 0196 3 dedicated chip selects each with independent timing control 0197 3 indicated interrupt lines 0198 The UART includes 0199 16450 register set compatible UART 0200 9600 19 2K 38 4K 57 61K 115 2K 230 4K 460 8K and 921 6 Kbs UART baud rates 0201 RTS and CTS flow control signals for UART 0202 Direct Memory Access DMA for low overhead UART control Park sniff and hold modes Point to point point to multipoint and scatter Mar 8 2012 0203 The USB support includes 0204 USB version 2 0 compliant interface 0205 USB wakeup and detach sideband signals sup ported 0206 Direct Memory Access DMA for low overhead USB control 0207 The general purpose I O features 0208 Sixteen individually programmable general pur pose I O 0209 Configurable for UART wake up hand shaking 0210 Base band and CPU activity indication 0211 USB UART mode select 0212 Each GPIO can be used as interrupt 0213 The pulse code modulator support includes 0214 PCM interface for audio applications PCM OUT PCM_IN PCM_CLK and 0215 PCM SYNC 0216 Linear u Law
4. 0255 On the console or host system processor side the serial driver initializes and configures the serial port baud rate equal to the modem baud rate An appropriate modem driver is loaded to manipulate the connected socket modem A WLAN module is a port of the Linux WLAN driver adapted to the host board The USB WLAN modules identified from Linksys and NetGear use the same driver Once the WLAN hardware is connected to the USB port it is logically con nected to the access point using the WLAN control utility 0256 A suitable Linux Bluetooth software stack is BlueZ Processing data from the stack involves developing parsing the data received from the remote The communication with Mar 8 2012 the remote is established using the Bluez utilities from the host for remote headset and serial port functionalities Once the application knows the source of the data packet it redi rects the data to the appropriate module for the required functionality The software also provides a facility to send the data to the LCD available on the remote side The application developer can use the fingerprint raw data received from the Bluetooth remote and the authentication code libraries pro vided by the vendor to achieve the matching operation 0257 The console may support the following functions 0258 Bluetooth remote access 0259 WLAN enabled for network communication 0260 Socket modem module for dial up network con nection 0261 The
5. 5 A operating from a 5V input The output 1 8V is fed to the core of the processor PLL voltage The core voltage is the input to the PLL through a ferrite bead which supplies power to clock generation and PLL circuits of the processor 0224 Data sheets publicly available for the major IC com ponents include 1 LPC213x Philips User manual Nov 22 2004 2 Zeevo ZV4301 Datasheet Jan 24 2005 3 P89LPC930 931 Data Sheet Rev 05 15 Dec 2004 0225 4 DDG128032AAD Data sheet Rev 1 0 Issue date Oct 6 2004 5 ITT Cannon Miniature all direction scanning switch Data sheet US 2012 0056713 Al 6 Authentec Fingerprint sensor AES 3400 Data sheet 7 MSM7716 OKI Datasheet Version August 1998 8 AT49BV802A Datasheet Document 3405D Flash March 2005 0226 In addition a camera can be incorporated into the remote thereby enabling video conferencing and other visual features The camera is complemented by a glue logic appli cation supplied for or native to a communications and or multi media console such as one running under Windows OS X or Linux A CMOS camera commercially available for incorporation in camera phones may be suitable for this appli cation This is illustrated in FIG 7 0227 FIG 7 depicts building the digital butler remote board as an XScale processor based solution with a camera module and or memory card reader This remote is built around the Intel XScale micro controller or a digital signal proc
6. Direction control of individual bits 0059 Separate control of output set and clear 0060 All I O default to inputs after reset 0061 TheLPC 2132 memory maps shown in FIG 3 incor porate several distinct regions In addition the CPU interrupt vectors may be re mapped to allow them to reside in either Flash memory by default or on chip static RAM 0062 The vectored interrupt controller VIC accepts all of the interrupt request inputs and categorizes them as FIQ vectored IRQ and non vectored IRQ as defined by program mable setting The programmable assignment scheme means that priorities of interrupts from the various peripherals can be dynamically assigned and adjusted 0063 Fast interrupt request FIQ has the highest priority Ifmore than one request is assigned to FIQ the VIC combines the requests to produce the FIQ signal to the ARM processor The fastest possible FIQ latency is achieved when only one request is classified as FIQ because then the FIQ service routine can simply start dealing with that device But if more than one request is assigned to the FIQ class the FIQ services routine can read a word from the VIC that identifies an FIQ source that is requesting an interrupt Vectored IRAs have middle priority Sixteen of the interrupts can be assigned to this category Any of the interrupt requests can be assigned to any of the 16 vectored IRQ slots among which slot 0 has the highest priority and slot 15 has the lowe
7. and power consumption in power save modes Multiple embedded trace support together with 64 Kbytes KB of serial interfaces including two UART 16C550 246 embedded high speed flash memory 223 A 128 bit wide two Fast I2C bus 400 Kb s 244 SPI and SSP 245 memory interface 211 212 222 and accelerator architec with buffering and variable data length capabilities ture enable 32 bit code execution at maximum clock rate For 0047 Vectored interrupt controller 253 with config critical code size applications an alternate 16 bit thumb urable priorities and vector addresses mode reduces code by more then 30 with minimal perfor 0048 Up to 47 5 V tolerant general purpose UO pins mance penalty Due to their tiny size and low power consump 228 in tiny LQFP64 package tion these micro controllers are typically used for miniatur 0049 Up to nine edge or level sensitive external inter ized applications such as hand held equipment Most rupt pins 224 available peripheral pins can also be remapped as General Purpose 1 0 0050 60 MHz maximum CPU clock available from pins The system includes on chip SRAM of 16 KB 213 and programmable on chip PLL 241 is well suited for communication gateways and protocol con 0051 On chip crystal oscillator with an operating range verters soft modems voice recognition and low end manag of 1 MHz to 30 MHz ing providing both large buffer size and high processing 0052 Power saving modes inc
8. control a console or a combination of console and remote 0271 While the present invention is disclosed by refer ence to the preferred embodiments and examples detailed above it is understood that these examples are intended in an illustrative rather than in a limiting sense It is contemplated that modifications and combinations will readily occur to those skilled in the art which modifications and combinations will be within the spirit of the invention and the scope of the following claims We claim as follows 1 A remote control device with slaved audio reproduction the device including a wireless link transceiver at least one slaved audio output built into the remote con trol a trigger control built into the remote control hardware resources coupled between the wireless link transceiver the slaved audio output and the trigger con trol a stack running on the hardware resources and exchanging packets with a gateway device and a decoder logic running on the hardware resources logi cally coupled to the stack adapted to receive the packets processed by the gateway device into a remote control device format and to decode the remote control device format into signals to drive the slaved output wherein the remote control depends on the gateway device to transcode audio output from VoIP to the remote control device format and relies on the gateway device to respond to control signals sent by the remote control de
9. of the DRM key to exercise DRM evidenced rights When a user visits a neighbor s console they may take along their hand held remote and the associated digital rights for use on the neighbor s console or other device 0030 Another feature that can be combined with any of these embodiments is personalization based on a single action a swipe of the fingerprint reader Coupled wirelessly to the fingerprint sensor software is a personalization module If a user does not identify himself by swiping the fingerprint sensor then a generic profile is applied to personalization of music movies photos videos files and telephone access If Chip Name Main processor 100 Keypad controller 122 LCD Display module 133 Mar 8 2012 the user swipes the fingerprint sensor then personalization can be applied analogous to switching users in current Win dows XP implementations This degree of context shifting based on a single action at a remote control is believed to be new and unique The personalization may include favorite channels movies shows in a streaming video environment favorite music photos or video in an on demand environment approved access to DRM controlled content using one or more keys linked to the fingerprint history of searches recent topics personal interest a la Google Sidebar or Claria Per sonalWeb personal receptiveness to advertising content recently accessed files automatic authenticated access t
10. on screen menu and controls module can render a control interface translating a device menu and controls display that would normally appear on a TV or monitor for reproduction on a display that is part of the remote To imple ment this capability a menu generating device can assemble on screen menus and controls as a separate data stream apart from any video image that the menus and controls overlay The data stream can be supplied both to the device s own US 2012 0056713 Al on screen overlay generator and to a communications module coupled to the remote The remote uses the data stream to render the on screen display in a legible format adapted to the reduced size of a screen on the remote Preferably the menu and control organization format on the remote mimics what the viewer can see on the screen to minimize confusion Technologies such as a subset of HTML and JavaScript allow a designer to specify a menu and control layout in terms that permit rendering to a variety of display sizes Remote display of the on screen menu and control data stream may preempt a video image display or may be overlaid on top of the video image Optionally the device s on screen menu and controls can be supplied to the remote exclusively as a data stream and not as part of a rendered video stream to avoid confusing menus of different sizes Alternatively the on screen menus and controls may just appear on the remote s display as a consequence of bei
11. stream can be supplied both to the device s own on screen overlay generator and to a com munications module coupled to the remote The remote uses the data stream to render the on screen display in a legible format adapted to the reduced size of a screen on the remote Preferably the menu and control organization format on the remote mimics what the viewer can see on the screen to minimize confusion Technologies such as a subset of HTML and JavaScript allow a designer to specify a menu and control layout in terms that permit rendering to a variety of display sizes Remote display of the on screen menu and control data stream may preempt a video image display or may be overlaid US 2012 0056713 Al on top of the video image Optionally the device s on screen menu and controls can be supplied to the remote exclusively as a data stream and not as part of a rendered video stream to avoid confusing menus of different sizes Alternatively the on screen menus and controls may just appear on the remote s display as a consequence of being rendered to a TV or monitor that is reproduced on the remote s display 0025 In any of these embodiments a camera module can be incorporated into the remote thereby enabling video con ferencing and other visual features The camera is comple mented by a glue logic application supplied for or native to a communications and or multi media console such as one running under Windows OS X or Linux To sup
12. up to 4 dBm output power for class 2 amp 3 operation 0169 High sensitive design 86 dBm typically 0170 Class 1 operation is supported with an external power amplifier LNA interface 0171 IF enhanced direct conversion receiver architec ture 0172 Integrated TX Rx switch balun and matching network in an LTCC package 0173 Low power consumption receiver design 0174 Multiplexed RX TX antenna interface 0175 Fully integrated PLL synthesizer and loop fil ter requires external 12 MHZ crystal 0176 The baseband and software features include 0177 Required and optional Bluetooth 1 2 features faster connection extended SCO link adaptive fre quency hopping AFH QOS flow control 0178 Direct memory access DMA for low overhead UART control 0179 Standard Bluetooth HCI interface over UART and USB 0180 Support for a range of Bluetooth data rates 57 6 723 Kb sec 0181 Support for multiple ACL and HC SCO packet types 0182 0183 net 0184 Up to 7 slaves and up to 4 Pico nets supported 0185 u Law A Law and CVSD transcoders on SCO channel 0186 Full 8 to 128 bit encryption 0187 The baseband modem includes 0188 Demodulator modulator RX TX self calibra tion burst timing control and transmitter burst spectral shaping 0189 FEC encoder decoder data whitening encryp tion decryption and cyclic redundancy check 0190 Link controller for synchronization frequency
13. 0068 32kB On Chip Non Volatile Memory LPC2131 gei FIG 3 Patent Application Publication Mar 8 2012 Sheet 4 of 6 US 2012 0056713 Al 10 404 406 Main Proc Keyboard Ctlr Keyboard Matrix LPC 2132 P89LP931 8 return lines x 13 scan lines FIG 4 501 AT49 BV802A 8Mb Flash 141 MSM 7716 OKI codec US 2012 0056713 A1 Mar 8 2012 Sheet 5 of 6 Patent Application Publication JQVIUSLNI IN JAN NU oun ang di Al an open Py au EI gud ASN siepean 4104 Iren 754 gr 0099 GSN Le guoy acy SEI cavoguaniow VT NPON HIM ASN TTId ox mm ue 10 Co WON ug aa gt OJ ASN einpoy Dun UA RISE vum remm Wapoy 184905 an von yga De 019 d Ugda ZAe dsiq d 019 warsAs uod NYI GHY li Co 2007 IN WEI HO Patent Application Publication Mar 8 2012 Sheet 6 of 6 US 2012 0056713 Al INTEL XScale MicroController 732 BLUETOOTH SPI 1 INTERFACE VIDEO 50 Ap CMOS emer Je CAMERA PORT MODULE 751 WiFi 802 11b g USB HOST 133 LCD 2 2 LCD INTERFACE l 320x240 TFT 152 SPEAKER fre 741 AUDIO CODEC PCM ACST e AUDIO JACK HENSE S gr WW QWERT INTERFACE KEYPAD ni FINGER PRINT SPIO INTERFACE GPIO ANALOG INTERFACE 724 3 3 Volts owr 9 Media USB 713 1 2 Volts Reader Adapter Management FI G s 7 Battery Pack 160 770 US 2012 0056713 Al TETHERED DIGITAL BUTLER CONSUMER ELECTRONIC REMOTE CONTROL DEVICE AND METHOD RELA
14. IG 6 is a block diagram of the console 606 The host console of the system may be built on a standard Mini ITX motherboard and an additional add on board to support the features like WAP Bluetooth and a MODEM for PSTN and a PCI VGA Card A standard Mini ITX is available in a 17 cmx17 cm form factor The motherboard and or add on board may include two VGA connectors for example a VGA connector from motherboard 613 and a second VGA con nector using a PCI add on card 614 The design also may include a serial port for external interface 611A and another serial port for a modem 611B two USB ports 612B support for a USB hub an 802 11g WLAN module 632 preferably interoperable with 802 11b with a separately con nected antenna Other console components may include a USB to Bluetooth module 632 with chip antenna a standard PC hard disk drive 623 and DVD drive 624 and an ATX power supply or Mini ITX power module 0246 Motherboard support may include a VIA Eden C3 processor at operating at 1 0 1 5 GHz or another rate inte grated Castle Rock graphics with MPEG 2 decoder option ally an MPEG 4 decoder for video amemory socket such as al DDR266 SODIMM socket a PCI slot two UltraDMA 66 100 133 connectors SATA connectors can be used a 10 100 Base T Ethernet physical connection PS2 mouse and keyboard ports a parallel port an RJ 45 LAN port a serial port two USB 2 0 ports and a VGA port 0247 A socket modem module
15. INE 3 Keybd Return line 3 K131 3 Keybd input 4 P0 3 RET LINE 4 Keybd Return line 4 KBIA Keybd input 5 P0 4 RET LINE 5 Keybd Return line 5 K131 5 Keybd input 6 P0 5 RET LINE 6 Keybd Return line 6 K131 6 Keybd input 7 P0 6 RET LINE 7 Keybd Return line 7 K131 7 Keybd input 8 PO 7 RET LINE 8 Keybd Return line 8 K130 0 Keybd output 1 P2 0 SCAN LINE 1 Keybd Scan line 1 K130 1 Keybd output 2 P2 1 SCAN LINE 2 Keybd Scan line 2 K130 2 Keybd output 3 P2 2 SCAN LINE 3 Keybd Scan line 3 K130 3 Keybd output 4 P2 3 SCAN LINE 4 Keybd Scan line 4 KBOA Keybd output 5 P2 4 SCAN LINE 5 Keybd Scan line 5 K130 5 Keybd output 6 P2 5 SCAN LINE 6 Keybd Scan line 6 K130 6 Keybd output 7 P2 6 SCAN LINE 7 Keybd Scan line 7 K130 7 Keybd output 8 P2 7 SCAN LINE 8 Keybd Scan line 8 K130 8 Keybd output 9 P1 0 SCAN LINE 9 Keybd Scan line 9 K130 9 Keybd output 10 P1 1 SCAN LINE 10 Keybd Scan line 10 K130 10 Keybd output 11 P1 4 SCAN LINE 11 Keybd Scan line 11 K130 11 Keybd output 12 P1 6 SCAN LINE 12 Keybd Scan line 12 K130 12 Keybd output 13 P1 7 SCAN LINE 13 Keybd Scan line 13 0105 On chip power on reset allows operation without external reset components A reset counter and reset glitch suppression circuitry prevent spurious and incomplete resets A software reset function is also available 0106 The keypad 8 13 matrix 406 is connected to the GPIO lines of P89LPC931 micro controller 404 The key pad has 8 return lines and 13 scan lines The return lines are con
16. TED APPLICATIONS 0001 This application is a continuation of U S Pat No 7 907 710 to be issued Mar 15 2011 from application Ser No 12 758 241 filed 12 Apr 2010 by inventor Robert Stepa nian entitled TETHERED DIGITAL BUTLER CON SUMER ELECTRONIC DEVICE AND METHOD which is acontinuation of U S Pat No 7 697 669 filed 2 Oct 2009 which is a continuation of U S Pat No 7 609 824 filed 8 Apr 2009 which is a continuation of U S Pat No 7 542 753 filed 15 Sep 2008 which is in turn a continuation of U S Pat No 7 444 130 filed 18 Aug 2006 which is a continuation in part of U S Pat No 7 389 103 filed Feb 8 2006 which claims the benefit of U S Provisional Application No 60 709 666 filed 19 Aug 19 2005 0002 This application is related to US Design Patent Application Nos 29 236 023 29 236 022 and 29 236 022 filed on Aug 10 2005 by inventors Phoebe Ng Robert Stepa nian and Allison S Conner entitled NAVIGATION BUT TON ARRAY FOR REMOTE CONTROL HOUSING REMOTE CONTROL HOUSING and CONSOLE HOUSING The priority provisional and related design applications are incorporated by reference BACKGROUND OF THE INVENTION 0003 The present invention relates to a tethered digital butler consumer electronics product and method The teth ered digital butler of a price and form factor suitable for consumer electronics markets of developed and developing countries includes a communicat
17. US 20120056713A1 a2 Patent Application Publication o Pub No US 2012 0056713 A1 as United States Stepanian 43 Pub Date Mar 8 2012 54 TETHERED DIGITAL BUTLER CONSUMER ELECTRONIC REMOTE CONTROL DEVICE AND METHOD 75 Inventor Robert Stepanian San Jose CA US 73 Assignee Nexstep Inc San Jose CA US 21 Appl No 13 047 445 22 Filed Mar 14 2011 Related U S Application Data 63 Continuation of application No 12 758 241 filed on Apr 12 2010 now Pat No 7 907 710 which is a continuation of application No 12 572 677 filed on Oct 2 2009 now Pat No 7 697 669 which is a con tinuation of application No 12 420 723 filed on Apr 8 2009 now Pat No 7 609 824 which is a continua tion of application No 12 210 782 filed on Sep 15 2008 now Pat No 7 542 753 which is a continuation of application No 11 465 749 filed on Aug 18 2006 now Pat No 7 444 130 which is a continuation in part of application No 11 350 980 filed on Feb 8 2006 now Pat No 7 389 103 60 Provisional application No 60 709 666 filed on Aug 19 2005 cl SPI HIGH SPEED SENSOR RC KEYPAD POWER FROM CRADLE SUPPLY 36V NI NM BATTERY 3 3V REG BUCK BOOST PARALLEL PORT UARTO Reset Input DEBUG Publication Classification 51 Int Cl G05B 19 02 2006 01 52 BEN ei DEE 340 4 37 57 ABSTRACT The present invention relates to a tethered d
18. and A Law codes supported 0217 Interface to OKI MSM 7732 01 and OKI 7716 codec 0218 Direct Memory Access DMA for low overhead PCM control 0219 A 12 MHZ crystal serves as the primary clock crys tal 0220 FIG 5 shows the ZV4301 to other CPU and periph eral interfaces The ZV4301 is interfaced with the main pro cessor LPC2132 100 through the UART port The 8 Mb Flash memory AT49BV802A 501 is interfaced with ZV4301 through the external bus interface The single rail linear codec 141 is interfaced with the ZV4301 through the PCM interface 0221 Debugging of the remote is supported by JTAG header and BDM header is used in the board for the debug ging purposes This section gives the details of the JTAG header and BDM header 0222 The processor complies with the IEEE 1149 1A JTAG testing standard The JTAG test pins are multiplexed with background debug pins 0223 Thesystem is fed with 5 volts input power The input power is passed through a diode to provide the protection against reverse polarity The power to the digital butler remote comes from an external power supply module The external power supply module will provide power to the remote and for charging the battery The input power is fed through a connector From the 5 volts input the following voltages are derived on the CPU card Processor core voltage The core supply for the processor is generated through a low dropout regulator that can support current up to 1
19. ceive the packets processed by the gateway device into a remote control device format and to decode the remote control device format into signals to drive the slaved outputs wherein the remote control depends on the gateway device to transcode audio and video from a streaming audio and video format to the remote control device format wherein the streaming audio and video format is at least one of MPEG 2 MPEG 4 or IP TV and relies on the gateway device to respond to control signals sent by the remote control device in the packets at least to select among audio and video for the remote control device to receive 12 The remote control device of claim 11 wherein the remote control further depends on the gateway device to transcode audio output from VoIP to the remote control device format 13 The remote control device of claim 11 wherein the remote control further includes a an HTML decoder logic running on the hardware resources that decodes at least a subset of HTML and renders decoded content to the slaved video display 14 The remote control device of claim 13 wherein the HTML decoder logic further decodes at least a subset of JavaScript and executes the JavaScript 15 The remote control device of claim 11 wherein the HTML decoder logic further decodes at least a subset of JavaScript and executes the JavaScript US 2012 0056713 Al Mar 8 2012 13 16 The remote control device of claim 11 wherein the 20 The remote contro
20. cost palm held remote with a novel combination of features that are implemented by logic and resources of the console con nected wirelessly to the palm held remote Tethering the palm held device so that it depends on logic and resources of the console runs against the trends and teachings of the consumer electronics industry and particularly against the trend toward more powerful smartphones 0016 Various novel combinations of features are empha sized in this application One will recognize that the features US 2012 0056713 Al discussed can be combined in many ways while remaining faithful to the tethered digital butler concept 0017 Ina first embodiment of the tethered digital butler the palm held remote allows a user to select among and use logic and resources of a bread box or smaller sized console to authenticate users from a fingerprint reader on the remote to personalize the user s telephone TV viewing media access and internet browsing experiences to connect the user to a telephone network consistent with the user s authentication and to control multi media features such as channel control volume control DVD CD playback control and digitally stored music access and playback In this embodiment the palm held remote integrates at least a fingerprint reader a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigg
21. coupled to the stack adapted to encode signals from the slaved audio input into a remote control audio format and adapted to send audio packets in the remote control audio format to the gateway device wherein the remote control depends on the gateway device to transcode input from the slaved audio input to VoIP from the remote control device format and relies on the gateway device to respond to control signals sent by the remote control device in the packets 8 The remote control device of claim 7 further including a memory card reader coupled to the hardware resources 9 The remote control device of claim 7 wherein the remote control further includes voice recognition logic running on the hardware resources 10 The remote control device of claim 7 wherein the slaved audio input is a microphone 11 A remote control device with slaved audio and video reproduction the device including a wireless link transceiver slaved audio and video outputs including at least one slaved audio output and one slaved video display built into the remote control a trigger control built into the remote control hardware resources coupled between the wireless link transceiver the slaved audio output the slaved video display and the trigger control a stack running on the hardware resources and exchanging packets with a gateway device and a decoder logic running on the hardware resources logi cally coupled to the stack adapted to re
22. ectively pull down resistors are tied to the axis direction contacts while the common contact is tied to the ground or respectively to the power supply potential The change in state interrupts the main LPC2132 processor 100 The output pulse frequency is directly proportional to the moving speed and the direction The pulse frequency is pro cessed by the main processor LPC2132 and the correspond ing PS2 data sent to the host system 0124 Alternatively the ITT Industries Cannon Omni or Vari Point joystick or the Omni or Vari Disk navigation disk can be used instead of a trackball 0125 The AuthenTec EntrePad AES3400 AuthenTec s 3rd generation low power small form factor fingerprint iden tification sensor IC 121 This product combines silicon based image capture with a proprietary sensor control and matching algorithms to deliver ability to acquire ATA fin gerprint images and authentication AuthenTec s EntrePad AES3400 utilizes TruePrint Technology allowing the sensor to look past the easily obscured outer surface of the skin to the living layer below where the unique ridge and valley patterns of the fingerprint originate Trueprint is AuthenTec s unique patented imaging technology During imaging a small near field signal is generated between the IC and the finger s living tissue layer 16 384 individual elements in the sensor matrix form a planar antenna array that receives this signal creating a digital patter
23. er adapted to select and control resources of the console a compact keypad including numeric keys usable for telephone dialing the compact key pad further including alphabetic keys usable for web brows ing The bread box or smaller sized console integrates at least a DVD CD player a network port and logic and resources adapted to authenticate users of the palm held remote and personalize their telephone network connection and their Internet browsing based on fingerprints received from the palm held remote connect telephone features of the palm held remote to the telephone network respond to Internet browsing commands from the palm held remote and display web pages on a monitor or television control channels accessed by a video receiver drive speakers and provide volume control provide playback control for the DVD CD player and access and playback digitally stored music 0018 Ina second embodiment of the tethered digital but ler the palm held remote has fewer components the console supports fewer features thus the combination will be less expensive and more attractive in many markets Remote com ponents then include a speaker microphone and volume con trol adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console and a compact keypad including numeric keys usable for telephone dialing The fingerprint reader is not
24. essor DSP The main processor provides interfaces for the Keypad Joystick 320 240 graphics LCD module fin gerprint sensor Bluetooth SOC WiFi 802 11b g module audio codec camera module and memory card reader The audio codec interfaces with a microphone speaker and head phone for voice utilities Alternatively the microphone speaker and headphone could interface through the Bluetooth module as described in the context of FIG 1 A general USB dongle interface not shown could be provided to allow the user to use the USB port as ifit resided on the host device The USB port of the remote would function as a remote USB connection for the host 0228 From FIG 7 the components include the main pro cessor 700 which couples to the Bluetooth module 732 WiFi module 751 and audio codec 741 The audio codec couples to speaker 752 microphone 751 audio jack 753 The main processor also may couple to a fingerprint sensor 721 and a battery pack 712 A battery charger and power management component 724 such as a cradle couples to a DC power input 713 and charges the battery 712 The main processor also may couple to a camera module 750 a display 733 a keypad 711 and joy stick 723 The camera module may for instance be a 3 mega pixel CMOS component The memory card reader 760 can support one or more memory card formats Currently used memory card formats as of submission of this disclo sure include PC Card CompactFlash I and II Smar
25. face SPI specification 0085 Synchronous serial full duplex communication 0086 Combined SPI master and slave 0087 Maximum data bit rate of one eighth of the input clock rate 0088 The real time clock RTC 247 is designed to pro vide a set of counters to measure time when normal or ideal operating mode is selected The RTC uses little power mak ing it suitable for battery powered systems where the CPU is not running continuously idle mode The features of RTC are described below 0089 Measures the passage of time to maintain a cal endar and clock 0090 Ultra low power design to support battery pow ered systems 0091 Provides seconds minutes hours day month year day of week and the day of year 0092 Programmable reference clock divider allows adjustment of the RTC to match various crystal frequen cies 0093 The 8051 based Philips LPC89LPC931 controller in FIG 4 is suitable for keyboard interface The P89LPC930 931 404 is based on a high performance processor architec ture that executes instructions in two to four clocks six times the rate of standard 80C51 devices Many system level func tions have been incorporated into the P89LPC930 931 in order to reduce component count board space and system cost The P89LPC931 has the following enhanced features 0094 A high performance ARM processor 80C51 CPU provides instruction cycle times of 111 ns to 222 ns for instructions except multiply a
26. ferencing and other visual features Alternatively the remote may be packaged separately from a console and sold to inter act with capabilities of a communications and console set top box multi media PC or other consumer electronics device from a different source such as one running on a Windows OS X or Linux platform with or without telephone capabilities The remote may include a media reader and remote USB port Particular aspects of the present invention are described in the claims specification and drawings BRIEF DESCRIPTION OF THE DRAWINGS 0007 FIG 1 is a block diagram of the digital butler remote 0008 Details of the main processor are depicted in FIG 2 0009 The LPC 2132 memory maps are shown in FIG 3 0010 FIG 4 shows the 8051 based Philips LPC89LPC931 controller 0011 FIG 5 shows the ZV4301 to other CPU and periph eral interfaces 0012 FIG 6 is a block diagram of the console 0013 FIG 7 is an alternative block diagram of the digital butler remote with a CMOS camera module and or memory card reader DETAILED DESCRIPTION 0014 The following detailed description is made with ref erence to the figures Preferred embodiments are described to illustrate the present invention not to limit its scope which is defined by the claims Those of ordinary skill in the art will recognize a variety of equivalent variations on the description that follows 0015 A tethered digital butler produces a low
27. following combinations of hardware and soft ware features are within the scope of this disclosure for pro viding services described Supported by the console one or any combination of the following General Purpose Computer 0262 PVR TV Set Top Box w optional personal video recorder Terrestrial Cable Satellite IP 0263 Messaging console one or any combo Text SMS Webpages Voice Landline cell IP Video Network Port 0264 TV and or Monitor Out Optionally Hard Drive 0265 Media Card Reader non volatile memory CD DVD Writable versions possible Wireless network router 0266 Supported by the hand held remote one or any com bination of the following Fingerprint Optional 0267 Speaker Mic Vol control Display Cursor Control Thumb board Alphanumeric Video Camera Media Reader 0268 USB port 0269 Applied to the following services Communication including Phone LL Cell IP Internet email and text voice video messenger Entertainment including Multimedia apps including TV PVR DVD Video Photo Music Radio and Games US 2012 0056713 Al Productivity apps such as a personal information manager PIM contacts calendar editor Some Particular Embodiments 0270 The present invention may be practiced as a method or device adapted to practice the method The same method can be viewed from the perspective of a console adapted for use with a remote a remote adapted to
28. icro controller which operates in an interrupt mode Here the 8051 acts as a master and the LPC2132 acts as a slave 0238 Fingerprint sensor software uses SPI code on the main controller The fingerprint data will be sent in a particu lar packet format over the wireless link to be processed on the host side Authentec provides a useable appropriate library of routines for fingerprint authentication 0239 Coupled to the fingerprint sensor software is a per sonalization module If a user does not identify himself by swiping the fingerprint sensor then a generic profile is applied to personalization of music movies photos videos files and telephone access If the user swipes the fingerprint sensor then personalization can be applied analogous to switching users in current Windows XP implementations This degree of context shifting based on a single action at a remote control is new in this disclosure The personalization may include favorite channels movies shows in a streaming video environment favorite music photos or video in an on demand environment approved access to DRM controlled content using one or more keys linked to the fingerprint history of searches recent topics personal interest a la Mar 8 2012 Google Sidebar or Claria PersonalWeb recently accessed files automatic authenticated access to communication chan nels linked to the fingerprint such as voice over IP instant messaging web conferencing and e ma
29. igital butler con sumer electronics product and method The tethered digital butler of a price and form factor suitable for consumer elec tronics markets of developed and developing countries includes a communications and multi media console and a wireless remote The remote may resemble a handheld per sonal computer HPC a palm held personal computer PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the consumer elec tronics market In particular this disclosure relates to com bining telephone service device control and optionally a fingerprint reader for easy user identification authorization and personalization As another option a camera can be incorporated into the remote thereby enabling video confer encing and other visual features Alternatively the remote may be packaged separately from a console and sold to inter act with capabilities of a communications and console set top box multi media PC or other consumer electronics device from a different source such as one running on a Windows OS X or Linux platform with or without telephone capabilities The remote may include a media reader and remote USB port ZEEVO 24301 BLUETOOTH 500 Patent Application Publication Mar 8 2012 Sheet 1 of 6 US 2012 0056713 Al SPI HIGH SPEED PARALLEL PORT UARTO 6V NI NM 3 3 3V REG BATTERY N BUCK BO0 Patent Application Publication Ma
30. il electronic wallet access automatically looking up credit card information and other account authorization information and sharing of infor mation by person logged in 0240 The trackball or other pointing device interface module uses sampling techniques to read the ball movement and click button states The outputs of the trackball are con nected to general purpose I O channels The modules sense the state of the general purpose I O s at a predetermined frequency such as 1 kHz 0241 A Bluetooth wireless interface module may be based on Zeevo ZV4301 Bluetooth SOC or a Broadcom or RFMD design with headset and serial port profile SPP firm ware This module is coupled to the main controller through a UART The module is adapted to convey wirelessly a mix of keyboard data trackball data fingerprint sensor data for authentication and data to be displayed on the remote mod ule s display Console Hardware 0242 Introduction 0243 The core component of the console or host system may be a standard mini ITX mother board with ports to add peripherals A USB Bluetooth module and USB WLAN mod ule may be connected to the motherboard through USB ports A display is connected through VGA connector and the socket modem with RJ11 connector is connected through serial port 2 The remaining ports can be used for external interface The wireless remote communicates over Bluetooth with the USB Bluetooth module 0244 Features 0245 F
31. included nor is the alphabetic keypad The logic and resources of the console are reduced accordingly Logic and resources of the console need not authenticate and personalize based on fingerprints or access and playback digitally stored music Internet browsing may be limited or may be supported by an on screen key board 0019 Ina third embodiment of the tethered digital butler the DVD CD player is omitted from the console The features of the palm held remote do not much change but the logic and resources required of the console are reduced 0020 In fourth embodiment the console is implemented on a PC which may be larger than bread box sized This typically would be less desirable as most PCs do not fit a media room d cor and are relatively loud due to fans and hard disk rotation A new generation of PCs such as the Mac Mini presents a small form factor presently 6 5x6 5x2 inches and quiet operation while including enough computing power to function as PC 0021 In a fifth embodiment the remote is emphasized One aspect of the remote is to provide a complete I O plat form in the palm of the user s hand Features adaptable to VoIP and or video phone operation such as a microphone can be used for other purposes such as dictation note taking Mar 8 2012 voice messaging listening to music or remote viewing video To support the high demands of streaming video a broader communications channel such as Bluetooth ver
32. ions and multi media con sole anda wireless remote The remote may resemble a hand held personal computer HPC a palm held personal com puter PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the con sumer electronics market In particular this disclosure relates to combining telephone service device control and option ally a fingerprint reader for easy user identification authori zation and personalization The remote may be packaged separately from a console and sold to interact with capabili ties of a communications and multi media console from a different source such as one running on a Windows OS X or Linux platform 0004 Convergence of digital devices is not unbounded because it is guided by market realities Many concepts are floated as trial balloons that burst never to see an enabling development effort or a reduction to practice Some conver gence trends are strong and noteworthy Cellular smartphones or business phones such as Treo or Blackberry products are becoming powerful and supplanting separate PDAs These smartphones go with the user across a cellular network and even overseas They are untethered packing many features into a small form factor not requiring a console Another trend is to repackage a PC as media center complete with a wireless keyboard Recent announcements suggest interfac ing a Microsoft media center with a Bluetooth equipped cel lu
33. l device of claim 11 further includ remote control further receives steaming media directly from ing a server a digital rights management port coupled to the hardware 17 The remote control device of claim 11 further includ resources and adapted to couple electrically with a device that stores a DRM key and a DRM logic running on the hardware resources logically coupled to the stack adapted to exchange with the gate way device messages related to the DRM key when coupled to the digital rights management port ing amemory card reader coupled to the hardware resources 18 The remote control device of claim 13 wherein the memory card reader is presented by the remote control device to the gateway device as local to the gateway device 19 The remote control device of claim 11 wherein the slaved audio output is a speaker 5 Re
34. lar telephone to use the sound reproduction of a TV as a sort of speaker phone relying on the cellular telephone for net work connectivity In both instances the telephone features are untethered from and do not depend on availability of a console Mar 8 2012 0005 For developing countries and cost conscious buy ers the Treo and media center approaches are over built and too expensive An opportunity arises to provide a low cost integrated consumer electronics system that includes a novel feature set and a cost effective allocation of technical tasks between a remote and a console SUMMARY OF THE INVENTION 0006 The present invention relates to a tethered digital butler consumer electronics product and method The teth ered digital butler of a price and form factor suitable for consumer electronics markets of developed and developing countries includes a communications and multi media con sole and a wireless remote The remote may resemble a hand held personal computer HPC a palm held personal com puter PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the con sumer electronics market In particular this disclosure relates to combining telephone service device control and option ally a fingerprint reader for easy user identification authori zation and personalization As another option a camera can be incorporated into the remote thereby enabling video con
35. ll the data link and packet type fields the checksum field can be used to discard corrupted data packets 0230 Audio support enables the remote to act as a remote speaker and or microphone system for the host system Audio support can be for mono stereo or other advanced sound reproduction modes The audio can function in an on the ear mode e g like a telephone headset with a headset or as a speaker phone These audio features can enable telephonic capabilities for voice place shifting audio from the host loca tion to another room or floor in a home private listening via a wired or wireless headset and multiple stream playback so that the audio reproduced at the remote is different from the audio reproduced on speakers wired to the host 0231 The LCD connected to the main controller uses the GPIO interface including data and control lines The LCD can be used to display data received over the wireless link The data could be received in an HTML or HTML subset format and rendered by a compact browser module Or a custom designed packet format could be used for LCD data This format includes eight fields start of packet packet type link mode x position y position data and checksum The mode field indicates the mode in which the data is to be displayed This module operates in two modes a so called font mode and a byte mode Ina phone mode the given string is displayed on the LCD display in the predefined font shape and size
36. lude idle and Power power Various 32 bit timers 247 248 10 bit 8 channel ADC s 226 10 bit DAC 227 PWM channels 225 and 47 GPIO lines 228 with up to nine edge or level sensitive external interrupt pins make these microcontrollers particu larly suitable for industrial control and hand held systems 0041 The integrated ARM microprocessor operates at 60 MHz and in one embodiment supports the following fea tures 0042 16 32 bit ARM7TDMI S microcontroller 232 in a tiny LQFP64 package 8 16 32 KB of on chip static V 10 with 5 V tolerant I O pads RAM 213 and 64 512 KB of on chip Flash program A memory 223 A 128 bit wide interface accelerator 0057 The LPC 2132 s 64 KB of flash memory 223 may 211 212 222 enables high speed 60 MHz operation be used for both code and data storage Programming of the EC i flash memory may be accomplished in several ways It may be programmed in the system via the serial port 245 The application program may also erase and or program the flash while the application is running allowing flexibility for data storage field firm grade upgrades etc While the on chip boot loader is used 64 KB flash memory is available for user code ware and high speed tracing of instruction EE The LPC2132 flash memory provides a minimum of 100 000 One 8 channel 10 bit Al D converters 226 pr ovides a erase write cycles and 20 years of data retention On chip total ofup to 16 anal
37. n that accurately reproduces the fingerprint s underlying structure A powerful utility within TruePrint is Dynamic Optimization This tool analyzes each image con trolling up to 15 sensor parameters to optimize the fingerprint image regardless of unusual skin conditions or surface con tamination The TruePrint high quality fingerprint imaging technology enables reliable authentication 0126 The fingerprint sensor is small battery friendly and well suited to Bluetooth communications These sensors automatically generate interrupts and reduce system over head needed for finger detection 0127 Features of the fingerprint component in one embodiment include 0128 TruePrint technology for ability to acquire ATA 0129 Compact industry standard 100 Pin LQFP Pack age 0130 High definition 128x128 TruePrint technology based pixel array 0131 500 pixels per inch ppi 0132 Extended Range 2 7V to 3 6V single power sup ply 0133 0 C to 70 C operating temperature range 0134 Easy to integrate USB 2 0 full speed synchro nous amp asynchronous serial amp 8 bit parallel system interfaces Mar 8 2012 0135 6 or 12 MHz operation with crystal or supplied clock input 0136 USB selective suspend support 0137 Ultra hard surface coating 0138 1 million rubs w o degradation 0139 Highly scratch resistant 0140 IEC 61000 4 2 level 3 ESD capability 8 KV 0141 Built in low power finger detec
38. nd divide when executing at 18 MHz This is six times the performance of the standard 80C51 running at the same clock frequency A lower clock frequency for the same performance results in power savings and reduced EMI 0095 2 4 V to 3 6 V VDD operating range I O pins are 5 V tolerant 0096 8 kB flash code memory with 1 kB sectors and 64 byte page size US 2012 0056713 Al 0097 Byte erase allowing code memory to be used for data storage 0098 Flash program operation completes in 2 ms 0099 256 byte RAM data memory 0100 Real time clock that can also be used as a system timer 0101 Enhanced UART with fractional baud rate gen erator break detect framing error detection automatic address detection and versatile interrupt capabilities 0102 400 kHz byte wide 12C bus communication port 0103 Eight keypad interrupt inputs plus two additional external interrupt inputs Mar 8 2012 0109 The following tables describe interfaces among the CPU 100 keyboard controller 404 and matrix 406 Keyboard Controller to CPU Interface Signal LPC2132 P89LPC93 Remarks Serial I2C Data SDA SDA I2C interface Serial DC clock SCL SCL I2C interface 0104 Four interrupt priority levels Keyboard Controller to Matrix Interface P89LPC93 Signal Signal Name key board Remarks K131 0 Keybd input 1 P0 0 RET LINE 1 Keybd Return line 1 KBI 1 Keybd input 2 PO 1 RETLINE2 Keybd Return line 2 K131 2 Keybd input 3 DNK RET L
39. nected to the keyboard port of the P89LPC931 micro controller The P89LPC931 is connected to the main proces sor LPC2132 through the 12C bus to minimize the number of pins on the main processor 0107 The custom software is loaded into the flash pro gram memory of the P89LPC931 micro controller which scans the keypad and generates ASCII codes and communi cates to the main processor through the I2C bus The P89LPC931 micro controller is normally kept in power save mode and it will awaken in response to keyboard interrupts after the key press The keyboard port of P89LPC931 has a change on status interrupt feature and hence any key press will generate the keyboard interrupt The key bounces are taken care of by the software 0108 The QWERTY keyboard may have a Chinese char acter entry feature and the software transfers the Chinese corresponding ASCII codes to the main processor in Chinese key entry mode 0110 The LCD display 133 DD12803AAD in one embodiment is a 128 32 dot matrix LCD module The LCD Module can be easily accessed via parallel micro controller GPIO interface Its features include 0111 Transflective display mode and positive type B W mode FSTN LCD 0112 Graphic 128 32 dot matrix display format 0113 Parallel input data from micro controller 0114 1 33 duty multiplexing ratio 0115 1 16 bias 0116 6 o clock viewing direction 0117 Dimension outline 35 W 28 9 H 1 75 D mm 0118 Resol
40. ng rendered to a TV or monitor that is reproduced on the remote s display 0234 One of skill in the art will recognize that a display in the palm of the hand will be useful to many people because it reduces demands for eye hand coordination and short term memory The form factor is convenient A single remote can control for many devices Depending on the features com bined into the remote varying complexity can be delivered at varying prices 0235 The on screen display module can be more or less stateful JavaScript for instance can be used to keep track of the user s intermediate selections until they are sent to the host Or a Java or similar application could replicate the states of the host More simply the display could be essen tially stateless and rerendered by the host after each data transfer from the remote to the host 0236 The form factor of the remote display could alterna tively bea full display with touch sensitive areas and rendered buttons that provide visual and or audio feedback as opposed to the tactile feedback of pressed buttons 0237 The keyboard module of the remote is implemented using an 8051 The key press data is sent to the main micro controller through an DC interface for further processing The keyboard is a matrix keyboard including 13 scan lines and eight return lines A key press causes the 8051 to generate make and break codes along with key press values This data is given to the main m
41. o communication channels linked to the fingerprint such as voice over IP instant messaging web conferencing and e mail electronic wallet access automatically looking up credit card information and other account authorization infor mation and sharing of information by person logged in 0031 The console may be equipped with a remote locator control button that causes the remote to emit a tone which makes it easier to locate 0032 The form factor of a palm held remote should be easily recognized 0033 The form factor of a bread box or smaller sized console can be judged by volume A smallish consumer elec tronics component uses an enclosure from which connectors and feet protrude that is 12 by 15 by 3 inches and has a volume of 540 cubic inches This is an approximately bread box sized enclosure although the shape differs from a loaf of bread Remote Hardware 0034 Introduction 0035 The digital butler remote is a gadget based on the Bluetooth or another wireless technology used for communi cations and remote control applications 0036 Features 0037 The digital butler remote board is an ARM7 proces sor based solution 0038 This remote is built around the Philips LPC2132 ARM controller The main processor provides interfaces for the Keypad Trackball or other pointing device 128 32 graphics LCD module fingerprint sensor and Bluetooth SOC The Bluetooth SOC and Zeevo ZV 4301 interface with a microphone speake
42. og inputs with conversion times as static RAM 213 may be used for code and or data storage down 0053 Individual enable disable of peripheral functions as well as peripheral clock scaling down for additional power optimization 0054 Processor wake up from Power down mode via external interrupt 224 0055 Single power supply chip with POR and BOD circuits 0056 CPU operating voltage range of3 0 V to 36 V 33 0043 In System In Application Programming ISP IAP via on chip boot loader software Single Flash sec tor or full chip erase in 400 ms and programming of 256 bytes in 1 Ms Embedded Trace interfaces 231 offer real time debugging with the on chip real monitor soft low as 244 us per channel The SRAM may be accessed as 8 bits 16 bits or 32 bits wide 0044 Single 10 bit D A converter 227 provides vari General purpose parallel I O is supported by device pins that able analog output are connected to a specific peripheral function are controlled 0045 Two 32 bit timers counters with four capture by the GPIO registers Pins may be dynamically configured as and four compare channels each 225 PWM unit six inputs or outputs Separate registers allow setting or clearing outputs 225 and watchdog 248 any number of outputs simultaneously The value of the out US 2012 0056713 Al put register may be read back as well as the current state of the port pins The GPIO lines have the following features 0058
43. on whether the chip has to initiate a data transfer or is only addressed DC is a multi master bus that can be controlled by more than one bus master connected to it 0073 DC implemented in LPC2132 support bit rate up to 400 kbit s Fast DCH The features of LPC2132 DC bus is listed below Mar 8 2012 0074 Standard I2C compliant bus interface 0075 Easy to configure as master slave or line select master or slave 0076 Programming clocks allow versatile rate control 0077 Bi directional data transfer between masters and slaves 0078 Multi master bus no center master 0079 Arbitration between simultaneously transmitting masters without corruption of serial data on the bus 0080 Serial clock synchronization allows devices with different bit rates to communicate via one serial bus 0081 Serial clock synchronization can be used as a hand shack mechanism to suspend and resume serial transfer 0082 The DC bus may be used for test diagnostics purposes 0083 The SPI 245 is a full duplex serial I O interface designed to be able to handle multiple masters and slaves connected to a given bus A single master and a single slave communicate on the interface during a given data transfer During a data transfer the master always sends a byte of data to the slave and the slave always sends a byte of data to the master The features of the SPI controller is listed below 0084 Compliant with serial peripheral inter
44. port full motion video Bluetooth version 2 or later or a wireless Eth ernet protocol may be used to supply the required bandwidth 0026 As a further aspect of these embodiments the con sole may be equipped with a non volatile memory sized to time shift playback from the video receiver and its logic and resources are further adapted to provide a menu of upcoming video content schedule recording of the video content and replay the video content Alternatively the non volatile memory may be sized to hold a library of digital music 0027 The VO platform in the palm of our hand concept can be enhanced by adding a memory card reader to the remote One or more of the many memory card formats now in use or as may be developed in the future can be accommo dated 0028 Another form of I O is provided through a USB or Firewire port The remote may integrate a USB connector and port or similar Firewire support Glue logic running on the host device may be adapted to treat the USB or Firewire port as if it were local to a machine being accessed using the remote 0029 In another aspect of these embodiments the remote may hold a DRM key and automatically deliver the key to DRM enabled device Either memory on the remote a memory module or an identification reader combined with the remote may hold the DRM key The identification reader can read a smart card or similar module with memory or can read a fingerprint in order to authorize automatic use
45. r 8 2012 Sheet 2 of 6 US 2012 0056713 Al i Katar aler At E wm A TASTI TMS TCK TOT um 231 Test Debug Interface 232 ARMTTDMI S FIG 2 211 ARM Local Bus intemal SRAM 1 Controller 212 Internal Flash Controller 233 AHB Bridge 237 k Divider 6 16 32 kB 8 16 12 kB i SRAM FLASH i 213 223 A Peripheral Bus 7 on EINT30 External PC Serial Interrupts oul Interfaces and 1 2081 8x CAPD aam Se By MAT un SCKO 1 245 mam Kc Serial Interfaces gen EROS AD070 e 2 op du onverters ADL TO SN DSNIZ CTSIL RATSIE i DTRI2 OCDI2 RO A vi L HUE eal Time D A Converter 1 P0 31 0 228 248 eneral Watchdog P1 31 16 10 Purpose 1 0 Timer 229 249 PWM6 1 PWM System Control Patent Application Publication Mar 8 2012 Sheet 3 of 6 US 2012 0056713 Al 40GB OXFFFF FFFF AHB Peripherals 3 75 GB 0xF000 0000 VPB Peripherals 3 5 GB 0xE000 0000 0xC000 0000 Reserved Address Space 2 0 GB 0x8000 0000 Boot Block re mapped from On Chip Flash memory i Reserved Address Space 0x4000 8000 BKB On Chip Static RAM LPC2131 Wi 1 0 GB 0x400 080 3 0x4000 7FFF 32KB On Chip Static RAM LPC2138 bo 400 16kB On Chip Static RAM LPC2132 ny4000 2000 0 1FFF 0 0000 Reserved Address Space 0x0008 0000 512KB On Chip Non Volatile Memory LPC2138 Hayy iit 64kB On Chip Non Volatile Memory LPC2132 are Chip Non LPC2131 0x0000 7FFF
46. r and headphone for voice utilities The system may use a Philips 89LPC931 controller for the keypad interface through a 12C Bus Alternative hardware configu rations are illustrated in FIGS 7 and 8 0039 FIG 1 is a block diagram of the digital butler remote Embodiment Details Chip number Description LPC2132 Philips Main CPU 60 MHz 64 Kb flash 16 Kb SRAM 89LPC931 Philips 8051 MCU compatible with 8 KB flash 12C interface DDG128032AAD DDTL 128 32 graphics parallel serial LCD Module US 2012 0056713 Al Mar 8 2012 4 continued Embodiment Details Chip Name Chip number Description TrackBall 123 TBWB2A00 ITT Miniature all directional scanning switch Industries Cannon Omni or Vari Point or Omni or Vari Disk devices ITT Industries Cannon Fingertip sensor 121 AES3400 Authentech Fingertip sensor with SPI interfaces Bluetooth SOC 132 ZV4301 Zeevo or Bluetooth SOC with UART interface equivalent by Broadcom or RSMD Flash Memory 131 AT49BV802A Atmel Bluetooth SOC Flash 8 Mb Codec IC 141 MSM7716 OKI Single rail codec Power Supply 113 LTC 3440EDD Linear Micro power synchronous 600 ma Buck Technology Boost De DC converter 0040 Additional details of the main processor are 0046 Real time clock 247 equipped with indepen depicted in FIG 2 The LPC2132 100 is based on a 32 16 dent power and clock supply permitting extremely low bit ARM7TDMI S CPU 232 with real time emulation
47. sion 2 or later or 802 11n and a more powerful processor are included The remote may function in tandem with a console PC or set top cable or satellite box It also could be configured to control other consumer electronics device such as a TV IP TV home theater system component stereo digital video recorder DVD player or recorder VCR etc It can receive streaming media directly from a server The palm held remote may be combined with a glue logic application that enables a console PC set top box or other consumer electronics device to utilize the special purpose controls of the remote The remote may be adapted to invoke a glue logic application supplied for or native to acommunications and or multi media console such as one running under Windows OS X or Linux 0022 Ina sixth embodiment a remote control for a gate way device t is coupled to multimedia and communication resources The gateway device including logic and resources to process wireless input and provide access to the multime dia and communication resources The remote control includes a palm held remote adapted to invoke glue logic running on the gateway device by wirelessly directing input to the gateway device It integrates at least a speaker and volume control adapted for use as a remote speaker a fingerprint reader and a cursor control and trigger adapted to select and control resources of the console Glue logic invoked wire lessly by the remote control is adap
48. st Non vectored IRQ s have the lowest priority 0064 The VIC combines the requests from all the vec tored and non vectored IRAs to produce the IRQ signal to the ARM processor The IRQ service routine can start by reading the register from the VIC and jumping there If any of the vectored IRAs are requested the VIC provides the address of the highest priority requesting IRAs service routine other wise it provides the address of a default routine that is shared by all the non vectored IRAs The default routine can read another VIC register to see what IRAs are active 0065 The LPC 2132 contains two UARTs 246 One UART provides a full modem control handshake interface the other provides only transmit and receive data lines The features of UART is listed below 0066 16 byte receive and transmit FIFO s 0067 Register locations conform to 550 industry stan dard 0068 Receiver FIFO trigger points at 1 4 8 and 14 bytes 0069 Built in baud rate generator 0070 Standard modem interface signals included on UART 1 0071 DC 244 is a bi directional bus for inter IC control using only two wires a serial clock line SCL and a serial data line SDA Each device is recognized by a unique address and can operate as either a receiver only device or a transmitter with the capability both to receive and send infor mation 0072 Transmitters and or receivers can operate in either master or slave mode depending
49. stack software and Bluetooth profiles available from Zeevo s extensive part ner list 0146 The Zeevo4301 typical application supports AV equipment smart phones personal digital assistants printers cellular peripherals access points and industry controls Fea tures include 0147 Bluetooth 1 2 compliant 0148 High bandwidth ARM7TDM1 processor sub system 0149 12 24 and 48 MHz CPU clocks selectable on chip PLL from single 12 MHz input 0150 Highly integrated low cost solution Radio link control and CPU are integrated 0151 High throughput 0152 Tested qualified software stack available 0153 Support for very low power modes sleep and deep sleep 0154 Audio capability on an SCO channel 0155 On chip crystal tuning and power calibration 0156 Complete co location and co existence solutions with 802 11 supported through AWMA AFH and SFH 0157 The CPU and memory support include 0158 ARM7TDMI processor core 0159 12 24 and 48 MHz operation 0160 32 16 bit RISC architecture 32 bit ARM instruc tion 0161 16 bit Thumb instruction set for increased code density 0162 32 bit ALU and high performance multiplier US 2012 0056713 Al 0163 0164 0165 Extensive debug facilities J TAG 8 K bytes of boot ROM 64 K bytes of SRAM 0166 The radio features include 0167 Integrated RF interface connects directly to antenna 0168 Integrated power amplifier supports
50. t Gear WG111 These modules are interoperable with 802 11b A WLAN module may be an alternative to a Bluetooth module for communications with the remote or can provide a network interface for the console 0249 A standard off the shelf Bluetooth module 633 is available module with USB interface The module may be connected to the USB port available on the motherboard header The module will be connected to the host system by the USB port available on the motherboard header The mod ules built around CSR chipset may be suitable 0250 The power supply used may be a standard mini ITX power supply A standard 12 volts DC power module also can be used for this purpose The power supply board includes DC DC converters to provide output voltages of 12V 12V 3 3V and 5V DC similar to an ATX power supply These power supply tapping is used in the carrier board to supply power to the add on modules such as socket modem WLAN and Bluetooth modules Console Software 0251 Introduction 0252 A Linux core runs on the VIA Eden processor The module drivers loaded on the OS core takes control the peripheral devices A dedicated software application running parses data received wirelessly such as over Bluetooth It also redirects the data to corresponding modules 0253 Modules 0254 The modem connected with the host system moth erboard is used to make the dial up connections This makes the socket modem module as a portable one
51. tMedia Memory Stick Memory Stick Duo and Micro M2 Multime dia regular reduced size and micro Secure digital regular mini and micro xD Picture card and u card The main pro cessor 700 provides an array of ports for interfacing with these various components While currently available compo nents are generally identified such as by resolution or wire less standard one of skill in the art will recognize that these components will evolve over the 20 year life of a patent Remote Software 0229 Software components of the palm held remote include an LCD interface module a keyboard interface mod ule a fingerprint sensor module trackball or other directional device interface module and a Bluetooth module Other wire less protocols such as IEEE 802 1 x protocols can be substi tuted for Bluetooth Wireless protocols developed for cord less telephones also might be used Data is transmitted and received over Bluetooth or another wireless connection between the console and the palm held remote in a custom data format In this format a record may have fields including Mar 8 2012 start of packet packet type links data and checksum Differ ent packet types are assigned to keyboard trackball finger print and LCD packets The start of packet field indicates that the packet starts here For instance 0x7C can be used as a start of packet flag A data field of just two bytes may be sufficient When the checksum contains an XOR of a
52. ted to connect the speaker to a sound reproduction module and connect the fingerprint reader to an authentication and personalization module that selects a user profile based on activation of the fingerprint reader and authentication of the user The personalization module adapted to present the user s personalized favorite media access present the user s personalized history lists automatically authenticate the user for digital rights manage ment automatically authenticate the user for communication access and automatically authenticate the user for electronic wallet reproduction of purchasing credentials 0023 Analternative to video operation of a camera is still operation of the camera The still camera may be wirelessly coupled to a photographic capture module running on another device which persists the pictures taken The persistence at the other device can simplify the remote and reduce its cost as only temporary buffering in the remote is needed 0024 An aspect of this disclosure that can be combined with any of the foregoing embodiments is remote on screen menu and controls display translating a device menu and controls display that would normally appear on a TV or monitor for reproduction on a display that is part of the remote To implement this capability a menu generating device can assemble on screen menus and controls as sepa rate data stream apart from any video image that the menus and controls overlay The data
53. tion w system interrupt capability 0142 Low power operation lt 6 mW imaging event 0143 The interface of these fingertip sensors is pin selectable choices The SPI interface finger chip sensor is selected so that the finger tip sensor is connected to the SPI port 245 of the main processor 0144 The Zeevo ZV4301 in FIG 5 used in one embodi ment is a Bluetooth SOC adapted to provide a high bandwidth CPU system to add wireless connectivity to their product The ZV 4301 502 incorporates the industry standard 32 bit ARM7TDMI CPU core with high bandwidth processing capability sufficient to support a wide range of embedded applications The ZV 4301 operates from 25 C to 85 C and comes in a lead free version The ZV4301 is implemented in a 0 18 micro meter CMOS process and includes the integra tion of all RF components and digital circuitry The only external components needed are an antenna crystal refer ence resister decoupling capacitors and flash memory The ZV4301 is designed for low power applications including sleep and deep sleep modes and operates from a single 3 3V supply The ZV4301 is manufactured in an 8 6x8 6x1 65 mm LTCC BGA package with 100 balls 0145 The ZV4301 is supplied with a link library for a complete lower layer protocol stack and source code to the blueOS operating system target manager and link manager API Upper layers are supported through the Zeevo partner program with firmware Bluetooth protocol
54. ution 128 32 dots 0119 Active area 29 66 W 8 45 W mm 0120 Dots pitch 0 232 W 0 265 H mm 0121 Dots size 0 202 W 0 235 H mm 0122 The ITT Industries Cannon TBWB2A00 trackball 123 is a miniature all directional scanning switch developed for mobile remote PDA notebook PC and hand held device applications It includes two perpendicular rollers actuated by friction on the ball and two spring contacts which generate by contact closing and opening the electrical pulses and a light tactile effect click at each pulse A switch called Select is integrated in the trackball Optimally two LEDs US 2012 0056713 Al can be included with the trackball and driven according to the wishes of the user Several tactile effects can be obtained according to the number of tooth integrated in the gear axle the standard resolution is 12 pulses per ball rotation When the Trackball is activated its relative position changes are ana lyzed in two directions X and Y The two perpendicular rollers are actuated by friction on the ball During their revolution the rollers activate two spring contacts which generate by contact closing and opening the electrical pulses 0123 To track the ball movements a simple electronic device tied to the direction contacts converts the vertical and horizontal displacements of the both perpendicular rollers in logical levels of X axis and Y axis displacements Some pull up resistors or resp
55. vice in the packets 2 The remote control device of claim 1 further including a memory card reader coupled to the hardware resources 3 The remote control device of claim 2 wherein the memory card reader is presented by the remote control device to the gateway device as local to the gateway device 4 The remote control device of claim 1 wherein the slaved audio output is a speaker 5 The remote control device of claim 1 further including a digital rights management port coupled to the hardware resources and adapted to couple electrically with a device that stores a DRM key and a DRM logic running on the hardware resources logically coupled to the stack adapted to exchange with the gate way device messages related to the DRM key when coupled to the digital rights management port 6 The remote control device of claim 5 wherein the digital rights management port is a memory stick reader 7 A remote control device with slaved audio input the device including a wireless link transceiver at least one slaved audio input built into the remote control a trigger control built into the remote control hardware resources coupled between the wireless link transceiver the digital rights management port the slaved audio input and the trigger control Mar 8 2012 a stack running on the hardware resources and exchanging packets with a gateway device and an encoder logic running on the hardware resources logi cally
Download Pdf Manuals
Related Search