Home

Stepanian

1. amas ono pgoipcasi pu jen pmi 152 msan eri KEYBOARD 0c gt suero so vai ni wa SPEAKER 558 i CONTROLLER H Laici KEYPAD LPC 2132 pom i Le gt HEAD PHONE LA Lo 125 i TRACK BALL yet p FROM wa u2 124 CRADLE SUPPL ria i cim 36VNENM LL 33V REG Debug yA BATTERY asus amit Reset Input DEBUG header bee Ld i mm s i E FIG 1 N ses 7 GPIO 2 EXT INT GPIO n LCD MODULE m Ww d L orm caste Patent Application Publication Feb 22 2007 Sheet 2 of 6 242 213 M P ae 233 ARM Loca Bus Tiniemal SRAM Controller tore kB k SRAM 223 i LU o ammo Extemal i sr Interrupis i 225 1 i Capture Compare fw extemal clock 4 g TIMER BD amp 1 22 6 Li AUD Converters Band 13 2 27 DIA Converter 228 LI 1 1 1 Li 1 1 ia FUILI 1 Lie gl Marc uu General Purpose NO i 2 2 9 LI t LI t HT t t i PME FIG 2 232 iena ire a ARMTTDMI S Ed 55 211 Meera i vacates ners Certraier US 2007 0042767 A1 100 AMBA AHE Advances igt pernemance Bus VPB VPB LSI Peripheral Susi 24H m 3 sc Du FO Serial SU x Interfaces 0 and 1 SOAG I STKO SPI and S37 MOGI Ezrisl Interfaces meos i 246 Tei aj Bx DI 1 USRTOS amp T SSRIS RESTA oiii Ocoee er 247 RIXC i Real Time RATHI Clock cm 1 24g 249 Pate
2. 60 Provisional application No 60 709 666 filed on Aug the remote may be packaged separately from a console and 19 2005 sold to interact with capabilities of a communications and console set top box multi media PC or other consumer Publication Classification electronics device from a different source such as one running on a Windows OS X or Linux platform with or 51 Int CI without telephone capabilities The remote may include a H04M 3 00 2006 01 media reader and remote USB port a Lud eda JM SPI HIGH SPEED PARALLEL PORT i d PB9LPC931 EP KEYBOARD si 12C i ommum CONTROLLER IL i KEYPAD munit i LPC 2132 je si l i GPIO j TRACK BALL pe EXT INT m POWER FROM CRADLE SUPPL ie 124 3 6V Mid b gt BATER BUCK BOOST j Reset Input ies sata tn UARTO GPIO DEBUG 1 8Mb Flash i T x illt ISI AT MIC J wwe 182 BLUETOOTH sod I ameti temo saec can naa Paid HEAD PHONE 153 L TEN ie 153 SE n enne 5 1 i i 4 i i H r i Dans ZW4301 i Senf mri Codec i d pria header I NT 4 o9 ge a Lo Patent Application Publication Feb 22 2007 Sheet 1 of 6 US 2007 0042767 A1 12 1 poc i FINGER 3 swbFlash CHIP Pan SPI HIGH SPEED i TI Seusog LE PARALLEL PORT i 1 ll i51 comi UARTO 12 i E 132 p f asan YA i cn M Mic
3. 611A and another serial port for a modem 611B two USB ports 612B support for a USB hub an 802 11g WLAN module 632 preferably interoperable with 802 11b with a separately connected antenna Other console components may include a USB to Bluetooth module 632 with chip antenna a standard PC hard disk drive 623 and DVD drive 624 and an ATX power supply or Mini ITX power module 0253 Motherboard support may include a VIA Eden C3 processor at operating at 1 0 1 5 GHz or another rate integrated Castle Rock graphics with MPEG 2 decoder optionally an MPEG 4 decoder for video a memory socket such as al DDR266 SODIMM socket a PCI slot two UItraDMA 66 100 133 connectors SATA connectors can be used a 10 100 Base T Ethernet physical connection PS2 mouse and keyboard ports a parallel port an RJ 45 LAN port a serial port two USB 2 0 ports and a VGA port 0254 A socket modem module 634 is one component used to connect the motherboard to a POTS telephone system Alternatively modules can interface the mother board to a cellular or similar telephone system or to a voice over IP VoIP system One suitable module is a WMV34 0 TSM 100 from Analog Devices This serial socket modem provides complete worldwide support An Analog Devices serial socket modem features a solid state DAA that supports international operation with compliance to international telephone standards The modem module can be plugged on the carrier board
4. SIBPES ZSd i peog i uo QSNVOS3H LO IA hio Z vod aen uod esnowW ZSd Hod ASN Joyoauuog J0 98UUGZ pod eues VON VOA l i hi9 219 32V JL NI WNYALXS V219 VD US 2007 0042767 A1 Patent Application Publication Feb 22 2007 Sheet 6 of 6 Z SIA OLS Agr ctl OWdASy leBAND uL IHL OPCXOZC EEL YAJAYO V SUNI dit Z aci JOVANI Nv98 E EDES FINCOM T 094 Jaidepy Jepesy elpa JOv diat NI OO NN Old9 JOVANI 98g Mpeg TIL EIL quswsfe ue A J8MOdg PUB Jabir yo Alegeg Olds 160v Oa SOVAMELNI aoa liHOd O3GIA SJOWAMALNI Lids 4e oquo2 ODI AJ aeos TILNI ooL IMANI OC YTL HOSN3S INIdd 39NIJ lel 24009 Olanyv E EN PE cel 549414 208 HMA HloO H fYIS ToL US 2007 0042767 A1 TETHERED DIGITAL BUTLER CONSUMER ELECTRONIC DEVICE AND METHOD RELATED APPLICATIONS 0001 This application is a continuation in part of and claims priority to U S application Ser No 11 350 980 filed Feb 8 2006 by inventor Robert Stepanian entitled TETH ERED DIGITAL BUTLER CONSUMER ELECTRONIC DEVICE AND METHOD which claims the benefit of U S Provisional Application No 60 709 666 filed Aug 19 2005 it further claims the benefit of and priority to U S Provi sional Application No 60 709 666 filed Aug 19 2005 0002 This application is related to U S Design patent app
5. on the gateway device by wirelessly directing input to the gateway device wherein the palm held remote integrates at least a speaker and volume control adapted for use as a remote speaker a fingerprint reader a cursor control and trigger adapted to select and control resources of the console wherein the glue logic invoked wirelessly by the remote control is adapted to Feb 22 2007 connect the speaker to a sound reproduction module and connect the fingerprint reader to an authentication and personalization module that selects a user profile based on activation of the fingerprint reader and authentication of the user the personalization mod ule adapted to present the user s personalized favorite media access present the user s personalized history lists automatically authenticate the user for digital rights management automatically authenticate the user for communica tion access and automatically authenticate the user for electronic wallet reproduction of purchasing credentials 26 The remote control of claim 25 wherein the remote control further integrates a keyboard and the glue logic invoked wirelessly by the remote control is adapted to trigger to an Internet browsing module and one or more gateway device controls of media selection playback and volume control 27 The remote control of claim 25 wherein the palm held remote further integrates a USB connector and port and the logic and reso
6. DVD CD player and access and playback digitally stored music 0018 In a second embodiment of the tethered digital butler the palm held remote has fewer components the console supports fewer features thus the combination will be less expensive and more attractive in many markets Remote components then include a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console and a compact keypad including numeric keys usable for telephone dialing The fingerprint reader is not included nor is the alphabetic keypad The logic and resources of the console are reduced accordingly Logic and resources of the console need not authenticate and person alize based on fingerprints or access and playback digitally stored music Internet browsing may be limited or may be supported by an on screen keyboard 0019 Ina third embodiment of the tethered digital butler the DVD CD player is omitted from the console The features of the palm held remote do not much change but the logic and resources required of the console are reduced 0020 In fourth embodiment the console is implemented on a PC which may be larger than bread box sized This typically would be less desirable as most PCs do not fit a media room decor and are relatively loud due to fans and hard disk rotation Anew generation of PCs
7. according to the wishes of the user Several tactile effects can be obtained according to the number of tooth integrated in the gear axle the standard resolution is 12 pulses per ball rotation When the Trackball is activated its relative position changes are analyzed in two directions X and Y The two perpendicular rollers are actuated by friction on the ball During their revolution the rollers activate two spring contacts which generate by contact closing and opening the electrical pulses 0124 To track the ball movements a simple electronic device tied to the direction contacts converts the vertical and horizontal displacements of the both perpendicular rollers in logical levels of X axis and Y axis displacements Some pull up resistors or respectively pull down resistors are tied to the axis direction contacts while the common contact is tied to the ground or respectively to the power supply potential The change in state interrupts the main LPC2132 processor 100 The output pulse frequency is directly proportional to the moving speed and the direction The pulse frequency is processed by the main processor LPC2132 and the corresponding PS2 data sent to the host system 0125 Alternatively the ITT Industries Cannon Omni or Vari Point joystick or the Omni or Vari Disk navigation disk can be used instead of a trackball 0126 The AuthenTec EntrePad AES3400 AuthenTec s 3rd generation low power small form factor fingerp
8. and 47 GPIO lines 228 with up to nine edge or level sensitive external interrupt pins make these microcontrol lers particularly suitable for industrial control and hand held systems 0041 The integrated ARM microprocessor operates at 60 MHz and in one embodiment supports the following fea tures 0042 16 32 bit ARM7TDMI S microcontroller 232 in a tiny LQFP64 package 8 16 32 KB of on chip static RAM 213 and 64 512 KB of on chip Flash program memory 223 A 128 bit wide interface accelerator 211 212 222 enables high speed 60 MHz operation Feb 22 2007 0043 In System In Application Programming ISP IAP via on chip boot loader software Single Flash sector or full chip erase in 400 ms and programming of 256 bytes in 1 Ms Embedded Trace interfaces 231 offer real time debugging with the on chip real monitor software and high speed tracing of instruction execu tion One 8 channel 10 bit A D converters 226 pro vides a total of up to 16 analog inputs with conversion times as low as 244 us per channel 0044 Single 10 bit D A converter 227 provides vari able analog output 0045 Two 32 bit timers counters with four capture and four compare channels each 225 PWM unit six outputs 225 and watchdog 248 0046 Real time clock 247 equipped with indepen dent power and clock supply permitting extremely low power consumption in power save modes Multiple serial interfaces including two UART 16C55
9. control and digitally stored music access and play back 2 The system of claim 1 wherein the palm held remote further integrates a media card reader and the logic and resources of the console are further adapted to treat the media card reader as local to the console 3 The system of claim 1 wherein the palm held remote further integrates a media card reader and the logic and resources of the palm held remote are further adapted to browse media inserted into the media card reader and preview the contents of files on the inserted media 4 The system of claim 1 wherein the logic and resources of the console to authenticate users based on fingerprints is further adapted to personalize the users lists of favorite channels web browsing and digitally stored music 5 The system of claim 1 wherein the palm held remote further integrates a USB connector and port and the logic and resources of the console are further adapted to treat the USB connector and port as local to the console 13 Feb 22 2007 6 A remote control for a media center the media center including logic and resources to process wireless input the remote control including a palm held remote adapted to invoke glue logic running on the media center by wirelessly directing input to the media center wherein the palm held remote integrates at least a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing
10. direction scanning switch Data sheet 0231 6 Authentec Fingerprint sensor AES 3400 Data sheet 0232 7 MSM7716 OKI Datasheet Version August 1998 0233 8 AT49BV802A Datasheet 3405D Flash March 2005 0234 In addition a camera can be incorporated into the remote thereby enabling video conferencing and other visual features The camera is complemented by a glue logic application supplied for or native to a communications and or multi media console such as one running under Windows OS X or Linux A CMOS camera commercially available for incorporation in camera phones may be suit able for this application This is illustrated in FIG 7 0235 FIG 7 depicts building the digital butler remote board as an XScale processor based solution with a camera module and or memory card reader This remote is built around the Intel XScale micro controller or a digital signal processor DSP The main processor provides interfaces for the Keypad Joystick 320 240 graphics LCD module fin gerprint sensor Bluetooth SOC WiFi 802 11b g module audio codec camera module and memory card reader The audio codec interfaces with a microphone speaker and headphone for voice utilities Alternatively the microphone speaker and headphone could interface through the Blue tooth module as described in the context of FIG 1 A general USB dongle interface not shown could be provided to allow the user to use the USB port as if it resided on t
11. exclusively as a data stream and not as part of a rendered video stream to avoid confusing menus of different sizes Alternatively the on screen menus and controls may just appear on the remote s display as a consequence of being rendered to a TV or monitor that is reproduced on the remote s display 0025 In any of these embodiments a camera module can be incorporated into the remote thereby enabling video conferencing and other visual features The camera is complemented by a glue logic application supplied for or native to a communications and or multi media console such as one running under Windows OS X or Linux To support full motion video Bluetooth version 2 or later or a wireless Ethernet protocol may be used to supply the required bandwidth 0026 As a further aspect of these embodiments the console may be equipped with a non volatile memory sized to time shift playback from the video receiver and its logic and resources are further adapted to provide a menu of upcoming video content schedule recording of the video content and replay the video content Alternatively the non volatile memory may be sized to hold a library of digital music 0027 The I O platform in the palm of our hand concept can be enhanced by adding a memory card reader to the remote One or more of the many memory card formats now in use or as may be developed in the future can be accom modated 0028 Another form of I O is provided through a USB
12. flash memory provides a minimum of 100 000 erase write cycles and 20 years of data retention On chip static RAM 213 may be used for code and or data storage The SRAM may be accessed as 8 bits 16 bits or 32 bits wide General purpose parallel I O is supported by device pins that are connected to a specific peripheral function are controlled by the GPIO registers Pins may be dynamically configured as inputs or outputs Separate reg US 2007 0042767 A1 isters allow setting or clearing any number of outputs simultaneously The value of the output register may be read back as well as the current state of the port pins The GPIO lines have the following features 0058 Direction control of individual bits 0059 Separate control of output set and clear 0060 All I O default to inputs after reset 0061 The LPC 2132 memory maps shown in FIG 3 incorporate several distinct regions In addition the CPU interrupt vectors may be re mapped to allow them to reside in either Flash memory by default or on chip static RAM 0062 The vectored interrupt controller VIC accepts all of the interrupt request inputs and categorizes them as FIQ vectored IRQ and non vectored IRQ as defined by pro grammable setting The programmable assignment scheme means that priorities of interrupts from the various periph erals can be dynamically assigned and adjusted 0063 Fast interrupt request FIQ has the highest priority If more than one reques
13. including numeric keys usable for telephone dialing the compact keypad further including alphabetic keys usable for web browsing wherein the bread box or smaller sized console integrates at least a media card reader a network port and logic and resources adapted to authenticate users of the palm held remote and person alize their telephone network connection based on fingerprints received from the palm held remote connect the palm held remote to the telephone network control with the palm held remote retrieval transfer and playback of digital content from the media card reader control channels accessed by a video receiver drive speakers and provide volume control and provide playback control for the DVD CD player whereby the palm held remote allows a user of to select among and use the bread box or smaller sized con sole s user authentication and personalization tele phone network connection media card reader func tions channel control volume control and DVD CD playback control 20 The system of claim 19 wherein the palm held remote further integrates a media card reader and the logic and resources of the console are further adapted to treat the media card reader as local to the console US 2007 0042767 A1 21 The system of claim 19 wherein the palm held remote further integrates a media card reader and the logic and resources of the palm held remote are further adapted to browse media inserted into the
14. such as the Mac Feb 22 2007 Mini presents a small form factor presently 6 5x6 5x2 inches and quiet operation while including enough com puting power to function as PC 0021 In a fifth embodiment the remote is emphasized One aspect of the remote is to provide a complete I O platform in the palm of the user s hand Features adaptable to VoIP and or video phone operation such as a microphone can be used for other purposes such as dictation note taking voice messaging listening to music or remote view ing video To support the high demands of streaming video a broader communications channel such as Bluetooth ver sion 2 or later or 802 11n and a more powerful processor are included The remote may function in tandem with a con sole PC or set top cable or satellite box It also could be configured to control other consumer electronics device such as a TV IP TV home theater system component stereo digital video recorder DVD player or recorder VCR etc It can receive streaming media directly from a server The palm held remote may be combined with a glue logic application that enables a console PC set top box or other consumer electronics device to utilize the special purpose controls ofthe remote The remote may be adapted to invoke a glue logic application supplied for or native to a commu nications and or multi media console such as one running under Windows OS X or Linux 0022 In a sixth embodiment a remot
15. to other CPU and peripheral interfaces 0012 FIG 6 is a block diagram of the console 0013 FIG 7 is an alternative block diagram of the digital butler remote with a CMOS camera module and or memory card reader based Philips DETAILED DESCRIPTION 0014 The following detailed description is made with reference to the figures Preferred embodiments are described to illustrate the present invention not to limit its scope which is defined by the claims Those of ordinary skill in the art will recognize a variety of equivalent varia tions on the description that follows 0015 A tethered digital butler produces a low cost palm held remote with a novel combination of features that are implemented by logic and resources of the console connected wirelessly to the palm held remote Tethering the palm held device so that it depends on logic and resources of the console runs against the trends and teachings of the consumer electronics industry and particularly against the trend toward more powerful smartphones US 2007 0042767 A1 0016 Various novel combinations of features are empha sized in this application One will recognize that the features discussed can be combined in many ways while remaining faithful to the tethered digital butler concept 0017 Ina first embodiment of the tethered digital butler the palm held remote allows a user to select among and use logic and resources of a bread box or smaller sized conso
16. 0 246 two Fast I2C bus 400 Kb s 244 SPI and SSP 245 with buffering and variable data length capabilities 0047 Vectored interrupt controller 253 with config urable priorities and vector addresses 0048 Up to 47 5 V tolerant general purpose 1 0 pins 228 in tiny LQFP64 package 0049 Up to nine edge or level sensitive external inter rupt pins 224 available 0050 60 MHz maximum CPU clock available from programmable on chip PLL 241 0051 On chip crystal oscillator with an operating range of 1 MHz to 30 MHz 0052 Power saving modes include idle and Power down 0053 Individual enable disable of peripheral functions as well as peripheral clock scaling down for additional power optimization 0054 Processor wake up from Power down mode via external interrupt 224 0055 Single power supply chip with POR and BOD circuits 0056 CPU operating voltage range of 3 0 V to 36 V 33 V 10 with 5 V tolerant I O pads 0057 The LPC 2132 s 64 KB of flash memory 223 may be used for both code and data storage Programming of the flash memory may be accomplished in several ways It may be programmed in the system via the serial port 245 The application program may also erase and or program the flash while the application is running allowing flexibility for data storage field firm grade upgrades etc While the on chip boot loader is used 64 KB flash memory is available for user code The LPC2132
17. 0 4K 460 8K and 921 6 Kbs UART baud rates 0202 RTS and CTS flow control signals for UART 0203 Direct Memory Access DMA for low overhead UART control 0204 The USB support includes 0205 USB version 2 0 compliant interface wakeup and detach sideband signals sup 0206 USB wak d detach sideband signal ported 0207 Direct Memory Access DMA for low overhead USB control 0208 The general purpose I O features 0209 Sixteen individually programmable general pur pose I O 0210 Configurable for UART wake up hand shaking 0211 Base band and CPU activity indication 0212 USB UART mode select 0213 0214 The pulse code modulator support includes 0215 PCM interface for audio applications PCM OUT PCM IN PCM CLK and 0216 PCM SYNC 0217 Linear u Law and A Law codes supported 0218 Interface to OKI MSM 7732 01 and OKI 7716 codec 0219 Direct Memory Access DMA for low overhead PCM control 0220 A 12 MHZ crystal serves as the primary clock crystal 0221 FIG 5 shows the ZV4301 to other CPU and peripheral interfaces The ZV4301 is interfaced with the main processor LPC2132 100 through the UART port The 8 Mb Flash memory AT49BV802A 501 is interfaced with ZV4301 through the external bus interface The single rail linear codec 141 is interfaced with the ZV4301 through the PCM interface 0222 Debugging of the remote is supported by JTAG header and BDM header is used i
18. 042767 A1 0092 Programmable reference clock divider allows adjustment of the RTC to match various crystal fre quencies 0093 The 8051 based Philips LPC89LPC931 controller in FIG 4 is suitable for keyboard interface The P89LPC930 931 404 is based on a high performance pro cessor architecture that executes instructions in two to four clocks six times the rate of standard 80C51 devices Many system level functions have been incorporated into the P89LPC930 931 in order to reduce component count board space and system cost The P89LPC931 has the following enhanced features 0094 A high performance ARM processor 80C51 CPU provides instruction cycle times of 111 ns to 222 ns for instructions except multiply and divide when executing at 18 MHz This is six times the performance of the standard 80C51 running at the same clock frequency A lower clock frequency for the same per formance results in power savings and reduced EMI 0095 2 4 V to 3 6 V VDD operating range I O pins are 5 V tolerant 0096 8 kB flash code memory with 1 kB sectors and 64 byte page size 0097 Byte erase allowing code memory to be used for data storage 0098 Flash program operation completes in 2 ms 0099 256 byte RAM data memory 0100 Real time clock that can also be used as a system timer 0101 Enhanced UART with fractional baud rate gen erator break detect framing error detection automatic address detection and versatile in
19. 25 C to 85 C and comes in a lead free version The ZV4301 is implemented in a 0 18 micro meter CMOS process and includes the integration of all RF components and digital circuitry The only external components needed are an antenna crystal reference resister decoupling capacitors and flash memory The ZV4301 is designed for low power applications including sleep and deep sleep modes and operates from a single 3 3V supply The ZV4301 is manu factured in an 8 6x8 6x1 65 mm LTCC BGA package with 100 balls 0146 The ZV4301 is supplied with a link library for a complete lower layer protocol stack and source code to the blueOS operating system target manager and link manager API Upper layers are supported through the Zeevo partner program with firmware Bluetooth protocol stack software and Bluetooth profiles available from Zeevo s extensive partner list 0147 The Zeevo4301 typical application supports AV equipment smart phones personal digital assistants print ers cellular peripherals access points and industry controls Features include 0148 Bluetooth 1 2 compliant 0149 High bandwidth ARM7TDMI processor sub system 0150 12 24 and 48 MHz CPU clocks selectable on chip PLL from single 12 MHz input 0151 Highly integrated low cost solution Radio link control and CPU are integrated 0152 High throughput 0153 Tested qualified software stack available 0154 Support for very low power modes sleep an
20. Print technology for ability to acquire ATA 0130 Compact industry standard 100 Pin LQFP Pack age 0131 High definition 128x128 TruePrint technology based pixel array 0132 500 pixels per inch ppi 0133 Extended Range 2 7V to 3 6V single power supply 0134 0 C to 470 C operating temperature range 0135 Easy to integrate USB 2 0 full speed synchro nous amp asynchronous serial amp 8 bit parallel system interfaces 0136 6 or 12 MHz operation with crystal or supplied clock input 0137 USB selective suspend support 0138 Ultra hard surface coating 0139 1 million rubs w o degradation 0140 Highly scratch resistant 0141 IEC 61000 4 2 level 3 ESD capability 4 8 KV 0142 Built in low power finger detection w system interrupt capability 0143 Low power operation 6 mW imaging event 0144 The interface of these fingertip sensors is pin selectable choices The SPI interface finger chip sensor is selected so that the finger tip sensor is connected to the SPI port 245 of the main processor 0145 The Zeevo ZV4301 in FIG 5 used in one embodi ment is a Bluetooth SOC adapted to provide a high band width CPU system to add wireless connectivity to their product The ZV 4301 502 incorporates the industry stan dard 32 bit ARM7TDMI CPU core with high bandwidth US 2007 0042767 A1 processing capability sufficient to support a wide range of embedded applications The ZV4301 operates from
21. US 20070042767A1 19 United States a2 Patent Application Publication 10 Pub No US 2007 0042767 A1 Stepanian 43 Pub Date Feb 22 2007 54 TETHERED DIGITAL BUTLER CONSUMER 52 US EL inet e PEE SESS 455 420 ELECTRONIC DEVICE AND METHOD i 57 ABSTRACT 76 Inventor Robert Stepanian San Francisco CA US The present invention relates to a tethered digital butler consumer electronics product and method The tethered Correspondence Address digital butler of a price and form factor suitable for con HAYNES BEFFEL amp WOLFELD LLP sumer electronics markets of developed and developing P O BOX 366 countries includes a communications and multi media con HALF MOON BAY CA 94019 US sole and a wireless remote The remote may resemble a handheld personal computer HPC a palm held personal 21 Appl No 11 465 749 computer PPC or PDA or a smart phone but has a low cost a and feature set supported by the console that is novel in the 22 Filed Aug 18 2006 consumer electronics market In particular this disclosure Yd relates to combining telephone service device control and Related U S Application Data optionally a fingerprint reader for easy user identification 63 Continuation in part of application No 11 350 980 authorization and personalization As another option a cam era can be incorporated into the remote thereby enabling filed on Feb 8 2006 g i 3 video conferencing and other visual features Alternatively
22. Zeevo ZV4301 Bluetooth SOC or a Broadcom or RFMD design with headset and serial port profile SPP firmware This module is coupled to the main controller through a UART The module is adapted to convey wire lessly a mix of keyboard data trackball data fingerprint sensor data for authentication and data to be displayed on the remote module s display Console Hardware 0250 Introduction 0251 The core component of the console or host system may be a standard mini ITX mother board with ports to add peripherals A USB Bluetooth module and USB WLAN module may be connected to the motherboard through USB ports A display is connected through VGA connector and the socket modem with RJ11 connector is connected through serial port 2 The remaining ports can be used for external Feb 22 2007 interface The wireless remote communicates over Blue tooth with the USB Bluetooth module Features 0252 FIG 6 is a block diagram of the console 606 The host console of the system may be built on a standard Mini ITX motherboard and an additional add on board to support the features like WAP Bluetooth and a MODEM for PSTN and a PCI VGA Card A standard Mini ITX is available in a 17 cmx17 cm form factor The motherboard and or add on board may include two VGA connectors for example a VGA connector from motherboard 613 and a second VGA connector using a PCI add on card 614 The design also may include a serial port for external interface
23. a telephone number a cursor control and trigger adapted to select and control resources of the console a compact keypad including numeric keys usable for telephone dialing the compact keypad further including alphabetic keys usable for web browsing wherein the glue logic invoked wirelessly by the remote control is adapted to connect the speaker and microphone to a telecom module and connect the keyboard cursor control and trigger to an Internet browsing module and one or more media center controls of media selec tion playback and volume control 7 The remote control of claim 6 wherein the palm held remote further invokes glue logic running on the media center that is adapted upon successful authentication of the fingerprint reader data by the authentication module to personalize an authenticated user s experience with lists of the user s favorites and history the user s recent activity at the media center 8 The remote control of claim 6 wherein the palm held remote further integrates a camera the display is at least capable of showing a caller at on a video conference and the palm held remote invokes glue logic running on the media center that is adapted to connect camera data to a video conferencing module 9 The remote control of claim 6 wherein the palm held remote further integrates a camera the display is at least capable of showing a photograph and the palm held remote invokes glue logi
24. back control 15 The system of claim 14 wherein the palm held remote further integrates a media card reader and the logic and Feb 22 2007 resources of the console are further adapted to treat the media card reader as local to the console 16 The system of claim 14 wherein the palm held remote further integrates a media card reader and the logic and resources of the palm held remote are further adapted to browse media inserted into the media card reader and preview the contents of files on the inserted media 17 The system of claim 14 wherein the logic and resources of the console to authenticate users based on fingerprints is further adapted to personalize the users lists of favorite channels web browsing and digitally stored music 18 The system of claim 14 wherein the palm held remote further integrates a USB connector and port and the logic and resources of the console are further adapted to treat the USB connector and port as local to the console 19 A multi media and communications system includ ing a palm held remote and a bread box or smaller sized console in wireless commu nication with the remote wherein the palm held remote integrates at least a fingerprint reader a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console a compact keypad
25. by means of board to board connectors and will be interfaced to the additional serial port available on the motherboard header The socket modem module is powered by 3 3V DC supply and the interfacing signals are in the 3 3 V LVTTL level The socket modem module has the connections for a telephone line This connection will be terminated to a RJ11 jack 635 on the carrier board for this purpose The serial port signals in the motherboard are terminated to header COM2 which is in RS232 level A RS232 transceiver interfaces 631 to the modem 634 0255 A standard off the shelf 802 11 g WLAN module 632 is available module with USB interface The module can be connected to the USB port available on the mother board header An external antenna may be positioned at the rear panel of the host system for maximum sensitivity Some suitable modules include the Linksys WUSB54GP and Net Gear WG111 These modules are interoperable with 802 11b A WLAN module may be an alternative to a Bluetooth module for communications with the remote or can provide a network interface for the console US 2007 0042767 A1 0256 A standard off the shelf Bluetooth module 633 is available module with USB interface The module may be connected to the USB port available on the motherboard header The module will be connected to the host system by the USB port available on the motherboard header The modules built around CSR chipset may be suitable 0257 The p
26. c running on the media center that is adapted to connect camera data to a photographic capture module 10 The remote control of claim 6 wherein the palm held remote further integrates a media card reader and the logic and resources of the media center are further adapted to treat the media card reader as local to the media center 11 The remote control of claim 6 wherein the palm held remote further integrates a media card reader and the logic and resources of the palm held remote are further adapted to browse media inserted into the media card reader and preview the contents of files on the inserted media US 2007 0042767 A1 12 The remote control of claim 6 wherein the palm held remote further integrates a USB connector and port and the logic and resources ofthe console are further adapted to treat the USB connector and port as local to the console 13 The remote control of claim 6 wherein the display is adapted to show menu and control infor mation from the media center the palm held remote further integrates logic and resources adapted to reproduce menu and control infor mation received from the media center and to invoke glue logic running on the media center by wirelessly directing menu and control navigation input to the media center and the glue logic invoked wirelessly by the remote control is adapted to process the menu and control navigation input and control features of the media center 14 A multi media and c
27. d deep sleep 0155 Audio capability on an SCO channel 0156 On chip crystal tuning and power calibration 0157 Complete co location and co existence solutions with 802 11 supported through AWMA AFH and SFH 0158 The CPU and memory support include 0159 ARM7TDMI processor core 0160 12 24 and 48 MHz operation 0161 32 16 bit RISC architecture 32 bit ARM instruc tion 0162 16 bit Thumb instruction set for increased code density 0163 32 bit ALU and high performance multiplier 0164 Extensive debug facilities JTAG 0165 8 K bytes of boot ROM 0166 64 K bytes of SRAM 0167 The radio features include 0168 Integrated RF interface connects directly to antenna Feb 22 2007 0169 Integrated power amplifier supports up to 44 dBm output power for class 2 amp 3 operation 0170 High sensitive design 86 dBm typically 0171 Class 1 operation is supported with an external p pp power amplifier LNA interface 0172 IF enhanced direct conversion receiver architec ture 0173 Integrated TX Rx switch balun and matching network in an LTCC package 0174 Low power consumption receiver design 0175 Multiplexed RX TX antenna interface 0176 Fully integrated PLL synthesizer and loop fil ter requires external 12 MHZ crystal 0177 The baseband and software features include 0178 Required and optional Bluetooth 1 2 features faster connection extended SCO link adaptive fr
28. d as trial balloons that burst never to see an enabling development effort or a reduction to practice Some conver gence trends are strong and noteworthy Cellular smart phones or business phones such as Treo or Blackberry products are becoming powerful and supplanting separate PDAs These smartphones go with the user across a cellular network and even overseas They are untethered packing many features into a small form factor not requiring a console Another trend is to repackage a PC as media center complete with a wireless keyboard Recent announcements suggest interfacing a Microsoft media center with a Blue tooth equipped cellular telephone to use the sound repro duction of a TV as a sort of speaker phone relying on the cellular telephone for network connectivity In both instances the telephone features are untethered from and do not depend on availability of a console 0005 For developing countries and cost conscious buy ers the Treo and media center approaches are over built and too expensive An opportunity arises to provide a low cost integrated consumer electronics system that includes a novel Feb 22 2007 feature set and a cost effective allocation of technical tasks between a remote and a console SUMMARY OF THE INVENTION 0006 The present invention relates to a tethered digital butler consumer electronics product and method The teth ered digital butler of a price and form factor suitable for consumer elect
29. different bit rates to communicate via one serial bus 0081 Serial clock synchronization can be used as a hand shack mechanism to suspend and resume serial transfer 0082 The I2C bus may be used for test diagnostics purposes 0083 The SPI 245 is a full duplex serial I O interface designed to be able to handle multiple masters and slaves connected to a given bus A single master and a single slave communicate on the interface during a given data transfer During a data transfer the master always sends a byte of data to the slave and the slave always sends a byte of data to the master The features of the SPI controller is listed below 0084 Compliant with serial peripheral interface SPI specification 0085 Synchronous serial full duplex communica tion 0086 Combined SPI master and slave 0087 Maximum data bit rate of one eighth of the input clock rate 0088 The real time clock RTC 247 is designed to provide a set of counters to measure time when normal or ideal operating mode is selected The RTC uses little power making it suitable for battery powered systems where the CPU is not running continuously idle mode The features of RIC are described below 0089 Measures the passage of time to maintain a calendar and clock 0090 Ultra low power design to support battery pow ered systems 0091 Provides seconds minutes hours day month year day of week and the day of year US 2007 0
30. e quency hopping AFH QOS flow control 0179 Direct memory access DMA for low overhead UART control 0180 Standard Bluetooth HCI interface over UART and USB 0181 Support for a range of Bluetooth data rates 57 6 723 Kb sec 0182 Support for multiple ACL and HC SCO packet types 0183 Park sniff and hold modes 0184 Point to point point to multipoint and scatter net 0185 Up to 7 slaves and up to 4 Pico nets supported 0186 u Law A Law and CVSD transcoders on SCO channel 0187 Full 8 to 128 bit encryption 0188 The baseband modem includes 0189 Demodulator modulator RX TX self calibra tion burst timing control and transmitter burst spectral shaping 0190 FEC encoder decoder data whitening encryp tion decryption and cyclic redundancy check 0191 Link controller for synchronization frequency hope control and receiver transmitter slot timing 0192 The external bus interface includes 0193 8 16 bit data bus 0194 23 bit address bus 0195 Support for 2 memory banks Each bank sup ports up to 16 Mbytes flash and SRAM with indepen dent timing control for each bank 0196 GPIO can function as additional interrupts 0197 3 dedicated chip selects each with independent timing control 0198 3 indicated interrupt lines US 2007 0042767 A1 0199 The UART includes 0200 16450 register set compatible UART 0201 9600 19 2K 38 4K 57 61K 115 2K 23
31. e control for a gateway device t is coupled to multimedia and communi cation resources The gateway device including logic and resources to process wireless input and provide access to the multimedia and communication resources The remote con trol includes a palm held remote adapted to invoke glue logic running on the gateway device by wirelessly directing input to the gateway device It integrates at least a speaker and volume control adapted for use as a remote speaker a fingerprint reader and a cursor control and trigger adapted to select and control resources of the console Glue logic invoked wirelessly by the remote control is adapted to connect the speaker to a sound reproduction module and connect the fingerprint reader to an authentication and personalization module that selects a user profile based on activation of the fingerprint reader and authentication of the user The personalization module adapted to present the user s personalized favorite media access present the user s personalized history lists automatically authenticate the user for digital rights management automatically authenti cate the user for communication access and automatically authenticate the user for electronic wallet reproduction of purchasing credentials 0023 An alternative to video operation of a camera is still operation of the camera The still camera may be wirelessly coupled to a photographic capture module run ning on another device which persi
32. emote The remote uses the data stream to render the on screen display in a legible format adapted to the reduced size of a screen on the remote Preferably the menu and control organization for mat on the remote mimics what the viewer can see on the screen to minimize confusion Technologies such as a subset of HTML and JavaScript allow a designer to specify a menu and control layout in terms that permit rendering to a variety of display sizes Remote display of the on screen menu and control data stream may preempt a video image display or may be overlaid on top of the video image Optionally the device s on screen menu and controls can be supplied to the remote exclusively as a data stream and not as part of a rendered video stream to avoid confusing menus of different sizes Alternatively the on screen menus and controls may just appear on the remote s display as a consequence of being rendered to a TV or monitor that is reproduced on the remote s display 0242 One of skill in the art will recognize that a display in the palm of the hand will be useful to many people because it reduces demands for eye hand coordination and short term memory The form factor is convenient A single remote can control for many devices Depending on the features combined into the remote varying complexity can be delivered at varying prices 0243 The on screen display module can be more or less stateful JavaScript for instance can be used to keep
33. f context shifting based on a single action at a remote control is believed to be new and unique The personaliza tion may include favorite channels movies shows in a streaming video environment favorite music photos or video in an on demand environment approved access to DRM controlled content using one or more keys linked to the fingerprint history of searches recent topics personal interest a la Google Sidebar or Claria Personal Web per sonal receptiveness to advertising content recently accessed files automatic authenticated access to communication channels linked to the fingerprint such as voice over IP instant messaging web conferencing and e mail electronic wallet access automatically looking up credit card informa tion and other account authorization information and shar ing of information by person logged in 0031 The console may be equipped with a remote locator control button that causes the remote to emit a tone which makes it easier to locate 0032 The form factor of a palm held remote should be easily recognized 0033 The form factor of a bread box or smaller sized console can be judged by volume A smallish consumer electronics component uses an enclosure from which con nectors and feet protrude that is 12 by 15 by 3 inches and has a volume of 540 cubic inches This is an approximately bread box sized enclosure although the shape differs from a loaf of bread Remote Hardware 0034 Introducti
34. fingerprint sensor then a generic profile is applied to personalization of music movies photos videos files and telephone access If the user swipes the fingerprint sensor then personalization can be applied analogous to switching users in current Windows XP implementations This degree of context shifting based on a single action at a remote control is new in this disclosure The personalization may include favorite channels movies shows in a streaming video environment favorite music photos or video in an on demand environment approved access to DRM controlled content using one or more keys linked to the fingerprint history of searches recent topics personal interest a la Google Sidebar or Claria Personal Web recently accessed files automatic authenticated access to communication channels linked to the fingerprint such as voice over IP instant messaging web conferencing and e mail electronic wallet access automatically looking up credit card informa tion and other account authorization information and shar ing of information by person logged in 0248 The trackball or other pointing device interface module uses sampling techniques to read the ball movement and click button states The outputs of the trackball are connected to general purpose I O channels The modules sense the state of the general purpose I O s at a predeter mined frequency such as 1 kHz 0249 A Bluetooth wireless interface module may be based on
35. he host device The USB port of the remote would function as a remote USB connection for the host Document 0236 From FIG 7 the components include the main processor 700 which couples to the Bluetooth module 732 WiFi module 751 and audio codec 741 The audio codec couples to speaker 752 microphone 751 audio jack 753 The main processor also may couple to a fingerprint sensor 721 and a battery pack 712 A battery charger and power management component 724 such as a cradle couples to a DC power input 713 and charges the battery 712 The main processor also may couple to a camera module 750 a display 733 a keypad 711 and joy stick 723 The camera module may for instance be a 3 mega pixel CMOS com US 2007 0042767 A1 ponent The memory card reader 760 can support one or more memory card formats Currently used memory card formats as of submission of this disclosure include PC Card CompactFlash I and II SmartMedia Memory Stick Memory Stick Duo and Micro M2 Multimedia regular reduced size and micro Secure digital regular mini and micro xD Picture card and g card The main processor 700 provides an array of ports for interfacing with these various components While currently available components are gen erally identified such as by resolution or wireless standard one of skill in the art will recognize that these components will evolve over the 20 year life of a patent Remote Software 0237 Software components of
36. he Chinese corresponding ASCII codes to the main processor in Chinese key entry mode 0109 The following tables describe interfaces among the CPU 100 keyboard controller 404 and matrix 406 Keyboard Controller to CPU Interface Signal LPC2132 P89LPC93 Remarks Serial I2C Data SDA SDA I2C interface Serial I2C clock SCL SCL 12C interface 0110 Keyboard Controller to Matrix Interface P89LPC93 Signal Signal Name key board Remarks K131 0 Keybd input 1 P0 0 RET LINE 1 Keybd Return ine 1 KBI 1 Keybd input 2 PO 1 RET LINE 2 Keybd Return ine 2 K13I 2 Keybd input 3 P0 2 RET LINE 3 Keybd Return ine 3 K131 3 Keybd input 4 P0 3 RET LINE 4 Keybd Retum ine 4 KBIA Keybd input 5 P0 4 RET LINE 5 Keybd Return ine 5 K13L5 Keybd input 6 P0 5 RET LINE 6 Keybd Retum ine 6 K131 6 Keybd input 7 P0 6 RET LINE 7 Keybd Retum ine 7 K13I 7 Keybd input 8 P0 7 RET LINE 8 Keybd Retum ine 8 K130 0 Keybd output 1 P2 0 SCAN LINE 1 Keybd Scan ine 1 K130 1 Keybd output 2 P2 1 SCAN LINE 2 Keybd Scan ine 2 K130 2 Keybd output 3 P2 2 SCAN LINE 3 Keybd Scan ine 3 K130 3 Keybd output 4 P2 3 SCAN LINE 4 Keybd Scan ine 4 KBOA Keybd output 5 P2 4 SCAN LINE 5 Keybd Scan ine 5 K130 5 Keybd output 6 P2 5 SCAN LINE 6 Keybd Scan ine 6 K130 6 Keybd output 7 P2 6 SCAN LINE 7 Keybd Scan ine 7 K130 7 Keybd output 8 P2 7 SCAN LINE 8 Keybd Scan ine 8 K130 8 Keybd output 9 P1 0 SCAN LINE 9 Keybd Scan ine 9 K130 9 Keybd out
37. le to authenticate users from a fingerprint reader on the remote to personalize the user s telephone TV viewing media access and internet browsing experiences to connect the user to a telephone network consistent with the user s authentication and to control multi media features such as channel control volume control DVD CD playback control and digitally stored music access and playback In this embodiment the palm held remote integrates at least a fingerprint reader a speaker microphone and volume con trol adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console a compact keypad including numeric keys usable for tele phone dialing the compact keypad further including alpha betic keys usable for web browsing The bread box or smaller sized console integrates at least a DVD CD player a network port and logic and resources adapted to authen ticate users of the palm held remote and personalize their telephone network connection and their Internet browsing based on fingerprints received from the palm held remote connect telephone features of the palm held remote to the telephone network respond to Internet browsing commands from the palm held remote and display web pages on a monitor or television control channels accessed by a video receiver drive speakers and provide volume control provide playback control for the
38. lication Ser Nos 29 236 023 29 236 022 and 29 236 022 filed on Aug 10 2005 by inventors Phoebe Ng Robert Stepanian and Allison S Conner entitled NAVIGATION BUTTON ARRAY FOR REMOTE CONTROL HOUS ING REMOTE CONTROL HOUSING and CON SOLE HOUSING The priority provisional and related design applications are incorporated by reference BACKGROUND OF THE INVENTION 0003 The present invention relates to a tethered digital butler consumer electronics product and method The teth ered digital butler of a price and form factor suitable for consumer electronics markets of developed and developing countries includes a communications and multi media con sole and a wireless remote The remote may resemble a handheld personal computer HPC a palm held personal computer PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the consumer electronics market In particular this disclosure relates to combining telephone service device control and optionally a fingerprint reader for easy user identification authorization and personalization The remote may be pack aged separately from a console and sold to interact with capabilities of a communications and multi media console from a different source such as one running on a Windows OS X or Linux platform 0004 Convergence of digital devices is not unbounded because it is guided by market realities Many concepts are floate
39. media card reader and preview the contents of files on the inserted media 22 The system of claim 19 wherein the logic and resources of the console to authenticate users based on fingerprints is further adapted to personalize the users lists of favorite channels web browsing and digitally stored music 23 The system of claim 19 wherein the palm held remote further integrates a USB connector and port and the logic and resources of the console are further adapted to treat the USB connector and port as local to the console 24 The system of claim 19 wherein the display on the palm held remote is adapted to show menu and control information from the media center the palm held remote further integrates logic and resources adapted to reproduce menu and control infor mation received from the media center on the display and to invoke glue logic running on the media center by wirelessly directing menu and control navigation input to the media center and the glue logic invoked wirelessly by the remote control is adapted to process the menu and control navigation input and control features of the media center 25 A remote control for a gateway device that is coupled to multimedia and communication resources the gateway device including logic and resources to process wireless input and provide access to the multimedia and communi cation resources the remote control including a palm held remote adapted to invoke glue logic running
40. n a home private listening via a wired or wireless headset and multiple stream playback so that the audio reproduced at the remote is different from the audio reproduced on speakers wired to the host 0239 The LCD connected to the main controller uses the GPIO interface including data and control lines The LCD can be used to display data received over the wireless link The data could be received in an HTML or HTML subset format and rendered by a compact browser module Or a custom designed packet format could be used for LCD data This format includes eight fields start of packet packet type link mode x position y position data and checksum The mode field indicates the mode in which the data is to be displayed This module operates in two modes a so called font mode and a byte mode In a phone mode the given string is displayed on the LCD display in the predefined font shape and size In the byte mode the given date is displayed as raw data which allows the user to design their own shapes X and Y position coordinates indicate the row and column position on the LCD 0240 The remote control can duplicate the visual opera tion of an on screen display generated by a controlled Feb 22 2007 device using a display on the remote The on screen display interface is designed to provide easy smooth seamless operation of the device However most remotes provide an array of buttons and much different interface than the on
41. n the board for the debugging purposes This section gives the details of the JTAG header and BDM header 0223 The processor complies with the IEEE 1149 1 A JTAG testing standard The JTAG test pins are multiplexed with background debug pins Each GPIO can be used as interrupt 0224 The system is fed with 5 volts input power The input power is passed through a diode to provide the protection against reverse polarity The power to the digital butler remote comes from an external power supply module The external power supply module will provide power to the remote and for charging the battery The input power is fed through a connector From the 5 volts input the following Feb 22 2007 voltages are derived on the CPU card Processor core voltage The core supply for the processor is generated through a low dropout regulator that can support current up to 1 5A operating from a 5V input The output 1 8V is fed to the core of the processor PLL voltage The core voltage is the input to the PLL through a ferrite bead which supplies power to clock generation and PLL circuits of the processor 0225 Data sheets publicly available for the major IC components include 0226 1 LPC213x Philips User manual Nov 22 2004 0227 2 Zeevo ZV4301 Datasheet Jan 24 2005 0228 3 P89LPC930 931 Data Sheet Rev 05 15 Dec 2004 0229 4 DDG128032AAD Data sheet Rev1 0 Issue date 2004 Oct 6 0230 5 ITT Cannon Miniature all
42. nt Application Publication Feb 22 2007 Sheet 3 of 6 US 2007 0042767 A1 OxFFFF FFFF CaFoco 0000 78 Peripherais CxEUDU DOSI 3 05 66 Ca 7005 0000 Cx2000 Cono r2 pw a DI nat siate ire mappeg from Cn cop Flash mamorsi Ox4000 2000 0x4000 75FF 034900 4000 04000 3FFF Tx400D 2000 Ca4000 FFF 084000 0000 16 kB On Chip Static RAM LPO2132 8 B Zn Chip State RAM LPOZIOTI 1 6 GB Reserved Address Space Ca D008 G00 Os0007 FFFF 230001 DOC Gx0000 FERE Ox 0000 20000 Oo 512545 On C p Non Valatile Memory LPC2138 4 k8 On Chip Non Vciatile Memory LPIC21321 22 kB On Chip Non Velatile Memory dna PA 0 0 GB FIG 3 Main Proc j Keyboard Ctir Keyboard Matrix LPC 2132 P89LP931 8 return lines x 13 scan lines i o Hoy ioe FIG 4 Patent Application Publication Feb 22 2007 Sheet 4 of 6 US 2007 0042767 A1 AT49 BV802A 8Mb Flash LPC 2132 CPU 100 UART ZV4301 Bluetooth SOC 502 MSM 7716 OKI codec E Se Speaker FIG 5 US 2007 0042767 A1 Patent Application Publication Feb 22 2007 Sheet 5 of 6 SOVAH3lNI TV NHSILXS S39VAJH3LNI TV NYALI i S2 JOPSUUOD bry 9 ZED y aNPoN Ul9po N 1exoosS 9 Old hzo STI apo uyoojenig SSN apon HIM asn J81I9AUO TETSY 7 S 4 uod EYES a WA eid aua GAC xsiQ PeH Za M Hod 19 NYT Str uod i pueoghay i
43. ommunications system includ ing a palm held remote and a bread box or smaller sized console in wireless commu nication with the remote wherein the palm held remote integrates at least a fingerprint reader a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console a compact keypad including numeric keys usable for telephone dialing the compact keypad further including alphabetic keys usable for messaging wherein the bread box or smaller sized console integrates at least a DVD CD player a network port and logic and resources adapted to authenticate users of the palm held remote and person alize their telephone network connection and their messaging based on fingerprints received from the palm held remote connect the palm held remote to the telephone network send and receive messages across a communications network displaying the messages on a monitor or television control channels accessed by a video receiver drive speakers and provide volume control and provide playback control for the DVD CD player whereby the palm held remote allows a user of to select among and use the bread box or smaller sized con sole s user authentication and personalization tele phone network connection messaging channel con trol volume control and DVD CD play
44. on 0035 The digital butler remote is a gadget based on the Bluetooth or another wireless technology used for commu nications and remote control applications 0036 Features 0037 The digital butler remote board is an ARM7 pro cessor based solution 0038 This remote is built around the Philips LPC2132 ARM controller The main processor provides interfaces for the Keypad Trackball or other pointing device 128 32 graphics LCD module fingerprint sensor and Bluetooth SOC The Bluetooth SOC and Zeevo ZV4301 interface with a microphone speaker and headphone for voice utilities The system may use a Philips 89LPC931 controller for the keypad interface through a 12C Bus Alternative hardware configurations are illustrated in FIGS 7 and 8 US 2007 0042767 A1 0039 FIG 1 is a block diagram of the digital butler remote FIG 1 is a block diagram of the digital butler remote Embodiment Details Chip Name Chip Number Description Main processor LPC2132 Phillips Main CPU 60 MHz 100 64 Kb flash 16 Kb SRAM Keypad controller 89LPC931 Phillips 8051 MCU compatible 122 with 8 KB flash 12C interface LCD Display mod DDG128032AAD DDTL ule 133 128 32 graphics parallel serial LCD Module Miniature all direc tional scanning switch TrackBall 123 TBW2A00 ITT Industries Cannon Omni or Vari Point or Omni or Vari Disk devices ITT Industries Cannon Fingertip sensor AES3400 Authentech Finger
45. or Firewire port The remote may integrate a USB connector and port or similar Firewire support Glue logic running on the host device may be adapted to treat the USB or Firewire port as if it were local to a machine being accessed using the remote 0029 In another aspect of these embodiments the remote may hold a DRM key and automatically deliver the key to DRM enabled device Either memory on the remote a memory module or an identification reader combined with the remote may hold the DRM key The identification reader can read a smart card or similar module with memory or can read a fingerprint in order to authorize automatic use of the DRM key to exercise DRM evidenced rights When a user Feb 22 2007 visits a neighbor s console they may take along their hand held remote and the associated digital rights for use on the neighbor s console or other device 0030 Another feature that can be combined with any of these embodiments is personalization based on a single action a swipe of the fingerprint reader Coupled wirelessly to the fingerprint sensor software is a personalization mod ule If a user does not identify himself by swiping the fingerprint sensor then a generic profile is applied to per sonalization of music movies photos videos files and telephone access If the user swipes the fingerprint sensor then personalization can be applied analogous to switching users in current Windows XP implementations This degree o
46. ower supply used may be a standard mini ITX power supply A standard 12 volts DC power module also can be used for this purpose The power supply board includes DC DC converters to provide output voltages of 12V 12V 3 3V and 5V DC similar to an ATX power supply These power supply tapping is used in the carrier board to supply power to the add on modules such as socket modem WLAN and Bluetooth modules Console software 0258 Introduction 0259 A Linux core runs on the VIA Eden processor The module drivers loaded on the OS core takes control the peripheral devices A dedicated software application running parses data received wirelessly such as over Bluetooth It also redirects the data to corresponding modules 0260 Modules 0261 The modem connected with the host system moth erboard is used to make the dial up connections This makes the socket modem module as a portable one 0262 On the console or host system processor side the serial driver initializes and configures the serial port baud rate equal to the modem baud rate An appropriate modem driver is loaded to manipulate the connected socket modem A WLAN module is a port of the Linux WLAN driver adapted to the host board The USB WLAN modules iden tified from Linksys and NetGear use the same driver Once the WLAN hardware is connected to the USB port it is logically connected to the access point using the WLAN control utility 0263 A suitable Linux Blue
47. put 10 P1 1 SCAN LINE 10 Keybd Scan ine 10 K130 10 Keybd P1 4 SCAN LINE 11 Keybd Scan output 11 ine 1 K130 11 Keybd P1 6 SCAN LINE 12 Keybd Scan output 12 ine 12 K130 12 Keybd PI SCAN LINE 13 Keybd Scan output 13 ine 13 US 2007 0042767 A1 0111 The LCD display 133 DD12803AAD in one embodiment is a 128 32 dot matrix LCD module The LCD Module can be easily accessed via parallel micro controller GPIO interface Its features include 0112 Transflective display mode and positive type B W mode FSTN LCD 0113 Graphic 128 32 dot matrix display format 0114 Parallel input data from micro controller 0115 1 33 duty multiplexing ratio 0116 1 16 bias 0117 6 o clock viewing direction 0118 Dimension outline 35 W 28 9 H 1 75 D mm 0119 Resolution 128 32 dots 0120 Active area 29 66 W 8 45 W mm 0121 Dots pitch 0 232 W 0 265 H mm 0122 Dots size 0 202 W 0 235 H mm 0123 The ITT Industries Cannon TBWB2A00 trackball 123 is a miniature all directional scanning switch devel oped for mobile remote PDA notebook PC and hand held device applications It includes two perpendicular rollers actuated by friction on the ball and two spring contacts which generate by contact closing and opening the elec trical pulses and a light tactile effect click at each pulse A switch called Select is integrated in the trackball Opti mally two LEDs can be included with the trackball and driven
48. remote and a bread box or smaller sized console in wireless commu nication with the remote wherein the palm held remote integrates at least a fingerprint reader a speaker microphone and volume control adapted for use as a telephone a display at least capable of showing a telephone number a cursor control and trigger adapted to select and control resources of the console a compact keypad including numeric keys usable for telephone dialing the compact keypad further including alphabetic keys usable for web browsing wherein the bread box or smaller sized console integrates at least a DVD CD player a network port and logic and resources adapted to authenticate users of the palm held remote and person alize their telephone network connection and their Internet browsing based on fingerprints received from the palm held remote connect the palm held remote to the telephone network connect the palm held remote to the Internet and dis play web pages on a monitor or television control channels accessed by a video receiver drive speakers and provide volume control provide playback control for the DVD CD player and access and playback digitally stored music whereby the palm held remote allows a user of to select among and use the bread box or smaller sized con sole s user authentication and personalization tele phone network connection Internet browsing chan nel control volume control DVD CD playback
49. rint identification sensor IC 121 This product combines sili con based image capture with a proprietary sensor control and matching algorithms to deliver ability to acquire ATA fingerprint images and authentication AuthenTec s Entre Feb 22 2007 Pad AES3400 utilizes TruePrint Technology allowing the sensor to look past the easily obscured outer surface of the skin to the living layer below where the unique ridge and valley patterns of the fingerprint originate Trueprint is AuthenTec s unique patented imaging technology During imaging a small near field signal is generated between the IC and the finger s living tissue layer 16 384 individual elements in the sensor matrix form a planar antenna array that receives this signal creating a digital pattern that accurately reproduces the fingerprint s underlying structure A powerful utility within TruePrint is Dynamic Optimiza tion This tool analyzes each image controlling up to 15 sensor parameters to optimize the fingerprint image regard less of unusual skin conditions or surface contamination The TruePrint high quality fingerprint imaging technology enables reliable authentication 0127 The fingerprint sensor is small battery friendly and well suited to Bluetooth communications These sensors automatically generate interrupts and reduce system over head needed for finger detection 0128 Features of the fingerprint component in one embodiment include 0129 True
50. ronics markets of developed and developing countries includes a communications and multi media con sole and a wireless remote The remote may resemble a handheld personal computer HPC a palm held personal computer PPC or PDA or a smart phone but has a low cost and feature set supported by the console that is novel in the consumer electronics market In particular this disclosure relates to combining telephone service device control and optionally a fingerprint reader for easy user identification authorization and personalization As another option a cam era can be incorporated into the remote thereby enabling video conferencing and other visual features Alternatively the remote may be packaged separately from a console and sold to interact with capabilities of a communications and console set top box multi media PC or other consumer electronics device from a different source such as one running on a Windows OS X or Linux platform with or without telephone capabilities The remote may include a media reader and remote USB port Particular aspects of the present invention are described in the claims specification and drawings BRIEF DESCRIPTION OF THE DRAWINGS 0007 FIG 1 is a block diagram of the digital butler remote 0008 Details of the main processor are depicted in FIG 2 0009 The LPC 2132 memory maps are shown in FIG 3 0010 FIG 4 shows the 8051 LPC89LPC931 controller 0011 FIG 5 shows the ZV4301
51. screen display Sometimes the array of buttons antici pates that no screen will be available for display Other times the manufacturer overbuilds the remote control They attempt to expose all of the functionality of the host device through individual keys on the remote The sheer number of keys sometimes pushes controlled devices into states of operation that are surprising confusing and difficult to undo A high resolution display on the remote control can enhance the user interface For devices that accept keyboard or joystick mouse responses to an on screen display the remote can substantially duplicate the look and feel of the on screen display In this instance substantially means to the extent allowed by the form factor of the remote display For instance the same HTML code may be differently rendered to the on screen display and the remote display given the different dimensions of the displays 0241 Anon screen menu and controls module can render a control interface translating a device menu and controls display that would normally appear on a TV or monitor for reproduction on a display that is part of the remote To implement this capability a menu generating device can assemble on screen menus and controls as a separate data stream apart from any video image that the menus and controls overlay The data stream can be supplied both to the device s own on screen overlay generator and to a commu nications module coupled to the r
52. sible Wireless network router 0269 Supported by the hand held remote one or any combination of the following Fingerprint Optional Speaker Mic Vol control Display Cursor Control Thumb board Alphanumeric Video Camera Media Reader USB port 0270 Applied to the following services Communication including Phone LL Cell IP Internet email and text voice video messenger Entertainment including Multimedia apps including TV PVR DVD Video Photo Music Radio and Games Productivity apps such as a personal information manager PIM contacts calendar editor Some Particular Embodiments 0271 The present invention may be practiced as a method or device adapted to practice the method The same method can be viewed from the perspective of a console adapted for use with a remote a remote adapted to control a console or a combination of console and remote 0272 While the present invention is disclosed by refer ence to the preferred embodiments and examples detailed above it is understood that these examples are intended in an illustrative rather than in a limiting sense It is contem plated that modifications and combinations will readily occur to those skilled in the art which modifications and combinations will be within the spirit of the invention and the scope of the following claims US 2007 0042767 A1 We claim as follows 1 A multi media and communications system including a palm held
53. sts the pictures taken The persistence at the other device can simplify the remote and reduce its cost as only temporary buffering in the remote is needed 0024 An aspect of this disclosure that can be combined with any of the foregoing embodiments is remote on screen menu and controls display translating a device menu and controls display that would normally appear on a TV or monitor for reproduction on a display that is part of the remote To implement this capability a menu generating device can assemble on screen menus and controls as sepa US 2007 0042767 A1 rate data stream apart from any video image that the menus and controls overlay The data stream can be supplied both to the device s own on screen overlay generator and to a communications module coupled to the remote The remote uses the data stream to render the on screen display in a legible format adapted to the reduced size of a screen on the remote Preferably the menu and control organization for mat on the remote mimics what the viewer can see on the screen to minimize confusion Technologies such as a subset of HTML and JavaScript allow a designer to specify a menu and control layout in terms that permit rendering to a variety of display sizes Remote display of the on screen menu and control data stream may preempt a video image display or may be overlaid on top of the video image Optionally the device s on screen menu and controls can be supplied to the remote
54. t is assigned to FIQ the VIC combines the requests to produce the FIQ signal to the ARM processor The fastest possible FIQ latency is achieved when only one request is classified as FIQ because then the FIQ service routine can simply start dealing with that device But if more than one request is assigned to the FIQ class the FIQ services routine can read a word from the VIC that identifies an FIQ source that is requesting an interrupt Vectored IRAs have middle priority Sixteen of the interrupts can be assigned to this category Any of the interrupt requests can be assigned to any of the 16 vectored IRQ slots among which slot 0 has the highest priority and slot 15 has the lowest Non vectored IRQ s have the lowest priority 0064 The VIC combines the requests from all the vec tored and non vectored IRAs to produce the IRQ signal to the ARM processor The IRQ service routine can start by reading the register from the VIC and jumping there If any of the vectored IRAs are requested the VIC provides the address of the highest priority requesting IRAs service rou tine otherwise it provides the address of a default routine that is shared by all the non vectored IRAs The default routine can read another VIC register to see what IRAs are active 0065 The LPC 2132 contains two UARTs 246 One UART provides a full modem control handshake interface the other provides only transmit and receive data lines The features of UART is listed belo
55. terrupt capabilities 0102 400 kHz byte wide 12C bus communication port 0103 Eight keypad interrupt inputs plus two addi tional external interrupt inputs 0104 Four interrupt priority levels 0105 On chip power on reset allows operation without external reset components A reset counter and reset glitch suppression circuitry prevent spurious and incomplete resets A software reset function is also available 0106 The keypad 8x13 matrix 406 is connected to the GPIO lines of P89LPC931 micro controller 404 The keypad has 8 return lines and 13 scan lines The return lines are connected to the keyboard port of the P89LPC931 micro controller The P89LPC931 is connected to the main pro cessor LPC2132 through the 12C bus to minimize the number of pins on the main processor 0107 The custom software is loaded into the flash pro gram memory of the P89LPC931 micro controller which scans the keypad and generates ASCII codes and commu nicates to the main processor through the I2C bus The P89LPC931 micro controller is normally kept in power save mode and it will awaken in response to keyboard interrupts after the key press The keyboard port of P89LPC931 has a change on status interrupt feature and hence any key press Feb 22 2007 will generate the keyboard interrupt The key bounces are taken care of by the software 0108 The QWERTY keyboard may have a Chinese char acter entry feature and the software transfers t
56. the palm held remote include an LCD interface module a keyboard interface module a fingerprint sensor module trackball or other directional device interface module and a Bluetooth module Other wireless protocols such as IEEE 802 1 x protocols can be substituted for Bluetooth Wireless protocols developed for cordless telephones also might be used Data is trans mitted and received over Bluetooth or another wireless connection between the console and the palm held remote in a custom data format In this format a record may have fields including start of packet packet type links data and checksum Different packet types are assigned to keyboard trackball fingerprint and LCD packets The start of packet field indicates that the packet starts here For instance Ox 7C can be used as a start of packet flag A data field of just two bytes may be sufficient When the checksum contains an XOR of all the data link and packet type fields the checksum field can be used to discard corrupted data pack ets 0238 Audio support enables the remote to act as a remote speaker and or microphone system for the host system Audio support can be for mono stereo or other advanced sound reproduction modes The audio can function in an on the ear mode e g like a telephone headset with a headset or as a speaker phone These audio features can enable telephonic capabilities for voice place shifting audio from the host location to another room or floor i
57. tip sensor with 121 SPI interfaces Bluetooth SOC ZV4301 Zeevo or Bluetooth SOC with 132 equivalent by Broadcom or UART interface RSMD Flash Memory 131 AT49BV802A Atmel Bluetooth SOC Flash 8 Mb Single rail codec Micro power syn chronous 600 ma Buck Boost De DC cconverter Codedc IC 141 MSM7716 OKI Power Supply 113 LTC 3440EDD Linear Technology 0040 Additional details of the main processor are depicted in FIG 2 The LPC2132 100 is based on a 32 16 bit ARM7TDMI S CPU 232 with real time emula tion and embedded trace support together with 64 Kbytes KB of embedded high speed flash memory 223 A 128 bit wide memory interface 211 212 222 and accelerator architecture enable 32 bit code execution at maximum clock rate For critical code size applications an alternate 16 bit thumb mode reduces code by more then 30 with mini mal performance penalty Due to their tiny size and low power consumption these micro controllers are typically used for miniaturized applications such as hand held equip ment Most peripheral pins can also be remapped as General Purpose I 0 pins The system includes on chip SRAM of 16 KB 213 and is well suited for communication gateways and protocol converters soft modems voice recognition and low end managing providing both large buffer size and high processing power Various 32 bit timers 247 248 10 bit 8 channel ADC s 226 10 bit DAC 227 PWM channels 225
58. tooth software stack is BlueZ Processing data from the stack involves developing parsing the data received from the remote The communi cation with the remote is established using the Bluez utilities from the host for remote headset and serial port function alities Once the application knows the source of the data packet it redirects the data to the appropriate module for the required functionality The software also provides a facility to send the data to the LCD available on the remote side The application developer can use the fingerprint raw data received from the Bluetooth remote and the authentication code libraries provided by the vendor to achieve the match ing operation 0264 The console may support the following functions 0265 Bluetooth remote access 0266 WLAN enabled for network communication 0267 Socket modem module for dial up network con nection Feb 22 2007 0268 The following combinations of hardware and soft ware features are within the scope of this disclosure for providing services described Supported by the console one or any combination of the following General Purpose Computer TV Set Top Box w optional personal video recorder PVR Terrestrial Cable Satellite IP Messaging console one or any combo Text SMS Webpages Voice Landline cell IP Video Network Port TV and or Monitor Out Optionally Hard Drive Media Card Reader non volatile memory CD DVD Writable versions pos
59. track ofthe user s intermediate selections until they are sent to the host Or a Java or similar application could replicate the states of the host More simply the display could be essen tially stateless and rerendered by the host after each data transfer from the remote to the host 0244 The form factor of the remote display could alter natively be a full display with touch sensitive areas and US 2007 0042767 A1 rendered buttons that provide visual and or audio feedback as opposed to the tactile feedback of pressed buttons 0245 The keyboard module of the remote is imple mented using an 8051 The key press data is sent to the main microcontroller through an I2C interface for further process ing The keyboard is a matrix keyboard including 13 scan lines and eight return lines A key press causes the 8051 to generate make and break codes along with key press values This data is given to the main micro controller which operates in an interrupt mode Here the 8051 acts as a master and the LPC2132 acts as a slave 0246 Fingerprint sensor software uses SPI code on the main controller The fingerprint data will be sent in a particular packet format over the wireless link to be pro cessed on the host side Authentec provides a useable appropriate library of routines for fingerprint authentication 0247 Coupled to the fingerprint sensor software is a personalization module If a user does not identify himself by swiping the
60. urces of the console are further adapted to treat the USB connector and port as local to the console 28 The remote control of claim 25 wherein the display is adapted to show menu and control infor mation from the media center the palm held remote further integrates logic and resources adapted to reproduce menu and control infor mation received from the media center on the display and to invoke glue logic running on the media center by wirelessly directing menu and control navigation input to the media center and the glue logic invoked wirelessly by the remote control is adapted to process the menu and control navigation input and control features of the media center
61. w 0066 16 byte receive and transmit FIFO s 0067 Register locations conform to 550 industry standard 0068 Receiver FIFO trigger points at 1 4 8 and 14 bytes 0069 Built in baud rate generator 0070 Standard modem interface signals included on UART 1 0071 2C 244 is a bi directional bus for inter IC control using only two wires a serial clock line SCL and a serial data line SDA Each device is recognized by a unique Feb 22 2007 address and can operate as either a receiver only device or a transmitter with the capability both to receive and send information 0072 Transmitters and or receivers can operate in either master or slave mode depending on whether the chip has to initiate a data transfer or is only addressed I2C is a multi master bus that can be controlled by more than one bus master connected to it 0073 12C implemented in LPC2132 support bit rate up to 400 kbit s Fast I2C The features of LPC2132 I2C bus is listed below 0074 Standard I2C compliant bus interface 0075 Easy to configure as master slave or line select master or slave 0076 Programming clocks allow versatile rate control 0077 Bi directional data transfer between masters and slaves 0078 Multi master bus no center master 0079 Arbitration between simultaneously transmitting masters without corruption of serial data on the bus 0080 Serial clock synchronization allows devices with

Stepanian

Contents

Download Pdf Manuals

Related Search

Related Contents