Home

Infrared Imaging Sensor Brick for Modular Robotics

1. Design 1 and Design 2 zip drive manufacturer s website http www iomega com na products product_family jsp FOLDER 3C 3Efolde r 1d 432677 amp ASSORTMENT 3C 3East_ id 63 191 amp bmUID 1076946066400 15 Dealtime Design 1 and Design 2 CD ROM drive manufacturer s website http www dealtime com xPF Hewlett_Packard_ HP DC143B 16 Mini box Design 1 power module manufacturer s website http www mini box com pw 70a htm 17 Linksys PCI slot based 802 11g W LAN network adapter card manufacturer s website http www linksys com products product asp grid 33 amp scid 36 amp prid 520 18 Linksys USB port based 802 11g W LAN network adapter card manufacturer s website http www linksys com products product asp erid 33 amp scid 36 amp prid 578 19 Panasonic 12V Panasonic battery LC RA1212P manufacturer s website http www panasonic com industrial battery oem chem seal sla_discont htm 20 Vicor Corporation 12V to 15V dc to dc converter manufacturer s website http www vicr com 21 V Infinity LLC 12V to 5V dc to dc converter manufacturer s website http www v infinity com 46 Appendix I The below specified design of the thermal sensor brick was done during fall 2003 as part of my ECE 573 course This design was taken as reference and modifications done to it so as to develop the final design of the thermal sensor brick that has
2. 2 4 input option Hard disk Barracuda ATA V an 80 GB 7200 rpm hard disk from Seagate was the one selected for that system It had an average seek time of 9 4 ms and an Ultra ATA 100 interface 12 The model product number was ST380023A Some of its major advantages were It had a 7200 rpm desktop performance which helped to improve the overall PC performance The 2 MB cache buffer on it also helped to improve its performance significantly It had a 350 Gs non operating shock which gave the drive protection from all shocks and vibrations The Ultra ATA 100 interface on it allowed it to transfer data at the fastest possible transfer rates The 3D defense system on it provided for a comprehensive drive and data protection system Floppy drive or ZIP drive we suggested to fit a floppy drive and a ZIP drive and 48 keep the option of choosing any one or both of them as per the need be The floppy drive would have been a 1 44 MB floppy drive and the ZIP drive would be Zip a 750 MB USB 2 0 external drive from iomega 14 e CD ROM drive we also suggested to fit a CD ROM drive to the computer It would have been a 48 X Hewlett Packard HP DC143B Internal CD ROM Drive 3 which had a volume of 68 in and a weight of 800 grams 15 e Power supply the CPU setup required a regulated power supply The power supply that was designed to be on the CPU was PW 70 MINI ITX dc to dc converter it was a 70W dc t
3. The images obtained from the infrared camera are RGB images that consist of three color channels and so you need to obtain the intensity image from this that gives us the image representative of the intensity variations in the original input image The first operation that was done on the image was to obtain the intensity image from the RGB image This was done for both the background image and the current image and we obtained the difference image from them Then we obtained the histogram for all these intensity images The output from this operation on the sample images looked like the one shown in Figure 3 9 below 21 Original RGB Image Original Intensity Image Histagram of the Intensity Image 2000 1500 1000 s00 FGE Image of the Background Intensity Image of the Background Histogram of the Intensity Image of the Background 1500 1000 S00 0 0 s0 100 450 200 250 Difference Image in double format Difference Image in uing format Histogram of the Difference Image 10000 Figure 3 9 The current and the background RGB images their obtained intensity images and their respective histogram plots 3 2 2 Pseudo coloring the input images The other operation that was felt necessary was to pseudo color the intensity image using different color bars Since both the original RGB image and the intensity image were gray scale images we felt that a colored image would help us in getting a better understanding of the image de
4. designers who might review this work to get an understanding of the evolution process 8 DESIGN 2 Central Processing Unit of the brick Sensor Shuttle PC with 802 11g W LAN for Omega infrared camera and its power setup communication connected to it through the USB port on it Table A 1 Hardware architecture of the thermal sensor brick which was redesigned the first time to make the CPU smaller in size Sensor the infrared sensor on our brick was the Omega infrared camera manufactured by Indigo systems The camera had its own power setup It had a battery pack which consisted of rechargeable lithium batteries that could provide up to 2 hours of camera power The video output was obtained via an RCA connector The battery pack and charger could ensure up to 4 hours of camera operation in suitable environments 5 The Central Processing Unit this was where the images captured by the Omega infrared camera would be obtained stored processed and transmitted The CPU was a ST62K ATI RS300 based XPC It was a Shuttle PC 9 Figure A 2 shows pictures of the front and back panels of the shuttle PC All the below mentioned technical specifications of the Shuttle PC have been obtained from the official website of Shuttle Inc 9 e Processor Intel Pentium 4 Celeron in the 478 pin package with 400 533 800MHz FSB e Chipsets ATI RS300 IXP150 Support dual channel DDR200 266 333 400 DDR SDRAM interface Built in ATI Radeon 9100
5. 2 2 1 Central Processing Unit This is where the images captured by the Omega infrared camera would be obtained stored processed and transmitted The CPU is Toshiba Satellite Notebook A10 S129 Celeron 2 4G 15 TFT 256MB 40GB DVD CDRW 56K LAN WinXP Pro This is a notebook computer manufactured by Toshiba 7 All the below mentioned specifications of the Toshiba Satellite Notebook A10 S129 have been obtained from Newegg com official website The Toshiba Satellite Notebook computer is as shown in Figure 2 4 below Model Number Toshiba Satellite A10 S129 PSAIOU OZH6M 7 Processor Intel Celeron 2 4 GHz 400 FSB 256KB L2 Cache Chipsets Intel 852GM Display 15 TFT 1024 x 768 24bit Operating System Microsoft Windows XP Professional Vv Vv Y VW V YV Graphics Intel 852GM integrated graphics controller 32MB shared memory external and a maximum resolution of up to 1920 x 1440 M User Interface Full sized 85 keys with 12 function keys keyboard touchpad gt Sound Analog Devices AD1981 Codec Chip Software Sound Sound Blaster Pro Compatibility Ports external microphone port headphone port line in port gt Memory x 256MB 2 x 184 pin DDR Max capacity 1GB gt PC Card Slot Supports 1x Type II PC Card gt USB 2 x USB2 0 12 gt Others o 1x RJ 45 LAN port o l x Parallel Port o 1x VGA Pott o 1x RJ 11 Modem port gt Dimension 13 0 L x 11 5 W x 1 5 H inches gt Wei
6. 3 lenses 1Imm 18mm and 30mm that are part of the optional accessories for the Omega camera This picture has been obtained from the official website of Indigo Systems Corporation The Omega has both an analog and a digital output It 1s also capable of delivering wide dynamic range 14 bit images at real time video rates 30 fps for RS 170 A or 25 fps for CCIR 5 A function in the Omega called auto ranging spots out extremely hot scenes and decides to switch into an extended temperature range mode thereby allowing to image scenes up to 400 C 5 There is an internal shutter that continuously recalibrates the camera automatically or can be manually overridden This helps in process monitoring applications 5 The analog video output utilizes a feature called Smart Scene which helps to enhance picture quality for all the scenes This feature uses a dynamic non linear conversion to process the 14 bit digital image data into 8 bit data for analog video 5 The conversion algorithm automatically adjusts frame by frame to maximize the contrast in darker colder parts of the frame while trying to avoid blanking of brighter hotter objects in the image frame The advantage of this feature is that we automatically get a continuously optimized image which is independent of scene dynamics 5 The camera also comes in with a proprietary image optimization system that pre processes the image data and eliminates the need for temperature
7. Input voltage 12V Dimensions 1 25 X 0 8 X 0 4 116 9 mm X 61 0 mm X 12 7 mm Table 2 7 Technical specifications of 12V 5V dc to dc converter manufactured by V infinity 17 3 Architecture As is clear from the above sections the sensor brick consists of four major blocks Firstly the sensing and image acquisition block which mainly consists of the sensor the Omega infrared camera and the frame grabber video capture card on the CPU to obtain live analog data Second is the processing and fusion block here 1 e in the CPU is where the data acquired by the sensor would be operated on and some basic pre processing of thermal data done through use of software Thirdly comes the communication block for transmitting this acquired and processed data to the host computer or to the server so that it is available for further use and interpretation by users located far away from the sensor brick Finally comes the power block which manages the power supply for each and every block of the sensor brick for continuous and steady operation of the sensor brick components In this section we shall deal with both the hardware and the software architecture of the infrared imaging sensor brick We shall firstly take a look at the progression of the thermal sensor brick design and then look in detail at the packaging of the thermal sensor brick that has been built by us as part of the hardware architecture Secondly we shall deal with t
8. based 2D 3D graphic core e Memory 2 x 184 pin DDR SDRAM DIMM slots Support PC1600 2100 2700 3200 compliant DDR SDRAM up to 2GB capacity e VGA Integrated high performance ATI Radeon 9100 graphic core 50 TV out Support NTSC and PAL format in S video composite terminal support maximum input active resolution up to 1024 x 768 Onboard header 2 x UDMA100 IDE ports CD_in amp Aux CD_in headers 4 pin ATX 12V SV power header 3 fan connectors Parallel port IrDA header Dual USB ports header SPDIF in header Nee Bea TEEE1394a VIA VT6307 compliant with 1394 OHCI specification version 1 0 up to 400Mb s data transfer rate Fast Ethernet Onboard Realtek 8100C supports 10 100 LAN operation PCI slot 1x 32bit 33MHz PCI slot Audio On board Realtek ALC650 six channel audio Front panel 1 2x USB ports 1 x Line in 1 x Mic in 1 x Line out 2 1 x Power ON button 1 x Reset button Back panel 2 USB 2 0 ports 2 IEEE 1394 connectors 1 PS 2 keyboard port 1 PS 2 mouse port 1 Rear out 1 Front out 1 Center Bass connectors 1 RJ45 LAN port 1 Serial port 1 VGA port SPDIF out 1 TV out port Clear CMOS button 12V power adapter connector See a Extension bay 2 x 3 5 bays 1 x 5 25 bay Dimension 190 L x 170 W x 280 H mm 2 1Kg N W 5 2Kg G W Material Aluminum Power adapter Dimension 178 x 120 x 54 5mm Input 90 264V AC Output 12V 180W Power cord depends on specific region
9. been implemented It has been mentioned here as a reference for future designers who might review this work to get an understanding of the evolution process 8 DESIGN 1 Central Processing Unit of the Sensor 802 11g W LAN for Brick Communication motherboard processor RAM Omega infrared The power for the W LAN frame grabber card hard disk camera and its would be drawn from the CPU floppy drive CD ROM drive power setup power system because the two and power supply would never work in isolation Figure A 1 Hardware architecture of the original design for the thermal sensor brick This design was done as part of my fall 2003 ECE 573 course Sensor the infrared sensor on our sensor brick was the Omega infrared camera manufactured by Indigo systems The camera came equipped with its own power setup It had a battery pack that consisted of rechargeable lithium batteries and could provide up to 2 hours of uninterrupted camera power The video output could be obtained via an RCA connector The battery pack and the charger could together provide up to 4 hours of camera operation in suitable environments 5 The Central Processing Unit here was where the thermal images captured by the Omega infrared camera were supposed to have been procured stored processed and transmitted The components that would have gone in to make the CPU were e Motherboard the motherboard that was originally selected for our sensor brick was th
10. is what has led to the evolution of the brick design Earlier the camera used to power itself using its own battery pack and the CPU had its own battery setup These two battery setups would make up the power block which would provide power supply to all the brick components Now the power block which provides for the entire power supply requirements of the brick consists of a 12V Panasonic battery LC RA1212P and a 12V 100W 15V 75W dc to dc converter manufactured by Vicor Corporation that powers the laptop CPU and a 12V 5V dc to dc converter manufactured by V infinity to power the camera Figure 3 2 below shows the previous component wise diagram of the thermal sensor brick and Figure 3 3 shows the current component wise diagram of the thermal sensor brick VCE PRO Figure 3 2 Original component wise diagram 20 12v 5v converter Thermal sensor Frame grabber card Remote VCE PRO host computer 9 ate 802 11g Battery Wireless card 12v 15v converter CPU Figure 3 3 Current component wise diagram Figure 3 4 Evolution of the infrared imaging sensor brick packaging The process of developing a packaged infrared imaging sensor brick system was an evolving one and the packaging went through changes over times Figure 3 4 above 21 shows the evolution of the thermal sensor brick packaging Seen in Figure 3 5 and Figure 3 6 below are different views of the finally packaged infrared imaging sensor
11. on Control and Automation 18 20 June 2003 Braga Neto Ulisses Manish Choudhary and John Goutsias Automatic target detection and tracking in forward looking infrared image sequences using morphological connected operators 33rd Annual Conference on Information Sciences and Systems CISS 99 Vol I pp 173 178 Baltimore MD March 1999 Eveland Christopher K Diego A Socolinsky Lawrence B Wolff Tracking human faces in infrared video CVPR Workshop on Computer Vision beyond the Visible Spectrum Kauai December 2001 Fang Yajun Ichiro Masaki amp Berthold K P Horn New night visionary pedestrian detection and display systems Artificial Intelligence Laboratory MIT Cambridge MA Feller Steven D Evan Cull David Kowalski Kyle Farlow John Burchett Jim Adleman Charles Lin David J Brady Tracking and imaging humans on heterogeneous infrared sensor array for tactical applications SPIE Aerosense 2002 April 2002 Fujiwara Hideto Makiko Seki Kazuhiko Sumi and Hitoshi Habe The vehicle tracking method using texture based background subtraction Proceedings of the 7 Symposium on Sensing via Image Information pp 17 22 2000 Haritaoglu Ismail David Harwood and Larry S Davis Wf Who When Where What a real time system for detecting and tracking people Proc Third International Conference on Face and Gesture Recognition pp 222 227 Nara Japan April 14 16 1998 Haritaoglu
12. stabilization of the array 5 This helps in operating over a wider temperature range Hence the system does not need a thermoelectric cooler and this helps in saving on the power consumption 5 The absence of a TE cooler also helps in giving a very fast turn on time which is highly advantageous 5 2 1 2 Imperx VCE PRO Frame Grabber video capture card After having dealt with the infrared sensor the Omega infrared camera the other equally important component of this block that we need to look at is the video capture frame grabber card The video capture card that we have fitted to the CPU on our system is IMPERX VCE PRO Fast Analog CardBus video capture card manufactured by Imperx Inc 6 This video capture card is necessary for capturing analog video sequences directly from the Omega infrared camera The IMPERX VCE PRO is a PCMCIA based video capture card and is inserted in the PCMCIA slot on the CPU An S Video to RCA adapter cable is used to connect the Omega camera and the frame grabber card The video capture card thus helps us in grabbing live streaming video captured by the camera The card comes in with its own graphical user interface GUI which helps us in controlling all its operations The VCE PRO offers us a high performance full frame capture PC CardBus 8 0 based capture card 6 This card is perfectly suited to our design since it is like a plug and play device with hot insertion and removal so this means that we need not ha
13. the infrared imaging sensor brick implemented by us 2 1 Sensing and Image Acquisition Block The first and the most important block of the sensor brick that we need to deal with is the Sensing and Image Acquisition block On our sensor brick we have an infrared sensor the Omega infrared camera now known as ThermoVision Micron to capture infrared images The Omega infrared camera is the world s smallest and lightest infrared camera This camera was developed in 2002 as part of a joint venture program between Night Vision and Electronic Sensors Directorate NVESD a US army communications command research and development center and Indigo Systems Corporation of Santa Barbara CA The Omega belongs to the UL3 family of infrared cameras manufactured by Indigo systems 5 The Omega is a commercial off the shelf COTS thermal imager and has features like being the smallest in size 3 5 cubic inches lightest in weight 102 grams and has a very low power consumption lt 1 3 W Kostrzewa I It employs a 164 X 120 uncooled microbolometer focal plane array FPA and is extremely well suited for applications like security search and remote surveillance miniature unmanned aerial vehicles UAV s weapon sights checking mine fields and in unattended ground sensors UGS Kostrzewa I It finds applications for military purposes like unattended networked sensor guarding of points as in our case by a modular unmanned robot commercial applicati
14. 2V battery and then used two dc to dc converters to obtain the desired voltages so as to make all the bricks Vision Laser and Thermal bricks similar to each other and also to maintain the modular nature of the thermal sensor brick This was felt necessary since on a broader perspective all these bricks are part of the same robot 25 Power Cost Name of the component Units Omega infrared camera now known as ThermoVision Micron A thermal camera manufactured by Indigo systems 1 1 5 W input 16 000 Toshiba Satellite Notebook A 10S129 a 2 4 GHz Celeron notebook computer manufactured by Toshiba Inc Panasonic LC RA1212P 12V 20Ah lead acid battery VI 200 full size 12V 100W 15V 75W dc to de converter from Vicor VASIRS5 S12 S5 12V 5V dc to dc converter from V infinity LLC IMPERX VCE Pro Fast Analog CardBus 1 60 W input 1 000 l 240 W output 100 W input 75 W output 12 W input 1 5 W output 125 25 645 345 SDK video capture card for laptops from IMPERX 990 WUSB54G 802 11g standard based W LAN network adapter card from Linksys Printed circuit board 12V 0 29 A Brushless CPU fan Input Output module power video RS 232 and serial digital interface 12V 5A ON OFF Switch Connection splitters Q power connector Locking DC plug Velcro strips 6 32 1 4 inch screws washers and nuts 6 32 2 inch screws washers and nuts 6 32 1 inch screws washer
15. 30 fps Adjustable image brightness contrast Image controls l saturation and hue 24 bit RGB image or gray scale image and Image formats 8 bit gray scale image Single frame Multiple frame and Standard Frame capture avi clips PCMCIA Type II 85mm 3 3 in X 54mm 2 1 in X 5mm 0 2 in Operating voltage 3 3 V 5 Dimensions Operating current 160 mA Inrush current 350 mA Operating temperature 0 C 65 C Relative humidity 90 non condensing Operating system Windows 2000 and XP Adjustable frame rates Programmable date and time recording and capture delay of up to 60 minutes Additional features BMP and adjustable JPEG file formats Automatic NTSC PAL format detection and automatic gain control 16 bit YCrCb 4 2 2 digital output Table 2 3 Technical specifications of IMPERX VCE PRO Fast Analog CardBus video capture frame grabber card 11 2 2 Processing and Fusion Block After having seen the Sensing and Image Acquisition block of the sensor brick the next block that we need to deal with is the Processing and Fusion block Here 1 e in the CPU the data acquired by the sensor using the analog capture card fitted on the CPU would be captured and some low level image processing operations would be done on these captured images This is all the processing that is done at the level of the sensor brick and the processed images are available to the remotely located host computer for further use
16. I that was being developed for the infrared imaging sensor brick system This is a dialog based GUI to be used for human and intrusion detection ssseseeseeeseseeeesseessessssssssssssssssssssssessssessssssssssseeseeeeo 34 Figure 3 16 Screen shot of the future version of the GUI that was being developed for the infrared imaging sensor brick system This is a dialog based GUI to be used for under vehicle inspection for threat detection nssssssoeeeesssssssseeerssssssssseerrsssssssees 35 Figure 4 1 Under vehicle thermal video sequence for variations with time 37 Figure 4 2 Under vehicle thermal video sequence Normal expected results 38 Figure 4 3 Under vehicle thermal video sequence Normal expected results 39 Figure 4 4 Under vehicle thermal video sequence Hidden object cc cceeeesseeeeeeeeeees 40 Figure 4 5 Under vehicle thermal video sequence Threat object cccsseeeeeeeeeeees 4 Figure A 1 Hardware architecture of the original design for the thermal sensor brick This design was done as part of my fall 2003 ECE 573 COUurse ccccccseeeeeeeeeeeeeeeees 47 yi 1 Introduction The infrared imaging sensor brick for modular robotics that has been implemented by us has been both designed and built with main focus being set on its modularity and self sufficiency Since the sensor brick that has been built is a highly modular system such a s
17. Infrared Imaging Sensor Brick for Modular Robotics PILOT Project In Lieu of Thesis Presented for the Master of Science Degree The University of Tennessee Knoxville Nikhil Arun Naik December 2004 Acknowledgements First of all I would like to thank my parents Mr Arun B Naik and Mrs Rati A Naik for having given me an opportunity to pursue my Master s degree They have always backed me in all my endeavors and I am highly indebted to them I would sincerely like to thank my professor Dr Mongi A Abidi for his moral academic and financial support during my Master s study here at the University of Tennessee Thank you for showing faith in my abilities and in giving me an opportunity without you it would not have been possible for me to achieve my goals Secondly I would like to thank Dr Laura Morris Edwards for her sincere support to my research work at the IRIS lab She was responsible for a good part of my success I would like to thank Dr David Page for his guidance during the hardware implementation part of my Master s work He also helped in inculcating the values of professionalism in me I would like to thank Dr Andrei Gribok for helping me with the compilation of my report He spent his valuable time in guiding me on this report I would also like to thank Dr Seong Kong for agreeing to be part of my graduate committee I would like to thank Justin Acuff for his sincere help with all the computer related technicalities in
18. Ismail David Harwood and Larry S Davis Ghost A human body part labeling system using silhouettes 4th International Conference on Pattern Recognition Brisbane pp 77 82 Australia 16 20 August 1998 Jones B Design of a remotely operated intrusion detection system for security applications Proceedings of IEEE International Carnahan Conference on Security Technology pp 145 153 1993 Kostrzewa Joseph William Meyer Doug Kraemer George Poe Vu Nguyen Mark Brown William Terre Indigo Systems Corporation Santa Barbara CA and Gwendolyn Newsome U S Army Night Vision and Electronic Sensors 43 Directorate Fort Belvoir VA Use of a miniature infrared COTS sensor in several military applications Kostrzewa Joseph William Meyer William Terre Stan Laband Indigo Systems Corporation Santa Barbara CA and Gwendolyn Newsome U S Army Night Vision and Electronic Sensors Directorate Fort Belvoir VA Overview of the UL3 Omega uncooled camera and its applications Magneau Olivier Patrick Bourdot Rachid Gherbi 3D tracking based on infrared cameras Proc International Conference on Computer Vision and Graphics Zakopane Poland September 2002 Maurin B O Masoud and N Papanikolopoulos Monitoring crowded traffic scenes Proceedings of the IEEE 5th International Conference on Intelligent Transportation Systems ITSC 2002 pp 19 24 Singapore September 3 6 2002 Nakamura Masanob
19. ackodunder ve nicle roDOts irrin e e a E E a eniealeatins 23 Figure 3 7 CAD drawing of the internal layout of the infrared imaging sensor brick COMPONE 1S a a E 24 Figure 3 8 Electrical drawing showing the internal connections for the infrared imaging SEIS OF DICE aore a E ON 25 Figure 3 9 The current and the background RGB images their obtained intensity images and Their Tespective Histogram Plots rrene a 28 Figure 3 10 The current the background and the difference intensity images and their pseudo colored images using color bar HOT ssessssseeessssssssseerssssssssseerrsssssssseeeres 29 Figure 3 11 The current the background and the difference intensity images and their pseudo colored images using color bar JET essssssssseenssssssssseerrsssssssseerrssssssseeeeres 30 Figure 3 12 The current and the background RGB images their obtained intensity images the difference image and the binary difference image obtained after applyins a threshold VAN accra sled navies Mend vansebaavel unas endless 31 Figure 3 13 The edge detected difference images obtained using Sobel Prewitt Roberts V MELOT OD O reenter tame mer ate Tier one ar Ten ner emer ee elise ro ere ets nr nee tet teeter Meee errr 32 Figure 3 14 Screen shot of the current version of the GUI for the infrared imaging sensor brick that has been developed by us in Visual C Net ccceeecccccccceeeesssseeeeeeees 33 Figure 3 15 Screen shot of the future version of the GU
20. anasonic battery LC RA 1212P 16 Table 2 6 Technical specifications of VI 200 a 12V 100W 15V 75W dc to dc converter manufactured by Vicor corporation cccccccccesseeeesecceeceecaaeeeseeeceeeeeeaaas 17 Table 2 7 Technical specifications of 12V 5V dc to dc converter manufactured by V HH PANO Vator alkenes E T NE E A E anos abr RA A E E A Puta ataetinatcaciets 17 Table 3 1 Bill of materials for the infrared imaging sensor brick cccccssseeeeeeeeeees 26 Table A 1 Hardware architecture of the thermal sensor brick which was redesigned the first time to make the CPU smaller in Size 0 0 ee eeeeeesseseeeceeeecceceeeeeeeaeeeeeeeeeeeees 50 List of Figures Figure 1 1 Conceptual diagram of the self sufficient thermal sensor brick system implemented by us that is like a plug and play device cc eeeeeeececeeeeeeeeeeeees 3 Figure 2 1 The Omega infrared camera This picture has been obtained from the official website of Indigo Systems Corporation ccccccccccsssssssssseeseeeeeeeeeeeeeeeeeeeaaaeaeeeeeeeeees 6 Figure 2 2 The 3 lenses 1Imm 18mm and 30mm that are part of the optional accessories for the Omega camera This picture has been obtained from the official website of Indigo Systems Corporation nisoe E a 9 Figure 2 3 The IMPERX VCE PRO Fast Analog CardBus video capture frame grabber card This picture has been taken from the official website of Imperx Inc 10 Figure 2 4 Di
21. bot and attach it back at any desired time without affecting the main setup of the robot The brick could also exist as a stand alone system to capture infrared data and transmit it for useful purposes We will also acquire some thermal under vehicle video sequences using this thermal sensor brick These sequences will be obtained to observe variations in under vehicle conditions with respect to time and to display the advantages of the thermal camera in detecting hidden objects which may be possible threat objects and may remain occluded on a visual image We will also develop a GUI for the thermal sensor brick which will help us in data acquisition and in performing some processing operations on the acquired thermal data All in all the objective of this project is to actually build an infrared imaging sensor brick as per our own design and to test it The brick would have several applications which could include motion detection and intrusion detection face recognition pattern recognition under vehicle surveillance general area surveillance and others 1i Contents l AMI OCU CO Oiiser siesetasctsecicsutsenerensnadsncdue racins eislndenngutainanatnaseacdutsuaie e l tl Mo vyaton and OVeRVICW oarserdirir E E l L2 Missiona d App can ONS ea a a aa ai 2 2 Implementation of the Thermal Sensor Brick cccccccccccccesssseeeeeeeeeeeeaaaeeeeeeeeees 5 2 1 Sensing and Image Acquisition Block esessssseeeessssssssecrressssssseceresssssssece
22. brick system A point that needs to be noted here is that the camera can be pulled out from the box and laid horizontally This is what was done to use the thermal sensor brick as a set up for human detection and intrusion detection Figure 3 5 Different views of the packaged infrared imaging sensor brick 22 ht a fhe Pl te Ag oe Aos L hi Bell Aat WY E Oa Figure 3 6 Different views of the packaged infrared imaging sensor brick mounted on the tracked under vehicle robot The infrared imaging sensor brick that has been designed and built by us as 23 described above now has a CAD drawing showing the layout of the components inside the sensor brick as shown in Figure 3 7 it has an electrical drawing showing the wiring connections that are in place inside the box on the sensor brick as shown in Figure 3 8 and a bill of materials giving us the exact description of the components that have gone into the sensor brick is given in Table 2 8 21 0000 fi i 3000 sai its Wy Sii p 2 8000 jp 2soo 2 2500 0 2500 P 0 2500 R0250 D 1 5000 RO 5000 daam R0250 R0 1250 S7 300 6 0000 13 0000 3 7500 Figure 3 7 CAD drawing of the internal layout of the infrared imaging sensor brick components 24 12y 12 100 dc to de COMVEerier Figure 3 8 Electrical drawing showing the internal connections for the infrared imaging sensor brick We selected a 1
23. can be adjusted over a wide range of values Finally the image control section allows us to select the image format in which to save the single frame or a series of frames that are captured We have a choice between bmp and jpeg image formats Seen in Figures 3 15 and 3 16 below are screen shots of the future current version of the GUI designed us in Visual C Net ag Thermal Sensor Brick GUI Imaging Robotics and Intelligent Systems ERIS Ae Ce A TC OOR CF Image Capture Controls Single Frame 1 2 Frame Series of Frames 1 4 Frame AVI Video Gray Scale Intrusion Detection 1 Colored Intrusion Detection 2 Histogram Picture Controls Image Formats Grab Capture Exit Brightness Contrast Color Lae tS a Tee eee Low High Low High Low High Figure 3 15 Screen shot of the future version of the GUI that was being developed for the infrared imaging sensor brick system This is a dialog based GUI to be used for human and intrusion detection 34 ag Thermal Sensor Brick GUI Imaging Robotics and Imaging Robotics and Intelligent Systems Systems IRI LAB OR AT OR Y EET Image Capture Controls Single Frame 1 2 Frame Series of Frames 1 4 Frame AVI Video Gray Scale Intrusion Detection 1 Colored Intrusion Detection 2 Histogram Picture Controls Grab Capture Exit Brightness Contrast Color Ee ee ai Sd ed Low High Low High Low High Image F
24. card The second block of the sensor brick that we shall deal with is the Processing and Fusion block In this block we shall look at the preprocessing operations that are performed on the acquired images The third block is the communication block which basically deals with the 802 11g W LAN setup for the transfer of data between the host computer and the brick CPU Lastly we shall look at the power block of the sensor brick which deals with the power setup for running the camera and the CPU All these blocks which are being discussed here have actually been implemented and tested The infrared imaging sensor brick has been built on the design as shown in Table 2 1 below Sensing and Image Acquisition Block Sensor Omega infrared camera now known as ThermoVision Micron Frame Grabber IMPERX VCE PRO Fast Analog CardBus video capture frame grabber card Preprocessing and Fusion Block CPU 2 4 GHz Celeron Toshiba Satellite A10 129 Notebook computer Communication Block Wireless Card Linksys WUSB54G a USB based 802 11g standard W LAN network adapter card It has a 100 150 feet coverage area inside a room Power Block Battery Panasonic LC RA1212Pa12V battery 12V 100W 15V 75W dc to dc converter manufactured by Vicor Corporation that powers the laptop CPU 12V 5V dc to dc converter manufactured by V infinity to power the camera Table 2 1 The hardware architecture of
25. d possibly help in scouting missions like in a building or in a nuclear reactor where it could be asked to detect leaks fire see through smoke and search for victims detect for the presence of other flammable substances 2 On a larger scale the applications could include but not be limited by area surveillance checking for wanted suspects using face detection in naval operations it could be used for detecting possible oil spillage and also threat from enemy vessels at night in the dark 2 In air force they could use it for aerial surveillance and enemy detection Some of the commercial applications would include coverage of disaster footages through smoke and dark areas traffic reports even on a rainy and foggy day 2 The applications that we have focused on are under vehicle inspection by mounting the infrared imaging sensor brick on the tracked under vehicle robot and human tracking to guard a secure location by setting the brick in an area that needs to be guarded against intrusion 2 Implementation of the Thermal Sensor Brick In this section we shall be dealing in detail with the four blocks of the sensor brick that have been implemented in building the thermal sensor brick system The first and the most important block of the sensor brick that we need to look at is the Sensing and Image Acquisition block Here is where we undergo the process of image acquisition using the thermal camera and analog data capture using the video capture
26. d vibrations 52 3 The Ultra ATA 100 interface on it allowed it to obtain fastest possible data transfer rates 4 3D defense system provided a comprehensive drive and data protection system ZIP drive The ZIP drive would be Zip a 750 MB USB 2 0 external drive from iomega 14 CD ROM Drive the CPU could also be fitted with a CD ROM drive to write out data to save memory space and also to import some data if needed It would be a 48 X Hewlett Packard HP DC143B Internal CD ROM Drive which has a volume of 68 in and a weight of 800 grams 15 Communication Like in the case of our previous design we stuck with W LAN for the purpose of communication on the sensor brick The W LAN network adapter card that we selected was WUSB54G manufactured by linksys This could be fitted to the USB port on the CPU This Wireless G 802 11g helped in setting up wireless networks with speeds of up to 54Mbps and was also compatible with 11Mbps 802 11b networks 18 Since it was to be connected to the USB port on the CPU it would have operated on power drawn from the CPU 53
27. demand EART 5I e Accessories 1 x Main board user manual 1 x Main board CD driver 1 x XPC installation guide 1 x I C E technology CPU heat pipe 2 x HDD cable 1 x CD ROM cable Screws twin adhesive friendly front feet IDE power cable l 2 gt 4 5 6 7 A ELLLELLE ECEE CII 9 i F Pi Hing 2 909 Se X Figure A 2 The front and back panels of the Shuttle PC respectively This was the CPU for our revised version of the design e RAM 1 GB RAM Standard 128M X 72 ECC 133MHz 168 pin e Frame grabber card The frame grabber that we had short listed for our system was Pixelsmart5 12 8 from Pixelsmart It had a 256K image buffer with a possible up gradation to 2 4 8 16 32 64 images and could give up to 512 X 512 resolution 13 It was both NTSC and PAL compatible and had a look up table for color outputs optional false coloring 13 It came in with 1 composite video input 2 4 input option e Hard Disk Barracuda ATA V an 80 GB 7200 rpm hard disk from Seagate The hard disk had an average seek time of 9 4 ms and an Ultra ATA 100 interface 12 The model product number was ST380023A Some of its major advantages were 1 It had a 7200 rpm desktop performance which improves the overall PC performance Also it had a 2 MB cache buffer that improved its performance significantly 2 It had a 350 Gs non operating shock which gave protection to the drive from all shocks an
28. e P4GE VM manufactured by ASUSTeK computer Inc 10 11 The specifications are as given below they have been reproduced from the manufacturer s website Processor type Socket 478 for Pentium 4 Celeron up to 3 06GHz On die and Cache 512KB 256KB L2 Cache Chipset Intel 82845 GE GMCH Intel 82801 DB ICH4 Back Panel I O 1 x Parallel 1 x Serial 1 x PS 2 Keyboard 1 x PS 2 Mouse 1 x Ports VGA 1 x Audio I O 4 x USB 2 0 1 x RJ45 on LAN model only 2 x 184 pin DIMM sockets support max 2GB PC2700 PC2100 Memory FSB533 or PC2100 PC1600 FSB400 non ECC DDR SDRAM memory Front side bus 533 400 MHz Expansion slots 1 x AGP 4 x 1 5V only optional and 3 x PCI Integrated 3D graphics ADD card DVI 845 support 1 5V AGP cards only AGP 4 X optional Processor a 2 4 GHz Intel Pentium 4 CPU with a 512 K cache memory and a front side bus of 533 MHz was selected 11 RAM 1GB RAM Standard 128M X 72 ECC 133MHz 168 pin SDRAM 3 3V CL3 400mil TSOP double sided gold was considered necessary for the CPU Frame grabber card The frame grabber card that was short listed for the system was Pixelsmart5 12 8 from Pixelsmart It had a 256K image buffer with a possible up gradation to 2 4 8 16 32 64 images and it could give up to 512 X 512 resolution 13 It was both NTSC and PAL compatible and had a look up table for color outputs optional false coloring 13 It also came in with 1 composite video input
29. etup allows us to replace almost each and every major component in the system without affecting the remaining setup This sensor brick which is like a plug and play device can thus exist either as a stand alone system or as part of a multi sensor modular robotic setup The sensor brick consists of an infrared sensor Omega infrared camera now known as the ThermoVision Micron manufactured by Indigo systems for acquiring data or images a video capture frame grabber card connected to the CPU from the camera helps in analog data capture Toshiba Satellite Notebook A10 S129 which is a 2 4 GHz Celeron notebook computer manufactured by Toshiba Inc has been used as the CPU on the sensor brick Here is where some elementary image processing operations are performed on the acquired images The communication between the brick CPU and the host computer has been setup using 802 11g standard USB based W LAN network adapter card connected to the CPU Lastly the power block which provides for the entire power supply requirements of the brick consists of a 12V battery a 12V 100W 15V 75W dc to de converter to power the laptop CPU and a 12V 5V dc to dc converter to power the camera 1 1 Motivation and Overview The infrared sensor brick promises to be of great use in search and surveillance operations with its inherent advantages being that it is small in size and light in weight Being able to capture infrared data is what makes it very special becau
30. fferent views of the Toshiba Satellite A10 S129 Notebook computer This has been used as the CPU on our thermal sensor brick system These pictures have been obtained tromi NG WE 26 COMM sissies utes a itn E NE 13 Figure 2 5 WUSB54G an 802 11g standard USB based W LAN network adapter card This picture has been taken from the official website of Linksys Inc 0 15 Figure 2 6 The 12V battery Panasonic LC RA 1212P This picture has been obtained fromm the Panasonic Wes We seara a T AE 16 Figure 2 7 12V 100W 15V 75W dc to de converter VI 200 This picture has been obtained from the official website of Vicor corporation cccececeenseeeeeseeeeeeeeeees 17 Figure 2 8 12V to 5V dc to dc converter VASIR5 S5 S This picture has been obtained fom the official Website of V I0 nerea E li Meese 17 Figure 3 1 Design of the outer aluminum box built by us for the thermal sensor brick Design Courtesy Dous Wareena A EE a 19 Figure 3 2 Original component wise diagram sesssseeeesssssssseeerressssssscerrrssssssseeeeresss 20 Figure 3 3 Current component wise diagram esssseeeersssssssscerressssssseereresssssseereresss 21 Figure 3 4 Evolution of the infrared imaging sensor brick packaging cccceeeeeees 21 Figure 3 5 Different views of the packaged infrared imaging sensor brick 05 22 Figure 3 6 Different views of the packaged infrared imaging sensor brick mounted on the t
31. ght 6 3 lbs gt AC Adapter 75W external AC Adapter 100 240V 50 60Hz frequency Universal input voltage 15V x 4A output gt Battery Type 6 cell rechargeable removable Lithium Ion Li Ion battery 4400mAh Average Battery Life Approx 3 22hour s RAM Original 256 MB RAM extended 512MB RAM Total 768MB RAM Hard Disk 40 GB 4200 RPM Vv Vv V WV Optical Driver DVD CD RW combo driver DVD ROM read speed 8x CD ROM read speed 24x CD write speed 24x CD rewrite speed 10x Figure 2 4 Different views of the Toshiba Satellite A10 S129 Notebook computer This has been used as the CPU on our thermal sensor brick system These pictures have been obtained from NewEgg com 13 2 3 Communication Block After having dealt with the Processing and Fusion block of the sensor brick the next block that we need to deal with is the Communication block This section of the sensor brick deals with communication between the brick CPU and the host computer situated far away from the sensor brick For transmitting this acquired as well as preprocessed data to the host computer or to the server so that it is available for further use and interpretation to users located far away from the sensor brick we are employing a USB based 802 11g W LAN network adapter card The 802 11g Wireless LAN network adapter card that we have used on our sensor brick is Linksys WUSB54G This is fitted to the USB port on the CPU The envir
32. gle 12V battery source The package is also robust enough to be both airline and land travel compatible The design of the brick is completely modular and allows for quick exchange of any of its major blocks The design of the outer box for the thermal sensor brick is as shown in Figure 3 1 above This work was done in co ordination with Doug Warren who helped by guiding me in planning and executing all the sheet metal work He provided useful inputs for making the box and also contributed towards making it 19 3 1 1 Progression of the thermal sensor brick design On our infrared imaging sensor brick we have an infrared sensor Omega infrared camera now known as the ThermoVision Micron for the acquisition of thermal data or images It has an Imperx VCE PRO video capture frame grabber card connected to the CPU which helps in analog data capture These two components make up the sensing and image acquisition block Toshiba Satellite Notebook A10 S129 which is a 2 4 GHz Celeron notebook computer manufactured by Toshiba Inc has been used as the CPU on the sensor brick This part of the sensor brick is the processing and fusion block The communication between the brick CPU and the host computer has been setup using Linksys WUSB54G 802 1 1g standard USB based W LAN network adapter card which is connected to the CPU This is the communication block of the CPU Some changes have been inflicted in the power block of the thermal sensor brick and this
33. he software architecture which would give us the details of all the software s that would help in acquiring images We shall discuss the GUI that came along with the Imperx VCE Pro frame grabber card and the GUI that has been developed by us for the sensor brick system and the on brick processing operations that have been incorporated into the GUI 3 1 Packaging and Hardware Architecture The hardware architecture of the infrared imaging sensor brick that has been implemented by us is as given below Sensing and Image Acquisition block This section of the sensor brick consists of the infrared sensor for capture of thermal data and the video capture frame grabber card which allows us to perform analog video capture of data on the sensor brick Processing and Fusion block This section of the sensor brick is where the processing and fusion of acquired thermal images takes place Here 1 e in the CPU is where the data acquired by the sensor through analog capture card fitted on the CPU would be operated on and some basic pre processing of thermal data done through use of software The CPU is Toshiba Satellite Notebook AI0 S129 Celeron 2 4G 15 TFT 256MB 40GB DVD CDRW 56K LAN WinXP Pro This is a notebook computer manufactured by Toshiba Inc 7 Communication block This section of the sensor brick deals with communication between the brick CPU and the host computer situated far away from the sensor brick For transmitting this acq
34. his section we captured different thermal video sequences to look for expectations and for hidden possible threat objects which may not be visible under normal visibility conditions but the difference in temperature from the surroundings may highlight their presence Under expectations we looked for sections that we knew would both be hot or cold and check if they were really so If not then we could safely assume that something 37 was wrong in that section of the vehicle These data sets went a long way in highlighting the advantages of the thermal camera in detecting threats that may remain invisible through a normal vision camera We also imaged certain sections of the under vehicle to look for expected results 1 e to check if the catalytic converter and the muffler were hot as expected and whether the fuel tank and the axle were cold as expected Section showing a true muffler which is Section showing a false muffler which is hot as expected cold and so should be suspicious Figure 4 2 Under vehicle thermal video sequence Normal expected results In Figure 4 2 above and Figure 4 3 below we can see single frames of the under vehicle thermal video sequence taken to observe normal expected results in Figure 4 4 38 below we can see single frames of the under vehicle thermal video sequence taken to observe hidden object Section showing a true muffler which is Section showing a broad view of the under hot as ex
35. hree major sections They are image capture controls picture controls and image formats There are three primary buttons with predefined functions The first allows us to start grabbing frames the second allows us to start capturing frames and the last one is to exit the GUI directly The image capture control section has 11 predefined functions Three of these functions are to control the frame size 1 e either capture full frame size or half frame size or quarter frame size The next three functions are to control the sequence of data capture 1 e either to capture 33 NUM single frame or a series of frames or avi video sequence There are two features which allow the user to choose between the monochrome gray level intensity image and the pseudo colored image The feature labeled Histogram allows us to obtain the histogram of the intensity image of the current view The features labeled Intrusion 1 and Intrusion 2 allow us to perform the task of intrusion detection As mentioned in the section on processing and fusion Intrusion allows us to perform intrusion detection using pseudo colored images and Intrusion 2 allows us to perform intrusion detection using edge detected images The picture control section allows us to vary the image brightness image contrast and image color within a pre defined range of values from low to high The controls for these features are available on scroll bar buttons and so these features
36. ieved by the manufacturer by being successful in producing Vanadium oxide VOx microbolometer detectors along with proprietary on focal plane signal processing that helps in obtaining extraordinary image quality and a high level of image resolution 5 gt Since the design of the camera makes a total move away from one traditionally based on thermoelectric TE stabilization this is what allows the camera to operate with extremely low power consumption and also allows it to display the first image in less than 2 seconds The camera also incorporates analog RS 170 A as well as 14 bit digital output 5 The Omega which is the world s smallest thermal camera is as good as a larger infrared camera with regards to its performance and features that it has got to offer The Omega which has a 160 X 128 focal plane array with signal processing DSP based electronics and real time algorithms can deliver image quality as good as larger arrays 8 5 This proves that it basically makes no compromises for its small size 5 The VOx detectors allow the Omega to use a higher f number optics thereby helping in reducing costs and weight 5 While using the standard f 1 6 lens it can give a NedT of lt 80mK whereas while using an optional f 1 0 lens this comes down to lt 40mK which is a factor of 3 better than other competing technologies 5 Figure 2 2 below shows the 3 different lenses that can be fitted on the omega camera Figure 2 2 The
37. igo Systems Corporation since it proved to be the best on all the parameters that we had set for our selection Omega is the lightest smallest consumes the least amount of power and has a good temperature range Also the camera comes in with an accessory of lenses of three different wavelengths 2 SENSOR PROCESSING COMMUNICATION BLOCK AND FUSION BLOCK BLOCK The Omega Use 802 11g standard infrared camera Simple image USB based W LAN now known as processing network adapter card the operations on to communicate with Thermo Vision acquired images the host computer Micron POWER BLOCK 12V battery supply 12V 100W 15V 75W dc to de converter for the Laptop and a 12V 5V dc to de converter for the camera Figure 1 1 Conceptual diagram of the self sufficient thermal sensor brick system implemented by us that is like a plug and play device Comparison of different types of infrared cameras Infrared Field of view min Spectral Power Temperature oa Dimensions Volume Camera na distance range equired raaa Ea 8 67 UL3 Alpha ossos 3m AE lt ame 1 7 x1 7 x3 0 Pa 1 5 W 10 C to cosse 11mm 40 x30 0 1m 3 AG 18mm 7 5 13 5 7 r 40 C to 25 x19 0 3m lt 115g 1 x1 3 x1 9 ra 1550C 30mm 15 x11 0 3m 25 x19 0 3m lt 700g 10 4 x3 2 x4 1 136 45 gt 25 x19 0 3m Gia lt 700g 10 4 x3 2 x4 1 cubic lt 6 W aa ae um A 45 C Table 1 1 A co
38. ion detection using edge detected images Next we performed edge operations on the image for the purpose of edge detection using Sobel Prewitt Roberts and Log operators on the intensity image These operations helped us in detecting humans and other objects in that particular region like in the previous case where we used pseudo colored images Here also we first fixed a background image and then subtracted this image from the current image This gave us the difference image on which we performed edge detection operations Then we converted this difference intensity image into a binary image by setting a threshold level This was done since it is believed that edges are more clearly detected in binary images than on intensity images The threshold was set manually by looking at the image intensity values in the histogram but we can device a method to do this automatically based on some image parameters We performed the process of edge detection since this 30 would give us all the edges encountered in the image Thus this process of edge detection helped us in detecting any humans or objects that may present in the given image Some of the possible options tried on the sample images with different edge detection operators like Sobel Prewitt Roberts and Log are as shown in the Figure 3 13 below Figure 3 12 shows the process of fixing the background and then subtracting the background for every current image to look for intrusion Original RGB I
39. lso able to capture some under vehicle data using the infrared imaging sensor brick system by setting it on the tracked under vehicle robot These data sets captured helped in highlighting the advantages of the thermal camera over a normal vision camera We also showed the advantages of the proposed processing operations on the infrared imaging sensor brick We were also successful in designing an indigenous GUI for the thermal sensor brick and building its first version The thermal brick now has its own GUI that can be used for data capture but as yet it does not process data in real time 6 Future Work We developed an indigenous GUI for the infrared imaging sensor brick system but it was menu based The dialog based version of the GUI which was designed by us does not run in real time and so this can be an immediate future work Also we could explore all the possible options for setting up live streaming video over the internet As far as the hardware aspect of the design is concerned the brick could still reduce in size This could be achieved by using a smaller laptop as a CPU on the brick and also maybe design a more sleeker and compact package using all other components which are smaller in size We could also consider an alternate battery which is smaller in size 42 References Papers Bodor Robert Bennett Jackson Nikolaos Papanikolopoulos Vision based human tracking and activity recognition Proc of the lith Mediterranean Conf
40. mage Original Intensity Image Uifference Image in uinte format Figure 3 12 The current and the background RGB images their obtained intensity images the difference image and the binary difference image obtained after applying a threshold value 31 Edge detected with Sobel operator Edge detected with Prewitt s operator Figure 3 13 The edge detected difference images obtained using Sobel Prewitt Roberts and Log operator 3 2 5 Current version of the thermal sensor brick GUI In this section we shall discuss the GUI that came along with the Imperx VCE Pro frame grabber card and the GUI that was developed by us for the infrared imaging sensor brick system The CPU runs on Windows XP as the operating system The Imperx VCE Pro frame grabber card comes in with a default GUI that helps us in controlling certain features during image capture We can start and stop the process of both image grab and image capture using this We can either capture one frame at a time or a sequence of frames or an avi file We can also determine the size of the frame that we want to capture 1 e either a full frame or a half frame or a quarter frame Besides these the other features that we can control are the frame rate the image brightness image contrast image hue and saturation We can also select the image format in which we want to save the captured file The current version of the GUI for the thermal sensor brick that has been developed by u
41. mparison of different cameras considered in our survey With extra impetus being given to security and safety issues in the past two years the infrared sensor brick has many applications especially in search and surveillance operations When hooked up to a bigger system like a modular robotic platform the infrared imager could give the robot night vision to control its movement in the dark 8 The thermal images could also be used to thwart ambushes and plots laid in the dark by people directly or by using other objects or animals 8 Other primary applications of the sensor brick could be in face recognition pattern recognition and also perhaps in human 3 tracking systems 8 Most of the above mentioned applications of the sensor brick would be of use in military operations The other possible applications of the sensor brick could be in industrial production for quality control in the manufacturing process of a variety of products ranging from food items glass cast iron patterns moulds and others where quality assurance of the product and surveillance on the production line is a necessity 8 The sensor brick could also be setup to guard secure locations where it would be expected to monitor entry and exit to a particular room or building by allowing only selected people it would accomplish this by using face recognition by thermal images to match new images with its current database 8 When setup on a robotic chassis the sensor brick coul
42. o dc converter which operated on a dc input voltage of 12V It had a combined power output of 100W which in our estimate should have been sufficient to power both the CPU and the wireless card 11 16 802 11g for Communication after a thorough review of all the possible communication systems which included wired communication TCP IP different wireless LAN standards Cellular technology and Bluetooth technology we short listed on W LAN for the purpose of communication on the sensor brick The W LAN network adapter card that we selected was WMP54G from linksys It could be fitted to the PCI slot on the CPU This Wireless G 802 11g helped in connecting to a wireless network with speeds of up to 54Mbps and was also reverse compatible with 11Mbps 802 11b cards 17 The Wireless G had an up to 128 bit encryption protection along with the new industrial strength Wi Fi protected access WPA security 17 The design was such that the wireless network adapter card would operate on power drawn from the CPU 49 Appendix IT The below specified design was obtained by modifying the original design mentioned in Appendix I While designing this system our main consideration was in reducing the size of the CPU so that it would serve the purpose of using a really small camera like Omega on our sensor brick This was our intermediate design before we reached the final one which has been implemented It has been mentioned here for reference for future
43. obotic systems have been used previously in high level rescue operations like in the case of rescue operation at the world trade center site 3 The robots used there were equipped with infrared cameras so that the body heat could be detected very easily 3 Robotic systems with infrared cameras have also been used to recover flight recorders of electronic aircraft data and voice recordings 3 So all in all we know that the infrared sensor brick would be an important arm of any modular robotic platform meant for search and surveillance since it would help in giving vision beyond the human eyes and thereby help in overcoming the loopholes left in search and surveillance operations due to the limitations of a vision camera 1 2 Mission and Applications The conceptual diagram of the modular infrared imaging sensor brick system that has been developed by us is as shown in Figure 1 1 below The infrared sensor brick consists of 4 main blocks it has an infrared sensor Omega infrared camera now known as the ThermoVision Micron manufactured by Indigo systems for the acquisition of thermal data or images It has an Imperx VCE PRO video capture frame grabber card connected to the CPU which helps in analog data capture These two components make up the sensing and image acquisition block Toshiba Satellite Notebook A10 S129 which is a 2 4 GHz Celeron notebook computer manufactured by Toshiba Inc has been used as the CPU on the sensor brick Here is whe
44. onments in which we anticipate our brick might have to be placed in while perhaps on a search or surveillance mission forced us to go in for the slower but yet highly versatile W LAN setup using the 802 11g wireless standard Section that follows takes a closer look at some of the details of the 802 11g W LAN standard in general and some specifications about the W LAN network adapter card used on our sensor brick The 802 11g has a 54Mbps data rate and is reverse compatible with the 802 11b standard 18 The modulation technique used in 802 11g standard is called the Orthogonal Frequency Division Multiplexing OFDM which is similar to the one used in 802 lla This is what is mainly responsible for the higher data rates achievable with 802 11g 8 The operation of 802 11g in the 2 4GHz band and the modulation technique of Complementary Code Keying CCK is what makes it similar to the 802 11b and so the 802 11g is reverse compatible with the 802 11b 8 The 802 11g like the 802 11b has only three non overlapping channels and hence suffers from interference from other circuits like cordless phones and microwave ovens which also operate in the 2 4 GHz range 8 gt The 802 11g can achieve a maximum speed of 54 Mbps which is as much as the 802 1 la and 5 times more then the 802 11b 18 gt The 802 11 like the 802 11b has a coverage area of 100 150 feet inside a room depending on the materials used in the walls as well as the layout of the r
45. ons like in checking for hot spots and seeing through smoke in fire fighting applications Kostrzewa lI 2 1 1 Omega Infrared Camera The Omega is a long wavelength thermal camera with sensitivity in the range of 7 5 microns 13 5 microns Small size light weight and low power consumption which are the key features of the Omega camera are all achieved by employing state of the art readout integrated circuit ROIC design and innovative electronics packaging concepts Kostrzewa I Figure 2 1 below shows a picture of the omega infrared camera Figure 2 1 The Omega infrared camera This picture has been obtained from the official website of Indigo Systems Corporation The Omega camera does not have a Thermoelectric Cooler TEC which is usually found in most uncooled cameras The TEC helps in maintaining the focal plane array 6 FPA at a stable temperature else their output would vary non uniformly causing undesirable image artifacts The Omega instead utilizes a completely new technique by combining on focal plane circuitry and NUC non uniformity correction processing to eliminate the use of TEC This helps the camera to operate over a wider temperature range while at the same time maintaining its dynamic range and image uniformity Kostrzewa II These above mentioned design features of the Omega are those which are mainly responsible for the small size light weight low power consumption and low costs The absence of a TEC hel
46. oom while the 802 11a has a coverage area of only about 25 75 feet indoors 18 gt Since the 802 11g is reverse compatible with the 802 11b which is a widely used highly compatible system the 802 11g has all its features of public access 18 gt The 802 11b is the most widely adopted and hence an inexpensive technology but the 802 11g being new is not that widespread It is also relatively inexpensive if we weigh the cost against the benefits it has to offer 18 gt The only possible disadvantage of the 802 11g like the 802 11b is that it operates in the crowded 2 4 GHz range which runs it a high risk of interference On the other hand the 802 11a operates in the uncrowded 5 7 GHz range and so can coexist with 2 4 GHz range circuits without any interference 18 14 Figure 2 5 WUSB54G an 802 11g standard USB based W LAN network adapter card This picture has been taken from the official website of Linksys Inc Figure 2 5 above shows a picture of the WUSB54G network adapter card Given in Table 2 4 18 below are the technical specifications of Linksys WUSB54G 802 11g standard USB based W LAN network adapter card All these specifications have been obtained from the official website of Linksys Inc 18 IEEE 802 11b IEEE 802 11 USB1 1 and USB 2 0 15 17dBm typical 11M CCK 13 15dBm typical 54M OFDM Receive sensitivity Standards Transmitted power 5 to 90 non condensing PC with 400 MHz o
47. ormats Figure 3 16 Screen shot of the future version of the GUI that was being developed for the infrared imaging sensor brick system This is a dialog based GUI to be used for under vehicle inspection for threat detection 35 4 Experimental Results and Evaluation As is clear by now from the above sections we successfully designed and built a sensor brick with an infrared sensor on it This brick turned out to be exactly like how we wanted it to be a plug and play device It is a completely self sufficient system Since the infrared imaging sensor brick was successfully implemented by us we now needed to perform some experiments using this brick The infrared imaging sensor brick operated on a single power supply had a complete package and a single ON OFF switch The battery power lasted for about 3 4 hours of continuous operation of the sensor brick The tests conducted showed that the infrared imaging sensor brick system could last on its own power setup for up to 3 hours of continuous and guaranteed operation We were also able to perform some proposed on brick processing operations We were also successful in designing an indigenous GUI for the thermal sensor brick but it did not work completely in real time 4 1 Data collection with thermal sensor brick We used the thermal sensor brick to capture data to test its setup for human detection and intrusion detection We also captured two 2 different sets of under vehicle thermal video
48. pected and a false muffler which vehicle of the van is cold Figure 4 3 Under vehicle thermal video sequence Normal expected results 39 This 1s where the box was kept Section showing the area with the muffler Section showing the area with the muffler and the axle rod and the axle rod with a hidden box in between the two of them Figure 4 4 Under vehicle thermal video sequence Hidden object In Figure 4 5 below we can see single frames of the under vehicle thermal video sequence taken to observe possible threat object For all the above mentioned figures for each field of view we can see the visual image the acquired thermal image gray scale and the 40 pseudo colored thermal image on Section showing the area around the Section showing the area around the gas muffler hot with a suspicious cold tank cold with a suspicious hot object object tied around this This cannot be seen placed near it in the visual image Figure 4 5 Under vehicle thermal video sequence Threat object 41 5 Conclusions We were successful in designing and implementing the sensor brick with an infrared sensor Omega infrared camera on it This brick turned out to be exactly like how we had conceptually wanted it to be a plug and play device It is a completely self sufficient system Since our goal for this project was to design and implement the infrared imaging sensor brick system we accomplished our task and
49. ps in reducing the complexity of the camera thereby giving it a higher range of operation and also instant imaging on turn on in comparison to those cameras employing FPA temperature stabilization with a TEC which usually have a long enough waiting time Kostrzewa I Seen given in Table 2 2 below are the specifications and the technical details of the Omega infrared camera These specifications have been obtained from the official website of Indigo Systems Corporation 5 Array format 160 H X 120 V RS 170 A display Fini 160 H X 128 V CCIR display Input Output 18 pin connector for video power communication digital data Digital data Optional real time 14 bit pixel replaced normalized digital output Operating temperature 0 C to 40 C standard and an optional 40 C range to 55 C extended temperature range Scene temperature To 150 C standard and an optional auto gain range mode range to 400 C Field of view 40 X 30 25 X 19 and 15 X 11 degrees respectively IFoV Gnilliradians 4 64 2 83 1 70 respectively Table 2 2 Technical specifications and additional features of the Omega infrared camera These features are extra and so are additional and are not part of regular accessories Some of the major advantages that the Omega camera presents over other infrared cameras are that gt The Omega is extremely compact light in weight and has a fully integrated design This has been ach
50. r faster processor 64 MB RAM CD ROM Driver Available USB port and Windows 2000 or XP operating system Table 2 4 Technical specifications of the Linksys WUSB54G W LAN network adapter card System requirements 15 2 4 Power Block After having dealt with the Communication block of the sensor brick the next and final block that we need to deal with is the Power block Power supply is the most important factor for continuous and stable operation of the sensor brick Since we know that the sensor brick which has been designed on the concept of modularity and self sufficiency would exist either as a stand alone system or as part of a modular robotic system this would mean that it would require its own power setup at all times This block of the thermal sensor brick deals with the supply of power to all the individual blocks of the sensor brick The power block which provides for the entire power supply requirements of the brick necessary for continuous stable operation consists of a 12V Panasonic battery LC RA1212P and a 12V 100W 15V 75W dc to dc converter manufactured by Vicor Corporation that powers the laptop CPU and a 12V 5V dc to de converter manufactured by V infinity to power the camera The 12V Panasonic battery LC RA1212P is as shown in Figure 2 6 below and its technical specifications are given in Table 2 5 below They are obtained from Panasonic s official website 19 Figure 2 6 The 12V batter
51. re some elementary image processing operations are being performed on acquired images This part of the sensor is the processing and fusion block of the sensor brick The communication between the brick CPU and the host computer has been setup using Linksys WUSB54G 802 11g standard USB based W LAN network adapter card which is connected to the CPU This is the communication block of the sensor brick The Power block which provides for the entire power supply requirements of the brick consists of a 12V Panasonic battery LC RA1212P and a 12V 100W 15V 75W dc to dce converter manufactured by Vicor Corporation that powers the laptop CPU and a 12V 5V dc to dc converter manufactured by V infinity to power the camera We conducted a brief survey before selecting the infrared camera for our sensor brick and the main parameters that we considered were less weight small size and low power requirements All the cameras considered were those in which the detectors were Focal Plane Array FPA uncooled microbolometer type Seen in Table 1 1 below is a brief comparison of all the cameras considered based on the parameters defined by our needs All the cameras considered did not exhibit the zooming feature and also required manual adjustment of focus since they were not equipped with auto focus From the table below it is clear that the infrared camera that was best suited for our thermal sensor brick was the Omega infrared camera manufactured by Ind
52. resssssssees 6 Zable Cael nirare Gd CaMel dieso EEEN 6 2 1 2 Imperx VCE PRO Frame Grabber video capture Card cccceecccceseeeeeees 10 2 2 PTOCESSING and FUSION BOCK arssinat e eA 12 22 Ne Central Processing Wil cet tees easncid arava e 12 23 Ommu a ON BIOCK aeee E 14 TOW CU BIO korrea e A A A E en hiunaty sate canigparncn 16 he ACEC Gren a a a a ins oc poe a daaleds 18 3 1 Packaging and Hardware Architecture nneessooeenesssssssoeerrsssssssscerrssssssseererssssss 18 3 1 1 Progression of the thermal sensor brick design cccccccesseeeeeeeeeeeeeeeeeeeees 20 552 SOW Ake Adc MIL ClUbe Siaiaha toesaetiare he ieee toe he here ata te 2I 32 Analyze AINACES aeei a a E tien tase akeuciansauee 2i 3 2 2 Pseudo coloring the input images cccccccccccccaseeeeeeccececeeaeeenseeeeeeeeeeaseeeeees 28 3 2 3 Intrusion detection using pseudo colored images sssssseeeeessssssssseeersssssssee 28 3 2 4 Intrusion detection using edge detected 1MaeES ccccccccssseeeeeeeeeeeeeeeeeeeees 30 3 2 5 Current version of the thermal sensor brick GUI eeccceeceeeeeeeeeeeeees 32 3 2 6 Design of the future version of the GUI nsssssssssesssssssssoeerssssssssseerrsssssssees 33 4 Experimental Results and EY al WAU OM ssrin neran riietati geeks 36 4 1 Data collection with thermal sensor brick eensessseeoenessssssssseersssssssseerresssssssees 36 4 1 1 Under vehicle thermal video sequences va
53. riations with time 0666 36 4 1 2 Under vehicle thermal video sequences for normal expected results and for Maddena ODOC Reemenerenrs eset rire ane Raper annie tne se een errr rareey wary eCinre tere nn Cnrrn seer rte 37 BG MOC EUS LOS pee tia th crc htc ete nea siete ea hese aetna eases an 42 SPAY LUD can WN Or emer ama eer er aN ee ee eee 42 RETENC S spt pees edie E teen wercwces oust sar N vay imenasena ee Guame ened 43 PPS 1S ass cetera atasat sansa sutossteraka ecinsa ta cttercatasa a S 43 WoD chen See a REEE ARETE Pere PRR RSE eT REE Ee ee RS EEC DEE E en ESE eee ee 45 Appendix Torinesi E E enieiaatiinaiadinat ienieiaatase 47 PD BEN I LD carson satind aer a e setind gatindemtaue aadinsainmdne E a e tanh sedinsaiemdne tse setind gadinds 50 i List of Tables Table 1 1 A comparison of different cameras considered in Our SUIVCY 00eeeeeeeeees 3 Table 2 1 The hardware architecture of the infrared imaging sensor brick implemented by E octets AA veterans E E T A seaaciake IE E E A 5 Table 2 2 Technical specifications and additional features of the Omega infrared camera EE AEE EEE E AE EE AE E EEE ET E E 8 Table 2 3 Technical specifications of IMPERX VCE PRO Fast Analog CardBus video Capture mame STaDWeL CAN sscles erp E anaes cuase tence 11 Table 2 4 Technical specifications of the Linksys WUSB54G W LAN network adapter CA CU E AE A E E el A EE N ot eee 15 Table 2 5 Technical specifications of the 12V P
54. s and nuts 6 32 1 inch spacers 6 32 inch spacers 8 32 2 inch screws washers and nuts 14 gauge red wire 14 gauge black wire 6 32 inch spacers No 10 inch spacers No 10 1 2 inch screws washers and nuts No 8 1 inch screws Aluminum sheets FA NO N 3 5 W 15 0 fF p lt Lp Ph nr n 10 Sft P NO Table 3 1 Bill of materials for the infrared imaging sensor brick 26 3 2 Software Architecture After having dealt with the hardware architecture of the infrared imaging sensor brick we now need to take a look at the software architecture Here we shall deal with the low level image processing operations that are done at the sensor brick level These operations are done at the level of the sensor brick and then the processed images along with the raw data are available to the remotely located host computer for further use These preprocessing operations are of use from a statistical point of view to get some information regarding the image and they also assist in improving the appearance of an image thereby aiding in threat detection The processing operations that have been done at the brick level are some basic image processing operations on the acquired infrared images like analyzing the obtained images Since the raw images obtained from the sensor brick are RGB images we need to obtain the intensity image to perform all the preprocessing operations These operations include obtaining an inten
55. s is menu based and it consists of three subsections First sub section is input which allows us to control the input to the capture card from the camera This can either be composite 1 or composite 2 The other options are either S Video 1 or S Video 2 The second sub section is called mode which tells whether we are in snap mode or grab mode 32 Also this section has status bar option which shows the current values of the image details like brightness contrast hue and saturation The third and the last sub section is called image control this allows us to vary the image brightness image contrast image hue and image saturation within a pre defined range of values from low to high All the preprocessing operations that are being performed on the captured data are being performed on a single frame basis So the processed output data is not a streaming video but is a set of continuously refreshing frames In Figure 3 14 below we can see a screen shot of the current version of the GUI developed by us in Visual C Net Input Mode Image Control Ready Brightness 128 Contrast 68 Hue Q Saturation 64 50Hz Figure 3 14 Screen shot of the current version of the GUI for the infrared imaging sensor brick that has been developed by us in Visual C Net 3 2 6 Design of the future version of the GUI The final version of the GUI for the infrared imaging sensor brick that has been designed is one which is dialog based and it consists of t
56. se in the dark where human vision stops the infrared sensor could be used to detect possible ambushes plots and hidden enemies by making use of its night vision capabilities The thermal images generated could also be used for human detection and intrusion detection face recognition pattern recognition human tracking and in very many applications of thermal imaging Since currently the increase in the level of concern for both safety and security issues has no bound this was the main motivating factor for taking up this project Many robot based image processing systems are currently available for both commercial and research operations The robotic systems which are available are usually fitted with only one or two kinds of sensors mostly cameras The systems available are generally neither light in weight nor small in size and in case if any system is small in size and light in weight then it is highly improbable to be as highly sophisticated and modular as our sensor brick system Amongst the commercially available robots the Mini Andros can be fitted with an infrared camera 1 the Spiral Track Autonomous Robot STAR can be equipped with infrared sensors 1 but this might not be a camera Another very popular commercial robot the Robug III cannot be equipped with infrared cameras 1 The above discussion helps us to a certain extent in getting a clearer picture about the possible advantages of our sensor brick Infrared imaging based r
57. sequences They were as follows Thermal video sequence of the entire under vehicle Under all possible normal conditions looking out for variations over a period of time Thermal video sequence of the entire under vehicle with a threat object With a bomb other unwanted hidden threat object 4 1 1 Under vehicle thermal video sequences variations with time In this section we captured three different thermal video sequences to look for variations in under vehicle conditions over a period of time The 3 different fields of view were The catalytic converter and the muffler The muffler and the exhaust pipe The fuel tank and the axle All the data was acquired using the infrared imaging sensor brick system designed and built by us and the process was carried out at the UT motor pool using a Dodge RAM 3500 IRIS Van Also the camera was setup in the smart scene mode In Figure 4 1 below we can see a single frame of the under vehicle thermal video sequence taken to observe variations with time for each field of view we can see the visual image the acquired thermal image gray scale and the pseudo colored thermal image 36 Section showing the catalytic converter and Section showing the muffler and the the muffler exhaust pipe Figure 4 1 Under vehicle thermal video sequence for variations with time 4 1 2 Under vehicle thermal video sequences for normal expected results and for hidden threat object In t
58. sity image from an RGB image and displaying its histogram We found that the histogram of an image gave us all the valuable information regarding an image like the gray level intensity distribution which could be used effectively in detecting the presence of objects in a particular region intrusion detection and human detection The other operation that has been done on the input image is to pseudo color the intensity image using different color bars Since both the original RGB image and the intensity image are gray scale images a colored image helps us in getting a better understanding of the image details A color image gives us some more detailed information like difference in heat patterns in the image and thereby helps us in detecting glaring irregularities presence of humans and other objects In this section below we shall show all the low level image processing operations that have been performed on the sample thermal images This image was captured using our own infrared imaging sensor brick setup with an Imperx frame grabber card and Omega infrared camera It is an RGB image and is similar to the kind of images that are given out as raw output data from our sensor brick 3 2 1 Analyzing images The first thing that was done before the procured images were used for further applications both by the processing block on the brick or by the remotely located host computer was to analyze the images and obtain some valuable information from them
59. so the project was complete Since our ultimate goal was to develop a sensor brick which would firstly be completely modular and like a plug and play device hence we wanted it to be light in weight and completely self sufficient We were able to keep the weight size and power consumption on the lower side by using the Omega infrared camera as our sensor The brick was able to maintain its flexibility in being capable of communicating with the host computer from any location by employing the 802 11g W LAN network adapter card The laptop which was used as the CPU on the sensor brick to perform some on brick processing operations on the captured infrared images helped in reducing the size of the whole system The entire infrared imaging sensor brick setup operated on a single 12V power supply This battery was able to power the CPU and the camera The brick housed in a 21 X 17 X 5 25 aluminum box built for it by us The sensor brick with Omega infrared camera as the infrared sensor on it was successfully tested We were successful in capturing live data and streaming it out in real time over the W LAN to the host computer using remote desktop connection The thermal data was captured using a frame grabber card connected to the CPU We could capture a full frame size half frame size and quarter frame size of data Also the frame capture rate could be adjusted as per our need The system lasted on its own power set up for about 4 hours We were a
60. tails A color image would give us some more detailed information like difference in heat patterns in the image and thereby help us in detecting glaring irregularities presence of humans and other objects The output from this operation on the sample image looked like the one shown in Figures 3 10 and 3 11 below 3 2 3 Intrusion detection using pseudo colored images We performed the task of intrusion detection on the sensor brick For this we firstly fixed a background image which is the image of the area that is meant to be guarded against intrusion and then subtracted the background image from the current image which gave us the difference image which helped us in detecting humans and other objects entering that secure location Some of the possible options tried on the sample image for different color bars are shown in the Figures 3 10 and 3 11 below 28 Original RISB Image Fseudocolored Intensity Image Pseudocolored Intensity Image of the Background Difference Image in double format Pseudocolored Difference Image E 3 Figure 3 10 The current the background and the difference intensity images and their pseudo colored images using color bar HOT 29 Original RISB Image Pseudocalored Intensity Image Difference Image in double format Fseudocolored Difference Image Figure 3 11 The current the background and the difference intensity images and their pseudo colored images using color bar JET 3 2 4 Intrus
61. tml 4 De Montfort University Papers on contour coding http www dmu ac uk mt text papers html v2n01 v2n01 html 5 Indigo systems Omega infrared camera website http www indigosystems com product omega html 6 Imperx Video capture frame grabber card manufacturer s website http www imperx com 7 NewEgg com Toshiba Satellite A10 S129 notebook computer vendor s website http www newegg com app ViewProductDesc asp description 34 1 14 O32 amp catalog 32 amp manutactory BROWSE amp depa 3 amp section 2 8 Fall 2003 ECE 573 course project website Infrared Imaging in Modular Multipurpose Multi sensor ROBOT http www imaging utk edu classes fall2003 modsen ece573 nikhil webtemplate index htm 9 Shuttle Inc Design 2 CPU manufacturer s website http www shuttle com hq product barebone specification asp B_1d 29 10 ASUSTeK computers Inc Design 1 motherboard manufacturer s website http www asus com prog spec asp m P4GE VM 11 Justin Acuff s ECE 599 Fall 2003 internal report Computer hardware details http www imaging utk edu classes fall2003 acuffj ece599 12 Seagate Hard disk manufacturer s website http www seagate com cda products discsales marketing detail O 1081 559 00 ht ml 13 Pixel smart Design 1 and Design 2 frame grabber manufacturer s website http www ddg com pl nm ps5 12 8 html 45 14 Iomega
62. u Huijing Zhao Ryosuke Shibasaki Tracking passenger movement with infrared video data Proc ACRS 2001 22nd Asian Conference on Remote Sensing Vol 2 pp 1520 1523 Singapore 5 9 November 2001 Nanda Harsh and Larry Davis Probabilistic template based pedestrian detection in infrared videos Proc IEEE Intelligent Vehicle Symposium Versailles France 18 20 June 2002 Shunsuke Kamijo Yasuyuki Matsushita Katsushi Ikeuchi and Masao Sakauchi Traffic monitoring and accident detection at inter sections UM3 2000 Sugimura Koji Yasuo Suga and Junichi Tujitani Counting system of pedestrian Proceedings of the 7 Symposium on Sensing via Image Information pp 357 362 2001 Xu Fengliang Kikuo Fujimara Pedestrian detection and tracking with night vision Proc IEEE Intelligent vehicles Symposium Versailles France 18 20 June 2002 Xu Fengliang Kikuo Fujimara Human detection using depth and gray images Proc IEEE International Conference on Advanced Video and Signal based Surveillance Miami FL 21 22 July 2003 44 Websites 1 Nova Different types of available robots http www pbs org wgbh nova robots hazard meetandros html 2 x20 Another thermal camera manufacturer s website http www x20 org thermal new htm 3 Clark middle school botball team General and research website on robots http teams botball org team_web 2002 CMSERT private research h
63. uired and preprocessed data to the host computer or to the server so that it is available for further use and interpretation to users located far away from the sensor brick we are employing a USB based 802 11g W LAN network adapter card The 802 11g wireless LAN network adapter card that we have used on our sensor brick 1s 18 Linksys WUSBS54G and it is fitted to the USB port on the CPU Power block This section of the sensor brick deals with the management of power supply to all the blocks of the sensor brick for its continuous and stable operation Here we have Panasonic LC RA1212P a 12V battery that powers the entire brick We also have a 12V 15V dc to de converter VI 200 manufactured by Vicor Corporation to power the CPU laptop and a 12V 5V dc to dc converter VASIRS5 S5 S series manufactured by V Infinity to power the camera oo a a a i ap sor _ _ Et oF E y F PEW aes cece ne r PLE PEM IF 4 Le F Fa 4 TYF a TF r al a 7 ae l per 14 OFAN Figure 3 1 Design of the outer aluminum box built by us for the thermal sensor brick Design courtesy Doug Warren The infrared imaging sensor brick has been packaged by housing it in a 21 x 17 x 5 25 dimension box of aluminum built by us for it The thermal sensor brick has been designed and built based on the concept of modular sensor bricks The brick has a single ON OFF switch and operates on power drawn from one sin
64. ve it on the CPU at all times but we can use it whenever we want or else have it taken off It is capable of displaying capturing storing and previewing full motion video 1 e 30 frames per second at full VGA or higher resolution 6 It also gives us the option of being able to capture only one frame multiple frames and also standard avi format video clips from NTSC PAL or SECAM sources 6 The VCE PRO video capture card comes in with an inbuilt capture delay function which allows users to program the card so that video sequences scheduled at a later date can be recorded 6 The card comes in with an external trigger option which makes it very useful in certain demanding machine vision applications 6 The Imperx VCE PRO video capture card is as shown in Figure 2 3 below VCE PRO imperk gt incorporated Coming Agr fanging Scleticen Video C Figure 2 3 The IMPERX VCE PRO Fast Analog CardBus video capture frame grabber card This picture has been taken from the official website of Imperx Inc Seen given in Table 2 3 below are the technical specifications of the IMPERX VCE PRO Fast Analog CardBus video capture card All these specifications have been obtained from the official website of Imperx Inc 6 10 2 Composite inputs or 2 S Video inputs with anti alias filters 1 External trigger input 640 X 480 pixels 30 fps Fast video capture window frame sizes 320 X 240 pixels 30 fps 160 X 120 pixels
65. volved with my Master s work I admire his hard working nature My sincere thanks to Doug Warren for helping me in accomplishing the hardware related goals of my Master s work He has been my guide on the machining part of my Master s work I would also like to acknowledge Vicky Courtney Smith Kim Kate and Sharon Foy for their moral support Abstract In this project of Infrared Imaging Sensor Brick for Modular Robotics we will design and build a completely packaged thermal sensor brick based on the concept of modular sensor bricks The thermal sensor brick will house in a 21 x 17 x 5 25 box of aluminum built by us for it The brick will have a single ON OFF switch and operate on power drawn from one single 12V battery source The package will also be robust enough to be both airline and land travel compatible The design of the brick will be completely modular and allow for quick exchange of any of its major blocks The infrared sensor brick which is based on the concept of modular sensor bricks would consist of an acquisition sensor block to capture images a processing and fusion block to work on the acquired images a communication block for transferring data between the sensor brick and the host computer located either on the robot or somewhere remotely and a power block to maintain power supply to the whole brick The infrared sensor brick would be a self sufficient system and it would be possible to remove it from the ro
66. y Panasonic LC RA 1212P This picture has been obtained from the Panasonic website Dimensions in inch Total height 4 01 inch 102 mm Height 3 70 inch 94 mm Length 5 95 inch 151mm Width 3 86 inch 98mm Table 2 5 Technical specifications of the 12V Panasonic battery LC RA 1212P VI 200 the 12V 100W 15V 75W dc to dc converter manufactured by Vicor Corporation that powers the laptop CPU is as shown in Figure 2 7 below and its technical specifications are given in Table 2 6 below These specifications have been obtained from the official website of Vicor Corporation 20 16 Figure 2 7 12V 100W 15V 75W dc to de converter VI 200 This picture has been obtained from the official website of Vicor corporation Input voltage 12V Output voltage Dimensions 4 6 X 2 4 X 0 5 116 9 mm X 61 0 mm X 12 7 mm 6 0 oz 170g Efficiency Up to 90 Table 2 6 Technical specifications of VI 200 a 12V 100W 15V 75W dc to dc converter manufactured by Vicor corporation Figure 2 8 12V to 5V dc to dc converter VASIR5 S5 S This picture has been obtained from the official website of V infinity VASIR5 S5 S series 12V 5V dc to dc converter manufactured by V infinity which is used to power the camera is as shown in Figure 2 8 above and its technical specifications are given in Table 2 7 below These specifications have been obtained from the official website of V Infinity 21

Infrared Imaging Sensor Brick for Modular Robotics

Contents

Download Pdf Manuals

Related Search

Related Contents