A Cyber Infrastructure for Hard and Soft Data Fusion

Open Access
Misra, Kaustubh
Graduate Program:
Electrical Engineering
Master of Science
Document Type:
Master Thesis
Date of Defense:
June 21, 2010
Committee Members:
  • David J Hall, Thesis Advisor
  • John F Doherty, Thesis Advisor
  • Soft Sensing
  • Sensor Array Creation
  • Image Processing
  • Intelligent Agent Architecture
  • Social Network Analysis
  • Multisensor Data Fusion
  • Bluetooth Ad-hoc Piconets
Multi-sensor Data Fusion; utilizing sensors of various natures and denominations, is gradually finding implementation in many fields from Defense and Security to “Human Landscape” Evaluation and Environment Impact Assessment. It is an imperative tool in analyzing information about a complex situation or event and coming to a concrete conclusion about it utilizing sensing resources at hand. Apart from using the traditional sensors to assimilate information about targets, the focus is now shifting towards including a vital piece of information; observing and understanding what is called the “Human Terrain” and Human Landscape or the complex interrelationships and trends that define a specific human population. This thesis takes traditional sensing and furthers it with the addition of Human Observers. In consonance with using humans or “Soft Sensors”, the mapping of users of Microblogs as sensor arrays to facilitate Information extraction is analyzed. A cyber infrastructure is described to help realize the idea of fusing information from Human Observers, Traditional Sensors and web based entities. Also, a Distributed Multiple Software Agent System has been implemented to demonstrate the idea of Dynamic Human Sensor Array creation over the web. An infrastructure has been developed and explained that employs traditional sensors like Closed Circuit Video Camera Systems in conjunction with this Multiple Agent System to build a Multisensor Data Fusion Environment. Finally, an Ad-Hoc Wireless Sensor Network Creation Algorithm is described that uses Bluetooth. This adds a physical sensor array development example to the cyber infrastructure.