Faculty Advisor

Jie Fu

Faculty Advisor

Xinming Huang

Faculty Advisor

Yanhua Li


Pedestrian detection is a canonical instance of object detection that remains a popular topic of research and a key problem in computer vision due to its diverse applications. These applications have the potential to positively improve the quality of life. In recent years, the number of approaches to detecting pedestrians in monocular and binocular images has grown steadily. However, the use of multispectral imaging is still uncommon. This thesis work presents a novel approach to data and feature fusion of a multispectral imaging system for pedestrian detection. It also includes the design and building of a test rig which allows for quick data collection of real-world driving. An application of the mathematical theory of trifocal tensor is used to post process this data. This allows for pixel level data fusion across a multispectral set of data. Performance results based on commonly used SVM classification architectures are evaluated against the collected data set. Lastly, a novel cascaded SVM architecture used in both classification and detection is discussed. Performance improvements through the use of feature fusion is demonstrated.


Worcester Polytechnic Institute

Degree Name



Electrical & Computer Engineering

Project Type


Date Accepted





pedestrian detection, data fusion, trifocal tensor, feature fusion, decision fusion, stereo vision, thermal vision