Faculty Advisor

Whitehill, Jacob Richard

Abstract

Automatic estimation of student engagement can help computer-based learning systems adapt to individual learners. Linear models trained on Gabor features established cutting-edge yet sub-human accuracy on this task, while Convolutional neural networks (CNNs) heavily overfit to the dataset's few subjects. We found that transfer learning enabled linear ridge regression to leverage CNN features learned for image recognition and face re-identification tasks. Our best model achieved a four-fold cross-validated correlation of r=0.581, significantly outperforming the state-of-the-art r=0.522. Our information strength metric correlated with model accuracy (FaceNet, r=0.755; ImageNet, r=0.077), inviting further study of feature utility prediction.

Publisher

Worcester Polytechnic Institute

Date Accepted

April 2018

Major

Computer Science

Project Type

Major Qualifying Project

Accessibility

Unrestricted

Advisor Department

Computer Science

Share

COinS