Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Measuring Student Attention with Face Detection:: Viola-Jones versus Multi-Block Local Binary Pattern using OpenCV
KTH, School of Computer Science and Communication (CSC).
KTH, School of Computer Science and Communication (CSC).
2015 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

The purpose of this study is to discuss and attempt to approach an answer to the question of how face detection could be used to measure attention in a lecture hall.The conclusion might help further studies in using face detection to provide teachers with tools which can be used to improve learning during lectures.

Face detection in real time applications became possible in 2001 when Viola and Jones presented a new method several times faster than any previous attempt. In 2007 Liao et al. presented a method using multi-block local binary patterns (MB-LBP) for the purpose of overcoming the simplicity and limitations of the Viola-Jones method. Computer vision libraries such as OpenCV make it easy to implement such algorithms. It currently supports both the Viola-Jones algorithm and the MB-LBP algorithm.

This study compared these two face detection methods to see how they perform in terms of sensitivity and precision and attempted to identified limitations of both methods when used to detect attention in a simulated lecture environment. The study was conducted using boosted algorithms and functionality provided by OpenCV. The input data consisted of a recorded simulated lecture with 6 subjects performing different poses, labeled either attention or no attention, during certain periods of time, each pose recognized from a previously recorded actual lecture as a commonly occurring pose.

The most significant difference of performance identified in the study was that the MB-LBP method performed face detection in an image three times faster than for Viola-Jones which confirmed previous reported results. Both methods generated high sensitivity values for all poses, but low precision values for two of the poses.The ability of both methods to detect downward tilted faces contributed to a high number of false positives returned when subjects performed the two poses of subjects taking notes or subjects performing activities labeled as no attention. Due to the low precision values caused by this, both methods were not considered to measure attention effectively. It is therefore suggested to instead train a MB-LBP-based method for the specific task of measuring attention in a lecture hall by training it to reject downward-tilted faces and to accept only instances conforming to the chosen definition of attention.

Place, publisher, year, edition, pages
2015.
National Category
Computer Science
Identifiers
URN: urn:nbn:se:kth:diva-166416OAI: oai:DiVA.org:kth-166416DiVA: diva2:810985
Examiners
Available from: 2015-05-28 Created: 2015-05-08 Last updated: 2015-05-28Bibliographically approved

Open Access in DiVA

fulltext(8467 kB)180 downloads
File information
File name FULLTEXT01.pdfFile size 8467 kBChecksum SHA-512
865eec851c0e96b8cbf8ad338fac4f20d43bfa666660a4ce9349c70eba2ef4ed588eb956bc775d3283c5048b0981f1823b7ca72e5f37945fb48a95541c6c340f
Type fulltextMimetype application/pdf

By organisation
School of Computer Science and Communication (CSC)
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 180 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 972 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf