CSE498, Collaborative Design, Spring 2018
Computer Science and Engineering
Michigan State University

Yello is a Chicago-based company that provides software for talent acquisition. Their products help recruitment teams hire the right talent at the right time.

When evaluating job applicants, recruitment teams often have conflicting assessments due to differing opinions of applicants. This is challenging for recruiters when selecting candidates with conflicting reviews.

Automated emotion and sentiment analysis provides unbiased assessments to help evaluate candidates. Our Interview Video Analysis Tool (IVAT) automatically evaluates a candidate‘s sentiment (speech attitude) and emotion (facial expressions) in a video interview.

IVAT allows recruitment teams to set up video interview questions, schedule live interviews, and invite candidates to an interview. A candidate can pre-record video responses to interview questions or participate in a live interview.

A candidate‘s speech is processed and evaluated in terms of the sentiment of their words being negative, positive or neutral. Likewise, a candidate‘s facial expressions are analyzed and summarized across a set of emotions such as angry, sad or joyful.

IVAT is built with Ruby on Rails. The video interviews are streamed and archived using TokBox’s OpenTok API. Sentiment analysis is done with Microsoft’s Video Indexer and Emotion analysis uses Kairos Human Analytics API. Videos are stored on Microsoft’s Azure cloud storage.