CSE498, Collaborative Design, Spring 2021
Computer Science and Engineering
Michigan State University

United Airlines, Inc. is a leading American airline headquartered in Chicago, Illinois. In 2019, United and United Express operated more than 1.7 million flights carrying more than 162 million customers to their destinations safely.

Safety is United Airlines’ number one priority on every flight. An aircraft turn accounts for the time it takes for a series of safety procedures to be carried out by United Airlines’ employees from when the aircraft arrives at the gate to when it clears for departure.

Auditors conduct live audits of aircraft turns to determine whether the arrival and departure steps are compliant or non-compliant per standard operating procedure. United Airlines is exploring ways to automate the recognition of some of these aircraft turn tasks.

Our Turn Management Analyzer automatically identifies and evaluates the aircraft turn using the video camera feeds at each airport gate.

When an aircraft begins a turn, our system uses computer vision algorithms to track any objects and people working on the aircraft to determine if they are compliant with all safety protocols and complete the proper steps for a safe aircraft turn.

If our system detects a task that is performed incorrectly, out of sequence, or any employee not following safety protocols, it flags this action for review by a United Airlines auditor who can evaluate the situation.

Our software helps auditors ensure that United Airlines always provides their customers with the safest flight possible.

The front end is written in HTML, JavaScript and CSS. The back end consists of a MySQL database and PHP scripts to process data. The computer vision analyzer is developed with PyTorch, TensorFlow, OpenCV and Python.