| Title: |
Agricultural Machinery Operator Monitoring System (Ag-OMS): A Machine Learning Approach for Real-Time Operator Safety Assessment |
| Authors: |
Irumva, Terence; Mwunguzi, Herve; Pitla, Santosh; Lowndes, Bethany; Yoder, Aaron; Siu, Ka-Chun |
| Source: |
Department of Biological Systems Engineering: Faculty Publications |
| Publisher Information: |
DigitalCommons@University of Nebraska - Lincoln |
| Publication Year: |
2023 |
| Collection: |
University of Nebraska-Lincoln: DigitalCommons@UNL |
| Subject Terms: |
Ag-OMS; Machine learning (ML); Safety behaviors; OpenPose; Tractor operator; Bioresource and Agricultural Engineering; Civil and Environmental Engineering; Engineering; Environmental Engineering; Other Civil and Environmental Engineering |
| Description: |
The 2015 CS-CASH (Central States Center for Agricultural Safety and Health, 2015) Injury Surveillance Surveys showed that around 19% of injuries to agricultural producers are related to tractors or large agricultural machinery, yet only a limited number of studies are found that address tools and methods for monitoring safety behaviors of agricultural machinery operators in real-time. The current safety behavior monitoring approaches require an in-person presence, which can be both time- and cost-inefficient, and the other available methods lack a feedback element to alert operators in realtime. As a result, the research presented in this study aimed to develop an automated approach to monitoring tractor operators' safety behaviors through the use of a trained machine learning (ML) model and a feedback system to alert operators when they engage in unsafe practices. For the ML model development, a skeleton-detecting algorithm called OpenPose was used to detect real-time human postures in a livestreaming video feed from a camera installed in the tractor cab. The model was then trained on three separate categories of tractor operators’ safety operating behaviors, and this trained classifier was used to label operators’ safety behaviors in real time based on the three safety classes. A feedback mechanism controlled by an onboard microcontroller was then used to alert the operators when unsafe operating behavior was detected to facilitate safe practices. This monitoring system, named Ag-OMS (Agricultural Machinery Operators Monitoring System), monitored the ingress/egress operators’ behaviors in real-time entering and exiting the tractor cab. The Ag-OMS successfully identified the ingress/egress operators’ behaviors with an accuracy of 97% on the testing datasets for all safety risk categories. |
| Document Type: |
text |
| File Description: |
application/pdf |
| Language: |
unknown |
| Relation: |
https://digitalcommons.unl.edu/biosysengfacpub/859; https://digitalcommons.unl.edu/context/biosysengfacpub/article/1851/viewcontent/Irumval_JASH_2023_Agricultural_Machinery_Operator.pdf |
| Availability: |
https://digitalcommons.unl.edu/biosysengfacpub/859; https://digitalcommons.unl.edu/context/biosysengfacpub/article/1851/viewcontent/Irumval_JASH_2023_Agricultural_Machinery_Operator.pdf |
| Accession Number: |
edsbas.CE9D3E08 |
| Database: |
BASE |