Abstract
Using AI in Mining Environment to Improve the Communications in Operating Vehicles (Speech to Text)
Vehicles and driving is one of the highest risks to safety in mining environment. Operating heavy and light vehicles poses a risk of collisions. Communications in between vehicle operators, or the lack thereof, is a factor in many potentially fatal incidents (PFI).
To reduce the risk of miscommunications, which can lead to PFIs or worse, fatalities, vehicle operators must adhere to protocols for positive communications, for example:
- Establish radio contact with another vehicle before entering a 50m range, and identify itself by its equipment ID (example: “229 haul truck”)
- Request permission to pass the other vehicle, before doing so
- Proceed to pass, only after having received permission by the other vehicle
In practice, it is difficult to monitor the adherence to positive communications protocols. Thousands of distinct communications in between vehicle operators occur every day at a mine, resulting in hundreds of hours of recorded audio on the radio communication channels.
In this presentation:
- We will demonstrate that AI technology can assist us in monitoring the quality of radio communications between vehicle operators.
- We will also show that AI technology (speech to text tool) can be a useful to prevent miscommunication and safely operate vehicles by reducing collision risks.
We will explore the following:
- What are the unique challenges that stand in the way of leveraging AI in a mining environment?
- Can AI be made to ‘understand’ communications in between vehicle operators (i.e. in between 2 humans)?
- Can AI ‘learn’ what is a positive communication by feeding it a large amount of data?
- What did we learn after the completion of a proof-of-concept?
Approach
Rio Tinto initiated a proof-of-concept project at its Labrador City site (IOC Iron Ore Company of Canada), encompassing the following:
- Extraction of 6 hours of recorded audio of radio communications over night and day shifts
- Creation of an AI program with our technology partner
- Development of AI components: audio signal processing, speech recognition, natural language processing, and positive communications classification engine
- Feeding the AI with a large set of data: thousands of communications and their transcripts
- Machine learning: optimization by iteration
Key Findings
In this presentation, we will share the key findings from our proof-of-concept project. We will also suggest how these same findings can be leveraged for future projects whose goals are to use AI technology to safely operate vehicles, by reducing the risk of miscommunication.