Tag Archives: World Perception

Hexagon buys HARD-LINE, bringing scale to interoperable autonomy puzzle

Automation, Communications in mining, IoT, Mining equipment, Mining mergers and acquisitions, Mining services, Mining software, , , , , , , , , , ,

Hexagon has agreed to acquire Canada-based tele-remote operations leader HARD-LINE, bringing into its offering all the elements it needs to compete in the autonomous haulage system (AHS) space.

At HxGN LIVE Global 2023 in Las Vegas last month, Hexagon’s Mining division said it was enhancing its relationship with the company, building on a previous distribution agreement the two companies announced back in September 2021.

Now, the two companies have agreed to combine their expertise to achieve their ultimate autonomy goals.

Speaking to IM about the deal, Nick Hare, President, Hexagon’s Mining division, said: “It’s an absolute win for all stakeholders. It is good for us as it enables us to deliver on both safety and autonomy, core to our mission, with HARD-LINE’s considerable experience filling in technology gaps in remote control and its considerable library of interfaces on vehicle by-wire. It’s good for HARD-LINE, giving them access to our sales, distribution and support base in 50 different countries; and, most importantly, it is good for the customers, ensuring that they have an interoperable, OEM-independent partner to rely on.”

Walter Siggelkow, President of HARD-LINE, said he saw the combination of HARD-LINE’s mine operator market knowledge and Hexagon’s suite of products and global presence providing the “world’s first truly integrated autonomous solution”.

He told IM: “Hexagon and HARD-LINE share a common vision that autonomy can be accomplished without starting over. The advanced technologies to extend this capital investment is now available. We are completely confident that this is a perfect fit.”

HARD-LINE says it has developed “by-wire vehicle control solutions” for more than 200 equipment models covering several OEMs over the last 27 years, with more than 3,000 conversions of its platform completed to date, including its renowned TeleOp system. On top of its remote-control solutions, it also provides related network infrastructure to enable the tele-remote operation of heavy machinery from a secure control station on the surface or underground, regardless of distance.

Hexagon, meanwhile, has a significant autonomy stack, including the HxGN Autonomous Mining Mission Manager solution choreographing the movement of autonomous and non-autonomous vehicles, and mine production activities through one interface; the World Perception solution to enable object detection, operator vehicle-to-vehicle and vehicle-to-person awareness; as well as on-board infrastructure such as sensors and antenna.

Hare estimates Hexagon is already the biggest provider of autonomy solutions for off-road heavy industry, but he believes this latest deal will accelerate the realisation of its autonomy ambitions in mining: providing a scalable automation platform that all mining companies can use and grow with.

“Now we have the ability to move the machines, this creates a complete OEM independent solution from one partner,” he said. “You will start to see us go head-to-head on most projects with other AHS providers. The key – and we feel the differentiator for customers – is that we will be matching this with our ability to safely deliver customer success.

“A lot of AHS implementations have enabled companies to move more tonnes, but the return on investment hasn’t always been there. We intend to change that.”

The potential impact Hexagon can make on the AHS market from acquiring HARD-LINE is inevitably the highlight of this deal, but it also has positive ramifications for its latest product offerings, including HxGN Underground Mining, HxGN Autonomous Mining and the HxGN MineProtect solutions.

Hare implied the HARD-LINE platform – when integrated with the Minnovare drilling solutions the company recently acquired – could also see it expand into autonomous underground drilling solutions.

U&M and Hexagon ready to deploy AHS solution at Brazil mine

Automation, Communications in mining, IoT, Mine operation news, Mining equipment, Mining safety, Mining services, Mining software, Precious metals, Sustainable mining, , , , , , , , , , , , , , , , ,

U&M Mineração e Construção S/A, as the largest native open-pit mining contractor in the Americas and one increasingly focused on sustainability, is about to embark on a major autonomous haulage project that could prove transformational for all sizes of mine sites across the globe.

The company has been busily working on an in-house Autonomous Haulage System (AHS) for several years, enlisting the help of Hexagon’s Mining division back in 2020 to ensure what it delivered to the market was a commercial proposition with widescale applicability, IM discovered this week at HxGN LIVE Global 2023 in Las Vegas.

Now the companies are ready to deploy their combined OEM-agnostic AHS solution at a mine in Brazil, starting next month, as part of a plan to bring two AHS-enabled retrofitted Caterpillar 777 trucks to the operation.

The collaboration is seeing U&M carry out all mechanical changes to the 100-ton-class payload trucks to make them automation-ready without disturbing the OEM system. The contractor is also in charge of the navigation system and software that the trucks will run on – the ‘autonomous driver’ as it could be termed.

Hexagon, for its part, provides the HxGN Autonomous Mining Mission Manager Solution to optimise the movement of autonomous and non-autonomous vehicles, and mine production activities through one interface; the World Perception solution to enable object detection, operator vehicle-to-vehicle and vehicle-to-person awareness; and some additional on-board infrastructure – such as sensors and an antenna.

This, according to the companies, makes for an autonomous contractor solution that can be rolled out anywhere in the world.

“What we are creating is a scalable platform that can be used on any truck,” Mauricio Casara of U&M says

“The first project may involve Cat 777s, but what we are creating is a scalable platform that can be used on any truck,” Mauricio Casara, Commercial Director at U&M, told IM. “We are looking to improve on the legacy AHS solutions by making automation available to any size of mine with any type of trucks.”

As part of the company’s R&D work to this point, it has also retrofitted an autonomous solution on a Komatsu 730E, with that truck running at its proving grounds in Brazil.

Interestingly for this proof of concept involving the two Cat 777s, the plan is to enable the trucks to interact with both autonomous and manned vehicles in the haulage cycle from the off: an interaction that the traditional AHS providers have only just started to work on after more than a decade of industry deployments.

This is just one of the hurdles the solution will overcome, according to Andrew Crose, Vice President, Autonomous Mining, Hexagon’s Mining division.

“The world perception sensor stack that we have on board these machines will allow us to distinguish between trucks, light vehicles, berms, people and many other objects,” he said. “By leveraging this, we can ensure the trucks operate as safely as possible while being as productive as possible. That is key to achieving buy-in from all stakeholders involved.”

While the official partnership for this project was not signed until 2020, U&M has been utilising the GNSS positioning smarts of Hexagon – through the NovAtel business it acquired – for many more years.

This same GNSS solution is being leveraged in the two-strong autonomous truck trial along with V2X, 4D Radars,  ultra-wideband time-of-flight systems and more.

Crose added: “It’s worth mentioning that around 60% of the autonomous machines running in the field have some Hexagon solution on them. We are sometimes providing the positioning, world perception, fleet and mission management, onboard autonomy and by-wire, all part of our interoperable strategy.”

While this initiative is inevitably going to pique the interest of those companies in charge of running these autonomous trucks, U&M has no plans to compete with the likes of Caterpillar and Komatsu when it comes to manufacturing automation-ready trucks.

“There are so many existing trucks out in the field that our clients are running; all of which can be retrofitted with the solution we are working on,” Casara said. “The whole industry talks about sustainability and how to mine sustainably, but the sustainable solution to achieving autonomous operations is not to build brand new trucks and equip them for automation; it is to retrofit the smarts onto them to enable that automation.

“This is the sustainable way to roll out the automation needed across the sector to achieve mining companies’ productivity and decarbonisation goals.”

Hexagon’s Mining division highlights Power of One progress with new autonomous solutions launch

Automation, Communications in mining, Equipment maintenance, IoT, Mining equipment, Mining events, Mining safety, Mining services, Mining software, , , , , , , , , , , , , , , , , ,

Hexagon’s Mining division, on the day HxGN LIVE Global 2023 kicks off in Las Vegas, has introduced a new autonomous portfolio to its planning, operations and safety technology portfolios, signalling its intent to continue to solve the mining industry’s biggest challenges.

HxGN Autonomous Mining is a portfolio that protects people and equipment while addressing the challenges of operational productivity and decarbonisation, Hexagon’s Mining division says.

“By helping to autonomously manage vehicle traffic, improve fleet situation awareness and introduce drill automation, the new portfolio empowers mines to future-proof operations with the foundational building blocks of full operational autonomy,” it explained.

These building blocks include tools providing autonomous world perception, path planning in both manned driver-assist and autonomous operation, and machine intervention up through control on mining vehicles and drills primarily in open-pit environments and haulage operations.

HxGN Autonomous Mining unites Hexagon’s Power of One hardware with its core computing platform, connecting a unique ecosystem of sensors and software, according to the company. “The portfolio can help mines to succeed today while preparing for tomorrow,” Andrew Crose, Vice President, Autonomous Mining, Hexagon’s Mining division, said.

The Power of One platform is a holistic, life-of-mine smart solution connecting sensors, software, in-field apps and cloudware. The aim is to connect the mine to the boardroom via a single on-board ecosystem comprising a smart computer, antenna and display.

Nick Hare, President of Hexagon’s Mining division, told IM on the side lines of the Las Vegas event, hosted at Caesar’s Forum, that the company has rapidly moved from concept to reality with the Power of One platform.

He explained: “At MINExpo 2021, we announced the Power of One concept. Last year at HxGN LIVE Global, we told everyone it was now available and ready to implement. This year, we’re able to talk about real deployments that will start from the next quarter.

“We’ve moved from concept to deployment in just under two years, defying the supply chain issues that have affected everyone in this industry.”

The building blocks that are part of HxGN Autonomous Mining include the World Perception suite of detection solutions; mining’s first Level-9 collision avoidance technology, Hexagon’s collision intervention system, HxGN MineProtect Vehicle Intervention System; HxGN MineOperate Reverse Assist for optimised shovel and truck spotting; HxGN Autonomous Mining VIS Analytics to analyse and compare information such as locations, equipment and more; the intuitive drill automation platform, HxGN Autonomous Mining Drill Assist; HxGN Autonomous Mining Platooning Solutions to maximise the safety of ore haulage, boost cost-efficiency and reduce carbon emissions; and HxGN Autonomous Mining Mission Manager Solution to empower pit controllers and dispatchers to optimise the movement of autonomous and non-autonomous vehicles, and mine production activities through one interface.

The company’s “unparalleled” technology stack – as Crose refers to it – can currently automate around 80% of the processes involved in open-pit haulage, according to Hare.

In an on-the-road scenario, the company can already automate the majority of functions, as it is proving out with Mineral Resources Ltd on its autonomous road train project. In pit haulage, it is also working on an autonomous haulage system (AHS) solution to compete with the likes of Caterpillar and Komatsu’s own AHS platforms. Parts of this are likely to be seen operating later this year. In terms of autonomous drilling, the company is getting even closer to the fully-autonomous benchmark through work it is carrying out with Phoenix Drill Control.

While not all Power of One users will leverage the entire technology stack from the off, Hare said he is expecting many companies to quickly add building blocks to their deployments as they familiarise themselves with the platform.

“We have significantly improved upon the industry standard when it comes to the Power of One and this new automation platform,” he said. “For example, when integrating fleet management – under our HxGN MineOperate solution – and collision avoidance (the HxGN MineProtect Collision Avoidance System within the World Perception Suite), we can reduce the number of interfaces operators have to interact with. Depending on the scenario, we can highlight an optimised route to the crusher for a truck or make them aware of an impending collision on just one screen. This significantly improves the user experience, reduces the likelihood of incidents and improves productivity.”

Another significant enhancement the company has achieved with its Power of One platform is consolidating the numerous antenna fitted to open-pit trucks into a single antenna able to receive and, depending on the network and software settings, process the same amount of information.

“From a perception perspective, we have also moved up the tiers with our sensor solutions, going from a 2D radar-based system as was used for our initial collision avoidance systems to a 4D radar-based platform able to distinguish between people, berms, trucks, light vehicles, etc,” Hare said.

Add to this upgraded software to process all the valuable data coming off the sensor and the company believes it now has as close to an off-the-shelf commercial solution as can currently be obtained.

The platform is expected to bring immediate productivity benefits for customers – Crose mentions better blast outcomes with drilling automation to improved equipment performance and production via autonomously managed vehicle movement – but the reduction in hardware is also expected to lead to significant cost savings for clients.

“We are confident that this portfolio, under the auspices of the Power of One platform, will provide return on investment for clients,” Hare said. “While it is being integrated into a standardised offering that aids deployment cost and time, the starting point for every project is how to solve the problems the mining client is experiencing. We will take time to understand what issues they are having on site and ensure the system rules and algorithms are built in such a way as to prioritise solving these. At the same time, we will highlight as many opportunities to optimise their operations as we can.

“This is how we ensure that value is generated immediately from day one.”

Hexagon’s Mining division also introduced HxGN Underground Mining, an integrated sensor-software portfolio built for the unique challenges of underground environments, at the same event.