Is an international peer-reviewed open access journal，Focus on applied natural science。ByMDPIOnline publishing，Issued twice a month。In engineering（Multidisciplinary）And general engineering areJCRRatedQLevel 1。

August 8, 2024，It was studied by Dr. Gao Le, Vice President of Sany Heavy Machinery Small Excavation Research Institute, and Professor Hu Jie of Shanghai Jiaotong University.，Entitled《E-GTN: Advanced Terrain Sensing Framework for Enhancing Intelligent Decision Making of Excavators》The paper was officially released.。

 Introduction of the paper 

 

Facing the complex and changeable mining environment，A Multimodal Large Scale Model Technique——E-GTNFrame，It is jointly developed by Dr. Gaulle's team and Professor Hu Jie's team of Shanghai Jiaotong University.，Provides a theoretical solution to the existing challenge of unmanned mining。

 

Traditional unmanned mining techniques rely on expert experience and dynamic programming.，However, there are limitations in efficiency and generalization.。E-GTNThe framework uses terrain feature extraction and multi-modal fusion technology.，Based on reinforcement learning and large model architecture，It significantly improves the decision-making ability and environmental adaptability of unmanned mining.。The framework includes terrain information processing.、Terrain feature extraction and decision making。

E-GTNThe framework integrates multimodal fusion techniques.，By combining multiple sensor data，The high precision 3D reconstruction of the mining environment is realized.，It provides more abundant and accurate terrain information for the unmanned excavator.。In addition，The research team proposed a grid-based mining environment awareness technology based on convolutional network.，Custom-designed modelGridNetIt can extract significant terrain features.。The decision-making process is modeled as deep reinforcement learning based on a large model.（DRL）Algorithm is used for mining tasks。This technology can not only respond to environmental changes in real time.，It also has the ability of intelligent decision-making.，So that that unman excavator can work efficiently under various terrain condition、Precise excavation operation。

E-GTNThe launch of the framework，It provides a new technical exploration for the automation and intelligent development of mining industry.。With the maturity of large model technology and the expansion of its application scope,，Will bring more precision、Safe and efficient unmanned operation。