Intelligent Prediction of Ore Block Shapes Based on Novel View Synthesis Technology

Abstract

To address the problem of incomplete perception of limited viewpoints of ore blocks in future remote and intelligent shoveling-dominated mining scenarios, a method of using new view generation technology to predict ore blocks with limited view based on a latent diffusion model is proposed. Initially, an ore block image-pose dataset is created. Then, based on prior knowledge, the latent diffusion model undergoes transfer learning to develop an intelligent ore block shape prediction model (IOBSPM) for rock blocks. During training, structural similarity loss is innovatively introduced to constrain the prediction results and solve the issue of discontinuity in generated images. Finally, neural surface reconstruction is performed using the generated multi-view images of rock blocks to obtain a 3D model. Experimental results show that the prediction model, trained on the rock block dataset, produces better morphological and detail generation compared to the original model, with single-view generation time within 5 s. The average PSNR, SSIM, and LPIPS values reach 23.02 dB, 0.754, and 0.268, respectively. The generated views also demonstrate good performance in 3D reconstruction, highlighting significant implications for future research on remote and autonomous shoveling.