Simon de Moreau, Yasser Almehio, Andrei Bursuc, Hafid El-Idrissi, Bogdan Stanciulescu, Fabien Moutarde
{"title":"发光二极管夜间光增强深度估计","authors":"Simon de Moreau, Yasser Almehio, Andrei Bursuc, Hafid El-Idrissi, Bogdan Stanciulescu, Fabien Moutarde","doi":"arxiv-2409.08031","DOIUrl":null,"url":null,"abstract":"Nighttime camera-based depth estimation is a highly challenging task,\nespecially for autonomous driving applications, where accurate depth perception\nis essential for ensuring safe navigation. We aim to improve the reliability of\nperception systems at night time, where models trained on daytime data often\nfail in the absence of precise but costly LiDAR sensors. In this work, we\nintroduce Light Enhanced Depth (LED), a novel cost-effective approach that\nsignificantly improves depth estimation in low-light environments by harnessing\na pattern projected by high definition headlights available in modern vehicles.\nLED leads to significant performance boosts across multiple depth-estimation\narchitectures (encoder-decoder, Adabins, DepthFormer) both on synthetic and\nreal datasets. Furthermore, increased performances beyond illuminated areas\nreveal a holistic enhancement in scene understanding. Finally, we release the\nNighttime Synthetic Drive Dataset, a new synthetic and photo-realistic\nnighttime dataset, which comprises 49,990 comprehensively annotated images.","PeriodicalId":501031,"journal":{"name":"arXiv - CS - Robotics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"LED: Light Enhanced Depth Estimation at Night\",\"authors\":\"Simon de Moreau, Yasser Almehio, Andrei Bursuc, Hafid El-Idrissi, Bogdan Stanciulescu, Fabien Moutarde\",\"doi\":\"arxiv-2409.08031\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Nighttime camera-based depth estimation is a highly challenging task,\\nespecially for autonomous driving applications, where accurate depth perception\\nis essential for ensuring safe navigation. We aim to improve the reliability of\\nperception systems at night time, where models trained on daytime data often\\nfail in the absence of precise but costly LiDAR sensors. In this work, we\\nintroduce Light Enhanced Depth (LED), a novel cost-effective approach that\\nsignificantly improves depth estimation in low-light environments by harnessing\\na pattern projected by high definition headlights available in modern vehicles.\\nLED leads to significant performance boosts across multiple depth-estimation\\narchitectures (encoder-decoder, Adabins, DepthFormer) both on synthetic and\\nreal datasets. Furthermore, increased performances beyond illuminated areas\\nreveal a holistic enhancement in scene understanding. Finally, we release the\\nNighttime Synthetic Drive Dataset, a new synthetic and photo-realistic\\nnighttime dataset, which comprises 49,990 comprehensively annotated images.\",\"PeriodicalId\":501031,\"journal\":{\"name\":\"arXiv - CS - Robotics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Robotics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.08031\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Robotics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.08031","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Nighttime camera-based depth estimation is a highly challenging task,
especially for autonomous driving applications, where accurate depth perception
is essential for ensuring safe navigation. We aim to improve the reliability of
perception systems at night time, where models trained on daytime data often
fail in the absence of precise but costly LiDAR sensors. In this work, we
introduce Light Enhanced Depth (LED), a novel cost-effective approach that
significantly improves depth estimation in low-light environments by harnessing
a pattern projected by high definition headlights available in modern vehicles.
LED leads to significant performance boosts across multiple depth-estimation
architectures (encoder-decoder, Adabins, DepthFormer) both on synthetic and
real datasets. Furthermore, increased performances beyond illuminated areas
reveal a holistic enhancement in scene understanding. Finally, we release the
Nighttime Synthetic Drive Dataset, a new synthetic and photo-realistic
nighttime dataset, which comprises 49,990 comprehensively annotated images.