{"title":"qlty:在科学成像深度学习工作流程中处理大型张量","authors":"Petrus H. Zwart","doi":"10.1016/j.simpa.2024.100696","DOIUrl":null,"url":null,"abstract":"<div><p>In scientific imaging, deep learning has become a pivotal tool for image analytics. However, handling large volumetric datasets, which often exceed the memory capacity of standard GPUs, require special attention when subjected to deep learning efforts. This paper introduces <span>qlty</span>, a toolkit designed to address these challenges through tensor management techniques. <span>qlty</span> offers robust methods for subsampling, cleaning, and stitching of large-scale spatial data, enabling effective training and inference even in resource-limited environments.</p></div>","PeriodicalId":29771,"journal":{"name":"Software Impacts","volume":"21 ","pages":"Article 100696"},"PeriodicalIF":1.3000,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2665963824000848/pdfft?md5=c43cac7596e8a2515fe30e93f9292eb3&pid=1-s2.0-S2665963824000848-main.pdf","citationCount":"0","resultStr":"{\"title\":\"qlty: Handling large tensors in scientific imaging deep-learning workflows\",\"authors\":\"Petrus H. Zwart\",\"doi\":\"10.1016/j.simpa.2024.100696\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In scientific imaging, deep learning has become a pivotal tool for image analytics. However, handling large volumetric datasets, which often exceed the memory capacity of standard GPUs, require special attention when subjected to deep learning efforts. This paper introduces <span>qlty</span>, a toolkit designed to address these challenges through tensor management techniques. <span>qlty</span> offers robust methods for subsampling, cleaning, and stitching of large-scale spatial data, enabling effective training and inference even in resource-limited environments.</p></div>\",\"PeriodicalId\":29771,\"journal\":{\"name\":\"Software Impacts\",\"volume\":\"21 \",\"pages\":\"Article 100696\"},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2024-08-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2665963824000848/pdfft?md5=c43cac7596e8a2515fe30e93f9292eb3&pid=1-s2.0-S2665963824000848-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Software Impacts\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2665963824000848\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, SOFTWARE ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Software Impacts","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2665963824000848","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
qlty: Handling large tensors in scientific imaging deep-learning workflows
In scientific imaging, deep learning has become a pivotal tool for image analytics. However, handling large volumetric datasets, which often exceed the memory capacity of standard GPUs, require special attention when subjected to deep learning efforts. This paper introduces qlty, a toolkit designed to address these challenges through tensor management techniques. qlty offers robust methods for subsampling, cleaning, and stitching of large-scale spatial data, enabling effective training and inference even in resource-limited environments.