L. Gjesteby, Tzofi Klinghoffer, Meagan Ash, Matthew A. Melton, K. Otto, Damon G. Lamb, S. Burke, L. Brattain
{"title":"脑可塑性网络映射的高效注释3d U-Nets","authors":"L. Gjesteby, Tzofi Klinghoffer, Meagan Ash, Matthew A. Melton, K. Otto, Damon G. Lamb, S. Burke, L. Brattain","doi":"10.1109/ISBI48211.2021.9434142","DOIUrl":null,"url":null,"abstract":"A fundamental challenge in machine learning-based segmentation of large-scale brain microscopy images is the time and domain expertise required by humans to generate ground truth for model training. Weakly supervised and semi-supervised approaches can greatly reduce the burden of human annotation. Here we present a study of three-dimensional U-Nets with varying levels of supervision to perform neuronal nuclei segmentation in light-sheet microscopy volumes. We leverage automated blob detection with classical algorithms to generate noisy labels on a large volume, and our experiments show that weak supervision, with or without additional fine-tuning, can outperform resource-limited fully supervised learning. These methods are extended to analyze coincidence between multiple fluorescent stains in cleared brain tissue. This is an initial step towards automated whole-brain analysis of plasticity-related gene expression.","PeriodicalId":372939,"journal":{"name":"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Annotation-Efficient 3d U-Nets For Brain Plasticity Network Mapping\",\"authors\":\"L. Gjesteby, Tzofi Klinghoffer, Meagan Ash, Matthew A. Melton, K. Otto, Damon G. Lamb, S. Burke, L. Brattain\",\"doi\":\"10.1109/ISBI48211.2021.9434142\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A fundamental challenge in machine learning-based segmentation of large-scale brain microscopy images is the time and domain expertise required by humans to generate ground truth for model training. Weakly supervised and semi-supervised approaches can greatly reduce the burden of human annotation. Here we present a study of three-dimensional U-Nets with varying levels of supervision to perform neuronal nuclei segmentation in light-sheet microscopy volumes. We leverage automated blob detection with classical algorithms to generate noisy labels on a large volume, and our experiments show that weak supervision, with or without additional fine-tuning, can outperform resource-limited fully supervised learning. These methods are extended to analyze coincidence between multiple fluorescent stains in cleared brain tissue. This is an initial step towards automated whole-brain analysis of plasticity-related gene expression.\",\"PeriodicalId\":372939,\"journal\":{\"name\":\"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)\",\"volume\":\"42 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-04-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISBI48211.2021.9434142\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISBI48211.2021.9434142","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Annotation-Efficient 3d U-Nets For Brain Plasticity Network Mapping
A fundamental challenge in machine learning-based segmentation of large-scale brain microscopy images is the time and domain expertise required by humans to generate ground truth for model training. Weakly supervised and semi-supervised approaches can greatly reduce the burden of human annotation. Here we present a study of three-dimensional U-Nets with varying levels of supervision to perform neuronal nuclei segmentation in light-sheet microscopy volumes. We leverage automated blob detection with classical algorithms to generate noisy labels on a large volume, and our experiments show that weak supervision, with or without additional fine-tuning, can outperform resource-limited fully supervised learning. These methods are extended to analyze coincidence between multiple fluorescent stains in cleared brain tissue. This is an initial step towards automated whole-brain analysis of plasticity-related gene expression.