PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics
Problem
Reconstructing neurons, synapses, and organelles from nanometer-resolution volumetric microscopy requires scalable segmentation tools that can exploit scarce expert annotations and abundant unlabeled data.
Why it matters
Such segmentation underpins understanding of neuronal communication, metabolism, and development in animal brains.
What the AI did
PyTC, an open-source PyTorch deep-learning framework, performs semantic and instance segmentation of volumetric microscopy images, supporting multi-task and semi-supervised learning via configuration options.
Results
Best performance in the CREMI challenge for synaptic cleft segmentation (abstract truncated).
Impact
The framework reportedly achieved best CREMI synaptic cleft segmentation performance, per this preprint.
Record
| Venue | arXiv (Cornell University) |
|---|---|
| Published | 2021 |
| Work type | preprint |
| Authors | Zudi Lin, Donglai Wei, Jeff William Lichtman, Hanspeter Pfister |
| Citations | 25 (OpenAlex, at import time) |
| Model or method | PyTC (PyTorch-based deep learning framework) |
| Organization | not stated in source |
| Primary source | https://doi.org/10.48550/arxiv.2112.05754 |
| Open access | green |
| Keywords | connectomics, instance segmentation, PyTorch, electron microscopy, CREMI, semi-supervised learning |
Importance rating
real but narrower advance
Open-source framework supporting connectomics segmentation for understanding neuronal communication and development; broad field utility but no stated beneficiary scale.
More in Software & Coding
| # | Paper | Year | Citations | Importance |
|---|---|---|---|---|
| 1 | ImageNet classification with deep convolutional neural networks | 2017 | 106,345 |
8
|
| 2 | Deep Residual Learning for Image Recognition | 2016 | 221,134 |
8
|
| 3 | Faster sorting algorithms discovered using deep reinforcement learning | 2023 | 175 |
8
|
| 4 | A deep learning‐based approach for software vulnerability detection using code metrics | 2022 | 42 |
7
|
| 5 | Deep Learning-Based Attack Detection and Classification in Android Devices | 2023 | 41 |
7
|