Kniesel, Hannah;
Ropinski, Timo;
Bergner, Tim;
Devan, Kavitha Shaga;
Read, Clarissa;
Walther, Paul;
Ritschel, Tobias;
(2022)
Clean Implicit 3D Structure from Noisy 2D STEM Images.
In:
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
(pp. pp. 20730-20740).
IEEE: New Orleans, LA, USA.
Preview |
Text
Kniesel_Clean_Implicit_3D_Structure_From_Noisy_2D_STEM_Images_CVPR_2022_paper.pdf - Accepted Version Download (3MB) | Preview |
Abstract
Scanning Transmission Electron Microscopes (STEMs) acquire 2D images of a 3D sample on the scale of individual cell components. Unfortunately, these 2D images can be too noisy to be fused into a useful 3D structure and facilitating good denoisers is challenging due to the lack of clean-noisy pairs. Additionally, representing detailed 3D structure can be difficult even for clean data when using regular 3D grids. Addressing these two limitations, we suggest a differentiable image formation model for STEM, allowing to learn a joint model of 2D sensor noise in STEM together with an implicit 3D model. We show, that the combination of these models are able to successfully disentangle 3D signal and noise without supervision and outperform at the same time several baselines on synthetic and real data.
| Type: | Proceedings paper |
|---|---|
| Title: | Clean Implicit 3D Structure from Noisy 2D STEM Images |
| Event: | IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) |
| Location: | LA, New Orleans |
| Dates: | 18 Jun 2022 - 24 Jun 2022 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/CVPR52688.2022.02010 |
| Publisher version: | https://doi.org/10.1109/cvpr52688.2022.02010 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | 3-DIMENSIONAL RECONSTRUCTION, Computer Science, Computer Science, Artificial Intelligence, Imaging Science & Photographic Technology, MICROSCOPY, Science & Technology, Technology |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10215896 |
Archive Staff Only
 |
View Item |
