Skip to content

Machine learning for the cryo-EM and cryo-ET pipeline

Simons Machine Learning Center

The Simons Machine Learning Center (SMLC) is a dedicated machine learning research group within NYSBC. The SMLC develops computational methods and software that improve how cryo-EM and cryo-ET data are collected, processed, and interpreted, with a focus on making structural biology workflows more automated, data-efficient, and informative.

SMLC research applies modern machine learning, computer vision, and deep learning approaches to challenges across the cryo-EM pipeline. Areas of emphasis include automated microscope targeting and data collection; particle picking and object detection; image denoising; analysis of heterogeneous and flexible structures; tomogram and cellular segmentation; and models that integrate information from cryo-EM, cryo-ET, protein sequence, structure, and function. These methods help researchers extract more biological insight from complex, noisy, and information-rich datasets.

By pairing algorithm development with the experimental scale of SEMC, the SMLC creates tools that can be tested on real cryo-EM and cryo-ET workflows and then shared with the broader structural biology community. This close connection between computation, instrumentation, and biological application allows the group to address practical bottlenecks in data acquisition and analysis while advancing new approaches for understanding biomolecular structure and function.

Publications

Ghostbuster: Beyond Ewald Sphere Curvature Correction for Cryo-EM Single Particle Reconstruction Via Phase Retrieval

Joel Yeo, Benedikt Daurer, Dari Kimanius, Tristan Bepler, Deepan Balakrishnan, Yong Zi Tan, N. Duane Loh

Ghostbuster: Beyond Ewald Sphere Curvature Correction for Cryo-EM Single Particle Reconstruction Via Phase Retrieval

2025 January

Latent disentanglement in mesh variational autoencoders improves the diagnosis of craniofacial syndromes and aids surgical planning

Simone Foti, Alexander J. Rickart, Bongjin Koo, Eimear O’ Sullivan, Lara S. van de Lande, Athanasios Papaioannou, Roman Khonsari, Danail Stoyanov, N.u. Owase Jeelani, Silvia Schievano, David J. Dunaway, Matthew J. Clarkson

Computer Methods and Programs in Biomedicine, Vol. 256, Pages 108395

2024 November

Ghostbuster: A phase retrieval diffraction tomography algorithm for cryo-EM

Joel Yeo, Benedikt J. Daurer, Dari Kimanius, Deepan Balakrishnan, Tristan Bepler, Yong Zi Tan, N. Duane Loh

Ultramicroscopy, Vol. 262, Pages 113962

2024 August

The value of Augmented Reality in surgery — A usability study on laparoscopic liver surgery

João Ramalhinho, Soojeong Yoo, Thomas Dowrick, Bongjin Koo, Murali Somasundaram, Kurinchi Gurusamy, David J. Hawkes, Brian Davidson, Ann Blandford, Matthew J. Clarkson

Medical Image Analysis, Vol. 90, Pages 102943

2023 December

Machine learning optimization of candidate antibody yields highly diverse sub-nanomolar affinity antibody libraries

Lin Li, Esther Gupta, John Spaeth, Leslie Shing, Rafael Jaimes, Emily Engelhart, Randolph Lopez, Rajmonda S. Caceres, Tristan Bepler, Matthew E. Walsh

Nature Communications, Vol. 14, Issue 1

2023 June

Learning to automate cryo-electron microscopy data collection with Ptolemy

Paul T. Kim, Alex J. Noble, Anchi Cheng, Tristan Bepler

IUCrJ, Vol. 10, Issue 1, Pages 90-102

2023 January

Machine Learning Optimization of Candidate Antibodies Yields Highly Diverse Sub-nanomolar Affinity Antibody Libraries

Lin Li, Esther Gupta, John Spaeth, Leslie Shing, Rafael Jaimes, Rajmonda Sulo Caceres, Tristan Bepler, Matthew E. Walsh

2022 October

Automatic, global registration in laparoscopic liver surgery

Bongjin Koo, Maria R. Robu, Moustafa Allam, Micha Pfeiffer, Stephen Thompson, Kurinchi Gurusamy, Brian Davidson, Stefanie Speidel, David Hawkes, Danail Stoyanov, Matthew J. Clarkson

International Journal of Computer Assisted Radiology and Surgery, Vol. 17, Issue 1, Pages 167-176

2022 January

An engineered protein-phosphorylation toggle network with implications for endogenous network discovery

Deepak Mishra, Tristan Bepler, Brian Teague, Bonnie Berger, Jim Broach, Ron Weiss

Science, Vol. 373, Issue 6550

2021 July

CryoDRGN: reconstruction of heterogeneous cryo-EM structures using neural networks

Ellen D. Zhong, Tristan Bepler, Bonnie Berger, Joseph H. Davis

Nature Methods, Vol. 18, Issue 2, Pages 176-185

2021 February

DeepSeqPanII: an interpretable recurrent neural network model with attention mechanism for peptide-HLA class II binding prediction

Zhonghao Liu, Jing Jin, Yuxin Cui, Zheng Xiong, Alireza Nasiri, Yong Zhao, Jianjun Hu

IEEE/ACM Transactions on Computational Biology and Bioinformatics, Vol. 19, Issue 4, Pages 2188-2196

2021 January

Deep learning pan-specific model for interpretable MHC-I peptide binding prediction with improved attention mechanism

Jing Jin, Zhonghao Liu, Alireza Nasiri, Yuxin Cui, Stephen‐Yves Louis, Ansi Zhang, Yong Zhao, Jianjun Hu

Proteins: Structure, Function and Bioinformatics, Vol. 89, Issue 7, Pages 866-883

2021 January

Machine learning across the cryo-EM pipeline—targeting particle-picking, denoising, segmentation.