Elias Nehme

I am a PhD Candidate at the Electrical Engineering department of the Technion, jointly supervised by Prof. Tomer Michaeli and Prof. Yoav Shechtman. Prior to that, I did my bachelors in Biomedical Engineering also at the Technion.

My research interests lie at the intersection of computational imaging and machine learning, where I mostly work on next generation cameras employing co-designed Computational Optics to recover physical properties of the imaged scene. Specifically, my latest works were on end-to-end learning of optics and image processing for precise depth estimation under challenging scenarios in the revolutionary field of super-resolution microscopy (Noble Prize in Chemistry in 2014). I also frequently collaborate with Daniel Freedman from Google Research center in Haifa.

Email  /  CV  /  Google Scholar  /  Linkedin  /  Github  /  Twitter

profile photo
Whats New?

Sep 21, 2023 - NPPC was accepted to NeurIPS 2023.

Jun 01, 2023 - I gave an invited talk on Intelligent Microscopy at the AI for Scientific Data Analysis Mini-conference.

Dec 21, 2022 - The optimal Multicolor 3D PSF work now appears in Intelligent Computing.

May 20, 2022 - Our cell-cycle dependent chromatin dynamics work now appears in iScience.

Feb 09, 2022 - Our ICCP 2021 work won an Excellent Paper Award at the MLIS-TCE Conference.

Oct 04, 2021 - I started a Research Scientist Intern position at Verily (=Google Life Sciences).

Jul 19, 2021 - Deep-ROCS now appears in Optics Express.

May 27, 2021 - QAFKA now appears in The Journal of Physical Chemistry B.

May 24, 2021 - The Liquid-immersed Optics paper now appears in Nature Communications.

Apr 15, 2021 - The collaborative project ZeroCostDL4Mic now appears in Nature Communications.

Feb 28, 2021 - Our Multi-PSF Learning work was accepted to ICCP 2021 and selected for a special issue of TPAMI.

Feb 17, 2021 - I received the Jacobs-Qualcomm Fellowship for Outstanding Ph.D. Students 2020-2021.

Oct 19, 2020 - DeepSTORM3D was covered in a Nature Methods Technology Feature on smart microscopy.

Aug 23, 2020 - I received the VATAT Prize for Research in Applied Data Science 2019.

Jun 16, 2020 - DeepSTORM3D was covered in YNET, Jerusalem Post, American Technion Society, and Glocalist!

Jun 14, 2020 - DeepSTORM3D was featured on the cover of the Lorry I. Lokey Interdisciplinary center Annual Report.

Jan 25, 2020 - DeepSTORM is the Top-cited article in Optica from 2018 with over 200 citations!

Jan 09, 2019 - DeepSTORM3D won the Best Poster Award at QBI 2019.

Jun 20, 2018 - DeepSTORM won the Lev-Margulis Prize at ISM 2018.

May 31, 2018 - DeepSTORM was covered in a Nature Methods Research Highlight.

Publications
Uncertainty Quantification via Neural Posterior Principal Components
Elias Nehme, Omer Yair, Tomer Michaeli
NeurIPS, 2023
[paper] / [code] / [video] / [project webpage]

It is possible to learn the input-adaptive top posterior PCs and visualize reconstruction uncertainty in imaging inverse problems.

Learning Optimal Multicolor PSF Design for 3D Pairwise Distance Estimation
Ofri Goldenberg, Boris Ferdman, Elias Nehme, Yael Shalev Ezra, Yoav Shechtman
Intelligent Computing, 2022
[paper]

Multicolor 3D PSF engineering enables measuring distance between 2 fluorescently tagged DNA loci in yeast cells.

Quantifying Cell-cycle-dependent Chromatin Dynamics During Interphase by Live 3D Tracking
Tal Naor, Yevgeni Nogin, Elias Nehme, Boris Ferdman, Lucien E. Weiss, Onit Alalouf, Yoav Shechtman
iScience, 2022
[paper]

Cell-cycle-dependent chromatin dynamics in live cells can be quantified with high spatiotemporal resolution using end-to-end learned optics and image processing.

Deep-ROCS: From Speckle Patterns to Superior-resolved Images by Deep Learning in Rotating Coherent Scattering Microscopy
Alon Saguy, Felix Jünger, Aviv Peleg, Boris Ferdman, Elias Nehme, Alexander Rohrbach, Yoav Shechtman
Optics Express, 2021
[paper]

Efficient numerical combination of a set of differently illuminated images retrieves high-frequency information from a small number of speckle images.

Automated Analysis of Fluorescence Kinetics in Single-Molecule Localization Microscopy Data Reveals Protein Stoichiometry
Alon Saguy, Tim N. Baldering, Lucien E. Weiss, Elias Nehme, Christos Karathanasis, Marina S. Dietz, Mike Heilemann, Yoav Shechtman
The Journal of Physical Chemistry B, 2021
[paper] / [code]

Extracting and analyzing blinking events of fluorophore clusters with neural networks enables quantification of oligomerization level in membrane receptors.

3D Printable Diffractive Optical Elements by Liquid Immersion
Reut Orange-Kedem, Elias Nehme, Lucien E. Weiss, Boris Ferdman, Onit Alalouf, Nadav Opatovski, Yoav Shechtman
Nature Communications, 2021
[paper]

Diffractive Optical Elements fabrication can be made orders of magntiude cheaper by immersing 3D printed designs in a near-index-matched solution.

Learning Optimal Wavefront Shaping for Multi-channel Imaging
Elias Nehme*, Boris Ferdman*, Lucien E. Weiss, Tal Naor, Daniel Freedman, Tomer Michaeli, Yoav Shechtman
ICCP, 2021   (Selected for Special Issue of TPAMI)
[paper] / [code] (soon) / [video]

Given a budget of signal photons, we learn the optimal wavefront codes for recovering the depth of nanometric point sources under challenging conditions.

Democratising deep learning for microscopy with ZeroCostDL4Mic
Lucas Von Chamier, Romain F. Laine, Johanna Jukkala, Christoph Spahn, Daniel Krentzel, Elias Nehme, Martina Lerche, Sara Hernández-Pérez, Pieta K. Mattila, Eleni Karinou, Séamus Holden, Ahmet Can Solak, Alexander Krull, Tim-Oliver Buchholz, Martin L. Jones, Loic A. Royer, Christophe Leterrier, Yoav Shechtman, Florian Jug, Mike Heilemann, Guillaume Jacquemet, Ricardo Henriques
Nature Communications, 2021
[paper] / [code]

Self-explanatory collection of Colab notebooks to simplify access and use of deep learning in microscopy.

Microscopic Scan-free Surface Profiling Over Extended Axial Ranges by PSF Engineering
Racheli Gordon-Soffer, Lucien E. Weiss, Ran Eshel, Boris Ferdman, Elias Nehme, Moran Bercovici, Yoav Shechtman
Science Advances, 2020
[paper]

Leveraging PSF engineering it is possible to profile the topology of dynamic microsurface in 3D without scanning.

DeepSTORM3D: Dense 3D Localization Microscopy and PSF Design by Deep Learning
Elias Nehme, Daniel Freedman, Racheli Gordon, Boris Ferdman, Lucien E. Weiss, Onit Alalouf, Tal Naor, Reut Orange, Tomer Michaeli, Yoav Shechtman
Nature Methods, 2020   (Best Poster Award at QBI 2019)
[paper] / [code] / [video]

We address the challenge of dense 3D localization from a single 2D image by harnessing neural networks for both acquisition design and image processing.

VIPR: Vectorial Implementation of Phase Retrieval for Fast and Accurate Microscopic Pixel-wise Pupil Estimation
Boris Ferdman, Elias Nehme, Lucien E. Weiss, Reut Orange, Onit Alalouf, Yoav Shechtman
Optics Express, 2020
[paper] / [code]

Vectorial phase retreival facilitated by utilizing Wirtinger flow and vectorial optics.

Single-Particle Diffusion Characterization by Deep Learning
Naor Granik, Lucien E. Weiss, Elias Nehme, Maayan Levin, Michael Chein, Eran Perlson, Yael Roichman, Yoav Shechtman
Biophysical Journal, 2019
[paper] / [code]

Temporal convolutional networks can be employed to classify many short single-particle trajectories by diffusion type.

Deep-STORM: Super-resolution Single-molecule Microscopy by Deep Learning
Elias Nehme, Lucien E. Weiss, Tomer Michaeli, Yoav Shechtman
Optica, 2018   (Lev-Margulis Prize at ISM 2018, and Top cited article in Optica from 2018)
[paper] / [code]

Using a physical simulator we learn a neural network that achieves SotA performance in dense 2D localization microscopy.

Teaching Assistant
Statistical Methods in Image Processing
Teaching in English with Prof. Tomer Michaeli
[EE-048954]
Spring 2022

The course focuses on deep generative models for images describing practical strategies for learning high-dimensional probability distributions from samples.

Algorithms and Applications in Computer Vision
Taught in English with Tal Daniel, Dahlia Urbach, Hila Manor, and Prof. Anat Levin
[EE-046746]
Spring 2021, Winter 2022

The course focuses on fundamental problems in computer vision describing practical solutions including state-of-the-art deep learning approaches.

Computational Optical Imaging
Taught in English with Prof. Yoav Shechtman
[BME-336547]
Winter 2020

The course surveys recent computational imaging techniques co-designing optical sensors and data processing algorithms to advance imaging capabilities.

Analysis of Biological Signals
Taught in Hebrew with Prof. Yoav Shechtman
[BME-336208]
Spring 2018-2020

The course focuses on fundamental approaches in biological signal processing including linear filtering, correlation functions, non-stationary signals, and point processes.

Service
Teachers Qualification Program
Taught in Hebrew with Prof. Yoav Shechtman
Israel Ministry of Science and Technion-IIT
Winter 2019-2020

Fundamentals of biosignal and bioimage processing delivered to electronics high school teachers.


Website credits to Jon Barron.