1
|
Rosen J, Alford S, Allan B, Anand V, Arnon S, Arockiaraj FG, Art J, Bai B, Balasubramaniam GM, Birnbaum T, Bisht NS, Blinder D, Cao L, Chen Q, Chen Z, Dubey V, Egiazarian K, Ercan M, Forbes A, Gopakumar G, Gao Y, Gigan S, Gocłowski P, Gopinath S, Greenbaum A, Horisaki R, Ierodiaconou D, Juodkazis S, Karmakar T, Katkovnik V, Khonina SN, Kner P, Kravets V, Kumar R, Lai Y, Li C, Li J, Li S, Li Y, Liang J, Manavalan G, Mandal AC, Manisha M, Mann C, Marzejon MJ, Moodley C, Morikawa J, Muniraj I, Narbutis D, Ng SH, Nothlawala F, Oh J, Ozcan A, Park Y, Porfirev AP, Potcoava M, Prabhakar S, Pu J, Rai MR, Rogalski M, Ryu M, Choudhary S, Salla GR, Schelkens P, Şener SF, Shevkunov I, Shimobaba T, Singh RK, Singh RP, Stern A, Sun J, Zhou S, Zuo C, Zurawski Z, Tahara T, Tiwari V, Trusiak M, Vinu RV, Volotovskiy SG, Yılmaz H, De Aguiar HB, Ahluwalia BS, Ahmad A. Roadmap on computational methods in optical imaging and holography [invited]. APPLIED PHYSICS. B, LASERS AND OPTICS 2024; 130:166. [PMID: 39220178 PMCID: PMC11362238 DOI: 10.1007/s00340-024-08280-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Accepted: 07/10/2024] [Indexed: 09/04/2024]
Abstract
Computational methods have been established as cornerstones in optical imaging and holography in recent years. Every year, the dependence of optical imaging and holography on computational methods is increasing significantly to the extent that optical methods and components are being completely and efficiently replaced with computational methods at low cost. This roadmap reviews the current scenario in four major areas namely incoherent digital holography, quantitative phase imaging, imaging through scattering layers, and super-resolution imaging. In addition to registering the perspectives of the modern-day architects of the above research areas, the roadmap also reports some of the latest studies on the topic. Computational codes and pseudocodes are presented for computational methods in a plug-and-play fashion for readers to not only read and understand but also practice the latest algorithms with their data. We believe that this roadmap will be a valuable tool for analyzing the current trends in computational methods to predict and prepare the future of computational methods in optical imaging and holography. Supplementary Information The online version contains supplementary material available at 10.1007/s00340-024-08280-3.
Collapse
Affiliation(s)
- Joseph Rosen
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
- Institute of Physics, University of Tartu, W. Ostwaldi 1, 50411 Tartu, Estonia
| | - Simon Alford
- Department of Anatomy and Cell Biology, University of Illinois at Chicago, 808 South Wood Street, Chicago, IL 60612 USA
| | - Blake Allan
- Faculty of Science Engineering and Built Environment, Deakin University, Princes Highway, Warrnambool, VIC 3280 Australia
| | - Vijayakumar Anand
- Institute of Physics, University of Tartu, W. Ostwaldi 1, 50411 Tartu, Estonia
- Optical Sciences Center and ARC Training Centre in Surface Engineering for Advanced Materials (SEAM), School of Science, Computing and Engineering Technologies, Optical Sciences Center, Swinburne University of Technology, Hawthorn, Melbourne, VIC 3122 Australia
| | - Shlomi Arnon
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
| | - Francis Gracy Arockiaraj
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
- Institute of Physics, University of Tartu, W. Ostwaldi 1, 50411 Tartu, Estonia
| | - Jonathan Art
- Department of Anatomy and Cell Biology, University of Illinois at Chicago, 808 South Wood Street, Chicago, IL 60612 USA
| | - Bijie Bai
- Electrical and Computer Engineering Department, Bioengineering Department, California NanoSystems Institute, University of California, Los Angeles (UCLA), Los Angeles, CA USA
| | - Ganesh M. Balasubramaniam
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
| | - Tobias Birnbaum
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel VUB), Pleinlaan 2, 1050 Brussel, Belgium
- Swave BV, Gaston Geenslaan 2, 3001 Leuven, Belgium
| | - Nandan S. Bisht
- Applied Optics and Spectroscopy Laboratory, Department of Physics, Soban Singh Jeena University Campus Almora, Almora, Uttarakhand 263601 India
| | - David Blinder
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel VUB), Pleinlaan 2, 1050 Brussel, Belgium
- IMEC, Kapeldreef 75, 3001 Leuven, Belgium
- Graduate School of Engineering, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba, Chiba Japan
| | - Liangcai Cao
- Department of Precision Instruments, Tsinghua University, Beijing, 100084 China
| | - Qian Chen
- Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing, 210094 Jiangsu China
| | - Ziyang Chen
- Fujian Provincial Key Laboratory of Light Propagation and Transformation, College of Information Science and Engineering, Huaqiao University, Xiamen, 361021 Fujian China
| | - Vishesh Dubey
- Department of Physics and Technology, UiT The Arctic University of Norway, 9037 Tromsø, Norway
| | - Karen Egiazarian
- Computational Imaging Group, Faculty of Information Technology and Communication Sciences, Tampere University, 33100 Tampere, Finland
| | - Mert Ercan
- Institute of Materials Science and Nanotechnology, National Nanotechnology Research Center (UNAM), Bilkent University, 06800 Ankara, Turkey
- Department of Physics, Bilkent University, 06800 Ankara, Turkey
| | - Andrew Forbes
- School of Physics, University of the Witwatersrand, Johannesburg, South Africa
| | - G. Gopakumar
- Department of Computer Science and Engineering, Amrita School of Computing, Amrita Vishwa Vidyapeetham, Amritapuri, Vallikavu, Kerala India
| | - Yunhui Gao
- Department of Precision Instruments, Tsinghua University, Beijing, 100084 China
| | - Sylvain Gigan
- Laboratoire Kastler Brossel, Centre National de la Recherche Scientifique (CNRS) UMR 8552, Sorbonne Universite ´, Ecole Normale Supe ´rieure-Paris Sciences et Lettres (PSL) Research University, Collège de France, 24 rue Lhomond, 75005 Paris, France
| | - Paweł Gocłowski
- Department of Physics and Technology, UiT The Arctic University of Norway, 9037 Tromsø, Norway
| | | | - Alon Greenbaum
- Department of Biomedical Engineering, North Carolina State University and University of North Carolina at Chapel Hill, Raleigh, NC 27695 USA
- Comparative Medicine Institute, North Carolina State University, Raleigh, NC 27695 USA
- Bioinformatics Research Center, North Carolina State University, Raleigh, NC 27695 USA
| | - Ryoichi Horisaki
- Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656 Japan
| | - Daniel Ierodiaconou
- Faculty of Science Engineering and Built Environment, Deakin University, Princes Highway, Warrnambool, VIC 3280 Australia
| | - Saulius Juodkazis
- Optical Sciences Center and ARC Training Centre in Surface Engineering for Advanced Materials (SEAM), School of Science, Computing and Engineering Technologies, Optical Sciences Center, Swinburne University of Technology, Hawthorn, Melbourne, VIC 3122 Australia
- World Research Hub Initiative (WRHI), Tokyo Institute of Technology, 2-12-1, Ookayama, Tokyo, 152-8550 Japan
| | - Tanushree Karmakar
- Laboratory of Information Photonics and Optical Metrology, Department of Physics, Indian Institute of Technology (Banaras Hindu University), Varanasi, Uttar Pradesh 221005 India
| | - Vladimir Katkovnik
- Computational Imaging Group, Faculty of Information Technology and Communication Sciences, Tampere University, 33100 Tampere, Finland
| | - Svetlana N. Khonina
- IPSI RAS-Branch of the FSRC “Crystallography and Photonics” RAS, 443001 Samara, Russia
- Samara National Research University, 443086 Samara, Russia
| | - Peter Kner
- School of Electrical and Computer Engineering, University of Georgia, Athens, GA 30602 USA
| | - Vladislav Kravets
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
| | - Ravi Kumar
- Department of Physics, SRM University – AP, Amaravati, Andhra Pradesh 522502 India
| | - Yingming Lai
- Laboratory of Applied Computational Imaging, Centre Énergie Matériaux Télécommunications, Institut National de la Recherche Scientifique, Université du Québec, Varennes, QC J3X1Pd7 Canada
| | - Chen Li
- Department of Biomedical Engineering, North Carolina State University and University of North Carolina at Chapel Hill, Raleigh, NC 27695 USA
- Comparative Medicine Institute, North Carolina State University, Raleigh, NC 27695 USA
| | - Jiaji Li
- Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Research Institute (SCIRI), Nanjing, 210019 Jiangsu China
| | - Shaoheng Li
- School of Electrical and Computer Engineering, University of Georgia, Athens, GA 30602 USA
| | - Yuzhu Li
- Electrical and Computer Engineering Department, Bioengineering Department, California NanoSystems Institute, University of California, Los Angeles (UCLA), Los Angeles, CA USA
| | - Jinyang Liang
- Laboratory of Applied Computational Imaging, Centre Énergie Matériaux Télécommunications, Institut National de la Recherche Scientifique, Université du Québec, Varennes, QC J3X1Pd7 Canada
| | - Gokul Manavalan
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
| | - Aditya Chandra Mandal
- Laboratory of Information Photonics and Optical Metrology, Department of Physics, Indian Institute of Technology (Banaras Hindu University), Varanasi, Uttar Pradesh 221005 India
| | - Manisha Manisha
- Laboratory of Information Photonics and Optical Metrology, Department of Physics, Indian Institute of Technology (Banaras Hindu University), Varanasi, Uttar Pradesh 221005 India
| | - Christopher Mann
- Department of Applied Physics and Materials Science, Northern Arizona University, Flagstaff, AZ 86011 USA
- Center for Materials Interfaces in Research and Development, Northern Arizona University, Flagstaff, AZ 86011 USA
| | - Marcin J. Marzejon
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - Chané Moodley
- School of Physics, University of the Witwatersrand, Johannesburg, South Africa
| | - Junko Morikawa
- World Research Hub Initiative (WRHI), Tokyo Institute of Technology, 2-12-1, Ookayama, Tokyo, 152-8550 Japan
| | - Inbarasan Muniraj
- LiFE Lab, Department of Electronics and Communication Engineering, Alliance School of Applied Engineering, Alliance University, Bangalore, Karnataka 562106 India
| | - Donatas Narbutis
- Institute of Theoretical Physics and Astronomy, Faculty of Physics, Vilnius University, Sauletekio 9, 10222 Vilnius, Lithuania
| | - Soon Hock Ng
- Optical Sciences Center and ARC Training Centre in Surface Engineering for Advanced Materials (SEAM), School of Science, Computing and Engineering Technologies, Optical Sciences Center, Swinburne University of Technology, Hawthorn, Melbourne, VIC 3122 Australia
| | - Fazilah Nothlawala
- School of Physics, University of the Witwatersrand, Johannesburg, South Africa
| | - Jeonghun Oh
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, 34141 South Korea
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, Bioengineering Department, California NanoSystems Institute, University of California, Los Angeles (UCLA), Los Angeles, CA USA
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141 South Korea
- KAIST Institute for Health Science and Technology, KAIST, Daejeon, 34141 South Korea
- Tomocube Inc., Daejeon, 34051 South Korea
| | - Alexey P. Porfirev
- IPSI RAS-Branch of the FSRC “Crystallography and Photonics” RAS, 443001 Samara, Russia
| | - Mariana Potcoava
- Department of Anatomy and Cell Biology, University of Illinois at Chicago, 808 South Wood Street, Chicago, IL 60612 USA
| | - Shashi Prabhakar
- Quantum Science and Technology Laboratory, Physical Research Laboratory, Navrangpura, Ahmedabad, 380009 India
| | - Jixiong Pu
- Fujian Provincial Key Laboratory of Light Propagation and Transformation, College of Information Science and Engineering, Huaqiao University, Xiamen, 361021 Fujian China
| | - Mani Ratnam Rai
- Department of Biomedical Engineering, North Carolina State University and University of North Carolina at Chapel Hill, Raleigh, NC 27695 USA
- Comparative Medicine Institute, North Carolina State University, Raleigh, NC 27695 USA
| | - Mikołaj Rogalski
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - Meguya Ryu
- Research Institute for Material and Chemical Measurement, National Metrology Institute of Japan (AIST), 1-1-1 Umezono, Tsukuba, 305-8563 Japan
| | - Sakshi Choudhary
- Department Chemical Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Shiva, Israel
| | - Gangi Reddy Salla
- Department of Physics, SRM University – AP, Amaravati, Andhra Pradesh 522502 India
| | - Peter Schelkens
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel VUB), Pleinlaan 2, 1050 Brussel, Belgium
- IMEC, Kapeldreef 75, 3001 Leuven, Belgium
| | - Sarp Feykun Şener
- Institute of Materials Science and Nanotechnology, National Nanotechnology Research Center (UNAM), Bilkent University, 06800 Ankara, Turkey
- Department of Physics, Bilkent University, 06800 Ankara, Turkey
| | - Igor Shevkunov
- Computational Imaging Group, Faculty of Information Technology and Communication Sciences, Tampere University, 33100 Tampere, Finland
| | - Tomoyoshi Shimobaba
- Graduate School of Engineering, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba, Chiba Japan
| | - Rakesh K. Singh
- Laboratory of Information Photonics and Optical Metrology, Department of Physics, Indian Institute of Technology (Banaras Hindu University), Varanasi, Uttar Pradesh 221005 India
| | - Ravindra P. Singh
- Quantum Science and Technology Laboratory, Physical Research Laboratory, Navrangpura, Ahmedabad, 380009 India
| | - Adrian Stern
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, 8410501 Beer-Sheva, Israel
| | - Jiasong Sun
- Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Research Institute (SCIRI), Nanjing, 210019 Jiangsu China
| | - Shun Zhou
- Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Research Institute (SCIRI), Nanjing, 210019 Jiangsu China
| | - Chao Zuo
- Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094 Jiangsu China
- Smart Computational Imaging Research Institute (SCIRI), Nanjing, 210019 Jiangsu China
| | - Zack Zurawski
- Department of Anatomy and Cell Biology, University of Illinois at Chicago, 808 South Wood Street, Chicago, IL 60612 USA
| | - Tatsuki Tahara
- Applied Electromagnetic Research Center, Radio Research Institute, National Institute of Information and Communications Technology (NICT), 4-2-1 Nukuikitamachi, Koganei, Tokyo 184-8795 Japan
| | - Vipin Tiwari
- Institute of Physics, University of Tartu, W. Ostwaldi 1, 50411 Tartu, Estonia
| | - Maciej Trusiak
- Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - R. V. Vinu
- Fujian Provincial Key Laboratory of Light Propagation and Transformation, College of Information Science and Engineering, Huaqiao University, Xiamen, 361021 Fujian China
| | - Sergey G. Volotovskiy
- IPSI RAS-Branch of the FSRC “Crystallography and Photonics” RAS, 443001 Samara, Russia
| | - Hasan Yılmaz
- Institute of Materials Science and Nanotechnology, National Nanotechnology Research Center (UNAM), Bilkent University, 06800 Ankara, Turkey
| | - Hilton Barbosa De Aguiar
- Laboratoire Kastler Brossel, Centre National de la Recherche Scientifique (CNRS) UMR 8552, Sorbonne Universite ´, Ecole Normale Supe ´rieure-Paris Sciences et Lettres (PSL) Research University, Collège de France, 24 rue Lhomond, 75005 Paris, France
| | - Balpreet S. Ahluwalia
- Department of Physics and Technology, UiT The Arctic University of Norway, 9037 Tromsø, Norway
| | - Azeem Ahmad
- Department of Physics and Technology, UiT The Arctic University of Norway, 9037 Tromsø, Norway
| |
Collapse
|
4
|
Wang N, Zhang C, Wei X, Yan T, Zhou W, Zhang J, Kang H, Yuan Z, Chen X. Harnessing the power of optical microscopy for visualization and analysis of histopathological images. BIOMEDICAL OPTICS EXPRESS 2023; 14:5451-5465. [PMID: 37854561 PMCID: PMC10581782 DOI: 10.1364/boe.501893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/29/2023] [Accepted: 09/01/2023] [Indexed: 10/20/2023]
Abstract
Histopathology is the foundation and gold standard for identifying diseases, and precise quantification of histopathological images can provide the pathologist with objective clues to make a more convincing diagnosis. Optical microscopy (OM), an important branch of optical imaging technology that provides high-resolution images of tissue cytology and structural morphology, has been used in the diagnosis of histopathology and evolved into a new disciplinary direction of optical microscopic histopathology (OMH). There are a number of ex-vivo studies providing applicability of different OMH approaches, and a transfer of these techniques toward in vivo diagnosis is currently in progress. Furthermore, combined with advanced artificial intelligence algorithms, OMH allows for improved diagnostic reliability and convenience due to the complementarity of retrieval information. In this review, we cover recent advances in OMH, including the exploration of new techniques in OMH as well as their applications, and look ahead to new challenges in OMH. These typical application examples well demonstrate the application potential and clinical value of OMH techniques in histopathological diagnosis.
Collapse
Affiliation(s)
- Nan Wang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Chang Zhang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
| | - Xinyu Wei
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
| | - Tianyu Yan
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Wangting Zhou
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Jiaojiao Zhang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Huan Kang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Zhen Yuan
- Faculty of Health Sciences, University of Macau, Macau, 999078, China
| | - Xueli Chen
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
- Inovation Center for Advanced Medical Imaging and Intelligent Medicine, Guangzhou Institute of Technology, Xidian University, Guangzhou, Guangdong 510555, China
| |
Collapse
|