1
|
Osorio Quero C, Leykam D, Rondon Ojeda I. Res-U2Net: untrained deep learning for phase retrieval and image reconstruction. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:766-773. [PMID: 38856563 DOI: 10.1364/josaa.511074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 03/12/2024] [Indexed: 06/11/2024]
Abstract
Conventional deep learning-based image reconstruction methods require a large amount of training data, which can be hard to obtain in practice. Untrained deep learning methods overcome this limitation by training a network to invert a physical model of the image formation process. Here we present a novel, to our knowledge, untrained Res-U2Net model for phase retrieval. We use the extracted phase information to determine changes in an object's surface and generate a mesh representation of its 3D structure. We compare the performance of Res-U2Net phase retrieval against UNet and U2Net using images from the GDXRAY dataset.
Collapse
|
2
|
Khonina SN, Kazanskiy NL, Skidanov RV, Butt MA. Exploring Types of Photonic Neural Networks for Imaging and Computing-A Review. NANOMATERIALS (BASEL, SWITZERLAND) 2024; 14:697. [PMID: 38668191 PMCID: PMC11054149 DOI: 10.3390/nano14080697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 04/13/2024] [Accepted: 04/15/2024] [Indexed: 04/29/2024]
Abstract
Photonic neural networks (PNNs), utilizing light-based technologies, show immense potential in artificial intelligence (AI) and computing. Compared to traditional electronic neural networks, they offer faster processing speeds, lower energy usage, and improved parallelism. Leveraging light's properties for information processing could revolutionize diverse applications, including complex calculations and advanced machine learning (ML). Furthermore, these networks could address scalability and efficiency challenges in large-scale AI systems, potentially reshaping the future of computing and AI research. In this comprehensive review, we provide current, cutting-edge insights into diverse types of PNNs crafted for both imaging and computing purposes. Additionally, we delve into the intricate challenges they encounter during implementation, while also illuminating the promising perspectives they introduce to the field.
Collapse
|
3
|
Kutluyarov RV, Zakoyan AG, Voronkov GS, Grakhova EP, Butt MA. Neuromorphic Photonics Circuits: Contemporary Review. NANOMATERIALS (BASEL, SWITZERLAND) 2023; 13:3139. [PMID: 38133036 PMCID: PMC10745993 DOI: 10.3390/nano13243139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/08/2023] [Accepted: 12/10/2023] [Indexed: 12/23/2023]
Abstract
Neuromorphic photonics is a cutting-edge fusion of neuroscience-inspired computing and photonics technology to overcome the constraints of conventional computing architectures. Its significance lies in the potential to transform information processing by mimicking the parallelism and efficiency of the human brain. Using optics and photonics principles, neuromorphic devices can execute intricate computations swiftly and with impressive energy efficiency. This innovation holds promise for advancing artificial intelligence and machine learning while addressing the limitations of traditional silicon-based computing. Neuromorphic photonics could herald a new era of computing that is more potent and draws inspiration from cognitive processes, leading to advancements in robotics, pattern recognition, and advanced data processing. This paper reviews the recent developments in neuromorphic photonic integrated circuits, applications, and current challenges.
Collapse
Affiliation(s)
- Ruslan V. Kutluyarov
- School of Photonics Engineering and Research Advances (SPhERA), Ufa University of Science and Technology, 32, Z. Validi St., 450076 Ufa, Russia
| | - Aida G. Zakoyan
- School of Photonics Engineering and Research Advances (SPhERA), Ufa University of Science and Technology, 32, Z. Validi St., 450076 Ufa, Russia
| | - Grigory S. Voronkov
- School of Photonics Engineering and Research Advances (SPhERA), Ufa University of Science and Technology, 32, Z. Validi St., 450076 Ufa, Russia
| | - Elizaveta P. Grakhova
- School of Photonics Engineering and Research Advances (SPhERA), Ufa University of Science and Technology, 32, Z. Validi St., 450076 Ufa, Russia
| | | |
Collapse
|
4
|
Hong Q, Jiang J, Zhou S, Xia G, Xu P, Zhu M, Xu W, Zhang J, Zhu Z. Silicon-Based On-Chip Tunable High-Q-Factor and Low-Power Fano Resonators with Graphene Nanoheaters. NANOMATERIALS (BASEL, SWITZERLAND) 2023; 13:nano13101636. [PMID: 37242052 DOI: 10.3390/nano13101636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 05/11/2023] [Accepted: 05/12/2023] [Indexed: 05/28/2023]
Abstract
Tunable and low-power microcavities are essential for large-scale photonic integrated circuits. Thermal tuning, a convenient and stable tuning method, has been widely adopted in optical neural networks and quantum information processing. Recently, graphene thermal tuning has been demonstrated to be a power-efficient technique, as it does not require thick spacers to prevent light absorption. In this paper, a silicon-based on-chip Fano resonator with graphene nanoheaters is proposed and fabricated. This novel Fano structure is achieved by introducing a scattering block, and it can be easily fabricated in large quantities. Experimental results demonstrate that the resonator has the characteristics of a high quality factor (∼31,000) and low state-switching power (∼1 mW). The temporal responses of the microcavity exhibit qualified modulation speed with 9.8 μs rise time and 16.6 μs fall time. The thermal imaging and Raman spectroscopy of graphene at different biases were also measured to intuitively show that the tuning is derived from the joule heating effect of graphene. This work provides an alternative for future large-scale tunable and low-power-consumption optical networks, and has potential applications in optical filters and switches.
Collapse
Affiliation(s)
- Qilin Hong
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Jinbao Jiang
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Siyu Zhou
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Gongyu Xia
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Ping Xu
- Institute for Quantum Information and State Key Laboratory of High Performance Computing, College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China
| | - Mengjian Zhu
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Wei Xu
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Jianfa Zhang
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| | - Zhihong Zhu
- College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
- Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
| |
Collapse
|
5
|
Sadeghzadeh H, Koohi S. Translation-invariant optical neural network for image classification. Sci Rep 2022; 12:17232. [PMID: 36241863 PMCID: PMC9568607 DOI: 10.1038/s41598-022-22291-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Accepted: 10/12/2022] [Indexed: 01/06/2023] Open
Abstract
The classification performance of all-optical Convolutional Neural Networks (CNNs) is greatly influenced by components' misalignment and translation of input images in the practical applications. In this paper, we propose a free-space all-optical CNN (named Trans-ONN) which accurately classifies translated images in the horizontal, vertical, or diagonal directions. Trans-ONN takes advantages of an optical motion pooling layer which provides the translation invariance property by implementing different optical masks in the Fourier plane for classifying translated test images. Moreover, to enhance the translation invariance property, global average pooling (GAP) is utilized in the Trans-ONN structure, rather than fully connected layers. The comparative studies confirm that taking advantage of vertical and horizontal masks along GAP operation provide the best translation invariance property, compared to the alternative network models, for classifying horizontally and vertically shifted test images up to 50 pixel shifts of Kaggle Cats and Dogs, CIFAR-10, and MNIST datasets, respectively. Also, adopting the diagonal mask along GAP operation achieves the best classification accuracy for classifying translated test images in the diagonal direction for large number of pixel shifts (i.e. more than 30 pixel shifts). It is worth mentioning that the proposed translation invariant networks are capable of classifying the translated test images not included in the training procedure.
Collapse
Affiliation(s)
- Hoda Sadeghzadeh
- grid.412553.40000 0001 0740 9747Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| | - Somayyeh Koohi
- grid.412553.40000 0001 0740 9747Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| |
Collapse
|
6
|
Fujita T, Sakaguchi H, Zhang J, Nonaka H, Sumi S, Awano H, Ishibashi T. Magneto-optical diffractive deep neural network. OPTICS EXPRESS 2022; 30:36889-36899. [PMID: 36258609 DOI: 10.1364/oe.470513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 09/08/2022] [Indexed: 06/16/2023]
Abstract
We propose a magneto-optical diffractive deep neural network (MO-D2NN). We simulated several MO-D2NNs, each of which consists of five hidden layers made of a magnetic material that contains 100 × 100 magnetic domains with a domain width of 1 µm and an interlayer distance of 0.7 mm. The networks demonstrate a classification accuracy of > 90% for the MNIST dataset when light intensity is used as the classification measure. Moreover, an accuracy of > 80% is obtained even for a small Faraday rotation angle of π/100 rad when the angle of polarization is used as the classification measure. The MO-D2NN allows the hidden layers to be rewritten, which is not possible with previous implementations of D2NNs.
Collapse
|