1
|
Niarchou E, Matus V, Rabadan J, Guerra V, Perez-Jimenez R. Optical Camera Communications in Healthcare: A Wearable LED Transmitter Evaluation during Indoor Physical Exercise. SENSORS (BASEL, SWITZERLAND) 2024; 24:2766. [PMID: 38732872 PMCID: PMC11086232 DOI: 10.3390/s24092766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 04/20/2024] [Accepted: 04/24/2024] [Indexed: 05/13/2024]
Abstract
This paper presents an experimental evaluation of a wearable light-emitting diode (LED) transmitter in an optical camera communications (OCC) system. The evaluation is conducted under conditions of controlled user movement during indoor physical exercise, encompassing both mild and intense exercise scenarios. We introduce an image processing algorithm designed to identify a template signal transmitted by the LED and detected within the image. To enhance this process, we utilize the dynamics of controlled exercise-induced motion to limit the tracking process to a smaller region within the image. We demonstrate the feasibility of detecting the transmitting source within the frames, and thus limit the tracking process to a smaller region within the image, achieving an reduction of 87.3% for mild exercise and 79.0% for intense exercise.
Collapse
Affiliation(s)
- Eleni Niarchou
- Institute for Technological Development and Innovation in Communications (IDeTIC), University of Las Palmas de Gran Canaria, 35001 Las Palmas de Gran Canaria, Spain; (V.M.); (J.R.); (R.P.-J.)
| | - Vicente Matus
- Institute for Technological Development and Innovation in Communications (IDeTIC), University of Las Palmas de Gran Canaria, 35001 Las Palmas de Gran Canaria, Spain; (V.M.); (J.R.); (R.P.-J.)
| | - Jose Rabadan
- Institute for Technological Development and Innovation in Communications (IDeTIC), University of Las Palmas de Gran Canaria, 35001 Las Palmas de Gran Canaria, Spain; (V.M.); (J.R.); (R.P.-J.)
| | | | - Rafael Perez-Jimenez
- Institute for Technological Development and Innovation in Communications (IDeTIC), University of Las Palmas de Gran Canaria, 35001 Las Palmas de Gran Canaria, Spain; (V.M.); (J.R.); (R.P.-J.)
| |
Collapse
|
2
|
Zaccardi S, Frantz T, Beckwée D, Swinnen E, Jansen B. On-Device Execution of Deep Learning Models on HoloLens2 for Real-Time Augmented Reality Medical Applications. SENSORS (BASEL, SWITZERLAND) 2023; 23:8698. [PMID: 37960398 PMCID: PMC10648161 DOI: 10.3390/s23218698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Revised: 10/18/2023] [Accepted: 10/23/2023] [Indexed: 11/15/2023]
Abstract
The integration of Deep Learning (DL) models with the HoloLens2 Augmented Reality (AR) headset has enormous potential for real-time AR medical applications. Currently, most applications execute the models on an external server that communicates with the headset via Wi-Fi. This client-server architecture introduces undesirable delays and lacks reliability for real-time applications. However, due to HoloLens2's limited computation capabilities, running the DL model directly on the device and achieving real-time performances is not trivial. Therefore, this study has two primary objectives: (i) to systematically evaluate two popular frameworks to execute DL models on HoloLens2-Unity Barracuda and Windows Machine Learning (WinML)-using the inference time as the primary evaluation metric; (ii) to provide benchmark values for state-of-the-art DL models that can be integrated in different medical applications (e.g., Yolo and Unet models). In this study, we executed DL models with various complexities and analyzed inference times ranging from a few milliseconds to seconds. Our results show that Unity Barracuda is significantly faster than WinML (p-value < 0.005). With our findings, we sought to provide practical guidance and reference values for future studies aiming to develop single, portable AR systems for real-time medical assistance.
Collapse
Affiliation(s)
- Silvia Zaccardi
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel, 1050 Brussel, Belgium; (T.F.); (B.J.)
- Rehabilitation Research Group (RERE), Vrije Universiteit Brussel, 1090 Brussel, Belgium; (D.B.); (E.S.)
- IMEC, 3001 Leuven, Belgium
| | - Taylor Frantz
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel, 1050 Brussel, Belgium; (T.F.); (B.J.)
- IMEC, 3001 Leuven, Belgium
| | - David Beckwée
- Rehabilitation Research Group (RERE), Vrije Universiteit Brussel, 1090 Brussel, Belgium; (D.B.); (E.S.)
| | - Eva Swinnen
- Rehabilitation Research Group (RERE), Vrije Universiteit Brussel, 1090 Brussel, Belgium; (D.B.); (E.S.)
| | - Bart Jansen
- Department of Electronics and Informatics (ETRO), Vrije Universiteit Brussel, 1050 Brussel, Belgium; (T.F.); (B.J.)
- IMEC, 3001 Leuven, Belgium
| |
Collapse
|
3
|
Sitanggang OS, Nguyen VL, Nguyen H, Pamungkas RF, Faridh MM, Jang YM. Design and Implementation of a 2D MIMO OCC System Based on Deep Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:7637. [PMID: 37688093 PMCID: PMC10490714 DOI: 10.3390/s23177637] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 08/30/2023] [Accepted: 08/31/2023] [Indexed: 09/10/2023]
Abstract
Optical camera communication (OCC) is one of the most promising optical wireless technology communication systems. This technology has a number of benefits compared to radio frequency, including unlimited spectrum, no congestion due to high usage, and low operating costs. OCC operates in order to transmit an optical signal from a light-emitting diode (LED) and receive the signal with a camera. However, identifying, detecting, and extracting data in a complex area with very high mobility is the main challenge in operating the OCC. In this paper, we design and implement a real-time OCC system that can communicate in high mobility conditions, based on You Only Look Once version 8 (YOLOv8). We utilized an LED array that can be identified accurately and has an enhanced data transmission rate due to a greater number of source lights. Our system is validated in a highly mobile environment with camera movement speeds of up to 10 m/s at 2 m, achieving a bit error rate of 10-2. In addition, this system achieves high accuracy of the LED detection algorithm with mAP0.5 and mAP0.5:0.95 values of 0.995 and 0.8604, respectively. The proposed method has been tested in real time and achieves processing speeds up to 1.25 ms.
Collapse
Affiliation(s)
| | | | | | | | | | - Yeong Min Jang
- Department of Electronics Engineering, Kookmin University, Seoul 02707, Republic of Korea; (O.S.S.); (V.L.N.); (H.N.); (R.F.P.); (M.M.F.)
| |
Collapse
|
4
|
Al-Hamiri MG, Abd HJ. Designing a LiFi Transceiver based Space Time Block Coding with different pulses. 2022 3RD INFORMATION TECHNOLOGY TO ENHANCE E-LEARNING AND OTHER APPLICATION (IT-ELA) 2022. [DOI: 10.1109/it-ela57378.2022.10107931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
| | - Haider J. Abd
- University of Babylon,dept. of Electrical Engineering,Hillah,Iraq
| |
Collapse
|
5
|
Fassi B, Driz S, Al-Douri Y, Ameri M, Abd El-Rehim A. Optical investigations of Cu2CdSnS 4 quaternary alloy nanostructure for indoor optical wireless communications. OPTICS COMMUNICATIONS 2022; 517:128351. [DOI: 10.1016/j.optcom.2022.128351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
6
|
Kamalakis T, Ghassemlooy Z, Zvanovec S, Alves LN, Khalighi M. Optimization and design of a diffuse optical wireless sensor network. APPLIED OPTICS 2022; 61:6599-6608. [PMID: 36255886 DOI: 10.1364/ao.463330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 07/01/2022] [Indexed: 06/16/2023]
Abstract
Wireless sensor networks (WSNs) are currently being deployed in everyday objects to collect and transmit information related to humidity, temperature, heartbeat, motion, etc. Such networks are part of the massive machine-type communication (mMTC) scenario within the fifth/sixth generation of wireless networks. In this paper, we consider the optimization and design of an optical WSN composed of multiple battery-powered sensor nodes based on light-emitting diode transmitters. Extending our previous work, we take into account both line-of-sight and diffuse-light propagation, and show that in indoor scenarios, diffuse radiation can improve link availability under shadowing/blocking and extend battery life. In order to optimize the optical wireless link parameters, we use a machine-learning approach based on a genetic algorithm to ascertain the performance limits of the system. The presented results indicate that the proposed system is a viable wireless option for WSNs within the context of mMTC.
Collapse
|
7
|
Aguiar-Castillo L, Guerra V, Rufo J, Rabadan J, Perez-Jimenez R. Survey on Optical Wireless Communications-Based Services Applied to the Tourism Industry: Potentials and Challenges. SENSORS (BASEL, SWITZERLAND) 2021; 21:6282. [PMID: 34577489 PMCID: PMC8473424 DOI: 10.3390/s21186282] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Revised: 09/09/2021] [Accepted: 09/14/2021] [Indexed: 11/23/2022]
Abstract
In this paper, we explore the potential applications of Optical Wireless Communications in the tourism industry, considering both indoor and outdoor scenarios and different transmission speeds. They range from high-speed atmospheric outdoor links (Free-Space Optics (FSO)) to indoor systems based on high-speed lighting networks (known under the trade name LiFi©) or low-speed services support the Internet of Things networks, using visible light (VLC) or IR emitters, with receivers based on either on classical photodiodes or in image sensors, known as Optical Camera Communications. The avant-garde applications of this technology have been studied focusing on three possible use scenarios: the traveler himself, in what we have called TAN (Tourist Area Network); the tourist facility, which includes not only the hotel but also leisure areas (theme parks, museums, natural protected areas) or services (restaurants, shopping areas, etc.); and the entire destination, which can be both the city or the territory where the tourist is received, within the paradigm of the Smart Tourist Destination (STD). In addition to the classic services based on radio frequency and wired broadband networks, these technologies will make it possible to meet the tourist's challenging needs, the establishment, and the destination. Besides, they cover the services imposed by the new marketing services related to location or context and feed the big data systems used to study tourist behavior.
Collapse
Affiliation(s)
| | - Victor Guerra
- Institute for Technological Development and Innovation in Communications, Universidad de Las Palmas de Gran Canaria, 35017 Las Palmas, Spain; (L.A.-C.); (J.R.); (J.R.)
| | | | | | - Rafael Perez-Jimenez
- Institute for Technological Development and Innovation in Communications, Universidad de Las Palmas de Gran Canaria, 35017 Las Palmas, Spain; (L.A.-C.); (J.R.); (J.R.)
| |
Collapse
|
8
|
Biton N, Kupferman J, Arnon S. OAM light propagation through tissue. Sci Rep 2021; 11:2407. [PMID: 33510283 PMCID: PMC7843596 DOI: 10.1038/s41598-021-82033-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 01/07/2021] [Indexed: 01/30/2023] Open
Abstract
A major challenge in use of the optical spectrum for communication and imaging applications is the scattering of light as it passes through diffuse media. Recent studies indicate that light beams with orbital angular momentum (OAM) can penetrate deeper through diffuse media than simple Gaussian beams. To the best knowledge of the authors, in this paper we describe for the first time an experiment examining transmission of OAM beams through biological tissue with thickness of up to a few centimeters, and for OAM modes reaching up to 20. Our results indicate that OAM beams do indeed show a higher transmittance relative to Gaussian beams, and that the greater the OAM, the higher the transmittance also up to 20, Our results extend measured results to highly multi scattering media and indicate that at 2.6 cm tissue thickness for OAM of order 20, we measure nearly 30% more power in comparison to a Gaussian beam. In addition, we develop a mathematical model describing the improved permeability. This work shows that OAM beams can be a valuable contribution to optical wireless communication (OWC) for medical implants, optical biological imaging, as well as recent innovative applications of medical diagnosis.
Collapse
Affiliation(s)
- Netanel Biton
- Electrical and Computer Engineering Department, Ben-Gurion University of the Negev, P.O Box 653, IL84105, Beer-Sheva, Israel.
| | - Judy Kupferman
- Electrical and Computer Engineering Department, Ben-Gurion University of the Negev, P.O Box 653, IL84105, Beer-Sheva, Israel
| | - Shlomi Arnon
- Electrical and Computer Engineering Department, Ben-Gurion University of the Negev, P.O Box 653, IL84105, Beer-Sheva, Israel
| |
Collapse
|