1
|
Misthos LM, Krassanakis V, Merlemis N, Kesidis AL. Modeling the Visual Landscape: A Review on Approaches, Methods and Techniques. SENSORS (BASEL, SWITZERLAND) 2023; 23:8135. [PMID: 37836966 PMCID: PMC10574952 DOI: 10.3390/s23198135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 08/14/2023] [Accepted: 09/21/2023] [Indexed: 10/15/2023]
Abstract
Modeling the perception and evaluation of landscapes from the human perspective is a desirable goal for several scientific domains and applications. Human vision is the dominant sense, and human eyes are the sensors for apperceiving the environmental stimuli of our surroundings. Therefore, exploring the experimental recording and measurement of the visual landscape can reveal crucial aspects about human visual perception responses while viewing the natural or man-made landscapes. Landscape evaluation (or assessment) is another dimension that refers mainly to preferences of the visual landscape, involving human cognition as well, in ways that are often unpredictable. Yet, landscape can be approached by both egocentric (i.e., human view) and exocentric (i.e., bird's eye view) perspectives. The overarching approach of this review article lies in systematically presenting the different ways for modeling and quantifying the two 'modalities' of human perception and evaluation, under the two geometric perspectives, suggesting integrative approaches on these two 'diverging' dualities. To this end, several pertinent traditions/approaches, sensor-based experimental methods and techniques (e.g., eye tracking, fMRI, and EEG), and metrics are adduced and described. Essentially, this review article acts as a 'guide-map' for the delineation of the different activities related to landscape experience and/or management and to the valid or potentially suitable types of stimuli, sensors techniques, and metrics for each activity. Throughout our work, two main research directions are identified: (1) one that attempts to transfer the visual landscape experience/management from the one perspective to the other (and vice versa); (2) another one that aims to anticipate the visual perception of different landscapes and establish connections between perceptual processes and landscape preferences. As it appears, the research in the field is rapidly growing. In our opinion, it can be greatly advanced and enriched using integrative, interdisciplinary approaches in order to better understand the concepts and the mechanisms by which the visual landscape, as a complex set of stimuli, influences visual perception, potentially leading to more elaborate outcomes such as the anticipation of landscape preferences. As an effect, such approaches can support a rigorous, evidence-based, and socially just framework towards landscape management, protection, and decision making, based on a wide spectrum of well-suited and advanced sensor-based technologies.
Collapse
Affiliation(s)
- Loukas-Moysis Misthos
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
- Department of Public and One Health, University of Thessaly, GR-43100 Karditsa, Greece
| | - Vassilios Krassanakis
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
| | - Nikolaos Merlemis
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
| | - Anastasios L. Kesidis
- Department of Surveying and Geoinformatics Engineering, University of West Attica, GR-12243 Athens, Greece; (L.-M.M.); (V.K.); (N.M.)
| |
Collapse
|
2
|
Robert FM, Abiven B, Sinou M, Heggarty K, Adam L, Nourrit V, de Bougrenet de la Tocnaye JL. Contact lens embedded holographic pointer. Sci Rep 2023; 13:6919. [PMID: 37106122 PMCID: PMC10140282 DOI: 10.1038/s41598-023-33420-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Accepted: 04/12/2023] [Indexed: 04/29/2023] Open
Abstract
In this paper we present an infrared laser pointer, consisting of a vertical-cavity surface-emitting laser (VCSEL) and a diffractive optical element (DOE), encapsulated into a scleral contact lens (SCL). The VCSEL is powered remotely by inductive coupling from a primary antenna embedded into an eyewear frame. The DOE is used either to collimate the laser beam or to project a pattern image at a chosen distance in front of the eye. We detail the different SCL constitutive blocks, how they are manufactured and assembled. We particularly emphasize the various technological challenges related to their encapsulation in the reduced volume of the SCL, while keeping the pupil free. Finally, we describe how the laser pointer operates, what are its performances (e.g. collimation, image formation) and how it can be used efficiently in various application fields such as visual assistance and augmented reality.
Collapse
Affiliation(s)
- François-Maël Robert
- Département Optique, IMT Atlantique, Technopôle Brest-Iroise, 655 Avenue du Technopôle, CS 83818 - 29238, Brest Cedex 3, France
| | - Bernard Abiven
- Département Optique, IMT Atlantique, Technopôle Brest-Iroise, 655 Avenue du Technopôle, CS 83818 - 29238, Brest Cedex 3, France
| | - Maïna Sinou
- Département Optique, IMT Atlantique, Technopôle Brest-Iroise, 655 Avenue du Technopôle, CS 83818 - 29238, Brest Cedex 3, France
| | - Kevin Heggarty
- Département Optique, IMT Atlantique, Technopôle Brest-Iroise, 655 Avenue du Technopôle, CS 83818 - 29238, Brest Cedex 3, France
| | - Laure Adam
- LCS, 14 Place Gardin, 14000, Caen, France
| | - Vincent Nourrit
- Département Optique, IMT Atlantique, Technopôle Brest-Iroise, 655 Avenue du Technopôle, CS 83818 - 29238, Brest Cedex 3, France.
| | | |
Collapse
|
3
|
Nourrit V, Lamour JB, Abiven B, Fracasso B, de Bougrenet de la Tocnaye JL. Head-Mounted Miniature Motorized Camera and Laser Pointer Driven by Eye Movements. SENSORS (BASEL, SWITZERLAND) 2023; 23:3503. [PMID: 37050563 PMCID: PMC10098879 DOI: 10.3390/s23073503] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 03/17/2023] [Accepted: 03/23/2023] [Indexed: 06/19/2023]
Abstract
Recording a video scene as seen by an observer, materializing where is focused his visual attention and allowing an external person to point at a given object in this scene, could be beneficial for various applications such as medical education or remote training. Such a versatile device, although tested at the experimental laboratory demonstrator stage, has never been integrated in a compact and portable way in a real environment. In this context, we built a low-cost, light-weight, head-mounted device integrating a miniature camera and a laser pointer that can be remotely controlled or servo-controlled by an eye tracker. Two motorizations were implemented and tested (pan/tilt and Rilsey-prisms-based). The video was both recorded locally and transmitted wirelessly. Risley prisms allowed finer remote control of camera or laser pointer orientation (0.1° vs. 0.35°), but data processing and Wi-Fi transmission incur significant latency (~0.5 s) limiting the servo-controlling by eye movements. The laser beam was spatially shaped by a Diffractive Optical Element to facilitate object illumination or recognition. With this first proof-of-concept prototype, the data stream needs to be optimized to make full use of the eye tracker, but this versatile device can find various applications in education, healthcare or research.
Collapse
Affiliation(s)
- Vincent Nourrit
- Optics Department, IMT Atlantique, 29238 Brest CEDEX 03, France; (V.N.)
| | | | - Bernard Abiven
- Optics Department, IMT Atlantique, 29238 Brest CEDEX 03, France; (V.N.)
| | - Bruno Fracasso
- Optics Department, IMT Atlantique, 29238 Brest CEDEX 03, France; (V.N.)
| | | |
Collapse
|
4
|
de Bougrenet de la Tocnaye JL. Restored vision-augmented vision: arguments for a cybernetic vision. C R Biol 2022; 345:135-156. [PMID: 36847468 DOI: 10.5802/crbiol.102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Accepted: 11/17/2022] [Indexed: 12/14/2022]
Abstract
In this paper, we present some thoughts about the recent developments, made possible by technological advances and miniaturisation of connected visual prostheses, linked to the visual system, operating at different level of this one, on the retina as well as in the visual cortex. While these objects represent a great hope for people with impaired vision to recover partial vision, we show how this technology could also act on the functional vision of well sighted persons to improve or increase their visual performance. In addition to the impact on our cognitive and attentional mechanisms, such an operation when it originates outside the natural real visual field (e.g. cybernetics) raises a number of questions about the development and use of such implants or prostheses in the future.
Collapse
|
5
|
de Bougrenet de la Tocnaye JL, Nourrit V, Lahuec C. Design of a Multimodal Oculometric Sensor Contact Lens. SENSORS (BASEL, SWITZERLAND) 2022; 22:6731. [PMID: 36146080 PMCID: PMC9504896 DOI: 10.3390/s22186731] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 08/24/2022] [Accepted: 09/02/2022] [Indexed: 06/16/2023]
Abstract
Oculometric data, such as gaze direction, pupil size and accommodative change, play a key role nowadays in the analysis of cognitive load and attentional activities, in particular with the development of Integrated Visual Augmentation Systems in many application domains, such as health, defense and industry. Such measurements are most frequently obtained by different devices, most of them requiring steady eye and body positions and controlled lighting conditions. Recent advances in smart contact lens (SCL) technology have demonstrated the ability to achieve highly reliable and accurate measurements, preserving user mobility, for instance in measuring gaze direction. In this paper, we discuss how these three key functions can be implemented and combined in the same SCL, considering the limited volume and energy consumption constraints. Some technical options are discussed and compared in terms of their ability to be implemented, taking advantage of recent developments in the field.
Collapse
Affiliation(s)
| | - Vincent Nourrit
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France
| | - Cyril Lahuec
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France
- Laboratoire des Sciences et Techniques de l’Information, de la Communication et de la Connaissance, CNRS UMR 6285, 29238 Brest, Brittany, France
| |
Collapse
|
6
|
Robert FM, Nourrit V, Adam L, de Bougrenet de la Tocnaye JL. VCSEL pair used as optical pointers in a contact lens for gaze tracking and visual target designation. PLoS One 2022; 17:e0267393. [PMID: 35816475 PMCID: PMC9273061 DOI: 10.1371/journal.pone.0267393] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 04/07/2022] [Indexed: 12/01/2022] Open
Abstract
We present a new eye-tracking and target designation device based on a contact lens incorporating a pair of vertical-cavity surface-emitting lasers (VCSELs). We describe the operating principle, the manufacturing process and characterize the impact of the VCSELs encapsulation on their optical properties. We then describe how such device can be incorporated into an eye-wear or a visual augmented system. We compare two different detection set-ups, the first using a camera and the second a position sensitive device, both illustrating different laser beam detection modes. We analyze their performances in terms of angular accuracy, speed, compactness, manufacturability, compared to current conventional eye-tracking systems. We emphasize how the use of two VCSELs and the control of their orientation during the encapsulation can simplify their integration in host systems and improve the gaze detection performance. Finally, we describe various embodiments and discuss potential improvements that can be expected in future systems.
Collapse
|
7
|
Massin L, Lahuec C, Seguin F, Nourrit V, de Bougrenet de la Tocnaye JL. Multipurpose Bio-Monitored Integrated Circuit in a Contact Lens Eye-Tracker. SENSORS (BASEL, SWITZERLAND) 2022; 22:595. [PMID: 35062555 PMCID: PMC8778089 DOI: 10.3390/s22020595] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 12/28/2021] [Accepted: 01/11/2022] [Indexed: 02/01/2023]
Abstract
We present the design, fabrication, and test of a multipurpose integrated circuit (Application Specific Integrated Circuit) in AMS 0.35 µm Complementary Metal Oxide Semiconductor technology. This circuit is embedded in a scleral contact lens, combined with photodiodes enabling the gaze direction detection when illuminated and wirelessly powered by an eyewear. The gaze direction is determined by means of a centroid computation from the measured photocurrents. The ASIC is used simultaneously to detect specific eye blinking sequences to validate target designations, for instance. Experimental measurements and validation are performed on a scleral contact lens prototype integrating four infrared photodiodes, mounted on a mock-up eyeball, and combined with an artificial eyelid. The eye-tracker has an accuracy of 0.2°, i.e., 2.5 times better than current mobile video-based eye-trackers, and is robust with respect to process variations, operating time, and supply voltage. Variations of the computed gaze direction transmitted to the eyewear, when the eyelid moves, are detected and can be interpreted as commands based on blink duration or using blinks alternation on both eyes.
Collapse
Affiliation(s)
- Loïc Massin
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France; (L.M.); (F.S.); (V.N.); (J.-L.d.B.d.l.T.)
- Laboratoire des Sciences et Techniques de l’Information, de la Communication et de la Connaissance, UMR 6285, 29238 Brest, Brittany, France
| | - Cyril Lahuec
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France; (L.M.); (F.S.); (V.N.); (J.-L.d.B.d.l.T.)
- Laboratoire des Sciences et Techniques de l’Information, de la Communication et de la Connaissance, UMR 6285, 29238 Brest, Brittany, France
| | - Fabrice Seguin
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France; (L.M.); (F.S.); (V.N.); (J.-L.d.B.d.l.T.)
- Laboratoire des Sciences et Techniques de l’Information, de la Communication et de la Connaissance, UMR 6285, 29238 Brest, Brittany, France
| | - Vincent Nourrit
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France; (L.M.); (F.S.); (V.N.); (J.-L.d.B.d.l.T.)
| | - Jean-Louis de Bougrenet de la Tocnaye
- Optics Department, Institut Mines-Télécom Atlantique, Technopôle Brest Iroise, CS 83818, CEDEX 03, 29238 Brest, Brittany, France; (L.M.); (F.S.); (V.N.); (J.-L.d.B.d.l.T.)
| |
Collapse
|