P-MIRU, a Polarized Multispectral Imaging System, Reveals Reflection Information on the Biological Surface

Reflection light forms the core of our visual perception of the world. We can obtain vast information by examining reflection light from biological surfaces, including pigment composition and distribution, tissue structure and surface microstructure. However, because of the limitations in our visual system, the complete information in reflection light, which we term 'reflectome', cannot be fully exploited. For example, we may miss reflection light information outside our visible wavelengths. In addition, unlike insects, we have virtually no sensitivity to light polarization. We can detect non-chromatic information lurking in reflection light only with appropriate devices. Although previous studies have designed and developed systems for specialized uses supporting our visual systems, we still do not have a versatile, rapid, convenient and affordable system for analyzing broad aspects of reflection from biological surfaces. To overcome this situation, we developed P-MIRU, a novel multispectral and polarization imaging system for reflecting light from biological surfaces. The hardware and software of P-MIRU are open source and customizable and thus can be applied for virtually any research on biological surfaces. Furthermore, P-MIRU is a user-friendly system for biologists with no specialized programming or engineering knowledge. P-MIRU successfully visualized multispectral reflection in visible/non-visible wavelengths and simultaneously detected various surface phenotypes of spectral polarization. The P-MIRU system extends our visual ability and unveils information on biological surfaces.

Transparency in Human-Machine Mutual Action

Recent advances in human-computer integration (HInt) have focused on the development of human-machine systems, where both human and machine autonomously act upon each other. However, a key challenge in designing such systems is augmenting the user’s physical abilities while maintaining their sense of self-attribution. This challenge is particularly prevalent when both human and machine are capable of acting upon each other, thereby creating a human-machine mutual action (HMMA) system. To address this challenge, we present a design framework that is based on the concept of transparency. We define transparency in HInt as the degree to which users can self-attribute an experience when machines intervene in the users’ action. Using this framework, we form a set of design guidelines and an approach for designing HMMA systems. By using transparency as our focus, we aim to provide a design approach for not only achieving human-machine fusion into a single agent, but also controlling the degrees of fusion at will. This study also highlights the effectiveness of our design approach through an analysis of existing studies that developed HMMA systems. Further development of our design approach is discussed, and future prospects for HInt and HMMA system designs are presented.

A Hybrid Strategy for Target Search Using Static and Mobile Sensors

Locating a mobile target, untrackable in real-time, is pertinent to numerous time-critical applications, such as wilderness search and rescue. This paper proposes a hybrid approach to this dynamic problem, where both static and mobile sensors are utilized for the goal of detecting a target. The approach is novel in that a team of robots utilized to deploy a static-sensor network also actively searches for the target via on-board sensors. Synergy is achieved through: 1) optimal deployment planning of static-sensor networks and 2) optimal routing and motion planning of the robots for the deployment of the network and target search. The static-sensor network is planned first to maximize the likelihood of target detection while ensuring (temporal and spatial) unbiasedness in target motion. Robot motions are, subsequently, planned in two stages: 1) route planning and 2) trajectory planning. In the first stage, given a static-sensor network configuration, robot routes are planned to maximize the amount of spare time available to the mobile agents/sensors, for target search in between (just-in-time) static-sensor deployments. In the second stage, given robot routes (i.e., optimal sequences of sensor delivery locations and times), the corresponding robot trajectories are planned to make effective use of any spare time the mobile agents may have to search for the target. The proposed search strategy was validated through extensive simulations, some of which are given in detail here. An analysis of the method's performance in terms of target-search success is also included.