1
|
Lesage X, Tran R, Mancini S, Fesquet L. Velocity and Color Estimation Using Event-Based Clustering. Sensors (Basel) 2023; 23:9768. [PMID: 38139614 PMCID: PMC10747939 DOI: 10.3390/s23249768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 11/27/2023] [Accepted: 12/04/2023] [Indexed: 12/24/2023]
Abstract
Event-based clustering provides a low-power embedded solution for low-level feature extraction in a scene. The algorithm utilizes the non-uniform sampling capability of event-based image sensors to measure local intensity variations within a scene. Consequently, the clustering algorithm forms similar event groups while simultaneously estimating their attributes. This work proposes taking advantage of additional event information in order to provide new attributes for further processing. We elaborate on the estimation of the object velocity using the mean motion of the cluster. Next, we are examining a novel form of events, which includes intensity measurement of the color at the concerned pixel. These events may be processed to estimate the rough color of a cluster, or the color distribution in a cluster. Lastly, this paper presents some applications that utilize these features. The resulting algorithms are applied and exercised thanks to a custom event-based simulator, which generates videos of outdoor scenes. The velocity estimation methods provide satisfactory results with a trade-off between accuracy and convergence speed. Regarding color estimation, the luminance estimation is challenging in the test cases, while the chrominance is precisely estimated. The estimated quantities are adequate for accurately classifying objects into predefined categories.
Collapse
Affiliation(s)
- Xavier Lesage
- Univ. Grenoble Alpes, CNRS (National Centre for Scientific Research), Grenoble INP (Institute of Engineering), TIMA (Techniques of Informatics and Microelectronics for Integrated Systems Architecture), F-38000 Grenoble, France; (X.L.); (R.T.); (S.M.)
- Orioma, F-38430 Moirans, France
| | - Rosalie Tran
- Univ. Grenoble Alpes, CNRS (National Centre for Scientific Research), Grenoble INP (Institute of Engineering), TIMA (Techniques of Informatics and Microelectronics for Integrated Systems Architecture), F-38000 Grenoble, France; (X.L.); (R.T.); (S.M.)
| | - Stéphane Mancini
- Univ. Grenoble Alpes, CNRS (National Centre for Scientific Research), Grenoble INP (Institute of Engineering), TIMA (Techniques of Informatics and Microelectronics for Integrated Systems Architecture), F-38000 Grenoble, France; (X.L.); (R.T.); (S.M.)
| | - Laurent Fesquet
- Univ. Grenoble Alpes, CNRS (National Centre for Scientific Research), Grenoble INP (Institute of Engineering), TIMA (Techniques of Informatics and Microelectronics for Integrated Systems Architecture), F-38000 Grenoble, France; (X.L.); (R.T.); (S.M.)
| |
Collapse
|
2
|
Fang X, Wei K, Yang R. Untethered Soft Pneumatic Actuators with Embedded Multiple Sensing Capabilities. Soft Robot 2023. [PMID: 37948534 DOI: 10.1089/soro.2023.0048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2023] Open
Abstract
Pneumatic soft robot attracts extensive attention because of its own characteristics. It has great application potential in medical and other fields. Although the recent improvement of the soft robot shows great potentials for delicate manipulations, the development of completely untethered pneumatic intelligent soft robots remains challenging. This article introduces a novel type of untethered soft pneumatic actuator with embedded multiple sensing capabilities. The untethered drive of the soft pneumatic actuator is achieved by near-infrared-induced liquid-gas phase transition. In addition, a soft conductive resin was developed to make flexible sensors. Embedded flexible sensors enable bending and temperature sensing of soft actuators. With Digital Light Processing three-dimensional printing, the rapid fabrication of soft actuators and flexible sensors was realized. This article demonstrates the potential of the proposed untethered soft actuators with embedded multiple sensing capabilities as an important contribution to the research of completely untethered intelligent soft robots.
Collapse
Affiliation(s)
- Xingmiao Fang
- Department of Biomedical Engineering, Anhui Medical University, Hefei, China
| | - Kun Wei
- Department of Biomedical Engineering, Anhui Medical University, Hefei, China
| | - Runhuai Yang
- Department of Biomedical Engineering, Anhui Medical University, Hefei, China
| |
Collapse
|
3
|
Kamat AM, Pei Y, Jayawardhana B, Kottapalli AGP. Biomimetic Soft Polymer Microstructures and Piezoresistive Graphene MEMS Sensors Using Sacrificial Metal 3D Printing. ACS Appl Mater Interfaces 2021; 13:1094-1104. [PMID: 33395251 PMCID: PMC7812595 DOI: 10.1021/acsami.0c21295] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 12/23/2020] [Indexed: 05/23/2023]
Abstract
Recent advances in 3D printing technology have enabled unprecedented design freedom across an ever-expanding portfolio of materials. However, direct 3D printing of soft polymeric materials such as polydimethylsiloxane (PDMS) is challenging, especially for structural complexities such as high-aspect ratio (>20) structures, 3D microfluidic channels (∼150 μm diameter), and biomimetic microstructures. This work presents a novel processing method entailing 3D printing of a thin-walled sacrificial metallic mold, soft polymer casting, and acidic etching of the mold. The proposed workflow enables the facile fabrication of various complex, bioinspired PDMS structures (e.g., 3D double helical microfluidic channels embedded inside high-aspect ratio pillars) that are difficult or impossible to fabricate using currently available techniques. The microfluidic channels are further infused with conductive graphene nanoplatelet ink to realize two flexible piezoresistive microelectromechanical (MEMS) sensors (a bioinspired flow/tactile sensor and a dome-like force sensor) with embedded sensing elements. The MEMS force sensor is integrated into a Philips 9000 series electric shaver to demonstrate its application in "smart" consumer products in the future. Aided by current trends in industrialization and miniaturization in metal 3D printing, the proposed workflow shows promise as a low-temperature, scalable, and cleanroom-free technique of fabricating complex, soft polymeric, biomimetic structures, and embedded MEMS sensors.
Collapse
Affiliation(s)
- Amar M. Kamat
- Advanced
Production Engineering, Engineering and Technology Institute Groningen,
Faculty of Science and Engineering, University
of Groningen, Nijenborgh 4, Groningen 9747 AG, The
Netherlands
| | - Yutao Pei
- Advanced
Production Engineering, Engineering and Technology Institute Groningen,
Faculty of Science and Engineering, University
of Groningen, Nijenborgh 4, Groningen 9747 AG, The
Netherlands
| | - Bayu Jayawardhana
- Discrete
Technology and Production Automation, Engineering and Technology Institute
Groningen, Faculty of Science and Engineering, University of Groningen, Nijenborgh 4, Groningen 9747 AG, The
Netherlands
| | - Ajay Giri Prakash Kottapalli
- Advanced
Production Engineering, Engineering and Technology Institute Groningen,
Faculty of Science and Engineering, University
of Groningen, Nijenborgh 4, Groningen 9747 AG, The
Netherlands
- MIT
Sea Grant College Program, Massachusetts
Institute of Technology (MIT), 77 Massachusetts Avenue, NW98-151, Cambridge 02139, Massachusetts, United States
| |
Collapse
|
4
|
Payne N, Gangwani R, Barton K, Sample AP, Cain SM, Burke DT, Newman-Casey PA, Shorter KA. Medication Adherence and Liquid Level Tracking System for Healthcare Provider Feedback. Sensors (Basel) 2020; 20:s20082435. [PMID: 32344754 PMCID: PMC7219493 DOI: 10.3390/s20082435] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Revised: 04/11/2020] [Accepted: 04/22/2020] [Indexed: 11/16/2022]
Abstract
A common problem for healthcare providers is accurately tracking patients’ adherence to medication and providing real-time feedback on the management of their medication regimen. This is a particular problem for eye drop medications, as the current commercially available monitors focus on measuring adherence to pills, and not to eye drops. This work presents an intelligent bottle sleeve that slides onto a prescription eye drop medication bottle. The intelligent sleeve is capable of detecting eye drop use, measuring fluid level, and sending use information to a healthcare team to facilitate intervention. The electronics embedded into the sleeve measure fluid level, dropper orientation, the state of the dropper top (on/off), and rates of angular motion during an application. The sleeve was tested with ten patients (age ≥65) and successfully identified and timestamped 94% of use events. On-board processing enabled event detection and the measurement of fluid levels at a 0.4 mL resolution. These data were communicated to the healthcare team using Bluetooth and Wi-Fi in real-time, enabling rapid feedback to the subject. The healthcare team can therefore monitor a log of medication use behavior to make informed decisions on treatment or support for the patient.
Collapse
Affiliation(s)
- Nolan Payne
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; (N.P.); (K.B.); (S.M.C.)
| | - Rahul Gangwani
- Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI 48109, USA;
| | - Kira Barton
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; (N.P.); (K.B.); (S.M.C.)
| | - Alanson P. Sample
- Department of Computer Science and Engineering, University of Michigan, Ann Arbor, MI 48109, USA;
| | - Stephen M. Cain
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; (N.P.); (K.B.); (S.M.C.)
| | - David T. Burke
- Department of Human Genetics, University of Michigan School of Medicine, Ann Arbor, MI 48109, USA;
| | - Paula Anne Newman-Casey
- Department of Ophthalmology and Visual Sciences, University of Michigan, Ann Arbor, MI 48105, USA;
| | - K. Alex Shorter
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA; (N.P.); (K.B.); (S.M.C.)
- Correspondence:
| |
Collapse
|
5
|
Dang Y, Devaraj H, Stommel M, Cheng LK, McDaid AJ, Xu W. Experimental Investigation into the Dynamics of a Radially Contracting Actuator with Embedded Sensing Capability. Soft Robot 2020; 7:478-490. [PMID: 31923375 DOI: 10.1089/soro.2019.0064] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Dynamics, control, and sensing are still challenges for pneumatically actuated soft actuators. We consider feasible solutions based on a radially contracting actuator to overcome these challenges. The radially contracting actuator was inspired by the movement of the stomach wall. It was capable of achieving radial contraction by inflating its circular air chamber. A quasi-static model that relates the pressure with the deformed wall of the air chamber was proposed and validated. In this article, we conduct a thorough experimental investigation into the contracting dynamics of the actuator with embedded sensing capability. We analyze the kinematics of the actuator at its rest and pressurization states focusing on the midpoint of the deformed wall. The actuator dynamics is characterized under the square wave pressure input by two variables that are the pressure in the air chamber and the trajectories of the midpoint. To achieve the desired contraction, we construct a feed-forward control based on the quasi-static model. It proves that the actuator is capable of tracking a prescribed triangular wave displacement of the midpoint with small deviations. A custom-made soft sensor is integrated into the actuator, which brings in the embedded sensing capability without affecting the actuator compliance. The resistance changes of the sensor versus the controlled contraction are examined, which are used to indicate the amount of radial contraction. The experimental investigation provides a foundation for the closed-loop control and practical applications of the radially contracting actuator developed.
Collapse
Affiliation(s)
- Yu Dang
- Department of Mechanical Engineering, The University of Auckland, Auckland, New Zealand.,The Medical Technologies Centre of Research Excellence, Auckland, New Zealand
| | - Harish Devaraj
- Department of Mechanical Engineering, The University of Auckland, Auckland, New Zealand
| | - Martin Stommel
- The Medical Technologies Centre of Research Excellence, Auckland, New Zealand.,Department of Electrical and Electronic Engineering, Auckland University of Technology, Auckland, New Zealand
| | - Leo K Cheng
- The Medical Technologies Centre of Research Excellence, Auckland, New Zealand.,Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand.,The Riddet Institute, Palmerston North, New Zealand
| | - Andrew J McDaid
- Department of Mechanical Engineering, The University of Auckland, Auckland, New Zealand.,The Medical Technologies Centre of Research Excellence, Auckland, New Zealand
| | - Weiliang Xu
- Department of Mechanical Engineering, The University of Auckland, Auckland, New Zealand.,The Medical Technologies Centre of Research Excellence, Auckland, New Zealand.,The Riddet Institute, Palmerston North, New Zealand
| |
Collapse
|
6
|
Hehr A, Norfolk M, Kominsky D, Boulanger A, Davis M, Boulware P. Smart Build-Plate for Metal Additive Manufacturing Processes. Sensors (Basel) 2020; 20:s20020360. [PMID: 31936408 PMCID: PMC7013539 DOI: 10.3390/s20020360] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/06/2019] [Revised: 01/03/2020] [Accepted: 01/05/2020] [Indexed: 06/10/2023]
Abstract
This paper discusses the development, processing steps, and evaluation of a smart build-plate or baseplate tool for metal additive manufacturing technologies. This tool uses an embedded high-definition fiber optic sensing fiber to measure strain states from temperature and residual stress within the build-plate for monitoring purposes. Monitoring entails quality tracking for consistency along with identifying defect formation and growth, i.e., delamination or crack events near the build-plate surface. An aluminum alloy 6061 build-plate was manufactured using ultrasonic additive manufacturing due to the process' low formation temperature and capability of embedding fiber optic sensing fiber without damage. Laser-powder bed fusion (L-PBF) was then used to print problematic geometries onto the build-plate using AlSi10Mg for evaluation purposes. The tool identified heat generation, delamination onset, and delamination growth of the printed L-PBF parts.
Collapse
Affiliation(s)
- Adam Hehr
- Fabrisonic LLC, Columbus, OH 43221, USA;
| | | | - Dan Kominsky
- Luna Innovations Inc., Blacksburg, VA 24060, USA; (D.K.); (A.B.); (M.D.)
| | - Andrew Boulanger
- Luna Innovations Inc., Blacksburg, VA 24060, USA; (D.K.); (A.B.); (M.D.)
| | - Matthew Davis
- Luna Innovations Inc., Blacksburg, VA 24060, USA; (D.K.); (A.B.); (M.D.)
| | - Paul Boulware
- Edison Welding Institute (EWI), Columbus, OH 43221, USA;
| |
Collapse
|
7
|
Abstract
Energy harvesting utilizing piezoelectric materials has become an attractive approach for converting mechanical energy into electrical power for low-power electronics. Structural composites are ideally suited for energy scavenging due to the large amount of mechanical energy they are subjected to. Here, a multifunctional composite with embedded sensing and energy harvesting is developed by integrating an active interface into carbon fiber reinforced polymer composites. By modifying the composite matrix, both rigid and flexible multifunctional composites are fabricated. Through electromechanical testing of a cantilever beam of the rigid composite, it reveals a power density of 217 pW/cc from only 1 g root-mean-square acceleration when excited at its resonant frequency of 47 Hz. Electromechanical sensor testing of the flexible multifunctional composite reveals an average voltage generation of 23.5 mV/g at its resonant frequency of 96 Hz. This research introduces a route for integrating nonstructural functionality into structural fiber composites by utilizing BaTiO3 coated woven carbon fiber fabrics with power scavenging and passive sensing capabilities.
Collapse
Affiliation(s)
- Christopher C Bowland
- Materials Science and Technology Division, Oak Ridge National Laboratory , Oak Ridge, Tennessee 37831, United States
| | - Mohammad H Malakooti
- Department of Aerospace Engineering, University of Michigan , Ann Arbor, Michigan 48109, United States
| | - Henry A Sodano
- Department of Aerospace Engineering, University of Michigan , Ann Arbor, Michigan 48109, United States
- Department of Materials Science and Engineering, University of Michigan , Ann Arbor, Michigan 48109, United States
- Macromolecular Science and Engineering Department, University of Michigan , Ann Arbor, Michigan 48109, United States
| |
Collapse
|