Learning from droplet flows in microfluidic channels using deep neural networks

Role of Machine Learning Assisted Biosensors in Point-of-Care-Testing For Clinical Decisions

Point-of-Care-Testing (PoCT) has emerged as an essential component of modern healthcare, providing rapid, low-cost, and simple diagnostic options. The integration of Machine Learning (ML) into biosensors has ushered in a new era of innovation in the field of PoCT. This article investigates the numerous uses and transformational possibilities of ML in improving biosensors for PoCT. ML algorithms, which are capable of processing and interpreting complicated biological data, have transformed the accuracy, sensitivity, and speed of diagnostic procedures in a variety of healthcare contexts. This review explores the multifaceted applications of ML models, including classification and regression, displaying how they contribute to improving the diagnostic capabilities of biosensors. The roles of ML-assisted electrochemical sensors, lab-on-a-chip sensors, electrochemiluminescence/chemiluminescence sensors, colorimetric sensors, and wearable sensors in diagnosis are explained in detail. Given the increasingly important role of ML in biosensors for PoCT, this study serves as a valuable reference for researchers, clinicians, and policymakers interested in understanding the emerging landscape of ML in point-of-care diagnostics.

Generation of Multiple Concentration Gradients Using a Two-Dimensional Pyramid Array

Concentration heterogeneity of diffusible reactants is a prevalent phenomenon in biochemical processes, requiring the generation of concentration gradients for the relevant experiments. In this study, we present a high-density pyramid array microfluidic network for the effective and precise generation of multiple concentration gradients. The complex gradient distribution in the 2D array can be adaptively adjusted by modulating the reactant velocities and concentrations at the inlets. In addition, the unique design of each reaction chamber and mixing block in the array ensures uniform concentrations within each chamber during dynamic changes, enabling large-scale reactions with low reactant volumes. Through detailed numerical simulation of mass transport within the complex microchannel networks, the proposed method allows researchers to determine the desired number of reaction chambers within a given concentration range based on experimental requirements and to quickly obtain the operating conditions with the help of machine learning-based prediction. The effectiveness in generating a multiple concentration gradient environment was further demonstrated by concentration-dependent calcium carbonate crystallization experiments. This device provides a highly efficient mixing and adaptable concentration platform that is well suited for high-throughput and multiplexed reactions.

Artificial neural network modelling hydrodenticity for optimal design by microfluidics of polymer nanoparticles to apply in magnetic resonance imaging

The engineering of nanoparticles impacts the control of their nano-bio interactions at each level of the delivery pathway. Therefore, optimal nanoparticle physicochemical properties should be identified to favour on-target interactions and deliver efficiently active compounds to a specific target. To date, traditional batch processes do not guarantee the reproducibility of results and low polydispersity index of the nanostructures, while microfluidics has emerged as cost effectiveness, short-production time approach to control the nanoparticle size and size distribution. Several thermodynamic processes have been implemented in microfluidics, such as nanoprecipitation, ionotropic gelation, self-assembly, etc., to produce nanoparticles in a continuous mode and high throughput way.   In this work, we show how the Artificial Neural Network (ANN) can be adopted to model the impact of microfluidic parameters (namely, flow rates and polymer concentrations) on the size of the nanoparticles. Promising results have been obtained, with the highest model accuracy reaching 98.9 %, thus confirming the proposed approach's potential applicability for an ANN-guided biopolymer nanoparticle design for biomedical applications. Nanostructures with different degrees of complexity are analysed, and a proof-of-concept machine learning approach is proposed to evaluate Hydrodenticity in biopolymer matrices. STATEMENT OF SIGNIFICANCE: Size, shape and surface charge determine nano-bio interactions of nanoparticles and their ability to target diseases. The ideal nanoparticle design avoids off-target interactions and favours on-target interactions. So, tools enabling the identification of the optimal nanoparticle physicochemical properties for delivery to a specific target are required. In this work, we evaluate the use of Artificial Neural Network (ANN) to analyse the role of microfluidic parameters in predicting the optimal size of the different hydrogel nanoparticles and their ability to trigger Hydrodenticity.

Deep learning with microfluidics for on-chip droplet generation, control, and analysis

Droplet microfluidics has gained widespread attention in recent years due to its advantages of high throughput, high integration, high sensitivity and low power consumption in droplet-based micro-reaction. Meanwhile, with the rapid development of computer technology over the past decade, deep learning architectures have been able to process vast amounts of data from various research fields. Nowadays, interdisciplinarity plays an increasingly important role in modern research, and deep learning has contributed greatly to the advancement of many professions. Consequently, intelligent microfluidics has emerged as the times require, and possesses broad prospects in the development of automated and intelligent devices for integrating the merits of microfluidic technology and artificial intelligence. In this article, we provide a general review of the evolution of intelligent microfluidics and some applications related to deep learning, mainly in droplet generation, control, and analysis. We also present the challenges and emerging opportunities in this field.

Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications

Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.

Microsystem Advances through Integration with Artificial Intelligence

Microfluidics is a rapidly growing discipline that involves studying and manipulating fluids at reduced length scale and volume, typically on the scale of micro- or nanoliters. Under the reduced length scale and larger surface-to-volume ratio, advantages of low reagent consumption, faster reaction kinetics, and more compact systems are evident in microfluidics. However, miniaturization of microfluidic chips and systems introduces challenges of stricter tolerances in designing and controlling them for interdisciplinary applications. Recent advances in artificial intelligence (AI) have brought innovation to microfluidics from design, simulation, automation, and optimization to bioanalysis and data analytics. In microfluidics, the Navier-Stokes equations, which are partial differential equations describing viscous fluid motion that in complete form are known to not have a general analytical solution, can be simplified and have fair performance through numerical approximation due to low inertia and laminar flow. Approximation using neural networks trained by rules of physical knowledge introduces a new possibility to predict the physicochemical nature. The combination of microfluidics and automation can produce large amounts of data, where features and patterns that are difficult to discern by a human can be extracted by machine learning. Therefore, integration with AI introduces the potential to revolutionize the microfluidic workflow by enabling the precision control and automation of data analysis. Deployment of smart microfluidics may be tremendously beneficial in various applications in the future, including high-throughput drug discovery, rapid point-of-care-testing (POCT), and personalized medicine. In this review, we summarize key microfluidic advances integrated with AI and discuss the outlook and possibilities of combining AI and microfluidics.

Microneedle arrays integrated with microfluidic systems: Emerging applications and fluid flow modeling

Microneedle arrays are patches of needles at micro- and nano-scale, which are competent and versatile technologies that have been merged with microfluidic systems to construct more capable devices for biomedical applications, such as drug delivery, wound healing, biosensing, and sampling body fluids. In this paper, several designs and applications are reviewed. In addition, modeling approaches used in microneedle designs for fluid flow and mass transfer are discussed, and the challenges are highlighted.

Surfactant-laden droplet size prediction in a flow-focusing microchannel: a data-driven approach

The control of droplet formation and size using microfluidic devices is a critical operation for both laboratory and industrial applications, e.g. in micro-dosage. Surfactants can be added to improve the stability and control the size of the droplets by modifying their interfacial properties. In this study, a large-scale data set of droplet size was obtained from high-speed imaging experiments conducted on a flow-focusing microchannel where aqueous surfactant-laden droplets were generated in silicone oil. Three types of surfactants were used including anionic, cationic and non-ionic at concentrations below and above the critical micelle concentration (CMC). To predict the final droplet size as a function of flow rates, surfactant type and concentration of surfactant, two data-driven models were built. Using a Bayesian regularised artificial neural network and XGBoost, these models were initially based on four inputs (flow rates of the two phases, interfacial tension at equilibrium and the normalised surfactant concentration). The mean absolute percentage errors (MAPE) show that data-driven models are more accurate (MAPE = 3.9%) compared to semi-empirical models (MAPE = 11.4%). To overcome experimental difficulties in acquiring accurate interfacial tension values under some conditions, both models were also trained with reduced inputs by removing the interfacial tension. The results show again a very good prediction of the droplet diameter. Finally, over 10 000 synthetic data were generated, based on the initial data set, with a Variational Autoencoder (VAE). The high-fidelity of the extended synthetic data set highlights that this method can be a quick and low-cost alternative to study microdroplet formation in future lab on a chip applications, where experimental data may not be readily available.

Machine learning for microfluidic design and control

Microfluidics has developed into a mature field with applications across science and engineering, having particular commercial success in molecular diagnostics, next-generation sequencing, and bench-top analysis. Despite its ubiquity, the complexity of designing and controlling custom microfluidic devices present major barriers to adoption, requiring intuitive knowledge gained from years of experience. If these barriers were overcome, microfluidics could miniaturize biological and chemical research for non-experts through fully-automated platform development and operation. The intuition of microfluidic experts can be captured through machine learning, where complex statistical models are trained for pattern recognition and subsequently used for event prediction. Integration of machine learning with microfluidics could significantly expand its adoption and impact. Here, we present the current state of machine learning for the design and control of microfluidic devices, its possible applications, and current limitations.

Microfluidic Devices Controlled by Machine Learning with Failure Experiments

A critical microchannel technique is to isolate specific objects, such as cells, in a biological solution. Generally, this particle sorting is achieved by designing a microfluidic device and tuning its control values; however, unpredictable motions of the particle mixture make this approach time-consuming and labor intensive. Here, we show that microfluidic control with reinforced learning characterized by utilizing failure results can maximize the training effect with limited data. This method uses microscopic images of the separation process, including failed conditions (inappropriate flow speeds or dilution rates of biological samples), and insights for efficient learning are provided by setting gradient rewards according to the degree of failure. Once learning is performed in this manner, the optimal separating condition for other related samples can be automatically found. Failed experiments are not wasteful; they increase training data and make it easier to reach correct answers. This device control could be useful in automatic synthetic chemistry, biomedical analysis, and microfabrication robotics.

Artificial Intelligence-Controlled Microfluidic Device for Fluid Automation and Bubble Removal of Immunoassay Operated by a Smartphone

There have been tremendous innovations in microfluidic clinical diagnostics to facilitate novel point-of-care testing (POCT) over the past decades. However, the automatic operation of microfluidic devices that minimize user intervention still lacks reliability and repeatability because microfluidic errors such as bubbles and incomplete filling pose a major bottleneck in commercializing the microfluidic devices for clinical testing. In this work, for the first time, various states of microfluid were recognized to control immunodiagnostics by artificial intelligence (AI) technology. The developed AI-controlled microfluidic platform was operated via an Android smartphone, along with a low-cost polymer device to effectuate enzyme-linked immunosorbent assay (ELISA). To overcome the limited machine-learning capability of smartphones, the region-of-interest (ROI) cascading and conditional activation algorithms were utilized herein. The developed microfluidic chip was incorporated with a bubble trap to remove any bubbles detected by AI, which helps in preventing false signals during immunoassay, as well as controlling the reagents' movement with an on-chip micropump and valve. Subsequently, the developed immunosensing platform was tested for conducting real ELISA using a single microplate from the 96-well to detect the Human Cardiac Troponin I (cTnI) biomarker, with a detection limit as low as 0.98 pg/mL. As a result, the developed platform can be envisaged as an AI-based revolution in microfluidics for point-of-care clinical diagnosis.

A perspective on magnetic microfluidics: Towards an intelligent future

Magnetic microfluidics has been gradually recognized as an area of its own. Both conventional microfluidic platforms have incorporated magnetic actuation for microfluidic operation and microscale object manipulation. Nonetheless, there is still much room for improvement after decades of development. In this Perspective, we first provide a quick review of existing magnetic microfluidic platforms with a focus on the magnetic tools and actuation mechanisms. Next, we discuss several emerging technologies, including magnetic microrobots, additive manufacture, and artificial intelligence, and their potential application in the future development of magnetic microfluidics. We believe that these technologies can eventually inspire highly functional magnetic tools for microfluidic manipulation and coordinated microfluidic control at the system level, which eventually drives magnetic microfluidics into an intelligent system for automated experimentation.

Exploiting machine learning for bestowing intelligence to microfluidics

Intelligent microfluidics is an emerging cross-discipline research area formed by combining microfluidics with machine learning. It uses the advantages of microfluidics, such as high throughput and controllability, and the powerful data processing capabilities of machine learning, resulting in improved systems in biotechnology and chemistry. Compared to traditional microfluidics using manual analysis methods, intelligent microfluidics needs less human intervention, and results in a more user-friendly experience with faster processing. There is a paucity of literature reviewing this burgeoning and highly promising cross-discipline. Therefore, we herein comprehensively and systematically summarize several aspects of microfluidic applications enabled by machine learning. We list the types of microfluidics used in intelligent microfluidic applications over the last five years, as well as the machine learning algorithms and the hardware used for training. We also present the most recent advances in key technologies, developments, challenges, and the emerging opportunities created by intelligent microfluidics.

A fast and efficient deep learning procedure for tracking droplet motion in dense microfluidic emulsions

We present a deep learning-based object detection and object tracking algorithm to study droplet motion in dense microfluidic emulsions. The deep learning procedure is shown to correctly predict the droplets' shape and track their motion at competitive rates as compared to standard clustering algorithms, even in the presence of significant deformations. The deep learning technique and tool developed in this work could be used for the general study of the dynamics of biological agents in fluid systems, such as moving cells and self-propelled microorganisms in complex biological flows. This article is part of the theme issue 'Progress in mesoscale methods for fluid dynamics simulation'.

Intelligent acoustofluidics enabled mini-bioreactors for human brain organoids

Acoustofluidics, by combining acoustics and microfluidics, provides a unique means to manipulate cells and liquids for broad applications in biomedical sciences and translational medicine. However, it is challenging to standardize and maintain excellent performance of current acoustofluidic devices and systems due to a multiplicity of factors including device-to-device variation, manual operation, environmental factors, sample variability, etc. Herein, to address these challenges, we propose "intelligent acoustofluidics" - an automated system that involves acoustofluidic device design, sensor fusion, and intelligent controller integration. As a proof-of-concept, we developed intelligent acoustofluidics based mini-bioreactors for human brain organoid culture. Our mini-bioreactors consist of three components: (1) rotors for contact-free rotation via an acoustic spiral phase vortex approach, (2) a camera for real-time tracking of rotational actions, and (3) a reinforcement learning-based controller for closed-loop regulation of rotational manipulation. After training the reinforcement learning-based controller in simulation and experimental environments, our mini-bioreactors can achieve the automated rotation of rotors in well-plates. Importantly, our mini-bioreactors can enable excellent control over rotational mode, direction, and speed of rotors, regardless of fluctuations of rotor weight, liquid volume, and operating temperature. Moreover, we demonstrated our mini-bioreactors can stably maintain the rotational speed of organoids during long-term culture, and enhance neural differentiation and uniformity of organoids. Comparing with current acoustofluidics, our intelligent system has a superior performance in terms of automation, robustness, and accuracy, highlighting the potential of novel intelligent systems in microfluidic experimentation.

Integrating Engineering, Automation, and Intelligence to Catalyze the Biomedical Translation of Organoids

Organoid technology has developed at an impressive speed during the past decade. Still, organoids are not widely used in practical applications as expected. It is believed that this translation can be greatly accelerated with the integration of engineering and artificial intelligence into current research practices. It is proposed that this approach is the missing link to realize key milestones in organoid technology, namely, high-throughput, homogeneous, and standardized production, automated manipulation, and intelligent monitoring, evaluation, and control via integrated on-chip instrumentation and artificial intelligence. It is suggested that organoids-on-a-chip are the ideal platform to achieve these feats. Once these techniques are established and adopted by the scientific community, the rapid translation of organoids may be seen from laboratories to the clinics and pharmaceutical industry.

Adoption of reinforcement learning for the intelligent control of a microfluidic peristaltic pump

We herein report a study on the intelligent control of microfluidic systems using reinforcement learning. Integrated microvalves are utilized to realize a variety of microfluidic functional modules, such as switching of flow pass, micropumping, and micromixing. The application of artificial intelligence to control microvalves can potentially contribute to the expansion of the versatility of microfluidic systems. As a preliminary attempt toward this motivation, we investigated the application of a reinforcement learning algorithm to microperistaltic pumps. First, we assumed a Markov property for the operation of diaphragms in the microperistaltic pump. Thereafter, components of the Markov decision process were defined for adaptation to the micropump. To acquire the pumping sequence, which maximizes the flow rate, the reward was defined as the obtained flow rate in a state transition of the microvalves. The present system successfully empirically determines the optimal sequence, which considers the physical characteristics of the components of the system that the authors did not recognize. Therefore, it was proved that reinforcement learning could be applied to microperistaltic pumps and is promising for the operation of larger and more complex microsystems.

Artificial intelligence application for rapid fabrication of size-tunable PLGA microparticles in microfluidics

In this study, synthetic polymeric particles were effectively fabricated by combining modern technologies of artificial intelligence (AI) and microfluidics. Because size uniformity is a key factor that significantly influences the stability of polymeric particles, therefore, this work aimed to establish a new AI application using machine learning technology for prediction of the size of poly(D,L-lactide-co-glycolide) (PLGA) microparticles produced by diverse microfluidic systems either in the form of single or multiple particles. Experimentally, the most effective factors for tuning droplet/particle sizes are PLGA concentrations and the flow rates of dispersed and aqueous phases in microfluidics. These factors were utilized to develop five different and simple in structure artificial neural network (ANN) models that are capable of predicting PLGA particle sizes produced by different microfluidic systems either individually or jointly merged. The systematic development of ANN models allowed ultimate construction of a single in silico model which consists of data for three different microfluidic systems. This ANN model eventually allowed rapid prediction of particle sizes produced using various microfluidic systems. This AI application offers a new platform for further rapid and economical exploration of polymer particles production in defined sizes for various applications including biomimetic studies, biomedicine, and pharmaceutics.

Machine learning-enabled multiplexed microfluidic sensors

High-throughput, cost-effective, and portable devices can enhance the performance of point-of-care tests. Such devices are able to acquire images from samples at a high rate in combination with microfluidic chips in point-of-care applications. However, interpreting and analyzing the large amount of acquired data is not only a labor-intensive and time-consuming process, but also prone to the bias of the user and low accuracy. Integrating machine learning (ML) with the image acquisition capability of smartphones as well as increasing computing power could address the need for high-throughput, accurate, and automatized detection, data processing, and quantification of results. Here, ML-supported diagnostic technologies are presented. These technologies include quantification of colorimetric tests, classification of biological samples (cells and sperms), soft sensors, assay type detection, and recognition of the fluid properties. Challenges regarding the implementation of ML methods, including the required number of data points, image acquisition prerequisites, and execution of data-limited experiments are also discussed.

Mixing characterization of binary-coalesced droplets in microchannels using deep neural network

Real-time object identification and classification are essential in many microfluidic applications especially in the droplet microfluidics. This paper discusses the application of convolutional neural networks to detect the merged microdroplet in the flow field and classify them in an on-the-go manner based on the extent of mixing. The droplets are generated in PMMA microfluidic devices employing flow-focusing and cross-flow configurations. The visualization of binary coalescence of droplets is performed by a CCD camera attached to a microscope, and the sequence of images is recorded. Different real-time object localization and classification networks such as You Only Look Once and Singleshot Multibox Detector are deployed for droplet detection and characterization. A custom dataset to train these deep neural networks to detect and classify is created from the captured images and labeled manually. The merged droplets are segregated based on the degree of mixing into three categories: low mixing, intermediate mixing, and high mixing. The trained model is tested against images taken at different ambient conditions, droplet shapes, droplet sizes, and binary-fluid combinations, which indeed exhibited high accuracy and precision in predictions. In addition, it is demonstrated that these schemes are efficient in localization of coalesced binary droplets from the recorded video or image and classify them based on grade of mixing irrespective of experimental conditions in real time.

Step emulsification in microfluidic droplet generation: mechanisms and structures

Step emulsification for micro- and nano-droplet generation is reviewed in brief, including the emulsion mechanisms and microfluidic devices.