1
|
Scheidt J, Diener A, Maiworm M, Müller KR, Findeisen R, Driessens K, Tautz FS, Wagner C. Concept for the Real-Time Monitoring of Molecular Configurations during Manipulation with a Scanning Probe Microscope. THE JOURNAL OF PHYSICAL CHEMISTRY. C, NANOMATERIALS AND INTERFACES 2023; 127:13817-13836. [PMID: 37492192 PMCID: PMC10364088 DOI: 10.1021/acs.jpcc.3c02072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 06/20/2023] [Indexed: 07/27/2023]
Abstract
A bold vision in nanofabrication is the assembly of functional molecular structures using a scanning probe microscope (SPM). This approach requires continuous monitoring of the molecular configuration during manipulation. Until now, this has been impossible because the SPM tip cannot simultaneously act as an actuator and an imaging probe. Here, we implement configuration monitoring using experimental data other than images collected during the manipulation process. We model the manipulation as a partially observable Markov decision process (POMDP) and approximate the actual configuration in real time using a particle filter. To achieve this, the models underlying the POMDP are precomputed and organized in the form of a finite-state automaton, allowing the use of complex atomistic simulations. We exemplify the configuration monitoring process and reveal structural motifs behind measured force gradients. The proposed methodology marks an important step toward the piece-by-piece creation of supramolecular structures in a robotic and possibly automated manner.
Collapse
Affiliation(s)
- Joshua Scheidt
- Peter
Grünberg Institut (PGI-3), Forschungszentrum
Jülich, 52425 Jülich, Germany
- Jülich
Aachen Research Alliance (JARA)-Fundamentals of Future Information
Technology, 52425 Jülich, Germany
- Data
Science and Knowledge Engineering, Maastricht
University, 6229 EN Maastricht, The Netherlands
| | - Alexander Diener
- Peter
Grünberg Institut (PGI-3), Forschungszentrum
Jülich, 52425 Jülich, Germany
- Jülich
Aachen Research Alliance (JARA)-Fundamentals of Future Information
Technology, 52425 Jülich, Germany
- Data
Science and Knowledge Engineering, Maastricht
University, 6229 EN Maastricht, The Netherlands
| | - Michael Maiworm
- Laboratory
for Systems Theory and Automatic Control, Otto-von-Guericke-Universität Magdeburg, 39106 Magdeburg, Germany
| | - Klaus-Robert Müller
- Max
Planck Institute for Informatics, 66123 Saarbrücken, Germany
- Machine Learning
Group, Technische Universität Berlin, 10587 Berlin, Germany
- Department
of Artificial Intelligence, Korea University, Seoul 136-713, South Korea
| | - Rolf Findeisen
- Control
and Cyber-Physical Systems Laboratory, Technische
Universität Darmstadt, 64289 Darmstadt, Germany
| | - Kurt Driessens
- Data
Science and Knowledge Engineering, Maastricht
University, 6229 EN Maastricht, The Netherlands
| | - F. Stefan Tautz
- Peter
Grünberg Institut (PGI-3), Forschungszentrum
Jülich, 52425 Jülich, Germany
- Jülich
Aachen Research Alliance (JARA)-Fundamentals of Future Information
Technology, 52425 Jülich, Germany
- Department
of Artificial Intelligence, Korea University, Seoul 136-713, South Korea
| | - Christian Wagner
- Peter
Grünberg Institut (PGI-3), Forschungszentrum
Jülich, 52425 Jülich, Germany
- Jülich
Aachen Research Alliance (JARA)-Fundamentals of Future Information
Technology, 52425 Jülich, Germany
| |
Collapse
|
2
|
Leinen P, Esders M, Schütt KT, Wagner C, Müller KR, Tautz FS. Autonomous robotic nanofabrication with reinforcement learning. SCIENCE ADVANCES 2020; 6:6/36/eabb6987. [PMID: 32917594 PMCID: PMC7467688 DOI: 10.1126/sciadv.abb6987] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Accepted: 07/02/2020] [Indexed: 05/27/2023]
Abstract
The ability to handle single molecules as effectively as macroscopic building blocks would enable the construction of complex supramolecular structures inaccessible to self-assembly. The fundamental challenges obstructing this goal are the uncontrolled variability and poor observability of atomic-scale conformations. Here, we present a strategy to work around both obstacles and demonstrate autonomous robotic nanofabrication by manipulating single molecules. Our approach uses reinforcement learning (RL), which finds solution strategies even in the face of large uncertainty and sparse feedback. We demonstrate the potential of our RL approach by removing molecules autonomously with a scanning probe microscope from a supramolecular structure. Our RL agent reaches an excellent performance, enabling us to automate a task that previously had to be performed by a human. We anticipate that our work opens the way toward autonomous agents for the robotic construction of functional supramolecular structures with speed, precision, and perseverance beyond our current capabilities.
Collapse
Affiliation(s)
- Philipp Leinen
- Peter Grünberg Institut (PGI-3), Forschungszentrum Jülich, 52425 Jülich, Germany
- Jülich Aachen Research Alliance (JARA)-Fundamentals of Future Information Technology, 52425 Jülich, Germany
- Experimentalphysik IV A, RWTH Aachen University, Otto-Blumenthal-Straße, 52074 Aachen, Germany
| | - Malte Esders
- Machine Learning Group, Technische Universität Berlin, 10587 Berlin, Germany
| | - Kristof T Schütt
- Machine Learning Group, Technische Universität Berlin, 10587 Berlin, Germany
| | - Christian Wagner
- Peter Grünberg Institut (PGI-3), Forschungszentrum Jülich, 52425 Jülich, Germany.
- Jülich Aachen Research Alliance (JARA)-Fundamentals of Future Information Technology, 52425 Jülich, Germany
| | - Klaus-Robert Müller
- Machine Learning Group, Technische Universität Berlin, 10587 Berlin, Germany.
- Max Planck Institute for Informatics, 66123 Saarbrücken, Germany
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - F Stefan Tautz
- Peter Grünberg Institut (PGI-3), Forschungszentrum Jülich, 52425 Jülich, Germany
- Jülich Aachen Research Alliance (JARA)-Fundamentals of Future Information Technology, 52425 Jülich, Germany
- Experimentalphysik IV A, RWTH Aachen University, Otto-Blumenthal-Straße, 52074 Aachen, Germany
| |
Collapse
|
3
|
Wu Z, Li T, Li J, Gao W, Xu T, Christianson C, Gao W, Galarnyk M, He Q, Zhang L, Wang J. Turning erythrocytes into functional micromotors. ACS NANO 2014; 8:12041-8. [PMID: 25415461 PMCID: PMC4386663 DOI: 10.1021/nn506200x] [Citation(s) in RCA: 180] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Attempts to apply artificial nano/micromotors for diverse biomedical applications have inspired a variety of strategies for designing motors with diverse propulsion mechanisms and functions. However, existing artificial motors are made exclusively of synthetic materials, which are subject to serious immune attack and clearance upon entering the bloodstream. Herein we report an elegant approach that turns natural red blood cells (RBCs) into functional micromotors with the aid of ultrasound propulsion and magnetic guidance. Iron oxide nanoparticles are loaded into the RBCs, where their asymmetric distribution within the cells results in a net magnetization, thus enabling magnetic alignment and guidance under acoustic propulsion. The RBC motors display efficient guided and prolonged propulsion in various biological fluids, including undiluted whole blood. The stability and functionality of the RBC motors, as well as the tolerability of regular RBCs to the ultrasound operation, are carefully examined. Since the RBC motors preserve the biological and structural features of regular RBCs, these motors possess a wide range of antigenic, transport, and mechanical properties that common synthetic motors cannot achieve and thus hold considerable promise for a number of practical biomedical uses.
Collapse
Affiliation(s)
- Zhiguang Wu
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
- The Academy of Fundamental and Interdisciplinary Sciences, Harbin Institute of Technology, Harbin 150080, China
| | - Tianlong Li
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Jinxing Li
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Wei Gao
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Tailin Xu
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Caleb Christianson
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Weiwei Gao
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Michael Galarnyk
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Qiang He
- The Academy of Fundamental and Interdisciplinary Sciences, Harbin Institute of Technology, Harbin 150080, China
| | - Liangfang Zhang
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| | - Joseph Wang
- Department of Nanoengineering, University of California, San Diego, La Jolla, California 92093, United States
| |
Collapse
|
4
|
Lu NN, Liu J, Tian Y, Liao MH, Wang H, Lu YM, Tao RR, Hong LJ, Liu SS, Fukunaga K, Du YZ, Han F. Atg5 deficit exaggerates the lysosome formation and cathepsin B activation in mice brain after lipid nanoparticles injection. NANOMEDICINE-NANOTECHNOLOGY BIOLOGY AND MEDICINE 2014; 10:1843-52. [DOI: 10.1016/j.nano.2014.03.019] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2014] [Revised: 03/30/2014] [Accepted: 03/31/2014] [Indexed: 12/19/2022]
|
5
|
Abstract
Construction of nano-devices that can generate controllable unidirectional rotation is an important part of nanotechnology. Here, we design a nano-turbine composed of carbon nanotube and graphene nanoblades, which can be driven by fluid flow. Rotation motion of nano-turbine is quantitatively studied by molecular dynamics simulations on this model system. A robust linear relationship is achieved with this nano-turbine between its rotation rate and the fluid flow velocity spanning two orders of magnitude, and this linear relationship remains intact at various temperatures. More interestingly, a striking difference from its macroscopic counterpart is identified: the rotation rate is much smaller (by a factor of ~15) than that of the macroscopic turbine with the same driving flow. This discrepancy is shown to be related to the disruption of water flow at nanoscale, together with the water slippage at graphene surface and the so-called “dragging effect”. Moreover, counterintuitively, the ratio of “effective” driving flow velocity increases as the flow velocity increases, suggesting that the linear dependence on the flow velocity can be more complicated in nature. These findings may serve as a foundation for the further development of rotary nano-devices and should also be helpful for a better understanding of the biological molecular motors.
Collapse
|
6
|
Targeted therapy of brain ischaemia using Fas ligand antibody conjugated PEG-lipid nanoparticles. Biomaterials 2013; 35:530-7. [PMID: 24120040 DOI: 10.1016/j.biomaterials.2013.09.093] [Citation(s) in RCA: 71] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2013] [Accepted: 09/24/2013] [Indexed: 12/27/2022]
Abstract
The translation of experimental stroke research from the laboratory to successful clinical practice remains a formidable challenge. We previously reported that PEGylated-lipid nanoparticles (PLNs) effectively transport across the blood-brain barrier along with less inflammatory responses. In the present study, PLNs conjugated to Fas ligand antibody that selectively present on brain ischaemic region were used for therapeutic targeting. Fluorescent analysis of the mice brain show that encapsulated 3-n-Butylphthalide (dl-NBP) in PLNs conjugated with Fas ligand antibody effectively delivered to ipsilateral region of ischaemic brain. Furthermore, the confocal immunohistochemical study demonstrated that brain-targeted nanocontainers specifically accumulated on OX42 positive microglia cells in ischaemic region of mice model. Finally, dl-NBP encapsulated nano-drug delivery system is resulted in significant improvements in brain injury and in neurological deficit after ischaemia, with the significantly reduced dosages versus regular dl-NBP. Overall, these data suggests that PLNs conjugated to an antibody specific to the Fas ligand constituted an ideal brain targeting drug delivery system for brain ischaemia.
Collapse
|
7
|
Huang JY, Lu YM, Wang H, Liu J, Liao MH, Hong LJ, Tao RR, Ahmed MM, Liu P, Liu SS, Fukunaga K, Du YZ, Han F. The effect of lipid nanoparticle PEGylation on neuroinflammatory response in mouse brain. Biomaterials 2013; 34:7960-70. [DOI: 10.1016/j.biomaterials.2013.07.009] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2013] [Accepted: 07/01/2013] [Indexed: 10/26/2022]
|
8
|
Zheng YB, Pathem BK, Hohman JN, Thomas JC, Kim M, Weiss PS. Photoresponsive molecules in well-defined nanoscale environments. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2013; 25:302-312. [PMID: 22933316 DOI: 10.1002/adma.201201532] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2012] [Revised: 07/01/2012] [Indexed: 06/01/2023]
Abstract
Stimuli-responsive molecules are key building blocks of functional molecular materials and devices. These molecules can operate in a range of environments. A molecule's local environment will dictate its conformation, reactivity, and function; by controlling the local environment we can ultimately develop interfaces of individual molecules with the macroscopic environment. By isolating molecules in well-defined environments, we are able to obtain both accurate measurements and precise control. We exploit defect sites in self-assembled monolayers (SAMs) to direct the functional molecules into precise locations, providing a basis for the measurements and engineering of functional molecular systems. The structure and functional moieties of the SAM can be tuned to control not only the intermolecular interactions but also molecule-substrate interactions, resulting in extraction or control of desired molecular functions. Herein, we report our progress toward the assembly and measurements of photoresponsive molecules and their precise assemblies in SAM matrices.
Collapse
Affiliation(s)
- Yue Bing Zheng
- California NanoSystems Institute, University of California, Los Angeles, Los Angeles, CA 90095, USA
| | | | | | | | | | | |
Collapse
|
9
|
Pathem BK, Zheng YB, Payton JL, Song TB, Yu BC, Tour JM, Yang Y, Jensen L, Weiss PS. Effect of Tether Conductivity on the Efficiency of Photoisomerization of Azobenzene-Functionalized Molecules on Au{111}. J Phys Chem Lett 2012; 3:2388-2394. [PMID: 26292120 DOI: 10.1021/jz300968m] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
We establish the role of tether conductivity on the photoisomerization of azobenzene-functionalized molecules assembled as isolated single molecules in well-defined decanethiolate self-assembled monolayer matrices on Au{111}. We designed the molecules so as to tune the conductivity of the tethers that separate the functional moiety from the underlying Au substrate. By employing surface-enhanced Raman spectroscopy, time-course measurements of surfaces assembled with azobenzene functionalized with different tether conductivities were independently studied under constant UV light illumination. The decay constants from the analyses reveal that photoisomerization on the Au{111} surface is reduced when the conductivity of the tether is increased. Experimental results are compared with density functional theory calculations performed on single molecules attached to Au clusters.
Collapse
Affiliation(s)
| | | | - John L Payton
- ∥Department of Chemistry, The Pennsylvania State University, University Park, Pennsylvania 16802, United States
| | | | - Byung-Chan Yu
- ⊥Department of Chemistry and The Smalley Institute for Nanoscale Science and Technology, Rice University, Houston, Texas 77005, United States
| | - James M Tour
- ⊥Department of Chemistry and The Smalley Institute for Nanoscale Science and Technology, Rice University, Houston, Texas 77005, United States
| | | | - Lasse Jensen
- ∥Department of Chemistry, The Pennsylvania State University, University Park, Pennsylvania 16802, United States
| | | |
Collapse
|