A Hybrid LP-RPG Heuristic for Modelling Numeric Resource Flows in Planning

Although the use of metric fluents is fundamental to many practical planning problems, the study of heuristics to support fully automated planners working with these fluents remains relatively unexplored. The most widely used heuristic is the relaxation of metric fluents into interval-valued variables --- an idea first proposed a decade ago. Other heuristics depend on domain encodings that supply additional information about fluents, such as capacity constraints or other resource-related annotations. A particular challenge to these approaches is in handling interactions between metric fluents that represent exchange, such as the transformation of quantities of raw materials into quantities of processed goods, or trading of money for materials. The usual relaxation of metric fluents is often very poor in these situations, since it does not recognise that resources, once spent, are no longer available to be spent again. We present a heuristic for numeric planning problems building on the propositional relaxed planning graph, but using a mathematical program for numeric reasoning. We define a class of producer--consumer planning problems and demonstrate how the numeric constraints in these can be modelled in a mixed integer program (MIP). This MIP is then combined with a metric Relaxed Planning Graph (RPG) heuristic to produce an integrated hybrid heuristic. The MIP tracks resource use more accurately than the usual relaxation, but relaxes the ordering of actions, while the RPG captures the causal propositional aspects of the problem. We discuss how these two components interact to produce a single unified heuristic and go on to explore how further numeric features of planning problems can be integrated into the MIP. We show that encoding a limited subset of the propositional problem to augment the MIP can yield more accurate guidance, partly by exploiting structure such as propositional landmarks and propositional resources. Our results show that the use of this heuristic enhances scalability on problems where numeric resource interaction is key in finding a solution.

Plan-based Policies for Efficient Multiple Battery Load Management

Efficient use of multiple batteries is a practical problem with wide and growing application. The problem can be cast as a planning problem under uncertainty. We describe the approach we have adopted to modelling and solving this problem, seen as a Markov Decision Problem, building effective policies for battery switching in the face of stochastic load profiles. Our solution exploits and adapts several existing techniques: planning for deterministic mixed discrete-continuous problems and Monte Carlo sampling for policy learning. The paper describes the development of planning techniques to allow solution of the non-linear continuous dynamic models capturing the battery behaviours. This approach depends on carefully handled discretisation of the temporal dimension. The construction of policies is performed using a classification approach and this idea offers opportunities for wider exploitation in other problems. The approach and its generality are described in the paper. Application of the approach leads to construction of policies that, in simulation, significantly outperform those that are currently in use and the best published solutions to the battery management problem. We achieve solutions that achieve more than 99% efficiency in simulation compared with the theoretical limit and do so with far fewer battery switches than existing policies. Behaviour of physical batteries does not exactly match the simulated models for many reasons, so to confirm that our theoretical results can lead to real measured improvements in performance we also conduct and report experiments using a physical test system. These results demonstrate that we can obtain 5%-15% improvement in lifetimes in the case of a two battery system.

SU-E-I-44: The UF/NCI Family of Hybrid Computational Phantoms Representing the Current US Population of Male and Female Children and Adolescents Applications to CT Organ Dosimetry

PURPOSE

To assist in the rapid reporting of patient organ doses, researchers at the University of Florida and the National Cancer Institute have developed a family of computational hybrid phantoms, constructed from NURBS and polygon mesh surfaces, that fully represent the ICRP 89 50th percentile reference newborn, 1-year-old, 5-year-old, 10-year-old, 15-year- old male and female, and adult male and female. Coupled with Monte Carlo simulations, these phantoms can be used to estimate patient organ doses. Substantial increases seen in childhood obesity in the United States have prompted us to undergo a major revision to the UF/NCI phantom library.

METHODS

A decision was made to construct the new library in a gridded fashion by height/weight without further reference to age-dependent weight/height percentiles. At each height/weight combination, secondary circumferential parameters are also defined and used for phantom construction. All morphometric data for the new library are taken from the CDC NHANES survey data over the time period 1999 to 2006, the most recent reported survey period. A subset of the phantom library was then used in a CT organ dose sensitivity study to examine the degree to which full Monte Carlo simulations would be required to track organ doses for patients that are severely underweight to obese in body size.

RESULTS

Using primary and secondary parameters, a grid containing 85 pediatric male height/weight bins and a grid containing 73 pediatric female height' weight bins were constructed. These grids will provide the blueprints for later constructing a comprehensive library of patient' dependent phantoms containing 158 pediatric phantoms.

CONCLUSIONS

In the future, the UF/NCI phantom library will be used to construct pre-computed dose libraries for individuals undergoing CT examinations. Ultimately, these libraries can be deployed in the clinic for electronic recording of patient organ dosimetry following diagnostic imaging procedures.

COLIN: Planning with Continuous Linear Numeric Change

In this paper we describe COLIN, a forward-chaining heuristic search planner, capable of reasoning with COntinuous LINear numeric change, in addition to the full temporal semantics of PDDL. Through this work we make two advances to the state-of-the-art in terms of expressive reasoning capabilities of planners: the handling of continuous linear change, and the handling of duration-dependent effects in combination with duration inequalities, both of which require tightly coupled temporal and numeric reasoning during planning. COLIN combines FF-style forward chaining search, with the use of a Linear Program (LP) to check the consistency of the interacting temporal and numeric constraints at each state. The LP is used to compute bounds on the values of variables in each state, reducing the range of actions that need to be considered for application. In addition, we develop an extension of the Temporal Relaxed Planning Graph heuristic of CRIKEY3, to support reasoning directly with continuous change. We extend the range of task variables considered to be suitable candidates for specifying the gradient of the continuous numeric change effected by an action. Finally, we explore the potential for employing mixed integer programming as a tool for optimising the timestamps of the actions in the plan, once a solution has been found. To support this, we further contribute a selection of extended benchmark domains that include continuous numeric effects. We present results for COLIN that demonstrate its scalability on a range of benchmarks, and compare to existing state-of-the-art planners.

Permanent genetic resources added to Molecular Ecology Resources Database 1 August 2011-30 September 2011

This article documents the addition of 299 microsatellite marker loci and nine pairs of single-nucleotide polymorphism (SNP) EPIC primers to the Molecular Ecology Resources (MER) Database. Loci were developed for the following species: Alosa pseudoharengus, Alosa aestivalis, Aphis spiraecola, Argopecten purpuratus, Coreoleuciscus splendidus, Garra gotyla, Hippodamia convergens, Linnaea borealis, Menippe mercenaria, Menippe adina, Parus major, Pinus densiflora, Portunus trituberculatus, Procontarinia mangiferae, Rhynchophorus ferrugineus, Schizothorax richardsonii, Scophthalmus rhombus, Tetraponera aethiops, Thaumetopoea pityocampa, Tuta absoluta and Ugni molinae. These loci were cross-tested on the following species: Barilius bendelisis, Chiromantes haematocheir, Eriocheir sinensis, Eucalyptus camaldulensis, Eucalyptus cladocalix, Eucalyptus globulus, Garra litaninsis vishwanath, Garra para lissorhynchus, Guindilla trinervis, Hemigrapsus sanguineus, Luma chequen. Guayaba, Myrceugenia colchagüensis, Myrceugenia correifolia, Myrceugenia exsucca, Parasesarma plicatum, Parus major, Portunus pelagicus, Psidium guayaba, Schizothorax richardsonii, Scophthalmus maximus, Tetraponera latifrons, Thaumetopoea bonjeani, Thaumetopoea ispartensis, Thaumetopoea libanotica, Thaumetopoea pinivora, Thaumetopoea pityocampa ena clade, Thaumetopoea solitaria, Thaumetopoea wilkinsoni and Tor putitora. This article also documents the addition of nine EPIC primer pairs for Euphaea decorata, Euphaea formosa, Euphaea ornata and Euphaea yayeyamana.

Experience with high frequency oscillation ventilation during the 2009 H1N1 influenza pandemic in Australia and New Zealand

During the 2009 H1N1 pandemic, large numbers of patients had severe respiratory failure. High frequency oscillation ventilation was used as a salvage technique for profound hypoxaemia. Our aim was to compare this experience with high frequency oscillation ventilation during the 2009 H1N1 pandemic with the same period in 2008 by performing a three-month period prevalence study in Australian and New Zealand intensive care units. The main study end-points were clinical demographics, care delivery and survival. Nine intensive care units contributed data. During 2009 there were 22 H1N1 patients (17 adults, five children) and 10 non-H1N1 patients (five adults, five children), while in 2008, 18 patients (two adults, 16 children) received high frequency oscillation ventilation. The principal non-H1N1 high frequency oscillation ventilation indication was bacterial or viral pneumonia (56%). For H1N1 patients, the median duration of high frequency oscillation ventilation was 3.7 days (interquartile range 1.8 to 5) with concomitant therapies including recruitment manoeuvres (22%), prone ventilation (41%), inhaled prostacyclins (18%) and inhaled nitric oxide (36%). Seven patients received extracorporeal membrane oxygenation, six having H1N1. Three patients had extracorporeal membrane oxygenation concurrently, two as salvage therapy following the commencement of high frequency oscillation ventilation. In 2008, no high frequency oscillation ventilation patient received extracorporeal membrane oxygenation. Overall hospital survival was 77% in H1N1 patients, while survival in patients having adjunctive extracorporeal membrane oxygenation was similar to those receiving high frequency oscillation ventilation alone (65% compared to 71%, P = 1.00). Survival rates were comparable to published extracorporeal membrane oxygenation outcomes. High frequency oscillation ventilation was used successfully as a rescue therapy for severe respiratory failure. High frequency oscillation ventilation was only available in a limited number of intensive care units during the H1N1 pandemic.

Altered brain activation and connectivity in early Parkinson disease tactile perception

BACKGROUND AND PURPOSE

Deficits in tactile perception are common in patients with PD. However, the neural mechanisms have not been previously reported in the early stages. This study aims to investigate how the brain activity and connectivity changed under tactile perception at early Parkinsonian state by using functional MR imaging.

MATERIALS AND METHODS

Twenty-one patients with early PD and 22 age- and sex-matched controls were recruited and scanned under a passive tactile stimulation task. Within-group and between-group activation maps were acquired, and regions of interest were defined according to the group-comparison result. This was followed by a functional connectivity analysis based on the graph theory.

RESULTS

We found that in the PD group, bilateral sensorimotor cortex was hypoactive during the task, whereas the hyperactive regions were mainly in bilateral prefrontal cortex, bilateral cerebellum, and contralateral striatum. There was a significant decrease of total connectivity degree in ipsilateral SMA in PD, which was negatively correlated with the Unified Parkinson's Disease Rating Scale score. Furthermore, the connection strengths among the areas of prefrontal cortex, striatum, and cerebellum were increased.

CONCLUSIONS

This study illustrated that early PD was associated with not only altered brain activation but also changed functional connectivity in tactile perception. The most significant impairment was in SMA, whereas striato-prefrontal and cerebello-prefrontal loops may play a compensatory role in early PD tactile function.

Effects of pretreatment with Yisheng injection on renal warm ischemia/reperfusion injury in mice

INTRODUCTION

Due to the organ supply shortage, the donor pool has been expanded to include non-heart-beating donors, where renal warm ischemia/reperfusion (I/R) injury is inevitable. This study was undertaken to determine whether Yisheng injection (YM) could attenuate renal warm I/R injury in mice.

MATERIALS AND METHODS

Male C57BL/6 mice were divided into sham, ischemic, and YM-treated groups using 50 minutes of left kidney ischemia. Mice were humanely killed at 4 or 24 hours postreperfusion. We assayed the effects of YM on liver functional injury, neutrophil recruitment, and proinflammatory mediators after renal I/R injury.

RESULTS

Renal I/R produced dramatic injuries in mouse kidneys. Administration of YM reduced liver function (urea nitrogen of untreated vs treated, 4.7 +/- 0.6 vs 26.6 +/- 1.5 mmol/L; P < .01) and histological injury (histological scores of untreated vs treated, 4.12 +/- 0.14 vs 0.98 +/- 0.07; P < .01). YM at doses of 5, 15, or 25 mg/kg reduced the serum levels of tumor necrosis factor-alpha (TNF-alpha) by about 32.9%, 55.1%, and 74.5%, respectively. Moreover, YM also suppressed the increase in messenger RNA (mRNA) and protein expressions of TNF-alpha and intercellular adhesion molecule-1 (ICAM-1), as well as abrogated neutrophil recruitment in a dose-dependent manner.

CONCLUSION

YM protects murine kidneys from warm I/R injury, probably via decreasing functional injury, reducing neutrophil infiltration, and suppressing the overexpression of proinflammatory mediators and adhesion molecules.

MEK/ERK and p38 MAPK regulate chondrogenesis of rat bone marrow mesenchymal stem cells through delicate interaction with TGF-beta1/Smads pathway

OBJECTIVES

This study was carried out to reveal functions and mechanisms of MEK/ERK and p38 pathways in chondrogenesis of rat bone marrow mesenchymal stem cells (BMSCs), and to investigate further any interactions between the mitogen-activated protein kinase (MAPK) and transforming growth factor-beta1 (TGF-beta1)/Smads pathway in the process.

MATERIALS AND METHODS

Chondrogenic differentiation of rat BMSCs was initiated in micromass culture, in the presence of TGF-beta1, for 2 weeks. ERK1/2 and p38 kinase activities were investigated by Western Blot analysis. Specific MAPK inhibitors PD98059 and SB20350 were employed to investigate regulatory effects of MEK/ERK and p38 signals on gene expression of chondrocyte-specific markers, and TGF-beta1 downstream pathways of Smad2/3.

RESULTS

ERK1/2 was phosphorylated in a rapid but transient manner, whereas p38 was activated in a slow and sustained way. The two MAPK subtypes played opposing roles in mediating transcription of cartilage-specific genes for Col2alpha and aggrecan. TGF-beta1-stimulated gene expression of chondrogenic regulators, Sox9, Runx2 and Ihh, was also affected by activity of PD98059 and SB203580, to different degrees. However, influences of MAPK inhibitors on gene expression were relatively minor when not treated with TGF-beta1. In addition, gene transcription of Smad2/3 was significantly upregulated by TGF-beta1, but was regulated more subtly by treatment with MAPK inhibitors.

CONCLUSIONS

MAPK subtypes seemed to regulate chondrogenesis with a delicate balance, interacting with the TGF-beta1/Smads signalling pathway.

Can CO2 hydrate assist in the underground storage of carbon dioxide?

The sequestration of CO2 in the deep geosphere is one potential method for reducing anthropogenic emissions to the atmosphere without necessarily incurring a significant change in our energy-producing technologies. Containment of CO2 as a liquid and an associated hydrate phase, under cool conditions, offers an alternative underground storage approach compared with conventional supercritical CO2 storage at higher temperatures. We briefly describe conventional approaches to underground storage, review possible approaches for using CO2 hydrate in CO2 storage generally, and comment on the important role CO2 hydrate could play in underground storage. Cool underground storage appears to offer certain advantages in terms of physical, chemical and mineralogical processes, which may usefully enhance trapping of the stored CO2. This approach also appears to be potentially applicable to large areas of sub-seabed sediments offshore Western Europe.

Predictors of short-term outcome in brain-injured patients with disorders of consciousness

OBJECTIVES

To investigate predictors of recovery from the vegetative state (VS) and minimally conscious state (MCS) after brain injury as measured by the widely used Disability Rating Scale (DRS) and to explore differences in rate of recovery and predictors of recovery during inpatient rehabilitation in patients with non-traumatic (NTBI) and traumatic brain injury (TBI).

DESIGN

Longitudinal observational cohort design and retrospective comparison study, in which an initial DRS score was collected at the time of study enrollment. Weekly DRS scores were recorded until discharge from the rehabilitation center for both NTBI and TBI patients.

SETTING

Seven acute inpatient rehabilitation facilities in the United States and Europe with specialized programs for VS and MCS patients (the Consciousness Consortium).

PARTICIPANTS

One hundred sixty-nine patients with a non-traumatic (N=50) and a traumatic (N=119) brain injury who were in the VS or MCS states.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

DRS score at 13 weeks after injury; change in DRS score over 6 weeks post-admission; and time until commands were first followed (for patients who did not show command-following at or within 2 weeks of admission).

RESULTS

Both time between injury and enrollment and DRS score at enrollment were significant predictors of DRS score at week 13 post-injury but the main effect of etiology only approached significance. Etiology was however a significant predictor of the amount of recovery observed over the 6 weeks following enrollment. Time between injury and enrollment was also a good predictor of this outcome, but not DRS score at enrollment. For the time until commands were first followed, patients with better DRS scores at enrollment, and those with faster early rates of change recovered command following sooner than those with worse DRS scores or slower initial rates of change. The etiology was not a significant predictor for this last outcome. None of these predictive models explained sufficient variance to allow their use in individual clinical decision making.

CONCLUSIONS

Time post-injury and DRS score at enrollment are predictors of early recovery among patients with disorders of consciousness, depending on the outcome measure chosen. Etiology was also a significant predictor in some analyses, with traumatically injured patients recovering more than those with non-traumatic injuries. However, the hypothesized interaction between etiology and time post-injury did not reach significance in any of the analyses suggesting that, within the time frame studied, the decline in prognosis with the passage of time was similar in the two groups.

Blood metabolite levels in normal and handicapped pied flycatchers rearing broods of different sizes

We measured levels of select metabolites (glucose, triglycerides, free fatty acids, glycerol, uric acid) and corticosterone in the blood plasma of adult pied flycatchers Ficedula hypoleuca while they were rearing broods whose sizes were modified experimentally. We also made it more difficult than normal for some pairs of birds to forage by removing certain wing and tail feathers (handicapping them). Both procedures have been shown previously to change parental workload. We did this in order to determine if the birds alter their use of nutrients in response to differences in their workload. Metabolite levels were not influenced by handicapping or brood size. However, the concentration of free fatty acids in the plasma of females and of triglycerides in the plasma of males was directly related to the frequency with which the adults fed their nestlings. These findings suggest that the two sexes have different ways of coping with the work associated with rearing the brood: females apparently undergo brief daily fasts while feeding their chicks, whereas males take more time to feed themselves while providing food for their young, and spend more time doing so as their workload increases. The flycatchers exhibited high concentrations of uric acid and corticosterone in the blood plasma; corticosterone and glycerol were positively correlated in females; and corticosterone and triglyceride levels were negatively correlated in males; all of which suggest that gluconeogenesis provides some of the energy required for their parental activities.

Hypoxia/reoxygenation up-regulated the expression of death receptor 5 and enhanced apoptosis in human hepatocyte line

OBJECTIVES

Ischemia-reperfusion injury (IRI) is a key factor that contributes to early and late dysfunction of liver graft. Although we have known that hepatocytes express death receptors for tumor necrosis factor-related apoptosis-inducing ligand (TRAIL), the effects of TRAIL on hypoxia/reoxygenation (H/R)-mediated apoptosis are unclear. This study sought to examine the effects of H/R on TRAIL cytotoxicity, as a cause of primary hepatic graft dysfunction, delayed graft refunction, and chronic graft dysfunction.

METHODS

Using an hepatocyte H/R model in vitro to mimic IRI in the grafted liver, normal human hepatocytes HL-7702 were exposed to hypoxia for 5 hours then reoxygenated for 0, 2, 4, 6, or 20 hours. In another experiment, hepatocytes were exposed to hypoxia for 0, 2, 4, 8, or 20 hours. Expressions of TRAIL-R2/Death receptor 5 (DR5) mRNA were measured by semiquantitative reverse-transcriptase polymerase chain reactions. After 16 hours of hypoxia, human hepatocytes were treated with TRAIL in different concentrations for 5 hours. The death of hepatocytes was confirmed by flow cytometer and methyl thiazolyl tetrazolium analysis.

RESULT

After 5-hour hypoxia, the expressions of DR5 mRNA increased at all times of reoxygenation. DR5 mRNA was up-regulated from 0 hour after reoxygenation, reaching a peak value at 2 hours after reoxygenation compared with the normoxia cultured cells. Moreover, DR5 mRNA was up-regulated gradually following prolonged hypoxia. TRAIL-mediated cell killing was concentration-dependent being greater in the hypoxia treatment group compared to the normoxia group.

CONCLUSIONS

H/R up-regulated the expression of DR5 and enhanced TRAIL-mediated apoptosis in an human hepatocyte line. The TRAIL pathway might play a critical role in hepatocyte apoptosis induced by IRI.

Modelling Mixed Discrete-Continuous Domains for Planning

In this paper we present pddl+, a planning domain description language for modelling mixed discrete-continuous planning domains. We describe the syntax and modelling style of pddl+, showing that the language makes convenient the modelling of complex time-dependent effects. We provide a formal semantics for pddl+ by mapping planning instances into constructs of hybrid automata. Using the syntax of HAs as our semantic model we construct a semantic mapping to labelled transition systems to complete the formal interpretation of pddl+ planning instances. An advantage of building a mapping from pddl+ to HA theory is that it forms a bridge between the Planning and Real Time Systems research communities. One consequence is that we can expect to make use of some of the theoretical properties of HAs. For example, for a restricted class of HAs the Reachability problem (which is equivalent to Plan Existence) is decidable. pddl+ provides an alternative to the continuous durative action model of pddl2.1, adding a more flexible and robust model of time-dependent behaviour.

Heterogeneous nature of the dynamics and glass transition in thin polymer films

Recent experiments have demonstrated that the dynamics in liquids close to and below the glass transition temperature is strongly heterogeneous, on the scale of a few nanometers. We use here a model proposed recently for explaining these features, and show that the heterogeneous nature of the dynamics has important consequences when considering the dynamics of thin films. We show how the dominant relaxation time in a thin film is changed as compared to the bulk, as a function of the thickness, the interaction energy with the substrate, and the temperature. The corresponding time scales cover the so-called VFT (or WLF) regime and vary between 10(-8) s to 10(4) s typically. In the absence of interaction, our model allows for interpreting suspended films experiments, in the case of small polymers for which the data do not depend on the polymer weight. The interaction leads to an increase of T(g) for an interaction per monomer of the order of the thermal energy T. This increase saturates at the value corresponding to strongly interacting films for adsorption energies slightly larger and still of order T. In particular, we predict that the T(g) shift can be non-monotonous as a function of the film thickness, in the case of intermediate interaction strength.