A single population of olfactory sensory neurons mediates an innate avoidance behaviour in Drosophila

All animals exhibit innate behaviours in response to specific sensory stimuli that are likely to result from the activation of developmentally programmed neural circuits. Here we observe that Drosophila exhibit robust avoidance to odours released by stressed flies. Gas chromatography and mass spectrometry identifies one component of this 'Drosophila stress odorant (dSO)' as CO2. CO2 elicits avoidance behaviour, at levels as low as 0.1%. We used two-photon imaging with the Ca2+-sensitive fluorescent protein G-CaMP to map the primary sensory neurons governing avoidance to CO2. CO2 activates only a single glomerulus in the antennal lobe, the V glomerulus; moreover, this glomerulus is not activated by any of 26 other odorants tested. Inhibition of synaptic transmission in sensory neurons that innervate the V glomerulus, using a temperature-sensitive Shibire gene (Shi(ts)), blocks the avoidance response to CO2. Inhibition of synaptic release in the vast majority of other olfactory receptor neurons has no effect on this behaviour. These data demonstrate that the activation of a single population of sensory neurons innervating one glomerulus is responsible for an innate avoidance behaviour in Drosophila.     

Temporal difference models describe higher-order learning in humans

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.     

Cortical substrates for exploratory decisions in humans

Decision making in an uncertain environment poses a conflict between the opposing demands of gathering and exploiting information. In a classic illustration of this 'exploration-exploitation' dilemma, a gambler choosing between multiple slot machines balances the desire to select what seems, on the basis of accumulated experience, the richest option, against the desire to choose a less familiar option that might turn out more advantageous (and thereby provide information for improving future decisions). Far from representing idle curiosity, such exploration is often critical for organisms to discover how best to harvest resources such as food and water. In appetitive choice, substantial experimental evidence, underpinned by computational reinforcement learning (RL) theory, indicates that a dopaminergic, striatal and medial prefrontal network mediates learning to exploit. In contrast, although exploration has been well studied from both theoretical and ethological perspectives, its neural substrates are much less clear. Here we show, in a gambling task, that human subjects' choices can be characterized by a computationally well-regarded strategy for addressing the explore/exploit dilemma. Furthermore, using this characterization to classify decisions as exploratory or exploitative, we employ functional magnetic resonance imaging to show that the frontopolar cortex and intraparietal sulcus are preferentially active during exploratory decisions. In contrast, regions of striatum and ventromedial prefrontal cortex exhibit activity characteristic of an involvement in value-based exploitative decision making. The results suggest a model of action selection under uncertainty that involves switching between exploratory and exploitative behavioural modes, and provide a computationally precise characterization of the contribution of key decision-related brain systems to each of these functions.     

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.     

Diving insects boost their buoyancy bubbles

Backswimmers (Notonectidae) are common diving insects found around the world that exploit the mid-water zone for predation--they breathe by using an air bubble collected at the surface. Here we show that backswimmers achieve prolonged periods of neutral buoyancy by using oxygen stored in their haemoglobin to stabilize the volume of the bubble as they breathe from it. This enables them to maintain their position in the water column without continually swimming.     

Environmental biology: heat reward for insect pollinators

In neotropical forests, adults of many large scarab beetle species spend most of their time inside the floral chambers of heat-producing flowers, where they feed and mate throughout the night and rest during the following day, before briefly flying to another flower. Here we measure floral temperatures in Philodendron solimoesense (Araceae) in French Guiana and the respiration rates of Cyclocephala colasi beetles at floral and ambient temperatures, and show that the the beetles' extra energy requirements for activity are 2.0-4.8 times greater outside the flower than inside it. This finding indicates that heat produced by the flower constitutes an important energy reward to pollinators, allowing them to feed and mate at a fraction of the energy cost that would be required outside the flower.