Relative reward preference in primate orbitofrontal cortex

The orbital part of prefrontal cortex appears to be crucially involved in the motivational control of goal-directed behaviour. Patients with lesions of orbitofrontal cortex show impairments in making decisions about the expected outcome of actions. Monkeys with orbitofrontal lesions respond abnormally to changes in reward expectations and show altered reward preferences. As rewards constitute basic goals of behaviour, we investigated here how neurons in the orbitofrontal cortex of monkeys process information about liquid and food rewards in a typical frontal task, spatial delayed responding. The activity of orbitofrontal neurons increases in response to reward-predicting signals, during the expectation of rewards, and after the receipt of rewards. Neurons discriminate between different rewards, mainly irrespective of the spatial and visual features of reward-predicting stimuli and behavioural reactions. Most reward discriminations reflect the animals' relative preference among the available rewards, as expressed by their choice behaviour, rather than physical reward properties. Thus, neurons in the orbitofrontal cortex appear to process the motivational value of rewarding outcomes of voluntary action.     

Lateral habenula as a source of negative reward signals in dopamine neurons

Midbrain dopamine neurons are key components of the brain's reward system, which is thought to guide reward-seeking behaviours. Although recent studies have shown how dopamine neurons respond to rewards and sensory stimuli predicting reward, it is unclear which parts of the brain provide dopamine neurons with signals necessary for these actions. Here we show that the primate lateral habenula, part of the structure called the epithalamus, is a major candidate for a source of negative reward-related signals in dopamine neurons. We recorded the activity of habenula neurons and dopamine neurons while rhesus monkeys were performing a visually guided saccade task with positionally biased reward outcomes. Many habenula neurons were excited by a no-reward-predicting target and inhibited by a reward-predicting target. In contrast, dopamine neurons were excited and inhibited by reward-predicting and no-reward-predicting targets, respectively. Each time the rewarded and unrewarded positions were reversed, both habenula and dopamine neurons reversed their responses as the bias in saccade latency reversed. In unrewarded trials, the excitation of habenula neurons started earlier than the inhibition of dopamine neurons. Furthermore, weak electrical stimulation of the lateral habenula elicited strong inhibitions in dopamine neurons. These results suggest that the inhibitory input from the lateral habenula plays an important role in determining the reward-related activity of dopamine neurons.     

C. elegans odour discrimination requires asymmetric diversity in olfactory neurons

Caenorhabditis elegans senses at least five attractive odours with a single pair of olfactory neurons, AWC, but can distinguish among these odours in behavioural assays. The two AWC neurons are structurally and functionally similar, but the G-protein-coupled receptor STR-2 is randomly expressed in either the left or the right AWC neuron, never in both. Here we describe the isolation of a mutant, ky542, with specific defects in odour discrimination and odour chemotaxis. ky542 is an allele of nsy-1, a neuronal symmetry, or Nsy, mutant in which STR-2 is expressed in both AWC neurons. Other Nsy mutants exhibit discrimination and olfactory defects like those of nsy-1 mutants. Laser ablation of the AWC neuron that does not express STR-2 (AWCOFF) recapitulates the behavioural phenotype of Nsy mutants, whereas laser ablation of the STR-2-expressing AWC neuron (AWCON) causes different chemotaxis defects. We propose that odour discrimination can be achieved by segregating the detection of different odours into distinct olfactory neurons or into unique combinations of olfactory neurons.     

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.     

Synaptic potentiation onto habenula neurons in the learned helplessness model of depression

The cellular basis of depressive disorders is poorly understood. Recent studies in monkeys indicate that neurons in the lateral habenula (LHb), a nucleus that mediates communication between forebrain and midbrain structures, can increase their activity when an animal fails to receive an expected positive reward or receives a stimulus that predicts aversive conditions (that is, disappointment or anticipation of a negative outcome). LHb neurons project to, and modulate, dopamine-rich regions, such as the ventral tegmental area (VTA), that control reward-seeking behaviour and participate in depressive disorders. Here we show that in two learned helplessness models of depression, excitatory synapses onto LHb neurons projecting to the VTA are potentiated. Synaptic potentiation correlates with an animal's helplessness behaviour and is due to an enhanced presynaptic release probability. Depleting transmitter release by repeated electrical stimulation of LHb afferents, using a protocol that can be effective for patients who are depressed, markedly suppresses synaptic drive onto VTA-projecting LHb neurons in brain slices and can significantly reduce learned helplessness behaviour in rats. Our results indicate that increased presynaptic action onto LHb neurons contributes to the rodent learned helplessness model of depression.     

Dopamine responses comply with basic assumptions of formal learning theory.

According to contemporary learning theories, the discrepancy, or error, between the actual and predicted reward determines whether learning occurs when a stimulus is paired with a reward. The role of prediction errors is directly demonstrated by the observation that learning is blocked when the stimulus is paired with a fully predicted reward. By using this blocking procedure, we show that the responses of dopamine neurons to conditioned stimuli was governed differentially by the occurrence of reward prediction errors rather than stimulus-reward associations alone, as was the learning of behavioural reactions. Both behavioural and neuronal learning occurred predominantly when dopamine neurons registered a reward prediction error at the time of the reward. Our data indicate that the use of analytical tests derived from formal behavioural learning theory provides a powerful approach for studying the role of single neurons in learning.     

Odour-plume dynamics influence the brain's olfactory code

The neural computations used to represent olfactory information in the brain have long been investigated. Recent studies in the insect antennal lobe suggest that precise temporal and/or spatial patterns of activity underlie the recognition and discrimination of different odours, and that these patterns may be strengthened by associative learning. It remains unknown, however, whether these activity patterns persist when odour intensity varies rapidly and unpredictably, as often occurs in nature. Here we show that with naturally intermittent odour stimulation, spike patterns recorded from moth antennal-lobe output neurons varied predictably with the fine-scale temporal dynamics and intensity of the odour. These data support the hypothesis that olfactory circuits compensate for contextual variations in the stimulus pattern with high temporal precision. The timing of output neuron activity is constantly modulated to reflect ongoing changes in stimulus intensity and dynamics that occur on a millisecond timescale.     

Ultra-prolonged activation of CO2-sensing neurons disorients mosquitoes

Carbon dioxide (CO(2)) present in exhaled air is the most important sensory cue for female blood-feeding mosquitoes, causing activation of long-distance host-seeking flight, navigation towards the vertebrate host and, in the case of Aedes aegypti, increased sensitivity to skin odours. The CO(2) detection machinery is therefore an ideal target to disrupt host seeking. Here we use electrophysiological assays to identify a volatile odorant that causes an unusual, ultra-prolonged activation of CO(2)-detecting neurons in three major disease-transmitting mosquitoes: Anopheles gambiae, Culex quinquefasciatus and A. aegypti. Importantly, ultra-prolonged activation of these neurons severely compromises their ability subsequently to detect CO(2) for several minutes. We also identify odours that strongly inhibit CO(2)-sensitive neurons as candidates for use in disruption of host-seeking behaviour, as well as an odour that evokes CO(2)-like activity and thus has potential use as a lure in trapping devices. Analysis of responses to panels of structurally related odours across the three mosquitoes and Drosophila, which have related CO(2)-receptor proteins, reveals a pattern of inhibition that is often conserved. We use video tracking in wind-tunnel experiments to demonstrate that the novel ultra-prolonged activators can completely disrupt CO(2)-mediated activation as well as source-finding behaviour in Aedes mosquitoes, even after the odour is no longer present. Lastly, semi-field studies demonstrate that use of ultra-prolonged activators disrupts CO(2)-mediated hut entry behaviour of Culex mosquitoes. The three classes of CO(2)-response-modifying odours offer powerful instruments for developing new generations of insect repellents and lures, which even in small quantities can interfere with the ability of mosquitoes to seek humans.     

A subset of dopamine neurons signals reward for odour memory in Drosophila

Animals approach stimuli that predict a pleasant outcome. After the paired presentation of an odour and a reward, Drosophila melanogaster can develop a conditioned approach towards that odour. Despite recent advances in understanding the neural circuits for associative memory and appetitive motivation, the cellular mechanisms for reward processing in the fly brain are unknown. Here we show that a group of dopamine neurons in the protocerebral anterior medial (PAM) cluster signals sugar reward by transient activation and inactivation of target neurons in intact behaving flies. These dopamine neurons are selectively required for the reinforcing property of, but not a reflexive response to, the sugar stimulus. In vivo calcium imaging revealed that these neurons are activated by sugar ingestion and the activation is increased on starvation. The output sites of the PAM neurons are mainly localized to the medial lobes of the mushroom bodies (MBs), where appetitive olfactory associative memory is formed. We therefore propose that the PAM cluster neurons endow a positive predictive value to the odour in the MBs. Dopamine in insects is known to mediate aversive reinforcement signals. Our results highlight the cellular specificity underlying the various roles of dopamine and the importance of spatially segregated local circuits within the MBs.     

Loss-of-function mutations in sodium channel Nav1.7 cause anosmia

Loss of function of the gene SCN9A, encoding the voltage-gated sodium channel Na(v)1.7, causes a congenital inability to experience pain in humans. Here we show that Na(v)1.7 is not only necessary for pain sensation but is also an essential requirement for odour perception in both mice and humans. We examined human patients with loss-of-function mutations in SCN9A and show that they are unable to sense odours. To establish the essential role of Na(v)1.7 in odour perception, we generated conditional null mice in which Na(v)1.7 was removed from all olfactory sensory neurons. In the absence of Na(v)1.7, these neurons still produce odour-evoked action potentials but fail to initiate synaptic signalling from their axon terminals at the first synapse in the olfactory system. The mutant mice no longer display vital, odour-guided behaviours such as innate odour recognition and avoidance, short-term odour learning, and maternal pup retrieval. Our study creates a mouse model of congenital general anosmia and provides new strategies to explore the genetic basis of the human sense of smell.     

A neural correlate of response bias in monkey caudate nucleus

Primates are equipped with neural circuits in the prefrontal cortex, the parietal cortex and the basal ganglia that predict the availability of reward during the performance of behavioural tasks. It is not known, however, how reward value is incorporated in the control of action. Here we identify neurons in the monkey caudate nucleus that create a spatially selective response bias depending on the expected gain. In behavioural tasks, the monkey had to make a visually guided eye movement in every trial, but was rewarded for a correct response in only half of the trials. Reward availability was predictable on the basis of the spatial position of the visual target. We found that caudate neurons change their discharge rate systematically, even before the appearance of the visual target, and usually fire more when the contralateral position is associated with reward. Strong anticipatory activity of neurons with a contralateral preference is associated with decreased latency for eye movements in the contralateral direction. We conclude that this neuronal mechanism creates an advance bias that favours a spatial response when it is associated with a high reward value.     

Genetic variation in a human odorant receptor alters odour perception

Human olfactory perception differs enormously between individuals, with large reported perceptual variations in the intensity and pleasantness of a given odour. For instance, androstenone (5alpha-androst-16-en-3-one), an odorous steroid derived from testosterone, is variously perceived by different individuals as offensive ("sweaty, urinous"), pleasant ("sweet, floral") or odourless. Similar variation in odour perception has been observed for several other odours. The mechanistic basis of variation in odour perception between individuals is unknown. We investigated whether genetic variation in human odorant receptor genes accounts in part for variation in odour perception between individuals. Here we show that a human odorant receptor, OR7D4, is selectively activated in vitro by androstenone and the related odorous steroid androstadienone (androsta-4,16-dien-3-one) and does not respond to a panel of 64 other odours and two solvents. A common variant of this receptor (OR7D4 WM) contains two non-synonymous single nucleotide polymorphisms (SNPs), resulting in two amino acid substitutions (R88W, T133M; hence 'RT') that severely impair function in vitro. Human subjects with RT/WM or WM/WM genotypes as a group were less sensitive to androstenone and androstadienone and found both odours less unpleasant than the RT/RT group. Genotypic variation in OR7D4 accounts for a significant proportion of the valence (pleasantness or unpleasantness) and intensity variance in perception of these steroidal odours. Our results demonstrate the first link between the function of a human odorant receptor in vitro and odour perception.     

A natural polymorphism alters odour and DEET sensitivity in an insect odorant receptor

Blood-feeding insects such as mosquitoes are efficient vectors of human infectious diseases because they are strongly attracted by body heat, carbon dioxide and odours produced by their vertebrate hosts. Insect repellents containing DEET (N,N-diethyl-meta-toluamide) are highly effective, but the mechanism by which this chemical wards off biting insects remains controversial despite decades of investigation. DEET seems to act both at close range as a contact chemorepellent, by affecting insect gustatory receptors, and at long range, by affecting the olfactory system. Two opposing mechanisms for the observed behavioural effects of DEET in the gas phase have been proposed: that DEET interferes with the olfactory system to block host odour recognition and that DEET actively repels insects by activating olfactory neurons that elicit avoidance behaviour. Here we show that DEET functions as a modulator of the odour-gated ion channel formed by the insect odorant receptor complex. The functional insect odorant receptor complex consists of a common co-receptor, ORCO (ref. 15) (formerly called OR83B; ref. 16), and one or more variable odorant receptor subunits that confer odour selectivity. DEET acts on this complex to potentiate or inhibit odour-evoked activity or to inhibit odour-evoked suppression of spontaneous activity. This modulation depends on the specific odorant receptor and the concentration and identity of the odour ligand. We identify a single amino-acid polymorphism in the second transmembrane domain of receptor OR59B in a Drosophila melanogaster strain from Brazil that renders OR59B insensitive to inhibition by the odour ligand and modulation by DEET. Our data indicate that natural variation can modify the sensitivity of an odour-specific insect odorant receptor to odour ligands and DEET. Furthermore, they support the hypothesis that DEET acts as a molecular 'confusant' that scrambles the insect odour code, and provide a compelling explanation for the broad-spectrum efficacy of DEET against multiple insect species.     

RGS2 regulates signal transduction in olfactory neurons by attenuating activation of adenylyl cyclase III

The heterotrimeric G-protein Gs couples cell-surface receptors to the activation of adenylyl cyclases and cyclic AMP production (reviewed in refs 1, 2). RGS proteins, which act as GTPase-activating proteins (GAPs) for the G-protein alpha-subunits alpha(i) and alpha(q), lack such activity for alpha(s) (refs 3-6). But several RGS proteins inhibit cAMP production by Gs-linked receptors. Here we report that RGS2 reduces cAMP production by odorant-stimulated olfactory epithelium membranes, in which the alpha(s) family member alpha(olf) links odorant receptors to adenylyl cyclase activation. Unexpectedly, RGS2 reduces odorant-elicited cAMP production, not by acting on alpha(olf) but by inhibiting the activity of adenylyl cyclase type III, the predominant adenylyl cyclase isoform in olfactory neurons. Furthermore, whole-cell voltage clamp recordings of odorant-stimulated olfactory neurons indicate that endogenous RGS2 negatively regulates odorant-evoked intracellular signalling. These results reveal a mechanism for controlling the activities of adenylyl cyclases, which probably contributes to the ability of olfactory neurons to discriminate odours.     

Reward value of attractiveness and gaze

Faces are visual objects in our environment that provide strong social cues, with the eyes assuming particular importance. Here we show that the perceived attractiveness of an unfamiliar face increases brain activity in the ventral striatum of the viewer when meeting the person's eye, and decreases activity when eye gaze is directed away. Depending on the direction of gaze, attractiveness can thus activate dopaminergic regions that are strongly linked to reward prediction, indicating that central reward systems may be engaged during the initiation of social interactions.     

Repeated cocaine exposure in vivo facilitates LTP induction in midbrain dopamine neurons

Drugs of abuse are known to cause persistent modification of neural circuits, leading to addictive behaviours. Changes in synaptic plasticity in dopamine neurons of the ventral tegmental area (VTA) may contribute to circuit modification induced by many drugs of abuse, including cocaine. Here we report that, following repeated exposure to cocaine in vivo, excitatory synapses to rat VTA dopamine neurons become highly susceptible to the induction of long-term potentiation (LTP) by correlated pre- and postsynaptic activity. This facilitated LTP induction is caused by cocaine-induced reduction of GABA(A) (gamma-aminobutyric acid) receptor-mediated inhibition of these dopamine neurons. In midbrain slices from rats treated with saline or a single dose of cocaine, LTP could not be induced in VTA dopamine neurons unless GABA-mediated inhibition was reduced by bicuculline or picrotoxin. However, LTP became readily inducible in slices from rats treated repeatedly with cocaine; this LTP induction was prevented by enhancing GABA-mediated inhibition using diazepam. Furthermore, repeated cocaine exposure reduced the amplitude of GABA-mediated synaptic currents and increased the probability of spike initiation in VTA dopamine neurons. This cocaine-induced enhancement of synaptic plasticity in the VTA may be important for the formation of drug-associated memory.     

Innate versus learned odour processing in the mouse olfactory bulb

The mammalian olfactory system mediates various responses, including aversive behaviours to spoiled foods and fear responses to predator odours. In the olfactory bulb, each glomerulus represents a single species of odorant receptor. Because a single odorant can interact with several different receptor species, the odour information received in the olfactory epithelium is converted to a topographical map of multiple glomeruli activated in distinct areas in the olfactory bulb. To study how the odour map is interpreted in the brain, we generated mutant mice in which olfactory sensory neurons in a specific area of the olfactory epithelium are ablated by targeted expression of the diphtheria toxin gene. Here we show that, in dorsal-zone-depleted mice, the dorsal domain of the olfactory bulb was devoid of glomerular structures, although second-order neurons were present in the vacant areas. The mutant mice lacked innate responses to aversive odorants, even though they were capable of detecting them and could be conditioned for aversion with the remaining glomeruli. These results indicate that, in mice, aversive information is received in the olfactory bulb by separate sets of glomeruli, those dedicated for innate and those for learned responses.     

Neuronal filtering of multiplexed odour representations

Neuronal activity patterns contain information in their temporal structure, indicating that information transfer between neurons may be optimized by temporal filtering. In the zebrafish olfactory bulb, subsets of output neurons (mitral cells) engage in synchronized oscillations during odour responses, but information about odour identity is contained mostly in non-oscillatory firing rate patterns. Using optogenetic manipulations and odour stimulation, we found that firing rate responses of neurons in the posterior zone of the dorsal telencephalon (Dp), a target area homologous to olfactory cortex, were largely insensitive to oscillatory synchrony of mitral cells because passive membrane properties and synaptic currents act as low-pass filters. Nevertheless, synchrony influenced spike timing. Moreover, Dp neurons responded primarily during the decorrelated steady state of mitral cell activity patterns. Temporal filtering therefore tunes Dp neurons to components of mitral cell activity patterns that are particularly informative about precise odour identity. These results demonstrate how temporal filtering can extract specific information from multiplexed neuronal codes.     

Perception of sniff phase in mouse olfaction

Olfactory systems encode odours by which neurons respond and by when they respond. In mammals, every sniff evokes a precise, odour-specific sequence of activity across olfactory neurons. Likewise, in a variety of neural systems, ranging from sensory periphery to cognitive centres, neuronal activity is timed relative to sampling behaviour and/or internally generated oscillations. As in these neural systems, relative timing of activity may represent information in the olfactory system. However, there is no evidence that mammalian olfactory systems read such cues. To test whether mice perceive the timing of olfactory activation relative to the sniff cycle ('sniff phase'), we used optogenetics in gene-targeted mice to generate spatially constant, temporally controllable olfactory input. Here we show that mice can behaviourally report the sniff phase of optogenetically driven activation of olfactory sensory neurons. Furthermore, mice can discriminate between light-evoked inputs that are shifted in the sniff cycle by as little as 10 milliseconds, which is similar to the temporal precision of olfactory bulb odour responses. Electrophysiological recordings in the olfactory bulb of awake mice show that individual cells encode the timing of photoactivation in relation to the sniff in both the timing and the amplitude of their responses. Our work provides evidence that the mammalian olfactory system can read temporal patterns, and suggests that timing of activity relative to sampling behaviour is a potent cue that may enable accurate olfactory percepts to form quickly.     

Behavioral and olfactory responses of grasshopper hatchlings,<Emphasis Type="Italic">Melanoplus sanguinipes</Emphasis>, to plant odours and volatile compounds

Behavior and olfactory responses of grasshopper hatchlings, Melanoplus sanguinipes (F.), to odours from plant foliage and volatile compounds were tested using a glass Y-tube olfactometer and electroantennogram (EAG)techniques respectively. In single choice trials, newly hatched hoppers were much more sensitive to the odour from intact leaves and chopped foliage of ryegrass and wheat than other plants. Chopped sorghum leaves, but not stem-cut sorghum,were also significantly attractive. The orientation responses of grasshopper hatchlings to these plants were highly consistent with those of last instar hoppers and adults. When ryegrass was employed as the control, the odour from stem-cut alfalfa was more attractive. There was no significant difference in hopper orientation responses to the odours from chopped seedlings of sorghum, alfalfa, wheat or ryegrass.However, significantly more hoppers preferred the chopped ryegrass control to chopped Louisanna sage. Measurement of the EAG response of first instar hoppers to these plant odours showed that the odour of Louisanna sage elicited the greatest response amplitudes. In olfactory tests using different volatile components, Z-3-hexenol, E-3-hexenol,Z-hex-3-enyl acetate, E-2-hexenal and hexenal gave greater EAG responses than geraniol and 1-octen-3-ol. These results are also consistent with comparable data from adults. Newly hatched grasshoppers had similar EAG response profiles to plant materials and chemicals to those of adults, although the absolute EAG values of young hoppers were much lower than those of adults. Therefore, newly hatched hoppers were able to distinguish plants from an air control, and even host plants from non-host plants, and the feeding experience of hoppers probably has little influence on their subsequent ability as adults to identify and locate food plants.