View source for Philosophy:Pavlovian-instrumental transfer

'''Pavlovian-instrumental transfer''' ('''PIT''') is a [[Social:Psychology|psychological]] phenomenon that occurs when a conditioned stimulus (CS, also known as a "cue") that has been associated with [[Philosophy:Reward system|rewarding]] or [[Philosophy:Aversives|aversive]] [[Philosophy:Stimulus (psychology)|stimuli]] via [[Philosophy:Classical conditioning|classical conditioning]] alters [[Philosophy:Motivational salience|motivational salience]] and operant behavior.<ref name="Pavlovian-instrumental transfer review" /><ref name="Aversive PIT in humans - review">{{cite journal | vauthors = Geurts DE, Huys QJ, den Ouden HE, Cools R | title = Aversive Pavlovian control of instrumental behavior in humans | journal = Journal of Cognitive Neuroscience | volume = 25 | issue = 9 | pages = 1428–1441 | date = September 2013 | pmid = 23691985 | doi = 10.1162/jocn_a_00425 | s2cid = 6453291 | url = https://www.zora.uzh.ch/id/eprint/90321/1/Geurts_et_al_Aversive_Pavlovian-control.pdf }}</ref><ref name="Pavlovian-instrumental transfer of reward - review">{{cite journal | vauthors = Cartoni E, Balleine B, Baldassarre G | title = Appetitive Pavlovian-instrumental Transfer: A review | journal = Neuroscience and Biobehavioral Reviews | volume = 71 | pages = 829–848 | year = 2016 | pmid = 27693227 | doi = 10.1016/j.neubiorev.2016.09.020 | quote = This paper reviews one of the experimental paradigms used to study the effects of cues, the Pavlovian to Instrumental Transfer paradigm. In this paradigm, cues associated with rewards through Pavlovian conditioning alter motivation and choice of instrumental actions.&nbsp;... Predictive cues are an important part of our life that continuously influence and guide our actions. Hearing the sound of a horn makes us stop before we attempt to cross the street. Seeing an advertisement for fast food might make us hungry and lead us to seek out a specific type and source of food. In general, cues can both prompt us towards or stop us from engaging in a certain course of action. They can be adaptive (saving our life in crossing the street) or maladaptive, leading to suboptimal choices, e.g. making us eat when we are not really hungry (Colagiuri and Lovibond, 2015). In extreme cases they can even play a part in pathologies such as in addiction, where drug associated cues produce craving and provoke relapse (Belin et al., 2009).| url = http://puma.isti.cnr.it/rmydownload.php?filename=cnr.istc/cnr.istc/2016-A0-037/2016-A0-037.pdf | doi-access = free }}</ref><ref name="Mesolimbic computation of reward motivation review">{{cite journal | vauthors = Berridge KC | title = From prediction error to incentive salience: mesolimbic computation of reward motivation | journal = Eur. J. Neurosci. | volume = 35 | issue = 7 | pages = 1124–1143 | date = April 2012 | pmid = 22487042 | pmc = 3325516 | doi = 10.1111/j.1460-9568.2012.07990.x | quote = Incentive salience or ‘wanting’ is a specific form of Pavlovian-related motivation for rewards mediated by mesocorticolimbic brain systems&nbsp;...Incentive salience integrates two separate input factors: (1) current physiological neurobiological state; (2) previously learned associations about the reward cue, or Pavlovian CS&nbsp;...<br />Cue-triggered ‘wanting’ for the UCS<br />A brief CS encounter (or brief UCS encounter) often primes a pulse of elevated motivation to obtain and consume more reward UCS. This is a signature feature of incentive salience. In daily life, the smell of food may make you suddenly feel hungry, when you hadn’t felt that way a minute before. In animal neuroscience experiments, a CS for reward may trigger a more frenzied pulse of increased instrumental efforts to obtain that associated UCS reward in situations that purify the measurement of incentive salience, such as in Pavlovian-Instrumental Transfer (PIT) experiments&nbsp;... Similarly, including a CS can often spur increased consumption of a reward UCS by rats or people, compared to consumption of the same UCS when CSs are absent&nbsp;... Thus Pavlovian cues can elicit pulses of increased motivation to consume their UCS reward, whetting and intensifying the appetite. However, the motivation power is never simply in the cues themselves or their associations, since cue-triggered motivation can be easily modulated and reversed by drugs, hungers, satieties, etc., as discussed below.}}</ref> Two distinct forms of Pavlovian-instrumental transfer have been identified in humans and other animals&nbsp;– '''specific PIT''' and '''general PIT'''&nbsp;– with unique [[Biology:Neural substrate|neural substrate]]s mediating each type.<ref name="Pavlovian-instrumental transfer review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /><ref name="Mesolimbic dopamine in motivation and PIT">{{cite book | vauthors = Salamone JD, Pardo M, Yohn SE, López-Cruz L, SanMiguel N, Correa M | title = Behavioral Neuroscience of Motivation | chapter = Mesolimbic Dopamine and the Regulation of Motivated Behavior | journal = Current Topics in Behavioral Neurosciences | volume = 27 | pages = 231–257 | year = 2016 | pmid = 26323245 | doi = 10.1007/7854_2015_383 | quote = Considerable evidence indicates that accumbens DA is important for Pavlovian approach and Pavlovian-to-instrumental transfer [(PIT)]&nbsp;... PIT is a behavioral process that reflects the impact of Pavlovian-conditioned stimuli (CS) on instrumental responding. For example, presentation of a Pavlovian CS paired with food can increase output of food-reinforced instrumental behaviors, such as lever pressing. Outcome-specific PIT occurs when the Pavlovian unconditioned stimulus (US) and the instrumental reinforcer are the same stimulus, whereas general PIT is said to occur when the Pavlovian US and the reinforcer are different.&nbsp;... More recent evidence indicates that accumbens core and shell appear to mediate different aspects of PIT; shell lesions and inactivation reduced outcome-specific PIT, while core lesions and inactivation suppressed general PIT (Corbit and Balleine 2011). These core versus shell differences are likely due to the different anatomical inputs and pallidal outputs associated with these accumbens subregions (Root et al. 2015). These results led Corbit and Balleine (2011) to suggest that accumbens core mediates the general excitatory effects of reward-related cues. PIT provides a fundamental behavioral process by which conditioned stimuli can exert activating effects upon instrumental responding| isbn = 978-3-319-26933-7 }}</ref> In relation to rewarding stimuli, specific PIT occurs when a CS is associated with a specific rewarding stimulus through classical conditioning and subsequent exposure to the CS enhances an operant response that is directed toward the same reward with which it was paired (i.e., it promotes approach behavior).<ref name="Pavlovian-instrumental transfer review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /><ref name="Mesolimbic dopamine in motivation and PIT" /> General PIT occurs when a CS is paired with one reward and it enhances an operant response that is directed toward a different rewarding stimulus.<ref name="Pavlovian-instrumental transfer review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /><ref name="Mesolimbic dopamine in motivation and PIT" />
An example of specific PIT, as described by a neuroscience review on Pavlovian-instrumental transfer from 2013,<ref name="Pavlovian-instrumental transfer review" /> is as follows: <blockquote>In a typical experimental scenario a rat is trained to associate a sound (CS) with the delivery of food. Later, the rat undergoes an instrumental training where it learns to press a lever to get some food (without the sound being present). Finally, the rat is presented again with the opportunity to press the lever, this time both in the presence and absence of the sound. The results show that the rat will press the lever more in the presence of the sound than without, even if the sound has not been previously paired with lever pressing. The Pavlovian sound-food association learned in the first phase has somehow transferred to the instrumental situation, hence the name 'Pavlovian-instrumental transfer'.<ref name="Pavlovian-instrumental transfer review" /></blockquote>

==Specific and general transfer==
In relation to rewarding stimuli, specific PIT occurs when a CS is associated with a specific rewarding stimulus through classical conditioning and subsequent exposure to the CS enhances an operant response that is directed toward the same reward with which it was paired (i.e., it promotes approach behavior).<ref name="Pavlovian-instrumental transfer review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /><ref name="Mesolimbic dopamine in motivation and PIT" /> General PIT occurs when a CS is paired with one reward and it enhances an operant response that is directed toward a different rewarding stimulus.<ref name="Pavlovian-instrumental transfer review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /><ref name="Mesolimbic dopamine in motivation and PIT" /> Neurobiological state factors (e.g., [[Medicine:Appetite|appetite]] and [[Biology:Satiety|satiety]] states, [[Medicine:Psychological stress|stress level]], drug states such as intoxication and [[Medicine:Drug withdrawal|withdrawal]], etc.), and particularly the motivational state of an animal, strongly affect the amount of appetitive motivational salience (i.e., incentive salience) that a ''reward cue''{{#tag:ref|A "reward cue" is a conditioned stimulus (CS) that has been paired with a rewarding stimulus via classical conditioning.<ref name="Mesolimbic computation of reward motivation review" />|group="note"}} confers to an associated rewarding stimulus via Pavlovian-instrumental transfer.<ref name="Pavlovian-instrumental transfer review" /><ref name="Mesolimbic computation of reward motivation review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /> Acute stress amplifies the motivational salience that reward cues confer to rewarding stimuli through both specific and general PIT;<ref name="Learning+Motivation in PIT - neural mechanisms review" /> however, chronic stress reduces the motivational impact reward cues.<ref name="Learning+Motivation in PIT - neural mechanisms review" />

Specific PIT and general PIT also occur with aversive stimuli and are defined analogously.<ref name="Aversive PIT in humans - review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /> Specific PIT with an aversive stimulus occurs when a CS is paired with an aversive stimulus and subsequent exposure to the CS enhances an operant response that is directed away from the aversive stimulus with which it was paired (i.e., it promotes escape and avoidance behavior).<ref name="Aversive PIT in humans - review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /> General PIT with an aversive stimulus occurs when a CS is paired with one aversive stimulus and it enhances an operant response that is directed away from a different aversive stimulus.<ref name="Aversive PIT in humans - review" /><ref name="Learning+Motivation in PIT - neural mechanisms review">{{cite book | vauthors = Corbit LH, Balleine BW | title = Learning and Motivational Processes Contributing to Pavlovian-Instrumental Transfer and Their Neural Bases: Dopamine and Beyond | journal = Current Topics in Behavioral Neurosciences | volume = 27 | pages = 259–289 | date = 2016 | pmid = 26695169 | doi = 10.1007/7854_2015_388 | quote = Such effects suggest that specific motivational states gate the arousing effects of Pavlovian incentives processes on instrumental performance&nbsp;... Behavioral findings are supported by evidence that distinct neural circuits centered on the NAc core and shell mediate the general and specific forms of transfer, respectively&nbsp;... Finally, stress has been shown to increase the magnitude of transfer effects, particularly general transfer, suggesting a shift in cognitive control under stress conditions.&nbsp;... corticotropin-releasing factor (CRF) administered directly into the NAc shell enhances transfer in a dose-dependent fashion without affecting baseline lever-press performance (Pecina et al. 2006), suggesting that CRF amplifies the motivational impact of cued rewards in much the same manner as dopamine.&nbsp;... In general, acute treatments seem to enhance transfer effects, whereas chronic treatments decrease transfer| isbn = 978-3-319-26933-7 }}</ref>

==Neural substrates==

Based on studies of rats that involved PIT with rewards, it has been found that specific PIT is mediated by the nucleus accumbens shell and basolateral amygdala, while general PIT is mediated by the nucleus accumbens core and [[Medicine:Central nucleus of the amygdala|central amygdala]].<ref name="Pavlovian-instrumental transfer review" /><ref name="Mesolimbic dopamine in motivation and PIT" /> Studies on humans, which employed neuroimaging during PIT experiments with rewards, appear to be consistent with these findings.<ref name="Pavlovian-instrumental transfer review">{{cite journal | vauthors = Cartoni E, Puglisi-Allegra S, Baldassarre G | title = The three principles of action: a Pavlovian-instrumental transfer hypothesis | journal = Frontiers in Behavioral Neuroscience | volume = 7 | pages = 153 | date = November 2013 | pmid = 24312025 | pmc = 3832805 | doi = 10.3389/fnbeh.2013.00153 | doi-access = free }}</ref>

==Clinical significance==

===Addiction===
Due to the effect of reward cues and Pavlovian-instrumental transfer on the amplification of incentive salience for rewarding stimuli, PIT is believed to be one of the mechanisms responsible for producing "cue-triggered wanting", or craving, for a drug that occurs when an individual with a drug addiction is exposed to drug cues{{#tag:ref|Drug cues are environmental contexts, situations, and objects which have been repeatedly associated with drug use through classical conditioning.|group="note"}} even after long periods of abstinence.<ref name="Mesolimbic computation of reward motivation review" /><ref name="Learning+Motivation in PIT - neural mechanisms review" /><ref name="Preclinical PIT and incentive salience in addiction review">{{cite journal | vauthors = Lamb RJ, Schindler CW, Pinkston JW | title = Conditioned stimuli's role in relapse: preclinical research on Pavlovian-Instrumental-Transfer | journal = Psychopharmacology | volume = 233 | issue = 10 | pages = 1933–1944 | date = May 2016 | pmid = 26800688 | pmc = 4863941 | doi = 10.1007/s00213-016-4216-y | quote = Pavlovian learning plays a central role in many theories of addiction, particularly with regard to relapse. In broad terms, encountering drug-paired CSs are hypothesized to precipitate relapse, often, though not always, by increasing motivation to take drugs. Presumably, if a drug-paired CS increases motivation to take drugs, then a drug-paired CS should increase drug consumption.}}</ref> For example, anti-drug agencies previously used posters with images of drug paraphernalia&nbsp;– which is a type of drug cue –&nbsp;as an attempt to show the dangers of drug use. However, such posters are no longer used because of the effect of incentive salience in causing cravings and relapse upon sight of the stimuli illustrated in the posters.

===Dieting===
The sight or smell of food which one has consumed and enjoyed in the past can elicit hunger (i.e., the motivation to eat) in humans, an effect which is presumably mediated through PIT.<ref name="Pavlovian-instrumental transfer of reward - review" /><ref name="Mesolimbic computation of reward motivation review" /><ref name="Mesolimbic dopamine in motivation and PIT" /> In PIT experiments with rats, the presentation of a conditioned stimulus which has been paired with food has been shown to increase instrumental actions that have been reinforced by food, such as pressing a lever which leads to the delivery of a food pellet.<ref name="Mesolimbic dopamine in motivation and PIT" />

==See also==
{{col-list|colwidth=30em|
*Associative learning
*[[Philosophy:Classical conditioning|Classical conditioning]]
*[[Philosophy:Operant conditioning|Operant conditioning]]
*[[Philosophy:Motivational salience|Motivational salience]]
*[[Philosophy:Reward system|Reward system]]
}}

==Notes==
{{Reflist|group=note}}

==References==
{{reflist|30em}}

[[Category:Behavioral concepts]]
[[Category:Behaviorism]]
[[Category:Cognition]]
[[Category:Cognitive psychology]]
[[Category:Motivation]]

{{Sourceattribution|Pavlovian-instrumental transfer}}