INTRODUCTION

Although dopamine's specific contributions to motivated behavior continue to be debated (Dickinson et al, 2000; Berridge and Robinson, 2003; Wise, 2008; Nicola, 2010; Schultz, 2010; Glimcher, 2011), a large body of work has demonstrated its role in overcoming effort, and other forms of response cost, during the pursuit of reward (Walton et al, 2006; Salamone et al, 2007; Floresco et al, 2008b; Beeler et al, 2010). This is exemplified by the alterations in effortful reward-seeking behaviors brought about by treatments that disrupt or augment dopamine signaling (Beeler et al, 2010; Cousins and Salamone, 1994; Lindner et al, 1997; Aberman and Salamone, 1999; Hamill et al, 1999; Salamone et al, 2001; Mingote et al, 2005; Salamone et al, 1991, 1994a, 2007; Zhang et al, 2003). These findings are complemented by reports that task-related changes in extracellular dopamine levels vary with response cost (Sokolowski et al, 1998; Walton et al, 2006; Day et al, 2010; Wanat et al, 2010; Nasrallah et al, 2011; Ostlund et al, 2011).

Contemporary theories have addressed such findings by assigning dopamine a response-activating function; it is assumed that the amount of dopamine released determines the vigor of reward seeking, increasing the likelihood that more effortful or costly response options will be chosen (Robbins et al, 1998; Dickinson et al, 2000; Berridge and Robinson, 2003; Niv et al, 2007; Phillips et al, 2007; Salamone et al, 2007). Consistent with this account, recent studies have shown that anticipatory (pre-response) dopamine cell firing (Satoh et al, 2003) and mesolimbic dopamine release (Wassum et al, 2012) correlate with the vigor of reward seeking behavior.

One fundamental issue that must be resolved to improve our general understanding of cost/benefit decision-making and dopamine's role in this process is how response costs are evaluated. A common simplifying assumption is that these costs are absolute, fixed by the intrinsic properties of the action itself (in the case of effort), or the negative consequences of the action (eg, delayed reinforcement or punishment). However, behavioral findings suggest that such costs are evaluated in both absolute and relative terms, taking into account information about the cost of alternative options and/or the expected costs of a potential action based on previous experience. As evidence for the latter, rats lever pressing for food reward on a low (response-to-reward) ratio schedule of reinforcement will struggle to maintain their performance if the ratio schedule is suddenly increased—a phenomenon known as ratio strain—even though the same high ratio schedule would tend to encourage an even higher response rate if it were introduced more gradually. There is some evidence that dopamine's involvement in reward seeking involves processing relative response costs. For instance, rats pretrained to lever press on a high effort schedule (fixed ratio (FR)-300) before receiving dopamine deleting lesions of the nucleus accumbens exhibited a modest suppression of responding when tested on a less effortful schedule (FR-5), compared with deficits observed in rats not exposed to a high-effort pretraining condition (Salamone et al, 1993a, 1993b, 2001; Aberman and Salamone, 1999). This suggests that expecting a high cost may lead to underestimation of more moderate costs, decreasing the dopamine dependence of responding.

In the current study we investigate dopamine's role in overcoming relative rather than absolute response costs (see Figure 1). The basic design of the study involved training rats to lever press for food reward on either a high (FR-20), moderate (FR-10), or low (FR-1) cost reinforcement schedule before testing them under varying doses (0, 0.075, or 0.225 mg/kg) of the nonspecific dopamine receptor antagonist flupentixol. Importantly, for these initial tests, all rats were shifted to the moderate cost schedule. Thus, the response cost at test was lower (FR-20/FR-10), higher (FR-1/FR10), or no different (FR-10/FR-10) than what should have been expected based on their recent training history. A second round of tests was conducted to assess the effects of flupentixol on reward seeking with rats reinforced on their maintenance schedules, which differed in absolute response costs. Our findings demonstrate that dopamine is critical for adapting to relative and absolute response costs.

Figure 1
figure 1

Outline of experimental procedures. During initial lever press training, rats were gradually shifted from a low-effort (fixed ratio (FR)-1) to an intermediate-effort (FR-10) reinforcement schedule. Different groups (n=12) were then given maintenance training using either an FR-1, FR-10, or FR-20 (high-effort) schedule. Rats then received a series of tests (separated by maintenance schedule retraining) in which we assessed the effects of flupentixol pretreatment (0.000, 0.075, and 0.225 mg/kg; i.p.). During relative cost testing, lever pressing was reinforced using the FR-10 for all rats, which represented an upshift in effort for group FR-1 and a downshift for group FR-20. During absolute cost testing, rats were reinforced using their maintenance schedules.

PowerPoint slide

SUBJECTS AND METHODS

Subjects and Apparatus

Thirty-six adult (90 days) Sprague Dawley male rats (Charles Rivers Laboratories, Wilmington, MA) were used as subjects. They were group housed in transparent plastic cages (2–3 per cage) with corncob bedding in a temperature and humidity controlled vivarium. Experimental procedures were conducted during the light phase of a 12-h/12 h light/dark cycle. Throughout training and testing, the rats were kept on a food deprivation regimen to maintain them at 85% of their free-feeding body weight, giving each rat between 10 and 14 g of home chow per day after their daily training/testing sessions. Tap water was continuously available in the home cages. All procedures are in compliance with the National Research Council's Guide for the Care and Use of Laboratory Animals and were authorized by the institutional animal care and use committee of UCLA.

Behavioral procedures took place in eight identical Med Associates operant chambers (East Fairfield, VT), each equipped with a retractable lever located to the left of a recessed food cup that received deliveries of 45 mg grain-based food pellets (Bioserv, Frenchtown, NJ). A photobeam detector was used to monitor food cup approaches. A houselight (24 V, 2 W) positioned at the center-top of the opposite wall provided illumination during all experimental sessions.

Behavioral Training

Rats were initially given a 90-min magazine training session in which pellets were non-contingently delivered on a random time 5-min schedule. They were then given 11 days of instrumental conditioning. On each day, the rats were placed in the chamber and the lever was inserted, which the rats could press to earn food pellets. Sessions ended after 30 pellets were earned or 30 min had elapsed, whichever came first. Session length served as the primary measure of responding, with shorter session times indicating more vigorous task performance. Over the first seven sessions, all rats were shifted through increasingly more effortful ratio schedules, earning a pellet with every press (FR-1) on days 1–2, every 5 presses (FR-5) on days 3–4, and every 10 presses (FR-10) on days 5–7. This initial training was used to ensure that all rats were experienced in responding on the FR-10 schedule, which would be used again during testing. Separate groups of rats (n=12) were then given an additional four sessions of training with either a more effortful schedule (FR-20), the same schedule (FR-10), or a less effortful schedule (FR-1).

Relative Response Cost Testing

After initial training, the rats were given the first of three tests to assess the effects of systemic dopamine receptor blockade on their lever press performance. Two hours before each test, rats were given an injection (i.p., 1.0 ml/kg) of 0.0, 0.075, or 0.225 mg/kg of the nonspecific dopamine receptor antagonist flupentixol (Sigma Aldrich, St Louis, MO) mixed in sterile saline. Each rat received one test under each of the three treatments, counterbalancing test order across training groups with a latin square design. Similar to the training sessions, test sessions ended after 30 pellets had been earned or 30 min had elapsed, whichever came first. However, during this round of testing, all subjects were reinforced on the moderate-effort FR-10 schedule. Rats were given a day off after each test and were then given 3 days of retraining on their maintenance schedules (FR-1, FR-10, or FR-20) before the next test session. They were then given an additional round of retraining before undergoing absolute response cost testing.

Absolute Response Cost Testing

Rats were given a series of three tests under vehicle, low and high dose flupentixol to assess the impact of dopamine receptor blockade on reward seeking while maintained on schedules varying in absolute response cost. These tests were conducted using the same basic procedures used during relative response cost testing, including treatment order, except that lever pressing was reinforced using each rats’ maintenance training schedule at test. Again, rats were given a day off followed by 3 days of retraining between tests.

RESULTS

Initial Lever Press Training

All rats learned to lever press for food pellets over the first 7 days of training, when all groups were shifted through the same series of ratio schedules (Figure 2—days 1–7). Not surprisingly, the increasing response requirements associated with these schedules resulted in longer sessions times (Figure 2; top panel). A mixed ANOVA (session × group) detected a main effect of session (F6,198=29.62; p<0.001), but found no effect of group (F1,33=0.328; p>0.05) or group × session interaction (F12,198=0.850; p>0.05). However, for each new ratio schedule, the time it took rats to complete the session decreased over days; we detected a significant effect of session for FR-1 training (F1,35=79.84; p<0.001), FR-5 training (F1,35=15.53; p<0.001), and FR-10 training (F2,70=6.544; p<0.01). Rats appeared to learn to perform the task more efficiently (measured as the average number of presses performed before a rat checked the food cup) with practice (Figure 2; bottom panel). During FR-1 training, when each press resulted in a food pellet delivery, the rats displayed an appropriately low ratio of press-to-food cup approaches, indicating that they were, for the most part, checking the food cup after each press. However, such a low ratio is not compatible with rapid collection of food pellets when higher ratio schedules are in place as premature approaches waste time and effort. The rats adapted to changes in response demand appropriately, increasing their ratio of press-to-approaches. This was confirmed by an ANOVA (session × group), which found a main effect of session (F6,198=114.397; p<0.001) but no effect of group (F1,33=0.098; p>0.05) or interaction between these variables (F12,198=0.207; p>0.05).

Figure 2
figure 2

Instrumental training results, plotted separately for groups fixed ratio (FR)-1, FR-10, and FR-20. Top panel, mean session length (seconds; ±SEM) during initial lever press training (sessions 1–7) and maintenance training (sessions 8–11). Bottom panel, mean ratio of lever presses to food cup approaches (±SEM) during training sessions.

PowerPoint slide

Maintenance Schedule Training

Separate groups of rats were then given 4 days of training on different maintenance schedules: either FR-1, FR-10, or FR-20 (Figure 2—days 8–11). The new schedules had an immediate impact on the amount of time it took rats to earn 30 pellets. An ANOVA (session × group) found a significant main effect of group (F1,33=65.071; p<0.001), but found no effect of session (F3,99=1.24; p>0.05) or group × session interaction (F6,99=1.885; p=0.09). Bonferroni post hoc analysis confirmed that group FR-20 took longer than group FR-10 (p<0.001) and group FR-1 (p<0.001), and that group FR-10 took significantly longer than FR-1 (p<0.001). As during initial training, the response requirement of the maintenance schedule caused rats to adapt their food cup checking behavior, reflected in their ratio of press-to-food cup approaches (Figure 2; bottom panel). An ANOVA found main effects for group (F2,33=37.613; p<0.001) and session (F3,99=6.180; p<0.001), as well as a significant group × session interaction (F6,99=2.651; p<0.05), indicating that their behavior continued to adapt over days. Post hoc testing found that group FR-1 displayed a lower ratio than groups FR-10 (p<0.001) or FR-20 (p<0.001), which was appropriate given the former group's minimal response requirement. Interestingly, Groups FR-10 and FR-20 did not significantly differ from one another (p>0.05), even though group FR-20 had to press twice as much as group FR-10 for each reward. This premature checking behavior may have been encouraged by the absence of any explicit signal for food pellet deliveries.

Relative Response Cost Testing

We then conducted a series of tests to determine if the suppressive effect of dopamine receptor blockade on reward seeking is primarily dependent on the absolute cost of responding at test or whether this relationship is modulated by subjects’ expectations about response cost based on their pretraining. During these tests all rats were reinforced on the same FR-10 schedule, such that the absolute amount of effort needed to earn reward was identical across groups. However, the relative cost of responding differed across groups: compared with their maintenance schedule, group FR-1/FR-10 experienced an upshift in cost, group FR-20/FR-10 experienced a downshift in cost, and group FR-10/FR-10 experienced no shift in cost.

Consistent with the relative cost hypothesis, we found that these groups were differentially sensitive to the suppressive effects of the dopamine receptor antagonist flupentixol (Figure 3). An ANOVA performed on the time it took rats to complete the test session found a significant main effect of treatment (F2,66=14.361; p<0.001), a marginally insignificant effect of training group (F2,33=2.670; p=0.084), and a significant treatment × group interaction (F4,66=3.17; p<0.05). Bonferroni post-hoc comparisons of mean session lengths during the saline test did not detect any significant differences between groups (p>0.05), indicating that rats rapidly adapted their performance to the FR-10 schedule used at test. Individual repeated-measures ANOVAs, conducted separately for each group, found that flupentixol treatment significantly increased session lengths in group FR-1/FR-10 (F2,22=10.74; p<0.001), which experienced an upshift in cost, and in group FR-10/FR-10 (F2,22=4.169; p<0.05), the unshifted control condition. A mixed treatment × group ANOVA performed on the data from these two groups detected a significant treatment × group interaction (F2,44=5.073; p<0.05). Analysis of the effect sizes for each group confirmed that the disruptive effect of flupentixol was greater in group FR-1/FR-10 (η2=0.494) than in FR-10/FR-10 (η2=0.298). Although flupentixol treatment resulted in a similar numerical trend in the mean session lengths in group FR-20/FR-10, a repeated measures ANOVA found no effect of treatment in this group (F2,22=0.993; p>0.05), and effects size analysis found that flupentixol treatment accounted for an appreciably smaller amount of the total variance in their session lengths (η2=0.083) than in either of the other groups, indicating that the downshift in response cost protected them from the suppressive effects of flupentixol.

Figure 3
figure 3

Relative response costs modulate the suppressive effects of dopamine receptor blockade on reward seeking. Rats were pretreated with different doses of flupentixol before each of three test sessions on the intermediate-effort (fixed ratio (FR)-10) task. Relative to their maintenance schedule, the amount of effort need to earn reward was shifted up for group FR-1/FR-10 and down for group FR-20/FR-10, but remained the same for group FR-10/FR-10. Top panel, mean session length (seconds; ±SEM). Bottom panel, mean ratio of lever presses to food cup approaches (±SEM). Asterisks indicate significant treatment effects: *for p<0.05, ***for p<0.001.

PowerPoint slide

The pattern of food cup checking behavior appeared to depend on the rats’ training history. Even though all rats were reinforced every 10 presses, the ratio of press-to-food cup approaches varied across groups, presumably resulting in differences in task efficiency. An ANOVA found a main effect of group (F2,33=7.737; p<0.001) but found no effect of treatment (F2,66=1.529; p>0.05) or treatment × group interaction (F4,66=0.837; p>0.05). Post hoc testing found that the press-to-approach ratio was significantly lower for group FR-1/FR-10 than for group FR-10/FR-10 (p<0.05) or group FR-20/FR-10 (p<0.01), the later two groups not differing from each other (p>0.05). Therefore, it appears that dopamine receptor blockade did not affect this measure of task efficiency. However, given that group FR-1/FR-10 was both the most sensitive to flupentixol and the least efficient in checking the food cup, we examined if task efficiency influenced the impact of flupentixol on performance across rats. To do so, we assessed the correlation (Pearson's, two-tailed) between rats’ press-to-approach ratio during their saline test, which should reflect their efficiency on the FR-10/FR-10 schedule used at test, with their session length during the high dose flupentixol (0.225 mg/kg) test, computed as a percentage of their session length during the saline test to control for baseline response rate (Figure 4). Although no relationship was detected for groups FR-10/FR-10 (p>0.05) or FR-20/FR-10 (p>0.05), a significant negative correlation (r=−0.774; p<0.01) was found for group FR-1/FR-10. Specifically, the least efficient rats—those most likely to prematurely check the food cup—showed the strongest task suppression when treated with a high dose of flupentixol. Together with the group differences noted above, this finding suggests that the efficiency of task performance is an important factor affecting the dopamine-dependence of reward seeking behavior.

Figure 4
figure 4

For rats experiencing an upshift in response requirement during relative response cost testing, individual differences in task efficiency correlated with sensitivity to the suppressive effects of flupentixol. Scatter plots for groups fixed ratio (FR)-1/FR-10 (top), FR-10/FR-10 (middle), and FR-20/FR-10 (bottom). Vertical axis, displays the number of lever presses performed per food cup approach during the saline test for individual rats, which reflects task efficiency. Horizontal axis, displays the impact of flupentixol (high dose) on task performance (session length) for individual rats, plotted as a percentage of baseline performance during the saline test. A significant negative correlation was observed for group FR-1/FR-10 (p<0.01).

PowerPoint slide

Absolute Cost Testing

Although the current study focused on the question of whether relative response costs modulate the dopamine-dependence of reward seeking, previous studies have already established that absolute response costs can have such an effect. To confirm this relationship under the current experimental conditions, we conducted a series of tests to characterize the effects of dopamine receptor antagonism on reward seeking supported by the rats’ maintenance reinforcement schedules (ie, FR-1/FR-1, FR-10/FR-10, or FR-20/FR-20), predicting that rats with higher response demands would be the most sensitive to flupentixol. The results are presented in Figure 5. Consistent with this prediction, an ANOVA performed on test session lengths (Figure 5; top panel) found a significant main effect of treatment (F2,66=8.522; p<0.001) and a significant treatment × group interaction (F4,66=3.242; p<0.05), confirming that the suppressive effects of flupentixol depended on the rats’ reinforcement schedule at test. A significant treatment effect was found for group FR-20/FR-20 (F2,22=6.337; p<0.01), but not for group FR-1/FR-1 (F2,22=1.693; p>0.05). Although a numerical trend for the treatment effect was observed in group FR-10/FR-10, it did not reach significance (F2,22=2.001; p>0.05). This is noteworthy as this group showed a significant effect under identical conditions during relative response cost testing. The null effect observed here may have resulted from the additional training they received (Choi et al, 2005), or may reflect tolerance to the suppressive effects of flupentixol because of repeated exposure. The ANOVA also detected a significant main effect of group (F1,33=33.004; p<0.001), and post hoc testing confirmed that group FR-20/FR-20 took longer than group FR-1/FR-1 (p<0.001) and group FR-10/FR-10 (p<0.001) to finish their test session, and that group FR-10/FR-10 took longer than group FR-1/FR-1 (p<0.01), which is not surprising given the group differences in response requirement during these sessions.

Figure 5
figure 5

Absolute response costs modulate the suppressive effects of dopamine receptor blockade on reward seeking. Rats were pretreated with different doses of flupentixol before each of three test sessions on the maintenance reinforcement schedules, which were required either a low (fixed ratio (FR)-1/FR-1), intermediate (FR-10/FR-10), or high (FR-20/FR-20) amount of effort to earn reward. Top panel, mean session length (seconds; ±SEM). Bottom panel, mean ratio of lever presses to food cup approaches (±SEM). Asterisks indicate a significant treatment effect: **for p<0.01.

PowerPoint slide

The maintenance schedules supported different patterns of food cup checking, but only marginal effects of flupentixol were apparent on this aspect of behavior (Figure 5; bottom panel). An ANOVA found a significant effect of group (F1,33=55.748; p<0.001), a marginally insignificant effect of treatment (F2,66=2.688; p=0.077) and a marginally insignificant interaction between group and treatment (F4,66=2.083; p=0.093). Despite these trends, further analysis found no flupentixol effect in any group (largest F value: F2,22=2.502; p=0.105 for group FR-20/FR-20). Post hoc testing revealed that the press-to-approach ratio was greater for group FR-20/FR-20 than for FR-1/FR-1 (p<0.001) or for FR-10/FR-10 (p<0.001), and that the ratio for the latter groups differed from each other (p<0.001).

DISCUSSION

We investigated whether dopamine signaling is required for overcoming absolute and relative response costs for rats performing an instrumental lever-pressing task for food reward. Rats exerting a substantial amount of effort for each food reward (group FR-20/FR-20) were more likely to reduce their performance when pretreated with the flupentixol than rats performing low-effort (group FR-1/FR-1) or intermediate-effort (group FR-10/FR-10) tasks. However, when all rats were tested on the intermediate-effort task, flupentixol pretreatment was most effective in suppressing reward seeking in those rats experiencing an upshift in effort (group FR-1/FR-10). Furthermore, compared with rats maintained on the intermediate-effort schedule (group FR-10/FR-10), rats experiencing a downshift in effort (group FR-20/FR-10) were protected from the suppressive effects of flupentixol. These findings demonstrate that dopamine signaling is critical for adapting to changes in task demands and suggest that these relative, or subjective, response costs have a fundamental role in decision-making, even when the absolute, or objective, costs are held constant.

Interestingly, both individual and group differences in task efficiency, measured as the average number of presses performed before a rat checked the food cup, correlated with the dopamine-dependence of task performance. Thus, it appears that the way in which rats organized their reward seeking behavior influenced that behavior's vulnerability to disruption by dopamine receptor blockade. This relationship is consistent with three substantively different accounts that deserve consideration. First, if it is reasonable to take the press-to-approach ratio as a measure of how readily a rat adapts to a change in response requirement, this pattern suggests that rats experiencing the strongest ratio strain (ie, the most difficulty adapting to an upshift in response requirement) also showed the greatest sensitivity to dopamine antagonism. This interpretation is bolstered by the finding that rats shifted from FR-20 down to FR-10 at test exhibited the highest press-to-approach ratio and were also least affected by flupentixol. However, an alternative interpretation along similar lines is that these differences in the press-to-approach ratio represent objective, rather than subjective, differences in response cost since it is likely that premature visits to the food cup increase the net energy expenditure for the task. While these accounts focus on the role of costs (either relative or absolute) in determining the dopamine-dependence of performance, the flexible approach hypothesis (Nicola, 2010) provides a categorically different account. This framework assumes that dopamine transmission is required for initiating original (ie, non-habitual or undertrained) action sequences, particularly when subjects have disengaged from the instrumental task and must navigate back to the manipulandum from a new location in order to earn reward (Nicola, 2010). To explain why high-effort tasks tend to be more sensitive to dopamine receptor antagonism than low-effort tasks, this account notes that high-effort tasks cause subjects to disengage from the task following reward delivery (ie, the post-reinforcement pause). It is the ability to reinitiate performance during such pauses that is supposedly compromised by dopamine receptor antagonism. By extension, the flexible approach hypothesis may explain the current finding that an upshift in effort increased the dopamine-dependence of instrumental performance, if it can be assumed that this manipulation caused rats’ in group FR-1/FR-10 to disengage from the task. Although it is difficult to fully evaluate this account without detailed analysis of individual rats’ locomotion in the operant chamber at test, the finding that upshifted rats tended to perform the task inefficiently, making unnecessary trips to the food cup between reinforced presses, indicates that they were more frequently required to transition back from the food cup to the lever than unshifted or downshifted rats. However, it is important to note that no statistically significant differences in session length were detected between groups during the control (saline) relative response cost test. Indeed, a more detailed analysis of the rats’ mean latency to return to lever pressing after checking the food cup (regardless of whether or not a reward was delivered) during this test suggests that group FR-1/FR-10 (2.79 s; ±0.37) showed a tendency to be, if anything, more efficient in re-initiating task performance than group FR-20/FR-10 (4.23 s; ±0.51; Bonferroni post-hoc test: p=0.05) or group FR-10/FR-10 (3.39 s; ±0.32; p>0.10). Therefore, although the current findings do not provide a critical test of the flexible approach hypothesis, they seem to be more compatible with an effort-based interpretation of dopamine function.

The finding that dopamine signaling has a role in processing response costs is consistent with a number of recent studies measuring dopamine signaling in the nucleus accumbens. For instance, one study using microdialysis to track session-to-session changes in task-related dopamine efflux in rats lever pressing for food reward on a random ratio schedule found that differences in dopamine efflux across sessions tracked fluctuations in experienced response cost (Ostlund et al, 2011). Specifically, increases in the average number of presses required to earn reward were associated with decreases in dopamine efflux. These changes in dopamine may provide an incentive motivational function, in line with a recent computational model of tonic dopamine (Niv et al, 2007). Thus, when adapting to a change in work requirement, increases in dopamine levels may invigorate behavior when rewards are cheap, whereas decreases in dopamine may discourage responding when rewards are rare or costly. These short-term fluctuations in dopamine signaling can be contrasted with patterns observed in situations involving well-trained subjects. In such cases dopamine efflux during instrumental performance tests tends to be greater for rats trained on high-effort tasks than for those trained on low-effort tasks (Salamone et al, 1994b; Sokolowski et al, 1998; Segovia et al, 2011). Thus, it may be that short-term fluctuations in dopamine related to unexpected changes in response cost are countered by a more slowly acquired pattern of dopamine signaling (Ahn and Phillips, 2007), which may be critical for overcoming more persistent response costs.

Dopamine's role in processing relative response costs may also explain its contributions to cost/benefit decision-making. It is well established that treatments that disrupt dopamine signaling bias rats towards less costly response options (Cousins and Salamone, 1994; Denk et al, 2005; Floresco et al, 2008a). Furthermore, studies measuring phasic mesolimbic dopamine signaling during cost-based decision making tasks have found some, albeit mixed, evidence that anticipatory dopamine responses are lower for high-cost options, independent of changes related to reward magnitude (Day et al, 2010; Gan et al, 2010; Wanat et al, 2010; Nasrallah et al, 2011). Importantly, for two-option choice tasks, absolute and relative costs are necessarily conflated. For instance, when choosing between options that require either 16 presses or a single press to produce reward, the difference in absolute cost may be used to encode relative costs (eg, Option A is 16 times harder than Option B). Similarly, the progressive ratio task, where each new reward becomes harder to obtain, also conflates relative and absolute costs as subjects are likely tracking changes in effort over the session. To dissociate these two aspects of response cost, we applied a within-subjects procedure to manipulate relative response costs while holding absolute costs constant across groups, allowing us to attribute group differences in sensitivity to dopamine receptor antagonism to differences in relative response cost.

Although dopamine appears to incorporate information about past and present task conditions to regulate reward seeking, it is not required for learning about the incentive value of instrumental goals (Dickinson et al, 2000; Wassum et al, 2011) or using goal representations to guide action selection (Ostlund and Maidment, 2012), suggesting that dopamine tracks nonspecific information about reward value and response costs. Although these variables are the direct products of instrumental action, the dopamine system may encode such information through a Pavlovian learning process in the background of instrumental learning. This would explain reports that dopamine receptor antagonism selectively disrupts the response-invigorating effects of Pavlovian, reward-paired cues on instrumental reward seeking (Dickinson et al, 2000; Lex and Hauber, 2008; Wassum et al, 2011; Ostlund and Maidment, 2012).

The current results demonstrate that the dopamine-dependence of instrumental performance is modulated by both its absolute and relative costs. Advancing our understanding of dopamine's role in reward seeking will likely require a deeper appreciation for how such costs are computed and implemented to guide decision-making. Such knowledge could be useful for developing treatments to encourage healthy but effortful behaviors and/or discourage unhealthy behaviors (eg, compulsive drug or food seeking) associated with dysregulated dopamine signaling.