Goal-Directed and Habitual: Some Evidence
According to the dual-process theory,
instrumental actions can be a consequence of both
goal-directed processes and habitual processes. So far we have mainly relied on testimony
for this key premise. It’s now time to consider evidence for it.
Notes
Until The Minor Puzzle about Habitual Action we had not encountered any
evidence at all for the dual-process theory of instrumental action.
What evidence supports this theory?
The recording introduces three sources of evidence:
- cognitive load (via stress) - Schwabe & Wolf (2010)
- representation of contingency - Klossek, Yu, & Dickinson (2011)
- neurophysiology - Dickinson (2016)
If you have difficulty with this (perhaps you are new to psychology, or perhaps you
just struggle to follow the lecturer), please consider just the first of these.
It would be much better to have a firm understanding of Schwabe & Wolf (2010)
than to have a sense of what each of the three sources of evidence involves.
Ask a Question
Your question will normally be answered in the question
session of the next lecture.
More information about asking questions.
Glossary
devaluation :
To devaluate some food (or video clip, or any other thing) is to reduce its value,
for example by allowing the agent to satiete themselves on it or
by causing them
to associate it with an uncomfortable event such as an electric shock or mild illness.
dual-process theory of instrumental action :
instrumental action ‘is controlled by two dissociable processes: a
goal-directed and an habitual process’ (Dickinson, 2016, p. 177).
extinction :
In some experiments, there is a phase (usually following
instrumental training and an intervention such as devaluation) during
which the subject encounters the training scenario exactly as it was
(same stimuli, same action possibilities) but the actions produce no
revant outcomes. In this extinction phase, there is no reward (nor punishment).
(It is called ‘extinction’ because in many cases
not rewarding (or punishing) the actions
will eventually extinguish the stimulus--action links.)
goal-directed process :
A process which involves ‘a
representation of the causal relationship between the action and outcome
and a representation of the current incentive value, or utility, of the
outcome’ and which influences an action ‘in a way that rationalizes
the action as instrumental for attaining the goal’ (Dickinson, 2016, p. 177).
habitual process :
A process underpinning some instrumental actions which obeys
Thorndyke’s Law of Effect:
‘The presentation of an effective [=rewarding] outcome following an action [...] reinforces
a connection between the stimuli present when the action is performed and the action itself
so that subsequent presentations of these stimuli elicit the [...] action as a response’
(Dickinson, 1994, p. 48).
instrumental action :
An action is instrumental if it happens in
order to bring about an outcome,
as when you press a lever in order to obtain food. (In this case,
obtaining food is the outcome, lever pressing is the action, and the
action is instrumental because it occurs in order to bring it about
that you obtain food.)
You may variations on this definition of instrumental in the literature.
Dickinson (2016, p. 177)
characterises instrumental actions differently: in place of the teleological
‘in order to bring about an outcome’, he stipulates that an instrumental
action is one that is ‘controlled by the contingency between’ the action
and an outcome. And de Wit & Dickinson (2009, p. 464) stipulate that
‘instrumental actions are learned’.
References
de Wit, S., & Dickinson, A. (2009). Associative theories of goal-directed behaviour: A case for animalhuman translational models.
Psychological Research PRPF,
73(4), 463–476.
https://doi.org/10.1007/s00426-009-0230-6Dickinson, A. (1994). Instrumental conditioning. In N. Mackintosh (Ed.),
Animal learning and cognition. London: Academic Press.
Dickinson, A. (2016). Instrumental conditioning revisited: Updating dual-process theory. In J. B. Trobalon & V. D. Chamizo (Eds.),
Associative learning and cognition (Vol. 51, pp. 177–195). Edicions Universitat Barcelona.
Dickinson, A., & Pérez, O. D. (2018). Actions and Habits: Psychological Issues in Dual-System Theory. In R. Morris, A. Bornstein, & A. Shenhav (Eds.),
Goal-Directed Decision Making (pp. 1–25). Academic Press.
https://doi.org/10.1016/B978-0-12-812098-9.00001-2Klossek, U. M. H., Yu, S., & Dickinson, A. (2011). Choice and goal-directed behavior in preschool children.
Learning & Behavior,
39(4), 350–357.
https://doi.org/10.3758/s13420-011-0030-xSchwabe, L., & Wolf, O. T. (2010). Socially evaluated cold pressor stress after instrumental learning favors habits over goal-directed action.
Psychoneuroendocrinology,
35(7), 977–986.
https://doi.org/10.1016/j.psyneuen.2009.12.010