Could Motor Representations Ground Collective Goals?
Motor representations can ground collective goals in this sense: in some cases, two or more actions involving multiple agents have a collective goal in virtue of the actions being appropriately related to an interagential structure of motor representations. Or so the discoveries presented in this section suggest.
Any account of joint action should answer the question,
In virtue of what could two or more agents’ actions have a collective goal?
In some cases, it is probably the agents’ shared intention in virtue of which their actions have a collective goal (whatever exactly shared intention turns out to be.)
But if the conjecture is true, there are cases in which it is in virtue of an interagential structure of motor representations that actions have a collective goal (whatever exactly shared intention turns out to be.)
What is this interagential structure of motor representations?
First, there must be an outcome to which the actions are, or could be, collectively directed, and in each agent there must be a motor representation of this outcome.
Second, these motor representations must trigger planning-like processes which result in plan-like hierarchies of motor representations in each agent.
Third, the plan-like hierarchy in each agent must involve motor representations concerning not only actions she will eventually perform but also actions another will eventually perform.
Fourth, the plan-like hierarchies of motor representations in the agents must non-accidentally match.
When all four conditions are met, the result is an interagential structure of motor representations.
Because the existence of this interagential structure would provide for the coordination of the agents’ actions around the outcome represented motorically, it ensures that sufficient conditions are met for the existence of a collective goal of their actions. (The sufficient conditions featured in the section on Collective Goals.)
Note that this does not imply that there are any cases of joint action which do not involve shared intention. The challenge to the philosophical accounts (e.g. Bratman on Shared Intentional Action) is not that they fail to give necessary conditions. It is that there are basic questions about joint action which cannot be fully answered without going beyond philosophical frameworks to consider scientific discoveries.
Appendix: More Detail
Does the interagential structure of motor representations identified above really provide for coordination?
How could it do so?
To fully understand this, we need two things. An understanding of bimanual coordination in ordinary, individual action. And the notion of parallel planning.
Bimanual Coordination in Ordinary, Individual Action
Consider what is involved when, in acting alone, you move a mug from one place to another, passing it between your hands half-way. In this action there is a need to coordinate the exchange between your two hands. If your action is fluid, you may proactively prepare to release the mug from your left hand moments in advance of the mug’s being secured by your right hand (compare Diedrichsen, Verstynen, Hon, Lehman, & Ivry, 2003). How is such tight coordination achieved? A full answer cannot be given by appeal to physiology alone (Jackson, German, & Peacock, 2002; Piedimonte et al., 2015). Instead, part of the answer involves the fact that there is a motor representation for the whole action which triggers planning-like motor processes, so that the motor representations and processes concerning the actions involving each hand are not entirely independent of each other (compare Kelso, Southard, & Goodman, 1979 and Rosenbaum, 2010, pp. 244–8). Such planning-like processes result in motor representations concerning different parts of the action which can be hierarchically arranged by the means-ends relation and ensure that relational constraints on components of the action are satisfied. So when you move a mug from one place to another, passing it between your hands half-way, and when this action and its components are represented motorically in a plan-like hierarchy, it is this plan-like hierarchy which ensures the movements of one hand constrain and are constrained by the movements of the other hand.
This is how motor representations of outcomes can coordinate the actions of an individual agent using two hands.
Now switch from an individual agent performing a bimanual action to two agents acting together.
Motor representation can play a similar role when two agents act together. To see how, we need the notion of parallel planning.
‘each agent does not just intend that the group perform the […] joint action. Rather, each agent intends as well that the group perform this joint action in accordance with subplans (of the intentions in favor of the joint action) that mesh.’ (Bratman, 1992, p. 332)
On Bratman’s view,
‘shared intentional agency consists, at bottom, in interconnected planning agency of the participants.’ (Bratman, 2011).
Our planning is parallel just if you and I are each planning actions that I will eventually perform and actions that you will eventually perform, where the resulting plans non-accidentally match.
For parallel planning to be possible without irrationality, it can involve only agent-neutral representations and processes. It must also result in intentions that are open-ended with respect to who will act.
It may be controversial whether parallel planning involving practical reasoning and intentions is actually at all possible without irrationality. But our concern is different: we know that some motor processes are planning-like in that they involve computing means from representations of ends and in that they involve satisfying relational constraints on actions happening at different times. Perhaps there is something like parallel planning that involves not practical reasoning and intentions but motor processes and representations?
So how does the interagential structure of motor representations identified above provide for coordination of two agents’ actions?
The plan-like structure of motor representations in you concerns not only actions you will perform but also actions I will perform. This ensures that your actions are constrained by your plan for my actions. But because your plan-like structure matches my plan-like structure, this means that your actions are, in effect, constrained by my plan for my actions. And conversely.
So the interagential structure of motor representations identified above provides for the coordination of our actions in something like the way that motor representations coordinate the bimanual actions of an individual agent.3
Appendix: Further Sources
There are lots of additional sources in the references section of a guide to psychological research on coordination in joint action written for philosophers (Butterfill, 2017).
As you can see from the video, quite a bit has happened since that guide was written. The new research mostly confirms and extends the earlier research.
Ask a Question
Your question will normally be answered in the question session associated with this lecture.
agent-neutral : A representation or plan is _agent-neutral_ if its content does not specify any particular agent or agents; a planning process is _agent-neutral_ if it involves only agent-neutral representations.
bimanual : two-handed
CNV : Contingent negative variation, an EEG component. In the experimental designs of interest to us, the CNV serves as a signal of motor preparation for action which is time-locked to action onset. Although identified well over half a century ago, exactly what the CNV signals in different contexts remains a topic of investigation (Kononowicz & Penney, 2016).
collective goal : an outcome to which two or more agents’ actions are directed where this is not, or not only, a matter of each action being directed to that outcome (Butterfill & Sinigaglia, 2022).
EEG : Electroencephalography, the measurement of electrical activity on your scalp to make inferences about neural activity. Compared to fMRI, EEG has high temporal resolution but low spatial resoltion, and imposes less restrictions on movement during measurement. Involves wearing a cap studded with electrodes.
goal : A goal of an action is an outcome to which it is directed.
interconnected planning : Our plans are _interconnected_ just if facts about your plans feature in mine and conversely. Contrast parallel planning.
match : _[of outcomes]_ Two collections of outcomes, A and B, _match_ in a particular context just if, in that context, either the occurrence of the A-outcomes would normally constitute or cause, at least partially, the occurrence of the B-outcomes or vice versa. To illustrate, one way of matching is for the B-outcomes to be the A-outcomes. Another way of matching is for the B-outcomes to stand to the A-outcomes as elements of a more detailed plan stand to those of a less detailed one. _[of plan-like structures]_ In the simplest case, plan-like hierarchies of motor representations _match_ if they are identical. More generally, plan-like hierarchies _match_ if the differences between them _do not matter_ in the following sense. For a plan-like hierarchy in an agent, let the _self part_ be those motor representations concerning the agent's own actions and let the _other part_ be the other motor representations. First consider what would happen if, for a particular agent, the other part of her plan-like hierarchy were as nearly identical to the self part (or parts) of the other's plan-like hierarchy (or others' plan-like hierarchies) as psychologically possible. Would the agent's self part be different? If not, let us say that any differences between her plan-like hierarchy and the other's (or others') are _not relevant_ for her. Finally, if for some agents' plan-like hierarchies of motor representations the differences between them are not relevant for any of the agents, then let us say that the differences _do not matter_.
motor representation : The kind of representation characteristically involved in preparing, performing and monitoring sequences of small-scale actions such as grasping, transporting and placing an object. They represent actual, possible, imagined or observed actions and their effects.
outcome : An outcome of an action is a possible or actual state of affairs.
parallel planning : Our planning is _parallel_ just if you and I are each planning actions that I will eventually perform and actions that you will eventually perform, where the resulting plans non-accidentally match. Contrast interconnected planning.
planning-like : A process is _planning-like_ if has features characteristic of planning. For instance, it may start with representations of relatively distal outcomes and gradually fill in details, resulting in representations whose contents can be hierarchically arranged by the means--end relation (compare Grafton & Hamilton, 2007 on motor processes). Or a process may be _planning-like_ in that it involves meeting constraints on the selection of means by which to bring about one outcome that arise from the need to select means by which, later, to bring about another outcome (Rosenbaum et al., 2012).
practical reasoning : ‘The mark of practical reasoning is that the thing wanted is _at a distance_ from the immediate action, and the immediate action is calculated as a way of getting or doing or securing the thing wanted’ (Anscombe, 1957, p. 79). See also Millgram (2001, p. 1): ‘Practical reasoning is reasoning directed towards action: figuring out what to do, as contrasted with figuring out how the facts stand.’
shared intention : An attitude that stands to joint action as ordinary, individual intention stands to ordinary, individual action. It is hard to find consensus on what shared intention is, but most agree that it is neither shared nor intention. (Variously called ‘collective’, ‘we-’ and ‘joint’ intention.)
very small scale action : An action that is typically distantly related as a descendent by the means-ends relation to the actions which are sometimes described as ‘small scale’ actions, such as playing a sonata, cooking a meal or painting a house (e.g. Bratman, 2014, p. ][p. 8; Gilbert, 1990, p. ][p. 178).
Anscombe, G. E. M. (1957). Intention. Oxford: Blackwell.
Bekkering, H., Wohlschlager, A., & Gattis, M. (2000). Imitation of gestures in children is goal-directed. The Quarterly Journal of Experimental Psychology A, 53(1), 153–164. https://doi.org/10.1080/027249800390718
Bratman, M. E. (1992). Shared cooperative activity. The Philosophical Review, 101(2), 327–341.
Bratman, M. E. (2011). Acting over time, acting together. (Draft), 0(0), 0.
Clarke, S., McEllin, L., Francová, A., Székely, M., Butterfill, S. A., & Michael, J. (2019). Joint action goals reduce visuomotor interference effects from a partner’s incongruent actions. Scientific Reports, 9(1), 1–9. https://doi.org/10.1038/s41598-019-52124-6
della Gatta, F., Garbarini, F., Rabuffetti, M., Viganò, L., Butterfill, S. A., & Sinigaglia, C. (2017). Drawn together: When motor representations ground joint actions. Cognition, 165, 53–60.
Diedrichsen, J., Verstynen, T., Hon, A., Lehman, S. L., & Ivry, R. B. (2003). Anticipatory adjustments in the unloading task: Is an efference copy necessary for learning? Experimental Brain Research, 148(2), 272–276. https://doi.org/10.1007/s00221-002-1318-z
Gilbert, M. P. (1990). Walking together: A paradigmatic social phenomenon. Midwest Studies in Philosophy, 15, 1–14.
Gilbert, M. P. (2006). Rationality in collective action. Philosophy of the Social Sciences, 36(1), 3–17.
Kourtis, D., Knoblich, G., Woźniak, M., & Sebanz, N. (2014). Attention Allocation and Task Representation during Joint Action Planning. Journal of Cognitive Neuroscience, 26(10), 2275–2286. https://doi.org/10.1162/jocn_a_00634
Kourtis, D., Sebanz, N., & Knoblich, G. (2010). Favouritism in the motor system: Social interaction modulates action simulation. Biology Letters, 6(6), 758–761.
Loehr, J. D., Kourtis, D., Vesper, C., Sebanz, N., & Knoblich, G. (2013). Monitoring individual and joint action outcomes in duet music performance. Journal of Cognitive Neuroscience, 25(7), 1049–1061.
Loehr, J. D., & Palmer, C. (2011). Temporal coordination between performing musicians. The Quarterly Journal of Experimental Psychology, 64(11), 2153–2167.
Ménoret, M., Varnet, L., Fargier, R., Cheylus, A., Curie, A., Portes, V. des, … Paulignan, Y. (2014). Neural correlates of non-verbal social interactions: A dual-EEG study. Neuropsychologia, 55, 75–97.
Meyer, M., Hunnius, S., Elk, M. van, Ede, F. van, & Bekkering, H. (2011). Joint action modulates motor system involvement during action observation in 3-year-olds. Experimental Brain Research, 211(3–4), 581–592. https://doi.org/10.1007/s00221-011-2658-3
Meyer, M., Wel, R. P. R. D. van der, & Hunnius, S. (2013). Higher-order action planning for individual and joint object manipulations. Experimental Brain Research, 225(4), 579–588. https://doi.org/10.1007/s00221-012-3398-8
Millgram, E. (2001). Practical reasoning: The current state of play. In Varieties of practical reasoning (pp. 1–26). Cambridge, Mass: MIT Press.
Novembre, G., Ticini, L. F., Schutz-Bosbach, S., & Keller, P. E. (2014). Motor simulation and the coordination of self and other in real-time joint action. Social Cognitive and Affective Neuroscience, 9(8), 1062–1068. https://doi.org/10.1093/scan/nst086
Novembre, Giacomo, Ticini, L. F., Schütz-Bosbach, S., & Keller, P. E. (2012). Distinguishing self and other in joint action. Evidence from a musical paradigm. Cerebral Cortex, 22(12), 2894–2903.
Pacherie, E., & Dokic, J. (2006). From mirror neurons to joint actions. Cognitive Systems Research, 7(2–3), 101–112.
Piedimonte, A., Garbarini, F., Rabuffetti, M., Pia, L., Montesano, A., Ferrarin, M., & Berti, A. (2015). Invisible Grasps: Grip Interference in Anosognosia for Hemiplegia. Neuropsychology, 29(5), 776–781. https://doi.org/10.1037/neu0000182
Rosenbaum, D. A. (2010). Human motor control (2nd ed.). San Diego, CA, US: Academic Press.
Rosenbaum, D. A., Chapman, K. M., Weigelt, M., Weiss, D. J., & Wel, R. P. R. D. van der. (2012). Cognition, action, and object manipulation. Psychological Bulletin, 138(5), 924–946. https://doi.org/10.1037/a0027839
Sacheli, L. M., Arcangeli, E., Carioti, D., Butterfill, S., & Berlingeri, M. (2021). Taking apart what brings us together: The role of action prediction, perspective-taking, and theory of mind in joint action. Quarterly Journal of Experimental Psychology, 17470218211050198. https://doi.org/10.1177/17470218211050198
Sebanz, N., Knoblich, G., Prinz, W., & Wascher, E. (2006). Twin peaks: An ERP study of action planning and control in coacting individuals. Journal of Cognitive Neuroscience, 18(5), 859–870. https://doi.org/10.1162/jocn.2006.18.5.859
Vesper, C., Wel, R. P. R. D. van der, Knoblich, G., & Sebanz, N. (2013). Are you ready to jump? Predictive mechanisms in interpersonal coordination. Journal of Experimental Psychology: Human Perception and Performance, 39(1), 48–61. https://doi.org/10.1037/a0028066
Zhang, W., & Rosenbaum, D. A. (2007). Planning for manual positioning: The end-state comfort effect for manual abduction–adduction. Experimental Brain Research, 184(3), 383–389. https://doi.org/10.1007/s00221-007-1106-x
This evidence is compatible with two possibilities. It could be that there is a single planning processes concerning all agents’ actions, just as parallel planning requires; but it might also be that, in each agent, there are two largely separate planning processes, one for each agent’s actions. But, as mentioned above, there is evidence that collective goals are represented motorically. This evidence suggests that sometimes when exercising collective agency, the agents have a single representation of the whole action, not only separate representations of each agent’s part (see also Tsai, Sebanz, & Knoblich, 2011; Loehr, Kourtis, Vesper, Sebanz, & Knoblich, 2013; Ménoret et al., 2014). It follows that the second possibility obtains, at least sometimes. ↩
There are some important differences, of course. Most obviously, in the case of joint action there is more than one agent and so more than one plan-like structure of motor representations. And since in each of us there are representations of actions the other will eventually perform, something must prevent these motor representations from producing actions. ↩