We investigated whether 12-month-old infants rely on information about the certainty of goal selection in order to predict observed reaching actions. Infants' goal-directed gaze shifts were recorded as they observed action sequences in a multiple-goals design. We found that 12-month-old infants exhibited gaze shifts significantly earlier when the observed hand reached for the same goal object in all trials (frequent condition) compared with when the observed hand reached for different goal objects across trials (nonfrequent condition). Infants in the frequent condition were significantly more accurate at predicting the action goal than infants in the nonfrequent condition. In addition, findings revealed rapid learning in the case of certainty and no learning in the case of uncertainty of goal selection over the course of trials. Together, our data indicate that by the end of their first year of life, infants rely on information about the certainty of goal selection to make inferences about others' action goals.

Successful communication often involves comprehension of both spoken language and observed actions with and without objects. Even very young infants can learn associations between actions and objects as well as between words and objects. However, in daily life, children are usually confronted with both kinds of input simultaneously. Choosing the critical information to attend to in such situations might help children structure the input, and thereby, allow for successful learning. In the current study, we therefore, investigated the developmental time course of children’s and adults’ word and action learning when given the opportunity to learn both word-object and action-object associations for the same object. All participants went through a learning phase and a test phase. In the learning phase, they were presented with two novel objects which were associated with a distinct novel name (e.g., “Look, a Tanu”) and a distinct novel action (e.g., moving up and down while tilting sideways). In the test phase, participants were presented with both objects on screen in a baseline phase, then either heard one of the two labels or saw one of the two actions in a prime phase, and then saw the two objects again on screen in a recognition phase. Throughout the trial, participants’ target looking was recorded to investigate whether participants looked at the target object upon hearing its label or seeing its action, and thus, would show learning of the word-object and action-object associations. Growth curve analyses revealed that 12-month-olds showed modest learning of action-object associations, 36-month-olds learned word-object associations, and adults learned word-object and action-object associations. These results highlight how children attend to the different information types from the two modalities through which communication is addressed to them. Over time, with increased exposure to systematic word-object mappings, children attend less to action-object mappings, with the latter potentially being mediated by word-object learning even in adulthood. Thus, choosing between different kinds of input that may be more relevant in their rich environment encompassing different modalities might help learning at different points in development.

Communication with young children is often multimodal in nature, involving, for example, language and actions. The simultaneous presentation of information from both domains may boost language learning by highlighting the connection between an object and a word, owing to temporal overlap in the presentation of multimodal input. However, the overlap is not merely temporal but can also covary in the extent to which particular actions co-occur with particular words and objects, e.g. carers typically produce a hopping action when talking about rabbits and a snapping action for crocodiles. The frequency with which actions and words co-occurs in the presence of the referents of these words may also impact young children’s word learning. We, therefore, examined the extent to which consistency in the co-occurrence of particular actions and words impacted children’s learning of novel word–object associations. Children (18 months, 30 months and 36–48 months) and adults were presented with two novel objects and heard their novel labels while different actions were performed on these objects, such that the particular actions and word–object pairings always co-occurred (Consistent group) or varied across trials (Inconsistent group). At test, participants saw both objects and heard one of the labels to examine whether participants recognized the target object upon hearing its label. Growth curve models revealed that 18-month-olds did not learn words for objects in either condition, and 30-month-old and 36- to 48-month-old children learned words for objects only in the Consistent condition, in contrast to adults who learned words for objects independent of the actions presented. Thus, consistency in the multimodal input influenced word learning in early childhood but not in adulthood. In terms of a dynamic systems account of word learning, our study shows how multimodal learning settings interact with the child’s perceptual abilities to shape the learning experience.

Research on voluntary action has focused on the question of how we represent our behavior on a motor and cognitive level. However, the question of how we represent voluntary not acting has been completely neglected. The aim of the present study was to investigate the cognitive and motor representation of intentionally not acting. By using an action-effect binding approach, we demonstrate similarities of action and nonaction. In particular, our results reveal that voluntary nonactions can be bound to an effect tone. This finding suggests that effect binding is not restricted to an association between a motor representation and a successive effect (action-effect binding) but can also occur for an intended nonaction and its effect (nonaction-effect binding). Moreover, we demonstrate that nonactions have to be initiated voluntarily in order to elicit nonaction-effect binding.