Vojtěch Smekal, Marta Poyo Solanas, Evelyne I. C. Fraats, Beatrice de Gelder
{"title":"Differential contributions of body form, motion, and temporal information to subjective action understanding in naturalistic stimuli","authors":"Vojtěch Smekal, Marta Poyo Solanas, Evelyne I. C. Fraats, Beatrice de Gelder","doi":"10.3389/fnint.2024.1302960","DOIUrl":null,"url":null,"abstract":"<sec><title>Introduction</title><p>We investigated the factors underlying naturalistic action recognition and understanding, as well as the errors occurring during recognition failures.</p></sec><sec><title>Methods</title><p>Participants saw full-light stimuli of ten different whole-body actions presented in three different conditions: as normal videos, as videos with the temporal order of the frames scrambled, and as single static representative frames. After each stimulus presentation participants completed one of two tasks—a forced choice task where they were given the ten potential action labels as options, or a free description task, where they could describe the action performed in each stimulus in their own words.</p></sec><sec><title>Results</title><p>While generally, a combination of form, motion, and temporal information led to the highest action understanding, for some actions form information was sufficient and adding motion and temporal information did not increase recognition accuracy. We also analyzed errors in action recognition and found primarily two different types.</p></sec><sec><title>Discussion</title><p>One type of error was on the semantic level, while the other consisted of reverting to the kinematic level of body part processing without any attribution of semantics. We elaborate on these results in the context of naturalistic action perception.</p></sec>","PeriodicalId":56016,"journal":{"name":"Frontiers in Integrative Neuroscience","volume":"73 1","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Integrative Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3389/fnint.2024.1302960","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BEHAVIORAL SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction
We investigated the factors underlying naturalistic action recognition and understanding, as well as the errors occurring during recognition failures.
Methods
Participants saw full-light stimuli of ten different whole-body actions presented in three different conditions: as normal videos, as videos with the temporal order of the frames scrambled, and as single static representative frames. After each stimulus presentation participants completed one of two tasks—a forced choice task where they were given the ten potential action labels as options, or a free description task, where they could describe the action performed in each stimulus in their own words.
Results
While generally, a combination of form, motion, and temporal information led to the highest action understanding, for some actions form information was sufficient and adding motion and temporal information did not increase recognition accuracy. We also analyzed errors in action recognition and found primarily two different types.
Discussion
One type of error was on the semantic level, while the other consisted of reverting to the kinematic level of body part processing without any attribution of semantics. We elaborate on these results in the context of naturalistic action perception.
期刊介绍:
Frontiers in Integrative Neuroscience publishes rigorously peer-reviewed research that synthesizes multiple facets of brain structure and function, to better understand how multiple diverse functions are integrated to produce complex behaviors. Led by an outstanding Editorial Board of international experts, this multidisciplinary open-access journal is at the forefront of disseminating and communicating scientific knowledge and impactful discoveries to researchers, academics, clinicians and the public worldwide.
Our goal is to publish research related to furthering the understanding of the integrative mechanisms underlying brain functioning across one or more interacting levels of neural organization. In most real life experiences, sensory inputs from several modalities converge and interact in a manner that influences perception and actions generating purposeful and social behaviors. The journal is therefore focused on the primary questions of how multiple sensory, cognitive and emotional processes merge to produce coordinated complex behavior. It is questions such as this that cannot be answered at a single level – an ion channel, a neuron or a synapse – that we wish to focus on. In Frontiers in Integrative Neuroscience we welcome in vitro or in vivo investigations across the molecular, cellular, and systems and behavioral level. Research in any species and at any stage of development and aging that are focused at understanding integration mechanisms underlying emergent properties of the brain and behavior are welcome.