Subsequent Memory Effects in Cortical Pattern Similarity Differ by Semantic Class

Abstract

Although living and nonliving stimuli are known to rely on distinct brain regions during perception, it is largely unknown if their episodic memory encoding mechanisms differ as well. To investigate this issue, we asked participants to encode object pictures (e.g., a picture of a tiger) and to retrieve them later in response to their names (e.g., word “tiger”). For each of four semantic classes (living-animate, living-inanimate, nonliving-large, and nonliving-small), we examined differences in the similarity in activation patterns (neural pattern similarity [NPS]) for subsequently remembered versus forgotten items. Higher NPS for remembered items suggests an advantage of within-class item similarity, whereas lower NPS for remembered items indicates an advantage for item distinctiveness. We expect NPS within class-specific regions to be higher for remembered than for forgotten items. For example, the parahippocampal cortex has a well-known role in scene processing [Aminoff, E. M., Kveraga, K., & Bar, M. The role of the parahippocampal cortex in cognition. Trends in Cognitive Sciences, 17, 379–390, 2013], and the anterior temporal and inferior frontal gyrus have well-known roles in object processing [Clarke, A., & Tyler, L. K. Object-specific semantic coding in human perirhinal cortex. Journal of Neuroscience, 34, 4766–4775, 2014]. As such, we expect to see higher NPS for remembered items in these regions pertaining to scenes and objects, respectively. Consistent with this hypothesis, in fusiform, parahippocampal, and retrosplenial regions, higher NPS predicted memory for subclasses of nonliving objects, whereas in the left inferior frontal and left retrosplenial regions, lower NPS predicted memory for subclasses of living objects. Taken together, the results support the idea that subsequent memory depends on a balance of similarity and distinctiveness and demonstrate that the neural mechanisms of episodic encoding differ across semantic categories.