El presente artículo trata de explicar la falta de consenso acerca de la relación ambivalente entre los conceptos de confianza ciudadana y de coproducción de servicios públicos desde una perspectiva metodológica. Mediante una revisión sistemática descriptiva de la literatura tratando de la confianza ciudadana como causa y consecuencia de la coproducción de servicios públicos, este trabajo buscó conocer los métodos empleados por la investigación para examinar dicha relación, saber si estos están asociados a resultados específicos e identificar las oportunidades y límites que cada método presenta. Gracias a los hallazgos obtenidos, se pudo observar que no existe una relación significativa entre los métodos empleados y los resultados encontrados por la literatura. No obstante, esta revisión permitió plantear la necesidad para futuras investigaciones de combinar métodos cuantitativos y cualitativos, así como técnicas vinculadas a las neurociencias para analizar esta relación compleja.
{"title":"Revisión sistemática descriptiva de los métodos empleados para investigar la confianza ciudadana en la coproducción de servicios públicos","authors":"","doi":"10.35951/v3i2.122","DOIUrl":"https://doi.org/10.35951/v3i2.122","url":null,"abstract":"El presente artículo trata de explicar la falta de consenso acerca de la relación ambivalente entre los conceptos de confianza ciudadana y de coproducción de servicios públicos desde una perspectiva metodológica. Mediante una revisión sistemática descriptiva de la literatura tratando de la confianza ciudadana como causa y consecuencia de la coproducción de servicios públicos, este trabajo buscó conocer los métodos empleados por la investigación para examinar dicha relación, saber si estos están asociados a resultados específicos e identificar las oportunidades y límites que cada método presenta. Gracias a los hallazgos obtenidos, se pudo observar que no existe una relación significativa entre los métodos empleados y los resultados encontrados por la literatura. No obstante, esta revisión permitió plantear la necesidad para futuras investigaciones de combinar métodos cuantitativos y cualitativos, así como técnicas vinculadas a las neurociencias para analizar esta relación compleja.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77592943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
El auge de los certámenes cinematográficos ha captado la atención de los investigadores que trabajan su estudio desde diferentes enfoques, como el turismo, la economía, el periodismo, la etnografía, el género y, por supuesto, el cine. En sus metodologías destaca el uso de métodos procedentes de la antropología (Vallejo, 2017) como el estudio de caso, la observación participante, los grupos de discusión y el análisis de contenido y, como consecuencia, se presentan trabajos excelentes de repercusión limitada frente a estudios cartográficos más amplios. Este artículo propone un método de análisis de contenido de triangulación o método de triple análisis con objeto de concretar una muestra sobre la que se aplica una rúbrica, tomando como punto de partida las plataformas de distribución, el análisis de webs de festivales y el buscador genérico. La rúbrica facilita el estudio comparativo y cuantitativo. Como resultado se presenta un método de trabajo extrapolable a otro tipo de eventos culturales.
{"title":"La investigación de los certámenes cinematográficos en base al método de triple análisis","authors":"","doi":"10.35951/v3i2.121","DOIUrl":"https://doi.org/10.35951/v3i2.121","url":null,"abstract":"El auge de los certámenes cinematográficos ha captado la atención de los investigadores que trabajan su estudio desde diferentes enfoques, como el turismo, la economía, el periodismo, la etnografía, el género y, por supuesto, el cine. En sus metodologías destaca el uso de métodos procedentes de la antropología (Vallejo, 2017) como el estudio de caso, la observación participante, los grupos de discusión y el análisis de contenido y, como consecuencia, se presentan trabajos excelentes de repercusión limitada frente a estudios cartográficos más amplios. Este artículo propone un método de análisis de contenido de triangulación o método de triple análisis con objeto de concretar una muestra sobre la que se aplica una rúbrica, tomando como punto de partida las plataformas de distribución, el análisis de webs de festivales y el buscador genérico. La rúbrica facilita el estudio comparativo y cuantitativo. Como resultado se presenta un método de trabajo extrapolable a otro tipo de eventos culturales.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87399258","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
El uso que el medio cinematográfico realiza de aquellas imágenes que aparecen en pantalla durante un fugaz intervalo de tiempo, con el objetivo de afectar cognitivamente al espectador, sin que este llegue a ser consciente de ello, ha sido un tema que se ha tratado en los planos teórico, crítico e historiográfico con excesiva ligereza y falta de rigor. No obstante, desde los dominios de la psicología experimental y de la neurociencia se ha generado toda una amplia literatura científica interesada en abordar cómo estos estímulos pueden llegar a incidir sobre los procesos neuronales desencadenados por estímulos posteriores. Haciéndonos eco de esta, aquí apostamos por la adopción de una perspectiva interdisciplinar, donde las contribuciones realizadas en el curso de estos últimos años por estas tradiciones científicas, vengan a converger con aquellas otras emanadas de la teoría cinematográfica con el objeto de abordar las manifestaciones diversas de la imagen subliminal cinematográfica.
{"title":"Genealogía y ontología del fotograma subliminal desde una perspectiva cognitiva","authors":"","doi":"10.35951/v3i2.120","DOIUrl":"https://doi.org/10.35951/v3i2.120","url":null,"abstract":"El uso que el medio cinematográfico realiza de aquellas imágenes que aparecen en pantalla durante un fugaz intervalo de tiempo, con el objetivo de afectar cognitivamente al espectador, sin que este llegue a ser consciente de ello, ha sido un tema que se ha tratado en los planos teórico, crítico e historiográfico con excesiva ligereza y falta de rigor. No obstante, desde los dominios de la psicología experimental y de la neurociencia se ha generado toda una amplia literatura científica interesada en abordar cómo estos estímulos pueden llegar a incidir sobre los procesos neuronales desencadenados por estímulos posteriores. Haciéndonos eco de esta, aquí apostamos por la adopción de una perspectiva interdisciplinar, donde las contribuciones realizadas en el curso de estos últimos años por estas tradiciones científicas, vengan a converger con aquellas otras emanadas de la teoría cinematográfica con el objeto de abordar las manifestaciones diversas de la imagen subliminal cinematográfica.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80515056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
El objetivo del presente trabajo es mostrar las contribuciones de la sociosemiótica y la teoría de la enunciación a la investigación en comunicación. La articulación de categorías operativas provenientes de ambas perspectivas permite, por un lado, analizar los órdenes temático, retórico y enunciativo y, por el otro, precisar las dos posiciones posibles para estudiar el discurso mediático. Se muestra la aplicabilidad de esta metodología a partir del análisis de un ejemplo.
{"title":"Las contribuciones de la sociosemiótica y la teoría de la enunciación a la investigación en comunicación","authors":"","doi":"10.35951/v3i2.118","DOIUrl":"https://doi.org/10.35951/v3i2.118","url":null,"abstract":"El objetivo del presente trabajo es mostrar las contribuciones de la sociosemiótica y la teoría de la enunciación a la investigación en comunicación. La articulación de categorías operativas provenientes de ambas perspectivas permite, por un lado, analizar los órdenes temático, retórico y enunciativo y, por el otro, precisar las dos posiciones posibles para estudiar el discurso mediático. Se muestra la aplicabilidad de esta metodología a partir del análisis de un ejemplo.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87630811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-11-17DOI: 10.1080/19312458.2021.1999913
Timo Dobbrick, Julia Jakob, Chung-hong Chan, Hartmut Wessler
ABSTRACT Dictionary-based approaches to computational text analysis have been shown to perform relatively poorly, particularly when the dictionaries rely on simple bags of words, are not specified for the domain under study, and add word scores without weighting. While machine learning approaches usually perform better, they offer little insight into (a) which of the assumptions underlying dictionary approaches (bag-of-words, domain transferability, or additivity) impedes performance most, and (b) which language features drive the algorithmic classification most strongly. To fill both gaps, we offer a systematic assumption-based error analysis, using the integrative complexity of social media comments as our case in point. We show that attacking the additivity assumption offers the strongest potential for improving dictionary performance. We also propose to combine off-the-shelf dictionaries with supervised “glass box” machine learning algorithms (as opposed to the usual “black box” machine learning approaches) to classify texts and learn about the most important features for classification. This dictionary-plus-supervised-learning approach performs similarly well as classic full-text machine learning or deep learning approaches, but yields interpretable results in addition, which can inform theory development on top of enabling a valid classification.
{"title":"Enhancing Theory-Informed Dictionary Approaches with “Glass-box” Machine Learning: The Case of Integrative Complexity in Social Media Comments","authors":"Timo Dobbrick, Julia Jakob, Chung-hong Chan, Hartmut Wessler","doi":"10.1080/19312458.2021.1999913","DOIUrl":"https://doi.org/10.1080/19312458.2021.1999913","url":null,"abstract":"ABSTRACT Dictionary-based approaches to computational text analysis have been shown to perform relatively poorly, particularly when the dictionaries rely on simple bags of words, are not specified for the domain under study, and add word scores without weighting. While machine learning approaches usually perform better, they offer little insight into (a) which of the assumptions underlying dictionary approaches (bag-of-words, domain transferability, or additivity) impedes performance most, and (b) which language features drive the algorithmic classification most strongly. To fill both gaps, we offer a systematic assumption-based error analysis, using the integrative complexity of social media comments as our case in point. We show that attacking the additivity assumption offers the strongest potential for improving dictionary performance. We also propose to combine off-the-shelf dictionaries with supervised “glass box” machine learning algorithms (as opposed to the usual “black box” machine learning approaches) to classify texts and learn about the most important features for classification. This dictionary-plus-supervised-learning approach performs similarly well as classic full-text machine learning or deep learning approaches, but yields interpretable results in addition, which can inform theory development on top of enabling a valid classification.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45741654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-10-02DOI: 10.1080/19312458.2021.1986478
A. Waldherr, Martin Hilbert, Sandra González-Bailón
ABSTRACT Agent-based computational models create virtual laboratories in which to formalize and simulate dynamic, multi-level theories of communication. They allow the systematic development of thought experiments, and they improve our understanding of the generative mechanisms that underlie patterns observed in empirical data. Simulation models help explore hypothetical and unprecedented scenarios, serving as powerful hypothesis generators for future theoretical and empirical research. This Special Issue showcases a collection of studies that demonstrate the analytical potential and methodological contribution of agent-based modeling (ABM) for media and communication research. In this introduction, we highlight five major benefits of this modeling approach to communication scholarship: (1) formalization, (2) understanding, (3) explanation, (4) prediction, and (5) exploration. We then present the four studies of this special issue, which contribute methodologically and theoretically to diverse key areas of communication: the emergence of meanings; political deliberation; information diffusion; and media use and social influence. We conclude with outlining future perspectives of ABM in communication research.
{"title":"Worlds of Agents: Prospects of Agent-Based Modeling for Communication Research","authors":"A. Waldherr, Martin Hilbert, Sandra González-Bailón","doi":"10.1080/19312458.2021.1986478","DOIUrl":"https://doi.org/10.1080/19312458.2021.1986478","url":null,"abstract":"ABSTRACT Agent-based computational models create virtual laboratories in which to formalize and simulate dynamic, multi-level theories of communication. They allow the systematic development of thought experiments, and they improve our understanding of the generative mechanisms that underlie patterns observed in empirical data. Simulation models help explore hypothetical and unprecedented scenarios, serving as powerful hypothesis generators for future theoretical and empirical research. This Special Issue showcases a collection of studies that demonstrate the analytical potential and methodological contribution of agent-based modeling (ABM) for media and communication research. In this introduction, we highlight five major benefits of this modeling approach to communication scholarship: (1) formalization, (2) understanding, (3) explanation, (4) prediction, and (5) exploration. We then present the four studies of this special issue, which contribute methodologically and theoretically to diverse key areas of communication: the emergence of meanings; political deliberation; information diffusion; and media use and social influence. We conclude with outlining future perspectives of ABM in communication research.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43010000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-13DOI: 10.1080/19312458.2021.1968361
Leyla Dogruel, Philipp K. Masur, Sven Joeckel
ABSTRACT In light of the widespread use of big data analytics, internet users are increasingly confronted with algorithmic decision-making. Developing algorithm literacy is thus crucial to empower users to successfully navigate digital environments. In this paper, we present the development and validation of an algorithm literacy scale that consists of two interrelated dimensions: 1) awareness of algorithms use and 2) knowledge about algorithms. To validate the scale, we use item response theory and report findings from two studies. In study 1, we tested 46 items among N = 331 participants, resulting in a 32-item pool. These items were tested in a second study among N = 1,041 German internet users. The final scale consists of each 11 items measuring algorithm awareness and knowledge. Both subscales correlated positively with participants’ subjective coding skills and proved to be an appropriate predictor for participants’ handling of algorithmic curation in three test-scenarios.
{"title":"Development and Validation of an Algorithm Literacy Scale for Internet Users","authors":"Leyla Dogruel, Philipp K. Masur, Sven Joeckel","doi":"10.1080/19312458.2021.1968361","DOIUrl":"https://doi.org/10.1080/19312458.2021.1968361","url":null,"abstract":"ABSTRACT In light of the widespread use of big data analytics, internet users are increasingly confronted with algorithmic decision-making. Developing algorithm literacy is thus crucial to empower users to successfully navigate digital environments. In this paper, we present the development and validation of an algorithm literacy scale that consists of two interrelated dimensions: 1) awareness of algorithms use and 2) knowledge about algorithms. To validate the scale, we use item response theory and report findings from two studies. In study 1, we tested 46 items among N = 331 participants, resulting in a 32-item pool. These items were tested in a second study among N = 1,041 German internet users. The final scale consists of each 11 items measuring algorithm awareness and knowledge. Both subscales correlated positively with participants’ subjective coding skills and proved to be an appropriate predictor for participants’ handling of algorithmic curation in three test-scenarios.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46744376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-09-07DOI: 10.1080/19312458.2021.1965973
F. Lind, Jakob-Moritz Eberl, Olga Eisele, Tobias Heidenreich, Sebastian Galyga, H. Boomgaarden
ABSTRACT In communication research, topic modeling is primarily used for discovering systematic patterns in monolingual text corpora. To advance the usage, we provide an overview of recently presented strategies to extract topics from multilingual text collections for the purpose of comparative research. Moreover, we discuss, demonstrate, and facilitate the usability of the “Polylingual Topic Model” (PLTM) for such analyses. The appeal of this model is that it derives lists of related clustered words in different languages with little reliance on translation or multilingual dictionaries and without the need for manual post-hoc matching of topics. PLTM bridges the gap between languages by making use of document connections in training documents. As these training documents are the crucial resource for the model, we compare model evaluation metrics for different strategies to build training documents. By discussing the advantages and limitations of the different strategies in respect to different scenarios, our study contributes to the methodological discussion on automated content analysis of multilingual text corpora.
{"title":"Building the Bridge: Topic Modeling for Comparative Research","authors":"F. Lind, Jakob-Moritz Eberl, Olga Eisele, Tobias Heidenreich, Sebastian Galyga, H. Boomgaarden","doi":"10.1080/19312458.2021.1965973","DOIUrl":"https://doi.org/10.1080/19312458.2021.1965973","url":null,"abstract":"ABSTRACT In communication research, topic modeling is primarily used for discovering systematic patterns in monolingual text corpora. To advance the usage, we provide an overview of recently presented strategies to extract topics from multilingual text collections for the purpose of comparative research. Moreover, we discuss, demonstrate, and facilitate the usability of the “Polylingual Topic Model” (PLTM) for such analyses. The appeal of this model is that it derives lists of related clustered words in different languages with little reliance on translation or multilingual dictionaries and without the need for manual post-hoc matching of topics. PLTM bridges the gap between languages by making use of document connections in training documents. As these training documents are the crucial resource for the model, we compare model evaluation metrics for different strategies to build training documents. By discussing the advantages and limitations of the different strategies in respect to different scenarios, our study contributes to the methodological discussion on automated content analysis of multilingual text corpora.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41690213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-08-22DOI: 10.1080/19312458.2021.1953455
Kasper Welbers, Wouter van Atteveldt, Joseph W. Bajjalieh, Dan A. Shalmon, P. Joshi, Scott L. Althaus, Chung-hong Chan, Hartmut Wessler, Marc Jungblut
ABSTRACT Digital archives that document real-world events provide new opportunities for large-scale analyses of how news coverage represents reality. We present a method and open-source tool for linking event data to news articles, and demonstrate its application with an analysis of event and country level predictors of terrorism coverage in The Guardian from 2006 to 2018, using event data from the Global Terrorism Database (GTD). Our method builds on established techniques for calculating document similarity, and we propose a novel strategy for fine-tuning parameters of the event matching algorithm that requires no manual coding. An online appendix is provided that documents all code to replicate our analysis and reuse our tools.
{"title":"Linking event archives to news: a computational method for analyzing the gatekeeping process","authors":"Kasper Welbers, Wouter van Atteveldt, Joseph W. Bajjalieh, Dan A. Shalmon, P. Joshi, Scott L. Althaus, Chung-hong Chan, Hartmut Wessler, Marc Jungblut","doi":"10.1080/19312458.2021.1953455","DOIUrl":"https://doi.org/10.1080/19312458.2021.1953455","url":null,"abstract":"ABSTRACT Digital archives that document real-world events provide new opportunities for large-scale analyses of how news coverage represents reality. We present a method and open-source tool for linking event data to news articles, and demonstrate its application with an analysis of event and country level predictors of terrorism coverage in The Guardian from 2006 to 2018, using event data from the Global Terrorism Database (GTD). Our method builds on established techniques for calculating document similarity, and we propose a novel strategy for fine-tuning parameters of the event matching algorithm that requires no manual coding. An online appendix is provided that documents all code to replicate our analysis and reuse our tools.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47895851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2021-08-17DOI: 10.1080/19312458.2021.1955845
D. Maier, C. Baden, Daniela Stoltenberg, Maya De Vries-Kedem, A. Waldherr
ABSTRACT The goal of this paper is to evaluate two methods for the topic modeling of multilingual document collections: (1) machine translation (MT), and (2) the coding of semantic concepts using a multilingual dictionary (MD) prior to topic modeling. We empirically assess the consequences of these approaches based on both a quantitative comparison of models and a qualitative validation of each method’s potentials and weaknesses. Our case study uses two text collections (of tweets and news articles) in three languages (English, Hebrew, Arabic), covering the ongoing local conflicts between Israeli authorities, settlers, and Palestinian Bedouins in the West Bank. We find that both methods produce a large share of equivalent topics, especially in the context of fairly homogenous news discourse, yet show limited but systematic differences when applied to highly heterogenous social media discourse. While the MD model delivers a more nuanced picture of conflict-related topics, it misses several more peripheral topics, especially those unrelated to the dictionary’s focus, which are picked up by the MT model. Our study is a first step toward instrument validation, indicating that both methods yield valid, comparable results, while method-specific differences remain.
{"title":"Machine Translation Vs. Multilingual Dictionaries Assessing Two Strategies for the Topic Modeling of Multilingual Text Collections","authors":"D. Maier, C. Baden, Daniela Stoltenberg, Maya De Vries-Kedem, A. Waldherr","doi":"10.1080/19312458.2021.1955845","DOIUrl":"https://doi.org/10.1080/19312458.2021.1955845","url":null,"abstract":"ABSTRACT The goal of this paper is to evaluate two methods for the topic modeling of multilingual document collections: (1) machine translation (MT), and (2) the coding of semantic concepts using a multilingual dictionary (MD) prior to topic modeling. We empirically assess the consequences of these approaches based on both a quantitative comparison of models and a qualitative validation of each method’s potentials and weaknesses. Our case study uses two text collections (of tweets and news articles) in three languages (English, Hebrew, Arabic), covering the ongoing local conflicts between Israeli authorities, settlers, and Palestinian Bedouins in the West Bank. We find that both methods produce a large share of equivalent topics, especially in the context of fairly homogenous news discourse, yet show limited but systematic differences when applied to highly heterogenous social media discourse. While the MD model delivers a more nuanced picture of conflict-related topics, it misses several more peripheral topics, especially those unrelated to the dictionary’s focus, which are picked up by the MT model. Our study is a first step toward instrument validation, indicating that both methods yield valid, comparable results, while method-specific differences remain.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":null,"pages":null},"PeriodicalIF":11.4,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45628519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：