How do citations in Scopus and the timing of economics and finance research predict citation in policy documents in Brazil?

Carlos Vílchez-Román; Ronaldo Ferreira de Araujo

doi:10.22477/ix.ebbc.368

Autores

Carlos Vílchez-Román Centro de Altos Estudios Nacionales (CAEN) https://orcid.org/0000-0002-6802-053X
Ronaldo Ferreira de Araujo Leiden University https://orcid.org/0000-0003-0778-9561

DOI:

https://doi.org/10.22477/ix.ebbc.368

Palavras-chave:

Economics research, Brazilian policymaking, Negative binomial regression

Resumo

This study delves into the impact of Brazilian academic research on policymaking by analyzing citations in academic and policy document databases (2002 to 2022). Employing Scopus and Overton databases, we identified 2,258 studies that mentioned Brazil in the abstract field and prioritized 487 research papers cited by Brazilian policy sources. A key finding was the emergence of the Instituto de Pesquisa Econômica Aplicada (IPEA) as a dominant source, indicating its pivotal role in shaping Brazilian policymaking. Our multivariate analysis revealed a significant correlation between citations in Scopus and policy documents. At the same time, our negative binomial regression highlighted the influence of economics and finance studies on policy citations, emphasizing academic popularity over publication timing.

Referências

ALVAREZ-RISCO, Aldo; DEL-AGUILA-ARCENTALES, Shyla; YÁÑEZ, Jaime A. Telemedicine in Peru as a result of the COVID-19 pandemic: Perspective from a country with limited internet access. American Journal of Tropical Medicine and Hygiene, Arlington, v. 105, n. 1, p. 6-11, May. 2021. DOI: https://doi. org/10.4269/ajtmh.21-0255. Available at: https://www.ajtmh.org/view/journals/tpmd/105/1/article-p6. xml. Accessed on: 08 Mar. 2024.

AMARANTE, Verónica; BRUN, Martín. Cash transfers in Latin America: Effects on poverty and redistribution. Economia LACEA Journal, London, v. 19, n. 1, p. 1-31, Oct. 2018. DOI: https://doi.org/10.1353/ eco.2018.0006. Available at: https://economia.lse.ac.uk/articles/10.1353/eco.2018.0006. Accessed on: 08 Mar. 2024.

ANGRIST, Joshua; BETTINGER, Eric; BLOOM, Erik; KING, Elizabeth; KREMER, Michael. Vouchers for private schooling in Colombia: Evidence from a randomized natural experiment. American Economic Review, Washington, v. 92, n. 5, p. 1535-1558, Dec. 2002. DOI: https://doi.org/10.1257/000282802762024629. Available at: https://www.aeaweb.org/articles? id=10.1257/000282802762024629. Accessed on: 08 Mar. 2024.

ANGRIST, Joshua; BETTINGER, Eric; KREMER, Michael. Long-term educational consequences of secondary school vouchers: Evidence from administrative records in Colombia. American Economic Review, Washington, v. 96, n. 3, p. 847-862, Jun. 2008. DOI: https://doi.org/10.1257/aer.96.3.847. Available at: https://www.aeaweb.org/articles?id=10.1257/aer.96.3.847. Accessed on: 08 Mar. 2024.

BORNMANN, Lutz. What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society for Information Science, Hoboken, v. 64, n. 2, p 217-233, Feb. 2013. DOI: https://doi.org/10.1002/asi.22803. Available at: https://onlinelibrary.wiley.com/doi/10.1002/ asi.22803. Accessed on: 09 Mar. 2024.

BORNMANN, Lutz; HAUNSCHILD, Robin; Marx, Werner. Policy documents as sources for measuring societal impact: How often is climate change research mentioned in policy-related documents? Scientometrics, Dordrecht, v. 109, n. 3, p. 1477-1495, Sep. 2016. DOI: https://doi.org/10.1007/s11192-016- 2115-y. Available at: https://link.springer.com/article/10.1007/s11192-016-2115-y. Accessed on: 09 Mar. 2024.

CHEN, Chaomei. Predictive effects of structural variation on citation counts. Journal of the American Society for Information Science and Technology, Hoboken, v. 63, n. 3, p. 431-449, Mar. 2012. DOI: https://doi.org/10.1002/asi.21694. Available at: https://onlinelibrary.wiley.com/doi/10.1002/asi.21694. Accessed on: 10 Feb. 2024.

JAMESON, Kenneth P. The indigenous movement in Ecuador: The struggle for a plurinational state. Latin American Perspectives, v. 38, n. 1., p. 63-73, Jan. 2011. DOI: https://doi.org/10.1177/0094582X10384210. Available at: https://journals.sagepub.com/ doi/10.1177/0094582X10384210. Accessed on: 08 Mar. 2024.

KASSAB, Omar; Bornmann, Lutz; Haunschild, Robin. Can altmetrics reflect societal impact considerations? Exploring the potential of altmetrics in the context of a sustainability science research center. Quantitative Science Studies, Cambridge, v. 1, n. 2, p. 792-809, Spring 2020. DOI: https://doi. org/10.1162/qss_a_00032. Available at: https://direct.mit.edu/qss/article/1/2/792/96132/Can-altmetrics-reflect-societal-impact. Accessed on: 09 Mar. 2024.

LARA, Bernardo; MIZALA, Alejandra; REPETTO, Andrea. The effectiveness of private voucher education: Evidence from structural school switches. Educational Evaluation and Policy Analysis, v. 33, n. 2, p. 119-137; Jun. 2011. DOI: https://doi.org/10.3102/0162373711402990. Available at: https://journals. sagepub.com/doi/10.3102/0162373711402990. Accessed on: 08 Mar. 2024.

LEBEL, Jean; McLEAN, Robert. A better measure of research from the Global South. Nature, London, v. 559, n. 7712, p. 23-26, Jul. 2018. DOI: https://doi.org/10.1038/d41586-018-05581-4. Available at: https:// www.nature.com/articles/d41586-018-05581-4. Accessed on: 08 Mar. 2024.

Mc DONALD, John D. Understanding journal usage: A statistical analysis of citation and use. Journal of the American Society for Information Science and Technology, Hoboken, v. 58, n. 1, p. 39-50, Jan. 2007. DOI: https://doi.org/10.1002/asi.20420. Available at: https://onlinelibrary.wiley.com/doi/10.1002/ asi.20420. Accessed on: 10 Feb. 2024.

MESTANZA-RAMÓN, Carlos; CUENCA-CUMBICUS, Jefferson; D’ORIO, Giovanni et al. Gold mining in the Amazon region of Ecuador: History and a review of its socio-environmental impacts. Land, Basel, v. 11, n. 2, 221, Feb. 2022. DOI: https://doi.org/10.3390/land11020221. Available at: https://www.mdpi.com/2073-445X/11/2/221. Accessed on: 08 Mar. 2024.

MIZALA, Alejandra; TORCHE, Florencia. Bringing the schools back in: The stratification of educational achievement in the Chilean voucher system. International Journal of Educational Development, Amsterdam, v. 32, n. 1, p. 132-144, Jan. 2012. DOI: https://doi.org/10.1016/j.ijedudev.2010.09.004. Available at: https://linkinghub.elsevier.com/retrieve/pii/S0738059310001367. Accessed on: 08 Mar. 2024.

MOLYNEUX, Maxine; THOMSON, Marilyn. Cash transfers, gender equity and women’s empowerment in Peru, Ecuador and Bolivia. Gender & Development, London, v. 19, n. 2, p. 195-212, Jul. 2011. DOI: https://doi.org/10.1080/13552074.2011.592631. Available at: https://www.tandfonline.com/doi/full/10. 1080/13552074.2011.592631. Accessed on: 08 Mar. 2024.

PINHEIRO, Henrique; VIGNOLA-GAGNÉ, Etienne; CAMPBELL, David. A large-scale validation of the relationship between cross-disciplinary research and its uptake in policy-related documents, using the novel Overton altmetrics database. Quantitative Science Studies, Cambridge, v. 2, n. 2, p. 616- 642, Jul. 2021. DOI: https://doi.org/10.1162/qss_a_00137. Available at: https://direct.mit.edu/qss/article/2/2/616/101030/A-large-scale-validation-of-the-relationship. Accessed on: 08 Mar. 2024.

SZOMSZOR, Martin; ADIE, Euan. Overton: A bibliometric database of policy documents citations. Quantitative Science Studies, Cambridge, v. 3, n. 3, p. 624-650, Nov. 2022. DOI: https://doi.org/10.1162/ qss_a_00204. Available at: https://direct.mit.edu/qss/article/3/3/624/112760/Overton-A-bibliometric- -database-of-policy-document. Accessed on: 08 Mar. 2024.

WALTERS, Glenn D. Predicting subsequent citations to articles published in twelve crime-psychology journals: Author impact versus journal impact. Scientometrics, Dordrecht, v. 69, p. 499-510, Dec. 2006. DOI: https://doi.org/10.1007/s11192-006-0166-1. Available at: https://link.springer.com/article/10.1007/s11192-006-0166-1. Accessed on: 10 Feb. 2024.

YANG, Chao; HUANG, Cui. Target-oriented policy diffusion analysis: A case study of China’s information technology policy. Scientometrics, Dordrecht, v. 129, n. 3, p. 1347-1376, Feb. 2024. DOI: https://doi.org/10.1007/s11192-023-04895-z. Available at: https://ideas.repec.org/a/spr/scient/ v129y2024i3d10.1007_s11192-023-04895-z.html. Accessed on: 09 Mar. 2024.

ZONG, Qianjin; HUANG, Zhihong; HUANG, Jiaru. Can open access increase LIS researcher’s policy impact? Using regression analysis and causal inference. Scientometrics, Dordrecht, v. 128, n. 8, p. 4825- 4854, May. 2023. DOI: https://doi.org/10.1007/s11192-023-04750-1. Available at: https://ideas.repec. org/a/spr/scient/v128y2023i8d10.1007_s11192-023-04750-1.html. Accessed on: 09 Mar. 2024.