The Intellectual Influence of Economic Journals: Quality versus Quantity
by László Kóczy
Co-authored with Alex Nichifor; accepted at Economic Theory
The evaluation of scientific output has a key role in the allocation of research funds and academic positions.... more The evaluation of scientific output has a key role in the allocation of research funds and academic positions. Decisions are often based on quality indicators for academic journals and over the years a handful of scoring methods have been proposed for this purpose. Discussing the most prominent methods (de facto standards) we show that they do not distinguish quality from quantity at article level. The systematic bias we find is analytically tractable and implies that the methods are manipulable. We introduce modified methods that correct for this bias, and use them to provide rankings of economic journals. Our methodology is transparent; our results are replicable.
Changing publication patterns in the Social Sciences and Humanities, 2000–2009
An analysis of the changing publication patterns in the Social Sciences and Humanities (SSH) in the period 2000–2009... more An analysis of the changing publication patterns in the Social Sciences and Humanities (SSH) in the period 2000–2009 is presented on the basis of the VABB-SHW, a full coverage database of peer reviewed publication output in SSH developed for the region of Flanders, Belgium. Data collection took place as part of the Flemish performance-based funding system for university research. The development of the database is described and an overview of its contents presented. In terms of coverage of publications by the Web of Science we observe considerable differences across disciplines in the SSH. The overall growth rate in number of publications is over 62.1%, but varies across disciplines between 7.5 and 172.9%. Publication output grew faster in the Social Sciences than in the Humanities. A steady increase in the number and the proportion of publications in English is observed, going hand in hand with a decline in publishing in Dutch and other languages. However, no overall shift away from book publishing is observed. In the Humanities, the share of book publications even seems to be increasing. The study shows that additional full coverage regional databases are needed to be able to characterise publication output in the SSH.
Google Scholar’s Ranking Algorithm: The Impact of Citation Counts (An Empirical Study)
by Joeran Beel
Joeran Beel and Bela Gipp. Google Scholar’s Ranking Algorithm: The Impact of Citation Counts (An Empirical Study). In André Flory and Martine Collard, editors, Proceedings of the 3rd IEEE International Conference on Research Challenges in Information Science (RCIS’09), pages 439–446, Fez (Morocco), April 2009. IEEE. doi: 10.1109/RCIS.2009.5089308. Downloaded from www.docear.org
Google Scholar is one of the major academic search engines but its ranking algorithm for academic articles is unknown.... more Google Scholar is one of the major academic search engines but its ranking algorithm for academic articles is unknown. In a recent study we partly reverse-engineered the algorithm. This paper presents the results of our second study. While the previous study provided a broad overview, the current study focused on analyzing the correlation of an article’s citation count and its ranking in Google Scholar. For this study, citation counts and rankings of 1,364,757 articles were analyzed. Some results of our first study were confirmed: Citation counts is the highest weighed factor in Google Scholar’s ranking algorithm. Highly cited articles are found significantly more often in higher positions than articles that are cited less often. Therefore, Google Scholar seems to be more suitable for searching standard literature than for gems or articles by authors advancing a view different from the mainstream. However, interesting exceptions for some search queries occurred. In some cases no correlation existed; in others bizarre patterns were recognizable, suggesting that citation counts sometimes have no impact at all on articles’ rankings.
13 views
Seen by:Resultados de investigación científica con visibilidad internacional: México (ISI-WoS, 1990-2004)
Moya-Anegón, F., Chinchilla-Rodríguez, Z., Vargas-Quesada, B., Corera-Álvarez, E., Muñoz-Fernández, F. J. y González-Molina, A. Resultados de investigación científica con visibilidad internacional: México (ISI-WoS, 1990-2004), 2006. In Diagnóstico de la Política Científica, Tecnológica y de Fomento a la Innovación en México (2000-2006). Foro Consultivo Científico y Tecnológico (México). pp.89-157. (Published) [Book Chapter].
The main goal of this study is to describe and analyze the scientific output of Mexico, both at institutional level as... more
The main goal of this study is to describe and analyze the scientific output of Mexico, both at institutional level as thematic distribution, by the use of a set of scientometric indicators for the period 1990-2004 using Web of Science as data source.
El objetivo principal de este estudio es describir y analizar la producción científica de México, tanto a nivel institucional como la distribución temática, por el uso de un conjunto de indicadores cienciométricos para el período 1990-2004 utilizando la Web of Science como fuente de datos.
Producción científica e impacto: ranking general y por áreas de las instituciones universitarias españolas
Corera-Álvarez, E., Chinchilla-Rodríguez, Z., Moya-Anegón, F., y Sanz-Menéndez, L. Producción científica e impacto: ranking general y por áreas de las instituciones universitarias españolas, 2010. In La contribución de las universidades españolas al desarrollo. Informe CyD 2009. Fundación Conocimiento y Desarrollo (Spain). pp.254-262. (Published) [Book Chapter].
The objective is to present the scientific outputs, in terms of scientific publications of the High Education... more
The objective is to present the scientific outputs, in terms of scientific publications of the High Education Institutions (HEI) to locate the universities in a ranking, taking into account: the volume of publications and its relative quality measures by impact indicators using Scopus as source data.
El objetivo de este recuadro es presentar los resultados de investigación, representados éstos por la publicaciones científicas, de las instituciones españolas de educación superior y utilizar los mismos para posicionar a las universidades en un ránking, atendiendo a dos dimensiones esenciales: por un lado, el volumen total de producción científica y, por otro, la calidad relativa, medida a través de indicadores de impacto o citación de esos trabajos. Los datos se han generado a partir de los registros bibliométricos incluidos en la base de datos Scopus.
Producción y colaboración científica en agroalimentación
Chinchilla-Rodríguez, Z., Olmeda-Gómez, C. Producción y colaboración científica en agroalimentación, 2010. In Análisis sobre Ciencia e Innovación en España: Anuario ICONO. Fundación Española para la Ciencia y la Tecnología. pp.366-399. (Published) [Book Chapter].
This chapter presents a multilevel analysis that aims to characterize the generation of knowledge visible... more
This chapter presents a multilevel analysis that aims to characterize the generation of knowledge visible internationally in the field of food and agriculture in Spain during the last fifteen years from the analysis of research results in the terms of scientific publications. From visual representations of scientific information collected in international databases, analyze the patterns of publication and collaboration. It is expected to provide information relevant to decision making in science and technology.
Este capítulo presenta un análisis multinivel que pretende caracterizar la generación de conocimiento visible internacionalmente en el campo de la agroalimentación en España durante los últimos quince años a partir del análisis de los resultados de investigación en forma de publicaciones científicas. A partir de representaciones visuales de la información científica recogida en bases de datos internacionales, se analizan los patrones de publicación y colaboración. Se espera aportar información de interés para la toma de decisiones en materia de ciencia y tecnología.
La producción científica española en el contexto internacional y la posición de sus instituciones de investigación en el ránking mundial
Chinchilla-Rodríguez, Z., Corera-Álvarez, E., Moya-Anegón, F., y Sanz-Menéndez, L. La producción científica española en el contexto internacional y la posición de sus instituciones de investigación en el ránking mundial, 2011. In La contribución de las universidades españolas al desarrollo.. Fundación Conocimiento y Desarrollo (Spain). pp.292-301. (Published) [Book Chapter].
El objetivo de este apartado es presentar los principales indicadores de producción científica españoles, respecto a... more
El objetivo de este apartado es presentar los principales indicadores de producción científica españoles, respecto a la cantidad, calidad y visibilidad, del total de la producción española y del conjunto de instituciones del país. De esta manera, se contextualiza en una perspectiva comparada internacional la posición española, lo que permite un análisis más completo de la situación y su evolución.
The purpose of this section is to present the main Spanish scientific production indicators, regarding the quantity, quality and visibility of the total Spanish production and the whole country's institutions. Thus, it is contextualised in an international comparative perspective the Spanish position, allowing a more complete analysis of the situation and its evolution.
Producción científica e impacto: ránking general y por áreas de las instituciones universitarias españolas (2004-2008)
Corera-Álvarez, E., Chinchilla-Rodríguez, Z., Moya-Anegón, F. y Sanz-Menéndez, L. Producción científica e impacto: ránking general y por áreas de las instituciones universitarias españolas (2004-2008), 2011. In La contribución de las universidades españolas al desarrollo. Fundación Conocimiento y Desarrollo (Spain). pp.283-291. (Published) [Book Chapter].
This chapter refers to the presentation of the results of the scientific production of Spanish institutions of higher... more
This chapter refers to the presentation of the results of the scientific production of Spanish institutions of higher education, from which it is created a ranking, according to three key dimensions: the total volume of scientific production, the relative quality, measured through indicators of impact or citation of this work, and this year, the percentage of papers that have been published in journals ranked by their level of impact in the first quartile of its category (the most prestigious journals)
Este capítulo hace referencia a la presentación de los resultados de la producción científica de las instituciones españolas de educación superior, a partir de los cuales se crea un ránking, atendiendo a tres dimensiones esenciales: el volumen total de producción científica; la calidad relativa, medida a través de indicadores de impacto o citación de esos trabajos, y, este año, el porcentaje de trabajos que se han publicado en revistas clasificadas por su nivel de impacto en el primer cuartil de su categoría (las revistas más prestigiosas).
Technology mapping of the scientific research in biomaterials: a trends study of years 2000-2002.
Co-authored with Marisela Rodriguez-Salvador and Dieter Scharnweber
The maping of spanish social psychology through its conferences: A bibliometric perspective
Íñiguez-Rueda, L.; Martínez, L.; Muñoz-Justicia, J.; Peñaranda, M.; Sahagún,M.; Alvarado, J. (2008). The maping of spanish social psychology through its conferences: A bibliometric perspective. The Spanish Journal of Psychology. 11(1): 137-158.
This study of papers gathered from the proceedings presented at Spanish social psychology conferences explores the use... more
This study of papers gathered from the proceedings presented at Spanish social psychology conferences explores the use of bibliometrics for studying scientific disciplines. A reference database of all the papers included in the conference proceedings of events held from 1983 to 2000 was generated and classified by thematic area, paper type and author institutional affiliation. The references were laid out on contingency tables and mapped with correspondence analysis. The results show that there is a growing number of co-authored papers and a predominance of empirical over theoretical paper types. Some institutions have a higher concentration of theoretical papers while others work mostly in the areas of organizational and health psychology. In terms
of empirical papers, there is a tendency towards generating more qualitative-based studies over the span of time captured by this work. There are also a number of papers written about such areas as cultural psychology that points to the emergence of an interest in critical social psychology. Concluding remarks underline the role of conferences and scientific meetings as an important indicator of the dynamic development of a scientific discipline.
Etude métrique des mémoires en science de l’information au Bénin, 3ème édition
La troisième édition de l’Etude métrique des mémoires en science de l’information au Bénin porte sur 302 mémoires... more
La troisième édition de l’Etude métrique des mémoires en science de l’information au Bénin porte sur 302 mémoires soutenus au CEFOCI de 1984 à 2007. Le tiers n’a jamais cité de monographies, près des deux tiers jamais d’articles de périodique, et la moitié jamais de littérature grise.
Sur 188 mémoires soutenus à partir de 1997 inclus, seulement le tiers a cité au moins une ressource internet. La moitié des mémoires étudiés n’a jamais donné de citations à ses pairs ni reçu d'eux. La première citation reçue est intervenue à l’âge moyen de 2,04 ans. Les mémoires recoivent la moitié de leurs citations possibles au bout de 9 ans ; la demi-vie citante est de 6 ans.
Le réseau de citation est très peu dense et comporte trois composantes connexes dont laplus grande compte 222 éléments. Dix éléments constituent le chemin principal; des 26 mémoires les plus importants, un est soutenu en bibliothéconomie, huit en documentation et dix-sept en archivistique. Cependant, la tradition de recherhce est portée par les mémoires en archivistique ou soutenus sur des documents d’archives.
Attitudes of Academic Members of Iranian Medical Universities towards Factors that Increase h-index and Paper Citations
by Payam Kabiri
Co-authored with: Mesgarpour B, Vasei M , Nasiri I, Aminpour F and Bamdadi F.
Introduction: Nowadays, several indicators are used to evaluate scientific research outputs. The h index is one of the... more
Introduction: Nowadays, several indicators are used to evaluate scientific research outputs. The h index is one of the most common indices taken into account by many authorities to assess individuals and institutions, worldwide. In this study, the attitudes of medical sciences researchers towards significance of factors affecting the h index and citations were investigated.
Methods: At the beginning of 2008, h-indices of all academic members of Iranian medical universities were screened based on the Scopus database. The attitudes of the faculty members who had an h index of one or more were investigated through a self-structured questionnaire in which increasing factors of the h index and paper citations was assessed. The data were analyzed using statistical methods.
Results: The response rate was about 37%. The respondents’ attitudes toward the items were not different between the the group whose h-index was more than 6 to the other group whose h-index was less than 6. They respondents believed that publishing in high Impact Factor journals, well-designed researches considering the methodology, and to be the 1st study of its subject in the country and the world, are the most important factors in achieving citations. They did not believe that publishing review articles, contributing internationally, and having frequent paper topics were important in gaining citations.
Conclusion: It seems that our researchers were not aware of the importance of publishing review articles and also in Open Access journals to increase citation rates. Proper interventions should be conducted to correct this attitude in order to increase the country’s and researchers’ citations.
8 views
Seen by:
