Research Papers

Subject Area Risk Assessment of Four Hungarian Universities with a View to the QS University Rankings by Subject

  • Péter Sasvári , 1, 2, ,
  • Anna Urbanovics 1
Expand
  • 1Public Governance and International Studies, University of Public Service, Hungary
  • 2University of Miskolc, Hungary
†Péter Sasvári (Email:, ORCID: 0000-0002-4031-4843).

Received date: 2022-06-21

  Revised date: 2022-10-20

  Accepted date: 2022-10-24

  Online published: 2022-11-11

Abstract

Purpose: The aim of our paper is to investigate the role of a mentor leading a research team in the overall scientific performance of an academic institution and the possible risks of their departure with a special attention to their publication output.

Design/methodology/approach: By using SciVal subject area data, we composed a formula describing the level of vulnerability of any given university in the case of losing any of its leading mentors, identifying other risk factors by dividing their careers into separate stages.

Findings: It turns out that the higher field-weighed citation impact is, the better position universities reach in the rankings by subject and the vulnerability of institutions highly depends on the mentors, especially in view of their contribution to the topic clusters.

Research limitations: The analysis covers the publication output of leading researchers working at four Hungarian universities, the scope of the analysis is worth being extended.

Practical implications: Our analysis has the potential to give an applicable systemic approach as well as a data collection scheme to university managements so as to formulate an inclusive and comprehensive research strategy involving the introduction of a reward system aimed at publications and further encouraging national and international research cooperation.

Originality/value: The methodology and the principles of risk assessment laid down in our paper are not restricted to measuring the vulnerability level of a limited group of academic institutions, they can be appropriately used for investigating the role of mentors or leading researchers at every university across the globe.

Cite this article

Péter Sasvári , Anna Urbanovics . Subject Area Risk Assessment of Four Hungarian Universities with a View to the QS University Rankings by Subject[J]. Journal of Data and Information Science, 2022 , 7(4) : 61 -80 . DOI: 10.2478/jdis-2022-0023

1 Introduction

After the turn of the millennium, the emergence of global media rankings transformed university operations and priorities. Universities are at the intersection of global and national ranking benchmarks, which is mostly a communication challenge for them and an interpretative challenge for their users (Johnes, 2018). One of the most well-known of these rankings is the QS ranking (QS World University Rankings), which publishes not only general but also field-specific rankings annually (URL1). The latter is also attracting increasing attention because, unlike the general rankings, the rankings by subject provide an opportunity to compare institutions with similar structures and a similar disciplinary focus (García et al., 2012; López-Illescas et al., 2011). Primarily, the requirement to be ranked and to move up in the rankings has also emerged in Hungary among institutions that have moved to a foundation structure. The drastic restructuring of the Hungarian higher education system began in 2019-2020, however the “shift of university governance models” is just one element of the restructuring, it plays a core role in achieving a higher competitiveness and a more flexible operating model according to the Hungarian government. Restructuring the university system means that they are transformed from a state-funded institution into one that is maintained by a non-profit foundation. Through this change, the foundation controls the funding of the university, its operations, and maintains the rights of the university. The government managed, on the one hand, to step away from directly funding the university, while on the other hand, it has endowed the university with formerly publicly-held assets. With all these, the key goals are to empower the universities to play a central role in research, development, and innovation, as well as to strengthen their inter-institutional, corporate, and international relations in order to make Hungary a regional knowledge center (URL2). Hungarian universities with funding have made commitments (for extra resources) to a steady increase in Scopus (and Web of Science) indexed publications over the next 5 years.
The development of world-class universities is high on the policy agenda of the stakeholders in higher education around the world (Altbach & Balán, 2007). Several reforms can be studied both at the national and institutional levels in the quest for academic excellence, while these policy concerns let reinforce the role of university rankings (Salmi, 2009). In parallel, in the last decades, a growing number of nations introduced national policies in higher education dedicated to higher competitiveness. The same process can be observed in Hungary through the shift of governance models of universities. Usually, these policies are based on the peer-reviewed method, while rankings are centered around the research performance as well. Performances of universities are compared at the discipline level and not at the individual level, allowing a more rational comparison of universities having similar research profiles (Abramo et al., 2012). In this highly competitive environment, universities are exposed to their top scientists in producing high-quality publications and maintaining competitive research performance. This led universities to introduce risk assessment techniques, based on the following criteria (Syreyshchikova et al., 2020):
- systematic approach;
- continuous improvement;
- process approach;
- the contribution of efficient use of assets and resources;
- lowering the degree of uncertainty in the less critical aspects of the university's activities;
- protection of property interest and the creation and improvement of the university image;
- staff development and the creation of the institutional management knowledge database;
- optimization of business processes.
The risk concerning the educational field lies in the lack of meeting stakeholder expectations and goals, which depends on the quality of education received and the research capacities of the staff (Girdzijauskaite et al. 2019; Shatunova et al., 2019). In educational activities, the objects of risk management are the following processes: resource management, management of innovative and scientific and methodological activities, personnel management, the provision of educational services, procurement management, maintenance, disposal, and repair management (Suray et al., 2019). Risk assessment also deals with keeping up the position of universities in international university rankings.
As the question of competitiveness emerges, it is essential to study further the tools and strategies universities can use to maintain and increase their position in the international university rankings being important measuring tools in today's highly globalized and competition-centered higher education sphere (Altbach, 2012). Although risk assessment is widely used by universities, including academic risks, there has been only a handful of studies focusing on the research contribution of the mentors. In their remarkable study, Piro, Rørstad, and Aksnes (2016) investigated the mentors' contribution to their institution or department through their citation impact and found that the overall effect of the most prolific professors or mentors on their institution's citation impact was quite moderate and greatly varied by scientific fields as well as research topics.
In alignment with these, the main research questions of the study are the following:
To what extent are the institutions exposed to the attrition of their mentors, and are there already signs that the institutions will be able to replace them with other mentors?
The paper is divided into six sections. After the introduction, the second chapter maps the current literature on the significance of building an institutional-level research strategy. It includes argumentations about the role of mentors in successfully implementing the research strategy. The methodology is described in the third section introducing the general overview of the analyzed universities, the methodology of QS ranking by subjects, and the methodology of calculation of the risk assessment giving the core of this empirical analysis. The fifth section presents the research results, while the conclusions are drawn in the final section.

2 The significance of the institutional-level research strategy

Aboagye and co-authors (2021) have shown that institutional governance promotes the improvement of academic performance. They identified the following instruments:
- a research plan defined at the institutional level,
- human resources management from a strategic perspective,
- formally designated mentors,
- well-functioning and continuously developed colleague relations, both within and between organizational units,
- less teaching and administrative work for researchers,
- appropriate financial and infrastructural conditions.
It is also the responsibility of the university management to support the work of the research teams and the mentors leading them to implement the research strategy (Felisberti & Sear, 2014). Research teams sustain the scientific output of the institution, producing publications with greater impact and more references (Wuchty et al., 2007).
It is worth noting here that the literature divides a research career into several stages. Super (1980) distinguished five stages in the life cycle:
1. growth (interest and curiosity; 0-14 years),
2. discovery (definition and implementation; 15-24 years),
3. settlement (consolidation and progression; 25-44 years),
4. sustaining (upgrading and innovation; 45-65 years), and
5. decline or separation (slowing down and preparing for retirement; age 65 and over).
Hall and Chandler (2007) identified the following four career stages:
1. discovery (discovering the identity of the researcher),
2. probationary period (pathfinding and identity foundation),
3. settlement (immersing in career-specific tasks), and
4. becoming a master (becoming an honorary member of the organization).
Within a given career stage, there may be a number of smaller “mini-cycles”, which provide opportunities for the redesign. Due to the different roles and responsibilities that characterize the stages of a research career, institutions should consider the strategic tools they can use to offer their employees a satisfying and motivating career. The process of academic career progression determines not only research positions but also teaching and administrative positions (Baldwin & Blackburn, 1981).
Within each research team, work is organized along different roles. While the younger researchers play a follow-up role in the project, the older, senior researchers play a project designer and leadership role. The study of the role of leaders is a popular topic in management and organization studies. Research on this topic demonstrates that leaders play a significant role in achieving organizational performance (Hermalin, 2012; Van der Heijden et al., 2006). However, leaders are highly mobile within an organization, often joining other organizations or being lost to retirement, illness, or death, after which their replacement poses a challenge for the organization.
The key tasks of mentors in these research teams are:
- Researching strategy and the appropriate allocation of tasks among the members of the research team,
- managing and coordinating cooperation, motivating members of the research team towards a common goal,
- supporting and communicating expectations to research team members.
The mentor is described in the literature as the lead researcher who takes up a central position in the overall network—he or she has a direct relationship with the members of the research team and is also the most productive researcher in the network (Hayat et al., 2020).
From the institution's point of view, the organizational work of mentors is essential in the implementation of research strategies. These senior, leading researchers also ensure the functioning of the research teams and sustaining of scientific output. It is precisely for this reason their absence places a considerable burden on the organization and makes it a challenge to replace them. The work of Győrffy et al. (2020) highlights that the peak of a research career comes decades after the start of a research career, at the age of 48-49. This shows that “training” new mentors and preparing them for leadership roles are quite time-consuming for the institution. It is also important for institutional strategies that active researchers do not change their research field during their career, which they try to limit by means of grants and by following up research proposals (Zeng et al., 2019).
As already indicated above, it has become a priority for foundation universities to be ranked and to move up the rankings, not only to get into the rankings but to maintain the performance continuously and move up in them. As academic performance at the institutional level does not depend on a single author, it is worth looking at well-functioning, productive research teams that contribute to publication performance if universities seek to avoid taking the unnecessary risk of a measurable decrease in scientific output. By the working definition of this paper, the risk is the potential loss of a number of publications written by a lead researcher or by the members of a research team led by a mentor. Age risk refers to lead researchers and mentors heading towards the end of their academic careers; in other words, the older a mentor gets, the more likely their scientific performance suffers as a result of either retirement, a chronic illness, or a lack of ambition. If a lead researcher contributes to the majority of publications in a given topic or topic cluster, their withdrawal from the university as an author, regardless of its reason, poses a double risk to the university in the form of an almost disproportionately high loss in the number of publications. Therefore, it is in the best interest of universities to map these productive teams and identify the authors who connect and coordinate them, often in a mentoring role, and then to assess the number and age risk of publications by lead researchers and mentors in each topic cluster. It should be a priority for universities to develop an appropriate strategy because researchers standing at different stages of their careers can only be retained by universities through different motivational tools and different tasks (Brazeu & Woodward, 2012). It is also important to note however that, mentors have a core role in maintaining the publication performance of the university—not just being productive authors but serving as a bridge to connect other authors—a more inclusive and comprehensive research strategy is required to maintain the prominent ranking of universities.

3 Methodology

The framework for the present analysis is the QS rankings by subject so it is worth briefly reviewing its methodology. The QS is organized along six pillars. The two most important of these are the reputation and the volume of references of the researchers at the university under review, and the others are
- the esteem of the employer,
- the university faculty/student ratio,
- the ratio of foreign students,
- the number of foreign employees.
For the subject-specific QS ranking, lists are published in 5 disciplines divided into 51 science categories. Four components are used to rank universities by specialization for QS:
- Academic reputation,
- Employer reputation,
- Number of references per publication,
- H-index.
Four universities in Hungary were included in the study:
- Semmelweis University
- University of Debrecen
- University of Szeged
- University of Pécs
Their position in the QS rankings by subject is summarised in Table 1.
Table 1. Change in the QS rankings by subject of the four universities studied between 2019 and 2022.
Name of university Discipline (ranking) 2019 2020 2021 2022
SE Anatomy and Physiology (Ana) N.A. 51-100 N.A. 101-140
Medicine (Med) 201-250 201-250 201-250 201-250
Pharmacy and Pharmacology (Phar) 151-200 151-200 201-250 201-250
SZTE Computer and Information Systems (Com) 501-550 501-550 551-600 651-670
Agriculture and Forestry (Agr) N.A. 301-350 N.A. 351-400
Biological Sciences (Bio) 451-500 501-550 501-550 451-500
Medicine (Med) 301-350 301-350 351-400 351-400
Pharmacy and Pharmacology (Phar) N.A. N.A. N.A. 301-350
Chemistry (Che) N.A. 501-550 551-600 501-550
Mathematics (Mat) N.A. N.A. N.A. 401-450
Physics and Astronomy (Phy) N.A. N.A. 551-600 501-550
DE Agriculture and Forestry (Agr) 251-300 151-200 N.A. 201-250
Biological Sciences (Bio) 401-450 401-450 451-500 451-500
Medicine (Med) 301-350 301-350 351-400 351-400
Mathematics (Mat) N.A. N.A. N.A. 501-520
Physics and Astronomy (Phy) N.A. 551-600 501-550 451-500
PTE Medicine (Med) 351-400 351-400 351-400 351-400

Source: QS Ranking

The four institutions studied are among the best-positioned universities in higher education in Hungary. The University of Szeged (SZTE) and the University of Debrecen (DE) have a multidisciplinary profile, while Semmelweis University (SE) is specialized in Life Sciences. The University of Pécs (PTE) is ranked exclusively in the field of Medicine. A common feature of the universities is that they are all ranked in the field of Medicine.
The empirical study draws on data from SciVal's research support online platform. SciVal is a tool that draws on data from the Scopus database, allowing the overview, tracking, trending, and comparison of different units (researchers, institutions, publications, countries, and subject areas).
The Scopus and Scimago classification distinguishes 27 scientific disciplines and 330 science categories. The science categories can be further broken down into 1,500 topic clusters (TC). The topic clusters consist of 97,000 topics (T) altogether. Three keywords are used to describe the topic clusters and topics in SciVal. Topics contain more than 70 million publications in Scopus.
Topics (T) and topic clusters (TC) can be characterized by
- the number of publications,
- the distribution of publications by co-authorship,
- the Field-Weighted Citation Impact (FWCI),
- the number of institutional authors and their prevalence.
In SciVal, the Field-Weighted Citation Impact (FWCI) indicates how the number of citations received for a publication or a topic or topic cluster (entities for short) or author's publications compares to the average number of citations received for all other similar publications in the same discipline, or, in simpler terms, how the number of citations received for the entity's publications compares to the world average. An FWCI of 1.00 indicates that the number of citations received for the entity's publications is exactly what would be expected based on the global average of similar publications; the FWCI for the “World”, i.e., the entire Scopus database. An FWCI greater than 1.00 means that the citations of the publications are above the global average, for example, an FWCI value of 2.11 means 111% more than the world average. An FWCI value below 1.00 means that the citation value of publications in similar disciplines is below the global average, e.g., an FWCI value of 0.87 means 13% less than the world average.
For a given topic or topic cluster, the name of the institutional author with the most publications and the number of publications can be determined. In other words, the author who co-authors the most publications on a given topic stands out. They are the mentoring authors (mentors) who take care of a given topic and a given cluster.
As it was discussed in the second chapter, a mentor may pose a significant risk to the university if they take part in a high proportion or they are frequent co-authors of publications in a given topic or topic cluster. The increased level of risk may lead to the vulnerability of the university, which means that the potential loss of a mentor followed by the loss of numerous publications might lead to a drastically reduced publication output, negatively affecting the institution's overall position in the university rankings. Taking this into consideration, the vulnerability of any given university can be calculated using the following formula:
${{S}_{TCmax}}\text{=}\frac{{{x}_{TCmax}}}{z}$
where xTCmax = the number of publications by the author with the most publications for a given topic or topic cluster at a given institution and in a given period,
z = total number of publications for a given topic or topic cluster, for a given institution and period.
sTCmax = percentage risk value (0-100%] for authors with the most publications, for a given topic cluster, for a given institution and period.
A value higher than 50% is considered high risk for sTCmax.
Another risk factor may be the age of the mentor. In the case of
- old age, retirement or superannuation, possible illness or death, and lack of individual motivation for promotion, moral and financial motivation,
- contacting other institutions in the case of young age, possible illness or death (less likely), furthermore lack of individual motivation for promotion, moral and financial motivation
can be a problem. In this paper, based on the international literature, we divided authors or mentors into three broad career stages:
- early stage (age of 25-50),
- middle stage (age of 50-65),
- late stage (age of 65 and over).
Although we relied on the work of Super (1980) and Chandler and Hall (2007) when defining each stage, the specific structure of education and academic progression in Hungary had to be taken into consideration as well (Sasvári et al., 2021). Its significance can mostly be described by the different levels of frequency of publications in each identified stage: in the early stage researchers are more likely to publish a number of papers as it is needed for their academic promotion, in the middle stage, leading authors still publish regularly while organizing and operating a well-functioning research team or network, and finally, the late stage can be characterized by a declining number of occasional publications or complete withdrawal.

4 Research results

The exposure of the four universities to the QS rankings by subject was assessed along the following criteria:
- Position in the QS rankings by subject,
- Subject areas and their distribution,
- Connection of publications in the subject area by QS rankings by subject,
- Details of the members and the mentor of the research team working on a given subject area.
The scientometrics of the topic clusters of each university surveyed that can be considered in the QS rankings by subject are summarised in Table 2. It shows that SE, SZTE, and DE have similar numbers of publications, while PTE has a lower number of publications in these rankings. For each of these institutions, most of the publications considered were in the field of Medicine. In terms of the number of authors, SE stands out with more than 5,000 authors. SE also leads in terms of the number of references, followed by SZTE, DE, and PTE. Accordingly, SE stands out in terms of the number of references per publication. The main indicator in the table is the tendency of the FWCI values, for which the ranking between institutions is similar. However, it is worth highlighting that the FWCI values are around average in all cases, with only certain specializations standing out. Among these, the field of Physics and Astronomy at SZTE (4.88) stands out, while DE has a FWCI of 2.28 in the same specialization. Relatively lower FWCI values are found in the fields of Computer Science and Information Systems and Mathematics at SZTE and Mathematics at DE.
Table 2. Key science metrics for the universities surveyed between 2016 and 2021.
Name of university Discipline Number of publications (pcs) Number of authors (persons) Field-Weighted Citation Impact (FWCI) Number of references (pcs) Number of citations per communication (number per communication) h5 index
SE Total (T) 8,470 5,127 1.72 136,413 16.1 95
Anatomy and Physiology 425 672 1.60 7,618 17.9 31
Medicine 6,206 4,304 1.84 102,555 16.5 89
Pharmacy and Pharmacology 791 993 1.19 8,066 10.2 28
SZTE Total (T) 8,471 4,590 1.53 130,640 15.4 78
Computer and Information Systems 913 805 0.77 3,975 4.4 15
Agriculture and Forestry 532 614 1.20 4,873 9.2 22
Biological Sciences 1,695 1,784 1.25 23,281 13.7 39
Medicine 2,945 2,516 1.49 37,714 12.8 49
Pharmacy and Pharmacology 763 935 1.14 7,691 10.1 26
Chemistry 1,294 1,186 0.93 14,106 10.9 35
Mathematics 657 350 0.70 2,026 3.1 13
Physics and Astronomy 813 645 4.88 52,418 64.5 58
DE Total (T) 8,309 4,635 1.27 98,670 11.9 77
Agriculture and Forestry 1,087 1,013 1.19 10,386 9.6 30
Biological Sciences 1,730 1,888 1.26 27,813 16.1 46
Medicine 2,652 2,495 1.34 33,880 12.8 57
Mathematics 694 351 0.71 2,107 3.0 12
Physics and Astronomy 1,144 446 2.28 24,823 21.7 59
PTE Total (T) 5,273 3,411 1.25 58,622 11.1 61
Medicine 2,512 2,197 1.67 39,377 15.7 52

Source: SciVal

Table 3 shows the concentration of each topic and topic cluster in the universities surveyed. In the case of the two larger universities, SZTE and DE, both the number of topic clusters and the number of topics are higher than for the other two institutions. This is also due to the fact that they can be found in more than one rankings by subject at the same time, as they have more topics simultaneously than the discipline-specific SE or PTE that is prominent in the Medical Sciences. However, if we look at the clusters of Medical Sciences as a point of comparison, we can see that within these, SE has the most topic clusters (458), while SZTE, DE, and PTE are present with fewer topic clusters. The same order can be observed but with a significantly larger variation among institutions in terms of the number of topics. In the field of Medicine, SE is active in 3,138 topics, while SZTE is active in 1,857. Concentration can be measured by the number of topic clusters accounting for 50% of the publications published by the university. This shows that SZTE (106) and PTE (104) are more fragmented, while the strongest concentration is observed in SE. When compared to the total number of topic clusters, we can see that in general, 10% of the topic clusters account for 50% of the scientific output of the university. In comparison, DE is slightly more concentrated (9.53%), while PTE (12.7%) is more fragmented.
Table 3. Data on the topic cluster of the universities surveyed between 2016 and 2021.
Name of university Discipline Number of topic clusters (pcs) Number of topics (pcs) Number of topic clusters included in the study (pcs) (including 50% of the communications)
SE Total 708 3,709 71
Anatomy and Physiology 28 189 2
Medicine 458 3,138 65
Pharmacy and Pharmacology 95 509 5
SZTE Total 990 3,828 106
Computer and Information Systems 98 346 12
Agriculture and Forestry 136 439 10
Biological Sciences 277 1,163 32
Medicine 418 1,857 50
Pharmacy and Pharmacology 91 461 12
Chemistry 169 659 18
Mathematics 58 233 9
Physics and Astronomy 131 446 11
DE Total 986 3,672 94
Agriculture and Forestry 159 675 17
Biological Sciences 277 1,161 35
Medicine 393 1,643 44
Mathematics 55 194 6
Physics and Astronomy 121 316 9
PTE Total 815 2,743 104
Medicine 384 1,605 65

Source: Scival

Figure 1 shows the age distribution of mentors in the four universities. Overall, there are no major differences in age among the researchers surveyed. The average age is the lowest at SZTE with 52.9 years and the highest at PTE with 55.5 years. The median age is also the lowest at SZTE (51 years), while the median age at the other three universities is 54 years.
Figure 1. Age distribution of mentors by age in the most popular topic clusters in the universities surveyed.

Source: Scival

Figure 2 shows the levels of risk at the four surveyed universities in each topic cluster. At the bottom left corner, those topic clusters are shown that pose the lowest level of risk to the universities, and topic clusters with the highest risk are shown at the top right corner. The varying size of circles express the level of risk in percentage, that is, the bigger the circle is, the higher the rate of risk is measured. A more detailed summary of the results of the risk analysis can be found in Table 4 in the Appendix. The first column in Figure 2 shows low-risk topic clusters (below 50%), while the second one reveals high-risk topic clusters (above 50%). The latter column can be considered to be a double risk, i.e., it is considered to be risky according to both the age of the mentor and the extent of his or her contribution to the cluster. Overall, we can see that SE has the lowest risk cluster (30%), followed by SZTE (28%), DE (28%), and PTE (19%). These are topic clusters that can be sustained in the longer term. The highest proportion of topic clusters with double risk is found in PTE (13%) and the lowest in SE (1%). Due to the extent of mentor input, the institutions surveyed have a similar proportion of high-risk topic clusters, for example, 40% in PTE (=13%+14%+13%; including double-risk clusters as well). The pattern is different in SE (14%=6%+7%+1%). The critical points by specialization are as follows:
Figure 2. The levels of risk measured at the four surveyed universities in the identified topic clusters expressed in percentage.

Source: Scival, MTMT

Table 4. Results of the risk analysis of the universities surveyed between 2016 and 2021.
Name of university Discipline Mentor
25 to 50 years of age 50 to 65 years of age 65 years old and over
0-50%
I.
Above
50%
II.
0-50%
III.
Above
50%
IV.
0-50%
V.
Above
50%
VI.
SE Total 21 4 29 5 11 1
Anatomy and Physiology 1 0 0 0 1 0
Medicine 19 4 26 5 11 0
Pharmacy and Pharmacology 0 1 2 0 1 1
SZTE Total 30 11 23 18 17 7
Computer and Information Systems 3 3 1 2 2 1
Agriculture and Forestry 3 3 1 1 2 2
Biological Sciences 11 3 6 4 6 2
Medicine 11 4 12 10 9 4
Pharmacy and Pharmacology 5 1 1 0 3 2
Chemistry 4 1 6 3 4 0
Mathematics 0 2 1 2 1 3
Physics and Astronomy 2 1 6 1 1 0
DE Total 26 10 20 13 14 11
Agriculture and Forestry 8 2 2 1 3 1
Biological Sciences 6 4 11 5 5 4
Medicine 11 3 12 8 6 4
Mathematics 1 0 3 0 1 1
Physics and Astronomy 1 4 1 1 1 1
PTE Total 20 13 26 14 17 13
Medicine 13 7 22 7 10 5
SE Total 30% 6% 41% 7% 15% 1%
Anatomy and Physiology 50% 0% 0% 0% 50% 0%
Medicine 29% 6% 40% 8% 17% 0%
Pharmacy and Pharmacology 0% 20% 40% 0% 20% 20%
SZTE Total 28% 10% 22% 17% 16% 7%
Computer and Information Systems 25% 25% 8% 17% 17% 8%
Agriculture and Forestry 25% 25% 8% 8% 17% 17%
Biological Sciences 34% 9% 19% 13% 19% 6%
Medicine 22% 8% 24% 20% 18% 8%
Pharmacy and Pharmacology 42% 8% 8% 0% 25% 17%
Chemistry 22% 6% 33% 17% 22% 0%
Mathematics 0% 22% 11% 22% 11% 33%
Physics and Astronomy 18% 9% 55% 9% 9% 0%
DE Total 28% 11% 21% 14% 15% 12%
Agriculture and Forestry 47% 12% 12% 6% 18% 6%
Biological Sciences 17% 11% 31% 14% 14% 11%
Medicine 25% 7% 27% 18% 14% 9%
Mathematics 17% 0% 50% 0% 17% 17%
Physics and Astronomy 11% 44% 11% 11% 11% 11%
PTE Total 19% 13% 25% 14% 17% 13%
Medicine 20% 11% 34% 11% 16% 8%

Source: Scival, MTMT

- in the case of SE, in Anatomy and Physiology 50% (column V in the table, 1 topic cluster) due to the age of the mentor,
- in the field of Mathematics at SZTE, 33% (column VI) of the topic clusters have double-risk, furthermore 44% (=22%+22%) are at risk due to mentor contribution,
- in the field of Computer Science and Information Systems at SZTE, 42% of topic clusters are at risk due to mentor contribution (=25%+17%),
- at DE, in Physics and Astronomy, 55% (=44%+11%) of topic clusters are at risk due to mentor contribution,
- at DE, the ratio of double-risk topic clusters in Mathematics is 17%,
- at PTE, 27% (=13%+14%) of topic clusters are at risk due to mentor contribution.
SE is the best overall performer. DE and SZTE are exposed in the field of Mathematics, while SZTE is more at risk in Computer Science and Information Systems and DE in Physics and Astronomy.

5 Conclusions

In the politics of higher education in Hungary, especially among the universities maintained by foundations, getting on, staying present, and achieving more favorable positions in international university rankings over time has become a primary issue. Universities have a better chance of achieving this in certain specializations so for them, it is worth considering the rankings by subject. Hungarian universities are generally small in number and can only focus on specific areas. Research teams in these fields are key to maintaining the performance of the institutions, as only they can ensure sufficient productivity at the international level as well. One of the messages of the study is therefore that universities need to support their research teams and also have a key role to play in the selection of the lead researcher (mentor). Furthermore, as we have seen that the age distribution of mentors is similar both in terms of mean ages and medians of ages, this highlights that it is in fact the distribution of researchers by topic clusters that influences the stability or even the exposure of the institution. This is in line with the primary priority that the composition of the institution's researchers, the motivational factors, and the tasks associated with each career stage should be kept in mind by the university management. By considering these, universities can develop a strategy tailored to their researchers to ensure their competitiveness. Where the contribution of mentors to the leading topic clusters is high, it is worth motivating them towards mentoring and involving young researchers, while at those universities where the contribution of younger researchers is higher, it is worth motivating them with appropriate working conditions. However, identifying the exact elements of this strategy is beyond the scope of this analysis and will be addressed in a future paper.
The analysis looks at four Hungarian universities, two of which have been ranked in several disciplines, while the other two are ranked in the field of Medicine. The selected universities have been ranked in the QS rankings by subject for several years, of which SZTE is ranked in eight, DE in five, SE in three and PTE in one place, respectively. Maintaining these rankings is a priority for the universities, which they can ensure by examining their discipline-specific publication performance and the specificities of their researchers. This is what the analysis has attempted to do, using SciVal data. The results of the measurement can be summarised in a few key findings:
- 10% of the topic clusters managed by researchers at the universities alone account for 50% of the scientific output of the given university. This rule of thumb helps to identify those topic clusters that are represented by a sufficient number of publications to give the university international visibility. At the same time, within each specialization, a number of smaller topics ensure a diversity of research, thus giving researchers scope to add new topics to their portfolio. These minor topics contribute to the better ranking of the institution in the rankings by subjects.
- It is worth looking at the field-weighted citation impact, the higher the number, the better position the university is in the rankings by subject. Areas with a low FWCI value are at greater risk of not being cited enough.
- The exposure of institutions depends largely on the mentors—their age and the extent of their contribution to the cluster. The latter is also critical in the sense that if the cluster loses its current leading researcher, it is time-consuming and costly to recruit a new mentor. These results suggest that SE has a high proportion (71%=30%+41%) of topic clusters with several active researchers and a relatively young mentor. The highest proportion of double-risk topic clusters is associated with DE (33%). For the latter, it is important to recruit new researchers according to topic clusters and to develop them into mentors in time.
We believe that the research strategy of Hungarian universities should be designed by the university management, considering the exposure, because it is not enough to be ranked, they have to stay ranked. It is clearly deriving from our results that the studied universities have a rather elder group of mentors, representing a high risk in maintaining the rank achieved by these universities. In order to keep the prominent position of these universities, it is essential to elaborate an inclusive and comprehensive research strategy with a strong emphasis on talent management and the promotion of young researchers becoming mentors of their disciplines. Building a more inclusive strategy requires the “inclusivity” of publication practice as well, regardless of age, nationality, or status of the researchers. This should be reinforced by new incentives to develop a more comprehensive model of research and publication mentoring, including the development of the proper reward system, facilitating new and already existing international and national cooperation, and a better understanding and inclusive communication about the latest tendencies observed in the international academic community and publishing.
As a final remark, we would like to put an emphasis on the fact that although the empirical analysis presented a case study of four Hungarian universities—being mainly relevant for the Central—Eastern European higher education policy -, the methodology and the concept of risk assessment based on the mentors can be used for every university around the globe.

Funding information

The research was supprted by the Network Science Research Group at the University of Public Service and the Matthias Corvinus Collegium.

Author contributions

Peter Sasvari (sasvari.peter@uni-nke.hu): Conceptualization (Equal), Formal analysis (Equal), Investigation (Equal), Methodology (Equal), Supervision (Equal), Visualization (Equal); Anna Urbanovics (anna.urbanovics@gmail.com): Formal analysis (Equal), Investigation (Equal), Supervision (Equal).
[1]
Aboagye, E., Jensen, I., Bergström, G., Björk Brämberg, E., Pico-Espinosa, O.J., & Björklund, C. (2021). Investigating the association between publication performance and the work environment of university research academics: a systematic review. Scientometrics, 126, 3283-3301. https://doi.org/10.1007/s11192-020-03820-y

DOI

[2]
Altbach, P.G. (2012). The globalization of college and university rankings. Change: the Magazine of Higher Learning, 44, 26-31. https://doi.org/10.1080/00091383.2012.636001

[3]
Altbach, P.G., és, J. Balán. (2007). World Class Worldwide: Transforming Research Universities in Asia and Latin America. Johns Hopkins University Press. https://books.google.com.fj/books?id=YBjvzgEACAAJ

[4]
Baldwin, R.G., & Blackburn, R.T. (1981). The academic career as a developmental process: Implications for higher education. Journal of Higher Education, 52, 598-614. https://doi.org/10.2307/1981769

[5]
Brazeau, Gayle A., & Woodward, Jean M.B. (2012). Rethinking Faculty Career Development Strategies. American Journal of Pharmaceutical Education, 76(6), 101-. https://doi.org/10.5688/ajpe766101

DOI

[6]
Felisberti, F.M., & Sear, R. (2014). Postdoctoral Researchers in the UK: A Snapshot at Factors Affecting Their Research Output. PLoS ONE, 9(4), e93890. https://doi.org/10.1371/journal.pone.0093890

DOI

[7]
García, J.A., Rodríguez-Sánchez, Rosa, Fdez-Valdivia, J., Robinson-García, N., & Torres-Salinas, D. (2012). Mapping academic institutions according to their journal publication profile: Spanish universities as a case study. Journal of the American Society for Information Science and Technology, 63(11), 2328-2340. https://doi.org/10.1002/asi.22735

DOI

[8]
Giovanni, Abramo, Tindaro, Cicero, & Ciriaco Andrea D'Angelo (2012). The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems. Journal of Informetrics, 6(2), 155-168. https://doi.org/10.1016/j.joi.2011.11.007

DOI

[9]
Girdzijauskaite, E., Radzeviciene, A., & Jakubavicius, A. (2019). Impact of international branch campus KPIs on the university competitiveness: FARE method. Insights into Regional Development, 1(2), 171-180. https://doi.org/10.9770/ird.2019.1.2(7)

DOI

[10]
Győrffy, B., Csuka, G., Herman, P., & Török, Á. (2020). Is there a golden age in publication activity?—an analysis of age-related scholarly performance across all scientific disciplines. Scientometrics, 124, 1081-1097. https://doi.org/10.1007/s11192-020-03501-w

DOI

[11]
Hall, D.T., & Chandler, D.E. (2007). Career learning cycles and mentoring. In Ragins, B.R. and Kram, K.E. (Eds), Handbook of Mentoring at Work: Theory, Research, and Practice, Sage Publications, Thousand Oaks, CA, pp. 471-497. ISBN: 9781412916691

[12]
Hayat, D., Shuo, Y., Liangtian, W., Mengyang, W., Kaiyuan, Z., He, G., & Iftikhar, H. (2020). Detecting leaders and key members of scientific teams in co-authorship networks. Computers & Electrical Engineering, 85, 106703-. https://doi.org/10.1016/j.compeleceng.2020.106703

[13]
Hermalin, B.E. (2012). “11. Leadership and Corporate Culture”. The Handbook of Organizational Economics, edited by Robert Gibbons and John Roberts, Princeton: Princeton University Press, 432-478. https://doi.org/10.1515/9781400845354-013

[14]
Jamil, Salmi. (2009). The Challenge of Establishing World-class Universities. World Bank Publications, pp. 115.

[15]
Johnes, J. (2018). University Rankings: What Do They Really Show? Scientometrics, 115, 585-606. https://doi.org/10.1007/s11192-018-2666-1

DOI

[16]
López-Illescas, C., de Moya-Anegón, F., & Moed, H.F. (2011). A ranking of universities should account for differences in their disciplinary specialization. Scientometrics, 88, 563-574. https://doi.org/10.1007/s11192-011-0398-6

DOI

[17]
Nelli, V. Syreyshchikova, Danil Yu. Pimenov, Tadeusz Mikolajczyk, & Liviu Moldovan (2020). Development of a Risk Management Technique in Strategic Planning of Universities. Case study of a Polytechnical Institute, Procedia Manufacturing, 46, 256-262. https://doi.org/10.1016/j.promfg.2020.03.038

DOI

[18]
Piro, F.N., Rørstad, K., & Aksnes, D.W. (2016). How does prolific professors influence on the citation impact of their university departments?. Scientometrics, 107(3), 941-961. https://doi.org/10.1007/s11192-016-1900-y

DOI

[19]
Sasvári, P., Bakacsi, Gy., & Urbanovics, A. (2022). Scientific career tracks and publication performance—relationships discovered in the Hungarian academic promotion system. Heliyon. https://doi.org/10.1016/j.heliyon.2022.e09159

[20]
Shatunova, O., Anisimova, T., Sabirova, F., & Kalimullina, O. 2019. STEAM as an Innovative Educational Technology. Journal of Social Studies Education Research, 10(2), 131-144.

[21]
Super, D.E. (1980). A life-span, life-space approach to career development. Journal of Vocational Behavior, 16, 282-298. https://doi.org/10.1016/0001-8791(80)90056-1

[22]
Suray, N., Karpenko, E., Dubovik, M., Shlyenov, Y., & Sterlikov, F. 2019. Risk management at educational institution. Entrepreneurship and Sustainability Issues, 7(2), 1171-1184. http://doi.org/10.9770/jesi.2019.7.1(26)

[23]
URL1. QS Subject Rankings 2022. https://www.topuniversities.com/subject-rankings/2022Download date: 2022.05.10.

[24]
URL2. The shift in governance models for Hungarian universities. https://cz.boell.org/en/2021/06/14/shift-governance-models-hungarian-universitiesDownload date: 2022.09.05.

[25]
Van der Heijden, E., Potters, J., & Sefton, M. (2006). Hierarchy and Opportunism in Teams, Discussion Papers 2006-15, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham. https://ideas.repec.org/p/not/notcdx/2006-15.html

[26]
Wuchty, S., Jones, B.F., & Uzzi, B. (2007). The Increasing Dominance of Teams in Production of Knowledge. Science, 316(5827), 1036-1039. https://doi.org/10.1126/science.1136099

PMID

[27]
Zeng, A., Shen, Z.S., Zhou, J.L., Fan, Y., Di, Z.R., Wang, Y.G., Stanley, H.E., & Havlin, S. (2019). Increasing trend of scientists to switch between topics. Nature Communications, 10, 3439. https://doi.org/10.1038/s41467-019-11401-8

DOI PMID

Outlines

/

京ICP备05002861号-43

Copyright © 2023 All rights reserved Journal of Data and Information Science

E-mail: jdis@mail.las.ac.cn Add:No.33, Beisihuan Xilu, Haidian District, Beijing 100190, China

Support by Beijing Magtech Co.ltd E-mail: support@magtech.com.cn