The University of Graz is not alone in its work on the Activity Framework. Numerous initiatives, some of them global in scope, have taken up the topic of ‘performance reporting’ or ‘performance assessment’. Some countries and universities have already implemented their own approaches to the new performance reporting system.
In 2022, the University of Graz became the first Austrian university to sign up for CoARA membership. This entails 10 ‘commitments’, which have been taken into account within the Activity Framework. Working groups within the ARQUS network are also addressing the topic and providing input for its implementation.
Drawing on these ‘front-runners’ and various working groups and documents, the University of Graz has derived ideas and guidelines to design the Activity Framework based on the learnings of others and internal requirements. The ongoing exchange with our international partners, as well as national institutions, is intended to ensure that the Activity Framework remains a system that is iterative and capable of responding to new circumstances and conditions.
University of Graz CoARA Action Plan
The University of Graz’s Activity Framework is closely linked to the objectives and commitments of the Coalition for Advancing Research Assessment (CoARA). It was specifically developed to place CoARA’s core principles – such as transparency, diversity and a focus on quality – at the heart of performance recognition within the academic system. By signing the CoARA Commitments in 2022, the development of the Activity Framework at the University of Graz was intensified and aligned with international standards.
The Activity Framework puts the CoARA objectives into daily practice by shaping the framework of expectations for academic achievements (beyond the traditional metrics-based view) from multiple perspectives. Core elements such as the consideration of diverse, including qualitative, contributions to academic life, research, teaching, the promotion of early-career researchers and science communication directly correspond to the CoARA guidelines. At the same time, the inclusion of standardised and optional items creates transparency and increases flexibility for individual career paths. The AF explicitly avoids purely quantitative assessment procedures and rigid targets—also key requirements of CoARA.
The measures arising from the Activity Framework are forward-looking: the introduction and integration of the framework into existing processes, such as the annual staff appraisal, foster a culture of appreciation and development. Through regular review and adaptation of the items, the system remains dynamic and open to innovation. New staff members are made aware of the principles of modern research evaluation as early as the onboarding stage. In this way, the Activity Framework makes a decisive contribution to the transformation of academic culture and makes the University of Graz a pioneer in the implementation of CoARA standards in academic practice.
Here are the 10 CoARA Commitments and their concrete implementation at the University of Graz (based on the CoARA Action Plan 2024–2027):
1. Recognition of the diversity of academic contributions and careers Implementation: • The Activity Framework and the Research Fora capture and evaluate a wide range of activities: research, early-career support, teaching, societal engagement, management and knowledge transfer. • Outreach and teaching are taken into account at both departmental and individual levels.
2. Primarily qualitative assessment with peer review, supported by the responsible use of quantitative indicators Implementation: • Peer review is central to evaluation procedures and appointments. • Quantitative indicators are used responsibly; the h-index is avoided and, where necessary, critically explained.
3. Refraining from the inappropriate use of journal- and publication-based metrics (e.g. Journal Impact Factor, h-index) Implementation: • The Journal Impact Factor and h-index are not used as primary criteria. • Upon request, information is provided regarding their weaknesses.
4. Avoiding the use of research institution rankings in evaluation Implementation: • Rankings are not used for research evaluation. • Data from rankings (e.g. Leiden Ranking) are only used in combination with other indicators and background information.
5. Provision of resources for the reform of research evaluation Implementation: • Funding of coordination units for the Activity Framework and the Research Forums. • Resources for workshops and the involvement of external experts.
6. Continuous review and further development of evaluation criteria, tools and processes Implementation: • Regular audits (e.g. FINEEC Quality Audit), participation in international projects (Arqus R.I.), Task Force for Alternative Research Evaluation and CoARA Working Groups.
7. Awareness-raising, transparent communication, training and guidance on evaluation criteria and their application Implementation: • Events, workshops, handbooks and regular updates on the Activity Framework. • Training for staff and managers.
8. Exchange of practices and experiences for mutual learning within and outside the Coalition Implementation: • Active exchange with partner universities (Arqus, Universities Austria, EUA, CoARA Working Groups). • Participation in national and international forums.
9. Communication of progress in implementing the principles and commitments Implementation: • Publication of the Action Plan on Zenodo and the university website. --> see https://zenodo.org/records/12541677 • Active communication of the reform and ongoing reporting.
10. Evaluation of practices, criteria and tools based on evidence and the state of research; open data provision Implementation: • Ongoing analysis and monitoring, taking into account research on research evaluation. • Disclosure of data for evidence-based further development.