Multi-actor Policy Dynamics in Research Evaluation: Experts, Databases, and Academics

This mixed-methods study examines the complex interplay of actors and factors shaping research assessment policies in Lithuania in the years 1996-2008, a period of transition towards Western practices. Analysing policy documents, bibliometric data, interviews, and grey literature, we focus on the interactions among policymakers, international experts, providers of publication data, and researchers. Our findings reveal the significant influence of international networks on Lithuanian policymakers, leading to the adoption of quantitative assessment and reliance on Web of Science data. However, this narrow focus, coupled with existing power dynamics and top-down decision-making, led to gamesmanship in publishing practices and conflicts among disciplines, culminating in a Constitutional Court challenge. This research also highlights the substantial role of journal publishers and data providers in influencing policy shifts. We underscore the need for international organisations to adopt open data sources that encompass a wider array of scholarly outputs. Additionally, national policymakers must consider disciplinary differences and research capacity when designing assessment policies. The Lithuanian experience serves as a cautionary tale, emphasising the importance of context-specific, inclusive, and flexible research assessment systems, particularly in light of ongoing reforms such as the Coalition for Advancing Research Assessment (CoARA).