Julia Heuritsch

Research Group “Reflexive Metrics”, Institut für Sozialwissenschaften, Humboldt Universität zu Berlin, Universitätsstraße 3b, 10117 Berlin, Germany; [email protected] & [email protected]

Abstract

The extensive focus on performance indicators in research evaluation has been facing critique in science studies. Stemming from a neoliberalist paradigm, metrics allegedly objectify and create certainty about researchers’ performance. This has created a publish-or-perish culture where deviant behaviour, such as research misconduct, may have become the rule of the game. Not only does this culture foster a decrease of scientists’ well-being, but also a decrease in research quality. In recent years, calls for a culture change have accumulated, from discussing detrimental cultural aspects under #IchbinHannah to studies that demonstrate the connection between research culture and research integrity. This study is a qualitative analysis of how astronomers reimagine their research culture. This includes alternative output formats, alternative evaluation criteria and how they aspire to do research differently. In summary, we find that the time is ripe for a transformation in research culture towards a more participative and diverse work environment. This may include the use of an open knowledge management infrastructure, where all sorts of research output of various stages can be stored and shared. Moreover, through a more reflexive evaluation, which is continuously adapted to the needs of the researchers, scientific quality may be encouraged, rather than producing more and more publications. This study sets the basis for future action research with the aim of transforming academic cultures towards more participative ones, where scientists can let their creative minds thrive and collaborate beyond disciplinary boundaries.

Keywords: reflexive evaluation, participative leadership, deliberative democracy, diversity, experimentation, ambiguity, action research, evaluative inquiry

Table of Contents

<click on the content to navigate to the respective section>

Abstract

  1. Introduction
  2. The research culture: it’s status quo and where to go

2.1.      Indicators as Quality inscriptions

2.2.      Publish-or-Perish – a part of a neoliberalist academic culture

2.3.      Calls for a transformational culture change

2.4.      Democracy calls for Reflexive Evaluation: Evaluative Inquiry

  1. Methods
  2. Results

4.1.     MQ1 Imagining different outputs: Re-evaluing the paper

4.2.     MQ2 Re-evaluing evaluation