Citation in Science - Don't Quote Me on That: topic
This is a public forum
Are publication metrics appropriate for assessing people and/or institutes?
Maxine Clarke
Thursday, 29 May 2008 08:19 UTC
David Colquhoun’s comment in reply to Ian’s post elsewhere in this forum are worth a discussion thread of their own, I think, so I am reproducing a summary (for length reasons) here. David writes:
There are three separate problems that need to be kept distinct.
(1) Are any sort of publications metrics suitable for assessing people?
(2) Are any sort of publications metrics suitable for assessing institutions?
(3) How accurately can each sort of metric can be measured.
There is little point in discussing (3) unless the answer to (1) or (2) is yes.
It is very easy to see that the answer to (1) is no, simply by applying the proposed measure to someone who commands universal respect in you own field.
The answer to (2)is perhaps more difficult. The argument against using methods like that is partly their undemonstrated worth, but also the distortion of science that their imposition will undoubtedly produce. The pressure to produce cheap headline-grabbing work will be enormous. The long-term reputation of science will surely be damaged by this sort of bean-counting approach.
(Please see David’s full comment for further details and references for his reasoning.)
What are your views?
-
Replies
-
Amongst others, the Times Higher, has been following the long-running debate in this area, as evidenced in the latest issue
-
For me, the problem is not so much with the metrics (hey, we can use any metric to assess people), but with how they map onto what we’re trying to measure.
I think the problem ultimately comes down to finding an operational definition of quality – what do we mean when we say one scientist (or journal or department) is better than another? If we can find an unambiguous answer to that question, we are much better placed to see how to measure it.
The metrics are not to blame! Poor things, being abused like this.
-
