Soft peer review: social software and distributed scientific evaluation.
In: Hassanaly, P. and Ramrajsingh, A. and Randall, D. and Salembier, P. and Tixier, M., (eds.)
Proceedings of the 8th International Conference on the Design of Cooperative Systems, Carry-le-Rouet, 20-23 May 2008.
(pp. pp. 99-110).
Institut d'Etudes Politiques d'Aix-en-Provence: Aix-en-Provence, France.
The debate on the prospects of peer-review in the Internet age and the increasing criticism leveled against the dominant role of impact factor indicators are calling for new measurable criteria to assess scientific quality. Usage-based metrics offer a new avenue to scientific quality assessment but face the same risks as first generation search engines that used unreliable metrics (such as raw traffic data) to estimate content quality. In this article I analyze the contribution that social bookmarking systems can provide to the problem of usage-based metrics for scientific evaluation. I suggest that collaboratively aggregated metadata may help fill the gap between traditional citation-based criteria and raw usage factors. I submit that bottom-up, distributed evaluation models such as those afforded by social bookmarking will challenge more traditional quality assessment models in terms of coverage, efficiency and scalability. Services aggregating user-related quality indicators for online scientific content will come to occupy a key function in the scholarly communication system.
|Title:||Soft peer review: social software and distributed scientific evaluation|
|Open access status:||An open access version is available from UCL Discovery|
|Keywords:||Peer review, rating, impact factor, citation analysis, usage factors, scholarly publishing, social bookmarking, collaborative annotation, online reference managers, social software, web 2.0, tagging, folksonomy|
Archive Staff Only