UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Soft peer review: social software and distributed scientific evaluation

Taraborelli, D.; (2008) Soft peer review: social software and distributed scientific evaluation. In: Hassanaly, P. and Ramrajsingh, A. and Randall, D. and Salembier, P. and Tixier, M., (eds.) Proceedings of the 8th International Conference on the Design of Cooperative Systems, Carry-le-Rouet, 20-23 May 2008. (pp. pp. 99-110). Institut d'Etudes Politiques d'Aix-en-Provence: Aix-en-Provence, France. Green open access

[thumbnail of 8279.pdf]

Download (85kB)


The debate on the prospects of peer-review in the Internet age and the increasing criticism leveled against the dominant role of impact factor indicators are calling for new measurable criteria to assess scientific quality. Usage-based metrics offer a new avenue to scientific quality assessment but face the same risks as first generation search engines that used unreliable metrics (such as raw traffic data) to estimate content quality. In this article I analyze the contribution that social bookmarking systems can provide to the problem of usage-based metrics for scientific evaluation. I suggest that collaboratively aggregated metadata may help fill the gap between traditional citation-based criteria and raw usage factors. I submit that bottom-up, distributed evaluation models such as those afforded by social bookmarking will challenge more traditional quality assessment models in terms of coverage, efficiency and scalability. Services aggregating user-related quality indicators for online scientific content will come to occupy a key function in the scholarly communication system.

Type: Proceedings paper
Title: Soft peer review: social software and distributed scientific evaluation
Open access status: An open access version is available from UCL Discovery
Publisher version: http://coop.wineme.fb5.uni-siegen.de/?id=coop2008
Language: English
Keywords: Peer review, rating, impact factor, citation analysis, usage factors, scholarly publishing, social bookmarking, collaborative annotation, online reference managers, social software, web 2.0, tagging, folksonomy
URI: https://discovery.ucl.ac.uk/id/eprint/8279
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item