UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Apples and Oranges: An International Comparison of the Public's Experience of Justiciable Problems and the Methodological Issues Affecting Comparative Study

Pleasence, P; Balmer, NJ; Sandefur, RL; (2016) Apples and Oranges: An International Comparison of the Public's Experience of Justiciable Problems and the Methodological Issues Affecting Comparative Study. Journal of Empirical Legal Studies , 13 (1) pp. 50-93. 10.1111/jels.12097. Green open access

[img]
Preview
Text
Pleasence__Apples and Oranges v6 Final Amendments 280715.pdf

Download (1MB) | Preview

Abstract

Since the mid-1990s, at least 28 large-scale national surveys of the public's experience of justiciable problems have been conducted in at least 15 separate jurisdictions, reflecting widespread legal aid reform activity. While the majority of these surveys take their structure from Genn's Paths to Justice survey (1999), they vary significantly in length, scope, mode of administration, types of problems included, survey reference period, data structure, data analysis, and question formulation. This article draws on surveys from across the world, contrasting their methodologies, comparing their headline findings, and setting out the potential for bias as a consequence of methodological variation. The article also presents findings from five online experiments testing the impact of various question formulations on problem prevalence, use of advice, and formal processes. Specifically, the experiments test whether varying the reference period, describing problems as “legal,” offering detailed as opposed to simple problem descriptions, and describing problems as “difficult to solve” had an impact on reported prevalence of justiciable problems, and whether presenting lists as opposed to a series of individual questions had an impact on reported use of advice and processes. The experiments demonstrated that modest differences in question formulation yield significantly different results. Specifically, alteration of survey reference period did not result in a proportional change in reported problem prevalence, introducing problems as either “legal” or “difficult to solve” significantly reduced reported prevalence, and introducing use of advice/processes as multiple questions rather than as lists significantly increased reported use. The risks involved in comparative analysis (and particularly in looking beyond methodology when attempting to explain jurisdictional variation) are discussed. In relation to future studies, the importance of understanding the impact of methodological change, learning the lessons of the past, making technical details transparent, and making data available are highlighted.

Type: Article
Title: Apples and Oranges: An International Comparison of the Public's Experience of Justiciable Problems and the Methodological Issues Affecting Comparative Study
Open access status: An open access version is available from UCL Discovery
DOI: 10.1111/jels.12097
Publisher version: http://dx.doi.org/10.1111/jels.12097
Language: English
Additional information: Copyright © 2016, Copyright the Authors. Journal compilation © 2016, Cornell Law School and Wiley Periodicals, Inc. This is the peer reviewed version of the following Pleasence, P; Balmer, NJ; Sandefur, RL; (2016) Apples and Oranges: An International Comparison of the Public's Experience of Justiciable Problems and the Methodological Issues Affecting Comparative Study. Journal of Empirical Legal Studies , 13 (1) pp. 50-93 which has been published in final form at 10.1111/jels.12097. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.
Keywords: Social Sciences, Law, Government & Law, Morbidity, Quality, Lawyer
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL SLASH
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Laws
URI: https://discovery.ucl.ac.uk/id/eprint/1499025
Downloads since deposit
118Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item