A TOOL FOR JUSTICE THE COST BENEFIT ANALYSIS OF LEGAL AID A T O O L FO R J U ST I C E: CONTENTS DS? A C O ST B EN EFI T AN AL YSI S SIE O F L EG AL AI D FF S EO EG I TL A NA L YA 2 ABSTRACT TN 3 ACKNOWLEDGMENTS BIE EF 4 PREFACE NT 5 ES ACRONYMS AND ABBREVIATIONS BO 6 CHAPTER 1: WHY EXAMINE THE COSTS AND BENEFITS OF LEGAL AID? MDC The Challenge of Access to Justice ON F RA The Intrinsic Arguments for Legal Aid TS Legal Aid Can Also Be Smart Economics SS The Data Environment for Legal Aid is Improving N E EC OD 12 CHAPTER 2: FINDINGS AND EMERGING TRENDS FROM COST BENEFIT ANALYSES TR 12 Section 1: The Cost Benefit Analysis: a tool for examining the economic returns on legal aid EGTH What is a Cost Benefit Analysis? IN The Use of CBAs for Legal Aid Government Spending RG EM IN The Analytical Approach to Conducting a CBA of Legal Aid MA 14 Section 2: Main Findings of CBA Studies D EX Costs and Benefits of Legal Aid Services A NY Common Features of Legal Aid CBAs FI N D I N G S WH 18 Section 3: Emerging Trends of CBAs CBAs of Legal Aid Programs : Pre-trial Detention, Legal Advice, Legal Representation and Alternative Dispute Resolution CBAs of Specific Legal Aid Programs: Domestic Violence Legal Aid CBAs of Specific Legal Aid Programs: Foreclosure Legal Aid 26 CHAPTER 3: HOW TO CONDUCT A COST BENEFIT ANALYSIS OF A LEGAL AID PROGRAM 26 Section 1: Structure and Fundamentals for Conducting your own CBA How to Structure a CBA The Fundamentals of a CBA 29 Section 2: The Five Steps of a Legal Aid CBA Step 1: Definition of the Project Context Step 2: Identification of the Project Objectives and M&E Indicators Step 3: Financial Analysis Step 4: Economic Analysis Step 5: Risk Assessment 40 CONCLUSIONS 42 ANNEX 1: SUMMARY TABLE OF COST AND BENEFIT STUDIES OF LEGAL AID 50 ANNEX 2: CASE STUDIES OF CBAs OF LEGAL AID 55 ANNEX 3: CBA MATHEMATICAL COMPUTATION 60 REFERENCES cvr2 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID W F IN HD ILLUST R A TI O N S O F D A T A YIN EXGA SMAIN NDE E 9 FIGURE 1 RELATIONSHIP BETWEEN ACCESS TO JUSTICE AND HUMAN CAPITAL TMHE 14 FIGURE 2 THE THREE ANALYTICAL BLOCKS OF A CBA ER 15 TABLE 1 SUMMARY OF THE COMMON COSTS OF UNMET LEGAL NEEDS AND THE BENEFITS OF LEGAL AID PROGRAMS CG OIS 27 BOX 1 THE PWC THREE-SCENARIO STUDY OF THE NET BENEFITS OF LEGAL AID ON FAMILY MATTERS IN AUSTRALIA NTGS TA 30 BOX 2 WHERE TO FIND USEFUL DATA ON THE DEMAND FOR LEGAL AID SERVICES RN 31 TABLE 2 EXAMPLES OF OBJECTIVES AND INDICATORS OF LEGAL AID INTERVENTIONS ED ND 32 BOX 3 DIFFERENCE BETWEEN FINANCIAL AND ECONOMIC ANALYSIS BSEN 34 BOX 4 QUESTIONS DRIVING ESTIMATION OF ECONOMIC COST AND BENEFITS FRE FI 34 FIGURE 2 STAGES OF THE ECONOMIC ANALYSIS OF A LEGAL AID CBA OM T SC O F 35 BOX 5 SIMPLIFIED ILLUSTRATION OF A LEGAL AID PROGRAM CBA FINANCIAL ANALYSIS 39 BOX 6 SIMPLIFIED ILLUSTRATION OF A LEGAL AID PROGRAM CBA ECONOMIC ANALYSIS ST 39 TABLE 2 SOME EXAMPLES OF THE RISKS COMMONLY ASSOCIATED WITH THE ESTABLISHMENT OF A LEGAL AID SYSTEM LE BG 54 BOX 7 THE ESTIMATE OF THE SOCIAL DISCOUNT RATE IN MYANMAR USING THE RAMSEY FORMULA EA NLE FI 55 TABLE 3 YIELD TO MATURITY ON SOVEREIGN DEBT ISSUANCE BY DEVELOPING COUNTRIES AS A PROXY OF SDR A IT 55 TABLE 4 STANDARD CONVERSION FACTORS FOR SELECTED AFRICAN COUNTRIES (IN LCU BILLIONS, 2017) D?A N A LY S E S 57 BOX 8 SHADOW WAGE FACTOR (SWF) AS A SPECIAL CASE OF STANDARD CONVERSION FACTOR PHOTO CREDITS: Shutterstock images on pages 2, 4, 11, 39, and 41. All other photos by The World Bank. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 1 ABSTRACT SL BA TRAA DT IC ? The world faces a global justice gap and the poor and vulnerable benefit analysis offers a quantitative and quantitative data-based EG are the most affected. The Justice for All Report of the Task Force evaluation of the net economic benefits of a legal aid program. As WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L A on Justice reveals that around 5.1 billion people today—two-thirds in other sectors, not all costs and benefits can be quantified, but a of the world’s population—lack meaningful access to justice. good cost benefit analysis will quantify what it can and note what it Lack of access to justice traps people in vicious cycles of poverty, cannot. Some cost benefits analyses evaluate the economic impact inequality and marginalization. The burden of this justice gap falls of fully-fledged access to justice programs. Others focus on the disproportionally on the most vulnerable, including women, chil- impact of particular legal aid or related services. Overwhelmingly, dren, minorities and people with disabilities. Lack of access to jus- these studies suggest that the benefits of legal aid outweigh the tice also increases the risk of conflict and violence within a society. costs: for the individual involved, the community, the justice sector, as well as the economy and the society. Policymakers are increasingly looking for ways to address the justice gap. Faced with challenging budgetary environments, This report examines the findings of the various cost benefit governments are under increased pressure to show the most cost- analyses and provides guidance on how to conduct one’s own efficient allocation of government funding. In a world where data cost benefit analysis of a legal aid program. increasingly informs policy making, evidence-based policy propos- als that demonstrate the benefits of investments in legal aid pro- To assist interested policymakers and those who influence them, grams are useful and persuasive. In this spirit, policymakers and Part 3 offers a practical step-by-step guide on how to conduct policy influencers have turned to cost benefit analysis as a tool to a cost benefit analysis of different policy alternatives. With this better evaluate the economic impact of legal aid services and make guide, the report hopes to make a small contribution to the research informed decisions on how to address the justice gap and allocate in the field of the net benefits of legal aid. The guide offers gov- funding most efficiently and effectively. ernments, CSOs and others the tools to gather the relevant data needed to conduct their own cost-benefit analysis. The result can Cost benefit analyses from around the world suggest that the be better informed policies that allocate government resources benefits of legal aid and related services significantly outweigh efficiently and effectively to close the justice gap. their costs. This report surveys around 50 cost and benefit studies of past and proposed legal aid programs covering civil and com- mon law jurisdictions in developed and developing countries, large and small jurisdictions, and common and civil law systems. Cost 2 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID ACKNOWLEDGMENTS A W CH KYNO The report is the outcome of a joint project between the World Bank EWXA and the International Bar Association (IBA) Access to Justice and LMED Legal Aid Committee. The report was prepared by a team compris- INGE ing Georgia Harley, Irina Capita, Milos Markovic and Elaine Panter ME from the World Bank, and Lucy Scott-Moncrieff from the IBA. The TN HT authors would like to thank the IBA Access to Justice and Legal E SC O S T S A N D B E N E FI T S O F LE G A L A I D ? Aid Committee and the World Bank Global Governance Practice for sponsoring the study. Special thanks go to experts from around the world who provided examples of cost benefit studies from their jurisdictions. The team is grateful to these colleagues for their collaboration, which enabled these studies to be compiled for the first time in one report for the reader’s ready reference. The team would also like to thank the many experts who pro- vided comments on earlier drafts of this report, including Leonie Campbell, Klaus Decker, Hazel Genn, Steve King, Nicholas Menzies, Clare Murel, and Alan Paterson. The authors would also like to recognize the support of Astrid Wargenau and Romana St. Matthew Daniel in the publication of the report and of Moira Ratchford for the editing and design. September, 2019 For more information on the World Bank’s work in justice and rule of law, contact Georgia Harley at gharley@worldbank.org The World Bank 1818 H Street, NW Washington, D.C, 20433 USA Telephone: 202-473-1000 www.worldbank.org This work is a product of the staff of The World Bank with external contri- butions. The findings, interpretations, and conclusions expressed in this work do not necessarily reflect the views of The World Bank, its Board of Executive Directors, or the governments they represent. The World Bank does not guarantee the accuracy of the data included in this work. Rights and Permissions The material in this work is subject to copyright. Because The World Bank encourages dissemination of its knowledge, this work may be reproduced, in whole or in part, for noncommercial purposes as long as full attribution to this work is given. Any queries on rights and licenses, including subsidiary rights, should be addressed to World Bank Publications, The World Bank Group, 1818 H Street NW, Washington, DC 20433, USA; fax: 202-522-2625; e-mail: pubrights@worldbank.org. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 3 PREFACE PA EF RL AA DE IC ? The motivation for this report was spurred by discussions between WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G the IBA and the World Bank in Belfast in 2017. Together, we discussed how access to justice is a “win-win” for clients and the economy in light of growing evidence about financial and economic returns to investments in legal aid. We also discussed the increasing desire among justice policymakers to make a savvy “business case” for investments in justice. Work is underway in jurisdictions around the world to make this business case. It is a strong case. This report is one small contribution to that greater endeavor. The audience for this report is legal aid policymakers and those who advise them. In many jurisdictions, these people will work in an Attorney General’s Department or Ministry of Justice. In some juris- dictions, they may work at an independent legal aid commission, bar association or civil society organization. In most cases, these people are lawyers and not economists. They are accustomed to making the intrinsic arguments for legal aid. They express a desire to complement intrinsic arguments with economic considerations— but they feel less comfortable doing so because they are not familiar with the intricacies of economic arguments and have not previously used the relevant analytical tools. If you are one of these people, this report is for you. Here, we aim to demystify the cost benefit analysis—a tool that is much used in other sectors and increasingly used in justice. We encourage you to explore the examples and guidance contained in this report and to see how you might adapt this work to your own context. Hopefully this report will help you engage with your funders— whether they be Ministries of Finance, parliaments, development partners or foundations—in new and compelling ways. Enjoy! 4 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID ACRONYMS AND ABBREVIATIONS A W CH RYON EYXM AJS Aboriginal Justice Strategy AMS IA CAO Community Advice Offices NN CBA Cost Benefit Analysis EDTH CBR Cost Benefit Ratio AEBB CEPEJ Council of Europe European Commission for the efficiency of justice CROE CMS Case Management System SVTIS ENPV Economic Net Present Value ATA ERR Economic Rate of Return IN ONDS FAO Food and Agriculture Organization of the United Nations B E N E FI T S O F LE G A L A I D ? FDR Family Dispute Resolution Service FNPV Financial Net Present Value FRR Financial Rate of Return IBA International Bar Association ICPR Institute of Criminal Policy Research IRR Internal Rate of Return MJS Mainstream Justice System M&E Monitoring and Evaluation NLAP National Legal Aid Policy NPV Net Present Value ODI Overseas Development Institute OECD Organisation for Economic Co-operation and Development PAS Paralegal Advisory Service PV Present Value (Discounted Present Value) PWC PricewaterhouseCoopers SCF Standard Conversion Factor SDGs Sustainable Development Goals SDR Social Discount Rate UK United Kingdom UN United Nations UNODC United Nations Office on Drugs and Crime US United States WTP Willingness To Pay A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 5 CHAPTER 1: WHY EXAMINE THE COSTS AND BENEFITS WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G A L A I D ? OF LEGAL AID? The world faces a global justice gap, which is causing millions of people to live in extreme conditions of injustice, without access to legal recourse to resolve their problems. To close the justice gap in increasingly challenging budgetary environments, governments are turning to cost benefits analyses of legal aid programs to better estimate the benefits of such policies and to make evidence-based decisions on the allocation of resources. THE THREE DIMENSIONS The “justice gap” undermines human development, OF THE GLOBAL JUSTICE GAP: reinforces the poverty trap, and imposes high societal costs. 235 million people live in extreme conditions of injustice Measuring the Justice Gap, 1.5 billion people cannot resolve their World Justice Project, 2019 justice problems 4.5 billion people are excluded from the opportunities the law provides 2. This justice gap undermines human development, rein- UN Task Force on Justice, Justice for All, 2019 forces the poverty trap, and imposes high societal costs.5 Justice is a thread that runs through all 17 of the Sustainable Development Goals (SDGs) and is critical to end poverty, reduce inequality, reach those left behind and promote peace and security.6 SDG16, and in THE CHALLENGE OF ACCESS TO JUSTICE particular targets 16.3 and 16.b, seek to measure the extent to which the rule of law and equal access to justice for all are pro- 1. The world faces a widespread justice gap, where billions of moted, as well as the extent to which non-discriminatory laws and people lack access to basic justice services. The Justice for All policies for sustainable development are enforced.7 Report of the Task Force on Justice reveals that around 5.1 billion people today—two-thirds of the world’s population—lack mean- 5 The World Justice Project, Measuring the Justice Gap, 2019, https://worldjusticeproject.org/ ingful access to justice.1 While people in all countries are affected, sites/default/files/documents/WJP_Measuring%20the%20Justice%20Gap_final_20Jun2019. pdf. women, children, people with disabilities, and people from minority 6 UN Taskforce on Justice, Justice for All: the Report of the Task Force on Justice, April 2019, p. 11, https://www.justice.sdg16.plus/report. ethnic communities are often the most vulnerable.2 One billion chil- 7 https://sustainabledevelopment.un.org/sdg16. dren are victims of violence, and half of women surveyed say it is pointless to report a case of sexual harassment to the authorities.3 Businesses face myriad legal issues relating to tax, regulation, employment, and the payment of invoices, debt, and goods or ser- vices. These legal issues are particularly challenging for small and medium-sized enterprises to identify and resolve on their own.4 1 UN Taskforce on Justice, Justice for All: the Report of the Task Force on Justice, April 2019, p. 12, https://www.justice.sdg16.plus/report. 2 OECD, Equal Access to Justice for Inclusive Growth: Putting People at the Centre, March 2019, https://www.oecd-ilibrary.org/governance/equal-access-to-justice-for-inclusive- growth_597f5b7f-en. 3 UN Taskforce on Justice, Justice for All: the Report of the Task Force on Justice, April 2019. 4 OECD, Equal Access to Justice for Inclusive Growth: Putting People at the Centre, March 2019, https://www.oecd-ilibrary.org/governance/equal-access-to-justice-for-inclusive- growth_597f5b7f-en. 6 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID W H Y E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? Equal access to justice and legal empowerment Put simply, access to legal aid is fundamental are intrinsic goods; they are also fundamental to safeguarding fair, equal, and meaningful components of inclusive development, good access to justice. governance, public policy performance, and the rule of law, as underlined by the UN Sustainable UNDP and UNODC, Global Study on Legal Aid Development Agenda. Global Report, 2016 OECD, Equal Access to Justice for Inclusive Growth: Putting People at the Centre, 2019 THE INTRINSIC ARGUMENTS FOR LEGAL AID 4. Legal aid has long been viewed as an expression of society’s 3. Access to legal aid8 is central to ensuring access to justice, values. The primary arguments for supporting legal aid have rested especially for the poorest and most vulnerable people. That on the inherent value to society of protecting the most vulnerable, said, legal aid systems are different in each jurisdiction.9 While and of ensuring access to justice for those who cannot afford a to some extent, the differences may be influenced by a country’s lawyer. By leaning heavily on constitutional, human rights and income level, there is significant variation among countries of ideological principles underpinning the concepts of “access to similar levels of development in their approaches to legal aid justice” and “rule of law,” proponents highlight how legal aid is services. Services provided generally cover primary legal advice. intrinsically tied to the concept of the state and its duty to guar- This includes the provision of legal information, mediation and antee equality of arms as an element of equality under the law. education, legal representation and assistance in preparing cases Legal aid can help to ensure that people have access to informa- at the local, national or international level, psychological support tion about their rights, entitlements, and obligations.11 It is also and specialized assistance, and legal advocacy.10 essential for the protection and promotion of all other civil, cultural, economic, political and social rights. Without it, people who are living in poverty or otherwise vulnerable are denied the opportunity to claim their rights, resolve disputes, or challenge crimes, abuses or human rights violations committed against them.12 8 Legal aid is the provision of legal advice, assistance, and representation to people or groups who cannot afford to pay privately for that legal help. Legal aid is mainly provided by lawyers and paralegals to help address specific legal problems and is funded, in whole or part, by the state and includes court fee waivers and other financial concessions. Legal aid may include legal education and access to legal information, as well as other services provided through alternative dispute resolution mechanisms and restorative justice processes. 11 Ibid. 9 For an extensive discussion on the comparative development of legal aid refer to Francis 12 UN Report of the Special Rapporteur on extreme poverty and human rights, A/67/278, Regan, Alan Paterson, Tamara Goriely & Don Fleming, The Transformation of Legal Aid: https://www.ohchr.org/Documents/Issues/Poverty/A-67-278.pdf. Comparative and Historical Studies 1999, Oxford: Oxford University Press, Part 2, and Francis Regan, Why Do Legal Aid Services Vary Between the Societies? Reexamining the Impact of Welfare States and Legal States. 10 See e.g., United Nations, Global Study on Legal Aid: Country Profiles (November 2016), p. 24; Box 3 on page 25, http://www.undp.org/content/undp/en/home/librarypage/democratic- governance/access_to_justiceandruleoflaw/global-study-on-legal-aid.html. The report also states that, without legal aid, millions of people around the world are at heightened risk of rights violations when they interact with the criminal justice system, through arbitrary pre- trial detention, torture, coerced confessions, and/or wrongful convictions. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 7 5. These values are also reflected in national and international WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G A L A I D ? law. Various international instruments enshrine the right to legal aid in criminal matters.13 Treaty bodies have also highlighted the THE HIDDEN COSTS OF NOT importance of legal aid as a fundamental safeguard.14 Most recent- INVESTING IN LEGAL AID ly, the UN has adopted global standards for legal aid and invited The expense which governments incur in States to adopt and strengthen measures to ensure effective legal funding legal aid is obvious and measurable. aid is in their jurisdictions.15 In most countries, the right to legal What is not so obvious, and not so easily aid is also part of national legal frameworks, from constitutions measurable, but what is real and substantial, to national laws and policies on legal aid.16 A growing number of is the cost of the delay, disruption and States are developing legislation on the right to legal aid as the inefficiency, which results from absence or responsibility of the State.17 denial of legal representation. Much of that cost is also borne, directly, or indirectly, by LEGAL AID CAN ALSO BE SMART ECONOMICS governments. Providing legal aid is costly. So is not providing legal aid. 6. While not detracting from intrinsic arguments, there are also economic arguments that support investment in justice and Murray Gleeson, former Chief Justice of Australia legal aid in particular. The price of failing to address the global justice gap is high. Not providing legal aid can be a false economy, Law Council of Australia, the Justice Project Final Report: Introduction and Overview, 2018 as the costs of unresolved problems shift to other areas of govern- ment spending such as health care, housing, child protection, and incarceration. For example, a study for Canada estimates the cascading costs of unequal access to justice on public spending in other areas (e.g., employment insurance, social assistance, conviction, incarceration, probation, and post-prison supervision.20 and health care costs) to be approximately 2.35 times more than In addition, public investments in legal aid are also found to the annual direct service expenditures on legal aid.18 In Australia, generate net savings in terms of avoided shelter/housing costs.21 numerous studies show that there are net public benefits from Studies find significant net economic benefits, even in the short legal assistance expenditures.19 Investments in legal aid can lead term, including immediate benefits to clients and cost-savings to significant government savings through avoided cost of arrest, to governments. Moreover, many studies may under-estimate net benefits due to short time horizons and conservative assumptions. 7. There is a clear correlation between a country’s global 13 UN General Assembly, International Covenant on Civil and Political Rights, 16 ranking on access to justice and its ranking on human capital December 1966, United Nations, Treaty Series, vol. 999, p. 171, https://www.refworld.org/ docid/3ae6b3aa0.html. Council of Europe, European Convention for the Protection of Human formation, as Figure 1 shows.22 The inability to access legal and Rights and Fundamental Freedoms, as amended by Protocols Nos. 11 and 14, 4 November 1950, ETS 5, https://www.refworld.org/docid/3ae6b3b04.html. African Union, Protocol to the justice services can be both a result and a cause of disadvantage, African Charter on Human and People’s Rights on the Rights of Women in Africa, 11 July 2003, poverty and inequality. This is true in both income and non-income https://www.refworld.org/docid/3f4b139d4.html. 14 The UN Subcommittee on Prevention of Torture and the European Committee for the Prevention of Torture have repeatedly emphasized the importance of legal aid as a fundamen- tal safeguard against intimidation, ill-treatment, and torture. Both committees have identified 20 One study for the US estimates that, on average, American taxpayers spend approximately that the period immediately following deprivation of liberty is when the risk of intimidation US$ 14 billion to jail people who are awaiting trial (roughly 460,000 people or 65 percent of and physical ill-treatment is greatest. In order to protect the vulnerable position of people in the jail population on any given day are). See Pretrial Justice: How Much Does it Cost? (2017), police custody, they call on all States to develop an appropriate system of legal aid for those https://nicic.gov/pretrial-justice-how-much-does-it-cost-2017. who are not in a position to pay for a lawyer. See also UNODC and UNDP, Global Study on Legal 21 Providing legal counsel for low-income people at risk of losing their homes saves the city Aid Global Report, October 2016. of New York $320 million a year. See Stout Risius Ross Inc, The Financial Cost and Benefits of 15 The United Nations Principles and Guidelines on Access to Legal Aid in Criminal Justice Establishing a Right to Counsel in Eviction Proceedings Under Intro 214-A, (Paper Presented System, 3 October 2012, UN Doc. A/C.3/67/L.6, http://www.uianet.org/sites/default/files/ for: Pro Bono and Legal Services Committee of the New York City Bar Association, March 16, RES_GA_UN_121003_EN.pdf. 2016). 16 For a list of countries and further reference, consult United Nations, Global Study on Legal 22 Even after controlling for income levels, access to justice has a positive statistically Aid: Country Profiles, November 2016, pp. 525-562, http://www.undp.org/content/undp/en/ significant effect on human capital formation, albeit of a smaller magnitude (0.35) than home/librarypage/democratic-governance/access_to_justiceandruleoflaw/global-study-on- indicated by a correlation coefficient (0.5). It should also be noted that this report does not legal-aid.html. claim a causal link between access to justice and human capital. To proxy for access to 17 UNODC and UNDP, Global Study on Legal Aid Global Report, October 2016, pp. 21-23, justice, we use The WJP Rule of Law Index and sub-factor 7.1 (“people can access and afford https://www.unodc.org/documents/justice-and-prison-reform/LegalAid/Global-Study-on- civil justice”) which aims to measures how easy (or difficult) it is for the average citizen of a Legal-Aid_Report01.pdf accessed on July 26, 2019. country to assert and protect his/her rights and to understand his/her duties under civil law. 18 See Farrow et al., Everyday Legal Problem and The Cost of Justice in Canada: For more information about the Index and its methodology, see https://worldjusticeproject.org/ Overview Report, 2016, http://www.cfcj-fcjc.org/sites/default/files/Everyday%20Legal%20 our-work/research-and-data/wjp-rule-law-index-2019/current-historical-data. The Human Problems%20and%20the%20Cost%20of%20Justice%20in%20Canada%20-%20 Capital Index quantifies the contributions of health and education to worker productivity. Overview%20Report.pdf. The index score ranges from zero to one and measures the productivity as a future worker of 19 See Law Council of Australia, The Justice Project Final Report, August 2018, p. 15, child born today relative to the benchmark of full health and complete education. For more https://www.lawcouncil.asn.au/files/web-pdf/Justice%20Project/Final%20Report/Justice%20 information about the Human Capital Project, see https://openknowledge.worldbank.org/ Project%20_%20Final%20Report%20in%20full.pdf. handle/10986/30498. 8 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID FIGURE 1: RELATIONSHIP BETWEEN ACCESS TO JUSTICE W H Y E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? AND HUMAN CAPITAL Whenever someone is deprived of his right 1 to counsel and he feels that he is a victim of R2 = 0.49 0.9 injustice, that person may run away to the 0.8 mountains or turn into a rebel [...]. That is why HUMAN CAPITAL INDEX 0.7 we must assist everyone who has grievances 0.6 to seek redress through peaceful and legal 0.5 means. 0.4 0.3 Persida Acosta, Chief, Public Attorney’s Office, 0.2 Philippines 0.1 0 0 0.2 0.4 0.6 0.8 1 ACCESS TO CIVIL JUSTICE INDEX scenarios, such as employment opportunities, educational attain- ment and health conditions, all of which are important determi- nants of an individuals’ social and economic potential, as well 9. Improving access to justice can also help to prevent and as inclusive and sustainable growth of the economy in which they mitigate the risk of fragility, conflict and violence. The joint live.23 Conversely, investing in access to justice, particularly for United Nations-World Bank flagship report, Pathways for Peace: poor and marginalized groups, can reduce inequality and foster Inclusive Approaches to Preventing Violent Conflict, cites griev- human capital accumulation via several channels. In this sense, ances around social group-specific exclusion from access to justice access to justice is no less important to equitable and sustainable and security as one of four arenas of social contest that inform the economic development than good schools, functioning hospitals, risk of violence.25 The Pathways for Peace specifically identifies the and passable roads.24 delivery of justice and security as part of “the glue that binds state and society together” and is a tangible expression of the minimum 8. Unaddressed legal needs affect individuals, their families, that citizens expect from the state in exchange for their deference the justice system, the economy and the society. As this report to the state’s rule over them.26 The Pathways for Peace report high- outlines, impacts include not only monetary losses, such as stolen lights the enormous human and economic costs of violence and or damaged property, medical expenses, the loss of employment, conflict which make preventive actions both self-evident and highly income or productivity, but also socioeconomic costs that are real cost-effective. The report recommends that the best way to prevent but harder to quantify. Often referred to as victimization costs, societies from descending into crisis, including but not limited to these may include pain, suffering, trauma, fear, reduced quality conflict, is through long-term investment in inclusive and sustain- of life, damaged reputation, lost dignity, and reduced life chances. able domestic policies and programs that prevent the fraying of Children in families unable to assert their rights may be harmed by the effects of avoidable family breakdown, homelessness, and 25 See United Nations. World Bank, Pathways for Peace: Development Approaches to Prevention of Violent Conflict. 2018, Washington D.C.,https://openknowledge.worldbank.org/ disrupted schooling, which may limit their ability to become pro- handle/10986/28337. 26 Ibid, p. 158. ductive and well-integrated members of society and may increase the likelihood of them requiring state support or intervention. Unaddressed legal needs may also incur a cost to communities. Foreclosure, for example, can lead to reduced business investment, In short, we now understand that justice and lower property values, reduced economic output, and misappropri- governance are no less important to equitable ated financial resources (e.g., the potentially avoidable provision and sustainable development than good of emergency housing). schools, functioning health clinics, and passable roads. James A. Goldston, Remarks to UN General 23 OECD, Equal Access to Justice for Inclusive Growth: Putting People at the Centre, March 2019, https://www.oecd-ilibrary.org/governance/equal-access-to-justice-for-inclusive- Assembly, 2014 growth_597f5b7f-en. 24 Goldston, 2014. Justice for Development: integrating justice and human rights into the post 2015 development framework (Open Society Foundations). A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 9 social fabric, including by addressing inequalities and exclusion WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G A L A I D ? and making institutions more inclusive. In particular, it calls for expanded access to justice services, especially for those who have LEGAL PROBLEMS ARE COMMON been excluded.27 AND WIDESPREAD THE DATA ENVIRONMENT FOR LEGAL AID 1.4 billion people have unmet civil or IS IMPROVING administrative justice needs. 2.3 billion people lack proof of housing or land tenure. 1.1 billion 10. Estimates of the economic benefits of access to justice victims of non-violent crime have not reported reflect a growing body of research on legal aid needs. Recent their victimization. 235 million victims of progress has been made in understanding the extent of legal prob- violence have not reported their victimization. lems, including the kinds of groups most in need of legal aid, the reasons why legal needs remain unmet, and the barriers that people 560 thousand people are victims of lethal encounter to access justice.28 This body of research suggests that violence. 1.1 billion people lack legal identity. legal aid focus on everyday legal needs, which also happen to be 2.1 billion people are employed in the informal predominantly civil in nature.29 In housing for instance, the most economy. 12 million people are stateless. frequently cited legal needs relate to evictions, foreclosure, utility 40 million people are living in modern slavery. payment issues, unsafe housing conditions and homelessness. 203 million people live in countries with high Family legal needs generally include divorce, domestic violence, levels of insecurity and no rule of law. child custody, visitation, maintenance and alimony, and division of family assets. Depending on the context, access to criminal legal World Justice Project, 2019 aid, especially in the early stages of the criminal justice process, such as pre-trial detention, is found to be essential for poor and In Colombia, a 2014 national survey marginalized groups, who are often unaware of their legal rights established that approximately 40 percent and lack the resources to obtain legal advice or representation.30 of those surveyed had faced a legal problem Our understanding of legal needs has been deepened significantly in the preceding four years, with fraud, theft, by the World Justice Project, which now collects survey data on legal access to public services, and housing being needs from more than 100 countries.31 the most common problems. 11. While there is growing evidence on legal needs32 and the Encuesta Nacional de Necesidades Jurídicas, high cost of non-intervention,33 less is known about the extent 2013 to which society could benefit from legal aid, as well as whether the intervention can be justified from an economic perspective.34 In Papua New Guinea, a 2009 national survey found that 40 percent of respondents had a 27 Ibid, p. 168. dispute in the previous 12 months, and that the 28 See Pascoe Pleasence, Nigel J. Balmer and Rebecca L. Sandefur, Paths to Justice: A Past, Present and Future Road Map (August 2013), https://www.nuffieldfoundation.org/sites/ main sources of dispute related to land, water, default/files/files/PTJ%20Roadmap%20NUFFIELD%20Published.pdf; See also OECD and Open Society Foundation, “Understanding Effective Access to Justice,” Workshop Background Paper, and other natural resources. November 2016, pp. 8-9, http://www.oecd.org/gov/Understanding-effective-access-justice- workshop-paper-final.pdf. World Bank, 2014 29 Ibid, p. 5. 30 See generally United Nations Office on Drugs and Crime and United Nations Development Programme, Early access to legal aid in criminal justice processes: a handbook for policy- makers and practitioners, 2014, http://www.undp.org/content/undp/en/home/librarypage/ democratic-governance/access_to_justiceandruleoflaw/early-access-to-legal-aid-in-crimi- nal-justice-processes-handbook.html. 31 https://worldjusticeproject.org/. Generally, budget data on the costs of legal aid has been reported 32 From an evaluation perspective, the recognition of a clearly defined need is one of the key prerequisites for government intervention, followed by the idea that the proposed inter- whenever available. For instance, the Council of Europe regularly vention is likely to be worth the cost. See HM Treasury, Green Book, http://www.fao.org/ag/ humannutrition/33236-040551a7cfbc0e73909932192db580c4.pdf. publishes data on the cost of legal aid in its member states.35 33 This is particularly true in the case of violence against women, where enormous costs According to the 2018 CEPEJ report, in 2016 the 28 EU member of non-intervention were found throughout the literature. See, e.g., Ashe, S., Duvvury, N., Raghavendra, S., Scriver, S., & O’Donovan, D., Costs of Violence Against Women: An countries spent an average of €6.5 annually per inhabitant on Examination of the Evidence, 2016, https://www.whatworks.co.za/documents/publications/68- authors-ashe-s-duvvury-n-raghavendra-s-scriver-s-and-o-donovan-d/file. 34 See generally J.J. Prescott, “The Challenges of Calculating the Benefits of Providing Access to Legal Services,” 37 Fordham Urb. L.J. 303 (2010), pp. 319-320, http://ir.lawnet.fordham. 35 https://search.coe.int/directorate_of_communications/Pages/result_details. edu/cgi/viewcontent.cgi?article=2329&context=ulj. aspx?ObjectId=09000016808e349b. 10 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID W H Y E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? LEGAL NEEDS ARE PREDOMINANTLY CIVIL IN NATURE Research shows that legal needs are predominately civil in nature. The most common types of problems for which legal aid services are sought relate to consumer rights, government benefits, housing, employment issues, land and property disputes, family issues, conflicts with neighbors, and debt relief. Pascoe Pleasence, Nigel J. Balmer and Rebecca L. Sandefur, Paths to Justice: A Past, Present and Future Road Map, 2013 legal aid.36 Quantifying the full net economic impact of the provi- sion of legal aid is not straightforward, but there is at least some consensus on the direction of the impact and the main channels of transmission. Assessing the impact of some direct and predomi- nantly indirect economic benefits proves to be a more challenging exercise, as there are many areas of influence that are not easily disentangled and quantified.37 12. In a world where data is becoming a prerequisite for the evaluation of policies and programs,38 governments need qualitative and quantitative data to help them allocate social spending most efficiently and effectively on a range of services, including legal aid. At times of budgetary constraint, policy-mak- ers are under greater scrutiny to show that justice expenditures are evidence-based.39 As a result, cost benefit analyses of legal aid have drawn greater attention, and decision-makers throughout the international justice community have begun to acknowledge the importance of this line of work.40 36 Interestingly, on the basis of the right to Habeas Corpus, the UK allocates the highest percentage of its justice system budget to legal aid, with 39 percent in England and Wales and 34 percent of the total budget allocated to legal aid in Scotland. Northern European states also have a strong tradition of generous legal aid systems with a significant budgetary share within the total budget of the justice system: Norway (38 percent), Ireland (35 percent), Sweden (28 percent), Netherlands (22 percent) and Finland (21 percent). Council of Europe, European Commission for the Efficiency of Justice, “European Judicial Systems Efficiency and Quality of Justice,” CEPEJ Studies No. 26, pp. 77-78, available at: https://rm.coe.int/rapport- avec-couv-18-09-2018-en/16808def9c accessed on July 28, 2019. 37 Supra note 28. 38 Volume 2 Inquiry Report—Access to Justice Arrangements, p. 880, https://apo.org.au/sites/ default/files/resource-files/2014/12/apo-nid42575-1217831.pdf. 39 See also World Bank, What works?: examples of empirically proven justice reforms, 2017, http://documents.worldbank.org/curated/en/506611513850612331/pdf/WP-P165762- PUBLIC-WhatWorksFINAL.pdf. 40 See, e.g., Canadian Forum on Civil Justice, The Cost of Justice: Weighing the Costs of Fair and Effective Resolution to Legal Problems, available at [need link]. The background report notes “a lack of previous integrated scholarly work from which to build” to inform the research on costs of civil justice, as well as “the need to solve the current methodological problems in costs of justice research;” U.S. Department of Justice, White House Legal Aid Interagency Roundtable: Civil Legal Aid Research Workshop Report, February 2016, https://www.justice. gov/lair/file/828316/download. A TOOL A FOR JUSTICE: TOOL FOR A COST JUSTICE: A COST BENEFIT BENEFIT ANALYSIS ANALYSIS OF LEGAL AID OF LEGAL AID 11 11 CHAPTER 2: FINDINGS AND EMERGING TRENDS FROM COST DS IE ? BENEFIT ANALYSES EGNA L YAS There are many different costs and benefits of legal aid services. Some are direct costs and benefits deriving I TL A from the provision of legal aid services. Others are indirect consequences of such services on the individual, the FF S EO community, the justice system, the economy and the society. By relying on a set of conservative assumptions and TN generally quantifying only short-term impacts, these studies suggest that the benefits of investing in legal aid BIE greatly outweigh the costs. Overall, we notice that cost-benefit work is still relatively new to legal aid service NTEF delivery. But the handful of legal aid programs to which CBA has been BOES applied demonstrate its promising policy application. ON F RA MDC SECTION 1: THE COST BENEFIT ANALYSIS: efits of legal aid can be quantified. Nonetheless, a good CBA will TS A TOOL FOR EXAMINING THE ECONOMIC monetize the costs and benefits to the extent possible and will note DSS RETURNS ON LEGAL AID what cannot be monetized. This enables a systematic evaluation N E EC O of different investment alternatives, to inform decision-makers in TR reaching their final investment decision. TH WHAT IS A COST BENEFIT ANALYSIS? IN IN EG 13. Cost benefit analysis (CBA) is a method for assessing the 15. A CBA offers both a financial and economic performance RG EM economic efficiency of public policies through the systematic assessment of the policy alternatives. Financial analysis only MA considers the costs and benefits that occur in monetary form, D EX measurement of social costs and benefits.41 The CBA does this by building a model that identifies the benefits of a policy, inter- while economic analysis takes into account adjusted values of A NY financial flows and adds the monetized value of costs and benefits FI N D I N G S WH vention, program or project, as well as the associated costs, and then subtracts the costs from the benefits to estimate the net which are otherwise not expressed in money terms (e.g., value of cost-benefit. When completed, a CBA will yield estimates of the net time, suffering, injuries, etc.). Both parts of the assessment yield benefits of an investment and evidence-based conclusions around performance indicators (i.e., financial and economic performance the feasibility and/or advisability of a decision to invest in a certain indicators) which are used to make an assessment of the financial policy, intervention, program or project. While individual decisions and economic viability of the program. focus on benefits and costs to the individual, the CBA examines the benefits accruing to, and the costs incurred by, all members of 16. CBAs can be done ex-post or ex-ante. An ex-post CBA is society, hence the terms social benefits and costs.42 conducted after a program has already been implemented in order to measure its performance. Ex-post CBAs evaluate 14. A CBA requires the monetization of costs and benefits, whether the investment was economically beneficial and inform which allows for the comparison of different policy alterna- decision-making about whether it should be renewed or expanded. tives. A distinctive feature of CBA is that the social costs and An ex-ante CBA,43 on the other hand, is developed before a legal benefits of different policy interventions are expressed in monetary aid program is set up, to determine the best types and scope of terms, which allows for direct comparisons along a common scale. funding. Ex-ante CBAs guide the formulation of investments, the Because the investment effects are monetized, CBA enables deci- evaluation of various alternatives for achieving the desired targets, sion makers to compare policies and programs that have different and the decision making about whether or not to fund the proposed outcomes and purposes. For example, a scenario including the investment.44 provision of legal aid services would be contrasted with a counter- factual baseline scenario that foregoes the provision of these services. As with CBAs in any sector, not all of the costs and ben- 43 Most of the studies on the economic impact of legal aid assess annual costs and benefits 41 International Encyclopedia of the Social & Behavioral Sciences, 2001, https://www.scien- arising from legal aid programs as a whole. The Australian government used this compre- cedirect.com/topics/social-sciences/cost-benefit-analysis. hensive approach to evaluate economic benefits of the entire legal aid program for a 12-year 42 Anthony E. Boardman, International Encyclopedia of the Social & Behavioral Sciences period in order to make necessary adjustments to their legal aid funding model (PWC, 2015). (Second Edition), 2015, https://www.sciencedirect.com/topics/social-sciences/cost-benefit- 44 http://www.fao.org/in-action/herramienta-administracion-tierras/module-5/practical- analysis. evaluation-guide/introduction-cba/en/. 12 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID THE USE OF CBAs FOR LEGAL AID CBAs at a global scale.52 In particular, F W IN GOVERNMENT SPENDING HD this study surveyed CBAs from a range of YIN jurisdictions,53 including from OECD coun- EX The justice sector has GA 17. To help weigh their options, policy- tries and non-OECD countries, large and SM makers are increasingly turning to CBAs. been slow to catch small jurisdictions, and civil and common AIN Originally developed to evaluate engineering law systems. Most of these CBA studies have ND on to this trend [of E E projects, the CBA has since been adapted either examined the impact of overall legal TM conducting CBAs]. aid programs or the impact of legal aid in HE and used by governments and non-govern- ER ment entities alike to examine the intangible In recent years specific fields. These include legal aid poli- CG cies aimed at preventing domestic violence, OIS and tangible benefits of policies dealing with though, CBAs are NT mental illness,45 substance abuse,46 college delaying/avoiding foreclosures, preventing GS TA education,47 and chemical waste.48 The jus- used increasingly to evictions, reducing the rate of arbitrary RN tice sector has been slow to catch on to this detention of low-income individuals and ED evaluate spending ND trend. In recent years though, CBAs are used improving the efficiency of the courts system. BS on access to justice Researchers have applied CBAs to assess: (i) EN increasingly to evaluate spending on access FR to justice programs, including legal aid.49 the cost-effectiveness of a protective order E FI programs, including OM for victims of domestic violence; (ii) access T SC O F legal aid, to determine to legal aid representation in both criminal 18. CBAs can be a powerful tool for those seeking expanded funding of legal aid ser- the appropriate and civil legal matters; and (iii) access to ST vices. This is particularly relevant because legal aid information, including legal advice, LE 50 allocation of public BG many of the benefits brought by the provision education, workshops and clinics. This report EA NLE FI of legal aid programs go far beyond the resources. also surveyed some examples of CBAs and impact evaluations of access to justice A IT clients served, generating results for indi- D? viduals, the economy and society at large. interventions beyond legal aid. A N A LY S E S Carefully conducted CBAs may therefore cre- ate a broader consensus in favor of increased THE ANALYTICAL APPROACH TO CONDUCTING A CBA funding for legal aid programs, while guiding the design, evalua- OF LEGAL AID tion and monitoring of such programs in the future. 20. A CBA uses an incremental approach to assess the costs and 19. The use of CBA to evaluate legal aid investment is a small benefits arising from a “with-project” versus a “without-project” but growing field. This study surveyed around 53 cost and benefit scenario. The costs and benefits of each scenario are then devel- studies that sought to evaluate the economic impact of past or oped independently from one another and subsequently compared future interventions in legal aid and related services around the to arrive at a series of net benefits which represents the difference world.51 This is a first attempt at analyzing the results of legal aid that the additional (i.e., incremental) action is expected to bring about. Additionally, a CBA could consider more than one alternative to the “without-project” scenario in order to develop an optimal 45 Weisbrod, Burton A., “Benefit-Cost Analysis of a Controlled Experiment: Treating the program. Whatever the case, the comparison of project alternatives Mentally Ill.” Journal of Human Resources. 16 (4): 523–548, 1981, doi:10.2307/145235. JSTOR 145235. (e.g., scenarios) should consider only the incremental portion of the 46 Plotnick, Robert D., “Applying Benefit-Cost Analysis to Substance Abuse Prevention Programs.” International Journal of the Addictions, 29 (3): 339–359, 1994, “with-project” scenario (i.e., the portion of financial and economic doi:10.3109/10826089409047385. 47 Weisbrod, Burton A.; Hansen, W. Lee (1969). Benefits, Costs, and Finance of Public Higher costs and benefits which are the result of that particular scenario Education. Markham. versus a “do-nothing” approach). 48 Moll, K. S.; et al., Hazardous wastes: A Risk-Benefit Framework Applied to Cadmium and Asbestos, 1975, Menlo Park, CA: Stanford Research Institute. 49 See Yvon Dandurand and Micheal Maschek, Assessing the Economic Impact of Legal Aid in British Columbia: Promising Areas for Future Research, University of the Fraser Valley, April 19, 2012. 50 See Ken Smith, Barbara Finkelstein and Christopher O’Malley, “Economic Impacts of Legal Aid: Civil Justice for Low-Income People Creates Ripple Effects That Benefit Every Segment 52 In developing this Study, the International Bar Association and the World Bank used their of The Communities We Serve,” Management Information Exchange Journal, Fall 2011, joint networks to collect all known examples of CBAs of legal aid from around the world. No http://www.greatprograms.org/mie_article/pdfs/Economic%20Impacts%20of%20Legal%20 guarantee can be made, however, that all have been captured. Aid_MIE%20Journal_Fall%202011.pdf 53 The World Bank Group utilizes CBAs to perform both ex-post and ex-ante assessments of 51 Access to justice can be ensured in a variety of ways. While reviewing the costs and justice reform projects. For further details, please refer to the examples of Implementation benefits of policies and programs, this report does not advocate for any particular type of legal Completion and Results (ICR) Report for Justice Reform Projects in Romania (http://docu- aid or related service. Rather, to the extent possible, it tries to take a stock of existing evidence ments.worldbank.org/curated/en/676791513998156427/pdf/Implementation-Completion- on costs and benefits of legal aid and related programs. In doing so, it offers practitioners and-Results-Report-ICR-Document-12202017.pdf) and Croatia (http://documents.worldbank. guidance and tools to assess the economic viability of their own legal aid or related services. org/curated/en/725001497278193801/pdf/ICR00003984-06072017.pdf). A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 13 21. Conceptually, the development of a CBA has three main ana- FIGURE 2: THE THREE ANALYTICAL BLOCKS OF A CBA DS IE ? lytical blocks. As an illustration, let us consider a simplified envi- NA L YAS ronment where a decision-maker is considering whether and how to increase funding for a legal aid program for victims of domestic PHASE 1 EG I TL A violence. Applying the incremental approach would typically involve the following: Estimate costs and benefits of FF A WITHOUT-PROJECT SCENARIO S EO in monetary terms TN 1) Develop an estimate of all costs and benefits related and determine overall BIE EF to the current program operation (i.e., the “without-project” costs/benefits NT scenario).54 The amount of public and/or private funding that the BOES current legal aid program requires would be considered the total DC cost, while benefits would be estimated as the number of domestic M PHASE 2 ON violence cases avoided due to this program. These benefits include F RA TS many sub-items, of which the most common are the avoidance of: SS pain, suffering, health deterioration, decrease in production, con- Estimate costs and benefits of N OD sumption costs, administrative costs, second generation costs and A WITH-PROJECT SCENARIO E EC in monetary terms and TR the economic costs of transfers.55 TH determine overall EG costs/benefits IN 2) Estimate the scope and funding of the “with-project” alter- RGIN native and make a projection of the costs and benefits of this EM scenario. The costs of this scenario would be those associated with MA D EX additional funding for the provision of legal aid. The main benefits would come from the additional reduction of costs resulting from PHASE 3 A NY FI N D I N G S WH cases of domestic violence avoided due to the new legal aid pro- gram. This would be calculated using the same criteria as for the Subtract net benefits of Step 1 existing program. from those estimated in Step 2. Calculate financial and economic performance indicators. 3) Finally, compare the results of the “with” and “without” additional funding scenarios (i.e., determining the net benefits from adding more funds). These net benefits would be used to cal- culate financial and economic performance indicators, which would inform a final assessment of the effectiveness of the additional funding. In other words, if the performance indicators show that SECTION 2: MAIN FINDINGS OF CBA STUDIES adding funds to the existing legal aid program will bring net addi- tional benefits, then that program expansion is economically viable. COSTS AND BENEFITS OF LEGAL AID SERVICES 22. Legal aid services can deliver a range of benefits to the parties affected. Tangible costs and benefits are those that involve monetary payments as a result of the provision of legal aid ser- vices. These costs and benefits can be estimated quite accurately. Examples of tangible costs include government expenditures on legal aid programs, out-of-pocket losses to legal aid clients as well 54 The “without-project” scenario actually refers to the scenario where no additional invest- as the costs of pro-bono services provided by private lawyers, bar ment is made (i.e. keeping the current volume of legal aid program—current situation). This additional investment, made on top of the current program, is what the CBA deals with. associations and that of other providers. Tangible benefits include 55 Consumption costs include: property replacement, bad debts, and lost economies of public benefits recovered on behalf of legal aid clients or cost scale in household operation. Administrative costs include: legal/forensic services, temporary accommodation, paid care (i.e., housekeeper), counseling, perpetrator programs, interpreter savings to the government and society from avoided provision of services, and funerals. Second generation costs include: childcare, changing schools, coun- seling, child protection services, remedial/special education, increased future use of govern- government welfare programs. Tangible benefits may also include ment services, and increased juvenile and adult crime. Transfer payments include: Victim compensation, income support, accommodation subsidies, lost taxes, financial help to victim efficiency gains to the justice system from more expedient court from friends and family and child support. Access Economics, The Cost of Domestic Violence processes as a result of representation by legal aid litigants. to the Australian Economy: Part I, 200, p. 5 at: https://www.dss.gov.au/sites/default/files/ documents/05_2012/cost_of_dv_to_australian_economy_i_1.pdf 14 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 23. Intangible costs and benefits are harder to quantify. paid for through taxation or insurance). Government expenditures F W IN HD Intangible benefits can include social capital, feelings of empow- on legal aid programs are an example of direct costs to society from YIN erment, and increased trust in government and/or the rule of providing legal aid services. EXGA law. Such benefits are not easily quantified, and evaluating them is SM more subjective than for tangible benefits. Therefore, a CBA should 25. Indirect benefits and costs are the secondary results of AIN generally not be conducted using intangible benefits alone. legal aid. The efficiency gains to the courts derived from the NDE E provision of legal assistance, the training of legal aid clients and TM 24. With regards to measurement methods, benefits and costs self-represented litigants, and preserved property values resulting HE ER can be classified as either direct or indirect. Direct costs and from legal aid are just a few examples of its indirect benefits. To CG OIS benefits are associated with the provision of legal aid. To calculate estimate such benefits and costs, researchers generally tap sec- NT these, researchers look first at primary sources of information, such ondary sources of information, such as property valuation, surveys GS TA as civil legal aid surveys or the budgets of legal aid service provid- on productivity loss due to workdays missed, statistical data on RN ers. Avoided costs of hospitalization and medical treatment that increased morbidity as a consequence of lack of legal representa- ED ND legal aid help avert, for instance, is a direct benefit to survivors of tion, and court data on court efficiency gains/losses derived from BS domestic violence (in countries where users pay directly for these the provision of legal assistance and from self-representing clients. EN FR services) and to governments or businesses (when the services are E FI OM T SC O F TABLE 1. SUMMARY OF THE COMMON COSTS OF UNMET LEGAL NEEDS AND THE BENEFITS OF LEGAL AID PROGRAMS ST COST/ LE DIRECT INDIRECT BG BENEFITS EA NLE FI A IT TO THE INDIVIDUAL AND SOCIETY: TO THE INDIVIDUAL AND SOCIETY: • Property damage • Productivity losses for unpaid workdays D? • Medical and mental health care • Increased probability of mortality and A N A LY S E S • Government legal aid and related morbidity social services • Lost housework • Lost income for unpaid work days • Tax losses TANGIBLE • Legal fees TO THE JUSTICE SYSTEM: TO THE JUSTICE SYSTEM: • Court efficiency gains/losses from • Pre-trial detention the provision of legal assistance • Prosecution • Court efficiency loss due to • Incarceration self-representing clients • Court expenses associated with legal cases (e.g., filing, court staff time for record keeping etc.) TO THE INDIVIDUAL AND SOCIETY: TO THE INDIVIDUAL AND SOCIETY: • Pain, suffering and quality of life losses • Feelings of disempowerment/ INTANGIBLE • Behavioral problems and performance empowerment decline and lost education of children • Increased/decreased trust in the justice system TO THE JUSTICE SYSTEM: • Skills of legal aid clients and self- TO THE JUSTICE SYSTEM: represented litigants developed as a • Social clout and feelings result of capacity building training of empowerment A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 15 26. The terms “costs” and “benefits” are assessed the net economic impacts of their DS IE ? used interchangeably depending on wheth- legal aid systems.56 These studies gener- NA L YAS er one is examining the effect of a legal aid ally look at the direct economic benefits To calculate indirect program or the lack thereof. In other words, and costs of legal aid, and some indirect EG benefits or avoided I TL A the cost of an incident of domestic abuse, for benefits attained predominately in the areas instance, equals the benefit of an incidence of homelessness and domestic violence pre- FF costs (e.g., pain, S EO of domestic abuse that was prevented as a vention.57 Most of these studies rely on a set TN result of legal aid. Similarly, the benefits of suffering, reduced of conservative assumptions, quantifying BIE EF legal aid in terms of increased court effi- quality of life, etc.), only the directly observable tangible costs NT ciency will equal the cost of reduced court and benefits of legal aid that are most likely ES studies generally rely BO efficiency when legal aid is not provided. In to be realized.58 DC addition, this study does not aim to offer on existing literature ONM an exhaustive overview of all the potential 30. Most CBAs follow the standard method F RA on the cost of TS costs and benefits associated with legal aid of calculating the direct monetary ben- S victimization. S programs. Rather, the types of costs and efits and costs from the provision of legal N OD benefits described here are simply indicative aid services. The calculation of direct ben- TRE EC of the those commonly identified in the CBAs efits usually involves the sum of retroactive TH surveyed for this report. awards and new benefits won by the clients INEG of legal aid, as well as the anticipated future IN COMMON FEATURES OF LEGAL AID CBAs RG benefits.59 Total direct monetary benefits are computed by multiply- EM ing reward amounts by the number of beneficiaries and average MA D EX 27. The main findings of these CBAs suggest that the economic duration of each type of benefits.60 The calculation of direct costs benefits of legal aid investment outweigh the costs, and that A NY associated with the provision of legal aid is also straightforward. FI N D I N G S WH support for legal aid programs can bring significant budgetary The figures are usually obtained directly from the providers of legal savings to the government and economic savings to the society. aid and typically include all sources of revenues within a jurisdic- This is particularly relevant because many of the benefits brought by tion of interest.61 the provision of legal aid programs go far beyond the clients served, bringing tangible results for the economy, society and the justice 31. The calculation of indirect benefits of legal aid for CBAs system. As a result, CBAs offer a powerful tool for finding the most generally requires more expert knowledge and evidence on the efficient and effective allocation of government funding. subject. Most CBAs only consider direct costs such as damaged property or medical costs, but some also account for indirect costs 28. With regards to the costs and benefits quantified, CBAs of such as pain, suffering, fear, and reduced quality of life. When legal aid can be classified as either narrow or comprehensive. included, these costs are often drawn from existing literature on the Narrow cost-benefit analyses focus primarily on direct tangible cost of victimization. For CBAs of domestic violence legal aid pro- benefits and costs resulting from the provision of legal aid services. grams, numerous studies in the U.S. utilize the cost of victimization Comprehensive cost-benefit analyses include narrow cost-benefit provided by a renowned CBA study in the U.S. State of Wisconsin.62 analyses plus a more extensive accounting of the indirect economic That study finds that each prevented incident of domestic violence benefits to all those affected. This accounting includes all the costs and benefits to individuals, the justice system, the economy and society, such as: the avoided indirect costs of pain, suffering, fear 56 States that undertook economic impact analyses of their legal aid systems include Alaska, Arizona, Arkansas, California, Florida, Georgia, Iowa, Illinois, Louisiana, Maryland, and quality of life losses due to a specific crime, property value Massachusetts, New Hampshire, New York, North Carolina, Ohio, Oklahoma, Pennsylvania, and tax losses for communities, or efficiency losses for the courts Tennessee, Texas, and Virginia. In part, the decision to utilize these evidence-based practices was driven by the need to preserve and even extend funding for legal aid programs in times of from self-represented litigants. In other words, this comprehensive historic budgetary pressures, by showing decision makers that the work of legal aid services reaches beyond the clients served. assessment aims to capture the welfare costs of legal aid problems 57 Ibid. 58 Ibid. and tax losses that are avoided, along with the efficiency gains to 59 For the purpose of comparison, future streams of benefits are discounted to arrive at a the justice system. present value. 60 The information on the duration of benefits can be obtained from legal documents. 61 In the case of U.S. CBAs, the direct costs typically cover all in-state revenues of legal aid providers, such as state or local tax dollar support, contributions from other organizations 29. The narrow cost-benefit analysis is more common among the within the state, as well as voluntary donations. 62 See Liz Elwart, et al., “Increasing Access to Restraining Orders for Low-Income Victims of CBAs surveyed for this report. An extensive body of evidence comes Domestic Violence: A Cost-Benefit Analysis of the Proposed Domestic Abuse Grant Program,” from the U.S., where in the last two decades many states have Wisconsin Access To Justice Committee Report, December 2006, http://www.nlada.org/DMS/ Documents/1176146724.92/. 16 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID saves US$3,201 in avoided medical care, to result in more spending. This is because F W IN HD mental healthcare, lost productivity, and low-income households, which are the typical YIN property damage costs.63 recipients of legal aid, tend to spend most EX An inflow of extra GA of their income instead of saving it. Also, SM 32. Using these research findings as well money into the spending by low-income households typically AIN as other data sources, CBA studies in the takes place within their own communities ND community because E E U.S. States of Tennessee (2015) and Illinois rather than outside of them, which adds to TM (2012) estimate the costs of an avoided of legal aid can the potential multiplier effect of legal aid HE ER domestic violence incident to be US$10,620 support additional interventions.70 CG OIS and US$16,599 respectively. This includes a economic activity, NT wide range of impacts brought on by domestic 34. When accounting for the multiplier GS TA violence, including intangible losses.64 Other which generates effect, most U.S. CBA studies show sub- RN studies apply more conservative estimates stantial economic benefits from the provi- ED more income, which ND for the cost of domestic assault,65 factoring sion of legal aid. A CBA of civil legal aid in BS in only the cost of medical and mental health in turn leads to more Maine found that every dollar coming into the EN FR care, estimated at US$816 per incidence of state (e.g. recovered federal benefits, income E FI spending, more income OM abuse.66 As shown, the cost estimates of tax refunds and reductions for the legal T SC O F domestic violence vary widely across CBA and so on. aid clients, as well as federal grants to the studies, depending largely on the range and providers of legal aid) generates about one ST nature of impacts included in the cost of extra dollar through multiplier effects. The LE BG domestic abuse.67 statewide monetary impacts associated with EA NLE FI one-to-one civil legal aid services totaled an 33. Among the indirect benefits are those derived from the so- estimated $37 million in 2015, including US$6.6 million in federal A IT D? called multiplier effect. An inflow of extra money into the commu- dollars received and US$6.7 million from their associated multiplier A N A LY S E S nity because of legal aid can support additional economic activity, effects.71 A CBA of legal aid in the U.S. State of Texas found a size- which generates more income, which in turn leads to more spending, able benefit to the Texas economy: it estimated that for every dollar more income and so on. The multiplier effect analyses have gener- spent on the provision of legal aid services, the state economy gains ally been conducted under a set of conservative assumptions, with US$7.48 in overall spending, US$3.56 in gross product, and US$2.22 expert opinions given great consideration.68 The overall multiplier in personal income.72 None of the studies, however, attempted effect varies depending on the size of the community where the legal to determine the correct multiplier for various types of legal aid aid services are provided, as well as the spending patterns of the benefits,73 but instead relied on the Bureau of Economic Analysis civil legal aid organizations and their clients. It is also commonly 69 Regional Input Output Multiplier System74 and the respective known that at lower income levels, an increase in income is likely regional multipliers75 for the quantification of such net benefits. 63 Ibid., p. 13, See Minnesota 2013 (p.13), New York City 2010 (p. 26), Virginia (p.6), and 35. Some CBAs adopt a more tailored approach to estimating Montana 2015 (p. 17). the costs and benefits of legal aid. In many instances, the need 64 See Tennessee 2015, (p. 12); Illinois 2012 (p. 14). The per-incident cost of assault used in the analysis captures the losses in workplace productivity, lost income, medical and is prompted by the wide range of legal aid services, the valuation mental health treatment expenses, costs of social services, law enforcement, and justice system costs. 65 See Maryland 2013, p. 13. 66 Ibid. The studies use the average cost of US$816 for medical and mental health care resulting from a physical assault, referring to Department of Health and Human Services, 70 See Laura K. Abel & Susan Vignola, “Economic and Other Benefits Associated with the Centers for Disease Control and Prevention, National Center for Injury Prevention and Control, Provision of Civil Legal Aid,” 2010, Seattle Journal for Social Justice: Vol. 9: Iss. 1, Article 5., Costs of Intimate Partner Violence Against Women in the United States, March 2003, https:// p.p. 142-143 available at https://digitalcommons.law.seattleu.edu/sjsj/vol9/iss1/5 www.cdc.gov/violenceprevention/pdf/ipvbook-a.pdf (DHHS study). 71 See Todd Gabbe, Economic Impact of Civil Legal Aid Services in Maine. Maine’s Justice 67 For instance, when the quality of life is incorporated into the analyses, the cost of a domes- Action Group, November 2016. tic violence incident can average as much as US$26,000 (Wisconsin study). 72 The Perryman Group, Current and Potential Economic Benefits of Legal Aid Services in 68 See Iowa Legal Aid, The Economic Impact of Iowa Legal Aid, January 2013, Texas: 2013 Update, February 2013. http://www.iowalegalaid.org/files/A3ED30CF-AFFE-7431-9310-0D521E4312AF/attachments/ 73 See Supra note 72. CF9C722F-986A-48F4-A399-D664E1837D79/economic-impact-study-1-22-13.pdf. The deci- 74 “Multiplier models” or input-output models are often used to trace individual changes in sion to apply a multiplier of 1.25, a lower bound of the 1.25-1.4 multiplier range found by final demand through the economy over short periods of time. These multipliers can generally Iowa State Professor of Economics David Swenson, was made by the authors based on the be applied to all federal funds coming into a state, including federal grants that are used to conservative assumption, implying that “each new dollar brought into Iowa as a result of Iowa finance the provision of legal aid services and federal benefits recovered on behalf of legal Legal Aid’s work results in an additional 25 cents of economic activity”; Feelhaver et al., The aid clients. Economic Impact of Legal Aid of Nebraska (March 2008), [available at http://legalaidresearch. 75 See Jonah Kushner, Legal Aid in Illinois: Selected Social and Economic Benefits, July 2012, org/wp-content/uploads/Research-The-Economic-Impact-of-Legal-Aid-of-Nebraska.pdf] The http://iejf.org/wordpress/wp-content/uploads/LegSrvs_Report_120717.pdf. The researchers researchers used a multiplier of 2.0, finding it to be “conservative when compared to basic applied the retail trade sector multipliers to model the impact of Social Security, Temporary industries” for Nebraska. Assistance to Needy Families (TANF), veterans’ benefits and IRS tax awards. Similarly, the real 69 See generally Paola Cavallari, Matthew D. Devlin and Rebekah A. Tucci, Justice Measured: estate sector multipliers were applied to rental assistance awards, and multipliers for the An Assessment of the Economic Impact of Civil Legal Aid in Arkansas, October 2014. ambulatory care services sector were used for Medicare and Medicaid awards. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 17 of which could not easily be performed on an individual basis. For savings to the justice system from the reduced number of people DS IE ? example, a CBA of the Community Advice Offices (CAOs) in South held in pre-trial detention. In this example, the costs of deten- NA L YAS Africa76 adopted a contingent valuation Willingness To Pay (WTP)77 tion are generally observable and can be linked to the number of approach to the CAO’s service users. By following this approach, a detainees. When legal aid is accessible and arbitrary detention is EG I TL A total of 186 service users were asked about the amount of annual avoided as a result, the calculation of savings realized is relatively contribution they would be willing to offer, if legal advice services straightforward. Other economic benefits to the justice system, such FF S EO were not provided for free. The users were also asked about the as increased public trust in the rule of law, are more difficult to TN amount they would be willing to offer for the service they received calculate. However, depending on the political context of the coun- BIE EF on the day of the interview. The main assumption of the evaluation try (e.g., fragile and conflict affected settings), neglecting those NT was that users are sufficiently informed about what value the CAO variables can significantly underestimate the overall benefits of the BOES brings and that their willingness to pay to keep it in operation would legal aid delivery system. DC be a reasonable proxy for the benefits it provides. This South Africa ONM study demonstrates alternative ways to estimate the benefits of 38. Within this line of work, some studies analyzed the costs F RA TS legal advice that are not easily to be monetized. and benefits attributable to alternative dispute resolution, legal SS advice and legal representation in courts. For example, in OD SECTION 3: EMERGING TRENDS OF CBAs N Uganda80 a CBA was conducted of the National Legal Aid Policy TRE EC (NLAP) with the aim of expanding early access to dispute resolu- TH CBAs OF LEGAL AID PROGRAMS: PRE-TRIAL DETENTION, tion mechanisms for indigent, marginalized and vulnerable groups EG LEGAL ADVICE, LEGAL REPRESENTATION AND ALTERNATIVE IN through greater use of paralegals81 and students in law clinics IN DISPUTE RESOLUTION RG as legal aid providers. Land disputes, especially for women, were EM identified as a key priority of legal aid in the country. To conduct MA 36. Legal aid can make the justice system more cost-efficient D EX and equitable. Economic research suggests that there are several the CBA, the study relied on various sources of information, such A NY channels of transmission through which the justice system can as desks reviews, interviews with various stakeholders, relevant FI N D I N G S WH become more cost-efficient and equitable as a result of the provi- baseline surveys, as well as the available literature on the costs and sion of legal aid. In the case of the criminal justice system, a func- benefits of legal aid in the African context. The benefits and costs of tioning legal aid delivery system may help reduce the length of time legal aid identified in the study included: suspects are held in police stations and detention centers.78 In addi- a. cost savings to police by reducing avoidable detentions at tion, it can contribute to a reduction in the prison population, the police stations; number of wrongfully convicted persons, as well as the prevention of b. cost savings to prisons by reducing populations in pre-trial crime by increasing awareness of legal rights among marginalized detention and remand; groups. Legal aid in civil, administrative and family justice systems c. cost savings to courts through fewer self-representing litigants can also make them more efficient by resolving legal problems at and the number of cases diverted from the courts system; early stages through alternative dispute resolution mechanisms, d. employment related benefits (post detention); as well as by reducing the time spent by courts on otherwise self- e. cost savings from using paralegals compared to legal officers represented litigants. at magistrate districts; f. pro-bono services; 37. A growing number of CBAs argue that the provision of legal g. cost savings to individuals from resolved land dispute cases, aid can bring cost savings to the justice system. These include and; the avoidance of pre-trial detention,79 avoided sentencing costs, h. direct budgetary costs of legal aid services.82 and efficiency gains for the courts via reduced time spent on self- In addition, the study mentions other commonly identified social and represented litigants. More easily quantifiable evidence includes economic costs of pre-trial detention to low-income individuals and their families, such as loss of income, suspension of education, loss 76 See YD Davids et al, Community advice offices: Making a case for public funding, September 2015. 77 See: https://marketbusinessnews.com/financial-glossary/willingness-pay-definition- 80 See Legal Aid Service Providers’ Network, Cost Benefit Analysis of the Uganda meaning/. National Legal Aid Policy, May 2016, http://www.laspnet.org/joomla-pages/reports/research- 78 See generally Dandurand, Yvon and Jahn, Jessica, A Feasibility Study on Measuring reports/405-cost-benefit-analysis-of-the-uganda-national-legal-aid-policy/file. Economic Impact of Criminal and Immigration and Refugee Legal Aid in Canada Issues, 81 A paralegal is generally referred to as a person who is not a fully qualified lawyer, but Options and Recommendations, 2018, 10.13140/RG.2.2.30042.18882. capable of providing some or all of the services that are provided by fully qualified law- 79 High rates of pre-trial detention are particularly evident in low income countries and yers. The reliance of paralegals as legal aid providers has been growing in many regions states emerging from conflict. According to the Institute for Criminal Policy Research (ICPR), of the world, particularly in developing African countries. See generally the Kampala pre-trial detainees account for 86 percent of the prison population in Bolivia, 83 percent in Declaration on Community Paralegals, available at available at https://namati.org/wp- Liberia, and 74 percent in Bangladesh. It has been estimated that globally about 3 million content/uploads/2015/02/Kampala_Declaration_on_Community_Paralegals.pdf. people or one third of the global prison population are held in pre-trial detention at any given 82 Ibid. See pp 34-44 for further reference, Cost Benefit Analysis of the Uganda National time (Open Justice Foundations). Legal Aid Policy. 18 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID of housing, exposure to disease, and psychological abuse. However, • for every £1 of legal aid expenditure on housing advice, the F W IN HD these benefits are described generally as a way to strengthen the state potentially saves £2.34; YIN case for the legal aid intervention, but are not monetized and so do • for every £1 of legal aid expenditure on debt advice, the state EXGA not influence the empirical results of the CBA. potentially saves 2.98; SM • for every £1 of legal aid expenditure on advice relating to AIN 39. The provision of legal aid through alternative dispute reso- social welfare entitlements, the state saves £8.80; NDE E lutions, legal advice, education and representation also gener- • for every £1 of legal aid expenditure on employment advice, TM ated significant benefits for women, children and marginalized the state saves £7.13. HE ER communities in Bangladesh. Through 453 legal aid clinics in 63 out The CBA model builds upon three main variables: (i) the incidence CG OIS of 64 districts across the country, the Human Rights and Legal Aid of adverse consequence amongst legal aid clients, (ii) the cost of NT Services program reported the following results: (i) 90,118 people adverse consequences88 on other public services, and (iii) the link GS TA were made aware of human rights and received basic legal educa- between receiving advice with a positive outcome89 and avoidance RN tion, (ii) 28,000 complaints were received at legal aid clinics, with of adverse consequences. The authors then calculate the total cost ED ND 18,656 resolved through alternative dispute resolutions, (iii) 2,023 to the government for those people receiving legal aid who would BS cases of violence were reported and (iv) more than US$ 5million experience adverse consequences. The cost of prevented adverse EN FR recovered in favor of legal aid clients.83 consequences because of legal advice is calculated by adjusting E FI OM the total costs by the percentage of legal aid recipients who had T SC O F 40. In Liberia, an impact evaluation84 of a pro bono legal aid a positive outcome. Total savings (overall costs minus the cost program found that legal aid for marginalized groups had sig- of prevented adverse consequences) are adjusted for the cost of ST nificant and positive impacts on legal case outcomes, as well as legal aid to arrive at the savings to the government per type of LE BG significant downstream economic effects, including on household legal aid advice. EA NLE FI and child food security.85 Another study in Liberia measured the effects of mediation services and found that land disputes were 29 42. An assessment of legal aid in Scotland also points to signifi- A IT D? percent less likely to remain unresolved, property destruction was cant social returns on investment.90 That study concluded that, A N A LY S E S lowered by 32 percent, and disputants were 10 percent more satis- for a period of up to 12 months following legal aid: fied with outcomes.86 • Every £1 spent on legal aid in housing cases saw a return of around £11; 41. Several studies demonstrate that legal aid can deliver • Every £1 spent legal aid in criminal or family cases saw a substantial savings to the government by reducing expenditure return of around £5. on other public services or by avoiding or limiting the use of Across these three areas, at least 80 percent of the net benefits state resources. For example, a study from the U.K. examines accrued to the legal aid clients. For the clients, quantified benefits how adverse consequences associated with civil justice prob- included: avoided eviction; avoided custodial sentences (including lems, and the downstream costs for other public services, can be avoided loss of income); more and better prospects of employment; mitigated by legal advice.87 Using data from the justice survey and better health and family relationships. For the justice system, and the outcome data from legal aid work, the study finds that: the quantified benefits included: fewer cases going to court; fewer custodial sentences and incarceration costs; and reduced public spending on social services, including homelessness. Another study 83 See the 2018 BRAC annual report for Bangladesh, Human Rights and Legal Aid Services, in Indonesia91 showed that community-based justice can also p. 28, http://www.brac.net/sites/default/files/annual-report/2018/Bangladesh-Annual- reduce public spending by limiting the use of state resources on Report-2018.pdf. BRAC is a leading NGO that works to empower the poorest and most vulner- able in Bangladesh and eleven other countries across the world. other services.92 84 An impact evaluation applies rigorous methods to determine the changes in outcomes which can be attributed to a specific intervention. It differs from a CBA in that it focuses on the causal impact of an intervention, it is always done ex post, and it does not necessarily assess the economic viability of the intervention or quantify all costs and benefits. Impact 88 Ibid., this is estimated on the basis of the percentages of respondents who reported evaluations can, however, inform CBAs, particularly where they demonstrate socio-economic particular adverse consequences times and the average cost of an adverse consequence to impacts of legal aid. In this spirit, examples of impact evaluations are included in this study the government. for the reader’s reference. 89 Ibid., the case data used for the CBA included information on the outcome for the legal 85 See Bilal Siddiqi and Justin Sandefur, Delivering Justice to the Poor: Theory and aid client. This analysis assumes that getting a substantive benefit for a client means that Experimental Evidence from Liberia, March 2015, https://editorialexpress.com/cgi-bin/confer- the adverse consequences of the civil justice problem are avoided. ence/download.cgi?db_name=CSAE2013&paper_id=1014. 90 See Hammond, Clare, Vermeulen, Inga, Social Return on Investment in Legal Aid, 2017, 86 See Blattman et. al., How to Promote Order and Property Rights under Weak Rule of Law? Rocket Science UK Ltd commissioned by the Law Society of Scotland, https://www.lawscot.org. An Experiment in Changing Dispute Resolution Behavior through Community Education, 2014, uk/media/359230/social-return-on-investment-in-legal-aid-technical-report.pdf. American Political Science Review, 108(1), 100-120. doi:10.1017/S0003055413000543, avail- 91 See Berenschot W., Rinaldi T. Paralegalism and Legal Aid in Indonesia: Enlarging the able at https://chrisblattman.com/documents/research/2014.ImprovingOrder&PropertyRights. Shadow of the Law, 2011, available at http://namati.org/wp-content/uploads/2013/12/ APSR.pdf. Paralegalism-and-Legal-Aid-in-Indonesia_Final-Report.pdf. 87 See The National Association of Citizens Advice Bureau, Towards a business case for 92 Ibid., analysis of 338 cases in Indonesia showed that paralegals in Indonesia often found legal aid, July 2010, available at https://www.accesstojusticeactiongroup.co.uk/wp-content/ alternative solutions that minimized the need to involve police, mediating between conflicting uploads/2011/07/towards_a_business_case_for_legal_aid.pdf. parties in 54 percent of cases reviewed. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 19 43. Several studies93 suggest that legal aid can have a signifi- of detention. Within its first year of operation, the project recorded DS IE ? cant positive impact on pre-trial detention and the justice sys- significant successes in terms of the numbers of persons released NA L YAS tem. Examples from across the globe94 show that early intervention or diverted from pre-trial custody (611 detainees97) and police sta- schemes can reduce the use of pre-trial detention, improve the per- tions (644 persons), as well as in the average duration of pre-trial EG I TL A formance of the criminal justice system, and increase accountabil- detention (the average length of detention declined from 609 days ity and respect for the rule of law. An impact evaluation of legal aid to 171 days as a result of the project). FF S EO in three target districts of Sierra Leone found that the pilot secured TN bail for about 50 percent of people assisted in police stations. In 44. Another example of the impact of legal aid on pre-trial BIE EF addition, in 28 percent of the cases, the charges were dropped, detention comes from a project carried out by the Paralegal NT usually due to errors of identity, the misunderstanding of facts, or Advisory Service (PAS) in Malawi.98 The initial purpose of PAS was BOES a lack of evidence.95 As a result, within nine months of operation to reduce unlawful detention and prison overcrowding. During the DC and with only ten paralegals on duty, the pilot secured the release of first four years of its operation PAS contributed to the release of ONM approximately 80 percent of people from pre-trial detention at police approximately 2,000 prisoners, reduced substantially the number of F RA TS stations. A similar project aimed at providing early access to legal persons unlawfully remanded in prison and stabilized the remand SS aid on pre-trial detention was introduced in Nigeria in 2005.96 The population at 22 percent compared to 50 percent before the project N OD project sought to reduce both the number of pre-trial detainees as a was implemented. In addition to the reduction in the remand popu- TRE EC proportion of the overall prison population and the average duration lation, paralegals benefited the criminal justice system in many TH other ways: (i) about 100,000 prisoners were enabled to represent INEG themselves in court, argue for bail or enter a plea to the charges RGIN 93 It should also be noted that most of these studies are impact evaluations that did not against them; (ii) the number of illegal remand warrants used by EM attempt to quantify all the costs and benefits of legal aid programs under consideration. police declined significantly because of the routine administrative MA Nevertheless, they provided important evidence on the outcome of legal aid interventions, as D EX well as they magnitudes that could be regarded as an important milestone for a hypotheti- cal CBA. checks brought by the project; (iii) 354 juveniles were diverted out of 94 See generally Open Society Foundations, Improving Pretrial Justice: The Roles of Lawyers A NY and Paralegals, 2012, https://www.justiceinitiative.org/uploads/ce76d68b-747d-4743-a594- FI N D I N G S WH 4cd18d1759cb/improving-pretrial-justice-20120416.pdf. 95 See Open Society Foundations, Improving Pretrial Justice in Sierra Leone, https://www. 97 Ibid, this also represents a 19.6 percent decrease in the baseline number of persons justiceinitiative.org/publications/socioeconomic-impact-pretrial-detention-sierra-leone awaiting trial in the pilot states. 96 See Anthony Nwapa, Building and Sustaining Change: Pretrial Detention Reform in Nigeria 98 See Clifford Msiska, On the Front Lines: Insights from Malawi’s Paralegal Advisory Services in Justice Initiatives: Pretrial Detention, Open Society Institute, 2008, https://www.opensoci- in Justice Initiatives: Pretrial Detention, Open Society Institute, 2008, https://www.opensoci- etyfoundations.org/sites/default/files/Justice_Initiati.pdf etyfoundations.org/sites/default/files/Justice_Initiati.pdf 20 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID the criminal justice process; and (iv) savings 46. Some studies focus only on the net effi- W F IN HD to the justice system resulting from prisoners ciency benefits of legal aid for the courts. YIN entering informed pleas to their charges. An example comes from a CBA analysis EX A study from the GA Another positive impact of a paralegal pro- conducted by PricewaterhouseCoopers (PwC) SM gram was found in the case of Bangladesh, U.S. State of Kentucky for the National Legal Aid in Australia.103 That AIN where a program operating in three prisons study focused exclusively on quantifying the ND found that every US$1 E E resulted in the release of 700 unnecessary direct costs and benefits of legal aid which TM detained prisoners in just one year.99 spent on legal aid to accrue to the efficiency of the court system. HE ER secure a domestic It did not attempt to quantify benefits to cli- CG OIS 45. The excessive use of pre-trial deten- ents, the community or the broader economy/ violence protective NT tion also comes at a heavy socio-econom- society. Moreover, the report focused only GS TA ic cost to defendants, their families and order generated US$32 on legal representation, dispute resolution RN society at large, which can be mitigated services, and duty lawyer services, and did ED in avoided costs for ND through the effective provision of legal aid. not account for other services, such as legal BS Ineffective and corrupt penal systems are society. advice, information and education, though EN FR most damaging to the poorest and foster it also noted that these net benefits would E FI OM inequalities in society. Reports from around be expected to be significant, particularly T SC O F the world indicate that those entering pre- because they provide early intervention and trial detention come predominantely from the prevent unnecessary escalation of matters ST poorest and most marginalized groups of society, who are also least through the system. The costs were measured in terms of the LE BG prepared to encounter the criminal justice process, but more likely to funding provided for legal aid services. The savings to courts were EA NLE FI be detained awaiting trial, and less able to make bail or pay bribes measured based on the average court costs per type of outcome.104 for their release. Excessive and arbitrary pre-trial detention comes Key areas of efficiency savings included: A IT 100 D? with a wide range of socioeconomic shocks to detainees and their a. the resolution of legal issues at an early stage and streamlining A N A LY S E S families—pre-trial detainees may lose their job and be forced to of matters appropriately through the justice system; abandon their education or be evicted from their homes. In addition b. the diversion of cases away from the courts through the provi- to direct economic costs, detention imposes significant yet difficult- sion of dispute resolution mechanisms; to-quantify costs on individuals, including the loss of liberty, dignity, c. the increased efficiency of court processes by having duty law- damaged reputation and disruptions to family life, including multi- yers on hand to help self-represented litigants to address the generational effects. The over-use of pre-trial detention also makes court and present relevant information, and; the communities worse off, depriving them of income-earners and, d. the increased efficiency of the court associated with otherwise in some cases, exposing them to communicable diseases contracted self-representing litigants having legal representation. in detention facilities.101 Releasing detainees may also come at The study finds the net efficiency benefits to the courts of providing cost (such as the costs-imposed if these individuals commit crimes legal aid to be in the range of AUD$15.86 million to AUD$32.90 similar to those for which they are accused while on bail). But even million per annum. when the costs associated with the risk posed by each defendant to commit a crime during their pre-trial releases are taken into account, 47. Another study finds that legal workshops and clinics provided some studies still find significant societal benefits (approximately to self-represented litigants can produce cost savings for courts US$78 billion in economic value). 102 and litigants. This was shown by research conducted in the six trial courts of California’s San Joaquin Valley. The study found that courts that provided legal aid services through a workshop managed to reduce the number of court hearings and staff time, and that only US$0.23 was spent on legal aid for every dollar of overall savings for 99 Supra note 82, page 46. the courts. When benefits to litigants were taken into account, the 100 See Teresa Garcia Castro, Pretrial Detention in Latin America: the Disproportionate Impact on Women Deprived of Liberty for Drug Offenses, June 2019, https://www.wola.org/wp-content/ uploads/2019/05/Pretrial-detention-in-Latin-America_June-2019.pdf; See also Penal Reform International, Global Prison Trends 2018 (May 2018), available at https://cdn.penalreform. org/wp-content/uploads/2018/04/PRI_Global-Prison-Trends-2018_EN_WEB.pdf. 103 PricewaterhouseCoopers, 2009, Economic Value of Legal Aid. Analysis in relation to 101 See Open Society Foundations, The Socioeconomic Impact of Pretrial Detention (February Commonwealth funded matters with a focus on family law, available at http://legalaidact.org. 2011), available at https://www.justiceinitiative.org/uploads/84baf76d-0764-42db-9ddd- au/sites/default/files/files/publications/economic_value_of_legalaid.pdf. 0106dbc5c400/socioeconomic-impact-pretrial-detention-02012011.pdf. 104 Ibid., pp. 32-34. See also Australian Government, 2009, Productivity Commission, Inquiry 102 See Shima Baradaran, “Cost of pretrial detention,” Boston University Law Review. Boston Report, Volume 2, pp. 1060-1062 on a review of the study and issues with its assumptions, University. School of Law, January 2017, file:///C:/Users/wb402468/Downloads/costsofpretri- available at https://www.pc.gov.au/inquiries/completed/access-justice/report/access-justice- aldetention.pdf. volume2.pdf A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 21 a. The predominantly direct/tangible benefits to victims of domes- DS IE ? tic violence; NA L YAS THE COST SAVINGS OF LEGAL AID FOR b. The savings in the cost of emergency shelters for survivors of HOMELESS PEOPLE IN PHILADELPHIA domestic abuse, and; EG I TL A c. The benefits to children by protecting them from the negative If the city of Philadelphia invested $3.5 million consequences of domestic violence.106 FF per year to fund counsel for low-income tenants, S EO the city would save $45.2 million per year in other TN 49. Much of the domestic violence research looks at “improved BIE costs and expenses. EF Annual savings consist of: safety” in terms of “civil protective orders obtained” or “rates of NT re-abuse.”107 A study from the U.S. State of Kentucky examined the ES • $26 million in shelter costs for newly BO homeless persons impact of civil protective orders on victims of domestic violence. To DC • $7.5 million in in-patient hospital costs evaluate the intervention, the authors quantified the economic costs ONM • $1 million in emergency room treatments of partner violence six months before a protective order was issued F RA TS • $7.5 million in mental health costs and six months afterwards.108 The estimated costs were focused SS primarily on direct costs related to service utilization, including D Philadelphia Bar Association’s Civil Gideon and N O health and mental care services, legal services, and civil and crimi- E EC Access to Justice Task Force, November 2018 TR nal courts. Indirect costs related to lost opportunities to work and TH perform other duties, loss of quality of life, property losses and time INEG spent on transportation.109 Findings from the study suggested that RGIN protective orders made a difference in terms of safety, fear levels EM costs dropped to US$0.13 for every dollar of savings. Additionally, and cost savings. The relative cost of a protective order was found MA courts that provided one-on-one assistance and information services D EX to be small compared to the total costs associated with partner to litigants saved at least 5 to 15 minutes of hearing time for every A NY violence.110 Overall, the study found that for every US$1 spent on the hearing held, and 1 to 1.5 hours of court staff time related to aiding FI N D I N G S WH protective order, there were US$32 in avoided costs for society. self-represented litigants. The court savings as a result of the legal aid program ranged from a high of US$0.55 to a low of US$0.36 for 50. A similar study was conducted in the U.S. State of Wisconsin111 every dollar saved. If the cost savings to litigants were included, the to inform a decision on legal aid funding for victims of domestic overall costs decline to a range of US$0.33 to US$0.26 for every dollar violence. The study assumed that a legal aid service was success- of savings. Finally, assistance to self-represented litigants in resolv- ful if an effective restraining order was granted, meaning that it ing cases at the first court appearance reduced the number of future prevented at least one violent attack per victim. According to the court hearings, as well as their costs.105 The cost of the self-help study, this was a conservative assumption given that the average services was about US$0.45 for every dollar of savings, declining victim is assaulted an average of 3.4 times per year.112 Among the to US$0.14 for every dollar saved when the cost savings to litigants primary costs and benefits used in the model, the authors included were included. the direct costs of the legal aid program, the victims’ loss of access to their abusers’ income, and the cost-savings to victims of pre- CBAs OF SPECIFIC LEGAL AID PROGRAMS: DOMESTIC VIOLENCE LEGAL AID venting abuse, including the avoided costs of medical care, mental 48. Overall, the most common type of legal problem covered 106 See Supra note 56. by legal aid CBAs focuses on domestic violence. Most of these 107 None of those studies, however, attempts to measure the “improved safety” as such. Although not measured empirically, many studies point to consistent victim satisfac- studies follow a comprehensive cost-benefit analysis framework. tion with restraining orders. These findings are supported by other studies that find that “restraining orders do not appear to significantly increase the risk of re-abuse and may So in addition to the direct benefits, these studies identify and deter some abusers” See e.g., Jane Murphy, “Engaging with the State: The Growing Reliance quantify the indirect benefits attributable to the prevention of legal on Lawyers and Judges to Protect Battered Women,” 11 Am. U. J. Gender Soc. Pol’y & L. 499, 2003, p. 504 available at http://digitalcommons.wcl.american.edu/cgi/viewcontent. problems. Among the CBAs surveyed for this study, there are three cgi?article=1404&context=jgspl. 108 TK Logan et al., The Kentucky Civil Protective Order Study: A Rural and Urban Multiple commonly identified types of positive impacts arising from reduc- Perspective Study of Protective Order Violation Consequences, Responses, & Costs, University tions in the incidence of domestic abuse: of Kentucky, September 2009, http://www.ncjrs.gov/pdffiles1/nij/grants/228350.pdf. 109 In order to construct cost estimates, victims of domestic abuse were asked to report their services utilization, including services used because of the abuse, time lost from work, as well an any property losses stemming from the abuse, during the six months before and after the issuance of the protective order. 110 Ibid. 111 Wisconsin report. Liz Elwart, et al. “Increasing Access to Restraining Orders for Low- 105 See Greacen John, The Benefits and Costs of Programs to Assist Self-Represented Income Victims of Domestic Violence: A Cost-Benefit Analysis of the Proposed Domestic Abuse Litigants, May 2009, http://www.courts.ca.gov/partners/documents/Greacen_benefit_cost_ Grant Program,” Wisconsin Access To Justice Committee Report, December 2006. final_report.pdf. 112 Ibid., p. 12. 22 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID health care, lost income, lost quality of life and property damage. future domestic violence attacks, the increase in the number of vic- F W IN HD Total benefits or avoided costs were adjusted further for the effec- tims served by the legal aid program, and the increase in the num- YIN tiveness of a restraining order of 40 percent to arrive at an estimate ber of restraining orders granted).114 The results indicated mean EXGA of US$20.6 million. When total costs were taken into account (about net benefits of $9.1 million, with minimum benefits of $600,000 SM US$10.7 million, including the costs of the proposed program, as and maximum benefits of $27.5 million. The mean net benefits from AIN well as costs associated with losing access to abuser’s income), the the Monte Carlo sensitivity analysis were still high, indicating an NDE E net benefit of expanding the legal aid program was estimated to be economicallly viable program even given the uncertainty of some TM US$9.8 million. parameters used in the model. Under the worst-case scenario, the HE ER authors looked at the lowest possible benefits yielded by the legal CG OIS 51. Given the inherent uncertainty surrounding estimates of aid program subject to the minimum value of the model parameters NT costs and benefits of domestic violence legal aid, some studies (except the percent of victimizations that were physical assaults, GS TA have conducted additional robustness checks to corroborate the which was at its maximum in the worst-case scenario). When the RN findings. To assess the robustness of estimates of avoided costs to worst-case outcomes were considered, the legal aid program was ED ND the victims of domestic violence, CBA studies have utilized various still yielding net benefits of about $344,000, suggesting that the BS modelling techniques, including Monte Carlo113 sensitivity analysis program expansion would still be economically viable.115 EN FR and worst-case scenario analysis. Monte Carlo analysis was applied E FI OM to assess the program’s outcome under various changes in the 52. Alternative social services can also reduce the probability of T SC O F model’s inputs (e.g., changes in the number of victims of domestic future domestic violence. Some studies demonstrate that women’s violence, the proportion of victimizations that are rape or physical access to alternative social services, including legal assistance, ST assault, the number of effective restraining orders in deterring can reduce the probability of future domestic violence. In an effort LE BG to explain the causes behind a decrease domestic violence in the EA NLE FI 113 Monte Carlo is a statistical technique that uses sampling and probability distribution to A IT simulate the effects of uncertain variables on model outcomes. The advantage of this method D? is that it gives insights into the cumulative effect of multiple sources of uncertainty on each 114 Ibid., supra note 110, pp. 14-15. of the costs and benefits, including possible interactions between them. 115 Ibid., supra note 110, p. 16. A N A LY S E S A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 23 U.S. during the 1990s, Amy Farmer and Jill Tiefenthaler empirically values.122 A CBA for the U.S. State of Tennessee notes that every DS IE ? explored the linkages between an individual woman reporting abuse foreclosure may lead to a reduction in property value for the actual NA L YAS and relevant individual and county-level characteristics, including homeowners of as much as 43 percent, with an average reduction of the availability of legal assistance programs in the counties.116 The nine percent in the property value of homes in the neighborhood.123 EG I TL A study found that women who lived in counties with legal assistance programs designed to help women victim of domestic violence were 56. By preventing foreclosures, local governments and commu- FF S EO significantly less likely to be victims of domestic violence and report nities may avoid unnecessary spending on maintenance, sheriff TN abuse than women who lived in counties without aid.117 The study evictions, inspections, and the public safety of otherwise vacant BIE EF also found that other policy responses to domestic violence, namely and abandoned properties. These costs can be obtained from NT “hotlines, shelters, safe homes, emergency transportation, and previous cases of foreclosure and relevant financial statements of BOES counseling programs,” did not contribute to the decline in domestic government agencies.124 Another cost to governments is a reduction DC abuse,118 though they did provide some temporary safety nets to in property tax revenues resulting from foreclosures.125 The amount ONM the victims. Overall, the study supported a continued expansion of of property tax losses avoided due to the provision of legal aid can F RA TS civil legal aid services in communities, with the long-term benefit be calculated by multiplying the avoided reduction in assessed SS of reducing the incidence of domestic abuse.119 value per foreclosure by the property tax in the service area. As for N OD costs saved by keeping people out of homeless shelters, the overall E EC CBAs OF SPECIFIC LEGAL AID PROGRAMS: TR savings are determined by multiplying the number of cases in which TH FORECLOSURE LEGAL AID foreclosure was avoided or eviction was prevented/delayed by the INEG number of families in need of an emergency shelter and the aver- IN 53. A growing number of CBAs examine the impact of legal aid RG age cost of emergency shelter per family.126 According to the report, EM on eviction or foreclosure. As in the case of domestic violence the average costs of shelter for first-time homelessness is between MA D EX and other CBAs, measuring the benefits of avoiding eviction or US$1,634 and US$2,308 for an individual and between US$3,184 to foreclosure requires an estimate of a favorable outcome achieved A NY US$20,301 for a family. So, preventing foreclosures can avoid these FI N D I N G S WH for the clients compared to a business-as-usual scenario without costs as well. legal aid. By design, most legal aid housing programs include a range of predetermined positive outcomes that may be achieved for the clients (e.g., avoided eviction, obtained additional time, or avoided foreclosure). Whenever the outcome-to-case tracking is available, the existing studies rely upon that information to derive their outcome ratios.120 In other cases, some general assumptions are made about the degree of success.121 54. Foreclosures avoided through legal aid can generate sig- nificant savings for individual homeowners and for neighboring low-income communities, by helping preserve home values in the area. CBA studies generally rely on cost-of-foreclosure literature to derive their estimates on the resulting reduction in property 122 This includes the actual properties involved in foreclosure, as well as the immediate neighboring properties affected by the foreclosure. 123 See Ohio 2010 (p. 7). The study reports that each incidence of foreclosure may lower 116 See Amy Farmer & Jill Tiefenthaler, “Explaining the Recent Decline in Domestic Violence,” property values for other homes by as much as 2.1 percent, referencing Brien A. Mikelbank, 21 Contemporary Economic Policy 158, 2003, https://www.cga.ct.gov/jud/tfs/20160729_ November 2008. Spatial Analysis of the Impact of Vacant, Abandoned, and Foreclosed Task%20Force%20to%20Improve%20Access%20to%20Legal%20Counsel%20in%20 Properties, Federal Reserve Bank of Cleveland, https://www.clevelandfed.org/newsroom- Civil%20Matters/Reference%20Materials/Explaining%20the%20Decline%20in%20 and-events/publications/special-reports/sr-200811-spatial-analysis-of-impact-of-vacant- Domestic%20Violence.pdf abandoned-foreclosed-properties.aspx; See also Tennessee 2015 (p. 7), Montana 2015 (p. 18) 117 Ibid., pp. 10-12. In addition to the increased provision of legal assistance for victims of and North Carolina 2012 (p. 16). These studies reference Li Schloemer, Ernst and Keest. 2006. domestic violence, the authors report improvements in women’s economic status and demo- Losing Ground: Foreclosure in the Subprime Market and The Cost to Homeowners, Center for graphic trends among the key factors contributing to the decline in the incidence of domestic Responsible Lending, Table 6, available at http://www.peri.umass.edu/fileadmin/pdf/confer- violence during the period analyzed. ence_papers/SAFER/Schloemer_etal_Losing_Ground.pdf; According to the study, homeowners 118 Ibid. impacted by nearby foreclosures experience on average a loss of US$23,150 as a result of their 119 See Lou Marano, Access to Legal Aid Lowers Domestic Abuse, January 2003, United proximity to the foreclosures. Press International, http://www.upi.com/Odd_News/2003/01/08/Access-to-legal-aid-lowers- 124 Ibid. domestic-abuse/UPI-20631042061919/. 125 Ibid., see Tennessee 2015, p. 11. 120 Assumptions are generally based on the success rate of legal aid in avoiding/delaying 126 The average cost of emergency shelter provision for one family is based on the length eviction or avoiding foreclosure. See Tennessee 2015 (p. 10): by drawing on a scientific survey of stay (usually the number of days) and the cost of alternative housing in the area (e.g., on legal aid in the U.S. State of Pennsylvania, the authors assume an outcomes ratio of 11 the lowest cost of a hotel stay). Some studies (e.g., North Carolina 2012 and Montana 2015) percent and 51 percent, for brief representation versus extended representation housing derive their cost estimates for emergency shelter from a research study conducted by the cases, respectively. See also Pennsylvania 2012 (p. 7). Department of Housing and Urban Development. See U.S. Department of Housing and Urban 121 This may also include “borrowing” the estimates from other studies. See Tennessee, Development, Office of Policy Development and Research. March 2010. Cost Associated with 2015, http://www.tba.org/sites/default/files/2015-TN-Final%20Report%20Package_ First-Time Homelessness for Families and Individuals, available at https://www.huduser.gov/ Consolidated%20Statewide_3-18-2015.pdf. publications/pdf/Costs_Homeless.pdf. 24 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 55. In addition to the foreclosure studies in the US, there is escalation, heightened security of land tenure, more productive use W F IN HD considerable literature on the benefits of legal aid and legal of land, improved household incomes, better food security, and bet- YIN empowerment in land cases in the developing world, but no ter access to credit. There is also considerable qualitative evidence EXGA CBAs.127 Literature highlights various benefits that can flow to of the benefits of legal empowerment for women in the context of SM poor households through better access to legal information about land titling, inheritance and land disputes arising from gendered AIN land titling, and legal advice and representation in land disputes, land tenure practices. However, few cases have sought to quantify NDE E including early conflict resolution and the prevention of conflict these benefits, and none appear to have used a CBA methodology. TMHE Lessons could be applied from the CBAs in other fields to develop ER 127 See Mueller et. al, Filling the legal void? Impacts of a community-based legal aid CBAs of this type of legal aid. CG program on women’s land-related knowledge, attitudes, and practices, Oxford Development OIS Studies, 2018, 46:4, 453-469, DOI: 10.1080/13600818.2017.1414174; Robin Nielsen and NT Tim Hanstad. “Land-related legal aid in community driven development projects: lessons GS TA from Andhra Pradesh,” 2008, Agricultural and Rural Development Notes, no. 37, Washington, DC: World Bank, http://documents.worldbank.org/curated/en/234371468161671426/Land- RN related-legal-aid-in-community-driven-development-projects-lessons-from-Andhra-Pradesh; ED Behrman et. al., “Evaluation of grassroots community–based Legal aid activities in Uganda ND and Tanzania: Strengthening women’s legal knowledge and land rights,” 2013, CAPRi Working Paper No. 108, Washington, D.C.: International Food Policy Research Institute, http://dx.doi. BS org/10.2499/CAPRiWP108; Massay, Godfrey, Pillars of the community: How trained volun- EN teers defend land rights in Tanzania, London: International Institute for Environment and FR Development, 2016. E FI OM T SC O F STLE BGEA NLE FI A IT D?A N A LY S E S A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 25 CHAPTER 3: HOW TO CONDUCT A COST BENEFIT ANALYSIS ADM? OF A LEGAL AID PROGRAM PGRAO RI LG A This chapter offers guidance on how to structure and conduct a CBA of any legal aid or related program. LE FI D Building on the explanations and categorization outlined in previous chapters, the following sections provide SL OA an overview of the fundamentals of legal aid CBAs and practical guidelines for implementing them. NE F EA TA EIG LF SECTION 1: STRUCTURE AND FUNDAMENTALS 59. These blocks comprise a five-step technical procedure used SDOB FOR CONDUCTING YOUR OWN CBA to conduct the cost benefit analysis of a legal aid program: STEP 1: Analyze the social, economic, political and institutional YSAIN HOW TO STRUCTURE A CBA framework of the project in the selected jurisdiction. LS STEP 2: Define the objectives and the monitoring and evaluation AT NS (M&E) indicators of the analysis, keeping in mind the existing AO 57. The main objective of conducting a CBA is to identify the net TC benefit (benefits minus costs) of a policy in a standardized, com- demand for legal aid, including the special needs of the poorest HE T FI parable manner. Utilizing CBAs to assess the costs and benefits and most vulnerable segments of society. NE of a business investment is a well-known and widely recognized STEP 3: Conduct comparative financial analyses that weigh the NEE costs and benefits of two alternatives: the “with-project” and B procedure. The use of CBAs in legal aid is not as common, but a MI “without-project” scenarios. Calculate the financial performance AT growing number of countries and sub-national authorities across XS indicators. EO the world are beginning to see the importance of assessing the YC cost-effectiveness of their legal aid programs using the CBA frame- STEP 4: Conduct comparative economic analyses that weigh the T A costs and benefits of two alternatives: the “with legal aid” and WH work. Existing CBAs either evaluate legal aid programs as a whole HOW TO CONDUC or assess the benefits of legal aid programs in a specific field (e.g.. “without legal aid” scenarios. Calculate the economic performance domestic violence, foreclosure and homelessness). In each evalua- indicators. tion, different costs and benefits must be taken into consideration. STEP 5: Undertake a risk assessment of the “with-project” scenario and analyze the possible effects on the financial and economic 58. As shown in Part 1, a CBA utilizes three main analyti- performance indicators. cal blocks when assessing the viability of an investment. The first analytical block is estimation of what would be expected THE FUNDAMENTALS OF A CBA from the “do-nothing” (i.e., without-project) scenario. Second is 60. One of the important underlying principles of CBA is the development of the “with-project” scenario performed through a incremental approach. This approach requires a comparison of the quantitative assessment of the costs and benefits of pursuing this net benefits of the with- and without-project scenarios, i.e., the dif- alternative. Finally, a comparison of these two scenarios yields ference between implementing the project and leaving everything a stream of net benefits expected to occur at different stages of as is.128 A practical example is offered in Box 1 on the following implementation of the legal aid program/policy. These benefits will page. The box shows different alternatives for the provision of legal be used to calculate a set of financial and economic performance assistance on family law matters in Australia. The study considered indicators, to determine how effective the allocation of resources to three alternative scenarios: first, the existing level of legal assis- the proposed legal aid program would be. tance on family matters, second, the removal of all legal assistance and, third, the expansion of services).129 128 All costs and benefits must be converted to one unique currency to ensure comparability. Most often, such cases are encountered when legal aid is financed from a foreign-currency denominated donation while other costs and most of the benefits are generated in local currency. Also, prices are generally expressed in real terms rather than nominal since the use of nominal prices involves development of inflation rate projections which are seldom reliable enough. 129 PricewaterhouseCoopers, 2009, Economic Value of Legal Aid. Analysis in relation to Commonwealth funded matters with a focus on family law, http://www.legalaidact.org.au/ pdf/economic_value_of_legalaid.pdf. 26 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID BOX 1. THE PWC THREE-SCENARIO STUDY OF THE NET BENEFITS OF LEGAL AID ON FAMILY MATTERS IN AUSTRALIA WO H HW Y T In order to assess the benefits of legal aid, PwC investigated the impact of legal aid services on the costs and benefits of the EO Family Court in three scenarios: X ACMOIN ND SCENARIO 1 OUTCOME: X litigants normally assisted by legal aid in court would now be EUT Removing all existing legal aid services self-representing litigants and the actual court costs would increase by Y% CHTEACC SCENARIO 2 OUTCOME: X litigants normally assisted by legal aid in court would be Maintaining the existing legal aid self-representing and use duty lawyer services, and therefore actual court OO services currently provided by costs would increase by Y% - Z% where Z% is the efficiency gain from duty SS TT duty lawyers129a lawyer services SB AE SCENARIO 3 OUTCOME: X litigants would normally be assisted with legal representation, NN DE B Providing duty lawyers and legal so actual court costs wouldn’t change representation in the court FIETNA E FI 129a A duty lawyer is a lawyer who offers services on a volunteer basis. They often represent clients who meet income eligibility requirements. NA TLY S OSF I SLE OGFAAL LE A IG DA?L AID PROGRAM A TOOL A TOOL FOR JUSTICE: A FOR JUSTICE: COST BENEFIT A COST ANALYSIS OF BENEFIT ANALYSIS OF LEGAL LEGAL AID AID 27 27 61. The CBA of legal aid requires the calculation of three main 64. If the CBA is done over a multi-year period, the calculation ADM? metrics: the Net Present Value (NPV), the Internal Rate of Return of the present values of the costs and benefits should acknowl- RI LG A (IRR) and the Cost Benefit Ratio (CBR).130All costs and benefits edge the time value of money. As mentioned above, all future AO must be discounted to the present value to ensure comparability. financial and economic flows should be brought down to the present LEPGR The NPV, also called Discounted Present Value, is the estimated value (PV) by using an appropriate discount rate. In both ex-ante FI D current value of the future costs and benefits, discounted at an and ex-post CBAs the costs and benefits of the project should be SL OA appropriate rate.131 The IRR is the percentage rate earned on each discounted to the value in the year zero (i.e., the year preceding the TA currency unit invested for each period it is invested132 and is used beginning of program implementation). This is essential to recog- EIG LF to assess the annual growth rate of an investment. Finally, the nizing the different timing in the occurrence of various costs and NE CBR is the ratio of the discounted benefits of a project or proposal, benefits. F EA expressed in monetary terms, relative to its discounted costs, also SDOB expressed in monetary terms. 65. The first performance indicator of a legal aid CBA is the Net AIN Present Value (NPV). The NPV of a project is simply the sum of the YS LS 62. In applying the concept of discounting, it is crucial to select present value of benefits less the present value of costs for the AT NS the proper discount rate. This would be the rate at which the entire duration of the project.133 The NPV helps determine whether AO estimated stream of future net benefits will be brought down to the or not an investment opportunity is a smart decision. If the NPV is HE TC present value. The choice of the level of discount rate should be positive, that means that the project makes financial and/or eco- T FI driven by the opportunity cost of capital used to finance the particu- nomic sense. The opposite is true when the NPV is negative. When NE EE lar program. This opportunity cost represents the returns foregone the NPV is 0, there is no gain or loss associated with the legal aid BN from not investing in another project with a similar risk profile. program. MI AT There are several ways of estimating the discount rate. One way is XS EO by using the “marginal direct cost of public funds,” which is usually 66. Another performance indicator, showing the expected annu- YC proxied by the real return on government bonds. Alternatively, it can al return on investment, is the Internal Rate of Return (IRR). The WHT A be estimated by considering the returns on a portfolio of a govern- IRR, expressed as a percentage, is used in CBA to estimate the prof- HOW TO CONDUC ment’s financial assets that reflect the risk profile of the project itability of a potential investment. It is an indicator used together under consideration. The discount rate for developed countries is with NPV. The financial IRR, or Financial Rate of Return (FRR), is the normally in the range of 3 to 5 percent in nominal terms. percentage growth of the financial costs and benefits; the economic IRR, or Economic Rate of Return (ERR), is the percentage growth of 63. The time horizon (i.e., reference period) of a CBA should be the economic costs and benefits of a legal aid program. Projects the duration of the legal aid program. If done ex-ante, the CBA are considered financially and/or economically viable if their IRR will typically consider the expected duration of the program/policy is higher than the rate used to discount cash flows expected as a and should ideally be informed by the cost and benefit estimates result of project implementation (i.e., the rate used when calculat- taken from ex-post CBAs from existing and/or completed legal aid ing NPV). This rate is essentially considered as the cost of capital, programs. A large majority of reviewed CBAs in the legal aid field are while IRR represents the rate of return. Hence, positive net returns done for one year only. However, legal aid programs may take time to (i.e., IRR is higher than the discount rate) imply that the project will fully realize their true potential in terms of the benefits they bring to bring net benefits. the economy and society. Alternatively, the final years of a program may see some tapering off in the level of gains citizens collect from these programs. Hence it is very important to include all years of the program duration to be able to capture these variations. 131 The discounted present value or present value (PV) or present worth provides a common basis for comparing investment alternatives. The present value is always less than or equal 133 The NPV is the present value (PV) of all the cash flows (with inflows being positive cash to the future value because money has interest-earning potential. This is a characteristic flows and outflows being negative), which means that the NPV can be considered a formula referred to as the time value of money, except during times of negative interest rates, when for revenues minus costs. If the NPV is positive, that means that the value of the revenues the present value will be more than the future value. (cash inflows) is greater than the costs (cash outflows). When revenues are greater than costs, 132 Robert Schmidt, What is IRR and How Does it Work? June 9, 2014, https://www.property- the investor makes a profit. The opposite is true when the NPV is negative. When the NPV is metrics.com/blog/2014/06/09/what-is-irr/ 0, there is no gain or loss. 28 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 67. Finally, to estimate the potential profitability of a project, SECTION 2: THE FIVE STEPS OF A LEGAL H WOHW one can calculate the third performance indicator, the Cost- AID CBA Y T Benefit Ratio (CBR). The CBR is the ratio of the benefits of a project EOX AC or proposal, relative to its costs, with both expressed in monetary STEP 1: DEFINITION OF THE PROJECT CONTEXT terms. The financial CBR is the ratio of the financial costs and MOIN benefits; the economic CBR is the ratio of the economic cost and ND 70. The first step of a legal aid program CBA is to conduct a EUT benefits. If the ratio is greater than 1, the benefits are greater than careful study of the political, social and institutional framework CH the costs, and the project is economically viable.134 of the jurisdiction of the program. This step is critical to define TEACC the exact scope and geographical limitation of the program and 68. Some governments—often in more advanced economies— OO to identify the main actors involved. The elements that should be SS will have a locally available CBA framework to follow and input TT considered include: the socio-economic conditions of the jurisdic- SB parameters that are set in advance.135 These guidelines usually tion that are relevant to the project objectives (i.e., to which the AE contain input parameters that are required by all CBAs across the NN legal aid program applies), and are supported by credible data and DE B economy (e.g., the social discount rate and value of time). However, reports; existing national/regional/sectoral strategies, policies and FI most often they contain little or no reference to investments in the ET development plans and the respective roles of the key stakeholders NA judicial sector, and are more focused on sectors with large-scale in the legal aid program; existing legal aid programs and services E FI NA investment projects (e.g., transport and energy). Section 2 below provided; and the summary of the findings of any previous cost TLY S O reiterates the common steps in conducting a CBA, which have benefit analyses of the legal aid field. SF appeared in other publications. However, its approach is adjusted to I SLE the needs of assessing legal-aid-related interventions (i.e., invest- 71. At this stage it also important to identify the most salient OG ments) and thus represents a useful supplement to the existing legal needs in the area under consideration and the market FAA guidance material on CBAs. demand for legal aid. Market research assesses and quantifies L LE A IG the current demand, while forecasting future demand. The research DA 69. Moreover, there is an ongoing global effort to standardize should first identify the variety of factors affecting the demand for ?L AID PROGRAM the way in which CBAs are carried out across different sectors. legal aid and the overall “market” conditions. The demand indicator An example is a comprehensive CBA Guide developed by the EU should describe the level and quality of existing legal aid services Directorate-General for Regional and Urban Policy, Guide to Cost and deficiencies that can be addressed by the program. It should Benefit Analysis of Investment Projects, which stretches across five contain detailed data on the frequency of a particular event—such sectors (i.e., transport, energy, environment, broadband, research and as the rate of eviction or domestic violence—that could be pre- innovation) and contains overall guidance for other sectors. Over time, vented or remedied by the provision of legal aid. Reference should these efforts to standardize the process will enable a direct compari- be made to any existing legal aid programs, their effectiveness and son of investment alternatives in various sectors, and allow decision the residual (i.e., unmet) demand for legal aid services. makers to choose the optimal sectoral mix of public investments. As we have seen from Parts 1 and 2 above, there is a degree of inconsis- 72. The way this step is conducted largely determines the qual- tency among CBAs in the field of legal aid. This report introduces the ity of the remaining parts of the analysis. The context should pro- conventional CBA framework and offers practical guidance on how to vide the framework for deriving assumptions which are instrumental calculate a set of common and widely used financial and economic to estimating the financial and economic costs and benefits—from performance indicators in legal aid CBAs. It is a step toward enabling those related to the macroeconomic and social conditions in the the consistency of not only legal CBAs but overall consistency as well. area to those relating to the legal system. Ideally, this section should be based on relevant statistical data obtained from reliable sources, such as the national statistical office, judicial authorities 134 A CBR takes into account the amount of monetary gain realized by performing a project versus its costs. A ratio of greater than one indicates that the project is a viable one. General or reputable survey firms. In the absence of these, which is a pro- rule of thumb is that if the benefit is higher than the cost the project is a good investment. The higher the BCR the better the investment. nounced issue in some developing countries, one should reach for 135 In France, guidance is provided in the Instruction du Gouvernement du 27 juin 2014 alternatives which are sufficiently trustworthy and consistent (See relative à l’évaluation des projets de transport (https://www.ecologique-solidaire.gouv.fr/ sites/default/files/Note_technique_completesignatureok.pdf). In the UK, guidance is pro- Box 2). vided in The Green Book: Central Government Guidance on Appraisal and Evaluation (https:// assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/ file/685903/The_Green_Book.pdf). In Chile, the framework is part of the National Investment System managed by the Ministry of Social Development and Family (http://sni.ministeriode- sarrollosocial.gob.cl/quienes-somos/marco-legal/) Overall guidance for EU member states is provided in the Guide to Cost Benefit Analysis of Investment Projects (https://ec.europa. eu/regional_policy/sources/docgener/studies/pdf/cba_guide.pdf). These guidelines are also applied in other countries for projects financed by the EU (i.e., predominantly EU accession countries). A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 29 BOX 2. WHERE TO FIND USEFUL DATA ON THE DEMAND FOR LEGAL AID SERVICES O RI LG A ADM? CIVIL JUSTICE PROBLEMS ARE MORE COMMON THAN CRIMINAL PROBLEMS LEPGRA The usual methods of estimating and forecasting market demand for a product or service require comprehensive FI D datasets. These datasets originate either from surveys from the representative sample or secondary data from the legal SL OA administration institutions. However, conducting such surveys may be challenging for various reasons (e.g., accessibility TA and budget). Likewise, proper administrative data on legal issues may be unavailable due to poor record-keeping. In such EIG situations, there are several alternatives which would provide an overview of the trends and structure of the demand for NELF legal aid. F EA SDOB EXISTING DATA SOURCES YSAIN USING DATA FROM EXISTING SURVEYS. The World Justice countries each year. Their dataset has significantly LS Project conducts periodic surveys of people’s legal needs increased the availability of data on legal needs. See https:// AT NS in more than 120 countries, and they are adding more worldjusticeproject.org/ HE AO TC USING KEYWORD RESEARCH TOOLS: One of the simplest and insights on the trend of demand. There are many free Keyword NET FI cheapest ways to assess demand is to use Keyword Research Research Tools available on the internet. One of the simplest EE Tools. These web analytic tools provide information on how is Google Trends (available at https://trends.google.com/), MIBN many online searches have been conducted by internet users which shows the popularity of key words or phrases (e.g., “free XSAT for a specific keyword or phrase during a specific time period legal aid” or “domestic violence”) for a specified location and YCEO and location. While this certainly cannot substitute for an time period. T A analysis based on high quality data, it can provide initial WH HOW TO CONDUC USING DATA FROM OTHER INSTITUTIONS: Most national services. The UK Ministry of Justice (available at https://data. statistical institutes provide at least some basic statistics on gov.uk/dataset/77f5eb2d-8162-4655-b107-974240064031/ criminal acts, which can be used to forecast aggregate trends legal-aid-statistics) provides a good example of very detailed of legal aid demand. However, this data is often insufficient to statistics on the volume and associated value of submitted gain an insight into the structure of the demand for a service. claims for legal help and controlled legal representation (and In such cases, data from other institutions in countries with other useful legal aid statistics) in England and Wales. a developed statistical system may be useful to assess figures on relative demand across categories of legal aid TIME- AND COST-SAVING SURVEY METHODS USING DATA FROM EXISTING SURVEYS: The World Justice USING ONLINE SURVEYS: Online surveys have gained Project conducts periodic surveys of people’s legal needs popularity in recent years due to their cost effectiveness and in more than 120 countries, and they are adding more the proliferation of internet users. countries each year. Their dataset has significantly See the website of the Law Society of UK (www.lawsociety. increased the availability of data on legal needs. org.uk) for a recent example of a large online survey of See https://worldjusticeproject.org/. individuals’ handling of legal issues in England and Wales.135a USING THE ASSISTANCE OF A NATIONAL STATISTICAL aid can be combined with a survey on poverty and living INSTITUTE: In many countries, national statistical institutes conditions, to get detailed insight into the demand for legal will conduct customized surveys at subsidized prices or aid of vulnerable groups in society. simultaneously with some standard surveys for the purpose of non-commercial research. For instance, a survey on legal 135a https://www.lawsociety.org.uk/support-services/research-trends/documents/legal-needs-survey-online-survey-inviduals-handling-legal-issues-may-2016/. 30 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID STEP 2: IDENTIFICATION OF THE PROJECT whenever possible (including baseline and target values) (e.g., the H WO OBJECTIVES AND M&E INDICATORS HW expected reduction in the rate of domestic violence or foreclosures). Y T If objectives cannot be quantified, a clear explanation of the way EOX AC 73. The second step of a CBA should clearly define the objec- qualitative definitions will be verified must be provided. Table 2 tives and M&E indicators of the proposed legal aid intervention. gives several examples of how the project objectives of providing MOIN The project objectives should clearly illustrate how the program will legal aid can be quantified by objectively verifiable indicators. NDEUT meet the existing needs for legal aid services and create benefits CH for the designated community. Project M&E indicators should be TEACC defined in a clear and precise manner using quantitative indicators OOSS TT TABLE 2. EXAMPLES OF OBJECTIVES AND INDICATORS OF LEGAL AID INTERVENTIONS SB AENN AREA OF POSSIBLE BASELINE TARGETED DE B OBJECTIVE INTERVENTION INDICATOR VALUE VALUE FIETNA E FI NA Assist people Percentage of 50% 60% FAMILY TLY in coming to a negotiated outcomes S O RELATIONSHIP negotiated agreement between parents SF CENTRE that is in the best that are in the best I SLE SOLICITOR interests of the interests of the OG children children FAAL LE HOMELESS Provide legal Number of one-hour Not Three A IG advice to people appointments to applicable appointments DA PERSONS’ ?L AID PROGRAM experiencing, or at provide legal advice SERVICE risk of, homelessness per applicant per applicant Bulk debt negotiation Percentage of 30% 50% disputes on debt BULK DEBT scheme to help low- repayment negotiated SCHEME income debtors in and settled out of financial hardship court Provide legal Percentage of 60% 80% IMMIGRATION assistance to immigrants receiving ADVICE immigrants at risk a permanent visa SERVICE of return to unsafe situations or countries Note: activities and objectives are adopted from Stubbs et al. (2012) A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 31 74. The second step of a CBA should also determine the key should: i) identify the differences between groups or populations; ii) ADM? stakeholders, timeline, and the funding available for the imple- identify how justice processes differ across groups/populations; iii) RI LG A mentation of the CBA. At this stage, it is important to outline the distribute the costs and benefits according to the identified varia- AO details of the legal aid services to be provided. This should include tions (i.e., heterogeneous impact). LEPGR the scope, level and source of proposed funding, the impact area, FI D the beneficiaries and stakeholders, the timetable of the project STEP 3: FINANCIAL ANALYSIS SL OA implementation, the body responsible for implementation, and the TA assessment of its technical, financial and institutional capacity to 76. The third step of a legal aid CBA is estimating the financial EIG costs and benefits of the with-project versus the without-project LF successfully carry out the project. NE scenario. Estimates must be made for each year of the program F EA 75. When designing the provision of legal aid services and the duration. These estimates will enable the calculation of the SDOB impact area, special attention should be paid to the benefits to project’s financial performance indicators (i.e., the Financial Net AIN poor and vulnerable groups. Most of the existing methodologies Present Value (FNPV), the Financial Rate of Return (FRR) and the YS Financial Cost Benefit Ratio). The appraisal of financial benefits LS of legal aid CBAs focus on the average impact of the provision of AT requires the use of heterogeneous data sources and the formulation NS legal services on the public at large. However, Mahony, Manning AO and Wong (2019) warn that the effects of justice policies are often of appropriate assumptions to overcome possible gaps in the data. TC The majority of the financial benefits are represented by cost sav- HE heterogeneous with respect to groups of population. Therefore, T FI a comprehensive CBA framework that measures the differential ings. Depending on the type of service provided, there may also be NE direct client benefits in the form of cash inflows, such as in cases EE impact of justice services across individuals and communities BN where legal aid helps clients to access social welfare entitlements, MI AT receive compensation, or recoup lost wages from an employer. Case XS EO BOX 3. DIFFERENCE BETWEEN FINANCIAL Study 1 in Annex II (KPMG, 2008) illustrates in greater detail how YC AND ECONOMIC ANALYSIS the benefits of legal aid are calculated in terms of avoided costs to WHT A the justice system. HOW TO CONDUC FINANCIAL ANALYSIS 77. The main financial outflow item in legal aid interventions Considers solely the costs and benefits that occur is the total funding of the legal aid program.136 The CBA should in monetary (i.e., financial or money) form. It does acknowledge and discuss the structure of this funding. It is impor- not include any non-monetary cost and benefit tant to differentiate among sources of financing, and to show pre- items. These financial flows are used to calculate cise numbers as to which portion of the funding comes from public a set of financial performance indicators which versus private funds. The importance of this breakdown comes from are used to assess the financial viability of the the requirement to perform adjustments to these financial outflows proposed project. in the economic analysis stage of the CBA (i.e., Step 4). These adjustments are of different magnitudes depending on the source ECONOMIC ANALYSIS of funding. Broadens the context of financial analysis by taking the perspective of the society. It builds on 78. The financial benefits of legal aid programs can be grouped the financial analysis by adjusting the monetary into three categories: costs and benefits estimated within financial a) Direct client benefits: Direct monetary income that accrues analysis to ensure that these financial flows to the users of legal aid which is either secured or obtained as a reflect their value to the society. It also adds result of legal assistance provided. These benefits come from both the monetized (i.e., quantified) estimates of non- public and private (i.e., non-governmental) sources. Some examples monetary costs and benefits (e.g., value of time, include supplemental security income, disability income, medical suffering, injuries, etc.) to this adjusted stream of aid, veteran benefits, tax credits, child support aid, spousal main- costs and benefits. The economic flows obtained tenance awards, as well as recoveries from consumer and mortgage in this way are used to calculate economic scams. performance indicators, which are used to assess the economic viability of the project. 136 A recent study by Manuel et al (2019) provides estimates of the cost of providing access to justice in different categories of countries across the world Although not focused on a particular type of legal aid, this paper is a source of information for legal aid program design and scoping, and it may also point to the overall benefits (or costs foregone) that come as a result of legal aid program implementation. 32 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID b) Client cost savings: Cost savings that accrue to legal aid ben- when the area of the law and the case itself are less complex, when WO H HW eficiaries in the court procedure. Typical examples include savings the client has greater capabilities, or when the courts are supportive Y T on various fees of lawyers and associated providers. An estimate of of self-representation. Empirical analysis has shown that, in some EOX AC these cost savings implicitly assumes that clients benefiting from contexts, limited legal assistance may be sufficient to support legal aid would otherwise go to court and pay for these services on families in their applications for benefits and administrative tasks; MOIN their own, which is not often the case, especially in countries where enforce child support orders; explain education laws and school NDEUT such services are not affordable for a majority of population. Absent discipline policies to help keep children in school; and advise and CH a reliable survey or other direct empirical information, the assump- represent parents of children with special needs in schools. TEACC tion of the percentage of clients that would go to court should be d) Mediation (alternative dispute resolution): Mediation has been OO made based on the target group’s willingness and capacity to pay shown to lead to positive results, especially when parties were will- SS for legal services (i.e., affordability assessment). ing participants and of relatively equal strength, and where services TTSB c) Justice system cost savings: These consist of reduction of costs are free from corruption and conflicts of interest. The use of media- AE that normally accrue to courts as a result of increased efficiency. tion in legal aid cases can generate significant savings compared NN DE B Estimating these costs requires case-related information and to non-mediated cases. FI requires assumptions on case outcomes had legal aid not been ETNA provided. This is necessary since different costs are associated 80. The possession of reliable and complete data helps to E FI NA with different cases depending on the format of case closure (e.g., develop accurate estimates of the financial benefits of provid- TLY S O mediated agreements vs interim or final order, etc.). ing legal aid. For instance, to make a quantitative (i.e., monetary) SF estimate of a benefit stemming from legal aid that is a result of cost I SLE 79. When appraising the financial costs and benefits, it is reduction due to an increase in the efficiency of the court system, OG important to understand the use and effectiveness of available one would need to know the cost difference among similar cases FA legal aid instruments. The 2019 OECD Equal Access to Justice for A with and without legal aid. To calculate this, an analyst would need: L LE Inclusive Growth report137 provides a summary of some important i) financial statements of relevant justice agencies, differentiating A IG DA benefits of investing in the justice system. It also describes the between cases that received legal aid and those that did not, and ii) ?L AID PROGRAM challenges to a proper appraisal of those benefits, including legal case-related data from relevant case-management systems (CMS), information, assistance, advice, representation, and alternative providing information on the type of cases and their outcome, and dispute resolution. The study considers: i) direct benefits for separating cases that included legal aid from those that did not. the users of legal services, from alleviating the burden of legal Although it looks relatively simple, the availability of data is often problems on citizens; ii) indirect benefits for the broader society, an issue. It depends largely on the design of the CMS across the including a more inclusive society, the reduction of social costs judiciary, the interoperability of the CMS and the financial manage- of violence, and better institutional governance. According to the ment software, as well as the overall implementation status of both OECD, some important aspects to consider when assessing the systems. effects of legal aid include: a) Use of legal jargon: When legal jargon is overused, a targeted 81. Generally, the less information is available, the more group of beneficiaries may fail to utilize legal information services, assumptions must be made based on the available information. especially if this group includes a less-educated, vulnerable popu- When accurate and research-based sources are not available, it lation, or migrants who have not mastered the official language. is important to develop realistic assumptions. As an illustration, b) Technology of providing information/advice: The choice of a analyses based on the assumption that an individual will never medium for disseminating legal information (face-to-face, tele- act on a legal problem without legal assistance may substantially phone, internet) should align with local preferences (local culture, overestimate the benefits of such assistance. Conversely, assuming habits and education) to maximize the effectiveness of the legal aid that legal problems will go away on their own could significantly service provided. underestimate the benefits from legal aid.138 c) Degree of legal representation: Advocacy for better access to justice has traditionally focused on the provision of full legal 82. Once the necessary valuations and assumptions have been representation. Indeed, in complex disputes such as divorce or child made, it is possible to discount all costs and benefits to the pres- protection cases, full representation by a lawyer remains the most effective form of assistance. Full representation is less beneficial 138 When it is not possible to make assumptions, it is advisable to restrain from the quan- 137 OECD, Equal Access to Justice for Inclusive Growth: Putting People at the Centre, tification of specific financial costs and benefits to preserve the credibility of the CBA. In such March 2019, https://www.oecd-ilibrary.org/governance/equal-access-to-justice-for-inclusive- circumstances, the author should ensure that the unquantifiable share of benefits is clearly growth_597f5b7f-en. stated and that their expected effect, if quantified, is thoroughly explained. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 33 BOX 4. QUESTIONS DRIVING ESTIMATION STEP 4: ECONOMIC ANALYSIS ADM? OF ECONOMIC COST AND BENEFITS RI LG A 84. The fourth step of a legal aid CBA is an estimate of the RAO economic net benefits of the with-and without-project sce- LEPG According to the Productivity Commission of narios. As with the financial costs and benefits, estimates must FI D Australia, there are at least four important be made at the annual level for all years of the program duration. SL OA questions that an analyst must answer—and These estimates will enable the calculation of the project’s eco- TA make correct and impartial assumptions about— nomic performance indicators (i.e. the Economic Net Present Value EIG LF to arrive at a reliable estimate of net benefits (ENPV), the Economic Rate of Return (ERR) and the Economic Cost NE associated with legal aid: Benefit Ratio). The appraisal of the economic benefits is a critical F EA 1 What would happen to an individual if legal SDOB component of the CBA that usually requires creative thinking and assistance were not provided? an understanding of the relevant transfers of wealth within the AIN 2 How much does receiving assistance affect economy that occur or are affected by the program intervention. YS LS the legal outcome of a case? AT NS 3 Does obtaining a favorable legal outcome 85. The economic analysis is broader than the financial analy- AO avoid adverse outcomes in the client’s life TC sis, and includes the monetary value of social costs and benefits. HE “outside the court room?” The economic analysis captures both the financial outcomes of the T FI 4 What are the costs of these adverse NE legal aid project and the non-monetary benefits and costs. These are EE outcomes that are avoided? often more challenging to express in monetary terms and include MIBN costs and benefits such as health costs and benefits, time savings XSAT or loss, a reduction or increase in suffering, and productivity losses EO or increases. The economic analysis of a legal aid CBA can be com- YC T A pleted in three stages: WH ent values and calculate the financial performance indicators.139 1. Conversion of market to accounting prices; HOW TO CONDUC When all financial costs and benefits have been considered and dis- 2. Monetization of non-market impacts; counted to the present value, one can then calculate the Financial 3. Calculation of the economic performance indicators (economic Net Present Value (FNPV), the Financial Rate of Return (FRR) and the net present value, economic rate of return and B/C ratio). Financial Cost-Benefit Ratio (See Appendix III: CBA Mathematical Computation). If the NPV is positive, the investment will be a profit- able one. If the FRR percentage of a with-project scenario is higher than the FRR of the “without-project” or other alternative scenarios, FIGURE 3. STAGES OF THE ECONOMIC ANALYSIS the investment will be more profitable than other investments. If the OF A LEGAL AID CBA Financial Cost-Benefit Ratio is above 1, the benefits will exceed the costs, and the investment will be profitable. CONVERSION OF MARKET TO 83. The choice of the appropriate financial discount rate should ACCOUNTING PRICES be carefully made. As explained in the section on Fundamentals of the CBA, the discount rate is the rate used to bring the set of future financial (or economic) flows to their present value. It is used to determine the Cost-Benefit Ratio by calculating the NPV and MONETIZATION OF discounting costs and benefits. The IRR is compared to the discount NON-MARKET rate to determine a project’s profitability. The rate can be expressed IMPACTS in nominal (i.e., including the expected increase in price level) or real terms. CALCULATION OF ECONOMIC PERFORMANCE INDICATORS 139 Legal aid CBAs should distinguish between the Financial Net Present Value and the Economic Net Present Value. The former is simply the NPV of the financial costs and benefits, and the latter is the NPV of the economic costs and benefits. If the benefits are greater than the costs, the net benefits will be positive. If the costs are greater than the benefits, the net benefit will be negative. 34 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID WO H HW Y T BOX 5. SIMPLIFIED ILLUSTRATION OF A LEGAL AID PROGRAM CBA FINANCIAL ANALYSIS EOX ACM The fictional country of Legaland is considering introducing a three-year program of legal aid to help its citizens address OIN issues of family violence. The government considers building five centers across the country and employing 40 people in NDEUT each one. The government expects that raising awareness of legal aid will increase the number of clients and therefore CH expects 10 additional people will need to be employed in the second and third years of the program to match the rising TEACC demand for services. OOSS After conducting market-demand research, a government On the benefits side, the analyst considers that one employee TTSB analyst envisages the following cost of the project in local may serve around 40 clients annually, so the estimated cost AE currency units: savings to the judicial system per client due to legal aid is NN DE B 1,800 LD. FI i) the costs of building five centers in “zero” year, at 300,000 ETNA Legaland dollars (LD) each Since the official Financial Discount Rate in Legaland is eight E FI ii) the operation and maintenance (O&M) cost of five centers, percent, the following are the estimates of the financial costs NA TLY at 30,000 LD per center, during each year of the program and benefits of the project implementation: S O iii) salary costs, which equal the number of staff times SF an annual salary of 50,000 LD per year of program operation. I SLE OGFAA YEAR (T) 0 1 2 3 L LE A IG Financial costs (in LCU of year t): DA?L AID PROGRAM i) Buildings 1,500,000 0 0 0 ii) O&M costs 0 150,000 150,000 150,000 iii) Salaries (gross) 0 2,000,000 2,500,000 3,000,000 Total 1,500,000 2,150,000 2,650,000 3,150,000 Financial benefits (in LCU of year t) Avoided costs of judicial system 0 2,880,000 3,600,000 4,320,000 Discounted financial cash flows (in LCU of year 0) Total costs 1,500,000 1,990,741 2,271,948 2,500,572 Total benefits 0 2,666,667 3,086,420 3,429,355 Net Undiscounted Financial Cash Flow 1,500,000 675,926 814,472 928,784 Net Discounted Financial Cash Flow -1,500,000 625,857 698,278 737,299 After the cash inflows and outflows are projected, FNPV, All three indicators provide the same assessment of the FRR and Financial Benefit-Cost ratio can be computed: profitability of the legal aid program, and in this case, it is i) FNPV = 561,435 clearly profitable. ii) FRR = 27% iii) Financial Cost-Benefit Ratio = 1.61 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 35 86. The first step of economic analysis entails the conversion ADM? of market to accounting prices (i.e., transforming the financial RI LG A to economic cash flows). Economic analysis requires that adjust- SIMPLIFIED EXAMPLE OF THE O WILLINGNESS-TO-PAY APPROACH A ments be made to the financial costs and benefits estimated under LEPGR Step 3. These adjustments are made to ensure that the costs and FI D benefits used in the economic analysis reflect their true value to Improvements in transportation frequently save SL OA society. This is achieved by eliminating various transfers between people time. Measuring the money value of that TA different agents acting within the society (e.g., excluding taxes and time saved involves gathering information on how EIG much the public values time, revealed by their LF social contributions) and accounting for various market inefficien- NE cies (e.g., unemployment rate). choices between time and money. If people have F EA a choice of parking close to their destination SDOB 87. Apart from eliminating taxes from financial estimates, for 50 cents more, or parking farther away and AIN another key element of this step is the use of conversion factors spending five more minutes walking, and they YS always choose to spend the money to save the LS to address the inefficiencies of the market in which the legal aid AT time and effort, then they have revealed that their NS program is implemented. Prices of major non-tradable items must AO be converted using an appropriate (i.e., specific) conversion factor time is more valuable than 10 cents per minute. TC If they were indifferent to the two choices, they HE while tradable items and all minor items are adjusted using the T FI Standard Conversion Factor (SCF). Please refer to Appendix III for would have revealed that the value of their time NE was exactly 10 cents per minute. EE further details on how to calculate the SCF and specific conversion BN factors. XS EO MI AT 88. In the second step, economic analysis should include quan- YC tification of the so-called “non-market” impacts, which refer WHT A appraisal and evaluation of various policy alternatives. Secondary to the social utility of implementing the program. For example, HOW TO CONDUC sources must be chosen carefully to ensure that the underlying con- in the case of the evaluation of a legal aid program for domestic ditions of the source are as close as possible to the circumstances violence cases, the main non-market impact will be the reduction of the study in question. Depending on which costs and benefits of in domestic violence cases. This is typically estimated as the sum a legal aid program are factored into a study, different estimates of the value of the change in numerous indices relating to domestic related to the same legal aid program may yield considerably dif- violence such as: pain, suffering, health, productivity, etc. ferent results. For instance, a CBA of the legal aid services for domestic violence cases in the U.S. State of Minnesota estimated 89. The monetization of the non-market impacts determines the avoided costs due to legal aid at USD 26,000 per victim in one the money value of non-market aspects of a legal aid program. case and USD 16,449 in another. 142 It can be difficult to calculate the value of a net change of suffer- ing and pain as a result of legal aid, since individuals assign very 91. The third and final stage of the economic analysis is the different values to this. To address the problem, CBA studies often calculation of the economic performance indicators (the eco- rely on a method called “Willingness-To-Pay” (WTP).140 WTP is a nomic net present value, the net economic rate of return and the survey-based methodology that yields an estimate of the average net economic cost/benefit ratio). As in the financial analysis, the value a group of individuals from a representative sample is willing economic performance indicators provide a valuation of the profit- to pay for a certain good or service. These studies are complex and ability of the legal aid project. The difference between the two is expensive to carry out for each benefit surrounding legal aid issues. that the economic performance indicators work with economic net benefits which include monetized values of the economic costs and 90. If the use of WTP is not possible, CBA analysts must rely benefits and account for the effects of taxes and various market on external sources. If budget or other constraints limit the use of imperfections. Using a few mathematical formulas (See Appendix WTP, a CBA analyst should either turn to a relevant scientific source III: CBA Mathematical Computation) is therefore possible to obtain for building a trustworthy assumption or look for justified and objec- the Economic Net Present Value (ENPV), the Economic Rate of Return tive alternatives elsewhere. An example would be a UK Green Book (ERR) and the Economic Cost-Benefit Ratio. 141 which provides detailed guidance and quantitative inputs for the 140 See footnote 57. 141 UK Green Book: Government Guidance on Appraisal and Evaluation, 2018. 142 See CBA of legal aid in the U.S. State of Minnesota. 36 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 92. The choice of a social discount rate (i.e., SDR—the rate H WOHW at which economic net benefits are discounted) is essential for Y T the calculation of economic performance indicators. Just as EOX AC in the financial analysis above, the calculation of the ENPV and Cost-Benefit Ratio will require discounting a stream of estimated MOIN net benefits using this rate, while assessing the value of ERR NDEUT will require a comparison with the social discount rate. This rate CH reflects the opportunity cost of capital for the society as a whole. If TEACC markets were perfectly competitive, the social discount rate would OO equal the financial discount rate. The less competitive the market, SS the greater the difference between these in absolute terms. The TTSB positive difference in favor of a social discount rate represents AE the choice of current versus future consumption, which is usually NN DE B the case, so the social discount rate is almost always higher than FI financial discount rate. ETNA E FI NA TLY S OSF I SLE OGFAAL LE A IG DA?L AID PROGRAM A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 37 RI LG A ADM? BOX 6. SIMPLIFIED ILLUSTRATION OF A LEGAL AID PROGRAM CBA ECONOMIC ANALYSIS GRAO Building on the example of a fictional country Legaland a. Benefits are assumed to be 80% of the avoided costs of LEP presented in Box 5, the CBA analyst decides to add the the judicial staff’s gross salaries and 20% of avoided FI D economic costs and benefits to the computation. The legal aid operation and maintenance costs. Thus benefits are SL OA program under consideration is a 3-year program to assist adjusted to economic value using the weighted average TA victims of family violence. The government is considering of SCF and SWF in relevant proportion (i.e., 80% SWF EIG LF building five centers across the country and employing 40 and 20% SCF); NE people in each of them. The government expects that raising b. In addition to the benefits derived from the avoided costs F EA awareness of legal aid will increase the number of clients, to the judicial system, it is assumed that additional SDOB and therefore expects 10 additional people will need to be benefits to society are gained through the avoided costs AIN employed in the second and third years of the program to of productivity loss (positive externality), economically YS match the rising demand for services. valued at 800 LCU per client; ATLS c. The Standard Conversion Factor (SCF) is 0.88; AONS Prior to the calculation of the economic performance d. The Shadow Wage Factor (SWF) is 0.75; TC indicators, the CBA analyst will conduct a monetization of the e. The Official Social Discount Rate in Legaland is 10%. HE T FI economic costs and benefits, and find the necessary metrics After costs and benefits are adjusted by relevant factors, NE by conducting a WTA survey or by using existing sources. The externality is added to calculation, and SDR is applied to EE results of these steps are: discount cash flows, projected economic values are given in MIBN table below: YC XS EO AT YEAR (T) 0 1 2 3 WHT A Economic costs (in LCU of year t): HOW TO CONDUC i) Buildings 1,320,000 0 0 0 ii) O&M costs 0 132,000 132,000 132,000 iii) Salaries (gross) 0 1,500,000 1,875,000 2,250,000 Total 1,320,000 1,632,000 2,007,000 2,382,000 Economic benefits (in LCU of year t) Avoided cost of judicial system 0 2,234,880 2,793,600 3,352,320 Avoided costs of productivity loss (positive 0 1,280,000 1,600,000 1,920,000 externality) Total Economic Benefits 0 3,514,880 4,393,600 5,272,320 Discounted economic cash flows (in LCU of year 0) Costs 1,320,000 1,632,000 2,007,000 2,382,000 Benefits 0 3,514,880 4,393,600 5,272,320 Net Undiscounted Economic Cash Flow -1,320,000 1,882,880 2,386,600 2,890,320 Net Discounted Economic Cash Flow -1,320,000 1,711,709 2,887,786 2,171,540 Following the valuation of the economic costs, the ENPV, The economic performance indicators show that the project ERR and Benefit-Cost ratio are computed: is profitable. The socio-economic performance of this project i) ENPV = 5,451,035 slightly exceeds that of the financial analysis, mainly due to ii) ERR = 146% avoided costs of production loss gained from legal aid, which iii) C-B ratio = 1.80 were not included in the financial analysis. 38 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID STEP 5: RISK ASSESSMENT hood of their occurrence, as well as an estimate of their effect on H WOHW project implementation. The risk assessment of a CBA should also Y T 93. The fifth and final step of a legal aid CBA is the assessment include a detailed discussion on the risk prevention and mitigation EOX AC of risks associated with the implementation of the proposed proj- measures that the responsible institution will undertake. Some examples of the common risks attributable to the development of M ect. Risk assessment is an analysis of events that surround legal OIN a legal aid system and the associated probabilities and mitigation ND aid project implementation which could have a negative impact on EUT the fulfillment of project objectives. It consists of a qualitative and measures are provided in the table below. CH quantitative risk analysis and probabilistic assessment of the likeli- TEACC OO TABLE 2. SOME EXAMPLES OF THE RISKS COMMONLY ASSOCIATED WITH THE ESTABLISHMENT OF A LEGAL AID SYSTEM SS TTSB AE PROBABILITY RISK MITIGATION MEASURE NN DE B FIET Lack of a political commitment and Setting up a comprehensive monitoring and evaluation NA E FI a willingness to support actions framework that will provide timely warnings on LOW NA toward the development of a legal insufficient commitment to the development of the TLY aid system. legal aid system. S OSF I SLE Insufficient awareness of the roles of Active participation of all beneficiaries in the process OGFA MEDIUM all beneficiaries in the development of legal aid development, through public consultations A of the legal aid system. and designated working groups. L LE A IG DA?L AID PROGRAM Development of an extensive training program to Insufficient capacities and high support the strengthening of the capacities of the MEDIUM turnover rates among the staff existing staff, and timely recruitment of new staff involved in the provision of legal aid. if needed. Relevant government institutions Conduct workload analyses of the human resources hesitant to commit necessary human of involved institutions to ensure that the burden of MEDIUM resources to the provision of legal tasks is evenly and properly distributed. aid services. Lack of financial resources from the Continuous efforts of government institutions to HIGH national budget to provide sufficient ensure additional funding from external sources, funding of the legal aid system. such as financial assistance from donors. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 39 CONCLUSIONS benefits are included in the analysis and may understate the net ADM? benefits. Also, the indirect benefits of legal aid on the community RI LG A 94. Policymakers are increasingly looking for ways to address are a significant portion of the overall benefits. The multiplier effect AO accounts for most of the overall economic benefits brought as a R the justice gap. In a world where data increasingly drives policy LEPG making, and where budgetary pressures can crunch social spend- result of legal aid. By omitting those benefits, decision-makers may FI D ing, evidence-based proposals that demonstrate the net benefits of be missing a substantial component of the benefits of legal aid. SL OA legal aid are useful and persuasive. In this spirit, policymakers and TA 97. International consensus is growing on the utility of the use EIG policy influencers have turned to cost benefit analysis as a tool to LF better evaluate the economic impact of legal aid and related ser- of CBAs for legal aid and related access to justice programs. NE Critical gaps in the literature should be filled before robust cost- F EA vices and to make informed decisions on how to address the justice SDOB gap and allocate funding most efficiently and effectively. benefit analysis can be conducted for all legal aid policies and interventions. YSAIN 95. The cost benefit analyses surveyed in this report suggest LS that the benefits of legal aid outweigh the costs. This report sum- 98. To assist interested policymakers and those who influence AT NS marizes the results of around 50 cost benefit analyses conducted them, Chapter 3 offers a practical step-by-step guide on how to AO conduct a cost benefit analysis of different policy alternatives. TC around the world. The study does not presume to provide a conclu- HE sive response on the economic desirability of any specific legal aid With this guide, the report hopes to make a small contribution T FI to the research in the field of the net benefits of legal aid. The NE policy. However, under the assumption that social costs and benefits EE involve discretion by analysts, the results from the survey suggest guide offers governments, CSOs and others the tools to gather the MIBN overwhelmingly that the benefits of legal aid investments greatly relevant data needed to conduct their own cost-benefit analysis. XSAT outweigh the costs. The result can be better informed policies that allocate government EO resources efficiently and effectively to close the justice gap. YC T A 96. CBAs rely on a variety of assumptions regarding the costs WH and benefits of legal aid, and more work is needed to develop HOW TO CONDUC consistency among these assumptions. As more studies are conducted—and the more that each learns from the others—this consistency is likely to develop over time. Nearly all the studies reviewed build their analytical strategies on a set of conservative assumptions, meaning that the likely identifiable and quantifiable 40 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID WO H Y T HW EOX ACMOIN ND CH EUT OO TEACC TT SS AE SB NN DE B FIET E FI NA NA S O TLY SF I SLE OGFAA A IG L LE DA?L AID PROGRAM 41 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID L NA WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA N DX IE ? ANNEX I: SUMMARY TABLE OF COST AND BENEFIT STUDIES OF LEGAL AID 42 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID LEGAL AID BENEFITS/ RESEARCH # COUNTRY STUDY REFERENCE YEAR STUDY TYPE LEGAL AID NEEDS COSTS METHOD Anthony Nwapa, Building and Sustaining Reduction in the number Narrow CBA/ Change: Pre-trial Detention Reform in Access to justice of pre-trial detainees and Impact 1 NIGERIA 2008 Impact Nigeria in Justice Initiatives: Pre-trial (pre-trial detention) the average duration of evaluation Evaluation Detention detention Reduction in the remand population; in the number Clifford Msiska, On the Front Lines: of pre-trial detainees, Narrow CBA/ Insights from Malawi’s Paralegal Advisory Access to justice savings to the justice Impact 2 MALAWI 2008 Impact Services in Justice Initiatives: Pre-trial (pre-trial detention) system resulting from evaluation Evaluation Detention prisoners entering informed pleas to their charges Narrow CBA/ Descriptive SIERRA Open Society Foundations, Improving Pre- Access to justice Reduction in the number of 3 2013 Impact statistics/ LEONE trial Justice in Sierra Leone (pre-trial detention) pre-trial detainees Evaluation survey Reduction in the number Narrow CBA/ SOUTH YD Davids et al., Community advice offices: Access to justice of pre-trial detainees and Impact 4 2008 Impact AFRICA Making a case for public funding (pre-trial detention) the average duration of evaluation Evaluation detention Access to justice (legal PricewaterhouseCoopers. Economic Direct representation, duty Quantifiable benefits and Value of Legal Aid. Analysis in relation to calculation/ 5 AUSTRALIA 2009 Narrow CBA lawyer assistance, costs of legal aid to the Commonwealth funded matters with administrative alternative court system. a focus on family law records dispute resolution mechanisms, etc.) LEGAL AID BENEFITS/ RESEARCH N# COUNTRY STUDY REFERENCE YEAR STUDY TYPE LEGAL AID NEEDS COSTS METHOD Direct Liz Elwart, et al. “Increasing Access calculation; to Restraining Orders for Low-Income Domestic violence Direct benefits and costs; expert inputs Victims of Domestic Violence: A Cost- Comprehensive 6 USA 2006 prevention/ indirect benefits of avoided on indirect Benefit Analysis of the Proposed Domestic CBA restraining order costs per violent incident benefits; Abuse Grant Program,” Wisconsin Access sensitivity To Justice Committee Report analysis Consumer rights, Literature government benefits, review of Laura K.Abel, Susan Vignola, Economic housing, employment Direct benefits and costs; Comprehensive/ studies/ 7 USA and Other Benefits Associated with the 2010 issues, land and indirect benefits of avoided Narrow CBAs analysis of Provision of Civil Legal Aid property disputes, costs CBAs of legal family problems, aid justice system, etc. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID Costs include medical, TK Logan et al., The Kentucky Civil mental health, criminal Protective Order Study: A Rural and Urban Domestic violence justice, legal, lost earnings, Comprehensive Experimental 8 USA Multiple Perspective Study of Protective 2009 prevention/ property losses, and time CBA research Order Violation Consequences, Responses, restraining order lost for family and civic & Costs responsibilities as well as an index of quality of life Amy Farmer & Jill Tiefenthaler, “Explaining The Survey/ the Recent Decline in Domestic Violence,” Domestic violence Assessment of legal aid 9 USA 2003 effectiveness of econometric Contemporary Economic Policy, Volume prevention effectiveness legal aid analysis 21, pg.158 Costs of pre-trial Open Society Foundations and United detention: income, Access to the justice Literature/ Nations Development Programme, The Costs of pre-trial employment, education, 10 WORLD 2010 system (pre-trial evidence Socioeconomic Impact of Pre-trial detention incarceration-related detention) review Detention expenses, and long-term effects 43 WN A HN YE X E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? 44 L NA WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA N DX IE ? LEGAL AID BENEFITS/ RESEARCH N# COUNTRY STUDY REFERENCE YEAR STUDY TYPE LEGAL AID NEEDS COSTS METHOD A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID Costs to law enforcement (per arrest); courts (per case); jails and prisons The top-down (per inmate); probation and and bottom-up Various legal aid parole (per supervisee); approaches Vera Institute of Justice. A Guide to Costs to the needs overlapping 11 WORLD 2013 juvenile detention and to calculating Calculating Justice-System Marginal Costs justice system with the criminal commitment (per youth); marginal costs justice system juvenile supervision (per to justice youth); criminal justice system programs (per participant), etc. Various legal aid Literature/ Sandefur L. Rebecca, The Impact of Costs to the Costs of unaddressed civil 12 WORLD 2010 needs related to the evidence Counsel: An Analysis of Empirical Evidence justice system justice problems civil justice review Albiston R. Catherine and Sandefur L. The Costs to the justice system Literature/ 13 USA Rebecca, Expanding the Empirical Study 2013 effectiveness of Access to justice from self-represented evidence of Access to Justice legal aid litigants review John Greacen, The Benefits and Costs Direct of Programs to Assist Self-Represented Direct costs of legal aid; calculation/ Various legal aid 14 USA Litigants, Results from Limited Data 2009 Narrow CBAs savings to the courts and survey/ needs Gathering Conducted by Six Trial Courts in litigants administrative California’s San Joaquin Valley data gathering J.J. Prescott, ”The Challenges of General discussion on Costs and Literature/ Calculating the Benefits of Providing Various legal aid how to calculate costs 15 WORLD 2010 benefits of legal evidence Access to Legal Services,” Fordham Urban needs and benefits of legal aid aid review Law Journal, Volume 37, pg. 303 programs LEGAL AID BENEFITS/ RESEARCH N# COUNTRY STUDY REFERENCE YEAR STUDY TYPE LEGAL AID NEEDS COSTS METHOD Assessments of cost-effectiveness Consumer rights, of legal aid for the states of Alaska, government Direct Arizona, Arkansas, California, benefits, housing Direct benefits and calculation; Florida, Georgia, Iowa, Illinois, (e.g. evictions), costs; indirect benefits expert inputs 16-40 USA Louisiana, Maryland, Massachusetts, N/A Narrow CBAs employment issues, of homelessness and on indirect New Hampshire, New York, land and property domestic violence benefits/ North Carolina, Ohio, Oklahoma, disputes, family prevention avoided costs Pennsylvania, Tennessee, Texas, and problems, justice Virginia system, etc. Direct monetary costs to individuals (e.g., lawyers’ fees, transportation Farrow et al., Everyday Legal costs, court fees, etc.), Direct Various legal aid 41 CANADA Problem and The Cost of Justice in 2016 Narrow CBA cost of service provision, calculation/ needs Canada: Overview Report avoided public costs on survey A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID social assistance, health care, and employment insurance Assessments of cost-effectiveness Consumer rights, of legal aid for the states of Alaska, government Direct Arizona, Arkansas, California, benefits, housing Direct benefits and calculation; Florida, Georgia, Iowa, Illinois, (e.g. evictions), costs; indirect benefits expert inputs 42 USA Louisiana, Maryland, Massachusetts, N/A Narrow CBAs employment issues, of homelessness and on indirect New Hampshire, New York, land and property domestic violence benefits/ North Carolina, Ohio, Oklahoma, disputes, family prevention avoided costs Pennsylvania, Tennessee, Texas, and problems, justice Virginia system, etc. 45 WN A HN YE X E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? 46 L NA WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA N DX IE ? LEGAL AID BENEFITS/ RESEARCH N# COUNTRY STUDY REFERENCE YEAR STUDY TYPE LEGAL AID NEEDS COSTS METHOD A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID Direct costs of pre-trial detention; benefits/ avoided costs of detention associated with (i) prosecuted crimes, (ii) failures to appear in Direct court, (iii) felonies for calculation/ which no arrest is made, estimation with Baughman, Shima Baradaran, The Comprehensive Access to justice and (iv) post-prison expert inputs 43 USA 2011 State of Pre-trial Detention CBA (pre-trial detention) monitoring. Economic for unit cost costs of detention of crime and associated with (i) loss economic cost of freedom, (ii) loss of detention of income, (iii) loss of housing, (iv) childcare costs, (v) stolen or lost property, (vi) loss of income taxes, etc. Overall effectiveness Access to justice Literature/ Rhode et al., Access to Justice of legal aid in terms Comprehensive (limited legal evidence 44 USA Through Limited Legal Assistance, 16 2018 of obtained positive CBA assistance review/survey Nw. J. Hum. Rts. 1 outcomes; direct costs of programs) analyses legal aid programs Overall effectiveness of Ward Berenschot, Taufik Rinaldi, Narrow CBA/ community-based justice; Paralegalism and Legal Aid in Impact 45 INDONESIA 2011 Impact Access to justice public savings from Indonesia: Enlarging the Shadow of assessment assessment reduced use of police the Law services STUDY LEGAL AID BENEFITS/ RESEARCH # COUNTRY STUDY REFERENCE YEAR LEGAL AID NEEDS TYPE COSTS METHOD Direct costs of civil Direct Various legal aid legal aid; cost-savings calculation The National Association of Citizens needs related to of avoided “mounting using case 46 UK Advice Bureau, Towards a business 2010 Narrow CBA housing, debt, problems”: (i) housing, management case for legal aid welfare benefits, and (ii) debt, (iii) welfare data/expert employment benefits and (iv) input employment Assessments of the benefits brought by lawyers and paralegals Literature/ Open Society Foundations, Improving Impact Access to justice for the administration of evidence 47 WORLD Pre-trial Justice: The Roles of 2012 assessment (pre-trial detention) justice, the efficiency of review/survey Lawyers and Paralegals criminal justice systems, analyses A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID and respect for the rule of law Assessment of the legal 2018 Annual BRAC report for Impact Various legal aid aid program results; Impact 48 BANGLADESH Bangladesh, Human Rights and Legal 2018 assessment needs recovered cash benefits assessment Aid Services program, p. 28 for legal aid clients Behrman, J., L. Billings, and A. Peterman. Evaluation of grassroots community–based Legal aid Qualitative evidence on activities in Uganda and Tanzania: UGANDA AND Impact Access to justice the benefits of legal aid; Impact 49 Strengthening women’s legal 2013 TANZANIA assessment (land rights) costs of providing legal assessment knowledge and land rights. CAPRi aid Working Paper No. 108. Washington, D.C.: International Food Policy Research Institute 47 WN A HN YE X E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? 48 L NA WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA N DX IE ? STUDY LEGAL AID BENEFITS/ RESEARCH # COUNTRY STUDY REFERENCE YEAR LEGAL AID NEEDS TYPE COSTS METHOD A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID Robin Nielsen and Tim Hanstad. Land-related legal aid in community Qualitative evidence on driven development projects: Impact Access to justice benefits of legal aid; Impact 50 INDIA lessons from Andhra Pradesh. 2008 assessment (land rights) costs of providing legal assessment Agricultural and Rural Development aid notes; no. 37. Washington, DC: World Bank. Cost of legal aid; eviction avoided; custodial sentence avoided—loss of income avoided, social isolation Hammond, Clare, Vermeulen, Inga. avoided; more and better Direct Social Return on Investment in employment prospects calculation/ Housing, family and 51 UK Legal Aid. Rocket Science UK Ltd 2017 Narrow CBA during the case; better case criminal law matters commissioned by the Law Society health and family management of Scotland relationships during the data case; fewer cases going to court; fewer custodial sentences; reduced public spending because homelessness avoided Bilal Siddiqi and Justin Sandefur. Socioeconomic gains as a Impact Delivering Justice to the Poor: result of legal aid; better assessment/a Theory and Experimental Evidence Impact Access to justice 52 LIBERIA 2013 outcomes for legal aid randomized from Liberia (paper presented at the assessment (Property Rights) clients; 10% reduction in trial of legal World Bank Workshop on the African the incidence of bribe aid program Political Economy, Washington D.C.) LEGAL AID BENEFITS/ RESEARCH # COUNTRY STUDY REFERENCE YEAR STUDY TYPE LEGAL AID NEEDS COSTS METHOD Blattman et. al. How to Promote Order and Property Rights under Effectiveness of legal Weak Rule of Law? An Experiment aid through Alternative Impact Access to justice Impact 53 LIBERIA in Changing Dispute Resolution 2014 Dispute Resolution in assessment (Property Rights) assessment Behavior through Community addressing land related Education (2014). American Political disputes Science Review, 108(1), 100-120 Dandurand, Yvon and Jahn, Jessica. Measurable outcomes of A Feasibility Study on Measuring legal aid related to (i) the Literature/ Economic Impact of Criminal and Methodological efficiency of the criminal 54 CANADA 2018 Access to justice evidence Immigration and Refugee Legal note justice process (including review Aid in Canada Issues, Options and pre-trial detention) and Recommendations (ii) case disposition A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 49 WN A HN YE X E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? ANNEX II: CASE STUDIES OF CBAs OF LEGAL AID L NA WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA N DX IE ? CASE STUDY A: COST BENEFIT ANALYSIS OF THE i) the costs are represented by the financial costs of FDR to the FAMILY DISPUTE RESOLUTION SERVICE (FDR) IN Australian Government; AUSTRALIA ii) the benefits are represented by the value of court event hours that are avoided as a result of successful FDR outcomes. In December 2018, KPMG reported on the evaluation of the Family The costs of FDR services are estimated as the lump sum based on Dispute Resolution (FDR) services in legal aid commissions the administrative data of the Attorney General’s Department (Table throughout Australia, at the request of The Attorney-General’s A1). However, the computation of total benefits in terms of avoided Department. The FDR evaluation reports also encompassed a CBA court costs required a more complex approach, that combines analysis, which considered the costs and benefits of FDR services for heterogeneous data sources and types of assumptions to derive the the program, in the commissions of each jurisdiction, in cases where: interim (Table A2) and final (Table A3) inputs and outputs of the benefit analysis. TABLE A1. CALCULATIONS OF THE FAMILY DISPUTE RESOLUTION SERVICE (FDR) COSTS SCOPE/UNIT OF CATEGORY VALUE SOURCE ASSUMPTION MEASUREMENT COSTS Grant, Screening Attorney General’s Consistency across the A OF FDR and Administration 19,748,000 Department state SERVICES ($) 50 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID The estimate of avoided costs per case due to Family Dispute Resolution service is considered an interim output. The avoided cost per case is A WNHN estimated on an hourly basis, by dividing the appraised expenditure per case by the funded hours of the legal aid provision. YE X E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? TABLE A2. CALCULATIONS OF THE FAMILY DISPUTE RESOLUTION SERVICE (FDR) BENEFITS PER CASE, BASED ON CALCULATING THE COSTS OF A CASE GOING TO COURT WITH FULL LEGAL AID SCOPE/UNIT OF CATEGORY VALUE SOURCE ASSUMPTION MEASUREMENT BENEFIT (AVOIDED COSTS) PER CASE Real net recurrent The components of the expenditure per expenditure include Real net recurrent finalization for salary and non- salary expenditure per the Family Court expenditure, court B 3,369 finalization for Productivity administration agency Family Court ($) Commission Review of and umbrella department EXPENDITURE Government Services, expenditure, and PER CASE 2008, pp. 7.11s contract expenditure. The median amount Real average cost Hunter, R. (2000) Legal paid by legal aid prior of legal aid fees per services in family law, C 2,706 to a hearing for cases case for a family law Law Foundation of NSW, handled by private matter ($) pp 224 lawyers. HOURS Weighted average of Productivity D FUNDED BY Hours 22 estimates provided Commission reports LEGAL AID during consultation HOURLY COST PER Hourly cost per case E CASE TO 281.25 Derived value (B+C)/D in ($) LEGAL SYSTEM A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 51 The interim results from the FDR benefits per case assessment help court time. Using the additional assumptions on the distribution of DX IE ? calculate the avoided costs per case. All cases are classified into the outcomes of legal aid on the outcome of litigation, the avoided L NAN fully resolved and partially settled. The partially settled ones are costs are computed for all groups of cases, and then summarized to WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA further divided into two criteria: partially-saved and fully-saved determine the total benefit. TABLE A3. CALCULATIONS OF THE FAMILY DISPUTE RESOLUTION SERVICE (FDR) TOTAL BENEFITS SCOPE/UNIT OF CATEGORY VALUE SOURCE ASSUMPTION MEASUREMENT BENEFIT (AVOIDED COSTS) PER CASE Attorney General’s F Cases 3,887 Department CASES FULLY Court event hours G 84,115 Derived value DxF RESOLVED avoided Cost of hours H 23,611,000 Derived value ExG avoided ($) CASES PARTIALLY Attorney General’s I Cases 1,567 SETTLED IN A Department WAY THAT Number of cases which do not result J in litigation (fully 1,175 Assumed value 75% of total cases at J I) COURT saved court event EVENT TIME time) IS FULLY Court event hours K SAVED 25,432 Derived value DxJ avoided Cost of hours L 7,139,000 Derived value ExK avoided ($) Number of partially settled cases that result in litigation 50% of the 25% that M Assumed value but experience proceed to litigation saved court event time II) COURT EVENT TIME On average, the number PARTIALLY of court event hours Court event hours N SAVED 1,411 Derived value saved equals a third of avoided the average court time (7.2 hours), D/3 x M Cost of hours O 397,000 Derived value ExN avoided CASES Total cost of cases P PARTIALLY 7,536,000 Derived value L+O partially avoided SETTLED TOTAL BENEFITS 31,147,000 DERIVED VALUE H+P 52 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID Eventually, the CBA was determined by calculating the Net Present Nonetheless, the assessment was performed from the perspective WN A HN Value and Cost-Benefit ratio to indicate the profitability of the of the sponsor (The Attorney General’s Department) and as such did YE X Family Dispute Resolution service as a form of legal aid. As Table not quantify several other benefits that evidently accrued to other E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? A4 reads, the FDR generated important savings in judicial costs. agents within the Australian society. Those include primarily saving So, the Cost-Benefit Ratio of 1.58 suggesting that the legal aid litigants’ time, as well as a series of benefits that would depend program was highly successful. on the specific disputes that legal aid helped resolve (e.g., avoided domestic violence and associated productivity and health benefits). TABLE A4. CALCULATIONS OF THE FAMILY DISPUTE RESOLUTION SERVICE (FDR) CBA INDICATORS CBA INPUTS/OUTPUT CALCULATION VALUE ($) VALUE OF Q INPUT Table A3 19,748,000 BENEFITS VALUE OF R INPUT Table A1 31,147,000 COSTS S OUTPUT NPV Q–R 11,399,000 COST- T OUTPUT BENEFIT Q/R 1.58 RATIO CASE STUDY B: COST BENEFIT ANALYSIS OF THE 2. To determine the average cost per case of going through the MJS, ABORIGINAL JUSTICE STRATEGY IN CANADA researchers divided the total costs (administration of court services, prosecution and legal aid) by the number of cases. In the 2014-15 As a part of an evaluation of the Aboriginal Justice Strategy (AJS), period, total costs of $1,650,268,754, divided by the number of the Department of Justice of Canada conducted a statistical cases, equaled $4,435. analysis of how AJS-funded community-based justice programs affected the rates of recidivism. These studies compared recidi- 3. For the sake of the cost savings assessment, the incremental vism rates for offenders who participated in one of the selected AJS reduction in the average recidivism rates between program par- programs, with a group of offenders who were referred but did not ticipants and the comparison group were calculated each year for participate. eight years following program participation, using the findings from the abovementioned statistical studies (8.8 percent in the first year Since the rates of re-offending were significantly lower among pro- down to 0.5 percent in eighth year). For example, since the recidi- gram participants at every point in time after completing the pro- vism analysis found the program participants in the study were 8.8 gram, a cost analysis was conducted to estimate the impact of the percent less likely to re-offend after one year than the comparison AJS programs on reducing costs to the Mainstream Justice System group, and the average cost per case in the MJS was estimated at (MJS). This is an example of an access to justice intervention that $4,435, the cost savings per program participant, in 2014 dollars, goes beyond legal aid. It demonstrates that CBAs can be conducted one year later was $4,435 × 8.8% = $390. on a range of justice programs. 4. The social discount rate was set to 8 percent (official social dis- The analysis was carried out in the following steps: count rate set by the Treasury Board of Canada Secretariat). 1. To calculate the mean of the average cost per participant in the AJS programs (which were $2,831 in 2014-15) researchers divided the total costs of AJS program by the total number of clients (i.e., $2,831 = $25,591,255 / 9,039). A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 53 5. Immediate savings per program participant (in the current year) Alternatively, B/C per participant could be used as an indicator of DX IE ? equal the MJS cost per case minus the AJS cost per case (or $4,435 economic profitability. In that case, the total benefit would equal the L NAN - $2,831 = $1,604, according to 2014-15 figures). This amount sum of the discounted stream of future cost savings, plus the full WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA basically reflects the difference in the per-participant expenses MJS cost savings in the current year ($5094.6 = $ 659.6 + $4,435). between the with- or without-program scenario. Then the Cost-Benefit ratio would be computed as B/C = $5094.6 / $2831.2 = 1.8, confirming that program is highly profitable in an 6. The stream of cash flows for each of the eight years is calculated economic sense. based on the previous inputs, using the formula for economic net present value given in the table below: As in the example from Annex A above, the Cost-Benefit ratio of 1.8 suggests that the project is economically sound. 7. Eventually, the present value of the cost savings of the total AJS-funded program would be calculated by taking the total pres- Nonetheless, the value seems underestimated as a range of other ent value of savings per case and multiplying it by the number of benefits are not quantified in this study. Some of those include the AJS clients for 2014-15 ($2,264 x 9,039 clients), which gives the benefits of avoiding imprisonment (e.g., lost time and productivity and respectable number of $20,464,296 cost savings. the avoided expense of imprisonment), probation costs, avoided costs associated with the offender’s family support in their absence, etc. TABLE B1. CALCULATIONS OF THE NET PRESENT VALUE OF THE ABORIGINAL JUSTICE STRATEGY PROGRAM, USING DISCOUNTED CASH FLOWS YEAR 0 1 2 3 4 5 6 7 TOTAL I Rate of incremental re- 8.8 3.4 1.5 1.3 0.8 0.7 0.7 offense reduction II Savings of MSJ costs per program 390.3 150.8 66.5 57.7 35.5 31.0 31.0 participant (I*4,435) III Discount factor 0.9 0.9 0.8 0.7 0.7 0.6 0.6 1/ (1+0.08) Year IV Discounted economic future 361.4 129.3 52.8 42.4 24.1 19.6 18.1 659.6 cost savings (II*III) V Immediate 1603.8 1603.8 savings Total NPV of 2263.4 savings (IV+V) 54 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID ANNEX III: CBA MATHEMATICAL COMPUTATION WN A HN YE X E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? THE CALCULATION OF FINANCIAL PERFORMANCE where NFCFt is an annual net financial cash flow in year t, T is a INDICATORS length of the project lifecycle in years. Financial performance indicators are obtained by applying the c) Financial Benefit-Cost (B/C) Ratio—The ratio of discounted Discounted Cash Flow (DCF) Method143 to the series of net finan- project benefits relative to discounted project costs. It is particularly cial benefits arising from legal aid over the investment horizon useful when running comparisons between two projects of different under consideration. Discounting is applied to account for the scope. time value of net benefits expected to accrue at different points in time. Accounting for the difference in time these benefits accrue THE CALCULATION OF ECONOMIC PERFORMANCE enables a determination of their aggregate value at a common point INDICATORS in time (i.e., present). There are three main financial performance indicators: As with the financial performance indicators, economic perfor- mance indicators are obtained by applying the Discounted Cash a) Financial Net Present Value (FNPV)—Expressed in absolute Flow (DCF) Method to the net economic benefits occurring over number and thus varying with project size. Calculated by using the the period analyzed. There are three main economic performance following formula: indicators: a) The Economic Net Present Value (ENPV) is the difference between the discounted economic benefits and the costs. The ENPV where FNCFt is an annual net financial cash flow in year t, T is is a measure of the socioeconomic profitability of the project that the length of the project lifecycle in years, and dt is the financial indicates whether the present value of economic benefits exceeds discount factor in year t. the present value of economic costs. It is calculated as follows: The financial discount factor dt shall be computed as , where i is the financial discount rate. where NECFt is an annual net economic cash flow in year t, T is The financial discount rate is the rate at which a series of cash a length of the project lifecycle in years, and dt is a discount factor flows (i.e., net benefits in our case) are discounted. It represents the in year t. opportunity cost of capital at an annual level. Hence, the cash flow (i.e., net benefits) accruing a year after the assessment is made are Social discount factor dt shall be computed as , where discounted (i.e., divided) by a factor equal to 1+i, while cash flow i is the social discount rate. accruing in two years are discounted (i.e., divided) by a factor equal to (1+i)2, and so forth. b) The Economic Rate of Return (ERR) is the internal rate of return that equals value of ENPV to zero. The economic rate of return is a b) The Financial Rate of Return (FRR)144—Expressed in percent- measure of the socioeconomic profitability of the project, indicating age points and scale-invariant. This feature of the indicator allows whether the project rate of return is higher or lower than the bench- a comparison of many different project alternatives regardless of mark economic discount rate. If higher, the project is considered size. It represents a discount rate which returns a FNPV of zero (i.e., beneficial to the society. It is calculated as follows: makes the stream of future financial cash flows from project imple- mentation equal to zero). It can be viewed as return on the invest- ment in the project being considered. It is calculated as follows: where NECFt is an annual net financial cash flow in year t, T is a length of the project lifecycle in years. 143 The discounted cash flow is a valuation method used to estimate the value of an invest- ment based on its future cash flows. 144 Adopted from the more common term “internal rate of return” to allow for differentiation between the financial term and the economic rate of return. A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 55 c) The Economic Benefit-Cost (B/C) Ratio is a measure of project and thus equates the social discount rate to a rate of time prefer- DX IE ? profitability and viability computed as the ratio of total discounted ence, usually estimated with the Ramsey formula. L NAN benefits to total discounted costs over a project lifecycle. The BC b) The social opportunity cost of capital. This approach is based WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA ratio indicates whether the present value of economic benefits is on the argument that public investment crowds out private invest- higher than the present value of economic costs. The program is ment one-for-one and, as such, the discount rate is estimated based generally financed or considered beneficial if: on the pre-tax real rate of return for private investment, typically estimated using returns to private capital. The estimated value of the social discount rate usually falls within the range of 10-12 percent for developing countries, or 3-5 per- As pointed out in the main text, the choice of an appropriate social cent for advanced countries. Based on the social opportunity cost discount rate is one of the key elements of an economic analysis. of the capital approach, development banks (e.g., the World Bank The main methods used to calculate the social discount rate are: and the Asian Development Bank) typically apply a real discount a) The social rate of time preference. This approach is based on rate in the range of 10-12 percent when evaluating projects in the argument that public investment reduces private consumption developing countries. Consequently, many government agencies in BOX 7. ESTIMATING THE SOCIAL DISCOUNT RATE IN MYANMAR USING THE RAMSEY FORMULA According to the Ramsey formula, a social discount rate rests • Elasticity of the marginal utility of consumption y : on three key variables: Typically, between 1-2. In the absence of adequate i) how much the future is discounted relative to the present study for Myanmar, an approximation is made based on (∂), ii) how the additional utility from an increase in the estimated elasticity for India (value 1.64), drawing consumption changes (y ), and iii) how much consumption from data between 1965 and 1995 (Kula, 2004). will grow over time (g). The formula reads as: • Growth rate of per capita consumption g: the first scenario is a historical average of Myanmar per capita SDR = ∂ + yg, consumption growth rates (3%); the second scenario is a historical average of the Least Developed Countries The study of Dobermann (2018) attempts to capture the per capita consumption growth rates (4.72%). social discount rate for Myanmar under several scenarios, utilizing the following assumptions on Ramsey formula parameters: • Time discount rate ∂: Typically, between 1-1.5%, adjusted up or down based on whether mortality is high or low. Using a 10-year average of the crude death rate for Myanmar from WDI data, it is adjusted to 0.83%. Based on these assumptions, the following values of SDR are computed for Myanmar: PARAMETER MINIMUM MIDDLE MAXIMUM Time discount ∂ 0% 0.83% 1.5% Utility y 1% 1.64% 2% SDR if consumption growth g = 3% (scenario 1) 3% 5.75% 7.5% SDR if consumption growth g = 4.72% (scenario 2) 4.72% 8.57% 10.94% 56 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID these countries follow such guidelines and apply a discount rate tries should be valued at the yield-to-maturity of the recent issu- WN A HN within similar range when evaluating public projects. In the case ance of dollar-denominated sovereign debt with a maturity greater YE X of advanced countries, the European Commission, for example, than five years. This is considerably lower than the usual range of E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? recommends that the social discount rate of five percent be used 10-12 percent, as illustrated in Table 3 below. for major projects in cohesion countries145 and three percent for the other member states. Some comparison of real discount rates being used for selected advanced and developing countries can be found in Harrison (2010). Nevertheless, such high social discount rates for developing countries are prone to serious criticism. For instance, Warusawitharana (2014) argued that the SDR for developing coun- 145 Cohesion countries are EU countries with a GNI of less than 90 percent of the EU average. These countries are beneficiaries of the EU Cohesion Fund, established to reduce economic and social disparities within the Union. TABLE 3. YIELD TO MATURITY ON SOVEREIGN DEBT ISSUANCE BY DEVELOPING COUNTRIES AS A PROXY OF SDR YIELD-TO- YIELD-TO- COUNTRY ISSUE DATE MATURITY COUNTRY ISSUE DATE MATURITY PROXY FOR SDR PROXY FOR SDR Kenya 6/17/2014 6.88% Senegal 7/23/2014 6.25% Zambia 4/7/2014 8.63% Honduras 12/11/2013 8.75% Ivory Coast 7/16/2014 5.63% Gabon 12/5/2013 6.38% Sri Lanka 4/8/2014 5.13% Bolivia 8/15/2013 6.25% Pakistan 4/9/2014 8.25% Nigeria 7/2/2013 6.63% Source: Warusawitharana (2014) Finally, in order to transform the market to accounting prices and Where M corresponds to the total value of imports (X – total value address inefficiencies of the market environment in which legal aid of exports), Rm stands for import taxes, while Rx stands for export is delivered, it is necessary to use the The Standard Conversion taxes. The computation of SCF values for five selected African Factor (SCF). SCF is estimated using the following formula: countries, based on the data from WDI, is given in the table below. TABLE 4. STANDARD CONVERSION FACTORS FOR SELECTED AFRICAN COUNTRIES (IN LCU BILLIONS, 2017) STANDARD COUNTRY IMPORT IMPORT DUTIES EXPORT TAX ON EXPORT CONVERSION FACTOR Botswana 61,108 17,864 71,735 2 0.88 Cote d'Ivoire 7,022,003 485,539 7,532,730 601,891 1.01 Equatorial 2,731,809 12,292 4,109,215 8,074 1.00 Guinea Senegal 4,342,562 263,495 2,665,072 2,891 0.96 Togo 1,667,073 100,130 1,133,838 1,556 0.97 AVERAGE 0.96 Source: own computation using WDI data A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID 57 The average value of SCF is around 0.96, which is in line with the Shadow wage factors (SWF) is a specific conversion factor used to DX IE ? assessed average values of SCF in other world regions, but indi- account for imperfections on the labor market. These imperfections L NAN vidual values per countries may considerably vary relative to the are reflected through the unemployment rate and the rate at which WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O F L E G AA average. In the case of selected countries, the SCF for Botswana is wages are taxed in the economy. Please see the box on the following considerably lower at 0.88. It means that the economic value of the page for the details on how to calculate it. estimated costs and benefits will be considerably lower than the financial value. For example, if we apply this rate to the estimated financial costs of the buildings in Box 4 (i.e., construction costs), then the economic value of the costs will be 1,500,000 x 0.88 = 1,322,214. BOX 8. SHADOW WAGE FACTOR (SWF) AS A SPECIAL CASE OF STANDARD CONVERSION FACTOR While the use of SCF is particularly worthwhile in a CBA For instance, let’s consider Rwanda data on SWF inputs from when significant portions of the cost stem from investments WDI in 2017: in physical assets, it has limited usefulness in a CBA of i) The unemployment rate (% of the total labor force, investments in social infrastructure where labor costs entire economy) = 17.4%; dominate the total cost structure. This is typically the case ii) The tax rate on income, profits and capital gains with legal aid projects/programs. The labor cost is adjusted (% of total taxes, overall) = 39%; using the Shadow Wage Factor. (SWF) calculated as: iii) The social contribution (% of revenue, overall) = SW=(1-u)*(1-t), where u is the unemployment rate while 8.4%. t is the rate of social security and related taxes. Both parameters apply to the market segment relevant for the When the inputs are inserted into the SWF formula, project (e.g. lawyers in the case of legal aid programs). the following estimate of the SWF for Rwanda is obtained: However, if these data do not exist, the analyst would have to SWF = (1 - 17.4%) *(1 - (39% + 8.4%)) = 0.44 make a reasonable adjustment to the overall unemployment and overall wage tax burden data of the country in question. Thus, according to this calculation, when the performing the adjustment using the SW factor, the economic labor costs The SW factor is designed to account for local labor market would represent only 44% of the initially estimated financial imperfections and to arrive at the social cost of labor. labor cost. Adjustments of such magnitude are usually seen Generally, the higher the unemployment rate and wage tax in non-competitive labor market segments (e.g. low-skilled burden, the less competitive the labor market is and the staff). Legal aid provision entails the participation of highly higher the magnitude of adjustment. skilled labor for which the market is highly competitive. Therefore, the adjustment will typically not be so intensive. 58 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID WN A YE X HN E X A M I N E T H E C O S T S A N D B E N E FI T S O F LE G A L A I D ? 59 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID REFERENCES ER LN AE AC DS IE ? Boston Bar Association, Investing in Justice: A Roadmap to Cost- Pennsylvania Interest on Lawyers Trust Account Board, Supreme EEFG effective Funding of Civil Legal aid in Massachusetts, 2014, http:// Court of Pennsylvania, The Economic Impact of Outcomes Obtained WH Y E X A M I N E T H E C O S T S A N D B E N E F I T S O FR L www.bostonbar.org/docs/default-document-library/statewide-task- for Legal Aid Clients Benefits Everyone in Pennsylvania, October force-to-expand-civil-legal-aid-in-ma---investing-in-justice.pdf 2012, http://legalaidresearch.org/wp-content/uploads/Research- The-Economic-Impact-of-Outcomes-Obtained-for-Legal-Aid- Feelhaver Rod and Jerome A. Deichert, The Economic Impact of Clients-Benefits-Everyone-in-Pennsylvania.pdf Legal Aid of Nebraska, March 2008, http://legalaidresearch.org/ wp-content/uploads/Research-The-Economic-Impact-of-Legal-Aid- Richardson A. James, Legal Services Programs in Louisiana: of-Nebraska.pdf Their Economic Impact on the State of Louisiana, January 2011, https://www.americanbar.org/content/dam/aba/administrative/ Holt L. Victoria L., Mary A. Kernic, Thomas Lumley, Marsha E. legal_aid_indigent_defendants/ATJReports/ls_LA_impact_2011. Wolf, and Frederick P. Rivara, “Civil Protection Orders and Risk authcheckdam.pdf Subsequent Police-Reported Violence.” Journal of the American Medical Association 288: 589-94, 2002, https://jamanetwork.com/ The Maryland Access to Justice Commission, Economic Impact of journals/jama/fullarticle/195163 Civil Legal Services in Maryland, January 2013, http://mdcourts. gov/mdatjc/pdfs/economicimpactofcivillegalservicesinmd201301. Irvine Mary L, The Economic Impact to the State of North Carolina pdf of Civil Legal Services in 2012, January 2014, http://www.law.unc. edu/documents/poverty/justice/economicbenefits2012fullreport.pdf The Minnesota Legal Services Coalition, Economic Impact Measurements of Minnesota Legal Aid, November 2011, Kenneth A. Smith and Andrea J. Brewer, Economic Impacts of Civil http://mylegalaid.org/downloads/Economic_Impact_Report.pdf Legal Aid Organizations in Virginia, September 2011, http://www. vplc.org/wp-content/uploads/2012/10/VA-Report-on-Economic- The Montana Legal Services Association, The Economic Impacts.pdf Impact of Civil Legal Aid to the State of Montana, 2015, https://courts.mt.gov/portals/113/supreme/boards/a2j/docs/ Kenneth A. Smith and Kelly Thayer, Economic Impact of Civil Legal Aid Organizations Tennessee, March 2015, http://www.tba.org/ sites/default/files/2015-TN-Finalpercent20Reportpercent20Pack- age_Consolidatedpercent20Statewide_3-18-2015.pdf Kushner Jonah, Legal Aid in Illinois, July 2012, http://iejf.org/word- press/wp-content/uploads/LegSrvs_Report_120717.pdf 60 A TOOL FOR JUSTICE: A COST BENEFIT ANALYSIS OF LEGAL AID