WPS7840 Policy Research Working Paper 7840 Citizen Engagement in Rulemaking Evidence on Regulatory Practices in 185 Countries Melissa Johns Valentina Saltane Development Economics Global Indicators Group September 2016 Policy Research Working Paper 7840 Abstract This paper presents a new database of indicators measuring Differences are also apparent among regions: rulemaking the extent to which rulemaking processes are transparent processes are significantly less transparent and inclusive in and participatory across 185 countries. The data look at how Sub-Saharan Africa, the Middle East and North Africa, and citizen engagement happens in practice, including when South Asia on average than in Organisation for Economic and how governments open the policy-making process to Co-operation and Development high-income countries, public input. The data also capture the use of ex ante assess- Europe and Central Asia, and East Asia and the Pacific. ments to determine the possible cost of compliance with a In addition, ex ante impact assessments are much more proposed new regulation, the likely administrative burden common among higher-income economies than among of enforcing the regulation, and its potential environmen- lower-income ones. And greater citizen engagement in tal and social impacts. The data show that citizens have rulemaking is associated with higher-quality regulation, more opportunities to participate directly in the rulemaking stronger democratic regimes, and less corrupt institutions. process in developed economies than in developing ones. This paper is a product of the Global Indicators Group, Development Economics. It is part of a larger effort by the World Bank to provide open access to its research and make a contribution to development policy discussions around the world. Policy Research Working Papers are also posted on the Web at http://econ.worldbank.org. The authors may be contacted at mjohns@worldbank.org. The Policy Research Working Paper Series disseminates the findings of work in progress to encourage the exchange of ideas about development issues. An objective of the series is to get the findings out quickly, even if the presentations are less than fully polished. The papers carry the names of the authors and should be cited accordingly. The findings, interpretations, and conclusions expressed in this paper are entirely those of the authors. They do not necessarily represent the views of the International Bank for Reconstruction and Development/World Bank and its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent. Produced by the Research Support Team Citizen Engagement in Rulemaking – Evidence on Regulatory Practices in 185 Countries Melissa Johns and Valentina Saltane JEL codes: K0, K2, N4, O0, O10. Keywords: Regulatory governance, consultation, notice and comment, regulatory transparency, impact assessments, transparency, inclusive law making, citizen engagement.       I. Introduction Transparency and accountability in government actions are increasingly recognized as central to economic development and political stability (Gisselquist 2012; Fosu, Bates and Hoeffler 2006; Bates and others 2004). Where citizens know the rules that govern their society and have a role in shaping them, they are more likely to comply with those rules. Corruption is lower, and the quality of regulation higher. In addition, citizen access to the government rulemaking process is central to the creation of a business environment in which investors make long-range plans and investments (Diergarten and Krieger 2015; Lindstedt and Naurin 2010; Aidt 2009; Shim and Eom 2008). Governments have opened their policy-making processes to greater public scrutiny and input over the past few decades. In the early 2000s the governments of such countries as Australia, the United Kingdom and the United States began posting the text of proposed regulations online for citizens to read and comment on, as well as contacting specific stakeholders to discuss their areas of concern. Mexico’s government passed a law in 2002 requiring federal ministries and agencies to make all draft regulations publicly available on their websites, and Poland’s government launched an online consultation platform in 2013. Online publication and consultation for new regulations have been shown to boost trust in government and to increase compliance by firms and individuals by improving the likelihood that those affected will know about the new rules and by achieving greater buy-in on their scope and application (Vallbé and Casellas 2014; Torriti 2007; Radaelli 2003; Fadairo, Williams and Maggio 2015; Molster and others 2013). Impact assessments have increasingly formed part of the general public scrutiny of proposed regulations. These assessments open the empirical analysis underlying a proposed regulation to stakeholders, allowing them to review and comment on the assumptions used or the analysis conducted. In this way an impact assessment and public consultation can reinforce each other in improving the quality and effectiveness of regulations (Morrall 2001). In practice, however, studies show that few governments systematically incorporate impact assessments into their consultations but the quality of analysis and consultation varies substantially (OECD 2011, 2015; Kirkpatrick and Parker 2004; Backlund 2009; Torriti 2007; Staronová 2010). Building on the existing literature and with the aim of extending the analysis to developing countries, we sought to chart the extent to which—and how—citizens, civic organizations and business associations around the world can engage with governments on the content and scope of new regulations. To that end we collected data in 185 countries focusing on three areas. The first area was government transparency around proposed regulations, including whether governments communicate with the public about proposed regulations and, if so, how they do it. Communication could be through a unified website where all (or substantially all) new   2          regulations are posted before their final adoption, websites specific to particular ministries or publicly available registries or journals. The second area we studied was government practices of consultation on proposed regulations. Here we investigated whether public notices of rulemaking are accompanied by consultation of stakeholders, whether through online solicitation of comments, public meetings or targeted outreach to particular groups. Finally, we explored the extent to which governments assess the possible impact of proposed regulations within their country before finalizing them. These impacts could be economic, social or environmental. We also considered whether that assessment forms part of the consultation process. Central to this exercise was an effort to capture how rulemaking happens in practice in the different jurisdictions, not just what is required “by laws on the books.” For example, while the data collection exercise looked at whether a country’s laws or regulations require that the general public be engaged in the design of new regulations, we report what happens in practice. Functionally, we seek to identify where governments offer citizens opportunities to voice their concerns about proposed regulations and where they attempt to measure the possible impact of proposed regulations before their adoption. This effort was global in scale. In developing the new data set and related analysis, our goal was to help policy makers identify how their government’s regulatory practices compare with those of others in the areas of transparency, consultation and impact assessment. Varying practices for citizen engagement and impact assessment can be found in countries at all levels of development. We also lay the foundation for a more comprehensive assessment of the relationship between citizen engagement and different economic outcomes by including both developed and developing countries in our sample. In summary, this paper presents a new global data set on citizen engagement in rulemaking and provides detailed descriptive statistics for the indicators. The paper then provides preliminary analysis on how the level of citizen engagement correlates with other social and economic outcomes. To support this analysis, we developed a composite citizen engagement in rulemaking score around the publication of proposed regulations, consultation on their content and the use of regulatory impact assessments. We compare the composite score with indicators from other data sets for two reasons. First, we want to see whether the citizen engagement in rulemaking score aligns with indicators that capture similar concepts. The scores for different countries would be expected to follow the same direction as their scores on good governance and transparency, for example. Second, we explore two hypotheses: 1. In countries that perform well on measures of regulatory quality, the government is more likely to involve the public in developing new regulations. We expect that where civil   3          society, the private sector and other stakeholders have the opportunity to help shape the regulations that affect their day-to-day lives and business operations, the resulting regulations better meet their stated goal and have fewer unintended consequences. 2. In countries with a democratic form of governance, the government is more likely to follow inclusive practices in rulemaking. The essence of a democratic system lies in inclusive and representative governance in which everyone’s voice counts. We therefore expect the manner in which national leaders develop the rules and regulations for society to reflect the practices followed in selecting those leaders. While we conduct initial investigations of these hypotheses, our main purpose in this paper is to present the new data and we do not claim any causal relationships for outcomes. The rest of the paper is structured as follows: Section II reviews relevant literature on participatory rulemaking and social and economic outcomes. Section III presents the questionnaire design and data collection methodology. Section IV offers descriptive statistics with a primary focus on patterns across regions and income groups. Section V discusses the scoring methodology, and Section VI our main analysis. Section VII concludes. II. Literature review A growing body of literature shows a positive association between greater citizen engagement in rulemaking and advanced economic prosperity (Vallbé and Casellas 2014; Torriti 2007; Radaelli 2003; OECD 2009; Denhardt and others 2009). In most economically prosperous countries around the world, the government systematically consults citizens on the scope, content and intended impact of proposed regulations before these regulations are adopted and implemented (Diergarten and Krieger 2015; Gurin 2014). Policies that encourage citizen participation have also proved to be beneficial for less economically prosperous nations (Adams and Atsu 2005; Denhardt and others 2009; Fishkin 2008). A study examining the effect of regulation on income inequality in 26 Sub-Saharan African countries from 1970 to 2005 shows that government transparency, investment and quality regulation are positively and significantly correlated with economic growth (Adams and Atsu 2005). The study emphasizes that lack of transparency in rulemaking undermines the use of public funds and state resources, jeopardizing the entire system of good governance. The authors advocate for stronger participatory democratic governance and greater transparency, especially in relation to public finance and the budget, as well as for opening laws and procedures to public discussion and scrutiny. Similarly, a cross-country analysis of developing countries suggests a strong causal link between regulatory quality and economic performance (Jalilian, Kirkpatrick and Parker 2006). This study shows that efficient governance policies and strong, transparent regulatory institutions lead to   4          higher economic growth. These findings are consistent with earlier research showing strong links between productivity growth, income levels and quality of governance (Gisselquist 2012; Fosu, Bates and Hoeffler 2006; Bates and others 2004). Another study, focusing on economic and social development in Asia, echoes these findings (Sen 2014). This study suggests that government systems with high state administrative capacity and state legitimacy—including those with public involvement in rulemaking processes, strong rule of law and programs to combat corruption—lead to strong gains in social development, such as reductions in income poverty and inequality. It also finds that improvements in government effectiveness and regulatory quality are associated with lower headcount poverty. Efforts to increase transparency and public engagement in rulemaking often have the goal of reducing corruption (United Nations 2012). One study finds that corruption has a negative impact on growth and sustainable development even in economies with already advanced levels of good governance and robust rulemaking institutions (Aidt 2009). And poor governance and weak rulemaking institutions can lead to the misallocation and mismanagement of rich resources, hampering both political and economic development (Bates and others 2004). Corruption in public administration leads to ineffective enactment of public responsibilities, loss of citizen trust, weaker compliance with the rule of law and greater loss of honest human capital (United Nations 2012). Corrupt governments also easily lose the trust of investors (Parker 2002). Moreover, information asymmetry between the regulators and the regulated in countries with little transparency or consultation can lead to “socially sub-optimal outcomes” from new regulations (Jalilian, Kirkpatrick and Parker 2006). Among relatively recent approaches to combating corruption is the participatory budget movement, now implemented in many cities around the world. This approach allows constituencies to have a say in how policy makers use public funds, either directly or through elected budget representatives. It has been shown to foster greater government transparency and increased levels of civic involvement in rulemaking. This and other types of open data initiatives have managed to attract investors by boosting their confidence in the local rule of law and government accountability (Gurin 2014). Yet the simple act of making information publicly available may not prevent corruption or enhance accountability. What matters for a government’s openness is not how much it has integrated modern communications technology into its day-to-day operations but how responsive it is to citizens (Yu and Robinson 2012). Research shows that achieving the benefits of transparency requires that citizens have the capacity and opportunity to act on the information made publicly available, not just to see it (Lindstedt and Naurin 2010; Schantz 2013). But how much information is made publicly available? According to the 2015 Open Budget Survey, the governments of 78 countries, accounting for about 68 percent of the world’s population, provided insufficient budget information to their constituencies (Open Budget Survey 2015).   5          Other research links inclusive, community-oriented approaches to governance with sustainable and well-functioning democracies. Studies have found the integration of citizens, government and civil society to be part of the formation and maintenance of stable democracies (Denhardt and others 2009; Fishkin 2008). One way to achieve this integration is through modern electronic communications channels—such as online or mobile communications—which can help revolutionize the way citizens engage with rulemakers and participate in important decision making processes. The use of online platforms allows civil society and individuals to challenge government decisions in a way that is relatively inexpensive and requires no extra travel time. It also permits the public to enforce, to at least some extent, government accountability for policy priorities and democratic rule (Farazmand 2012). In addition, online platforms help generate feedback from citizens who would normally not participate in government activities, an outcome that can further improve trust in government (Fadairo, Williams and Maggio 2015). The pursuit of greater transparency and inclusiveness is not without countervailing challenges, however. Scholars point out that governments may not be inclined to adopt economic measures that promise to be beneficial in the long run but fail to get overwhelming popular support in the short run. This may be especially true in fragile states (Fosu, Bates and Hoeffler 2006). Researchers argue for a balance between “pleasing the masses” in the short run and implementing sound economic policies. Accommodating the interests of powerful minority groups could also pose a challenge to rulemaking, especially when the opinions of these groups diverge from those of larger ones and impede economic reform (Fosu, Bates and Hoeffler 2006). Interest in tracking and understanding practices related to citizen engagement in rulemaking has grown over time. Numerous studies and data collection efforts on inclusiveness in regulatory decision making have been carried out in the developed world, primarily by the Organisation for Economic Co-operation and Development (OECD). But data on this topic for developing countries have been lacking. Moreover, it is unclear whether adapting the regulatory processes of OECD countries to developing ones is appropriate. This paper offers a comprehensive data set covering multiple forms and stages of citizen engagement globally, attempting to bridge the data gaps for developing countries. III. Questionnaire design and data collection To collect data, we developed a questionnaire covering practices of transparency, consultation and impact assessment in the creation of new regulations. These areas were identified by academics and regulatory governance experts as central to good regulatory practices and lacking in global comparative data. Particular care was taken to create questions that would apply to the wide range of countries in the sample and that would allow for cross-economy comparability of the data. Care was also taken to ensure that the questions would be easily understood by the respondents.   6          The questionnaire was organized around five core questions: Do ministries or regulatory agencies in your jurisdiction give notice of proposed regulations to the general public? Do they publish the text of proposed regulations before those regulations are adopted? Do they request comments on proposed regulations from the general public? Do they report on the results of the consultation on proposed regulations? And do ministries or regulatory agencies in your jurisdiction conduct an impact assessment of proposed regulations? Each of these core questions was followed by up to nine additional questions requesting details on how certain practices are carried out, for example, whether through a unified website or public meetings. The questionnaire also touched on the institutional setup for regulatory practices and legal requirements. And it gave respondents space to provide additional comments and clarifications at the end of each section. Respondents were asked to report on actual practice as well as what is required by law. The five core questions can be seen as sequential—as tracing a possible developmental arc of good regulatory practices. The foundational transparency that comes with notifying the public of proposed regulations is essential to effectively carrying out the sequence of acts from publishing drafts, to requesting comments from the public, to reporting back on the results of that consultation. By systematically analyzing (and sharing) the possible effects of proposed regulations, impact assessments represent a further step toward ensuring that regulations meet their intended goal. Of course, the components of the process do not need to develop in the sequence shown, but we do chart a possible developmental path for countries reforming their rulemaking practices. The questionnaire was sent to more than 1,500 experts in 190 countries worldwide.1 It was distributed in French to respondents in French-speaking countries, in Spanish to those in Spanish-speaking countries, in Russian to those in Russian-speaking economies, in Arabic to those in Arabic-speaking countries, and in English to respondents in all other economies. (The questionnaire is available at http://rulemaking.worldbank.org/methodology.) For 144 countries experts from both the public and private sector responded to the questionnaire. A majority of the private sector respondents were corporate lawyers; however, private sector respondents also included notaries, academics and think tank researchers. The public sector respondents were civil servants identified as experts in their government’s rulemaking process. For 41 countries the data come only from private sector contributors. Where necessary, we conducted extensive follow-up by phone and email to clarify and confirm the data. In many cases we also reviewed specific laws and regulations and checked websites to independently verify the information provided by respondents. When desktop research was inconclusive, additional follow-up was done by phone or email.                                                              1  Survey responses were received from 185 of out 190 countries.    7          The data set is unique in two ways. First, it captures what happens in practice during rulemaking. Unlike other data sets on rulemaking practices, its data collection does not rely solely on what government officials report about their transparency and quality assurance practices; instead, it also seeks private sector input on whether the government actually publishes proposed regulations and engages with the public on them. Thus if an economy’s laws or regulations stipulate that the government must engage the general public in the design and implementation of new regulations, but the government does not carry out such consultation in practice or the private sector is unaware of it, we code the economy as not conducting public consultation. Functionally, such countries fail to offer citizens a way to voice their concerns about proposed regulations. Second, the data set is global in scope. It covers countries in all regions and at all levels of income, including low-income economies. Previous studies have focused on certain economies or regions and thus do not provide the comprehensive, point-in-time global snapshot of regulatory practices given by this data set. A significant limitation of the data set, however, is that it provides data only at the national level. Citizen engagement in rulemaking processes can differ substantially at the regional and even municipal levels. This issue could be especially relevant for big countries, such as Brazil, China, India, Mexico and the Russian Federation, as well as many others. An interesting project going forward would be to design and conduct country-specific studies comparing participation in rulemaking at the subnational level. Another limitation is that while we know where platforms for consultation exist and are used, the data do not tell us how many people actively engage with policy makers or how much diversity there is in their views. Nor do we know the extent to which government officials take public feedback into account when finalizing regulations, unless the government reports back on the results of consultations. And while we know whether or not regulatory impact assessments are being conducted, we do not capture the quality of those assessments or their impact on the proposed regulatory changes. These questions could be additional areas of exploration in future research.   8          IV. Descriptive statistics In this section, we outline the main data trends with the focus on the core components of the survey, including 1) giving notice of proposed regulations and publishing drafts, 2) requesting comments and reporting on results of the consultation process, and 3) conducting regulatory impact assessments a. Giving notice of proposed regulations and publishing drafts Notifying the general public of a proposed new regulation is a common practice, reported in 136 of the 185 countries included in the Citizen Engagement in Rulemaking data set. A large plurality of these economies are in the OECD high-income group or Europe and Central Asia.2 In many countries the public notices include a wide range of information on the proposed regulation. In Estonia, for example, they provide a short summary of the proposed regulation and explain why the regulation is needed, what it is intended to change and when it is expected to enter into force. In Lithuania the notices include this same information and also detail the expected positive and negative consequences of the regulatory change and describe the consultation process planned. And in Moldova they include the general justification for the proposed regulation, contact details for civil servants responsible for the regulation, as well as the deadline and method for submitting recommendations, comments or feedback. Providing public notice of proposed regulatory changes is part of ensuring predictability in the regulatory environment, an aspect that has long been key for firms seeking to make long-range plans and investments. Foreign investors seek insight into the rulemaking plans of the economies in which they invest, both to inform their operations there and to avoid situations where domestic actors receive preferential treatment. otification practices vary across regions. The government gives notice of proposed regulations in more than 70 percent of countries in East Asia and the Pacific (19 of 25) and in 57 percent in South Asia (4 of 7). But the government does so in only 37 percent of economies in the Middle East and North Africa (7 of 19). It follows that in many of this region’s countries trust in government institutions is low and government accountability is weak (World Bank Group 2015). Coming into the Arab Spring in late 2010, the region had promising potential for positive change—with a young and educated population, a strong resource base, low absolute poverty, and an economic resilience that helped in overcoming the effects of the 2008/09 global financial crisis. But the region has shown only limited improvement in governance, including in the quality and transparency of rulemaking institutions (Heidenhof 2014). The practice of providing public notice of proposed regulations is by no means limited to advanced economies, nor is it followed by all wealthy countries. Notification is given in around                                                              2  We follow the World Bank’s regional classification and income groups of economies.    9          70 percent of low- and lower-middle-income economies in East Asia and the Pacific, including Cambodia, the Lao People’s Democratic Republic and the Solomon Islands. But in the Middle East and North Africa it is the wealthiest countries that have the least transparent practices. In the 136 countries around the world where the government provides notice of proposed regulations, the most common practice, followed in the majority of these economies, is to use a single, dedicated website to publish regulatory announcements and related materials (figure 1). This practice, in which different agencies use a single, unified website to provide notification, is widely followed among economies in the OECD high-income group as well as in Europe and Central Asia. In another 30 percent of these 136 countries, notice is given through the website of the ministry or regulatory institution leading the changes. In contrast, websites are used to share news of proposed regulations in less than 7 percent of all countries in Sub-Saharan Africa. Figure 1. In economies where the government gives notice of proposed regulations, the most common practice for doing so is through a unified website 1.5 2 proportion of economies proportion of economies 1.5 1 1 .5 .5 0 D ia an ia a a fic 0 ric ric EC As As ci be e e e e Af Af Pa m m m m O l ib h tra ut co co co co th n ar e: & ra en So or in in in in C m ia ha N C co w h e e & As ig Sa dl dl Lo & & a in H id id ic st st b- pe m m h er Ea Ea ig Su ro Am er er H Eu e pp w dl Lo tin U id La M Unified website Ministry website Unified website Ministry website Journal Other Journal Other Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Note: The categories shown are not mutually exclusive. In some countries, for example, the government might use both unified and ministerial websites to give notice of proposed regulations. The figure shows data only for the 136 (of 185) economies in which the government gives notice of proposed regulations. Given global trends in internet access, it is no surprise that the use of the internet for citizen engagement in rulemaking is more prevalent among high- and upper-middle-income countries. Indeed, unified websites are used in as many as 75 percent of high-income economies, while electronic platforms are used in less than 7 percent of low-income economies. Legal requirements may drive some of this transparency. In 51 of the 185 countries surveyed, rulemaking bodies are required by law to give public notice of their regulatory reform efforts. Most of these economies are in the OECD high-income group or Europe and Central Asia. In Switzerland, for example, article 13 of the  Publications Act  requires the government to give   10          public notice of all proposed regulations. In Hungary the government faces a similar obligation, dating from 2010,3 and regulators comply by publishing the entire text of proposed regulations on a single, unified website. In Poland, which has adopted legal requirements over the past two and a half decades intended to ensure a more transparent and inclusive rulemaking process,4 draft regulations are publicly accessible on the parliament’s website. Perhaps more interesting are the countries where the government faces no legal obligation to publish proposed regulations or seek public input on them but systematically does so anyway. In more than 30 of the sampled economies regulators voluntarily publish proposed regulations despite having no formal requirement to do so. Examples can be found in all regions of the world. In Australia, for instance, the consultation process is regulated mostly by “circular letters” from the Office of the Prime Minister, which are not considered legally enforceable—yet these letters are strictly adhered to. In Bosnia and Herzegovina rulemaking bodies have no legal requirement to give public notice of proposed regulations, but they do so both on websites and in the official gazette. And in Namibia, while there is no legal obligation to give notice, it is common to do so. The government often publishes draft legislation and regulations and invites stakeholders to submit comments. These examples suggest that while legal requirements may be useful in prompting reform of nontransparent rulemaking practices, they are not necessary where public consultation is deeply imbedded in the tradition and practice of rulemaking.  In 43 of the 185 countries surveyed the law stipulates a minimum period for which the draft regulations must be publicly available for review and comment. In more than half these economies this consultation period is 30 days or more. In the Republic of Korea and Montenegro it usually lasts for about 40 days, and in Mexico for 60 days. In Lao PDR and Vietnam draft regulations are available for two months, while in Hungary and the Solomon Islands they are available for a year. In Estonia, by contrast, the consultation period is 15–20 working days for draft laws and 10 working days for draft regulations. In Canada, where there is no set requirement to make draft regulations publicly available, the standard practice is to allow a comment period of 30 days, though the length can vary according to legislative requirements, international obligations and other considerations. And in India draft regulations are generally available for 30–90 days, though the length of time is not governed by law.                                                              3 Act 130/2010; Act 131/2010. 4 Polish Constitution; Act on Employer Organizations, dated May 23, 1991; Act on Lobbying Activity in the Law- Making Process, dated July 7, 2005; Act on Tripartite Commission for Social and Economic Affairs, dated July 6, 2006; Rules of Procedure of Council of Ministers Resolution, dated October 29, 2013; Act on Trade Unions, dated December 6, 2013; and Act on Access to Public Information, dated April 14, 2014.    11          b. Requesting comments and reporting on results of the consultation process The practice of seeking stakeholder input to the rulemaking process is widespread. In 123 of the 185 countries surveyed, ministries or regulatory agencies request comments on proposed regulations. By getting feedback from the groups that will need to comply with a proposed new regulation, policy makers can identify conceptual problems and shape the scope of the regulation to effect the intended outcome. They can also hear from other groups that, while not the target of the proposed regulation, may face substantial unintended harm if the draft remains unchanged. Governments conduct public outreach through websites, through open meetings or by reaching out directly to known stakeholders. Feedback is solicited through at least one of these means in all OECD high-income economies, in 77 percent of countries in Europe and Central Asia and in 68 percent in East Asia and the Pacific (figure 2). Apart from targeted outreach to specific stakeholders, regulatory agencies request public feedback on proposed regulations in 80 percent of high-income countries globally. In contrast, comments from constituents are rarely solicited in the Middle East and North Africa, though Jordan and Morocco are notable exceptions. In Morocco comments on proposed legislation can be submitted on the same web page where the proposed text is published, in both French and Arabic. Figure 2. Comments on proposed regulations are requested in all OECD high-income economies 1.00 1 proportion of economies 0.77 .8 0.68 0.57 .6 0.37 0.37 .4 0.21 .2 0 D a ia an a a fic si ric ri c EC As ci be lA Af Af Pa O ib h tra ut an th ar e: & en So or C r m ia ha N C co & As Sa & & a in ic st st b- pe h er Ea Ea ig Su ro Am H Eu e dl tin id La M Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. In the data collection we distinguished between fully public consultation through websites, gazettes, newspapers and public meetings and more “closed door” outreach to specific   12          stakeholders. The most common practice for soliciting feedback on proposed regulations is through targeted outreach to business associations and other stakeholders, reported in 40 percent of the countries surveyed. The least common practice for doing so is through the relevant agency’s website, reported in about 16 percent of the countries (figure 3). Yet this practice, while less frequent, can be found across all regions and in both low- and high-income countries. In both Myanmar and Spain, for example, regulatory agencies have created specific websites to receive comments from the general public on proposed regulations. In only 7 percent of the economies surveyed does the government request comments through specific outreach to identified stakeholders and not also through additional, more public means, such as through websites or meetings open to the public. Of the regulatory agencies, 33 percent conduct no consultation outside the government. Figure 3. Among countries where the government requests comments on proposed regulations, the most widely used method is targeted outreach to specific stakeholders proportion of economies 1.5 1.5 proportion of economies 1 1 .5 .5 0 a ia D an ic a a si ri c ric EC cif As be lA 0 Af Af Pa O ib h ra ut th n e e e e ar e: & nt ra m m m m So or C m Ce ia ha co co co co N co & As Sa in in in in & & a in ic st st w h le le b- pe gh er ig Ea Lo Ea d d Su ro H id id Am Hi Eu m m e dl tin er er id pp w La M Lo U Unified website Ministry website Unified website Ministry website Targeted outreach Public meetings Targeted outreach Public meetings Email Other Email Other Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Note: The categories shown are not mutually exclusive. In some economies, for example, the government might use both unified and ministerial websites to solicit comments on proposed regulations. The figure shows data only for the 105 (of 185) economies in which the government requests comments on proposed regulations. Among low- and middle-income countries, another common method of soliciting comments is through discussions at public meetings. In close to a third of those in which the government requests comments on proposed regulations, it does so through open town hall meetings. Government agencies in high-income economies also use public meetings to solicit stakeholder input, often in tandem with online platforms. This approach is followed in Canada, Singapore and Spain, for example. In South Asia, unlike in other regions, the most preferred method for engaging stakeholders is by email. And among the countries worldwide where regulators request comments, 14 have a specialized government body tasked with soliciting and reviewing   13          comments—most of them high-income countries. Open consultations are least common in the Middle East and North Africa and in Sub-Saharan Africa. In more than two-thirds of surveyed countries where the government solicits feedback on proposed regulations, it also reports back on the results of the consultation process. In about 60 percent of these economies the government prepares one consolidated response to the comments received, while in about 30 percent it provides customized responses for different audiences. In the rest of the countries the government uses various other ways to report back on the consultation process. In Romania, for example, results are reported at public meetings, while in many other countries a synopsis is posted on the relevant agency’s website. Customized responses are more common among low-income countries, while consolidated responses are more widespread in other income groups. Consolidated responses are distributed in Belgium, Peru and Vietnam, for example. In Albania both customized and consolidated responses are prepared, in the form of an explanatory note attached to the final draft of the text to be approved by the Council of Ministers. This note provides detailed information on the consultation process with the stakeholders, civic associations and the business community. Whether consolidated or customized, reports on the results of public consultations are communicated though a variety of channels. In 18 percent of the sampled countries results are posted on a dedicated website used for all regulatory consultations, while in 10 percent they are posted on the website of the relevant agency or ministry. In another 6 percent results are printed in a federal journal or similar publication. And in 20 percent they are communicated directly to stakeholders. Not surprisingly, online platforms tend to be used in high-income economies: in 24 of the 41 high-income countries where regulators report the results of public consultations, they use the internet to do so. Governments in these economies most often use a single, dedicated website for this purpose (figure 4). In Canada, for example, departments and agencies use such a website to provide a summary of comments received along with their responses to those comments. The website of an individual agency or ministry or a unified website is rarely used in low- or lower- middle-income countries to disseminate the results of public consultations.   14          Figure 4. Governments in high-income countries frequently use online platforms to report the results of public consultations proportion of economies .8 proportion of economies .2 .4 .6 .8 1 .2 .4 .6 0 D a a an c a a ifi si i ric ric EC As 0 be c lA Af Af Pa O ib h e e e e tra ut th n m om m m ar e: & ra So en or co co co C om a ha c N C si in in in in & c Sa A & & a in w h e e ic st ig dl dl st b- Lo pe h er Ea H id id Ea ig Su ro Am m m H Eu e er er dl tin pp w id Lo La M U Unified website Ministry website Unified website Ministry website Federal journal Stakeholders Federal journal Stakeholders Other Other Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Note: The categories shown are not mutually exclusive. In some countries, for example, the government might use both unified and ministerial websites to report the results of public consultations. Sample size is 183. The figure shows data only for the 77 (of 183) economies in which the government reports the results of public consultations. Reporting the results of public consultations is required by law in 26 of the 185 countries surveyed, including 11 economies in Europe and Central Asia and 9 in the OECD high-income group. No such requirements exist in South Asia or Latin America and the Caribbean. Where results must be reported, this must happen most commonly within 15–30 days after the end of the consultation process. In Latvia the law requires the rulemaking body to publish the results within 30 days after the end of the process, on a website and, where possible, through additional public vehicles such as press releases. In Spain the rulemaking body is required to publish a consolidated consultation report within 15 days after the end of the consultation process. In practice, however, it generally takes the rulemaking body several weeks to publish the report. In 32 of the 185 countries rulemaking bodies have no legal obligation to report the results of consultation processes but still do so in practice. In Singapore, for example, regulators generally post a consolidated report on the relevant agency’s website—even though they face no statutory requirement to publish the results of public consultations. The results of a consultation are published either before or together with the final text of the legislative change. While many governments follow such practices, it is important to keep in mind that in 108 of the 185 countries sampled the government either does not request comments from the public on proposed regulations or does not report back to the public on the results of consultations. This group consists mostly of low- and lower-middle-income economies, but it also includes Argentina, Lebanon, South Africa and Turkey.   15          c. Conducting regulatory impact assessments The practice of assessing the potential impact of proposed regulatory changes on citizens, businesses and society at large is more common among higher-income economies than among lower-income ones. These assessments also vary in scope and frequency. And how they are performed, if at all, depends on legal obligations and agency capacity. In the United States, for example, under the Administrative Procedure Act and Executive Order 12866, a regulatory agency proposing regulatory changes must conduct an initial cost-benefit analysis to determine whether those changes would be economically significant. If the proposed changes meet a certain threshold, the agency must prepare an impact assessment and submit the assessment along with the underlying analysis for review by the Office of Information and Regulatory Affairs at the Office of Management and Budget. Within the European Union some member countries, including Germany, the Netherlands, Sweden and the United Kingdom, have conducted impact assessments for years, while others have only recently integrated impact assessment into their rulemaking process (De Francesco, Radaelli and Troeger 2012). And every time the European Commission proposes new legislation, it needs to evaluate the possible economic, social and environmental impacts.5 In 98 of the 185 countries surveyed for this paper, ministries and regulatory agencies do not conduct impact assessments of proposed regulations. In those where they do, the impact assessments vary in scope, reflecting most commonly the anticipated administrative costs to the government of enforcing the new regulation and the expected compliance costs for the private sector. Measures of the possible environmental impact and potential effect on market openness are also common. Survey results show that impact assessments encompass a wide range of practices and methods. Impact assessments of proposed regulations are more likely to be conducted in richer countries: they are performed in 97 percent of the high-income countries studied but only about 18 percent of the low-income ones (figure 5). In 42 of the 87 economies where the government performs impact assessments, it is required to do so by law; most of these 42 are in the OECD high- income group or Europe and Central Asia. In 30 countries, half of them in the OECD high- income group, there are specific criteria that trigger a requirement for an impact assessment. In Norway, for example, the government conducts an impact assessment if a proposed regulation is likely to have major consequences for the economy. In Japan and Malta there are specific monetary thresholds for potential economic impacts of new regulations. In the United States the policy is to carry out an impact assessment of all “economically significant” regulations. An “economically significant regulatory action” is defined as one that is likely to result in a regulation that may have an annual effect on the economy of $100 million or more or adversely                                                              5  For more information, see “Guidelines on Impact Assessment,” Better Regulation, European Commission, last updated May 19, 2015, http://ec.europa.eu/smart-regulation/guidelines/ug_chap3_en.htm.     16          affect in a material way the economy, a sector of the economy, productivity, competition, jobs, the environment, public health or safety, or state, local or tribal governments or communities.6 Figure 5. Governments in almost all OECD high-income countries conduct regulatory impact assessments 0.97 1 proportion of economies 0.77 .6 .8 0.37 .4 0.32 0.29 0.26 0.20 .2 0 D a an ia fic a a si ric ric EC As ci be lA Af Af Pa O ib h ra ut th n ar e: & nt ra So or C m e ia ha N C co & As Sa t& & a in ic st b- pe s h er Ea Ea ig Su ro Am H Eu e dl tin id La M Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Note: RIAs = regulatory impact assessments. Among the countries where impact assessments are conducted, only slightly over half have guidelines on how to conduct them. In most of these countries the guidelines are published on regulatory websites. But there are also other ways to make the guidelines public. In Hungary, for example, the guidelines are part of the Decree of the Minister of Justice and Public Administration 24/201. Another 28 percent (24) of the countries with impact assessments have developed no guidelines for conducting them. These countries fall in all income groups and regions. Examples include Armenia; Hong Kong SAR, China; and Portugal. Making the impact assessments publicly available and open for scrutiny forms part of the consultation process in many countries. In 82 percent of the countries where the government conducts impact assessments, the results are distributed online or through targeted outreach to business associations, other stakeholder groups or both. And in 65 percent the results are distributed together with the text of the proposed regulation. By providing the analysis underpinning the scope and content of the proposed regulation for comment from the general public and stakeholders, governments open their motivation and reasoning for the regulatory change to scrutiny and input.                                                              6  Section 3(f) of Executive Order 12866.    17          Notably, 51 countries in the sample have a specialized government body tasked with conducting or reviewing impact assessments of proposed regulations. These oversight bodies may be responsible for determining which regulatory reforms require an impact assessment, for example. But their most common responsibility is to provide guidance to the experts conducting the assessments. They also frequently review and monitor impact assessments conducted by ministries and inform the cabinet or legislature about their compliance with the requirements (figure 6). These specialized bodies can develop expertise within the government on conducting high-quality impact assessments and simultaneously ensure that ministries are complying with impact assessment guidelines. Figure 6. Specialized bodies supervising regulatory impact assessments perform multiple functions .6 proportion of economies .2 0 .4 Rejects drafts Reports progress Advocates reform Reviews RIAs Informs cabinet Provides guidance Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Note: The categories shown are not mutually exclusive. The figure shows data only for the 48 (of 185) economies in which the government has a specialized body conducting or reviewing regulatory impact assessments. RIA = regulatory impact assessment. V. Scoring countries on the level of citizen engagement in rulemaking To advance our analysis, we developed a composite score—the citizen engagement in rulemaking score—reflecting respondents’ answers to the core questions for each economy with a few adjustments. The six components of the score reflect whether governments publish the text of proposed regulations before their adoption, publicly request comments on proposed regulations, publicly report on the results of consultation processes, conduct impact assessments of proposed regulations, have a specialized body tasked with reviewing regulatory impact   18          assessments, and publicly distribute the results of regulatory impact assessments. These questions were chosen as best reflecting the principles of transparency, consultation and impact assessment in creating new regulations. Two of the six component indicators (conducting impact assessments of proposed regulations and having a specialized government body tasked with reviewing regulatory impact assessments) have simple binary scoring: each economy receives a score of either 1 (the highest score) or 0 (the lowest). For each of the other four component indicators the possible score ranges from 0 to 1, with the possible values including 0.2, 0.6 and 0.8. The score assigned to an economy depends on the level of transparency or inclusiveness reflected in how the government carries out the relevant action (if at all)—that is, publishing proposed regulations, requesting comments, reporting back on the results of the consultation or publishing the regulatory impact assessment. A score of 1 is awarded if the action is performed through a unified website, 0.8 if through individual ministry websites, 0.6 if through public meetings or publication in an official journal, and 0.2 if through targeted outreach to identified stakeholders; a score of 0 is assigned if the action is not performed. For each economy the highest possible score is assigned, even where the government uses a variety of different methods for carrying out the action. A lower score is awarded for targeted outreach to identified stakeholders because of the inherent potential for exclusion in this approach. The composite score is the simple sum of the six component indicator scores. Table 1 provides an overview of the scoring possibilities for the Citizen Engagement in Rulemaking indicators. Because there is no literature establishing the relative importance of transparency, consultation and impact assessment in the rulemaking process, we chose to use the common approach of assigning equal weights to all components of the citizen engagement in rulemaking score. However, the core analysis presented in this paper does not change substantially when slightly different weights are assigned to the components of the score.   19          Table 1. Scoring for the Citizen Engagement in Rulemaking indicators Indicator Description Possible scores Relative weight Publication of proposed Yes/no and manner: unified website, 0–1 (possible 1/6 regulations ministry website, public meetings or scores include targeted outreach 0.2, 0.6 and 0.8) Consultation on Yes/no and manner: unified website, 0–1 (possible 1/6 proposed regulations ministry website, public meetings or scores include targeted outreach 0.2, 0.6 and 0.8) Reporting back on Yes/no and manner: unified website, 0–1 (possible 1/6 results of consultations ministry website, public meetings or scores include targeted outreach 0.2, 0.6 and 0.8) Conducting regulatory Yes/no 0 or 1 1/6 impact assessments Specialized body to Yes/no 0 or 1 1/6 review impact assessments Publication of Yes/no and manner: unified website, 0–1 (possible 1/6 regulatory impact ministry website, public meetings or scores include assessments targeted outreach 0.2, 0.6 and 0.8) Composite score = Simple sum of the six component indicator scores   20          VI. Discussion of the results The composite score allows us to analyze data at the aggregate level, observing important variations by region and income level. Not surprisingly, OECD high-income countries and high- income countries in general, tend to perform well on the citizen engagement in rulemaking score (figure 7). The exceptions are Gulf States, with little transparency or consultation around regulatory changes. The data also reveal a strong positive relationship between the level of economic development, proxied by income per capita, and the citizen engagement in rulemaking score. The scores for the component indicators are also strongly correlated with income levels. In the scoring on publishing proposed regulations before their adoption, for example, 38 of 53 high- income countries in the sample receive the maximum score of 1, compared with only 1 of 33 low-income countries. The maximum score reflects the advanced use of unified electronic platforms. Similarly, when we examine the data on whether regulators solicit comments on proposed regulations from the general public, 22 of 53 high-income countries receive the maximum score, in contrast with only 4 of 46 lower-middle-income economies and 1 of 33 low- income ones (see appendix table A.1). Figure 7. High-income countries tend to perform well on the citizen engagement in rulemaking score 5.01 3.85 4 5 CER aggregate core 4 CER aggregate core 3.55 3 3 1.95 2 1.81 2 1.48 1.32 1.31 0.99 0.94 0.94 1 1 0 0 D a ia an c a a ifi si ri c ric EC As e e e e be c lA m m m m Af Af Pa O ib h co co co co tra ut th an ar e: & in in in in en So or C r om ia ha w h e e N C ig dl dl & As Lo c Sa & H id id & a in m m ic st st b- pe h er Ea Ea er er ig Su ro Am H pp w Eu e Lo dl U tin id La M Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. The scores for distributing regulatory impact assessments follow a similar pattern. Among 53 high-income countries, all receive the highest possible score, indicating that their government distributes regulatory impact assessments through widely accessible channels. By comparison, the maximum score is received by only 7 of 50 upper-middle-income countries, only 5 of 46 lower-middle-income countries and no low-income ones. Indeed, among 33 low-income economies, 27 receive a score of 0, while 5 get a score of 0.6 and one a score of 0.2. Overall, of   21          the 87 sampled countries in which the government conducts regulatory impact assessments, 41 are high-income countries and only 6 are low-income ones. This is not surprising, because regulatory impact assessments can require considerable institutional capacity and expertise within the government. Analysis relating the citizen engagement in rulemaking score to other measures of good governance supports earlier findings linking transparency, consultation and ex ante assessment in rulemaking with higher-quality regulation, lower corruption and stronger rule of law (figure 8; see also appendix table A.5 for detailed regression results). Comparator indicators include Transparency International’s overall score; the World Justice Project’s rule of law, effective regulatory enforcement and open government indices; and the Worldwide Governance Indicators project’s measures of voice and accountability, government effectiveness, regulatory quality and rule of law. The analysis also includes measures of regulatory efficiency and regulatory quality from the World Bank Group’s Doing Business project. The assumption for this analysis is that countries with high levels of citizen engagement in rulemaking tend to have better governance and stronger rule of law. In all cases the results are statistically significant, and in most they are significant at the 1 percent level. We run regressions with and without controlling for income per capita, to ensure that we do not capture general effects of good governance associated with already high levels of economic development. The results are statistically significant in both cases. Overall, the ordinary least squares (OLS) regression outcomes presented in figure 8 appear to validate the robustness of the citizen engagement in rulemaking score, supporting its possible relevance to desired regulatory and economic outcomes. However, a rigorous analysis needs to be performed to either confirm or reject this possibility.   22          Figure 8. The citizen engagement in rulemaking score shows a strong relationship with measures of government transparency, openness, effectiveness and rule of law 100 0.80 Transparency International score 80 0.70 WJP open government index 0.60 60 0.50 40 0.40 20 0.30 0 0 2 4 6 0 2 4 6 Citizen engagement in rulemaking score Citizen engagement in rulemaking score CPI_2014_Score Fitted values Factor3_OpenGovernment Fitted values 20.00 40.00 60.00 80.00 100.00 100.00 WGI government effectiveness rank 40.00 60.00 80.00 WGI rule of law rank 20.00 0.00 0.00 0 2 4 6 0 2 4 6 Citizen engagement in rulemaking score Citizen engagement in rulemaking score Rank_WGI_Gov_Effectiveness Fitted values Rank_WGI_Rule_of_Law Fitted values     Source: Analysis based on data from Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org; World Justice Project database; and Worldwide Governance Indicators database. Note: All the regressions control for income per capita and are significant at the 1 percent level. WJP = World Justice Project; WGI = Worldwide Governance Indicators. This preliminary analysis appears to be in line with the findings of existing literature. Civil society organizations, political parties and private sector entities with a “voice” in decision- making help to reinforce responsive and accountable states. In such states communication channels between government officials and civic organizations are well established and highly functional (Sharma 2008). And better communication techniques and stronger formal institutions enhance people’s trust in government and the rule of law (Knack and Zak 2003). Yet while our analysis suggests that economies with transparent, consultative and evidence-based rulemaking   23          also have effective government and rule of law, the reverse could also be true, of course. An alternative interpretation of the results could be that governments that are effective and follow the rule of law also actively seek to serve their citizenry—and thus engage citizens in continual efforts to create effective regulations that are easy to comply with. After looking at the relationship between the citizen engagement in rulemaking score and relevant indicators from other data sets, we explore the relationship between this score and five distinct measures of regulatory quality from the Doing Business project. We expect inclusive rulemaking practices to be strongly and positively associated with higher regulatory quality. It is assumed that in regimes in which a wide range of stakeholders have a voice in policy making, governments benefit from that feedback and therefore produce regulations that are more relevant, easy to comply with and targeted to the desired outcome. Results show that the citizen engagement in rulemaking score is strongly and positively correlated with all five of the Doing Business project’s distinct measures of regulatory quality (figure 9; see also appendix table A.6). The results remain significant with and without introducing income per capita controls. Income per capita is highly correlated only with the quality of land administration index. As in the previous analysis, we run the same regression using the log of income per capita. Taking the log of income per capita improves the size of the coefficients without influencing the strength of the coefficients of the dependent variables. (Regression results with the log of income per capita are presented in appendix table A.6.) We observe that countries that have higher citizen engagement in rulemaking scores also tend to have higher-quality business regulation as reflected in quality control practices for construction, in the monitoring of utilities, in the transparency of electricity tariffs and in systems of land dispute resolution. In addition, there is an apparent relationship between transparent, consultative, evidence-based rulemaking and a high-quality judiciary system: economies that perform well on the citizen engagement in rulemaking score also tend to have a judiciary with specialized courts, high levels of court modernization and automation, and an effective and transparent case management system—along with a best-practice insolvency framework. Again, we are observing simple correlations, without inferring any causal relationship.   24          Figure 9. The citizen engagement in rulemaking score is highly correlated with Doing Business measures of regulatory quality 15 30 Quality of land administration index Building quality control index 10 10 20 5 0 0 0 2 4 6 0 2 4 6 Citizen engagement in rulemaking score Citizen engagement in rulemaking score DwC_quality index Fitted values RP_quality_index Fitted values 15 80 Doing Business regulatory quality score Quality of judicial administration index 60 10 40 5 20 0 0 0 2 4 6 0 2 4 6 Citizen engagement in rulemaking score Citizen engagement in rulemaking score DTF_Quality_DB16 Fitted values EC_quality_index Fitted values Source: Analysis based on data from Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org; and Doing Business database, World Bank Group, http://www.doingbusiness.org. Note: All the regressions control for income per capita and are significant at the 1 percent level. The analysis would not be complete without testing the relationship between our composite score and different degrees of democracy at the national level. As defined by Thomas Franck (1999), “Democracy, as its etymology makes clear, concerns the role of the people in their governance: the right of persons in a political community to participate meaningfully in the process by which they define and implement values, priorities and policies.” Thus as the final step in our analysis we correlate the citizen engagement in rulemaking score with several measures of freedom and democracy. For this analysis we chose democracy and autocracy measures from the Polity IV   25          data set of the University of Maryland, measures from Freedom House capturing various aspects of political rights and civil liberties and the democracy classification score of the Economist. Results from OLS regressions are presented in figure 10 and appendix table A.7. We expected the results to show that inclusive regulatory practices go hand in hand with strong democratic forms of governance. Most of the relationships are significant at the 1 percent level and hold with and without controlling for income per capita. And all the signs of the coefficients of the Polity IV data set match our hypotheses. We find a strong positive relationship between the citizen engagement in rulemaking score and the strength of democratic regimes. The opposite is true for autocratic regimes. For the Freedom House data all the results are statistically significant. We also find a strong positive association between the World Justice Project’s civic participation in politics score and our measure of inclusive rulemaking (see figure 10). Figure 10. The citizen engagement in rulemaking score is strongly associated with measures of democracy and civic participation 1.00 The Economist's democracy classification score 10 WJP civic participation score 0.80 6 8 0.60 4 0.40 2 0.20 0 2 4 6 Citizen engagement in rulemaking score 0 2 4 6 Citizen engagement in rulemaking score Democracy_Index _core Fitted values 3_3_CivicParticipation Fitted values Source: Analysis based on data from Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org; the World Justice Project database and the Economist journal’s database. Note: All the regressions control for income per capita and are significant at the 1 percent level. WJP = World Justice Project. Indeed, countries with a robust, well-functioning democracy also tend to have a highly inclusive rulemaking process—and vice versa. Conversely, countries that lack a well-functioning government along with political pluralism, respect for civil liberties and freedom of expression and belief also tend to exclude the public from rulemaking processes. Researchers emphasize that citizen participation in rulemaking and transparency in governance can enhance democratic legitimacy by bridging the gap between government agencies and their constituencies.   26          Democratic values as well as overall social welfare are directly affected by the ways in which rules are designed and implemented (Coglianese, Kilmartin and Mendelson 2009). VII. Conclusion and recommendations for future research This paper presents new global data on government transparency, consultation and impact assessment practices around new regulations. The data show that inclusive rulemaking processes are widespread in the developed world but sorely lacking among developing countries. Variation exists within each region and income group. Yet aside from a handful of notable exceptions, developing countries still lag significantly behind the advanced ones when it comes to better rulemaking practices. We also find that legal requirements do not necessarily drive governments’ transparency and impact assessment practices. In the majority of countries where the government publishes proposed regulations and conducts consultations, it has a legal requirement to do so. But in a third of these economies the government does so voluntarily, with no formal obligation to take these actions. Conversely, not all governments that are legally required to publish proposed regulations and conduct consultations comply with these requirements in practice. When we compare our composite score on transparency, consultation and impact assessment in rulemaking with different outcomes measured by other relevant indicators, we find that citizen participation in the rulemaking process and stronger impact assessment practices are associated with higher-quality regulation. Broader public consultation is also linked with adherence to democratic principles of governance and stronger rule of law. Finally, we see that these better rulemaking practices are correlated with more advanced economic development. While this paper expands the data coverage of inclusive regulatory practices, especially for developing countries, further analysis is warranted on the link between levels of development, regulatory practices and different outcomes. One question to be explored is whether there is a threshold income level below which consultation or impact assessment seems to have no impact on regulatory quality or democracy. Also interesting to explore would be differences in rulemaking at the subnational level, since the data set is currently limited to national rulemaking processes. An additional question that remains open is how, and to what degree, comments by external stakeholders change the shape of the ultimate regulation. Yet another is what the practical limits are to inclusiveness. The potential trade-offs between extensive consultation and policy making efficiency could also be explored. What is clear from this study, however, is that much more work remains to be done by regulators to increase transparency and public involvement in the rulemaking process and deepen the analysis of possible impacts of new regulations, especially in developing economies. In so doing,   27          policy makers can bolster the relevance and quality of laws and regulations that have meaningful effects on people’s lives.   28          Appendix Table A.1. Scores on Citizen Engagement in Rulemaking indicators by country Publication of regulatory  results of consultations   Publication of proposed  Conducting regulatory  Citizen engagement in  proposed regulations  impact assessments   impact assessments  Specialized body to  Reporting back on  rulemaking score  Consultation on  review impact  assessments  regulations  Economy  Afghanistan  0.2  0.6  0  0  0  0  0.8  Albania  0.2  0.8  0.2  1  1  0.6  3.8  Algeria  0  0  0  0  0  0  0  Angola  0  0  0  0  0  0  0  Antigua and Barbuda  0  0  0  0  0  0  0  Argentina  0  0  0  0  0  0  0  Armenia  1  0.2  0  1  0  0.2  2.4  Australia  1  1  1  1  1  1  6  Austria  1  0.2  1  1  1  1  5.2  Azerbaijan  1  1  0  0  0  0  2  Bahamas, The  1  0.2  0  0  0  0  1.2  Bahrain  0  0  0  1  1  0  2  Bangladesh  0  0  0  0  0  0  0  Barbados  1  0.6  0  0  0  0  1.6  Belarus  1  0.2  0.2  1  1  0.2  3.6  Belgium  1  0.8  1  1  1  1  5.8  Belize  0  0  0  0  0  0  0  Benin  0.2  0.6  0  0  0  0  0.8  Bhutan  0.6  0.6  0  1  1  0.2  3.4  Bolivia  0  0  0  1  0  0.2  1.2  Bosnia and  0.8  0.6  0.2  1  0  0.8  3.4  Herzegovina  Botswana  0  0  0  0  0  0  0  Brazil  1  1  1  1  1  1  6  Brunei Darussalam  0  0  0  0  0  0  0  Bulgaria  1  1  1  1  0  1  5  Burkina Faso  0  0  0  0  0  0  0  Burundi  0  0  0  0  0  0  0  Cabo Verde  0  0  0  0  0  0  0  Cambodia  0.2  0.2  0  0  0  0  0.4  Cameroon  0.2  0  0  0  0  0  0.2  Canada  1  1  1  1  1  1  6    29          Central African  0  0  0  0  0  0  0  Republic  Chad  0  0  0  0  0  0  0  Chile  0.8  0.8  0.8  1  0  0.8  4.2  China  1  1  0  0  0  0  2  Colombia  0.8  0.8  0.6  1  0  0.8  4  Comoros  0.2  0.2  0.2  0  0  0  0.6  Congo, Dem. Rep.  0  0  0  0  0  0  0  Congo, Rep.  0  0  0  1  0  0.6  1.6  Costa Rica  0.8  0.8  0.8  0  0  0  2.4  Côte d’Ivoire  0.8  0.6  0  0  0  0  1.4  Croatia  1  0.8  0.8  1  1  1  5.6  Cyprus  1  0.2  0.2  1  1  1  4.4  Czech Republic  1  1  0  1  1  1  5  Denmark  1  1  1  1  1  1  6  Djibouti  0  0  0  0  0  0  0  Dominica  0.2  0.6  0  0  0  0  0.8  Dominican Republic  1  0  0  0  0  0  1  Ecuador  0  0  0  0  0  0  0  Egypt, Arab Rep.  0.6  0  0  0  0  0  0.6  El Salvador  0  0  0  0  0  0  0  Eritrea  0  0  0  0  0  0  0  Estonia  1  1  1  1  1  1  6  Ethiopia  0  0  0  0  0  0  0  European Union  1  1  1  1  1  1  6  Fiji  0  0  0  0  0  0  0  Finland  1  1  1  1  0  1  5  France  1  0.8  0.8  1  1  1  5.6  Gabon  0  0  0  0  0  0  0  Gambia, The  0.6  0.6  0.2  0  0  0  1.4  Georgia  1  0  0  1  0  1  3  Germany  1  0.2  0.2  1  0  0.2  2.6  Ghana  0  0  0  0  0  0  0  Greece  1  1  0.8  1  1  1  5.8  Grenada  0  0  0  0  0  0  0  Guatemala  0  0  0  1  0  0  1  Guinea  0  0  0  0  0  0  0  Guinea‐Bissau  0.6  0  0  0  0  0  0.6  Guyana  0.6  0  0  0  0  0  0.6  Haiti  0  0  0  0  0  0  0  Honduras  0  0  0  0  0  0  0    30          Hong Kong SAR, China  1  1  1  1  1  1  6  Hungary  1  1  0  1  0  1  4  Iceland  1  1  1  0  0  0  3  India  0.8  0.8  0.8  1  0  0  3.4  Indonesia  1  0.6  0  1  0  0  2.6  Iran, Islamic Rep.  0  0  0  0  0  0  0  Iraq  0  0  0  0  0  0  0  Ireland  1  0.8  0.8  1  0  1  4.6  Israel  1  1  0.8  1  1  0  4.8  Italy  0.8  0.8  0.8  1  1  0  4.4  Jamaica  1  0.6  0.2  1  0  0  2.8  Japan  1  1  0  1  0  1  4  Jordan  1  0.6  0.2  0  0  0  1.8  Kazakhstan  0.8  1  0  1  0  0.2  3  Kenya  0.6  1  0.6  1  1  0.6  4.8  Kiribati  0  0  0  0  0  0  0  Korea, Rep.  1  1  1  1  1  1  6  Kosovo  1  1  0.6  0  0  0  2.6  Kuwait  0  0  0  0  0  0  0  Kyrgyz Republic  1  0.6  0  0  0  0  1.6  Lao PDR  1  1  0.2  1  1  1  5.2  Latvia  1  0.8  0.2  1  0  1  4  Lebanon  0  0  0  1  0  0.2  1.2  Lesotho  0  0  0  0  0  0  0  Liberia  0  0  0  0  0  0  0  Libya  0  0  0  0  0  0  0  Lithuania  1  1  1  1  0  1  5  Luxembourg  1  1  1  1  0  1  5  Macedonia, FYR  1  1  1  1  1  1  6  Madagascar  0  0  0  1  1  0.2  2.2  Malawi  0  0  0  0  0  0  0  Malaysia  0.2  0.8  0.8  1  1  1  4.8  Mali  0  0  0  0  0  0  0  Malta  1  1  1  1  1  0  5  Marshall Islands  0.2  0.6  0  0  0  0  0.8  Mauritania  0  0  0  0  0  0  0  Mauritius  1  0  0  0  0  0  1  Mexico  1  1  1  1  1  1  6  Micronesia, Fed. Sts.  0  0  0  0  0  0  0  Moldova  1  0.6  0.8  1  0  1  4.4    31          Mongolia  0  0  0  0  0  0  0  Montenegro  0.8  0.8  0.8  1  1  0.8  5.2  Morocco  1  1  1  0  0  0  3  Mozambique  0.6  0.6  0.2  1  1  0.6  4  Myanmar  0.8  0.8  0  0  0  0  1.6  Namibia  0.6  0.6  0.2  0  0  0  1.4  Nepal  0  0  0  0  0  0  0  Netherlands  1  1  1  1  0  1  5  New Zealand  1  0.8  0.8  1  1  0.8  5.4  Nicaragua  0.2  0.2  0.2  1  0  0.2  1.8  Niger  0.2  0.6  0.6  0  0  0  1.4  Nigeria  0.6  0.2  0.2  1  1  0.6  3.6  Norway  1  1  1  1  0  1  5  Oman  0  0  0  1  1  0  2  Pakistan  0.8  0.8  0  0  0  0  1.6  Palau  0  0  0  0  0  0  0  Panama  0.2  0  0  1  0  0.2  1.4  Papua New Guinea  0.8  0.6  0  0  0  0  1.4  Paraguay  0  0  0  1  0  0.2  1.2  Peru  0.8  0.2  0.8  1  0  0.8  3.6  Philippines  0.8  0.8  0  0  0  0  1.6  Poland  1  0.2  1  1  1  1  5.2  Portugal  0.8  0.8  0.8  1  0  0  3.4  Qatar  0  0  0  0  0  0  0  Romania  1  0.6  0.8  1  0  0  3.4  Russian Federation  1  0  0  1  1  1  4  Rwanda  0.6  0.6  0.2  1  1  0.6  4  Samoa  0  0  0  0  0  0  0  San Marino  0.6  0  0  0  0  0  0.6  São Tomé and  0  0  0  0  0  0  0  Príncipe  Saudi Arabia  0  0  0  0  0  0  0  Senegal  0.2  0.6  0  0  0  0  0.8  Serbia  1  1  1  1  1  1  6  Seychelles  0  0  0  0  0  0  0  Sierra Leone  0.6  0.6  0  1  0  0.6  2.8  Singapore  1  1  1  1  1  0  5  Slovak Republic  1  1  1  1  1  1  6  Slovenia  1  1  0.2  1  1  0  4.2  Solomon Islands  0.8  0.6  0  0  0  0  1.4  South Africa  1  1  0  0  0  0  2    32          South Sudan  0  0  0  0  0  0  0  Spain  1  0.8  1  1  1  1  5.8  Sri Lanka  0  0  0  0  0  0  0  St. Kitts and Nevis  0  0  0  0  0  0  0  St. Lucia  0.2  0.6  0  0  0  0  0.8  St. Vincent and the  0  0  0  0  0  0  0  Grenadines  Sudan  0  0  0  0  0  0  0  Suriname  0  0  0  0  0  0  0  Swaziland  0  0  0  0  0  0  0  Sweden  0.6  0.2  0.6  1  1  0.2  3.6  Switzerland  1  1  0.6  1  1  1  5.6  Syrian Arab Republic  0  0  0  0  0  0  0  Taiwan, China  1  0.6  1  1  1  0.2  4.8  Tajikistan  0  0  0  0  0  0  0  Tanzania  0.2  0.6  0  0  0  0  0.8  Thailand  0.8  0.6  0  1  0  0.6  3  Timor‐Leste  0.6  0.6  0.2  0  0  0  1.4  Togo  0.2  0.2  0  1  0  0.6  2  Tonga  0.6  0  0  0  0  0  0.6  Trinidad and Tobago  1  0  0  0  0  0  1  Tunisia  1  1  0  1  0  0  3  Turkey  1  0  0  0  0  0  1  Uganda  0.6  0.6  0  0  0  0  1.2  Ukraine  0.8  0.8  0.8  1  1  0.8  5.2  United Arab Emirates  0.2  0  0  0  0  0  0.2  United Kingdom  1  0.6  0.6  1  1  1  5.2  United States  1  1  1  1  1  1  6  Uruguay  0  0  0  1  0  0.2  1.2  Uzbekistan  1  0  0  1  0  1  3  Vanuatu  0  0  0  0  0  0  0  Vietnam  1  1  1  1  0  1  5  West Bank and Gaza  0  0  0  0  0  0  0  Zambia  0.2  0.6  0.2  1  1  0.6  3.6  Zimbabwe  0  0  0  0  0  0  0  Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Note: All data and further details on economies are available at http://rulemaking.worldbank.org.   33          Table A.2. Average scores on Citizen Engagement in Rulemaking indicators by income group Reporting Conducting Specialized Publication of Citizen Publication of Consultation back on results regulatory body to review regulatory engagement in proposed on proposed of impact impact impact rulemaking regulations regulations consultations assessments assessments assessments score Entire sample Number of economies 185 185 185 185 185 185 185 Average score 0.51 0.41 0.27 0.46 0.26 0.30 2.22 Low income Number of economies 33 33 33 33 33 33 33 Average score 0.22 0.25 0.06 0.18 0.12 0.10 0.94 Lower middle income Number of economies 47 47 47 47 47 47 47 Average score 0.39 0.28 0.13 0.36 0.11 0.18 1.45 Upper middle income Number of economies 50 50 50 50 50 50 50 Average score 0.5 0.428 0.216 0.4 0.16 0.244 1.948 High income Number of economies 55 55 55 55 55 55 55 Average score 0.80 0.62 0.58 0.78 0.56 0.57 3.91 Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org. Table A.3. Average scores on Citizen Engagement in Rulemaking indicators by region Publication of Consultation on Reporting back Conducting Specialized body Publication of Citizen proposed proposed on results of regulatory impact to review impact regulatory impact engagement in regulations regulations consultations assessments assessments assessments rulemaking score Entire sample Number of economies 185 185 185 185 185 185 185 Average score 0.51 0.41 0.27 0.46 0.26 0.30 2.22 East Asia & Pacific Number of economies 25 25 25 25 25 25 25 Average score 0.51 0.50 0.21 0.32 0.20 0.19 1.93 Europe & Central Asia Number of economies 26 26 26 26 26 26 26 Average score 0.88 0.58 0.37 0.77 0.35 0.60 3.55 OECD high income Number of economies 32 32 32 32 32 32 32 Average score 0.97 0.84 0.80 0.97 0.69 0.78 5.04 Latin America & Caribbean Number of economies 30 30 30 30 30 30 30 Average score 0.36 0.22 0.15 0.37 0.07 0.15 1.32 Middle East & North Africa Number of economies 19 19 19 19 19 19 19 Average score 0.25 0.19 0.12 0.26 0.16 0.01 0.99 South Asia Number of economies 7 7 7 7 7 7 7 Average score 0.34 0.40 0.11 0.29 0.14 0.03 1.31 Sub-Saharan Africa Number of economies 46 46 46 46 46 46 46 Average score 0.21 0.21 0.06 0.20 0.13 0.11 0.92 Source: Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org.     34          Table A.4. Summary statistics for the main variables Standard  Variable  Observations  Mean  deviation  Min  Max  Doing Business regulatory efficiency  score   (0–100)  189  65.49842  12.13246  30.03227  92.62958  Doing Business regulatory quality score   (0–100)  189  50.09358  18.14384  11.50794  83.90873  Doing Business distance to frontier (DTF)  score for regulatory efficiency   (40–90)  189  65.49842  12.13246  30.03227  92.62958  Doing Business DTF score for regulatory  quality   (15–90)  189  50.09358  18.14384  11.50794  83.90873  Doing Business reliability of supply and  transparency of tariffs index   (0–8)  189  3.685567  3.045271  0  8  Doing Business building quality control  index (0–15)  177    9.403955    3.382246    0  15  Doing Business quality of land  administration index   (0–30)  189  14.02062  7.51593  0  28.5  Doing Business quality of judicial  processes index  (0–18)  189  8.293814  2.997194  2.5  15.5  Doing Business strength of insolvency  framework index   (0–16)  189  7.878866  4.132459  0  15  Transparency International score  (11–92)  177  44.16949  19.92014  11  92  World Justice Project (WJP) rule of law  index   (0–1)  104  0.569565  0.137721  0.353065  0.870437  WJP effective regulatory enforcement  index   (0–1)  104  0.539726  0.139348  0.334872  0.861032  WJP open government index   (0–1)  104  0.549477  0.119116  0.318025  0.813501  WJP civic participation score     .6015277    .1580295     .2126949    .9001995  (0‐1)  103  Worldwide Governance Indicators (WGI)  voice and accountability rank   (0–100)  194  48.8909  28.51429  1.421801  100  WGI government effectiveness rank   (0–100)  193  49.33436  28.80149  0.956938  100  WGI regulatory quality rank   (0–100)  193  49.55252  27.95952  0.478469  100  WGI rule of law rank   (0–100)  194  48.42674  28.51157  0.473934  100    35          WGI control of corruption rank   (0–100)  193  48.97984  28.88054  0.956938  100  Polity IV democracy score   (0–10)  159  5.987421  3.690541  0  10  Polity IV autocracy score  (0–10)  159  1.578616  2.603269  0  10  Polity IV polity score  (−10 to +10)  159  4.408805  6.041223  −10  10  Freedom House Electoral Process score  (1–12)  186  8.091398  4.114212  0  12  Freedom House Political Pluralism and  Participation score   (1–16)  186  10.45161  5.027527  0  16  Freedom House Functioning of  Government score   (1–12)  186  6.650538  3.564301  0  12  Freedom House Freedom of Expression  and Belief score   (1–16)  186  11.32258  4.26085  0  16  The Economist’s democracy classification  score   (1–10)  158  5.658101  2.149248  1.43  9.93            36          Table A.5. OLS regressions with the citizen engagement in rulemaking score and measures of rule of law, regulatory quality and corruption Doing  Doing  WJP effective  WGI  voice  WGI   Business  DTF  Business  DTF  Transparency  regulatory  WJP open  and  government  WGI   WGI  control   score for   score for   International   WJP rule of  enforcement  government  accountabilit effectiveness   regulatory  WGI  rule of  of corruption  regulatory  regulatory  score law index  index  index  y rank  rank  quality rank  law rank  rank  efficiency  quality  (11–92) (0–1) (0–1) (0–1) (0–100) (0–100) (0–100) (0–100) (0–100) (40–90) (15–90) Citizen engagement in  1.432** 0.009* 0.004 0.012** 2.772*** 3.080*** 4.024*** 2.246*** 1.11 1.488*** 4.512*** rulemaking score  (0–6) [0.571] [0.005] [0.005] [0.005] [0.994] [0.620] [0.683] [0.678] [0.800] [0.300] [0.465] LN income  per capita in  8.792*** 0.071*** 0.077*** 0.052*** 9.818*** 13.698*** 11.530*** 13.349*** 13.906*** 5.212*** 4.962*** US$ [0.774] [0.007] [0.007] [0.007] [1.469] [0.862] [0.903] [0.923] [1.085] [0.411] [0.666] Constant ‐34.565*** ‐0.072 ‐0.138** 0.064 ‐41.206*** ‐74.674*** ‐58.001*** ‐70.738*** ‐72.256*** 17.640*** ‐2.296 [5.683] [0.054] [0.054] [0.056] [10.471] [6.533] [6.805] [7.250] [8.116] [3.251] [5.072] Observations 164 97 97 97 180 180 180 180 180 180 180 R‐squared 0.618 0.699 0.697 0.613 0.426 0.737 0.683 0.653 0.595 0.659 0.658 Source:  Analysis based on data from Citizen Engagement in Rulemaking database, World Bank Group, http://rulemaking.worldbank.org; World Justice  Project database;  Worldwide  Governance  Indicators database; and Doing Business database, World Bank Group. Note:  Robust standard errors in brackets. For definitions of  abbreviations used in the  table, see  appendix  table  A.4. *p < 0.1   **p < 0.05   ***p < 0.01           37          Table A.6. OLS regressions with the citizen engagement in rulemaking score and Doing Business measures of regulatory quality Reliability of  Quality of  Strength of  supply and  Quality of land  judicial  insolvency  Building quality  transparency of  administration  administration  framework  Regulatory  control index  tariffs index  index  index  index  quality score  (0–15) (0–8) (0–30) (0–18) (0–16) (0–100) Citizen engagement in  0.574*** 0.510*** 1.452*** 0.657*** 0.996*** 4.512*** rulemaking score (0–6) [0.114] [0.094] [0.224] [0.101] [0.143] [0.465] LN income per capita in  0.625*** 1.033*** 2.267*** 0.539*** 0.433** 4.962*** US$ [0.169] [0.131] [0.292] [0.143] [0.209] [0.666] Constant 2.464* ‐6.259*** ‐8.652*** 2.276** 1.968 ‐2.296 [1.384] [0.948] [2.219] [1.061] [1.666] [5.072] Observations 180 180 180 180 180 180 R‐squared 0.297 0.573 0.564 0.412 0.36 0.658 Source:  Analysis based on data from Citizen Engagement in Rulemaking database, World Bank Group,  http://rulemaking.worldbank.org; and Doing Business database, World Bank Group, http://www.doingbusiness.org. Note:  Robust standard errors in brackets. *p < 0.1   **p < 0.05   ***p < 0.01    38          Table A.7. OLS regressions with the citizen engagement in rulemaking score and measures of democracy and civil liberties Freedom  House  Freedom  Freedom  Political   House  House  The  Freedom  Pluralism  Functioning  Freedom of  Economist's   Polity IV  House  and  of  Expression  democracy   Polity IV  autocracy  Polity IV  Electoral   Participation  Government  and Belief  classification  democracy  score  polity score  Process  score  score  score  score  score  score (0–10) (0–10) (−10  to +10) (1–12) (1–16) (1–12) (1–16) (1–10) Citizen engagement in  0.662*** ‐0.468*** 1.131*** 0.350* 0.469** 0.397*** 0.276 0.274*** rulemaking score   (0–6) [0.168] [0.152] [0.313] [0.179] [0.217] [0.132] [0.173] [0.087] LN income  per capita  0.363 0.304 0.058 0.907*** 1.180*** 1.061*** 1.060*** 0.559*** in US$ [0.250] [0.220] [0.460] [0.263] [0.313] [0.188] [0.252] [0.132] Constant 1.288 0.111 1.178 ‐0.431 ‐0.663 ‐3.305** 1.666 0.235 [1.809] [1.520] [3.249] [1.910] [2.285] [1.364] [1.852] [0.968] Observations 157 157 157 183 183 183 183 156 R‐ squared 0.239 0.105 0.171 0.206 0.239 0.37 0.214 0.351 Source:  Analysis based on data from Citizen Engagement in Rulemaking database, World Bank Group,  http://rulemaking.worldbank.org; Polity IV  dataset, University of Maryland and Freedom House  database. Note:  Robust standard errors in brackets. *p < 0.1   **p < 0.05   ***p < 0.01   39          Bibliography Adams, S., and F. Atsu. 2005. “Transparency, Regulation and Economic Performance in Africa.” Paper presented at the Transatlantic Conference on Transparency Research, University of Utrecht. Available at http://pages.stern.nyu.edu/~agavazza/Adams.pdf. Aidt, Toke S. 2009. “Corruption, Institutions, and Economic Development.” Oxford Review of Economic Policy 25 (2): 271–91. Backlund, Ann-Katrin. 2009. “Impact Assessment in the European Commission: A System with Multiple Objectives.” Environmental Science & Policy 12 (8): 1077–87. Bates, R., A. Greif, M. Humphreys and S. Singh. 2004. “Institutions and Development.” CID Working Paper 107, Center for International Development at Harvard University, Cambridge, MA. Bertolini, L. 2006. “How to Improve Regulatory Transparency: Emerging Lessons from an International Assessment.” Gridlines note 11, Public-Private Infrastructure Advisory Facility, World Bank Group, Washington, DC. Coglianese, C., H. Kilmartin and E. Mendelson. 2009. “Transparency and Public Participation in the Federal Rulemaking Process: Recommendations for the New Administration.” George Washington Law Review 77 (4): 924–72. De Francesco, F., C. Radaelli and V. Troeger. 2012. “Implementing Regulatory Innovations in Europe: The Case of Impact Assessment.” Journal of European Public Policy 19 (4): 491–511. doi:10.1080/13501763.2011.607342. Deighton-Smith, R. 2004. “Regulatory Transparency in OECD Countries: Overview, Trends and Challenges.” Australian Journal of Public Administration 63 (1): 66–73. Denhardt, J., L. Terry, E. R. Delacruz and L. Andonoska. 2009. “Barriers to Citizen Engagement in Developing Countries.” International Journal of Public Administration 32 (14): 1268– 88. Diergarten, Y., and T. Krieger. 2015. “Large-Scale Land Acquisitions, Commitment Problems and International Law.” Law and Development Review 8 (1): 217–33. Fadairo, S. A., R. Williams and E. Maggio. 2015. “Accountability, Transparency and Citizen Engagement in Government Financial Reporting.” Journal of Government Financial Management 64 (1): 40–45. Farazmand, Ali. 2012. “Sound Governance: Engaging Citizens through Collaborative Organizations.” Public Organization Review 12: 223–41. Fenton, H., and B. Anderson. 2013. “Internet Enhancement of the Role of Civil Society in Promoting the Rule of Law in Transitional States.” Journal of Open Access to Law 1 (1): 1–30. Fishkin, James S. 2008. “Consulting the Public—Thoughtfully.” In Governance Reform under Real-World Conditions: Citizens, Stakeholders, and Voice, edited by Sina Odugbemi and Thomas Jacobson. Washington, DC: World Bank.   40          Fosu, A., R. Bates and A. Hoeffler. 2006. “Institutions, Governance and Economic Development in Africa: An Overview.” AERC Supplement, Oxford Journal of African Economies 15 (S1): S1–S9. Franck, Thomas M. 1999. “Democracy, Legitimacy and the Rule of Law: Linkages.” Public Law and Legal Theory Working Paper 2, New York University School of Law, New York. Gisselquist, R. 2012. “Good Governance as a Concept, and Why This Matters for Development Policy.” UNU-WIDER Working Paper 2012/30, United Nations University World Institute for Development Economics Research, Helsinki. Gupta, Aarti. 2008. “Transparency under Scrutiny: Information Disclosure in Global Environmental Governance.” Global Environmental Politics 8 (2): 1–7. Gurin, J. 2014. “Open Governments, Open Data: A New Lever for Transparency, Citizen Engagement, and Economic Growth.” SAIS Review of International Affairs 34 (1): 71– 82. Hahn, R., and R. Litan. 2003. “Recommendations for Improving Regulatory Accountability and Transparency.” Testimony 03-2, AEI-Brookings Joint Center for Regulatory Studies, Washington, DC. Hahn, R., and R. Litan. 2004. “Counting Regulatory Benefits and Costs: Lessons for the U.S. and Europe.” Journal of International Economic Law 8 (2): 473–508. Hall, D. 2009. Administrative Law: Bureaucracy in a Democracy. 4th ed. Upper Saddle River, NJ: Prentice Hall. Heidenhof, Guenter. 2014. “Strengthening Governance and Institutions in MENA: Issues and Priorities.” MENA Knowledge and Learning Quick Notes series, no. 114, World Bank, Washington, DC. Iida, K., and J. Nielson. 2003. “Transparency in Domestic Regulation: Practices and Possibilities.” In Domestic Regulation and Service Trade Liberalization, edited by Aaditya Mattoo and Pierre Sauvé. Washington, DC: World Bank; and New York: Oxford University Press. Jalilian, H., C. Kirkpatrick and D. Parker. 2006. “The Impact of Regulation on Economic Growth in Developing Countries: A Cross-Country Analysis.” World Development 35 (1): 87–103. Kingsbury, B., N. Krisch and R. Stewart. 2005. “The Emergence of Global Administrative Law.” Law and Contemporary Problems (Duke University School of Law) 68 (3/4): 15–61. Kirkpatrick, C., and D. Parker. 2004. “Regulatory Impact Assessment and Regulatory Governance in Developing Countries.” Public Administration and Development 24: 333– 44. Kirkpatrick, C., and D. Parker. 2006. “The Impact of Regulation on Economic Growth in Developing Countries: A Cross-Country Analysis.” World Development 35 (1): 87–103. Knack, Stephen, and Paul J. Zak. 2003. “Building Trust: Public Policy, Interpersonal Trust, and Economic Development.” Supreme Court Economic Review 10: 91–107.   41          Lindstedt, Catharina, and Daniel Naurin. 2010. “Transparency Is Not Enough: Making Transparency Effective in Reducing Corruption.” International Political Science Review 31 (3): 301–22. Molster, C., A. Potts, B. McNamara, L. Youngs, S. Maxwell, H. Dawkins and P. O’Leary. 2013. “Informing Public Health Policy through Deliberative Public Engagement: Perceived Impact on Participants and Citizen-Government Relations.” Genetic Testing and Molecular Biomarkers 17 (9): 713–18. Morrall, J., III. 2001. “Regulatory Impact Analysis: Efficiency, Accountability, and Transparency.” Speech delivered in Singapore. U.S. Office of Management and Budget, Washington, DC. Nicola, Fernanda. 2015. “The Paradox of Transparency: The Politics of Regulatory Cooperation in the TTIP Negotiation.” SIDIBlog, February 4. http://www.sidiblog.org/2015/02/04/the- paradox-of-transparency-the-politics-of-regulatory-cooperation-in-the-ttip-negotiation/. OECD (Organisation for Economic Co-operation and Development). 2009. Focus on Citizens: Public Engagement for Better Policy and Services. OECD Studies on Public Engagement. Paris: OECD Publishing. ———. 2011. “Improving the Transparency of Regulations.” In Government at a Glance 2011. Paris: OECD Publishing. http://dx.doi.org/10.1787/gov_glance-2011-51-en. ———. 2015. OECD Regulatory Policy Outlook 2015. Paris: OECD Publishing. http://www.oecd.org/publications/oecd-regulatory-policy-outlook-2015-9789264238770- en.htm. OECD, Regulatory Policy Committee. 2009. Indicators of Regulatory Management Systems: 2009 Report. Paris: OECD Publishing. http://www.oecd.org/gov/regulatory- policy/44294427.pdf. Parker, D. 2002. “Economic Regulation: A Review of Issues.” Annals of Public and Cooperative Economics 73 (4): 493–519. Parker, D., and A. Alemanno. 2014. “Towards Effective Regulatory Cooperation under TTIP: A Comparative Overview of the EU and US Legislative and Regulatory Systems.” Directorate General for Trade, European Commission, Brussels. http://ec.europa.eu/trade/policy/in-focus/ttip/resources/. Radaelli, Claudio. 2003. The Open Method of Coordination: A New Governance Architecture for the European Union? Report 1. Stockholm: Swedish Institute for European Policy Studies. Schantz, F. 2013. “Fighting Corruption with Social Accountability: A Comparative Analysis of Social Accountability Mechanisms’ Potential to Reduce Corruption in Public Administration.” Public Administration and Development 33 (3): 161–74. Sen, K. 2014. “Governance and Development Outcomes in Asia.” ADB Economics Working Paper 384, Asian Development Bank, Manila. http://www.adb.org/publications/governance-and-development-outcomes-asia.   42          Shapiro, M. 1996. “Golden Anniversary: The Administrative Procedure Act of 1946, A.” Regulation, no. 3: 40–48. Available at http://scholarship.law.berkeley.edu/facpubs/379. Sharma, Bhavna. 2008. “Voice, Accountability and Civic Engagement: A Conceptual Overview.” Paper commissioned by Oslo Governance Centre, Bureau for Development Policy, United Nations Development Programme. Overseas Development Institute, London. Shim, D., and T. Eom. 2008. “E-Government and Anti-Corruption: Empirical Analysis of International Data.” International Journal of Public Administration 31 (3): 298–316. Staronovά, K. 2010. “Regulatory Impact Assessment: Formal Institutionalization and Practice.” Journal of Public Policy 30: 117–36. Stewart, R. 2005. “U.S. Administrative Law: A Model for Global Administrative Law?” Law and Contemporary Problems (Duke University School of Law) 68 (3/4): 63–108. Strauss, Peter L. 2006. “Rulemaking in the Ages of Globalization and Information: What America Can Learn from Europe, and Vice Versa.” Columbia Public Law Research Paper 06-104, Columbia Law School, New York. Torriti, Jacopo. 2007. “(Regulatory) Impact Assessments in the European Union: A Tool for Better Regulation, Less Regulation or Less Bad Regulation?” Journal of Risk Research 10 (2): 239–76. United Nations. 2012. Preventing Corruption in Public Administration: Citizen Engagement for Improved Transparency and Accountability. Report of an Expert Group Meeting, June 25–28. New York: United Nations. Vallbé, J., and N. Casellas. 2014. “What’s the Cost of e-Access to Legal Information? A Composite Indicator.” Presented at the Doing Business Research Conference “Past, Present, and Future of Business Regulation,” McDonough School of Business, Georgetown University, Washington, DC, February 20–21. Webb Yackee, J., and S. Webb Yackee. 2006. “A Bias towards Business? Assessing Interest Group Influence on the U.S. Bureaucracy.” Journal of Politics 68 (1): 128–39. World Bank Group. 2010. “Governance and Anticorruption (GAC): Experiences in the MENA Region.” MENA Knowledge and Learning Fast Brief, World Bank, Washington, DC. World Bank Group. 2015. Maximizing the World Bank Group’s Impact in the Middle East and North Africa. Washington, DC: World Bank Group. Yu, Harlan and Robinson, David G., The New Ambiguity of 'Open Government' (February 28, 2012). 59 UCLA L. Rev. Disc. 178 (2012).     43