Eitan Felner¹

Replicated from Sur - Revista Internacional de Direitos Humanos, São Paulo, n.9, p.108-154, December 2008.

Email: Email: eitanfelner@yahoo.com

ABSTRACT

In spite of positive developments in the last 60 years, the worldwide promotion and protection of economic and social rights remains a daunting challenge. While millions of people are deprived of clean water, primary health care and basic education, most states do not recognize economic and social rights as more than abstract declarations of principles. Also, governments and international organizations usually tackle these questions exclusively as development challenges, ignoring their relation to human rights obligations. In this article, there is an initial attempt to set out a methodological framework to illustrate how some simple quantitative methods can be used in concrete situations to assess whether a state is violating its human rights obligations. Quantitative tools can help us, as human rights advocates, not only to persuasively show the scope and magnitude of various forms of rights denial, but also in revealing and challenging policy failures that contribute to the perpetuation of those deprivations and inequalities.

Introduction

Taking stock on economic and social rights

Milestones are often an occasion for introspection. This year the international community is celebrating the 60th anniversary of the Universal Declaration of Human Rights. It is also 15 years since the UN World Conference on Human Rights in Vienna, in which all States affirmed the indivisibility and interdependence of human rights and called for renewed efforts to ensure recognition of economic, social and cultural rights at the national, regional and international levels.

This is therefore a timely opportunity to assess the progress made in the field of economic and social rights since then. The international community has given increasing recognition to the indivisibility and interdependence of all human rights: civil, political, economic, social and cultural. At the same time, extraordinary progress has been made by academics and human rights advocates in articulating both the content of economic, social and cultural rights (ESC rights), and the nature of the corresponding state obligations.

In spite of these positive developments, the worldwide promotion and protection of economic and social rights remains a daunting challenge. While millions of people are deprived of clean water, primary health care and basic education, most states do not recognize economic and social rights as more than abstract declarations of principles. When governments and international organizations address problems of health, education, clean water and housing, they usually tackle these exclusively as development challenges, ignoring their relation to human rights obligations. This was the case over a decade ago at the World Summit for Social Development and is still the case today, as demonstrated by the Millennium Development Goals, to which links to human rights have been made only as an after-thought.

The limited inroads human rights advocates have made in development debates is in part due to states' reluctance to accept legal accountability in areas of economic and social policy. But the failure of the human rights movement to develop effective monitoring tools in this field may also be a contributing factor.

The challenge of making economic and social rights operational

Some state obligations of immediate effect have also proven difficult to monitor. These include core obligations to ensure at least "minimum levels"of enjoyment of the essential elements of economic and social rights, such as access to essential foodstuffs, basic health care and primary education. ³ Another is the obligation to guarantee the exercise of rights without discrimination, particularly to reduce disparities resulting from the unfair distribution of goods and services.

Monitoring these various dimensions of state obligations requires a methodology not based exclusively on qualitative research; the methodology should also include quantitative tools. These tools are not typically part of human rights organizations' research toolkits, which in many cases were originally developed to monitor civil and political rights. ⁴ As Michael Ignatieff and Kate Desormeau point out,

Even where relevant data is available over time we are uncertain how to interpret it, how to use it to guide our human rights arguments. Many practitioners are unsure how to conduct their own studies; many too are uncertain where to find relevant statistics and unsure what to do with them once they have found them. ⁵

Given the difficulties of monitoring the dimensions of ESC rights obligations that require the use of quantitative tools, measuring progressive realization according to maximum available resources, both the UN Committee on Economic, Social and Cultural Rights (CESCR) and human rights NGOs have usually refrained, when monitoring specific countries, from addressing issues of ESC rights that are bound to the requirements of progressive achievement and resource constraints, ⁶ focusing instead on various immediate obligations related to ESC rights which are not dependent on resource availability. ⁷ These obligations include the duty to respect, which requires the state to refrain from interfering with people's exercise of a right; the duty to protect, which requires the state to ensure that third parties do not interfere, primarily through effective regulation and remedies, ⁸ as well as the most tangible aspects of the duty to guarantee the exercise of rights without discrimination, particularly discrimination formally enshrined in law or discriminatory practices carried out by public officials, such as doctors, teachers, etc.

For example, in recent years, international NGOs have documented violations such as denying access to health and education for minority communities, ⁹ failing to enact or enforce laws on women's property rights, ¹⁰ carrying out arbitrary forced evictions, ¹¹ or restricting humanitarian agencies' access to refugee camps to deliver food in emergencies. ¹²

While this focus has been effective in many ways, sidestepping the standards of resource availability and progressive realization - and to some extent, also the standard of minimum core obligations – ¹³ have severely constrained the ability of the human rights movement to address broader issues of public policy that have a huge impact on the realization of ESC rights. Millions of people around the world are victims of avoidable deprivations such as illiteracy, preventable diseases, malnutrition and homelessness, which are not necessarily the result of interference by the State or third parties in the exercise of their ESC rights. These avoidable deprivations cannot be attributed to violations of the duties to respect or protect human rights. Nevertheless, whether these people can enjoy their ESC rights often depends on whether they have access to adequate health care or quality education and these largely (albeit not only) depend on the availability of resources. ¹⁴

Moreover, without a monitoring methodology to address these crucial issues, advocacy efforts are severely undermined. Governments can easily claim, for instance, that the lack of progress is due to insufficient resources when, in fact, the problem is often not the availability, but rather the distribution, of resources.

Using indicators to monitor economic and social rights

All these efforts have helped lay the groundwork for using quantitative data to monitor ESC rights. In particularly, these efforts have contributed to clarifying the potential benefits of applying indicators for monitoring economic and social rights, setting out a typology for the development and selection of human rights indicators and proposing specific indicators related to specific rights.

However, despite all this progress made at the conceptual level, these various sets of proposed indicators have only rarely been used in the assessment of specific countries. ¹⁷ So far, there are more conferences and articles about human rights indicators than actual use of indicators in monitoring the compliance of a specific state on ESC rights.

What may be missing to turn indicators into an operational tool to monitor economic and social rights in specific situations is a methodology toolbox that would explain more specifically how and when to use these indicators. Much the same way as having a grocery shopping list is not sufficient to make a meal, having a list of human rights indicators is not sufficient to assess compliance. As with cooking, what is also needed is a set of recipes, or a toolbox of simple methods that explains how indicators could be used in order to assess the compliance of specific countries with regard to the multiple dimensions of rights obligations. Only after such tools are developed, will it be possible to actually apply the multiple sets of indicators that have been proposed in recent years to monitoring specific rights in specific countries.

In the remaining of this article, I will make an initial attempt to set out a methodological framework for this toolbox and to illustrate how some simple quantitative methods, both alone and combined with qualitative research, can be used in concrete situations to assess whether a state is violating its human rights obligations. The quantitative tools presented in this article are just a few examples of the Center for Economic and Social Rights' current efforts to develop a methodological toolbox to monitor economic and social rights. At this stage this toolbox is being developed for only two rights – the right to education and the right to health – both because they are prominent in many monitoring and advocacy efforts and because these are two areas of public policy related to ESC rights in which there is more data available. It should be stressed that the tools presented here reflect only the initial efforts in developing the toolbox. They are illustrations of a work in progress and should be treated as such. CESR invites critiques of the underlying assumptions, methodological tools and conclusions in order to correct or refine the tools for future use.

Talk of quantitative tools may raise some concern among many human rights advocates that what is proposed in this article is a set of complicated methods that are beyond the reach of most human rights NGOs or international monitoring mechanisms and that they turn human suffering and injustice into rarefied statistical techniques, thereby diminishing the potential of numbers as a powerful advocacy tool. But quantitative methods do not necessarily have to be complex in order to be effective monitoring and advocacy tools. To take the cooking analogy further, just as it is possible to make both sophisticated and simple food recipes, it is also possible to measure states' efforts to comply with their human rights obligations using either sophisticated tools (such as benefit incidence analysis, public expenditure tracking surveys or complex costing exercises) or simple tools.

Accordingly, this article presents some simple quantitative tools based on descriptive statistics that any human rights advocate could use without advanced technical knowledge.

Conceptual and methodological issues

Before discussing the specific tools that can be used to monitor ESC rights, it is necessary to clarify some conceptual and methodological issues related to the nature of human rights indicators and to the various purposes for which they could be used.

The differences between the various frameworks proposed to use indicators in the monitoring of economic and social rights might be partially attributed to differences in conceptual and methodological premises, but it is also related to the different end goals of each of these initiatives. In the field of economic and social rights, as in other fields, indicators and data are often used for more than one purpose and by more than one type of user (be it an organization or an individual).

For example, the quantitative tools that a UN Human Rights Treaty Body would use to monitor compliance with an international convention would probably be very different than those used by an international development agency interested in assessing human rights progress by individual countries to help them determine their aid priorities. ¹⁸ Furthermore, the use of quantitative tools by a government committed to integrating human rights principles into its public policies ¹⁹ would be quite different than that of an advocacy human rights NGO that is interested in exposing, and perhaps "naming and shaming,"a government that is unwilling to adopt policies in line with its human rights obligations.

The tools presented here are meant primarily to serve national and international NGOs as well as international monitoring bodies to monitor compliance of state obligations related to economic and social rights. Nevertheless, it is our hope that the tools will also serve other users and might be adapted for different purposes.

A focus on accountability for avoidable deprivations

Most indicators proposed by various authors to monitor ESC rights are in fact development indicators, commonly used by international agencies such as the World Bank, UNICEF or WHO to monitor and conduct research on issues such as health, education and food security. This is not only the case with 'outcome indicators' which measure the extent to which a population enjoys a specific right such as chronic malnutrition rates or illiteracy rates, but also with 'process indicators,' measure various types of efforts being undertaken by the State, as the primary duty-holder of ESC rights, in implementing its obligation, such as the proportion of births attended by health skilled personnel. ²⁰ Both of these types of indicators are the bread and butter of any analysis done by development economists, epidemiologists and other social scientists who conduct public policy research and analysis.

Although indicators to monitor ESC rights might be the same ones commonly used in the field of development, it is the purpose for which they are used that can transform indicators such as child mortality rates or pupil-teacher ratios into genuine human rights indicators. This purpose should reflect the unique contribution that a human rights perspective can bring to the development field.

It is widely recognized that one of the key contributions of a human rights perspective to the development field is its focus on accountability. ²¹ Human rights can help hold national governments – the primary duty bearer of human rights – accountable for avoidable deprivations of basic needs.

Clearly, there are numerous reasons why millions of people around the world are deprived of basic education, health care, shelter or food. Some of these reasons, such as natural disasters, humanitarian crises or scarcity of resources are often beyond the control of governments, and as such, cannot be deemed human rights violations. Nonetheless, using a human rights approach calls attention to the fact that widespread deprivations are all too often not inevitable; rather, they are frequently generated or exacerbated by the lack of political will of governments

A government's failure to prevent or rectify avoidable deprivations can take many forms. In some cases, these failures are the result of deliberate policies of government agents, such as corrupt practices that reduce the resources available for the progressive achievement of economic and social rights, or discriminatory distribution of social services resources, for example providing less to those areas where the majority of people belong to an ethnic minority group. In other cases, marginalized groups are deprived of programs and resources they need to enjoy their economic and social rights simply as the result of the willful indifference of political and economic elites. ²²

The overarching challenge is how to distinguish between deprivations that are the result of factors beyond the control of national governments, and deprivations in which government policies are a major contributing, if not causal, factor. In other words, one must distinguish between cases in which governments are unable to meet their duties and those in which governments lack the political will to do so. ²⁴

Methodological framework

Quantitative tools can play a crucial role in holding governments accountable for policies and practices which lead to avoidable deprivations, thus breaching their human rights obligations. Such tools could help assess whether high levels of deprivations or inequalities in the fields of education, health, housing, and food security are created, perpetuated or exacerbated by specific actions or omissions ²⁵ of state policy.

To be able to analyze data for monitoring economic and social rights, it is not sufficient to have only a set of indicators. Data about a sole indicator generally does not indicate much. For instance, if one never heard any statistics about maternal mortality and learned that country X has a maternal mortality ratio of 76 per 100,000 live births, one could intuitively say that it is 76 women too many who died, but would not be able to say anything else significant. It wouldn't be possible, for instance, to tell if 76 is a very high or very low number in relation to the country's development level, or whether the country has made progress in reducing maternal mortality. Therefore, the basic tools proposed here compare an indicator with various types of reference points or objective benchmarks against which it can be judged. ²⁶ For the purposes of human rights monitoring, I suggest using one of the following types of benchmarks against which to compare human rights indicators:

(1) International human rights standards. For example, the obligation of universal primary education sets a benchmark of 100% primary education completion rate. Comparing rates in the focus country with the relevant international human rights obligation can reveal shortfalls in the enjoyment of a right in the focus country.
(2) A commitment taken either by a state or by a specific government. This can include a legal commitment enshrined in a state's constitution or basic education law to spend a certain percentage of its government budget on education; the commitment assumed by a state when adopting the MDGs of reducing under-five mortality rate by two-thirds between 1990 and 2015; or a publicly-made commitment by the current president of a state to increase public housing by 20% in two years. Such comparisons would reveal the disparities of the relevant indicator in the focus country with the commitment taken by the state or the specific government. The commitment itself should also be scrutinized, as it could be flawed from a human rights perspective.
(3) A past value of an outcome indicator or a process indicator. In the case of an outcome indicator, these comparisons reveal if the state has made progress or has regressed in the level of ESC rights enjoyment. In the case of a process indicator, it reveals whether a state has made progress or has regressed in the proportion of people in the country who make use of a good or service deemed essential for enjoying a right. ]]> (4) Countries with similar levels of development as the focus country. ²⁷ These cross-country comparisons could reveal whether the levels of deprivation of the focus country are lower than expected given the country's development level. This could be related to an aspect of an ESC right (outcome indicator) or to the proportion of people who make use of some good or service deemed essential for enjoying a right (process indicator).
(5) Disaggregated national data (male/female, indigenous/non-indigenous, poor/non-poor, etc). This type of comparison could help identify disparities, and therefore possible discrimination, among population groups in the access to and enjoyment of economic and social rights.

A three-step methodology ²⁸

The proposed approach consists of three basic steps: firstly using quantitative data to identify economic and social rights deprivations and disparities of outcome, from the perspective of core obligations, progressive realization and non-discrimination; secondly analyzing the main determinants of these outcomes so as to identify the policy responses that can reasonably be expected of the state; and thirdly using quantitative data combined with qualitative information, to assess to what extent deprivations, disparities and lack of progress can be traced back to failures of government policy. ²⁹

Step #1 - Identifying deprivations and disparities in the enjoyment of economic and social rights

The first step of the proposed methodology uses outcome indicators, such as primary completion rates, maternal mortality rates or child malnutrition rates, to identify deprivations and disparities in the enjoyment of economic and social rights. The selection of relevant outcome indicators should be determined primarily based on the legal or normative standards of each right, but should also take into account data availability.

Examining outcome indicators not only provides a snapshot of the level of enjoyment of economic and social rights in a given country, but also helps evaluate whether states – the primary duty-holders of human rights – are complying with key aspects of their human rights obligations. Specifically, they can help assess whether a state is complying with its "minimum core obligations", since theyreveal the extent to which the population is deprived of the most basic elements of the right to health, education, food and other economic and social rights. International comparisons provide a useful benchmark of what has been achieved in countries with similar resources.

This step also serves to measure progressive achievement according to maximum available resources since it enables one to measure human rights progress or retrogression over time according to the level of a country's development. Furthermore, disaggregated data can reveal wide disparities in the enjoyment of economic and social rights by gender, ethnicity, socio-economic status or geographic location (e.g. urban/rural) which may be result from the discriminatory effects of government policy.

The following table provides an illustrative list of simple tools that use outcome indicators to monitor the various dimensions of state obligations pertaining to economic and social rights.

It should be stressed that evidence of deprivation or disparities in the enjoyment of ESC rights does not provide in and of itself conclusive evidence that a state has violated a right. This is because, as noted above, deprivations or disparities could be the result of factors beyond the control of a government. In some cases, a state may have made more effort to reduce deprivations or inequalities in education, health, food security than its neighbors, and yet because of circumstances beyond its control, the levels of deprivation or inequalities have worsened. ³²

Similarly, disparities in outcome indicators by gender or ethnicity are not in themselves proof of discrimination. In some cases, they might be the result of economic, historic or other factors and they might exist in spite of a government's genuine efforts to close those enduring gaps. Nevertheless, evidence of deprivation or disparities may be suggestive of specific human rights violations and can serve as a crucial first step in a more comprehensive human rights assessment.

Step #2 – Identifying main determinants of deprivations and inequalities ³³

A second step is to identify the various causes of those deprivations and inequalities in the enjoyment of economic and social rights. Understanding the nature and extent of the obstacles preventing the enjoyment of economic and social rights is necessary to assess the adequacy of policy interventions undertaken by the state to address those obstacles. While the first step is more directly related to the realization of the right from the perspective of the right-holder, this step and the following one help to assess the extent to which the state, as the primary duty-bearer, is complying with its human rights obligations.

Many factors combine to affect the level of enjoyment of economic and social rights. In the case of health, the human rights framework explicitly acknowledges that the right to health extends not only to timely and appropriate health care, but also embraces a wide range of socio-economic factors that promote conditions in which people can lead a healthy life. This extends to the underlying determinants of health, such as food and nutrition, housing, access to safe and potable water and adequate sanitation, safe and healthy working conditions, and a healthy environment. ³⁴ Similar factors affect also other rights. For instance, socio-economic and cultural factors, as well as a range of underlying determinants related to other rights, affect the enjoyment of the right to education, the right to food, and the right to adequate housing.

A vast literature on the determinants of social outcomes has been produced over the years by economists, educational specialists, health experts and other social scientists. It is beyond the scope of this article to review this literature, but it is worth pointing out some basic distinctions found in the literature about the different types of factors that affect key areas of education, health or food security, leading to high levels of school drop-out rates, of maternal or child mortality, and of chronic malnutrition.

i. Supply-side and demand-side factors: ³⁵ Health and education determinants can be broadly classified as supply or demand factors. Supply-side factors are associated with the provision of health and educational services. They are directly related to government policies and interventions, and include government-provided inputs like clinics and schools, medical and school supplies and equipment, teachers and physicians, etc. Indicators of supply typically measure one of the elements defined by the, defined as the essential features or elements of a right, namely availability of goods and services, physical accessibility of services and facilities (e.g. distance to schools and clinics) and affordability (economic accessibility) of services, adaptability or cultural acceptability of services (e.g. gender sensitivity and cultural adequacy of the services) and quality of services. ³⁶

At the same time, provision of goods and services are not sufficient to ensure the use of essential inputs necessary for the enjoyment of ESC rights. Services or goods may be available, but they may not be used often because of the demand-side factors that determine the utilization (or use) of health and educational services. Although their influence on health and educational outputs is more indirect than that of supply-side factors, demand factors are nonetheless critical elements of what may be "a long and complex causal pathway"leading to a given outcome. ³⁷

The effects of low income, however, go beyond limited ability to pay for healthcare and education. For example, it both increases exposure and reduces resistance to disease: poor people cannot afford clean water and sanitation, or non-polluting heating and cooking fuels, thereby increasing levels of exposure to unsanitary conditions. They are also likely to be malnourished, thereby reducing their resistance to sickness. ³⁸ At the same time, income poverty is typically associated with malnutrition and poor housing conditions, both of which generally inhibit the ability of children to learn.

Cultural beliefs or barriers can sometimes be strong determinants of who demands and uses health and educational services. This is particularly notable with culturally-defined roles between males and females. For instance, girls' engagement in household chores and care economy (i.e. taking care of siblings, sick and the elder) adversely affect girls' school participation. Similarly, concerns such as perceived unsafe school environment, son preference, lack of female teachers that can serve as role models, etc, are all factors that influence household decisions to send their girls to school. Cultural barriers may also prevent women from using health care services because health care providers are men, or because women have limited mobility. Similarly, son preference often implies that households do not invest in healthcare for girls and women.

ii. Direct and indirect determinants: Not all factors affecting these social outcomes (causing or exacerbating levels of deprivation or inequality in the rights enjoyment) do so directly. In fact, various authors talk about a long sequence of interlinked causes leading to a given output or outcome. Several conceptual frameworks have been developed to understand the relation between various determinants. Depending on the proximity of the effect they have on the outcome, we could distinguish between direct determinants (those determinants that directly affect a social outcome) and indirect determinants (those determinants that affect the outcome through their effect on a direct determinant or another indirect determinant). ³⁹

The following diagram illustrates these various types of determinants on one desired social outcome. if acquiring literacy and numeracy is a desired outcome of primary education – which certainly constitutes a key aspect of the enjoyment of the right to education – one could say, based on the literature on the determinants of primary education outcomes, that the direct determinants of this desired outcome, affecting each student differently depending on her or his circumstances, are school participation, education quality and student's learning capacities.

In turn, each one of these immediate determinants is influenced by a set of indirect determinants. School participation depends not only on the availability and physical accessibility of students to school facilities and teachers, but also to demand factors, such as the ability of poor families to pay the direct and indirect cost of schooling, the cultural beliefs of households (such as bias of parents against investing in girls' learning). Education quality depends on a whole set of factors, including the quality of school facilities, ⁴⁰ the availability of textbooks, ⁴¹ instruction time and teacher's performance. Students' learning capacities depend, among other factors, on their health and nutrition status ⁴² and student's specific characteristics, such as innate intelligence.

Each of these indirect determinants or factors is in turn influenced by other indirect factors. Thus, instruction time is affected by class size, as well as by teacher's absenteeism, ⁴³ and teacher performance is affected by their education and training, their salary levels, their experience, and their knowledge of the subject matter.

Because of these and other complexities, a complex analysis of the causes of deprivation or disparities in any given country (why, for instance, country X has such a high incidence of children not completing primary school and the relative impact of each factor, or the extent to which different underlying factors can explain the wide disparities between various groups of the population in maternal mortality rates in country Y) generally entails a rather sophisticated use of technical knowledge and tools (such as complex statistical analysis) that most actors within the human rights movement working on ESC rights – whether advocates in national or international NGOs, members of a Treaty Body or Special Rapporteurs – are unequipped to carry out. ⁴⁵

But fortunately, for the purposes of human rights advocacy, there is no need to establish firm causal links between an outcome and a whole web of determinants, nor is there necessarily a need to estimate very accurately the exact impact of specific factors on certain outcomes. Advocates can instead rely largely on the myriad studies conducted by social scientists that have already identified the main reasons for existing deprivation and inequalities in areas such as nutrition, maternal mortality and schooling.

Step #3 - Assessing the adequacy of policy efforts to address these determinants

This step in the proposed methodology identifies and exposes cases in which specific actions or omissions of state policy contribute to the creation, perpetuation or exacerbation of high levels of deprivations or inequalities in the enjoyment of economic and social rights, as identified in Step #1. The tools proposed in this step could help identify cases in which the government had the capacity to deal with some of the determinants of specific deprivations and inequalities identified in Step #2, but failed to do so. Thus, this step is crucial for building the case that there has been a violation of economic and social rights.

The proposed tools focus on the main determinants of deprivations and inequalities: (A) supply-side factors and (B) demand-side factors. They also assess the state's commitment to providing the adequate and equitable resources that are often needed to address these factors (C).

A. Identify policy failures in providing essential goods and services (supply-side factors)

The adequacy of government goods and services affecting health and educational outcomes can be assessed with reference to the essential features of a right that, as mentioned above, the CESCR has defined for several ESC rights, namely availability, accessibility, quality and acceptability.

The following is a list of illustrative quantitative tools that could be used for this purpose.

a. Measuring availability of services

With some of these goods and services, determining whether they are available "in sufficient quantity within a state"might be relatively easy, since "in sufficient quantity"would mean that person or household has them. That is the case, for instance, with services such as adequate sanitation facilities and potable water. But with many others services, such as the number of hospital beds per 1,000 people or the proportion of births attended by skilled health personnel, simply knowing the total number or the percentage of those services per X inhabitants may not be sufficient to assess whether they are "available in sufficient quantity within a state". Two simple tools might be helpful for this purpose:

Internationally accepted benchmarks: One simple tool to use, when available, is an objective benchmark related to specific education or health services. This is typically based on empirical evidence about the effectiveness of the benchmark on a desired education or health outcome. Examples of these benchmarks include:

a) The "Education For All Fast Track Initiative": a global partnership launched by the World Bank to help low-income countries meet the education MDGs  has an indicative benchmark of one trained teacher for every 40 primary school-age children and another of between 850 and 1000 annual instructional hours for pupil. ⁴⁶
b) The guidelines developed by WHO, UNICEF and UNFPA to monitor the availability and use of obstetric services consider that for every 500,000 people, there should be at least four basic emergency care facilities and at least one comprehensive emergency facility. ⁴⁷
c) Joint Learning Initiative, an enterprise engaging more than 100 global health leaders in landscaping human resources for health suggest, based on empirical evidence, that a density of 2.5 workers per 1,000 may be considered a threshold of worker density necessary to attain adequate coverage of some essential health interventions and core MDG-related health services. These interventions and services can include 80 percent measles immunization coverage, and 80 percent births attended by skilled professionals. ⁴⁸
Cross-country comparisons: Comparing the levels of goods and services in the focus country with those of other countries in the same region. For instance, if the focus country has a much lower proportion of immunization rates, fewer hospital beds per 1,000 people, lower proportion of people with access to an improved water source, lower percentage of textbooks per pupil, or higher pupil-teacher ratio than most of the countries in the region, it would suggest that these levels are insufficient given its level of development, and that the focus country has failed to ensure the availability of these essential services in sufficient quantity. Similar to the cross-country comparisons of outcome indicators made in Step #1, cross-country comparisons over time can also useful for assessing whether the progress the focus country made has been bigger or smaller than that of other countries in same region. ⁴⁹

b. Measuring accessibility of services

Quantitative tools can be used to assess inequalities in the accessibility of various sectors of a population to essential services needed for the enjoyment of economic and social rights.

c. Measuring quality of services

Quantitative indicators could also be helpful for measuring the quality of services provided. For instance, data about conditions of health clinics or school facilities could reveal that a country has a high proportion of health clinics or school facilities in poor conditions (e.g. with leaking roofs, without proper sanitation or access to potable water, etc). Reviewing standardized tests for teachers, one could learn about some key aspects of teacher qualifications, a primary determinant of the quality of education. Similarly, one could review assessments of health professionals.

Disparities in the quality of the services provided can also be identified using quantitative tools. Although there might not always be data available explicitly showing that vulnerable or marginalized sections of the population receive poorer quality services than other segments of the population, it is often possible to reach this conclusion by comparing disaggregated data by region or municipality about the quality of an essential service (e.g. quality of teachers or health professionals, conditions of school facilities or clinics, etc.) with population data about the same regions or municipalities disaggregated by ethnic groups or poverty levels. This could show, for instance, that the conditions of health clinics in the areas mostly populated by an ethnic minority or by poor people are worse than those enjoyed by the ethnic majority group or the non-poor.

B. Identify policy failures in tackling obstacles in the utilization of goods and services essential for the enjoyment of economic and social rights (demand-side factors)

As discussed above, the reasons for avoidable deprivations and for inequalities in the enjoyment of ESC rights are often also related to demand factors, such as the cost of schooling and health care. Therefore, monitoring of state policy efforts must go beyond monitoring the adequacy of the supply factors to analyze the extent to which a state has adequate policies and programs addressing the demand factors possibly preventing people from using the good and services necessary for enjoying economic and social rights.

Addressing demand-factor problems can be undertaken by adopting various types of policy interventions or programs, often implemented by different agencies of a government. For instance, when the costs of education and health prevent poor people from utilizing essential education and health services, the state could address this problem through a type of direct policy intervention (e.g. subsidizing the costs of education for the poor through scholarships, or providing school meals as a means to tackle child malnutrition) or through an indirect policy intervention (e.g. adopting macroeconomic policies aimed at reducing poverty).

a. Direct policy interventions:

Direct policy interventions to tackle demand-side obstacles to the enjoyment of economic and social rights are specifically aimed at removing a particular demand-side obstacle. This type of interventions are usually carried out through focused programs by the government agency that has overall responsibility for the relevant sector (i.e. the Ministry of Education to tackle a demand-side obstacle to the right to education or the Ministry of Health to tackle a demand-side obstacle to the right to health).

Following are some initial suggestions of quantitative tools that can be helpful to assess whether the manner in which the focus country has implemented such programs has been adequate in key aspects such as coverage, funding and distribution of benefits.

Identifying underfunded programs: An international comparison can show whether the focus country is spending sufficient resources in a program aimed at addressing a demand-side obstacle. This is done by a double comparison of the resources a country devotes to a specific program with those spent on similar programs in other comparable countries of the same region, related to levels of the relevant deprivation in these countries that these programs are supposed to address. ⁵³

Measuring whether program benefits are unfairly distributed: Analyzing distribution of the benefits of a program aimed at boosting demand by group (e.g. indigenous/non-indigenous, poor/non-poor) or location (e.g. provinces or municipalities) and contrasting them with levels of deprivation that program is supposed to address across the same groups or locations, can help identify unfair distribution patterns that benefit people who do not need these programs the most. ⁵⁴

b . Indirect policy interventions

Indirect policy interventions are aimed at changing the socio-economic or cultural factors that gave rise to the demand-side factor to begin with. Unlike direct policy interventions that are typically very focused on a specific program carried out by the government agency that has overall responsibility for the relevant sector, indirect policy interventions, which are meant to address broader socio-economic or cultural factors, often require a whole set of programs carried out by a whole set of government agencies. For instance, a comprehensive strategy for poverty reduction requires a multi-sectored approach in order to undertake a whole set of macroeconomic, structural and social policies and programs.

Determining which indirect policy interventions to examine when monitoring state's efforts to comply with their economic and social rights obligations largely depends on which factors are preventing people from realizing their rights in a specific circumstance

Imagine for instance that during Step #1 of the proposed methodological framework, one finds that in the focus country, a large proportion of girls are dropping out of school, while most boys complete primary school. If in Step #2, one finds that customs and social norms may be influencing parents' decisions not to send girls to school, then in Step #3, one should see whether the government has made efforts to counteract these entrenched social norms that have proven to be useful in other circumstances. This could include legislative reforms such as marriage rights and inheritance, ⁵⁵ or public awareness campaigns about the benefits of girls' education. But in Step #2, one may find that the primary reason that many parents are not sending their girls to school is not due to cultural or social norms, but rather due to economic reasons. For example, in that country, educated boys can expect to receive more future income than equally educated girls, and poor households without the means to send all their children to school, thus choose to send boys rather than girls. In such a case, during this step, one should assess whether governments have made specific efforts to change labor market circumstances, so that it does not discriminate against women, and so that opportunities and advantages faced by all children at given levels of education and achievement are broadly equal. ⁵⁶

C.Monitoring resource allocation

 The appropriate measures which a state should take as part of its policy efforts include legislative, administrative and financial measures. ⁵⁷ A key area of policy effort success is the degree to which sufficient resources are allocated to social sectors, such as the educational or health system, and whether this allocation is distributed in line with need.

An in-depth budget analysis is optimal for this purpose. Some pioneer NGOs have made important inroads in this regard, integrating rigorous budget analysis into a human rights framework. ⁵⁸ But many human rights activists may not have the technical skills, time or resources required to undertake complex budget analysis. It is nevertheless possible to adopt simple quantitative tools helpful in assessing the adequacy and distribution equity of resources devoted to the realization of economic and social rights.

• a government devotes insufficient resources to an area related to a specific right, such as education, health, food security, etc;
• a government appears not to raise sufficient revenues to be able to adequately fund the competing needs the state has.
• Within a sector related to ESC rights, a government allocates disproportionately little resources to those budgetary items that should be a priority, in that they could have more impact on ensuring minimum essential levels of rights enjoyment in areas related to core elements of the right to health, education etc (e.g. disproportionate spending on tertiary versus primary education, or on metropolitan hospitals as opposed to rural primary health care services

The right to education could be used to explain the usefulness of this set of ratios.

1. Public expenditure ratio – Government share of GDP

This ratio determines the size of a government's budget in relation to the size of its economy (using GDP as a proxy). It indicates the "size of the cake"of resources a government has at its disposal to undertake all its functions. Since taxation is generally a major funding source for public expenditure, this ratio often depends largely on investing in taxation levels Although possibilities for raising taxes may partially depend on state capabilities, ⁶¹ they also depend in varying degrees on state policy decisions.

If this ratio is too high, this might cause problems for economic growth, which in turn could jeopardize the sustainability of economic and social rights realization. ⁶²

If this ratio is too low, it would make the state too weak and unable to adequately provide resources for the many competing and often essential functions of a state. A persistently low ratio can reflect a state structural problem – for instance, state capture by an economic elite resisting any substantial tax increases or strengthening of the state – ⁶³ that could seriously impair the state's ability to realize its economic and social rights obligations.

2. Education expenditure ratio – Education share of GDP

A low education expenditure ratio would mean that resources may be insufficient for the educational system as a whole to effectively address the various obstacles, both supply and demand factors, that may be inhibiting children's access to quality education. Moreover, when this ratio is very low, it could seriously undermine any state effort or program to improve the availability, affordability or quality of the educational system, and could severely diminish the effectiveness of any program adopted to address the demand-factors related to school desertion.

3. Education allocation ratio – Education share of government spending

This ratio reflects the relative priority given to education among competing budgetary needs.

The extent to which a low education allocation ratio is problematic from a human rights perspective depends on the circumstances. The level of enjoyment of a specific right is crucial. A state that has fulfilled its minimum core obligations regarding the right to education (meaning that most of the population is literate and practically all children enjoy access to primary education) might be justified in reducing its education spending to reallocate it to another social sector in which there might still be a significant proportion of people deprived of essential levels of health care or shelter, for example. Even if these other sectors are not worse off than the education sector, it could still be legitimate for a state to invest relatively more on housing than on education, or more on education than health. According to international law, national sovereignty implies that governments have a large margin of discretion in selecting the appropriate measures necessary for realizing economic, social and cultural rights. This of course includes spending priorities. ⁶⁴

But if there is a high level of illiteracy or yawning disparities in the primary completion rates of boys and girls in the state, a low education allocation ratio would not be justified. It would also be necessary to search for any type of extravagant spending that squanders state resources on unnecessary areas. ⁶⁵

4. Primary education priority ratio– Primary education share of education spending

This ratio reflects priorities within the educational system. Interpreting low levels of this ratio depends once again on the circumstances. In countries where a significant proportion of the population is illiterate or many children are deprived of the most basic forms of education, a low primary education priority ratio could be interpreted as a violation of a state's minimum core obligations regarding the right to education. As Philip Alston points out, in a country with very limited resources the maxim that "poverty is a denial of human rights"would be often valid in legal terms if the government "has failed to take possible steps to improve the situation and instead has opted to devote scarce resources to other objectives that do not address directly the realization of basic rights". ⁶⁶ This is precisely what is happening in many poor countries, where the most impoverished people lack primary health care and basic education, but the state allocates most of its social spending on the non-poor.

This regressive pattern of spending may also be considered a covert form of discrimination, where, for example, investments "disproportionately favour expensive curative health services which are often accessible only to a small, privileged fraction of the population, rather than primary and preventive health care benefiting a far larger part of the population". ⁶⁷ On the other hand, countries that have already achieved high standards of primary education may be well justified in prioritizing higher education levels.

5. Primary education expenditure ratio – Primary education share of GDP

Choosing which ratio or combination or ratios to use in the monitoring process depends on a set of factors:

• The focus of the monitoring: Is it the whole gamut of economic and social rights, only one right, or one specific aspect of a right (such as primary education or maternal mortality)?
• The scope and purpose of the monitoring exercise: Is it in-depth research on a specific right, a shadow report, or is it carried out by a Treaty Body?
• The type of obligation being monitored: Minimum core obligations, the duty of progressive realization according to available resources, or the obligation to ensure no discrimination in the enjoyment of rights?
• The availability of data.

i. How to Use the Ratios

There is no universal prescription for using each of these ratios, and they depend largely on the circumstances. But there is a basic method for determining if ratio levels in a given country are relative high or low.

Once again, this approach compares the ratio level with a reference point or objective benchmark against which it can be judged. Specifically, the insufficiency of key budget items for the realization of economic and social rights can often be identified with simple tools, by comparing them with:

(a) State commitment, such as the constitution, national plans, or political agreements. For instance, in its 1996 Guatemala Peace Agreements, the government committed itself "to step up public spending on education as a proportion of gross domestic product by at least 50 per cent over its 1995 level". ⁶⁸
(b) The level of the same ratio of other countries in the same region. ⁶⁹
(c) A suggested benchmark based on empirical evidence. For instance, when originally suggesting these ratios as a means to analyze public spending from a human development perspective, UNDP provided certain benchmarks or guidelines about what the levels of these three ratios should be, namely: 25% for the public expenditure ratio, 40% for the social allocation ratio, and 50% for the social priority ratio, ⁷⁰ leading to a human expenditure ratio of 5%. ⁷¹ Similarly, the WHO has set a global minimum target of 5 percent of Gross National Product (GNP) for health expenditure. ⁷²

IV. Challenges and limitations of proposed methodology

The proposed quantitative tools are subject to a number of important challenges and limitations which need to be recognized and addressed if these tools are to be useful for monitoring a wide variety of countries.

The first challenge is that these simple tools work best in extreme cases, where the outcome deprivations and disparities are much bigger than those in neighboring countries, while the resources allocated to the health and education sectors are much lower. These tools may be less useful in their conclusions about countries not doing exceptionally badly. For such middle-ranking countries, simple tools may still be helpful in flagging possible concerns which arise when development statistics are analyzed in light of international human rights standards, but not for providing conclusive evidence of a country's compliance with these obligations. ⁷³ In order to reach the more nuanced judgments required in such cases, more sophisticated tools are needed. Tools commonly used in the development field to measure equality-related issues (such as benefit incidence analysis used to evaluate equity of public expenditure) ⁷⁴ can be particularly relevant for countries performing reasonable well at the aggregate level, but still suffering from serious inequalities in the enjoyment of ESC rights among various groups in its population.

The second challenge of the proposed methodology is that, as with any quantitative tools, its applicability hinges on data availability, which varies significantly by country. This problem is particularly acute for disaggregated data by gender, ethnicity, socio-economic status and geography, such as rural and urban areas. Scarcity of data is obviously a problem not only for this particular methodological framework, but for almost any monitoring effort. This is why human rights Treaty Bodies frequently call upon State Parties to produce more data, without which, any monitoring exercise is severely weakened.

Although there is a serious problem of data availability to make a proper assessment of a government's compliance with its ESC rights obligations in many countries, the human rights movement has not yet made use of all already available relevant data. An example the reports on ESC rights on specific countries that typically do not use and analyze household surveys, which usually contain a wealth of relevant data for human rights analysis.

V. Potential impact of quantitative tools for economic and social rights advocacy

Combining the strengths of traditional human rights advocacy methodologies with those of a socio-economic analysis used by economists and other social scientists could contribute to transforming the ability of the human rights movement to hold governments accountable for violations of economic and social rights.

Once tested and refined, a framework methodology for using quantitative tools, along the lines suggested above, could be potentially used more extensively by a whole range of actors within the human rights movement. For example, national and international NGOs could adopt it for monitoring and advocacy on a range of issues; monitoring treaty bodies and Special Rapporteurs could use it to promote more substantive dialogue with countries that claim not to have enough resources to address an issue; ⁷⁵ and public interest legal advocates could make use of more data in national and regional courts to enforce economic and social rights.

One of the strengths of this multidisciplinary approach to monitoring economic and social rights, is its versatility, which enables it to be further developed and adapted to different types of issues of various levels of complexity. The next challenge would be to set out tools for a human rights analysis of additional relevant indicators relevant to other ESC rights (such as the right to food, the right to housing or the right to decent work), adding to those for which the methodology toolbox was initially developed (the right to health, the right to education, etc). Then it would be useful to explore how this monitoring toolbox can be used to monitor ESC rights violations in developed countries, helping to critically address complex issues such as the health system in the United States, or the effects of social policies of countries in the European Union on the enjoyment of economic and social rights of the Roma people or the immigrant population from a human rights perspective.

Those with expertise in assessing the human rights impact of international economic relations could further develop such methodologies to address the impact of external actors, such as international financial institutions and industrialized nations in the global North, on the realization of ESC rights in developing countries. Topics may include agricultural subsidies, foreign debt or the effects of intellectual property laws on access to medicine. Combining rigorous economic research with human rights analysis, this multi-disciplinary approach would be useful to explore the human rights implications of trade agreements, to analyze the impact on worker's rights of unregulated financial flows in a globalized economy, and to explore how structural adjustment programs have led to drastic cuts in social spending, impeding the ability of the state to provide basic needs such as health care and education.

To gradually being able to analyze such complex issues with rigour – critical for any effective advocacy – will required a concerted effort from people from various disciplines. No one discipline has the expertise or holistic perspective required to implement this approach alone. It requires interdisciplinary collaboration, to which there is often little more than a rhetorical commitment in the area of ESC rights advocacy. But the potential of theses efforts for being able to show the value-added of a 'rights-based approach' to development issues could be immense.

VI. Conclusions

Quantitative tools are not a panacea for monitoring economic and social rights. When people are not treated by doctors because they belong to an ethnic minority, women are not informed of their reproductive rights or a whole village is forcibly evicted without any due process, the traditional monitoring methods that have served us so well in the human rights movement - of fact-finding investigations based on testimony gathering and legal research – may be more effective building a case of a violation than analyzing outcome and process indicators.

But quantitative tools are indispensable to assess the impact of broad public policies on the realization of ESC rights. When used strategically – and combined with qualitative research –quantitative tools can be particularly crucial to make governments accountable for the failure to prevent or rectify avoidable deprivations and inequalities in the enjoyment of economic and social rights. They can help us as human rights advocates not only to persuasively show the scope and magnitude of various forms of rights denial, but also in revealing and challenging policy failures that contribute to the perpetuation of those deprivations and inequalities.

Equipped with this type of tools, we can expand the range of issues that we can address as human rights advocates, and the areas of government policy that we can submit to human rights scrutiny and accountability. In particular, quantitative tools are crucial for monitoring the impact of public policies related to resource allocation and distribution on the enjoyment and realization of economic and social rights.

At the same, by interpreting the data obtained by these methods through a human rights lens that focuses on accountability, we furnish new meaning to these methods. They become powerful tools to expose multiple manifestations of social injustice. Thus, by exposing arbitrary cutbacks in social services or discriminatory policies depriving wide sectors of the population access to basic goods, this methodology can help identify, expose and challenge problems related to poverty that are usually perceived as irredeemably structural and therefore unsolvable –to causes that can be assigned to the actions (or inactions) of state agencies.

2. Joining the measurement revolution

In 2005, Michael Ignatieff and Kate Desormeau noted that a measurement revolution has been underway in the fields of development and governance. By measurement revolution, they meant the exponential diffusion and rising influence of standardized and quantifiable measures of performance in international public policy. Yet, they noted that as this quantitative revolution has spread— increasingly measuring all aspects of human wellbeing, changing the way the way international organizations monitor governments' behavior, and the way governments assess each other and target their aid and development policies—the human rights movement has stood aside. ⁷⁶

The pitiful failure of many governments to make significant strides in eradicating abysmal levels of inequality and deprivation, demands renewed efforts to demonstrate when and how these phenomena can be traced back to specific actions or omissions of state policy, and how they can be categorized as violations of internationally recognized human rights obligations.

Sixty years on from the Universal Declaration, it is time we joined the revolution and opened new fronts of struggle in the battle against economic and social injustice.

Appendix I. Illustrations of the methodological framework

By bringing to bear a range of quantitative and qualitative tools of socio-economic analysis to the assessment of compliance with human rights obligations, the approach adopted in this project seeks to operationalize the human rights framework so as to increase its usefulness as an instrument for enhancing public policy accountability and design. ⁷⁸

1. Identifying and exposing high deprivations and inequalities in outcome indicators

Guatemala has some of the worst education outcomes in Latin America. This becomes apparent when using some of the tools described in the previous section.

i. Measuring deprivation levels according to levels of development with cross-country comparisons

The following graph compares the Education for All Development Index, a composite indicator developed by UNESCO to capture the status of education in a given country. ⁷⁹

This comparison reveals not only that Guatemala has one of the highest levels of educational deprivations in the region, but that these deprivations are also significantly higher than Bolivia, Honduras or Paraguay, countries with lower levels of economic development. This suggests –it is not possible to reach a conclusion from only this fact – that Guatemala may be violating its obligation to the progressive realization of the right to education according to maximum available resources.

Disaggregated data makes it possible to identify inequalities in the enjoyment of economic and social rights among various groups in a population. For instance, the 2004 Guatemalan National Survey of Employment and Income found that children from the wealthiest 20% of society are more than twice as likely to finish primary school as the poorest 20% of children and that only 42% of rural children are likely to finish primary school, almost half the rate of urban children. ⁸⁰

The next step is to evaluate if the inequality levels in one country are similar, better or worse than the inequality levels in other neighboring countries. The following graph shows that unlike most countries in Latin America, where a smaller proportion of boys than girls finish primary, Guatemala is one of the few countries in the region where fewer girls than boys finish primary school. Moreover, as the graph indicates, the disadvantage of girls is more marked for Guatemala than for any other country in the region.

Click to enlarge

2. Identifying Inadequacy in Policy Efforts in the Guatemalan Education System

Guatemala's poor educational outcomes are largely the result of persistent state neglect. Consecutive governments have failed to remove the main obstacles that keep hundreds of thousands of children from obtaining a primary education, let alone good quality primary education. This failure is a violation of their right to education.

Presenting the full evidence for this conclusion is beyond the scope of this article ⁸¹ . Nevertheless, simple quantitative methods, either alone or combined with qualitative research, can be used to assess the adequacy of Guatemalan policy efforts in addressing some of the main obstacles preventing so many children from enjoying their basic right to primary education. It should be stressed that each tool alone is not sufficient to reach a general conclusion, but their combination provides a compelling picture of the inadequate, insufficient and inequitable nature of consecutive governments' response to those obstacles.

i. Chronic Underfunding of Aid Programs for Poor Children

The next graph shows how much money per student Guatemala devotes to its existing school meals program (a program with the stated goals of reducing child malnutrition), ⁸² compared with similar programs in other countries in the region. These figures are then contrasted with the magnitude of the problems that the programs purportedly attempt to overcome. The comparisons suggest that Guatemala's financial commitment to this program is altogether incommensurate with the enormity of the deprivations.

Click to enlarge

ii.Measuring whether programs benefits are unfairly distributed

The following graph shows that the allocation of resources of Guatemala's "Scholarships for Girls", established to reduce the staggering repetition and desertion rates of first grade girls, has often been skewed. Some of the municipalities with a relatively low number of girls dropping out of school after first grade in 2005 received a large number of "Scholarships for girls"the following year. Other municipalities, with a much higher levels of girl deserters after first grade, received fewer scholarships the following year.

Click to enlarge

iii. Identifying poor quality of education

The first national systematic evaluation of primary teachers in Guatemala, carried out in 2004, revealed some key aspect of their qualifications: the average teacher performance in Spanish reading was low (58 out of 100) and very low in math (26 out of 100). These dismal results suggest that many teachers in Guatemala may not only be incapable of properly teaching these subjects, but that many teachers also do not have the basic reading skills necessary to fully benefit from government investments in service training or professionalization. ⁸³

iv. Revealing inequalities in the quality of education

Comparing data from various data sets can reveal important information about violations of economic and social rights. The following graph shows that comparing results of the Guatemalan teacher evaluation by department ⁸⁴ with the incidence of poverty and concentration of indigenous peoples in each department reveals that the most disadvantaged children are being taught by the least qualified teachers. The three departments in which teachers had the lowest reading test scores are the three departments with the highest incidence of poverty. They are also among those departments with the largest concentration of indigenous people.

This disparity contributes to the inequality of opportunity for Guatemalan children. Quality education is largely unavailable to poor and indigenous children, both groups who generally live in rural areas, as there is little opportunity for being taught by the most experienced teachers.

Combining these data on the disparities in teachers' experience with cross-country comparative qualitative information suggests that urban-rural disparities are the result of Guatemala's policy decisions. Other countries in the region, such as El Salvador, Honduras and Nicaragua, have introduced salary incentives to encourage qualified teachers to work in rural or disadvantaged areas. ⁸⁶ At the time of writing, Guatemala had yet to adopt any system of incentives that could secure the most capable teachers for rural areas.

v. Identifying insufficiency of expenditure on education and health

The following ccomparison of the level of government spending on education and health in Guatemala with those of other countries in Latin America, reveals that Guatemala has among the lowest levels of health and education spending relative to GDP in Latin America and the Caribbean.

BIBLIOGRAPHY:

ALSTON, P. Ships Passing in the Night: The Current State of the Human Rights and Development Debate Seen Through the Lens of the Millennium Development Goals. Human Rights Quarterly, The Johns Hopkins University Press, v. 27, n.3,2005.

ALTO COMISSARIADO DAS NAÇÕES UNIDAS PARA DIREITOS HUMANOS. Report on indicators for promoting and monitoring the implementation of human rights , Documento das Nações Unidas, HRI/MC/2008/3, junho de 2008. Disponível em: <http://www2.ohchr.org/english/bodies/icm-mc/docs/HRI.MC.2008.3EN.pdf>. Último acesso em: 11 de out. de 2008.

ANISTIA INTERNACIONAL. Human Rights for Human Dignity: A primer on economic, social and cultural rights,2005.

ANISTIA INTERNACIONAL. Democratic People's Republic of Korea: starved of rights- human rights and the food crisis in the democratic people's republic of Korea, 2004.

ANISTIA INTERNACIONAL. Myanmar: The Rohingya Minority – Fundamental Rights Denied, 2004.

ANISTIA INTERNACIONAL. Serbia and Montenegro (Kosovo/a) "Prisoners in our own homes": Amnesty International's concerns for the human rights of minorities in Kosovo/Kosova, 2003.

ANISTIA INTERNACIONAL. Angola: mass forced evictions in Luanda – a call for a human rights-based housing policy, 2003.

Anderson, E . Using quantitative methods to monitor government obligations in terms of the rights to health and education. Artigo a pedido do Centro de Direitos Econômicos e Sociais, no prelo.

Banco Mundial. Guidelines for assessment and endorsement of the primary education component of an education sector plan, 2005. Disponível em: <http://www1.worldbank.org/education/efafti/documents/assessmentguidelines.pdf>. Último acesso: 1 o de nov. de 2008.

BANCO MUNDIAL . World Development Report, 1993.

BENAVOT, A. A Global Study of Intended Instructional Time and Official School Curricula, 1980-2000. Artigo contextual a pedido do Departamento Internacional de Educação para o relatório da UNESCO – intitulado "EFA Global Monitoring Report (2005): The Quality Imperative", 2004.

Birdsall, N.; Levine, R. & Ibrahim, A. Toward universal primary education: investments, incentives and institutions. Task Force on Education and Gender Equality, Projeto do Milênio das Nações Unidas, 2005.

Boissiere, M . Determinants of Primary Education Outcomes in Developing Countries – Artigo contextual para a Avaliação do Apoio do Banco Mundial à Ensino primário, Banco Mundial, 2004.

BRAVEMAN, P. Monitoring Equity in Health and Healthcare: A Conceptual Framework. Journal of Health, Population and Nutrition, Calverton/EUA, v. 3, p. 181-192, set. de 2003.

Centre on Housing and Rights and Evictions (COHRE). Program on monitoring, preventing and documenting forced evictions, desde 1994 (em arquivo do autor).

Centro DE direitos econômicos e sociais (CESR, sigla em inglês ) & Instituto Latinoamericano para Estúdios Fiscales (ICEFI). Rights or privileges? Health and Education in Guatemala: time to decide , no prelo.

Centro de direitos econômicos e sociais (CESR). Visualizing Rights. Country Fact sheet series .

CHAPMAN, A. The status of efforts to Monitor Economic, Social and Cultural rights. In: Hertel, S. & Minkler, L. (eds.). Economic Rights: Conceptual, Measurement, and Policy Issues. Cambridge University Press, 2007.

CHAPMAN, A. A "Violations Approach"for Monitoring the International Covenant on Economic, Social and Cultural Rights. Human Rights Quarterly, The Johns Hopkins University Press,v. 18, 1996.

COMISSÃO INTERAMERICANA PARA DIREITOS HUMANOS. Guidelines For Preparation Of Progress Indicators in The Area Of Economic, Social And Cultural Rights, OEA/Ser.L/V/II.132, 2008.

COMISSÃO NACIONAL DO QUÊNIA SOBRE DIREITOS HUMANOS. Living Large: Counting the Cost of Official Extravagance in Kenya , 2005.

Comissão Presidencial para a Paz dO GOVerno dA Guatemala E PARA A UnidadE RevolucionÁria Nacional Guatemalteca. Acuerdo sobre Aspectos Socioeconómicos y Situación Agraria , 6 de maio de 1996.

Commission of Jurists the Faculty of Law of the University of Limburg and the Urban Morgan Institute for Human Rights University of Cincinnati . The Maastricht Guidelines on Violations of Economic, Social and Cultural Rights. Publicado pelas Nações Unidas, 1997.

COMItê DAS NAÇÕES UNIDAS PARA DIREITOS ECONÔMICOS, SOCIAIS E CULTURAIS. General Comment 14 (sobre o direito ao mais elevado nível possível de saúde), 11 de ago. de 2000.

COMItê DAS NAÇÕES UNIDAS PARA DIREITOS ECONÔMICOS, SOCIAIS E CULTURAIS. General Comment 13 (sobre o direito à educação), 8 de dez. de 1999.

COMITÊ DAS NAÇÕES UNIDAS PARA DIRETOS ECONÔMICOS, SOCIAIS E CULTURAIS. General Comment 12 (sobre o direito a uma alimentação adequada), 1999.

COMItê DAS NAÇÕES UNIDAS PARA DIREITOS ECONÔMICOS, SOCIAIS E CULTURAIS. General Comment 3 , quinta sessão, 1990.

DREZE, J. Democracy and the right to food. In: Alston, P. y Robinson, M. (eds.). Human Rights and Development, Oxford University Press, 2005.

DI GROPELLO, E. Barriers to Better Quality Education in Central America. Banco Mundial, n. 64 (brevemente), Washington, mar. de 2005.

HINES, A. A collaborative human rights measurement regime. Artigo para discussão apresentado na conferência "Measuring Progress, Assessing Impact". Cambridge: Harvard University, maio de 2005.

Human Rights Internship Program & Asian Forum for Human Rights and DevelopmenT. Circle of rights - economic, social and cultural rights activism: a training resource, 2000. Disponível em: <http://www.iie.org/Website/WPreview.cfm?CWID=677&WID=189>. Último acesso em: nov. de 2008.

Human Rights Watch . A Dose of Reality: Women's Rights in the Fight against HIV/AIDS, 2005.

Human Rights Watch. Demolished: forced evictions and the tenants' rights movement in China, 2004.

Human Rights Watch. Not Eligible: the politicization of food in Zimbabwe, 2003.

HUNT, P. Report of the Special Rapporteur on the right of everyone to the enjoyment of the highest attainable standard of physical and mental health to the Commission on Human Rights, Documento das Nações Unidas, E/CN.4/2006/48, 2006.

Hunt, P. Interim report to the General Assembly of the Special Rapporteur on the right of everyone to enjoy the highest attainable standard of physical and mental health, Documento das Nações Unidas, A/58/427, out. de 2003.

Ignatieff, M. & Desormeau, K. Human Rights and the Measurement Revolution. Artigo para discussão apresentado na conferencia "Measuring Progress, Assessing Impact", Cambridge: Harvard University, maio de 2005.

INSTITUTO LATINOAMERICANO PARA ESTÚDIOS FISCALES. Mas y Mejor Educación en Guatemala: (2008-2021): ¿Cuanto nos Cuesta?, Guatemala, 2007.

INSTITUTO NACIONAL DE ESTADISTICA DE GUATEMALA. Encuesta Nacional de Empleos e Ingresos (ENEI), 2004.

JOINT LEARNING INITIATIVE. Human Resources for Health: Overcoming the Crisis. Boston, Harvard University Global Equity Initiative, 2004.

MAKKONEN, T. Multiple, Compound and Intersectional Discrimination: Bringing the Experiences of the Most Marginalized to the Fore. Relatório de pesquisa elaborado para o Ministério de Assuntos Exteriores da Finlândia. Åbo Akademi Institute for Human Rights Research Reports 11, 2002. Disponível em: <www.abo.fi/instut/imr/norfa/timo.pdf>. Último acesso em 1 o de nov. de 2008.

Malhotra, R. & Fasel, N. Quantitative Human Rights Indicators - A survey of major initiatives. Artigo apresentado no seminário ocorrido em Turku, Finlândia, 2005.

MOORE, M. (com Jennifer Leavy e Howard White). How governance affects poverty?. In: Houtzager, P. P. & Moore, M. (eds.). Changing Paths. International Development and the New Politics of Inclusion, 2003.

Mosley, H. & Chen, L . An Analytical Framework for the Study of Child Survival in Developing Countries. Population and Development Review, Nova York: Population Council, v. 10, 1984.

NAÇÕES UNIDAS. Pacto Internacional sobre Direitos Econômicos, Sociais e Culturais , 16 de dez. de 1966.

NAÇÕES UNIDAS. Convenção Internacional sobre os Direitos da Criança, 25 de nov. de 1989.

NUTTAL, D. The functions and limitations of international educational indicators. International Journal of Educational Research, v. 14, 1990.

ORGANIZAÇÃO MUNDIAL DA SAÚDE (OMS). National level monitoring of the achievement of universal access to reproductive health: conceptual and practical considerations and related indicators, 2008. Disponível em: <http://www.who.int/reproductivehealth/publications/universalaccess/national_level_monitoring.pdf>. Último acesso em: 11 de out. de 2008.

OMS. World Health Report 2005.

OMS, UNICEF e UNFPA. Methodological Issues in Measuring Maternal Mortality. Guidelines for Monitoring the Availability and Use of Obstetric Services, 1997. Disponível em: <http://www.who.int/reproductive-health/publications/unicef/monitoring_obstetric_services.pdf>. Último acesso em: 1 o de nov. de 2008.

PROGRAMA DAS NAÇÕES UNIDAS PARA O DESENVOLVIMENTO (PNUD). Human Development Report , 1996.

PNUD. Human Development Report, 1991.

Quintana, E. Measuring inequity and discrimination in health and education: a human rights perspective. Artigo a pedido do Centro de Direitos Econômicos e Sociais, no prelo.

RASO, G. et al. Disparities in parasitic infections, perceived ill health and access to health care among poorer and less poor schoolchildren in rural Côte d'Ivoire. Tropical Medicine and International Health, v. 10, n. 1, p. 42-57, jan. de 2005.

Riedel, E . IBSA (Indicadores, Estabelecimento de Metas, Análise das Metas e Avaliação, sigla em inglês). Disponível em:<http://ibsa.uni-mannheim.de/html/ibsa.html>. Último acesso em: 17 de dez. de 2008.

Rubenstein , L. Economic, Social, and Cultural Rights: A Response to Kenneth Roth. Human Rights Quarterly , The Johns Hopkins University Press,v. 26, 2004.

RUBIO, F. & SALANIC, V. Diagnóstico De Habilidades de Lectura y Matemática de Docentes de Primer y Tercer Grado en Escuelas  Públicas de Guatemala. Guatemala: USAID, 2005.

SEN, A. Human Rights and Human development. In: UNDP. Human Development Report 2000.

ROBINSON, M. What rights can add to good development practice. In: Alston, P. e Robinson, M. (eds.). Human rights and development. Oxford University Press, 2005.

SEPULVEDA, M. The Nature of the obligations under the International Covenant on Economic, Social and Cultural Rights.Intersentia, 2003.

STEWART, F. Planning to meet basic need. Londres: Macmillan, 1985.

TOMAŠEVSKI, K. Report of the Special Rpporteur on the right to education to the Commission on Human Rights, Documento das Nações Unidas, E/CN.4/2002/60, 2002.

UNESCO. Education for All Development Index (EDI). Disponível em: <http://portal.unesco.org/education/en/ev.phpURL_ID=43352&URL_DO=DO_TOPIC&URL_SECTION=201.html>. Último acesso em: 11 de out. de 2008.

UNESCO. Education for All Global Monitoring Report 2003/4: Gender and Education for All – The leap to Equality, 2003/2004.

VICTORIA, C.G.; WAGSTAFF, A.; SCHELLENBER, j.; GWATKIN, D.; CLAESON, M. & HABICHT, J.P. Applying an equity lens to child health and mortality: more of the same is not enough. The Lancet, Londres, v. 362, n. 9379, 19 de julho de 2003.

White , H. Books, Buildings, and Learning Outcomes: An Impact Evaluation of World Bank Support To Basic Education in Ghana. OED World Bank, 2004.

NOTES

1. I would like to thank my colleagues at the Center for Economic and Social Rights for their valuable feedback on earlier versions of this article, and, in particular Shira Stanton for the language editing and the graphs, Maria Jose Parada for her editorial suggestions and Ignacio Saiz for countless helpful conversations and for his invaluable editorial input. This article does not necessarily reflect the views of the Center for Economic and Social Rights.

2. UNITED NATIONS. International Covenant on Economic, Social and Cultural Rights, 16 Dec. 1966, article 2; UNITED NATIONS. Convention on the Rights of the Child, 25 Nov.1989, article 4.

3. United nations Committee on Economic, Social and Cultural Rights. General Comment 3, Fifth session, 1990.

5. Ignatieff, M. & Desormeau, K.Human Rights and the Measurement Revolution. Working paper presented at the conference "Measuring Progress, Assessing Impact", Cambridge: Harvard University, May 2005.

6. According to Audrey Chapman, the UN Committee on Economic, Social and Cultural Rights "rarely uses 'progressive realization' as a standard in reviewing states parties' reports". CHAPMAN, A. The status of efforts to Monitor Economic, Social and Cultural rights. In: Hertel, S. & Minkler, L. (eds.). Economic Rights: Conceptual, Measurement, and Policy Issues. Cambridge University Press, 2007, p.145.

7. This approach was coined several years ago by Audrey Chapman as a "violations approach"for monitoring economic, social and cultural rights (see CHAPMAN, A. A 'Violations Approach' for Monitoring the International Covenant on Economic, Social and Cultural Rights. Human Rights Quarterly, The Johns Hopkins University Press,v. 18, 1996).

8. In addition to these two types of obligations, states are also bound to fulfill economic and social rights. This third type of State obligation, which includes promoting rights, facilitating access to rights, and providing for those unable to provide for themselves, requires active intervention on the part of the State and is subject to progressive realization according to the maximum of available resources.

9. See Amnesty International. Serbia and Montenegro (Kosovo/a) "Prisoners in our own homes": Amnesty International's concerns for the human rights of minorities in Kosovo/Kosova, 2003, and Idem .Myanmar: The Rohingya Minority – Fundamental Rights Denied, 2004.

10. Human Rights Watch. A Dose of Reality: Women's Rights in the Fight against HIV/AIDS, 2005.

11. See Amnesty International.Angola: mass forced evictions in Luanda – a call for a human rights-based housing policy, 2003; Human Rights Watch.Demolished: forced evictions and the tenants' rights movement in China, 2004 and generally COHRE – Centre on Housing and Rights and Evictions. Program on monitoring, preventing and documenting forced evictions (on file with author).

12. Human Rights Watch.Not Eligible:The politicization of food in Zimbabwe, 2003; Amnesty International.Democratic People's Republic of Korea: starved of rights- human rights and the food crisis in the democratic people's republic of Korea, 2004.

13. Although this is an immediate obligation, it has not been used that frequently by NGOs when monitoring specific rights or countries. May be this is partly due to the lack of conceptual clarity about this standard (see Chapman, 2007, op.cit.) and the ambivalence of the human rights movement about using this standard (see e.g. International Human Rights Internship Program (Ihrip) and the Asian Forum for Human Rights and Development (FORUM-ASIA) and Circle of Rights, Economic, Social and Cultural Rights Activism: A Training Resource, 2000) but may be also related to the fact that assessing whether a state may have failed to prioritize minimum core obligations requires using quantitative tools.

15. For a review of the literature on the subject, see Malhotra & Fasel.Quantitative Human Rights Indicators - A survey of major initiatives. Paper presented at a seminar in Turku, Finland, 2005.

16. See, for instance, Office of the United Nations High Commissioner for Human Rights. Report on indicators for promoting and monitoring the implementation of human rights, UN Document HRI/MC/2008/3, June 2008. Available at: <http://www2.ohchr.org/english/bodies/icm-mc/docs/HRI.MC.2008.3EN.pdf>. Last accessed on: 11 Oct. 2008. TOMAŠEVSKI, K. Report of the Special Rapporteur on the right to education to the Commission on Human Rights, UN Document E/CN.4/2002/60, 2002. HUNT, P. Report of the Special Rapporteur on the right of everyone to the enjoyment of the highest attainable standard of physical and mental health to the Commission on Human Rights, UN Document, E/CN.4/2006/48, 2006. INTER-AMERICAN COMMISSION FOR HUMAN RIGHTS, Guidelines For Preparation Of Progress Indicators in The Area Of Economic, Social And Cultural Rights, OEA/Ser.L/V/II.132, 2008.

17. See for example the country case studies in WORLD HEALTH ORGANIZATION. National level monitoring of the achievement of universal access to reproductive health: conceptual and practical considerations and related indicators, 2008. Available on: <http://www.who.int/reproductivehealth/publications/universalaccess/national_level_monitoring.pdf>. Last accessed on: 11 Oct. 2008.

18. For instance, this has been a major motivation for the Canadian International Development Agency (CIDA) to become increasingly involved in initiatives related to human rights measurement.

19. For this purpose, such government might want to undertake a costing exercise to assess the cost of additional steps that it could take to raise the status of realization in ESC rights and calculate what would be the indirect effects of raising the revenue required to take these additional step. For a proposal on this direction, see Anderson, E. Using quantitative methods to monitor government obligations in terms of the rights to health and education. Paper commissioned by the Center for Economic and Social Rights, forthcoming.

20. These are two of three types of human rights indicators proposed originally by Paul Hunt, while serving as Special Rapporteur on the right to health and then further developed by the Office of the High Commissioner for Human Rights as a framework for the UN Treaty Bodies to monitor compliance with the corresponding International Treaties (Interim report to the General Assembly of the Special Rapporteur on the right of everyone to enjoy the highest attainable standard of physical and mental health: Hunt, P.Interim report to the General Assembly of the Special Rapporteur on the right of everyone to enjoy the highest attainable standard of physical and mental health, UN A/58/427, Oct. 2003 and United Nations High Commissioner for Human Rights.Report on indicators for promoting and monitoring the implementation of human rights, UN Document HRI/MC/2008/3, June 2008. Available at: <http://www2.ohchr.org/english/bodies/icm-mc/docs/HRI.MC.2008.3EN.pdf>. Last accessed on: 11 Oct. 2008.

21. SEN, A. Human Rights and Human development. In: UNDP. Human Development Report 2000. ROBINSON, M. What Rights can Add to Good Development Practice. In: Alston, P. & Robinson M. (eds.). Human Rights and Development. Oxford University Press, 2005.

22. As Len Rubenstein writes, "Ministries, for example, are more likely to focus on urban centers than on rural areas and are likely to ignore vulnerable populations because of their weakness as a political constituency; and a bureaucrat charged with implementing one program only rarely will see the task as to fulfill everyone's rights,"( Rubenstein, L. Economic, Social, and Cultural Rights: A Response to Kenneth Roth. Human Rights Quarterly, The Johns Hopkins University Press,v. 26, 2004).

23. AMNESTY INTERNATIONAL. Human Rights for Human Dignity: A primer on economic, social and cultural rights,2005.

25. The "Maastricht Guidelines on Violations of Economic, Social and Cultural Rights"state: "Violations of economic, social, cultural rights can also occur through the omission or failure of States to take necessary measures stemming from legal obligations,"( Maastricht Guidelines, 1997).

26. This idea is taken from Desmond l. Nuttall, who writes that "To be an indicator, an educational statistic must also have a reference point against which it can be judged,"(NUTTAL, D. The functions and limitations of international educational indicators. International Journal of Educational Research, v. 14, 1990).

27. When making such comparisons, one may want to control for other factors that could have an impact on the social outcome independent of GDP. For instance, when studying the effect of governance on poverty, Mick Moore controlled for population density, figuring that a country with a higher population density can more efficiently provide services than a larger country with small population density MOORE, M. (with Jennifer Leavy and Howard White). How governance affects poverty?. In: Houtzager, P. P. & Moore, M. (eds.). Changing Paths. International Development and the New Politics of Inclusion, Ann Arbor: University of Michigan Press, v. 1, 300 p., 2004 . In another study, Frances Stewart controlled for whether or not a country was heavily dependent on oil extraction for its economic well-being STEWART, F. Planning to meet basic need. London: Macmillan, 1985.To avoid controlling for a whole set of possible relevant factors (such as weather/climate reasons, conflict spillovers, population density and cultural beliefs) which would require making the quantitative tools proposed here more complex (because of the use multiple regressions), it is instead suggested here to only use comparisons across countries of the same geographic region, a standard practice used as a simple alternative to controlling for these potentially relevant factors.

28. For a set of examples illustrating how the following tools in assessing compliance with human rights obligations can be used in a concrete situation see the Appendix of this article in the web-based version, based on an in-depth research project on Guatemala that the Center for Economic and Social Rights is currently undertaking together with the Central American Institute for Fiscal Studies: www.surjournal.org.

29. NGOs may sometimes want to add an optional fourth step that explores whether those policy failures are related to political, economic or other types of interests (e.g. political clientelism, corruption, state capture by economic elites, etc). This step may be crucial for showing that the inadequacy of policy efforts are often not just a matter of lack of effectiveness in government policies and programs, but related to lack of political will. CESR is currently working on fleshing out what this fourth step would entail.

30. For instance, Jean Dreze points out that in India, if the child undernourishment figures continue to decline at the sluggish rate of one percentage point per year, it will take another forty years before India achieves nutrition levels similar to those of China today,"(DREZE, J. Democracy and the Right to Food. In: ALSTON & ROBINSON, op. cit.).

31. Compounded or intersecting forms of inequality are those situations in which people belong to several disadvantaged groups at the same time. As a result, they suffer aggravated forms of inequality and/or discrimination. For an analysis of the various types of compounded discriminations and their relevance for human rights, see MAKKONEN, T. Multiple, Compound and Intersectional Discrimination: Bringing the Experiences of the Most Marginalized to the Fore. A research report produced for the Ministry for Foreign Affairs of Finland. Åbo Akademi Institute for Human Rights Research Reports 11, 2002. Available at: <www.abo.fi/instut/imr/norfa/timo.pdf>. Last acessed on: 1st Nov. 2008.

32. The case of the right to health in Botswana is instructive to show the inadequacy of using only levels of deprivations (measured by outcome indicators) as the sole yardstick of a state's compliance with its human rights obligations. Since the HIV/AIDS epidemic reached Botswana, life expectancy in the country has plummeted, and its rank in the Human Development Index has dropped significantly as a result. Looking at these outcomes alone, one might conclude that the government of Botswana has neglected its human rights obligations. In fact, Botswana has been widely applauded for its response to the HIV/AIDS crisis, but has nonetheless been unable to prevent the disease from having a major impact on health outcomes in the country (HINES, A. A collaborative human rights measurement regime. Working paper presented at the conference 'Measuring Progress, Assessing Impact'. Cambridge: Harvard University, May 2005.

33. Those monitoring efforts that, given time constrains or lack of capacity, don't entail extensive research, might actually skip this step and move straight from step #1 to step #3. But even if they do so, the identification of determinants would be implicit in the monitoring exercise, since it wouldn't be possible to determine the adequacy of policy efforts (the focus of step #3) without presuming what are the obstacles (i.e. the determinants) that those policy efforts are supposed to tackle.

35. This section is taken from Quintana, E.Measuring inequity and discrimination in health and education: a human rights perspective. Paper commissioned by the Center for Economic and Social Rights, forthcoming.

36. UN Committee on Economic, Social and Cultural Rights. General Comment 13 (the right to education). 8 Dec.1999, par. 6 and Idem, General Comment 14, par. 12.

37. BRAVEMAN, P. Monitoring Equity in Health and Healthcare: A Conceptual Framework. Journal of Health, Population and Nutrition, Calverton/USA, v. 3, p. 181-192, Sept. 2003.

38. VICTORIA, C.G.; WAGSTAFF, A.; SCHELLENBER, j.; GWATKIN, D.; CLAESON, M. & HABICHT, J.P. Applying an equity lens to child health and mortality: more of the same is not enough. The Lancet, London, v. 362, n. 9379, 19 July 2003.

39. This is a simplified version of the models for understanding of determinants found in the literature. For an example of a more sophisticated model, regarding determinants of child mortality, see Mosley, H. & Chen, L. An Analytical Framework for the Study of Child Survival in Developing Countries. Population and Development Review, New York: Population Council, v. 10, 1984.

40. For example, schools in Ghana would often lose days of instruction due to leaking roofs ( White, H. Books, Buildings, and Learning Outcomes: An Impact Evaluation of World Bank Support To Basic Education in Ghana. OED World Bank, 2004).

41. According to a review of studies on primary educational outcomes, the lack of textbooks in many developing countries stands out as an input variable that consistently has an effect on poor academic performance of students ( Boissiere, M. Determinants of Primary Education Outcomes in Developing Countries - Background Paper for the Evaluation of the World Bank's Support to Primary Education World Bank 2004).

42. "It has been documented that illness of various sorts, for example, malaria in tropical countries, can cause absenteeism, as well as reduced energy levels in class. Lack of nutrition at home can lead to poor performance, even if attendance is regular. In addition, there are the various physical and mental disabilities that occur in all societies,"(Ibid).

43. "A review of studies for developing countries shows that there is a large difference between official and the actual instructional time in the classroom. Although there is much variation by context, the overall reduction in time on task is fairly large, perhaps as much as 30-50% is his rough guess. The reasons for this can vary, but teacher absenteeism is one major factor,"(Ibid, referring to BENAVOT, A. A Global Study of Intended Instructional Time and Official School Curricula, 1980-2000'. Background paper commissioned by the International Bureau of Education for the UNESCO- "EFA Global Monitoring Report (2005): The Quality Imperative", 2004.

45. Econometric studies using multiple regressions indicate, for instance, how much the differences in child mortality rates among various countries can be explained by higher government health spending, how much by higher female literacy rates, and how much the changes in child mortality rates are due to levels of income inequality in each of those countries.

46. FTI SECRETARIAT. Guidelines for assessment and endorsement of the primary education component of an education sector plan, 2005. Available at: <http://www1.worldbank.org/education/efafti/documents/assessmentguidelines.pdf>. Last accessed on: 1st November 2008.

47. WHO, UNICEF and UNFPA. Methodological Issues in Measuring Maternal Mortality. Guidelines for Monitoring the Availability and Use of Obstetric Services, 1997, ch. 2. Available at <http://www.who.int/reproductive-health/publications/unicef/monitoring_obstetric_services.pdf>. Last accessed on: 1st November 2008.

48. JOINT LEARNING INITIATIVE. Human Resources for Health: Overcoming the Crisis. Boston, Harvard University Global Equity Initiative, 2004.

49. For instance, the Center for Economic and Social Rights has produced short reports ("fact sheets") on countries appearing before the UN Treaty Bodies, showing that, for instance, while India had a much higher income growth than its neighbors in South Asia, its reduction in the child mortality rate during the same period was one of the lowest in this sub-region or that the proportion of urban Kenyans with access to an improved water source has been declining since 1990, in contrast to many of Kenya's neighbors that have made progress during the same period. See Center for Economic and Social Rights. Fact Sheet # 1 (India), figures 4and 5 and Idem, Fact Sheet # 4 (Kenya), figure 15.

50. RASO, G. et al. Disparities in parasitic infections, perceived ill health and access to health care among poorer and less poor schoolchildren in rural Côte d'Ivoire. Tropical Medicine and International Health, v. 10, n. 1, p. 42-57, Jan. 2005.

51. Fact Sheet #1 (India), figure 7.

52. Birdsall, N.; Levine, R. & Ibrahim, A.Toward universal primary education: investments, incentives and institutions. Task Force on Education and Gender Equality, UN Millennium Project 2005.

53. An example of this technique is shown below, with regards to the resources devoted by Guatemala to its school meals program.

55. In many societies, patrilineal principles of inheritance, where family property is transmitted through men, and patriarchal structures of authority, where most resources are under the control of the senior male, women are denied access to resources of their own and their ability to provide for themselves is restricted. In such societies, women tend to be regarded as economic dependents. The opportunity costs of sending girls to school is smaller than sending boys, since they cannot be expected to produce independent income in the future. In such circumstances, parents may prefer sending only the boys to school. (UNESCO- Education for All Global Monitoring Report 2003/4: Gender and Education for All – The leap to Equality, 2003/2004).

56. Ibid.

57. CESCR, General Comment 3.

58. See footnote 2, above, for examples of such organizations.

59. The difference between the expenditure ratios proposed by UNDP and those proposed here is that the UNDP's focus consolidates all types of social services into one single ratio, aggregating together different social service expenditures such as health, the education system, and the water and sanitation system. To be useful for the human rights framework, these ratios should be analyzed separately for each sector (i.e. health, nutrition, housing, etc.). This has two advantages for human rights purposes. First, expenditure analysis can monitor state compliance of a single right (e.g. the right to education or the right to health). This is not possible if all social services are analyzed in one category. Second, data on budget expenditure related to the right to education and the right to health is usually easily available, while data on social sectors (including other services such as water supplies and housing) is often not easily available. This makes it much more difficult to practically apply these ratios. This is one possible reason why the UNDP framework has not been used as much as one would expect. UNDP. Human Development Report, 1991 and Idem, Human Development Report, 1996.

60. UNDP, 1991.

61. As UNDP points out: "The possibilities for raising tax revenue will obviously vary among countries, depending, among other thing, on the structure of the economy, on the stage of development and on the country in institutional capacity". UNDP, 1991.

62. The relation between promoting ESC rights and promoting economic growth is a complex one, worthy of a separate analysis beyond the scope of this article.

63. See for instance, Center for Economical and Social Rights (CESR) and Instituto Latinoamericano para Estúdios Fiscales (ICEFI). Rights or privileges? Health and Education in Guatemala: time to decide, forthcoming.

65. One example was analyzed by the Kenya National Commission on Human Rights in its report Living Large: Counting the Cost of Official Extravagance in Kenya (2005). This report showed that Kenya's government has spent more than $12 million on new cars for senior government officials – enough money to send 25,000 children to school for eight years. Similarly, the UNDP cites a notorious example of a project whose principal aim is to enhance the prestige of its national leadership through the construction of the $250 million basilica to rival St. Peters, in a country where only 10% of the population is even nominally of that religious denomination, and where 82% of people lack access to safe water (UNDP 1991). [ the country referred to is Ivory Coast ]

66. ALSTON, P. Ships Passing in the Night: The Current State of the Human Rights and Development Debate Seen Through the Lens of the Millennium Development Goals. Human Rights Quarterly, The Johns Hopkins University Press, v. 27, n.3,2005.

67. General Comment 14,2000, par. 19.

68. Presidential Peace Commission of the Government of Guatemala and the Unidad Revolucionaria Nacional Guatemalteca.Agreement on Social and Economic Aspects and Agrarian Situation, 6 May 1996.

69. According to a study on the nature of the obligations under the International Covenant on Economic, Social and Cultural Rights, the UN Committee on Economic, Social and Cultural Rights compared the money spent by a state in the implementation of a specific Covenant right and that which is spent for the same item by other states with the same level of development to assess its compliance with its obligation of using the maximum available state resources. For example, when examining the Second Periodic Report of the Dominican Republic, the Committee noted with great concern that State expenditure on education and training as a proportion of total public spending was less than half the average in Latin America (SEPULVEDA, M. The Nature of the obligations under the International Covenant on Economic, Social and Cultural Rights.Intersentia, 2003).

70. Social allocation ratio and "social priority ratio"are two of the four ratios introduced originally by UNDP in 1991. The first one refers to social services share of government spending and the second refers to human priority [explain] share of social sector spending.

71. UNDP, 1991.

72. World Bank. World Development Report 1993.

73. An example of this is the Country Fact Sheet produced by the Center for Economic and Social Rights about Kenya, a country that overall, when compared with its neighbors in Sub-Saharan Africa, is not doing exceptionally badly. See Country Fact Sheet #4, op. cit.

75. Thus, some of the methods set out in this article might be helpful for the IBSA (Indicators, Benchamarking, Scoping and Assessment) procedure currently being developed by Eibe Riedel (member of the Committee on Economic, Social and Cultural Rights (CESCR) and Chair at the University of Mannheim) in co-operation with FIAN International, as a tool for Governments and UN treaty bodies to monitor the realisation of human rights treaties (see http://ibsa.uni-mannheim.de/html/ibsa.html) In particular, these methods might be helpful for the discussion between the UN treaty body and the relevant State Party on the State Party's established Benchmarks, in order to arrive at a consensus about them (scoping stage) and the dialogue stage between the State Party and the treaty body in preparation for the drafting of the latter's Concluding Observations (assessment stage).

76. Ignatieff & Desormeau, 2005, op.cit.

77. Center for Economic and Social Rights and Central American Institute for Fiscal Studies. Rights or privileges? Healthand education in Guatemala: time to decide, forthcoming.

78. The Center for Economic and Social Rights also applies these quantitative tools in its fact sheet series, "Visualizing Rights"on individual countries as part of its effort to strengthen human rights monitoring of various UN mechanism and human rights NGOs ( The Center for Economic and Social Rights. Visualizing Rights. Country Fact sheet series). These fact sheets collects relevant socioeconomic indicators from both international and national sources, analyzes them based on applicable international human rights standards, and displays the results in visual forms, in order to maximize their advocacy effectiveness.

79. UNESCO. Education for All Development Index (EDI). Available at: <http://portal.unesco.org/education/en/ev.phpURL_ID=43352&URL_DO=DO_TOPIC&URL_SECTION=201.html>. Last accessed on: 11 Oct. 2008.

80. GUATEMALA. INSTITUTO NACIONAL DE ESTADISTICA. Encuesta nacional de empleos e ingresos –ENEI.

81. For details, see CESR and ICEFI, op.cit.

82. Child malnutrition in Guatemala – as in many countries with high levels of child malnutrition – is not only a health problem but also a major constraint on pupils' ability to learn. Tackling this problem is therefore essential for the realization of the right to education (as well as, obviously, to the right to food and the right to health).

83. RUBIO, F. & SALANIC, V. Diagnóstico De Habilidades de Lectura y Matemática de Docentes de Primer y Tercer Grado en Escuelas  Públicas de Guatemala. Guatemala: USAID, 2005.

85. INSTITUTO LATINOAMERICANO PARA ESTÚDIOS FISCALES (ICEFI). Mas y Mejor Educación en Guatemala: (2008-2021): ¿Cuanto nos Cuesta?, Guatemala 2007.

86. DI GROPELLO, E. Barriers to Better Quality Education in Central America. World Bank, no. 64 (in Brief), Washington, Mar. 2005.

EITAN FELNER
Eitan Felner is the outgoing Executive Director of the Center for Economic and Social Rights (CESR). He is also the former Director of B'Tselem, the Israeli Information Center for Human Rights in the Occupied Territories and Chairperson of the Israeli Section of Amnesty International. Felner holds a Masters degree in International Human Rights Law from Oxford University and was a research fellow at the Carr Center for Human Rights Policy at Harvard University. He has published several articles on human rights in The International Herald Tribune, Le Monde, Le Monde Diplomatique, and other publications.