Skip to main content
Log in

Rethinking the Foundations of Sustainability Measurement: The Limitations of the Environmental Sustainability Index (ESI)

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

The objective of sustainability measurement is to move environmental decision making toward more rigorous, quantitative and empirical foundations. One of the most comprehensive attempts to lay out the foundations for sustainability measurement has been offered by the Environmental Sustainability Index (ESI). This paper aims to advance the science of sustainability measurement by assessing the validity and reliability of this composite index in order to provide new insights for future indicator development. The architecture of the ESI is validated against the Pressure-State-Response (PSR) model, after which an exploratory factor analysis is conducted to reveal the latent structure of the index. Further, the performance of the ESI is tested in cross-national regression models. The results indicate a lack of consistency with the well established PSR model and a potential bias towards economically developed countries grounded in the architecture and weighting mechanism of the index. A re-weighted index (Equivalised ESI) is constructed, resulting in a new ranking of countries’ sustainability. The Equivalised ESI improves the measurement qualities of the index, and in so doing actually reinforces the rich-country bias of the ESI. Put differently, the Equivalised ESI brings the deficiencies of the original ESI to the fore. This paper illustrates that there are serious conceptual problems and validity concerns with defining the ESI as a sustainability measure. Taken together, the findings reinforce the need to reconsider future foundations of sustainability measurement in order to ensure that it is clear both what is being measured and how well.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Asafu-Adjaye, J. (2003). Biodiversity loss and economic growth: A cross-country analysis. Contemporary Economic Policy, 21(2), 173–185.

    Article  Google Scholar 

  • Asheim, G. B. (2003). Green national accounting for welfare and sustainability: A taxonomy of assumptions and results. Scottish Journal of Political Economy, 50(2), 113–130.

    Article  Google Scholar 

  • Babcicky, P. (2012). Single and composite sustainability indicators in comparative sociology. In S. J. Babones & C. Chase-Dunn (Eds.), Routledge handbook of world-systems analysis: Theory and research (pp. 413–421). London: Routledge.

    Google Scholar 

  • Barkan, S. E. (2004). Explaining public support for the environmental movement: A civic voluntarism model. Social Science Quarterly, 85(4), 913–937.

    Article  Google Scholar 

  • Baumer, K. A., Herzog, T., & Pershing, J. (2005). Navigating the numbers: Greenhouse gas data and international climate policy. Washington, D.C.: World Resources Institute.

    Google Scholar 

  • Böhringer, C., & Jochem, P. E. P. (2007). Measuring the immeasurable—a survey of sustainability indices. Ecological Economics, 63(1), 1–8.

    Article  Google Scholar 

  • Bonini, A. N. (2008). Cross-national variation in individual life satisfaction: Effects of national wealth, human development, and environmental conditions. Social Indicators Research, 87(2), 223–236.

    Article  Google Scholar 

  • Bush, B. J. (2009). Democracy, autocracy, and hybridity: A cross-national analysis of political regimes, environmental sustainability, and performance. Ann Arbor: Norhtern Arizona University.

    Google Scholar 

  • Cabezas, H., & Fath, B. D. (2002). Towards a theory of sustainable systems. Fluid Phase Equilibria, 194–197, 3–14.

    Article  Google Scholar 

  • Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.

    Article  Google Scholar 

  • Dietz, S., & Neumayer, E. (2007). Weak and strong sustainability in the SEEA: Concepts and measurement. Ecological Economics, 61(4), 617–626.

    Article  Google Scholar 

  • Dietz, T., & Rosa, E. A. (1997). Effects of population and affluence on CO2 emissions. Proceedings of the National Academy of Sciences of the United States of America, 94(1), 175–179.

  • Ebert, U., & Welsch, H. (2004). Meaningful environmental indices: A social choice approach. Journal of Environmental Economics and Management, 47(2), 270–283.

    Article  Google Scholar 

  • Esty, D. C., Levy, M., Srebotnjak, T., & de Sherbinin, A. (2005). 2005 Environmental Sustainability Index: Benchmarking national environmental stewardship. New Haven: Yale Center for Environmental Law & Policy.

    Google Scholar 

  • Ewing, B., Moore, D., Goldfinger, S., Oursler, A., Reed, A., & Wackernagel, M. (2010). The ecological footprint atlas 2010. Oakland: Global Footprint Network.

    Google Scholar 

  • Freedom House. (1997). Freedom in the world: 1996–1997. New York: Freedom House.

  • Freedom House. (2010). Freedom in the world comparative and historical data. http://www.freedomhouse.org/template.cfm?page=439. Accessed 30th July 2010.

  • Freymeyer, R. H., & Johnson, B. E. (2010). A cross-cultural investigation of factors influencing environmental actions. Sociological Spectrum: Mid-South Sociological Association, 30(2), 184–195.

    Article  Google Scholar 

  • Giannetti, B. F., Bonilla, S. H., Silva, C. C., & Almeida, C. M. V. B. (2009). The reliability of experts’ opinions in constructing a composite environmental index: The case of ESI 2005. Journal of Environmental Management, 90(8), 2448–2459.

    Article  Google Scholar 

  • Grossman, G. M., & Krueger, A. B. (1995). Economic growth and the environment. The Quarterly Journal of Economics, 110(2), 353–377.

    Article  Google Scholar 

  • Hamilton, K., & Dixon, J. A. (2003). Measuring the wealth of nations. Environmental Monitoring and Assessment, 86(1), 75–89.

    Article  Google Scholar 

  • Hammond, A., Adriaanse, A., Rodenburg, E., Bryant, D., & Woodward, R. (1995). Environmental indicators: A systematic approach to measuring and reporting on environmental policy performance in the context of sustainable development. Washington, D.C.: World Resources Institute.

    Google Scholar 

  • Hueting, R., & Reijnders, L. (2004). Broad sustainability contra sustainability: The proper construction of sustainability indicators. Ecological Economics, 50(3–4), 249–260.

    Article  Google Scholar 

  • Jha, R., & Murthy, K. V. B. (2003). A critique of the Environmental Sustainability Index. Canberra: Australian National University.

    Google Scholar 

  • Jorgenson, A. K. (2003). Consumption and environmental degradation: A cross-national analysis of the Ecological Footprint. Social Problems, 50(3), 374–394.

    Article  Google Scholar 

  • Jorgenson, A. K. (2005). Unpacking international power and the Ecological Footprints of nations: A quantitative cross-national study. Sociological Perspectives, 48(3), 383–402.

    Article  Google Scholar 

  • Jorgenson, A. K. (2006). Global warming and the neglected greenhouse gas: A cross-national study of the social causes of methane emissions intensity. Social Forces, 84(3), 1779–1798.

    Article  Google Scholar 

  • Jorgenson, A. K., & Burns, T. J. (2007). The political-economic causes of change in the Ecological Footprints of nations, 1991–2001: A quantitative investigation. Social Science Research, 36(2), 834–853.

    Article  Google Scholar 

  • Jorgenson, A. K., & Clark, B. (2009). The economy, military, and ecologically unequal exchange relationships in comparative perspective: A panel study of the Ecological Footprints of nations, 1975–2000. Social Problems, 56(4), 621–646.

    Article  Google Scholar 

  • Kaufmann, D., Kraay, A., & Mastruzzi, M. (2009). Governance matters VIII: Aggregate and individual governance indicators 1996–2008. Washington, D.C.: The World Bank.

    Book  Google Scholar 

  • Kitzes, J. (2007). Current methods for calculating national ecological footprints accounts. Science for Environment & Sustainable Society, 4(1), 1–9.

    Google Scholar 

  • Lawn, P. (2007). A stock-take of green national accounting initiatives. Social Indicators Research, 80(2), 427–460.

    Article  Google Scholar 

  • Longo, S., & York, R. (2008). Agricultural exports and the environment: A cross-national study of fertilizer and pesticide consumption. Rural Sociology 73(1), 82–104.

    Google Scholar 

  • Mayer, A. L. (2008). Strengths and weaknesses of common sustainability indices for multidimensional systems. Environment International, 34(2), 277–291.

    Article  Google Scholar 

  • Mayer, A. L., Thurston, H. W., & Pawlowski, C. W. (2004). The multidisciplinary influence of common sustainability indices. Frontiers in Ecology and the Environment, 2(8), 419–426.

    Article  Google Scholar 

  • Morse, S. (2003). Greening the united nations’ Human Development Index? Sustainable Development, 11(4), 183–198.

    Article  Google Scholar 

  • Morse, S. (2004). Indices and indicators in development: An unhealthy obsession with numbers?. Trowbridge: Cromwell Press.

    Google Scholar 

  • Morse, S. (2008). On the use of headline indices to link environmental quality and income at the level of the nation state. Applied Geography, 28(2), 77–95.

    Article  Google Scholar 

  • Morse, S., & Fraser, E. D. G. (2005). Making ‘dirty’ nations look clean? The nation state and the problem of selecting and weighting indices as tools for measuring progress towards sustainability. Geoforum, 36(5), 625–640.

    Article  Google Scholar 

  • Niemeijer, D. (2002). Developing indicators for environmental policy: Data-driven and theory-driven approaches examined by example. Environmental Science & Policy, 5(2), 91–103.

    Article  Google Scholar 

  • Niemeijer, D., & de Groot, R. S. (2008). A conceptual framework for selecting environmental indicator sets. Ecological Indicators, 8(1), 14–25.

    Article  Google Scholar 

  • Norgaard, K., & York, R. (2005). Gender equality and state environmentalism. Gender and Society, 19(4), 506–522.

    Article  Google Scholar 

  • Park, H., Russell, C., & Lee, J. (2007). National culture and environmental sustainability: A cross-national analysis. Journal of Economics and Finance, 31(1), 104–121.

    Article  Google Scholar 

  • Parris, T. M., & Kates, R. W. (2003). Characterizing and measuring sustainable development. Annual Review Environmental Resources, 28, 559–586.

    Article  Google Scholar 

  • Pezzey, J. C. V., Hanley, N., Turner, K., & Tinch, D. (2006). Comparing augmented sustainability measures for Scotland: Is there a mismatch? Ecological Economics, 57(1), 60–74.

    Article  Google Scholar 

  • Pezzoli, K. (1997). Sustainable development: A transdisciplinary overview of the literature. Journal of Environmental Planning and Management, 40(5), 549–574.

    Article  Google Scholar 

  • Pillarisetti, J. R. (2005). The world bank’s ‘Genuine Savings’ measure and sustainability. Ecological Economics, 55(4), 599–609.

    Article  Google Scholar 

  • Pillarisetti, J., & van den Bergh, J. (2010). Sustainable nations: What do aggregate indexes tell us? Environment, Development and Sustainability, 12(1), 49–62.

    Article  Google Scholar 

  • Prew, P. (2010). World-economy centrality and carbon dioxide emissions: A new look at the position in the capitalist world-system and environmental pollution. Journal of World-Systems Research, 16(2), 162–191.

    Google Scholar 

  • Ravallion, M., Heil, M., & Jalan, J. (2000). Carbon emissions and income inequality. Oxford Economic Papers-New Series, 52(4), 651–669.

    Article  Google Scholar 

  • Rosa, E. A., York, R., & Dietz, T. (2004). Tracking the anthropogenic drivers of ecological impacts. Ambio, 33(8), 509–512.

    Google Scholar 

  • Shandra, J. M., Leckband, C., & London, B. (2009). Ecologically unequal exchange and deforestation: A cross-national analysis of forestry export flows. Organization & Environment, 22(3), 293–310.

    Article  Google Scholar 

  • Siche, J. R., Agostinho, F., Ortega, E., & Romeiro, A. (2008). Sustainability of nations by indices: Comparative study between Environmental Sustainability Index, ecological footprint and the energy performance indices. Ecological Economics, 66(4), 628–637.

    Article  Google Scholar 

  • Singh, R. K., Murty, H. R., Gupta, S. K., & Dikshit, A. K. (2009). An overview of sustainability assessment methodologies. Ecological Indicators, 9(2), 189–212.

    Article  Google Scholar 

  • Social Watch. (2007). Social watch—poverty eradication and gender justice. http://www.socialwatch.org/. Accessed 16th August 2010.

  • Sutton, P. C., & Costanza, R. (2002). Global estimates of market and non-market values derived from night time satellite imagery, land cover, and ecosystem service valuation. Ecological Economics, 41(3), 509–527.

    Article  Google Scholar 

  • Torras, M., & Boyce, J. K. (1998). Income, inequality, and pollution: A reassessment of the Environmental Kuznets Curve. Ecological Economics, 25, 147–160.

    Article  Google Scholar 

  • Van de Kerk, G., & Manuel, A. R. (2008). A comprehensive index for a sustainable society: The SSI—the Sustainable Society Index. Ecological Economics, 66(2–3), 228–242.

    Article  Google Scholar 

  • Wackernagel, M., & Rees, W. (1996). Our Ecological Footprint: Reducing human impact on the earth. Gabriola Island: New Society Publishers.

    Google Scholar 

  • Welsch, H. (2007). Environmental welfare analysis: A life satisfaction approach. Ecological Economics, 62(3–4), 544–551.

    Article  Google Scholar 

  • White, T. J. (2007). Sharing resources: The global distribution of the ecological footprint. Ecological Economics, 64(2), 402–410.

    Article  Google Scholar 

  • Whitford, A. B., & Wong, K. (2009). Political and social foundations for environmental sustainability. Political Research Quarterly, 62(1), 190–204.

    Article  Google Scholar 

  • World Bank. (2009). Worldwide governance indicators. http://info.worldbank.org/governance/wgi/. Accessed 25th July 2010.

  • World Bank. (2010). World development indicators 2010. http://www.worldbank.org/. Accessed 17th April 2010.

  • York, R. (2003). A rift in modernity? Assessing the anthropogenic sources of global climate change with the STIRPAT model. International Journal of Sociology and Social Policy, 23(10), 31–51.

    Article  Google Scholar 

  • York, R. (2009). The challenges of measuring environmental sustainability: Comment on “Political and social foundations for environmental sustainability”. Political Research Quarterly, 62(1), 205–208.

    Article  Google Scholar 

  • York, R., Rosa, E. A., & Dietz, T. (2003a). Footprints on the earth: The environmental consequences of modernity. American Sociological Review, 68(2), 279–300.

    Article  Google Scholar 

  • York, R., Rosa, E. A., & Dietz, T. (2003b). STIRPAT, IPAT and ImPACT: Analytic tools for unpacking the driving forces of environmental impacts. Ecological Economics, 46(3), 351–365.

    Article  Google Scholar 

  • York, R., Rosa, E. A., & Dietz, T. (2004). The Ecological Footprints intensity of national economies. Journal of Industrial Ecology, 8(4), 139–154.

    Article  Google Scholar 

  • Zidansek, A. (2007). Sustainable development and happiness in nations. Energy, 32(6), 891–897.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philipp Babcicky.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Babcicky, P. Rethinking the Foundations of Sustainability Measurement: The Limitations of the Environmental Sustainability Index (ESI). Soc Indic Res 113, 133–157 (2013). https://doi.org/10.1007/s11205-012-0086-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-012-0086-9

Keywords

Navigation