Abstract
The objective of sustainability measurement is to move environmental decision making toward more rigorous, quantitative and empirical foundations. One of the most comprehensive attempts to lay out the foundations for sustainability measurement has been offered by the Environmental Sustainability Index (ESI). This paper aims to advance the science of sustainability measurement by assessing the validity and reliability of this composite index in order to provide new insights for future indicator development. The architecture of the ESI is validated against the Pressure-State-Response (PSR) model, after which an exploratory factor analysis is conducted to reveal the latent structure of the index. Further, the performance of the ESI is tested in cross-national regression models. The results indicate a lack of consistency with the well established PSR model and a potential bias towards economically developed countries grounded in the architecture and weighting mechanism of the index. A re-weighted index (Equivalised ESI) is constructed, resulting in a new ranking of countries’ sustainability. The Equivalised ESI improves the measurement qualities of the index, and in so doing actually reinforces the rich-country bias of the ESI. Put differently, the Equivalised ESI brings the deficiencies of the original ESI to the fore. This paper illustrates that there are serious conceptual problems and validity concerns with defining the ESI as a sustainability measure. Taken together, the findings reinforce the need to reconsider future foundations of sustainability measurement in order to ensure that it is clear both what is being measured and how well.
Similar content being viewed by others
References
Asafu-Adjaye, J. (2003). Biodiversity loss and economic growth: A cross-country analysis. Contemporary Economic Policy, 21(2), 173–185.
Asheim, G. B. (2003). Green national accounting for welfare and sustainability: A taxonomy of assumptions and results. Scottish Journal of Political Economy, 50(2), 113–130.
Babcicky, P. (2012). Single and composite sustainability indicators in comparative sociology. In S. J. Babones & C. Chase-Dunn (Eds.), Routledge handbook of world-systems analysis: Theory and research (pp. 413–421). London: Routledge.
Barkan, S. E. (2004). Explaining public support for the environmental movement: A civic voluntarism model. Social Science Quarterly, 85(4), 913–937.
Baumer, K. A., Herzog, T., & Pershing, J. (2005). Navigating the numbers: Greenhouse gas data and international climate policy. Washington, D.C.: World Resources Institute.
Böhringer, C., & Jochem, P. E. P. (2007). Measuring the immeasurable—a survey of sustainability indices. Ecological Economics, 63(1), 1–8.
Bonini, A. N. (2008). Cross-national variation in individual life satisfaction: Effects of national wealth, human development, and environmental conditions. Social Indicators Research, 87(2), 223–236.
Bush, B. J. (2009). Democracy, autocracy, and hybridity: A cross-national analysis of political regimes, environmental sustainability, and performance. Ann Arbor: Norhtern Arizona University.
Cabezas, H., & Fath, B. D. (2002). Towards a theory of sustainable systems. Fluid Phase Equilibria, 194–197, 3–14.
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.
Dietz, S., & Neumayer, E. (2007). Weak and strong sustainability in the SEEA: Concepts and measurement. Ecological Economics, 61(4), 617–626.
Dietz, T., & Rosa, E. A. (1997). Effects of population and affluence on CO2 emissions. Proceedings of the National Academy of Sciences of the United States of America, 94(1), 175–179.
Ebert, U., & Welsch, H. (2004). Meaningful environmental indices: A social choice approach. Journal of Environmental Economics and Management, 47(2), 270–283.
Esty, D. C., Levy, M., Srebotnjak, T., & de Sherbinin, A. (2005). 2005 Environmental Sustainability Index: Benchmarking national environmental stewardship. New Haven: Yale Center for Environmental Law & Policy.
Ewing, B., Moore, D., Goldfinger, S., Oursler, A., Reed, A., & Wackernagel, M. (2010). The ecological footprint atlas 2010. Oakland: Global Footprint Network.
Freedom House. (1997). Freedom in the world: 1996–1997. New York: Freedom House.
Freedom House. (2010). Freedom in the world comparative and historical data. http://www.freedomhouse.org/template.cfm?page=439. Accessed 30th July 2010.
Freymeyer, R. H., & Johnson, B. E. (2010). A cross-cultural investigation of factors influencing environmental actions. Sociological Spectrum: Mid-South Sociological Association, 30(2), 184–195.
Giannetti, B. F., Bonilla, S. H., Silva, C. C., & Almeida, C. M. V. B. (2009). The reliability of experts’ opinions in constructing a composite environmental index: The case of ESI 2005. Journal of Environmental Management, 90(8), 2448–2459.
Grossman, G. M., & Krueger, A. B. (1995). Economic growth and the environment. The Quarterly Journal of Economics, 110(2), 353–377.
Hamilton, K., & Dixon, J. A. (2003). Measuring the wealth of nations. Environmental Monitoring and Assessment, 86(1), 75–89.
Hammond, A., Adriaanse, A., Rodenburg, E., Bryant, D., & Woodward, R. (1995). Environmental indicators: A systematic approach to measuring and reporting on environmental policy performance in the context of sustainable development. Washington, D.C.: World Resources Institute.
Hueting, R., & Reijnders, L. (2004). Broad sustainability contra sustainability: The proper construction of sustainability indicators. Ecological Economics, 50(3–4), 249–260.
Jha, R., & Murthy, K. V. B. (2003). A critique of the Environmental Sustainability Index. Canberra: Australian National University.
Jorgenson, A. K. (2003). Consumption and environmental degradation: A cross-national analysis of the Ecological Footprint. Social Problems, 50(3), 374–394.
Jorgenson, A. K. (2005). Unpacking international power and the Ecological Footprints of nations: A quantitative cross-national study. Sociological Perspectives, 48(3), 383–402.
Jorgenson, A. K. (2006). Global warming and the neglected greenhouse gas: A cross-national study of the social causes of methane emissions intensity. Social Forces, 84(3), 1779–1798.
Jorgenson, A. K., & Burns, T. J. (2007). The political-economic causes of change in the Ecological Footprints of nations, 1991–2001: A quantitative investigation. Social Science Research, 36(2), 834–853.
Jorgenson, A. K., & Clark, B. (2009). The economy, military, and ecologically unequal exchange relationships in comparative perspective: A panel study of the Ecological Footprints of nations, 1975–2000. Social Problems, 56(4), 621–646.
Kaufmann, D., Kraay, A., & Mastruzzi, M. (2009). Governance matters VIII: Aggregate and individual governance indicators 1996–2008. Washington, D.C.: The World Bank.
Kitzes, J. (2007). Current methods for calculating national ecological footprints accounts. Science for Environment & Sustainable Society, 4(1), 1–9.
Lawn, P. (2007). A stock-take of green national accounting initiatives. Social Indicators Research, 80(2), 427–460.
Longo, S., & York, R. (2008). Agricultural exports and the environment: A cross-national study of fertilizer and pesticide consumption. Rural Sociology 73(1), 82–104.
Mayer, A. L. (2008). Strengths and weaknesses of common sustainability indices for multidimensional systems. Environment International, 34(2), 277–291.
Mayer, A. L., Thurston, H. W., & Pawlowski, C. W. (2004). The multidisciplinary influence of common sustainability indices. Frontiers in Ecology and the Environment, 2(8), 419–426.
Morse, S. (2003). Greening the united nations’ Human Development Index? Sustainable Development, 11(4), 183–198.
Morse, S. (2004). Indices and indicators in development: An unhealthy obsession with numbers?. Trowbridge: Cromwell Press.
Morse, S. (2008). On the use of headline indices to link environmental quality and income at the level of the nation state. Applied Geography, 28(2), 77–95.
Morse, S., & Fraser, E. D. G. (2005). Making ‘dirty’ nations look clean? The nation state and the problem of selecting and weighting indices as tools for measuring progress towards sustainability. Geoforum, 36(5), 625–640.
Niemeijer, D. (2002). Developing indicators for environmental policy: Data-driven and theory-driven approaches examined by example. Environmental Science & Policy, 5(2), 91–103.
Niemeijer, D., & de Groot, R. S. (2008). A conceptual framework for selecting environmental indicator sets. Ecological Indicators, 8(1), 14–25.
Norgaard, K., & York, R. (2005). Gender equality and state environmentalism. Gender and Society, 19(4), 506–522.
Park, H., Russell, C., & Lee, J. (2007). National culture and environmental sustainability: A cross-national analysis. Journal of Economics and Finance, 31(1), 104–121.
Parris, T. M., & Kates, R. W. (2003). Characterizing and measuring sustainable development. Annual Review Environmental Resources, 28, 559–586.
Pezzey, J. C. V., Hanley, N., Turner, K., & Tinch, D. (2006). Comparing augmented sustainability measures for Scotland: Is there a mismatch? Ecological Economics, 57(1), 60–74.
Pezzoli, K. (1997). Sustainable development: A transdisciplinary overview of the literature. Journal of Environmental Planning and Management, 40(5), 549–574.
Pillarisetti, J. R. (2005). The world bank’s ‘Genuine Savings’ measure and sustainability. Ecological Economics, 55(4), 599–609.
Pillarisetti, J., & van den Bergh, J. (2010). Sustainable nations: What do aggregate indexes tell us? Environment, Development and Sustainability, 12(1), 49–62.
Prew, P. (2010). World-economy centrality and carbon dioxide emissions: A new look at the position in the capitalist world-system and environmental pollution. Journal of World-Systems Research, 16(2), 162–191.
Ravallion, M., Heil, M., & Jalan, J. (2000). Carbon emissions and income inequality. Oxford Economic Papers-New Series, 52(4), 651–669.
Rosa, E. A., York, R., & Dietz, T. (2004). Tracking the anthropogenic drivers of ecological impacts. Ambio, 33(8), 509–512.
Shandra, J. M., Leckband, C., & London, B. (2009). Ecologically unequal exchange and deforestation: A cross-national analysis of forestry export flows. Organization & Environment, 22(3), 293–310.
Siche, J. R., Agostinho, F., Ortega, E., & Romeiro, A. (2008). Sustainability of nations by indices: Comparative study between Environmental Sustainability Index, ecological footprint and the energy performance indices. Ecological Economics, 66(4), 628–637.
Singh, R. K., Murty, H. R., Gupta, S. K., & Dikshit, A. K. (2009). An overview of sustainability assessment methodologies. Ecological Indicators, 9(2), 189–212.
Social Watch. (2007). Social watch—poverty eradication and gender justice. http://www.socialwatch.org/. Accessed 16th August 2010.
Sutton, P. C., & Costanza, R. (2002). Global estimates of market and non-market values derived from night time satellite imagery, land cover, and ecosystem service valuation. Ecological Economics, 41(3), 509–527.
Torras, M., & Boyce, J. K. (1998). Income, inequality, and pollution: A reassessment of the Environmental Kuznets Curve. Ecological Economics, 25, 147–160.
Van de Kerk, G., & Manuel, A. R. (2008). A comprehensive index for a sustainable society: The SSI—the Sustainable Society Index. Ecological Economics, 66(2–3), 228–242.
Wackernagel, M., & Rees, W. (1996). Our Ecological Footprint: Reducing human impact on the earth. Gabriola Island: New Society Publishers.
Welsch, H. (2007). Environmental welfare analysis: A life satisfaction approach. Ecological Economics, 62(3–4), 544–551.
White, T. J. (2007). Sharing resources: The global distribution of the ecological footprint. Ecological Economics, 64(2), 402–410.
Whitford, A. B., & Wong, K. (2009). Political and social foundations for environmental sustainability. Political Research Quarterly, 62(1), 190–204.
World Bank. (2009). Worldwide governance indicators. http://info.worldbank.org/governance/wgi/. Accessed 25th July 2010.
World Bank. (2010). World development indicators 2010. http://www.worldbank.org/. Accessed 17th April 2010.
York, R. (2003). A rift in modernity? Assessing the anthropogenic sources of global climate change with the STIRPAT model. International Journal of Sociology and Social Policy, 23(10), 31–51.
York, R. (2009). The challenges of measuring environmental sustainability: Comment on “Political and social foundations for environmental sustainability”. Political Research Quarterly, 62(1), 205–208.
York, R., Rosa, E. A., & Dietz, T. (2003a). Footprints on the earth: The environmental consequences of modernity. American Sociological Review, 68(2), 279–300.
York, R., Rosa, E. A., & Dietz, T. (2003b). STIRPAT, IPAT and ImPACT: Analytic tools for unpacking the driving forces of environmental impacts. Ecological Economics, 46(3), 351–365.
York, R., Rosa, E. A., & Dietz, T. (2004). The Ecological Footprints intensity of national economies. Journal of Industrial Ecology, 8(4), 139–154.
Zidansek, A. (2007). Sustainable development and happiness in nations. Energy, 32(6), 891–897.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Babcicky, P. Rethinking the Foundations of Sustainability Measurement: The Limitations of the Environmental Sustainability Index (ESI). Soc Indic Res 113, 133–157 (2013). https://doi.org/10.1007/s11205-012-0086-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-012-0086-9