Skip to main content

The Logic of Method for Evaluating Healthy Cities

  • Chapter
  • First Online:
Healthy Cities

Abstract

It is important to evaluate and assess the workings and results of Healthy Cities. However, as Healthy Cities are conceptualized beyond ‘standard’ urban health initiatives that can be mapped with the repertoire of epidemiological techniques, an approach to generating evidence in this field must necessarily be complex and interactive. This chapter describes why and how monitoring, evaluation and assessment for Healthy Cities are important and what the evidence generated should be able to tell the different stakeholders in and beyond an individual Healthy City. The diversity of these functions must be embraced by a conscientiously developed ‘logic of method’ (methodology)—which for Healthy Cities is a negotiated and flexible effort. Two conceptual frameworks are presented that enable this: Fourth Generation Evaluation and Realist Synthesis. A long case study is presented on the negotiation, development and implementation of a Realist Synthesis evaluation of Phase V of the European WHO Healthy Cities Network, which involved 99 cities across dozens of constituencies—but with very high response rates and significant perceived relevance among stakeholders ranging from communities to WHO officers. This review argues that more attention needs to be paid to issues of resourcing, planning, timing and negotiating interactive methodologies for value-based urban health endeavours.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Arendt, H. (1969). Reflections on violence. Journal of International Affairs, 23(1), 1–35.

    Google Scholar 

  • Ashton, J., Grey, P., & Barnard, K. (1986). Healthy cities—WHO’s new public health initiative. Health Promotion International, 1(3), 319–324.

    Article  Google Scholar 

  • Banta, H. D. (2004). Considerations in defining evidence for public health. The European Advisory Committee for health research. International Journal of Technology Assessment in Health Care, 19(3), 559–572.

    Article  Google Scholar 

  • Bazeley, P., & Jackson, K. (Eds.). (2013). Qualitative data analysis with NVivo. Sage.

    Google Scholar 

  • Berkeley, D., & Humphreys, P. (1998). In-depth evaluation of 10 EU Healthy Cities projects: Constraints and possibilities. Luxemburg: Commission of the European Union, DGV.

    Google Scholar 

  • Bernier, N. F., & Clavier, C. (2011). Public health policy research: Making the case for a political science approach. Health Promotion International, 26(1), 109–116.

    Article  PubMed  Google Scholar 

  • Birckmayer, J. D., & Weiss, C. H. (2000). Theory-based evaluation in practice. What do we learn? Evaluation Review, 24(4), 407–431.

    Article  CAS  PubMed  Google Scholar 

  • Boutilier, M., Mason, R., & Rootman, I. (1997). Community action and reflective practice in health promotion research. Health Promotion International, 12(1), 69–78.

    Article  Google Scholar 

  • Capello, R. (2000). The city-network paradigm: Measuring urban network externalities. Urban Studies, 37(11), 1925–1945.

    Article  Google Scholar 

  • CHPPHF, Cochrane Health Promotion and Public Health Field. (2002). The Cochrane Collaboration Cochrane Health Promotion and Public Health Field start page. VicHealth, Adelaide, Australia. Retrieved September 4, 2002, from http://www.vichealth.vic.gov.au/cochrane/welcome/index.htm.

  • Creswell, J. W., & Clark, V. L. P. (2007). Designing and conducting mixed methods research. Sage.

    Google Scholar 

  • Critchley, R., Gilbertson, J. M., Green, G., & Grimsley, M. J. (2004). Housing investment and health in Liverpool. Sheffield: Centre for Regional Economic and Social Research, Sheffield Hallam University.

    Google Scholar 

  • Cummins, S., & Macintyre, S. (2002). “Food deserts”—Evidence and assumption in health policy making. British Medical Journal, 325, 436–438.

    Article  PubMed  PubMed Central  Google Scholar 

  • Custer, S. (2015). Avoiding data graveyards: 5 questions the data revolution should be asking. AidDataBeta, (11), 1925–1945. Retrieved May 10, 2015, from http://aiddata.org/blog/avoiding-data-graveyards-5-questions-the-data-revolution-should-be-asking.

  • Davies, S., Winpenny, E., Ball, S., Fowler, T., Rubin, J., & Nolte, E. (2014). For debate: A new wave in public health improvement. The Lancet, 384, 1889–1895. doi:10.1016/S0140-6736(13)62341-7.

    Article  Google Scholar 

  • de Leeuw, E. (1989). Concepts in health promotion: The notion of relativism. Social Science and Medicine, 29(11), 1281–1288.

    Article  PubMed  Google Scholar 

  • de Leeuw, E. (2009). Evidence for Healthy Cities: Reflections on practice, method and theory. Health Promotion International, 24(Suppl. 1), i19–i36.

    Article  PubMed  Google Scholar 

  • de Leeuw, E., Abbema, E., & Commers, M. (1998). Healthy Cities policy evaluation—Final report. Maastricht: World Health Organization Collaborating Centre for Research on Healthy Cities.

    Google Scholar 

  • de Leeuw, E., Clavier, C., & Breton, E. (2014a). Health policy—Why research it and how: Health political science. Health Research Policy and Systems, 12, 55.

    Article  PubMed  PubMed Central  Google Scholar 

  • de Leeuw, E., Green, G., Dyakova, M., Spanswick, L., & Palmer, N. (2015a). European Healthy Cities evaluation: Conceptual framework and methodology. Health Promotion International, 30(Suppl. 1), i8–i17.

    Article  PubMed  Google Scholar 

  • de Leeuw, E., McNess, A., Crisp, B., & Stagnitti, K. (2008). Theoretical reflections on the nexus between research, policy and practice. Critical Public Health, 18(1), 5–20.

    Article  Google Scholar 

  • de Leeuw, E., & Skovgaard, T. (2005). Utility-driven evidence for healthy cities: Problems with evidence generation and application. Social Science and Medicine, 61(6), 1331–1341.

    Article  PubMed  Google Scholar 

  • de Leeuw, E., Tsouros, A. D., Dyakova, M., & Green, G. (Eds.). (2014b). Healthy cities. Promoting health and equity—Evidence for local policy and practice. Summary evaluation of Phase V of the WHO European Healthy Cities Network. Copenhagen: World Health Organization Regional Office for Europe.

    Google Scholar 

  • de Leeuw, E., Tsouros, A., & Green, G. (2015b). Intersectoral governance for health and equity in European Cities. Healthy Cities in Europe, 30(Suppl. 1), 1–125.

    Google Scholar 

  • Draper, R., Curtice, L., Hopper, L., & Goumans, M. (1993). WHO Healthy Cities project: review of the first five years (1987–1992): A working tool and reference framework for evaluating the project. Copenhagen: WHO Regional Office for Europe. (EUR/ICP/HSC 644).

    Google Scholar 

  • Eriksson, C. (2000). Learning and knowledge-production for public health: A review of approaches to evidence-based public health. Scandinavian Journal of Public Health, 28, 298–308.

    Article  CAS  PubMed  Google Scholar 

  • Flyvbjerg, B. (2006). Five misunderstandings about case-study research. Qualitative Inquiry, 12(2), 219–245.

    Article  Google Scholar 

  • Green, G. (1998). Health and governance in European cities. A compendium of trends and responsibilities for public health in 46 member states of the WHO European Region. Copenhagen: World Health Organization European Regional Office and European Hospital Management Journal Ltd.

    Google Scholar 

  • Green, G., Acres, J., Price, C., & Tsouros, A. (2009). City health development planning. Health Promotion International, 24(Suppl. 1), i72–i80. doi:10.1093/heapro/dap057.

    Article  PubMed  Google Scholar 

  • Green, G., Gilbertson, J. M., & Grimsley, M. J. (2002). Fear of crime and health in residential tower blocks. A case study in Liverpool, UK. European Journal of Public Health, 12(1), 10–15.

    Article  PubMed  Google Scholar 

  • Green, G., & Tsouros, A. (2007). Evaluating the impact of healthy cities in Europe. Italian Journal of Public Health, 4, 255–260.

    Google Scholar 

  • Green, G., & Tsouros, A. (2013). City leadership for health: Summary evaluation of Phase IV of the European Healthy Cities Network. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

  • Green, G., Jackisch, J., Zamaro, G. (2015) ‘Healthy Cities as catalysts for caring and supportive environments’ , Health Promotion International 30: Suppl 1 i99–i107

    Google Scholar 

  • Health Development Agency. (2002). HDA Evidence base: Putting public health evidence into practice. Start page, HDA, London. Retrieved September 3, 2002, from http://194.83.94.80/hda/docs/evidence/eb2000/corehtml/intro.htm; Retrieved February 14, 2016.

  • Hunter, D. (2013). Getting knowledge on ‘wicked problems’ in health promotion into action. In C. Clavier & E. de Leeuw (Eds.), Health promotion and the policy process (pp. 131–153). Oxford: Oxford University Press.

    Chapter  Google Scholar 

  • International Union for Health Promotion and Education. (2000a). The Evidence of health promotion effectiveness. Shaping public health in a New Europe. Part one: Core document. Brussels/Luxembourg: ECSC-EC-EAEC.

    Google Scholar 

  • International Union for Health Promotion and Education. (2000b). The evidence of health promotion effectiveness. Shaping public health in a New Europe. Part two: Evidence book. Brussels/Luxembourg: ECSC-EC-EAEC.

    Google Scholar 

  • Ison, E. (2013). Health impact assessment in a network of European Cities. Healthy Promotion International, 90(Suppl. 1), S105–S115.

    Google Scholar 

  • Kickbusch, I. (2007). Health governance: The health society. In D. V. McQueen, I. Kickbusch, & L. Potvin (Eds.), Health and modernity: The role of theory in health promotion (pp. 144–161). New York: Springer.

    Chapter  Google Scholar 

  • Kickbusch, I., & Gleicher, D. (2012). Governance for health in the 21st century. Copenhagen: WHO Regional Office for Europe. Retrieved from http://www.euro.who.int/__data/assets/pdf_file/0019/171334/.

  • Kingdon, J. W. (1995). Agendas, alternatives and public policies (2nd ed.). New York: Harper Collins College Publishers.

    Google Scholar 

  • Lincoln, Y. S., & Guba, E. G. (1986). But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation. New Directions for Program Evaluation, 1986(30), 73–84.

    Article  Google Scholar 

  • Lindblom, C., & Cohen, D. (1979). Usable knowledge. New Haven: Yale University Press.

    Google Scholar 

  • Marmot, M., Allen, J., Bell, R., Bloomer, E., & Goldblatt, P. (2012). WHO European review of social determinants of health and the health divide. The Lancet, 380(9846), 1011–1029.

    Article  Google Scholar 

  • Marmot, M., & Wilkinson, R. G. (2003a). Social determinants of health (2nd ed.). Oxford: Oxford University Press.

    Google Scholar 

  • Marmot, M., & Wilkinson, R. (2003b). Social determinants of health: The solid facts (2nd ed.). Copenhagen: WHO Regional Office for Europe. Retrieved February 12, 2016, from http://www.euro.who.int/__data/assets/pdf_file/0005/98438/e81384.pdf.

  • McDougall, C., & de Leeuw, E. (2006). Healthy public policy. In: H. Keleher, C. McDougall, & B. Murphy (Eds.), Understanding health promotion (pp. 199–205). Melbourne: Oxford University Press.

    Google Scholar 

  • McQueen, D. V., & Anderson, L. (2001). What counts as evidence: Issues and debates. In I. Rootman, M. Goodstadt, B. Hyndman, D. V. McQueen, L. Potvin, J. Springett, & E. Ziglio (Eds.), Evaluation in health promotion. Principles and perspectives (pp. 63–82). European Series, No. 92, Ch. 3. Copenhagen: WHO Regional Publications.

    Google Scholar 

  • Milewa, T., & de Leeuw, E. (1995). Reason and protest in the new urban public health movement: An observation on the sociological analysis of political discourse in the ‘healthy city’. British Journal of Sociology, 47(4), 657–670.

    Article  Google Scholar 

  • Nationaal Instituut voor Gezondheidsbevordering en Ziektepreventie (NIGZ). (2002). Effectiviteit—Preffi. De checklist voor effectievere preventieprojecten (‘Effectiveness—Prevention Effectiveness Instrument. The checklist for more effective prevention projects’). Start page, NIGZ, Woerden, The Netherlands. Retrieved September 3, 2002, from http://www.nigz.nl/dossiers/index.cfm?action=dossierandvardossier=27.

  • Pawson, R., Greenhaigh, T., Harvey, G., & Walshe, K. (2004). Realist Synthesis: An introduction. Manchester, UK: University of Manchester. Retrieved February 14, 2016, from https://www.researchgate.net/profile/Gill_Harvey/publication/228855827_Realist_synthesis_an_introduction/links/0fcfd507f0b7cbb2ce000000.pdf.

  • Pawson, R., Greenhaigh, T., Harvey, G., & Walshe, K. (2005). Realist review—A new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy, 10(Suppl. 1), 21–34.

    Article  PubMed  Google Scholar 

  • Pawson, R., & Tilley, N. (1997). Realist evaluation. Thousand Oaks: Sage.

    Google Scholar 

  • Price, C., & Tsouros, A. (1996). Our cities, our future policies and action plans for health and sustainable development. Copenhagen: World Health Organization European Regional Office, Healthy City Project Office. Retrieved February 12, 2015, from RC62BD01-Governance-for-Health-Web.pdf.

    Google Scholar 

  • Sihto, M., Ollila, E., & Koivusalo, M. (2006). Principles and challenges of health in all policies. In T. Ståhl, M. Wismar, E. Ollila, E. Lahtinen, & K. Leppo (Eds.), Health in all policies: Prospects and potential. Helsinki: Ministrry of Social Affairs and Health.

    Google Scholar 

  • Stone, D. (1997). Policy Paradox. The art of political decision making. New York/London: W.W. Norton.

    Google Scholar 

  • Tones, K. (1997). Beyond the randomized controlled trial: A case for “judicial review”. Health Education Research, 12(2), 1–4.

    Article  Google Scholar 

  • Tsouros, A. D. (1991). World Health Organization Health Cities Project: A project becomes a movement. Review of progress 1987 to 1990.

    Google Scholar 

  • United Nations. (1992). Rio declaration on environment and development. New York: UN.

    Google Scholar 

  • Vedung, E. (2000). Public policy and programme evaluation. London: Transaction Publishers.

    Google Scholar 

  • Vos, T., Rob Carter, R., Barendregt, J., Mihalopoulos, C., Veerman, L., Magnus, A., … Wallace, A. (2010). Assessing cost-effectiveness in prevention. Brisbane: The University of Queensland.

    Google Scholar 

  • Weiss, C. H. (1979). The many meanings of research utilization. Public Administration Review, 39(5), 426–431.

    Article  Google Scholar 

  • Weiss, C. (1998). Evaluation: Methods for studying programs and policies (2nd ed.). Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Whitfield, M., Machaczek, K., & Green, G. (2013). Developing a model to estimate the potential impact of municipal investment on city health. Journal of Urban Health, 90(1), 62–73.

    Article  PubMed  Google Scholar 

  • WHO Centre for Urban Health. (1997). WHO Healthy Cities Project Phase III: 1998–2002. The requirements and the designation process. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

  • WHO Commission on Social Determinants of Health. (2008). Glosing the gap in a generation: Health equity through action on the social determinants of health. Geneva: WHO.

    Google Scholar 

  • World Health Organization. (1978). Declaration of Alma Ata. Geneva: WHO.

    Google Scholar 

  • World Health Organization. (1985). Targets for health for all: Targets in support of the European regional strategy for health for all. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

  • World Health Organization. (1992). Twenty steps for developing a healthy city project. WHO Regional Office for Europe.

    Google Scholar 

  • World Health Organization. (2001). City health development planning; concept, process, structure and content. WHO Regional Office for Europe.

    Google Scholar 

  • World Health Organization. (2005). The health for all policy framework for the WHO European Region: 2005 Update. Copenhagen: WHO Regional Office for Europe. Retrieved February 12, 2016, from http://www.euro.who.int/__data/assets/pdf_file/0008/98387/E87861.pdf.

  • World Health Organization. (2007). Global age-friendly cities: A guide. Geneva: WHO.

    Google Scholar 

  • World Health Organization. (2008). Phase V (2009–2013) of the European healthy cities network: Goals and requirements. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

  • World Health Organization. (2011). Healthy urbanization: Regional framework for scaling up and expanding healthy cities in the Western Pacific 2011–2015. Manila: WHO Regional Office for the Western Pacific.

    Google Scholar 

  • World Health Organization. (2012). Healthy cities tackle the social determinants of inequities in health: A framework for action. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

  • World Health Organization. (2013). Phase VI (2014–2018) of the WHO European Healthy Cities Network: Goals and requirements. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

  • World Health Organization. (2014). Athens declaration for Healthy Cities: Strengthening urban leadership for health, health equity and well-being for all. Copenhagen: WHO Regional Office for Europe.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Evelyne de Leeuw .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media LLC

About this chapter

Cite this chapter

de Leeuw, E., Green, G. (2017). The Logic of Method for Evaluating Healthy Cities. In: de Leeuw, E., Simos, J. (eds) Healthy Cities. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-6694-3_20

Download citation

  • DOI: https://doi.org/10.1007/978-1-4939-6694-3_20

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4939-6692-9

  • Online ISBN: 978-1-4939-6694-3

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics