Theory – navigating complexity in realist evaluation

This presentation will explore the challenges of working with theory in the realist evaluation of a project-in-practice, describing the process and results, and identifying theory’s contribution to navigating complexity. ... [ view full abstract ]

This presentation will explore the challenges of working with theory in the realist evaluation of a project-in-practice, describing the process and results, and identifying theory’s contribution to navigating complexity.

The research involves the evaluation of a novel Mentoring Programme offered to specialist practitioners working with people living with a long term neurological condition. They came from all sectors and a range of organisations across the north east of England (2009-2011), (Lawson, 2012). Due to a lack of mentoring theory (Bozeman and Feeney, 2007), this training intervention was simply described as an innovative way of increasing workforce capacity and capability and improving services to meet National Service Framework quality standards (DH, 2005). This reflected an hierarchical, management-performance discourse. The Programme was evaluated and reported at the time (Akhurst, 2011; Lawson, 2011).

This longitudinal realist evaluation (2009-2016), explores how mentoring works as an intervention and an approach when offered to practitioners as an opportunity to learn differently, work differently and make a difference. This is framed by a more agentically collaborative, outcome discourse.

What were the main challenges of locating theory in this evaluation?
• The challenge of purpose: identifying the theory of change in the Mentoring Programme and mentoring within it, and how middle range theory might structure an understanding of both;
• The challenge of analysis: combining theory, literature and expert opinion to support analysis of causality (theory-primed, literature-populated, expert-informed and participant-configured); and
• The challenge of transferability: reporting findings to contribute to understanding how this type of intervention might work and to strengthening practice in realist evaluation methodology.

Key words: realist evaluation, theory, mentoring, health and social care workforce development, outcomes

References
Akhurst, J. 2011. Neurosciences Workforce Innovations Programme (North East): Mentorship Programme. Action Research Report. Middlesbrough: North East Neurosciences Network.
Bozeman, B. and Feeney, M.K. 2007. Towards a Useful Theory of Mentoring: a Conceptual Analysis and Critique. Administration and Society, 2007, 39(6), 719-739.
Department of Health. 2005. National Service Framework for Long-term Conditions. London: Department of Health.
Lawson, S. 2011. Workforce Innovations Programme: Change and Benefit Realisation Report. Middlesbrough: North East Neurosciences Network.
Lawson, S. 2012. Improving outcomes through workforce innovations. Occupational Therapy News, 20, 22-23.