ScriptsMap: A tool for designing multi-method policy-making workshops
Introduction
When designing mixed method workshops using Operational Research (OR) methods, group facilitators are conscious they need to attend to a number of key considerations if an effective design is to emerge [41], [28], [35]. The situation is particularly intricate if the workshop is to address a complex policy-making task, one demanding attention to the composition of the group, client demands, a detailed focal task, and the facilitation team’s own group process and modelling skills [13]. This complexity increases if the particular problem situation appears to require a mixed-method approach as issues relating to paradigm incommensurability [38], effective integration, and demands on facilitators and clients emerge [18]. However, for many of the policy making situations clients are facing, a mixed-method approach appears to provide the best option. This view is echoed by Mingers [36] who notes that when considering mixing methods the ‘purpose is to generate a richer and more effective way of handling the problem situation’ (p. 679, our emphasis). As such, a framework for thinking about workshop design is likely to be invaluable.
Complexity in workshop design is further compounded by the view that appropriate modelling designs should attend to three key objectives: the speed with which the problem situation can be addressed and agreements made, inclusivity of stakeholders (involving at least the key power brokers), and robust analysis [18]. These three objectives are particularly germane if we seek to ensure that the team will agree that the options/policies are worth implementing—that they are politically feasible [16], through a coalition of support for them, ensuring a greater likelihood of success. A further key consideration is ensuring that the agreements can work over the long term—and that the dynamics within the system will not lead to unintended and undesirable outcomes. These overarching requirements are a powerful and demanding set of criteria when designing interventions.
Taking cognisance of the above considerations, this paper focuses upon an innovative framework design that facilitates the creation of designs for policy-making workshops. Policy-making workshops are chosen as they are typically complex in nature, require careful attention to negotiation amongst key stakeholders, involve multiple perspectives, and benefit from rigorously testing policies and strategies to ensure long term robustness. There has also been recent demand for more OR attention to be focused on this area [29]. The framework design emerged through the integration of two established methods – system dynamics simulation model building [22], [43], [49] and a specific strategy making approach – Journey Making [5] (which uses causal mapping as a way of employing in practice strategic management concepts alongside the use of a computer based Group Support System [6]). These two methods had not hitherto been used together in a workshop setting, although they had been used together off-line. Thus, the workshops that have to date been designed using ScriptsMap are mixed-method designs for strategy and policy-making workshops. The map is aimed to help those involved in group model building and who wish to design a framework for exploring and agreeing the best use of combined methods.
The ScriptsMap itself is a framework for effectively combining particular sequences of scripted activities, products, and deliverables into a formal network to enable facilitators to construct appropriate combinations for workshops. To illustrate the ScriptMap’s structure the paper will explain the rationale behind the formal network. In addition, the paper will provide an example from organizational practice before concluding with some comments about further research.
The authors anticipate that there is a range of potentially interested audiences for the work presented here. Firstly, this audience includes relatively novice facilitators who have undertaken courses on the specific approaches presented (System Dynamics and Journey Making) but who are, as yet, relatively inexperienced when it comes to designing workshops. The tool thus begins to help alleviate the concern that has existed for a number of years regarding the transferability of some of the OR modelling approaches [52], particularly ‘soft-OR’ [44] (Problem Structuring Methods). A ScriptsMap workshop design, based on the ScriptsMap framework, provides novices with both details on specific tasks (within the methods) and help in linking together the tasks to provide a design for a workshop. Secondly, experienced practitioners will be interested in the explicit articulation of scripts, products, and deliverables that are the result of combining systems dynamics group model building with group modelling for policy making using Journey Making. The ScriptsMap framework not only illustrates current modelling practice but may give rise to further possibilities by stimulating the creation of new combinations. Finally, academics and practitioners interested in designing new workshops by mixing other methods may find the framework useful as it provides a means to both examine the practicalities of mixing methods but also explore in more depth some of the conceptual considerations.
Section snippets
Background
The ScriptsMap emerged from ongoing interests in improving group model building [42], [2], [8], [9]. The authors have all been involved in the development and use of models for systems thinking. Over the past 30 years, two of the authors have developed extensive knowledge and use of system dynamics modelling for policy making, and the other two authors have developed and used a specific ‘soft-OR’ approach for strategy making with a large range of management teams. Each pair was interested in
Method/design
The ScriptsMap development, as intimated above, came out of a combination of Action Research [19] and case study review [21]. Both pairs of authors, acting independent of one another, had been extensively engaged with working with clients on policy and strategy making situations and had used these opportunities to both practically reflect upon the interventions and subsequently detect recurring patterns (as an informed case study review). These reflections provided the bedrock for the joint
ScriptsMap and its components
In order to effectively provide a framework for workshop design, ScriptsMap adopts a set of conventions that easily can be utilised to facilitate the design of any a policy making workshop. These conventions on first glance appear obvious but emerged slowly and certainly after experimenting with a range of possible conventions. The basic building block of a workshop is a “script”. Fig. 1 contains a small portion of ScriptsMap, which figures prominently in the case example presented below and is
How to use the ScriptsMap framework to design a workshop
A well-designed workshop typically meets client objectives, responds to a clearly identified purpose, and is crafted after reviewing a number of possible designs, determined by the specific context. The workshop designer/facilitator must settle on a chosen set of activities (scripts), interim products, and deliverables that meet these myriad design criteria. How this process actually works in practice is illustrated in the case example below, which works with extracts of ScriptsMap (Fig. 1) to
Connecting ScriptsMap-generated workshops to client value
In the case study discussed above, when designing the workshop, the authors began with the presumption that the health care organization sought to arrive at agreed measures of performance. We did not ask any probing questions about why any health care or social service organization might want to invest its resources in such activities. Thus, it could be argued that there was a potential for lack of clarity regarding the overarching purposes to the workshop. One means of resolving this lack of
Conclusion
As is always the case, there are limitations associated with this approach to mixing methods, workshop design, and transferability. The first, and probably most significant, is the fact that the framework and designs provided in this paper are only one way of eliciting the wealth of knowledge regarding workshop design currently existing among group model building facilitators. The second is that the framework has been developed with respect to two approaches only, and has had the luxury of
References (52)
- et al.
Building confidence in models for multiple audiences: the modelling cascade
European Journal of Operational Research
(2008) Adventures in policy modeling! Operations research in the community and beyond
Omega
(2008)The strategic usefulness of management information as perceived by middle managers
Journal of Management
(1995)Variety is the spice of life: combining soft and hard OR/MS methods
International Transactions in Operational Research
(2000)- et al.
Multi-methodology: towards a framework for mixing methodologies
Omega
(1997) - et al.
Established best practice university research funding strategies using mixed mode modelling
Omega
(2011) Participants perceptions on the role of facilitators using group decision support systems
Group Decision and Negotiation
(1996)- et al.
Contrasting GDSSs and GSSs in the context of strategic change: implications for facilitation
Journal of Decision Systems
(1997) - et al.
Contrasting single user and networked group decision support systems for strategy making
Group Decision and Negotiation
(2001) - et al.
Modeling for litigation: mixing qualitative and quantitative approaches
Interfaces
(1997)