users through any type of distribution or download environment the top declining skills are physical skills such as manual one of the major challenges with up- and reskilling from a graduate with an industry-approved associate degree in on the Severance & Separation Benefits – report by Lee Harrison. Challenges in planning or solving problems: Some people experience changes in their ability to develop and follow a plan or work with. PDF | Please note that gray areas reflect artwork that has been intentionally removed. Download full-text PDF · Read full-text and professional challenges in working or managing remote office contexts, Lassk is an associate professor at Northeastern. R.S. Gajendran and D.A. Harrison, “The Good, the Bad,. and the.
Expertise in research integration and implementation for tackling complex problems: when is it needed, where can it be found and how can it be strengthened?
Expertise in research integration and implementation is an essential but often overlooked component of tackling complex societal and environmental problems. We focus on expertise relevant to any complex problem, especially contributory expertise, divided into ‘knowing-that’ and ‘knowing-how.’ We also deal with interactional expertise and the fact that much expertise is tacit. We explore three questions. First, in examining ‘when is expertise in research integration and implementation required?,’ we review tasks essential (a) to developing more comprehensive understandings of complex problems, plus possible ways to address them, and (b) for supporting implementation of those understandings into government policy, community practice, business and social innovation, or other initiatives. Second, in considering ‘where can expertise in research integration and implementation currently be found?,’ we describe three realms: (a) specific approaches, including interdisciplinarity, transdisciplinarity, systems thinking and sustainability science; (b) case-based experience that is independent of these specific approaches; and (c) research examining elements of integration and implementation, specifically considering unknowns and fostering innovation. We highlight examples of expertise in each realm and demonstrate how fragmentation currently precludes clear identification of research integration and implementation expertise. Third, in exploring ‘what is required to strengthen expertise in research integration and implementation?,’ we propose building a knowledge bank. We delve into three key challenges: compiling existing expertise, indexing and organising the expertise to make it widely accessible, and understanding and overcoming the core reasons for the existing fragmentation. A growing knowledge bank of expertise in research integration and implementation on the one hand, and accumulating success in addressing complex societal and environmental problems on the other, will form a virtuous cycle so that each strengthens the other. Building a coalition of researchers and institutions will ensure this expertise and its application are valued and sustained.
‘Interdisciplinarity’ and ‘transdisciplinarity’ are widely heralded as key to research addressing complex societal and environmental problems, such as reducing the gap between rich and poor, combating illicit drug use, controlling spiralling health care costs and achieving sustainable social-ecological systems (Gibbons et al., ; Jacob, ; Ledford, ; National Academy of Sciences, National Academy of Engineering and Institute of Medicine, ). In these situations, the terms ‘interdisciplinarity’ and ‘transdisciplinarity’ are used generically to indicate that different strands of disciplinary and other knowledge (e.g., from policy makers and affected communities) need to be brought together and acted upon. Implicit, but largely unrecognised, is required expertise in (1) research integration to develop a more comprehensive understanding of the problem and possible ways to address it and (2) research implementation to improve the situation.
Poor understanding of expertise needed for research integration and implementation makes assessing interdisciplinarity and transdisciplinarity difficult at all levels, including tenure and promotion applications, funding proposals, outcomes of research projects, and outputs of inter- and transdisciplinary centres and other institutions (British Academy Working Group on Interdisciplinarity, ; Bursztyn and Drummond, ; Klein and Falk-Krzesinski, ; Lyall, ; McLeisch and Strang, ). For example, inadequate understanding of what interdisciplinarity involves and how to assess it may explain why interdisciplinary grant applications have lower success rates than discipline-based proposals (Bammer, a; Bromham et al., ; Reckling and Fischer, ).
It is tempting to blame reviewers for assessment problems, labelling them as hostile or ignorant. Instead, we argue that those researching complex societal and environmental problems must ensure that expertise in research integration and implementation is well articulated, accessible and useable. These tasks require a major effort, especially as defining ‘expertise’ is far from straight-forward. Our aim is to lay foundations for further work by exploring three questions:
When is expertise in research integration and implementation required?
Where can expertise in research integration and implementation currently be found?
What is required to strengthen expertise in research integration and implementation?
We open a discussion rather than being prescriptive and provide enough detail to give the ideas substance while inviting input and further development by others practising research integration and implementation.
Our starting point is that complex societal and environmental problems are generally investigated by teams made up of disciplinary experts and increasingly they include stakeholders affected by the problem, as well as those in a position to do something about it. We argue that some team members must have expertise in research integration and implementation to effectively harness the contributions of the full team. In this article, we start to tease out what that expertise entails.
In doing so, our focus is expertise that is not specifically about the problem being tackled, therefore we leave to one side understanding of the problem itself, be it climate change, organised crime or some other complex issue. Instead we are interested in the required expertise in research integration and implementation that is relevant to tackling any complex societal or environmental problem.
We explore three components of such expertise. Most of our focus is on contributory expertise, which Collins and Evans (, ) define as the expertise required to make a substantive contribution to a field. We divide contributory expertise into ‘knowing-that’ and ‘knowing-how’ (Gobet, ). For research integration and implementation, ‘knowing-that’ involves understanding what is required to deal with complex societal and environmental problems in an integrated way, such as knowing to look for interconnections with other problems and to explore political, economic, historical and other circumstances. ‘Knowing-how’ involves knowing which methods or processes to use in a particular context, along with skills in those methods and processes, such as building a model to describe the problem, or processes for engaging decision-makers in discussing research results. Of course, we acknowledge that knowing-that and knowing-how are in practice inseparable; nevertheless, distinguishing them helps us illuminate critical aspects of expertise in research integration and implementation.
Interactional expertise is a second component of expertise in research integration and implementation. This is the ability to understand disciplines, professional practice and community experience without being trained in those disciplines or professions or having lived in those communities (Collins and Evans, ). Interactional expertise is required to work effectively and knowledgeably with a team.
Third, contributory and interactional expertise are often tacit, in which case their inputs to thought and action are difficult to access and identify reflexively (Collins and Evans, ). Collins and Evans argue that expertise becomes tacit through the process of achieving expert status, which involves an internalisation of knowledge and skills, along with a fluidity in applying them. In this article we are also interested in tacit expertise as a component of learning-by-doing, which is a common way of achieving expertise in research integration and implementation. As we describe below, many researchers find themselves in roles requiring integration and implementation and develop skills on the fly without paying much conscious attention to them.
In opening up this discussion on expertise, our target audience is the many researchers who investigate complex societal and environmental problems and who are interested in the integration and implementation role. We want to kick-start a process of understanding and building expertise in research integration and implementation that involves newcomers through to established researchers. This scope is essential both to improving action-oriented research on complex societal and environmental problems and to recognising and rewarding properly those who undertake the integration and implementation.
As an authorship group, we illustrate, at a small scale, the challenges that this article seeks to highlight and address. Despite our common interests in research integration and implementation, we have not found it easy to articulate our own expertise. Further, many of us were not aware of each other’s contributions until we came together as invitees at the First Global Conference on Research Integration and Implementation (Integration and Implementation Sciences, a). That conference made evident the extensive array of integration and implementation expertise that has been developed for tackling complex problems and how much more effective research could be if it could draw on the full range, rather than a partial selection. Figuring out how to address these challenges has motivated our work on this article.
We start by identifying research tasks that lie outside the remit of traditional disciplines and that require expertise in research integration and implementation. We then identify three realms where such expertise currently resides, demonstrating that expertise is highly fragmented both within and across these realms. Members of the authorship group play leading roles in each of these realms.
To overcome fragmentation and strengthen expertise, we propose building a shared knowledge bank of expertise. A knowledge bank would have several major benefits. It would strengthen relevant expertise by bringing together different ways in which research integration and implementation are conceived and put into practice. It would also make expertise more visible and accessible. Further, it would unite relevant individuals and groups enabling them to provide an authoritative voice to research policy makers and funders about properly recognising, valuing and evaluating the integration and implementation expertise required to deal with complex societal and environmental problems.
We highlight key challenges in developing a knowledge bank: compiling existing expertise, indexing and organising the expertise to make it widely accessible, and understanding and overcoming the core reasons for the existing fragmentation. We close by describing the potential for a virtuous cycle between establishing a knowledge bank of expertise in research integration and implementation and increasing success in tackling complex societal and environmental problems.
Question 1: when is expertise in research integration and implementation required?
Addressing complex societal and environmental problems requires specific expertise over and above that contributed by disciplines, but there is little formal recognition of what that expertise is or reward for contributing it to a research team’s efforts. Our focus in this section is on tasks that require expertise in research integration and implementation, along with an indication of what that expertise involves, both in working with discipline-based experts and stakeholders and in dealing with the complexity of the problems.
The end points of research integration and implementation are to:
develop a more comprehensive understanding of the problem, plus possible ways to address it, by integrating disciplinary and stakeholder perspectives, and
support implementation of that understanding into evidence-informed government policy, professional and community practice, business and social innovation and other measures.
How best to achieve these goals (e.g., sequentially or concurrently) and which perspectives and implementers to involve are part of the required expertise in research integration and implementation. Expertise is also required to manage different start points, in other words whether the research is initiated and defined by the researchers, implementers (e.g., government policy makers), stakeholders affected by the problem or a combination of these.
An indication of the expertise needed can be gained by considering the complex problem of illicit drug use. One important task is to identify—using an amalgamation of know-that contributory expertise and interactional expertise—relevant discipline-based researchers and stakeholders, each of whom has an important, but only partial, understanding of the problem. Useful disciplinary inputs may include knowledge about drug effects from pharmacologists, estimates of levels of use in the population from epidemiologists, impacts on property theft and other crime from criminologists, information about regulations and laws from legal experts, and analysis of how those laws came into being from historians. Additionally, contributions to understanding come from two main groups of stakeholders: those affected by the problem, such as illicit drug users, and professional groups dealing with the problem, such as treatment and other service providers, police officers, and policy makers. As well as identifying useful perspectives, expertise in research integration and implementation is required to integrate them (know-how expertise), which includes assessing where perspectives align and where they conflict, and finding a way through conflicts.
Expertise in research integration and implementation is also required to assess and combine suggestions for action, determine strengths and risks, and decide whether the suggestions need to be supplemented by new ideas elicited through processes to spark innovation. This generally needs contributory know-how expertise. Know-how expertise, complemented by interactional expertise, is also required to identify various implementation options (through government, business and/or civil society, and through policy and/or practice change), as well as suitable implementation pathways, which can range from effective communication strategies for presenting results to decision-makers to using co-creative processes with decision-makers from the outset.
Expertise in research integration and implementation also requires the ability to embrace the challenges posed by ‘wicked problems’ (Rittel and Webber, ), also referred to as ‘messes’ (Ackoff, ). These are core to what we refer to as ‘complex’. (We eschew the terms ‘wicked’ and ‘messes’ because they are difficult to translate into other languages.) Based on our experience and key literature (Ackoff, ; Churchman, ; Cilliers, ; Horn and Weber, ; Midgley, ; Rittel and Webber, ; Ulrich, ), we propose five particular challenges that complex problems present and that need specific expertise in order to be understood and managed, and again illustrate them using the problem of illicit drug use, drawing on Babor et al. (), Ritter et al. () and Stevens ().
Delimiting the problem.
Know-that expertise is required to understand that complex real-world problems have no natural boundaries and that problems have many disparate causes, which are tangled and not easily apparent or readily inferred. For example, prevention of illicit drug use needs to account for, among other things, the legacy of childhood sexual abuse, influences of popular culture, youthful rebellion and peer pressure. Know-that expertise also includes understanding that (1) addressing a single aspect of the problem causes changes in other aspects and may lead to the emergence of new issues, (2) the problem and the system in which it is embedded evolve and (3) from both a research and an action perspective, everything cannot be dealt with, so artificial but necessary boundaries must be set. Know-how and interactional expertise are then required to draw out (from disciplinary and stakeholder subject matter experts) what the relevant interconnections are, what issues may emerge, what changes are likely, as well as to help set effective boundaries around the problem.
Managing contested problem definitions.
Know-that expertise is required to appreciate that the various parties involved in a complex societal or environmental problem have different ideas about the ‘real’ problem and its causes. For example, some see illicit drug use as a crime that results from the failure of individuals to take responsibility for adhering to laws meant to protect them. Others perceive laws as the heart of the problem, driving growth of organised crime and preventing a relatively innocuous activity from being controlled by social and cultural norms. Still others argue that illicit drug use results from a brain disorder that requires medical treatment. Know-that expertise entails understanding that definitional challenges are intrinsic to any complex problem and can only be effectively dealt with by understanding the history of conflict around the problem and its impact on the ability of groups with different perspectives to trust, listen to, and engage with each other. Know-how expertise, in turn, is needed to interact with different perspectives, to manage conflicts among them, and to provide an understanding of how they may affect decisions taken.
Managing critical, unresolvable unknowns.
Appreciating that it is not possible to know everything about a complex real-world problem is another dimension of know-that expertise. First, not everything that could be known will be investigated, because there is not enough research capacity, funding or interest to address every conceivable, and potentially important, question. Second, some critical issues cannot be researched effectively. For example, there are few feasible entry points for examining links among illicit drug use, organised crime and funding for terrorism. Third, interpretations of available information often conflict. Know-how expertise is then required to identify and chart a way of managing unknowns, so that they do not lead to adverse unintended consequences or nasty surprises.
Managing real-world constraints on ameliorating the problem.
Know-that expertise is required to appreciate that ideological, cultural, political, economic and other circumstances constrain how any complex real-world problem can be tackled, and also limit the influence of research-based evidence. In addition, options for moving forward are often hampered by current ways of managing the problem and may change the distribution of benefits and losses amongst the parties involved. Further, effectively addressing the problem often requires action across multiple poorly connected organisations. Know-that expertise therefore includes awareness of generic factors that play out in specific ways depending on the problem at hand. Such factors include the impact of laws and international treaties (which e.g., restrict options for action on illicit drugs), the importance of resources (where shifting resources, e.g., between law enforcement and health, can be challenging) and the necessity and difficulties of multi-sector collaboration (e.g., across law enforcement, health, social welfare and education). Know-that expertise is also required to appreciate that the multi-faceted circumstances in which a problem is embedded can make it resistant to change, as well as that those involved in dealing with the problem are likely to disagree about which constraints are open to modification. Know-how expertise, for its part, is required to find openings for doing things differently and to overcome resistance to change.
Appreciating and accommodating the partial and temporary nature of solutions.
Finally, know-that expertise is required to understand that no effort to tackle a complex real-world problem can take all aspects of complexity into account and that any way of moving forward will cause changes in interconnected problems, sacrifice a way of seeing the problem that some stakeholders want to preserve or even hold as non-negotiable, open the door to adverse unintended consequences and miss some real-world constraints. It also requires appreciation that the search is for best-possible or least-worst, rather than definitive, solutions. Know-how expertise is required to identify and address these limitations to understanding and action.
Given that complex societal and environmental problems are generally investigated by teams made up of disciplinary experts and stakeholders, an important question is ‘who in the team needs to have research integration and implementation expertise?’. We do not explore this question in detail here, noting that one of us (Bammer, ) has written about the advantages of developing a new discipline of Integration and Implementation Sciences (i2S) that would train experts in research integration and implementation as members of teams tackling complex problems.
In any case, identifying the range of expertise required and systematically considering how to include it in teams tackling complex societal and environmental problems will be an advance on the current shortcomings that stem from teams tending to rely on the happenstance of what their members know, are interested in, and consider to be important.
Question 2: where can expertise in research integration and implementation currently be found?
We have identified three major realms where expertise in research integration and implementation can be found and how they correspond (or not) to communities of researchers. First, some researchers apply specific approaches to tackling complex societal and environmental problems, such as interdisciplinarity, systems thinking, and action research. These approaches have coalesced around particular ways of understanding and operationalising research integration and implementation. Each community practising a specific approach is largely independent of the others.
Second, some researchers develop case-based experience without reference to specific approaches and, by moving from one problem to another, progressively build useful know-that and know-how expertise (often tacit) in research integration and implementation, along with interactional expertise. From time to time they may incorporate know-that and know-how developed by others into their practice. Unlike researchers using specific approaches, researchers drawing primarily on case-based experience tend not to be organised into communities around expertise in research integration and implementation, although they may be organised into communities around the problems of interest. We recognise that the communities using specific approaches to complex societal and environmental problems also work on cases (see for example Fulton et al. () for a case using complex systems science and Neuhauser () for a case using transdisciplinarity), but that is tangential to the point we make here.
The final source of expertise comes from researchers who investigate an element of research integration and implementation and who are not aligned with either of the other realms. We focus here on two examples—researchers interested in unknowns and those interested in innovation. In both cases, researchers come from various disciplinary and professional backgrounds. These examples differ in the strength of the associated community (measured by regular conferences and publishing in specific journals), which is weak in the case of unknowns and stronger for innovation. In both cases, interest in unknowns or innovation is not specifically focused on complex societal and environmental problems and the relevance of their insights to research integration and implementation may not be immediately obvious.
Of course, the three realms do not have hard boundaries and researchers may identify with different realms at different times in their careers. The point of identifying these three realms where expertise in research integration and implementation exists is to highlight both the existing fragmentation, as well as which veins need to be tapped into to draw together what is already available, especially in relevant know-that and know-how contributory expertise, and to illustrate where interactional expertise and tacit expertise are important.
One rich source of insights into expertise in research integration and implementation can be found in what we call specific approaches. The lists in Box 1 come from a sub-group of the authors who drew on several centuries of combined experience and scholarship, as well as their roles in helping develop some of these approaches (marked with an ‘a’).
The first column in Box 1 records 14 approaches that provide a wide range of expertise across both research integration and implementation. These approaches include action research, integrated assessment and post-normal science. The ten approaches in the second column provide a subset of expertise in research integration and implementation. Some provide expertise in research implementation only (change management, impact assessment, impact evaluation, implementation science, K* and policy science). Others provide expertise across both research integration and implementation, but only for a specific set of activities, rather than the broad range of expertise provided by the approaches listed in the first column. In particular, three approaches provide expertise in decision making and/or dealing with risk (decision making under deep uncertainty, decision sciences and risk analysis) and one in collaboration (science of team science). Multiple related approaches are listed under one specific approach in each column, namely systems thinking and K*. Many other approaches encompass various schools of thinking as well, but these have not split into separate but related approaches.
While we have listed all the specific approaches we are aware of, we anticipate that this list is not complete and that there are elements which could be contested. Further, we have not aimed to be comprehensive in the cited references, but rather have provided a major work (occasionally more) as a starting point for those interested in learning about each approach.
Before proceeding, it is important to recognise that the terms ‘interdisciplinarity’ and ‘transdisciplinarity’ are used in two different ways in the literature. In the introduction we used them in the generic sense for any research that brings together different strands of disciplinary and other knowledge and supports action based on this improved understanding. Now, unless otherwise specified, we use the second connotation, which refers to specific research approaches with established canons of scholarly work. It is also worth noting that in its specific sense, the term transdisciplinarity is used in multiple ways, including the development of new theoretical paradigms (e.g., general system theory) and methodologies that transcend disciplinary boundaries; critiques of existing structures of knowledge; building new integrative frameworks and research strategies; and involving stakeholders in both research on complex problems or phenomena and the implementation of solutions. The definition we use is provided in Box 2.
Specific approaches have at least one of the following characteristics:
they are associated with one or more professional associations or networks, and often with peer-reviewed journals and conferences; and
handbooks or other major academic works describe them.
Three examples, two from the first column in Box 1 and one from the second column, provide an illustration, while also demonstrating the different stages of development of these three approaches and the high level of fragmentation in the systems thinking community.
Systems thinkers, systems scientists and systems engineers have formed many international associations, including the Complex Systems Society; the IEEE (Institute of Electrical and Electronics Engineers) Systems Council; the IEEE Systems, Man and Cybernetics Society; the International Council on Systems Engineering; the International Federation for Systems Research; the International Society for Knowledge and Systems Sciences; the International Society for the Systems Sciences; the System Dynamics Society; and the World Organisation of Systems and Cybernetics. There are also numerous national bodies. Most societies run annual conferences. Journals include Cybernetics and Systems; International Journal of General Systems; International Journal of Knowledge and Systems Sciences; System Dynamics Review; Systemic Practice and Action Research; Systems; and Systems Research and Behavioural Science. Major reference works include an encyclopaedia (François, ) and various volumes of classic and contemporary reprints covering the whole field (Beishon and Peters, ; Buckley, ; Emery, , ; Midgley, ).
Interdisciplinarians have formed the Association for Interdisciplinary Studies and Intereach (Interdisciplinary Integration Research Careers Hub). The Association for Interdisciplinary Studies publishes the journal Issues in Interdisciplinary Studies and runs an annual conference. The Oxford Handbook of Interdisciplinarity (Frodeman, ) is now in its second edition.
Proponents of the science of team science have formed an International Network for the Science of Team Science and manage a listserv and annual conference. The major reference, produced in the US, is a report by the National Research Council ().
A detailed list of professional associations and networks, along with their journals and conferences, is available for most specific approaches at Integration and Implementation Sciences (b).
It is beyond the scope of this article to review these approaches. Instead, the aim of the lists in Box 1 is to demonstrate that there are many specific approaches that can provide know-that and know-how contributory expertise. Teasing out that expertise is a task for future research.
In Box 2 we describe examples of contributory expertise drawing on some of the specific approaches that we know best: interdisciplinarity, sustainability science, systemic intervention and transdisciplinarity. For each example of contributory expertise (e.g., the ‘three types of knowledge tool’ developed in transdisciplinary research) we also briefly describe when that expertise would be useful, referring back to the issues raised in addressing Question 1 (When is expertise in research integration and implementation required?). At this stage, we have not attempted to be systematic or detailed, but instead have aimed to highlight examples of expertise that we expect will resonate with our target audience. For this reason we focus on contributory expertise, except for Box 3 below. We also want to provide a sense of what compiling expertise will involve and that this compilation task is ripe for further work.
Case-based experience that is independent of specific approaches
Many researchers investigating complex real-world problems build their expertise by tackling particular problems without any real appreciation of the know-that and know-how offered by the specific approaches described above. This case-based expertise involves learning-by-doing and is generally augmented from project to project. Some codify the expertise they develop, while for others it remains largely tacit knowledge.
In Box 3 we provide brief descriptions of case-based expertise developed by members of the authorship group. This provides an opportunity to highlight both interactional expertise (usually tacit) and tacit contributory expertise, which are easier to identify in case-based experience than in the other realms. For each case we describe the aims of the research, along with the outcomes of the research integration and research implementation. We then highlight which disciplines and stakeholders were involved, requiring interactional expertise to effectively draw on their contributions. Finally, we highlight examples of the tacit contributory expertise developed in addressing the problem. That tacit expertise was made explicit through the process of writing this article.
As an aside, reviewing both Case 1 and Box 2 illustrates that researchers can move between realms. One of us (O’Connell) used the experience gained in case-based research to subsequently contribute to the development of sustainability science.
In Box 4, we describe two examples of codified expertise developed from case-based experience. The first example is a compilation of collaboration methods largely based on lessons learnt in resolving conflicts among researchers at the US National Cancer Institute (Bennett et al., ). From this compilation we specifically describe a set of know-that understandings that can be used to underpin ‘pre-nuptial’ agreements for research collaborators. The second example comes from a wide array of projects undertaken by the RAPID (Research and Policy in Development) programme of the UK’s Overseas Development Institute, which led to the development of a toolkit for engaging and influencing policy (Young et al., ), from which we describe one know-how method (alignment, interest and influence matrix).
Elements of research integration and implementation: considering unknowns and enhancing innovation
Expertise for tackling complex societal and environmental problems also comes from investigations on specific elements of research integration and implementation undertaken by researchers who are not involved in developing specific approaches or case-based experience. Here, we review expertise developed in research on unknowns and on enhancing innovation as two examples. We particularly emphasise considering unknowns, which is an area that is generally poorly understood and under-researched (Smithson, ), despite its critical importance in dealing with complex problems. Enhancing innovation is also of major importance in finding new, creative ways for understanding and acting on complex societal and environmental problems. These are also areas in which two of our authorship group specialise. Of course, expertise in considering unknowns and enhancing innovation can also be developed by those involved in specific approaches and case-based experience, but this is tangential to the point we aim to make here.
In Box 5, we provide two examples of know-that and three examples of know-how expertise developed by researchers considering unknowns. The first example of know-how is a compilation of strategies for accepting unknowns, while the other two are specific methods. In Box 6, we present two examples of know-that expertise and one of know-how expertise developed by researchers considering innovation. In both boxes, we also indicate when this expertise is required in tackling complex societal and environmental problems, referring back to the matters raised in addressing Question 1 (When is expertise in research integration and implementation required?).
Making an inventory of expertise in each of the three realms is beyond the scope of this article, but, as we argue in the next section, is a first step in strengthening expertise in research integration and implementation. We have set out to provide enough examples to demonstrate that considerable expertise already exists and to provide an indication of the effort required for an effective compilation exercise. In both this and the previous section, we have also aimed to provide a sense of the extent and diversity of the expertise required for effective research integration and implementation. On the other hand, there is also considerable overlap in know-that and know-how expertise developed by different communities and groups, which also has to be dealt with in any compilation exercise.