Using Evidence-based Implementation Models in School Health, Safety & Social Development (HS)This is a featured page

This initial or rough draft of a summary (formatted in an Handbook Section format) has been started by the International School Health Network from a previous Canadian project. Visitors to and members of this wiki-based web site are welcome to edit the draft (using the Easy Edit" tool found at the top of the page or to comment on the draft by using the "thread" tool found at the bottom of the page. (All previous versions of this page are automatically saved by the system, so don't hesitate to edit this page). Eventually, when time and resources permit, this initial draft will be formatted in accordance with the outline for handbook sections used in this knowledge exchange program for health,safety, educational and social development interventions.

Using Evidence-based Implementation Theory & Models in School Health Promotion (Draft April 15, 2009)
By Douglas McCall, Carol MacDougall, Sandra Carpenter, Cindy Andrew, Mary Shannon

This summary is in development and will eventually includes these topics:
  1. Introduction
  2. Definition of terms
  3. Why is this Important? (Describe scope of action possible with this intervention, including a discussion of potential outputs)
  4. Key aspects, elements of and approaches to the intervention
  5. Research and reports on the use of evidence-based implementation models on health, specific aspects of health/social development/learning/disparities or health/social behaviours (based on research reviews, landmark studies)
  6. Examples of the use evidence-based implementation strategies (successful case studies)
  7. Successful Strategies in evidence-based implementation
  8. Identify and discuss challenges to using evidence-based implementation models and ways to address those challenges
  9. Recommendations for National Agencies/Federal Departments, Provincial/State/Territorial Ministries, Local School Boards/Authorities/Agencies, Schools/Clinics/Local Professionals
  10. Provide links to key research references and reports/resources

1. Introduction


There is considerable discussion in the published research and more popular journals about selecting evidence-based programs and other interventions when developing a comprehensive approach to school health promotion. Programs and other types of interventions are presented with extensive data on their impact on health or other behaviours. These case studies are then scrutinized in systematic reviews and other more refined analyses. Unfortunately, there is considerably less discussion about using evidence-based planning and implementation models to plan, implement and sustain the school programs that have been selected. This summary

2. Defining Key Terms

An evidence-based implementation plan is based on an explicit model or theory that has selected or developed for the purpose of implementing, evaluating and sustaining a program, service, policy, organizational/professional practice or other type of intervention or approach. A program or approach is deemed to be sustainable or institutionalized when it becomes an integral part of the daily operations of an organization.

However, before discussing those implementation models, we should clarify some terms that are often used inter-changeably in school health promotion studies and practice. A clear understanding of terms such as dissemination, diffusion and institutionalization are required for effective, evidence-based implementation planning. These include distribution of a program, publicity/promotion about a program, dissemination of a program, diffusion of a program, implementation and institutionalization of a program. This careless use of these terms can lead to confusion and potential misrepresentation of the outcomes that can be expected of such activities.

  • Distribution of a Program: This limited strategy of the distribution of a resource, educational program or guidelines simply sends the materials to a set of intended audiences in a manner that is convenient to them, preferably using a means that does not reply on an intermediary to transmit the information further. Basic communications strategies such as timing of the distribution, the packaging, personalized mailing lists, adaptation of the material to suit the segmented audiences and other basic elements should be considered.
  • Promotion of/Publicity about a Program This second level of activity includes an ongoing publicity function to support or encourage distribution. This level of activity will have someone assigned to respond to inquiries. This person or agency will be hired by the originating organization and is made responsible as well as given time and funding to publicize the availability and desirable features of the resource. This ongoing promotion/publicity strategy also requires an ongoing budget or staff time to frequently publicize the resource, in appropriate and selected media, in a format suitable to the audiences, using spokespersons recognized as being credible by those audiences, with messages crafted to respond to current awareness, knowledge, perceptions and concerns of the audiences relative to the issue being addressed by the resource.
  • Dissemination: A dissemination strategy crosses the line into providing “customer support” but does not hire new staff or provide ongoing funding for new staff to diffuse or implement the educational resource or policy/program resource. Instead, a dissemination strategy distributes and promotes a new resource within the context of existing systems, agencies, communities or situations and persuades an existing organization or individual to use the new resources in their own work. In effect, a dissemination strategy relies on others becoming a champion and change agent on behalf of the new resource, innovation or idea. The benefits of the new resource would have to be not only understood and accepted by the partners, but the strategic advantages of the resource or in working with the publishers of the new resource would have to be apparent to the potential “champions”. These new partners would have to have the sustained resources necessary to diffuse or implement the resource.
  • Diffusion: Everett Rogers defines diffusion as the process by which an innovation is communicated through certain channels over time among the members of a social system. Rogers' definition contains four elements that are present in the diffusion of innovation process. The four main elements are:
    • (1) innovation - an idea, practices, or objects that is perceived as new by an individual or other unit of adoption. 2) communication channels - the means by which messages get from one individual to another. (3) time - the three time factors are: (a) innovation-decision process (b) relative time with which an innovation is adopted by an individual or group. (c) innovation's rate of adoption. (4) social system - a set of interrelated units that are engaged in joint problem solving to accomplish a common goal. In his later works, Rogers described the differences between early and later adopters of an innovation and made suggestions such as initially focusing on the early adopters in order to create momentum. One of the essential differences between a diffusion and dissemination strategy is the depth of penetration into the systems or communities it is intended to reach. A diffusion strategy recognizes that in most situations and systems such as school systems, there are several layers involved in accepting the change or program. Different approaches and explanatory materials need to be created for the different levels and sustained efforts need to be brought to bear over a number of years to achieve the desired effect. A second difference is that the resource is created after the recipients have identified the need for the program or new practice and are consequently looking for tools and techniques to help them implement the change.

    • Implementation/Evaluation/Evolution In this almost final stage of change, local agents have adopted the need for change and are implementing the innovation in their daily work. A significant difference between diffusion and implementation is the feedback loop whereby the impact and the process of the innovation is subject to evaluation. These evaluation results are then used to evolve or revise the innovation. The following diagram illustrates this feedback loop.

    • Institutionalization: This final stage of the process indicates that the program has become sustainable because it is now considered part of the core business of the organization. Swisher (2006) identifies the following as features of “institutionalization”:[xxi]
      · being a line item in the permanent agency budget;
      · having a place in the agency’s organization chart;
      · having personnel or full time equivalents (FTEs) assigned to specific prevention tasks;
      · having position descriptions that include prevention functions and level of effort;
      · having facilities and equipment for program operations;
      · developing an institutional memory for important agreements and understandings.

    • Others have included similar criteria or characteristics of institionalized programs. These include changes in the routines, core procedures and staffing structures of an organization (Ohly, et al, 2006; Pluye et al, 2004, Hoy and Sweetland, 2001) .

      [Untitled]



3. Why is this important?


4. Key Aspects/ Elements and Approaches to Evidence-based implementation Models or Theories


This article discusses some of the evidence-based theories and models that can be used to plan a successful implementation and institutionalization of a program. Evidence-based implementation plans and processes for school programs have these elements in common
  • They base their work on a proven theories on diffusion, organizational and professional change
  • They select or develop a planned diffusion/ implementation planning tool that has been evaluated and proved to be effective
  • They use active and ongoing staff involvementbased on a theory or model of staff development/teacher education
  • They use a variety of planning and training tools and processes including collegial/supervisory mentoring and coaching, collaborative work teams, communities of practice, formal and informal knowledge networks, workshops, email, online work spaces, conference calls and more
  • They use a variety of consultation, evaluation and reporting procedures
  • They use active parent involvement that is based on a theory or model of parent involvement in schools and health promotion/social development
  • They engage youth, informally or formally, in the development, operation and evaluation of the program in a manner that that is consistent with research and knowledge on effective youth engagement
  • They involve community-based and voluntary organizations through consultations and advisory committees.
  • They use data (surveys, administrative data, reports, consultations etc ) to identify the problem, select the program, assess implementation and evaluate outputs
  • They engage experts in the development and evaluation of their efforts
There are several bodies of knowledge that have a variety of theories and models can be used to plan, evaluate and implement programs including:
  • diffusion of innovations,
  • organizational development
  • systems change, capacity-building and continuous improvement
  • health promotion planning
  • educational reform and improvement
  • community development
  • management and leadership theories
  • staff development theory
5. Research on the use of Evidence-based Models in School Programs

Researchers are currently developing a body of knowledge that is coming to be known as "implementation science". Several evidence-based implementation models have been developed including the PRECEDE-PROCEED model in health promotion, the Concerns-based Adoption Model from education and the Mariner Model, all of which have been applied to school health, safety and social development through schools. Other evidence-based planning tools have been developed to help to select programs that are suitable to specific populations, contexts or issues. These include the Intervention Mapping approach. Online versions of these implementation planning guides are available, including the Intervention Mapping Protocol and another based on a Program Planning/Population Health Approach.


Theories and Models for Implementation & Sustainability

Returning to our list of bodies of knowledge from which we can draw suitable implementation planning models, we begin with diffusion of innovations theories.

  • Diffusion of Innovations (Rogers) theory describes how innovations are adopted within systems. Understanding the different stages of adoption, implementation and evolution help to focus resources on key steps in a timely manner. One of the best applications of this theory to school health was done by Kolbe & Iverson (1981). This early example described five basic stages in the implementation process within a school board.

    1. Mobilization Where those who are associated with a service or program become aware of how that service could be improved.

    2. Adoption Where the decision-makers governing that service or program make a commitment to pursue a given course of action.

    3. Implementation Where the course of action is put into practice.

    4. Maintenance When the practice is continued.

    5. Evolution When the new practice changes qualitatively or quantitatively.


    Clarke (1994) notes that some innovations take the world by storm (Sony Walkman and Apple Ipod), while others lie dormant for decades (fax machines). Most innovations, however, start slowly then become adopted quickly, with a slow-down in the later stages. He presents similar stages through which an innovation occurs. They include:
    • Knowledge about the innovation
    • Persuasion to form a favourable attitude
    • Decision to adopt
    • Implementation of the innovation
    • Confirmation of its value.

    Clarke also discusses the important characteristics of the innovation that will affect implementation. They include:
    • Relative advantage (perceived and real)
    • Compatability with existing values, experiences, needs
    • Complexiity and difficulty in using it
    • Trialability – degree to which it can be tried on a limited basis
    • Observability – the visibility of its results.

    There are also different categories of adopters, including:
    • Innovators – venturesome individuals
    • Early adopters – respectable members who begin the change
    • Early majority – deliberate decision-makers who are persuaded
    • Late majority – skeptical people who go along
    • Laggards – traditional people who may never adopt the change.

    There are also important roles played in the innovation process by several people. These include:
    • Opinion leaders – who have informal or formal influence over others
    • Change agents – who influence decisions and mediate between the change and the system
    • Change aides – who complement the change agent by having intensive contact with the adopters.

    The change agent functions include:
    • To develop a need for change within the system
    • To establish an information-exchange relationship
    • To diagnose problems in adopting the innovation
    • To create an intent for change among adopters and within the system
    • To help the adopter translate this intent into partial action
    • To stabilize the adoption prevent discontinuance
    • To shift adopters to self-reliance.


    Characteristics of the Innovation/Approach and Implementation


    Kolbe and Iverson (1981) describe how the important features of an innovation or reform will determine its potential
    Relative Change The different elements of relative advantage are economic costs (purchase value), usefulness (degree to which it meets the real needs of the group adopting it and pay-off time (the length of time it takes to realize results.

    Impact on Social Relations The positive or negative influence on social relationships within the target system as well as between the target system and important outside groups.

    Divisibility The degree to which the innovation can be implemented on a limited scale or in planned stages.

    Reversibility The greater the ease with which an innovation may be discontinued, the more likely it will be tried.
    Complexity The greater the complexity, the less likely it will be tried.

    Compatibility The congruence of the innovation with the technical, psychological, sociological and cultural attributes of the situation.

    Communicability The ease with which the information can be disseminated and understood.

    Time The length of time required to introduce or implement the innovation.

    Risk and Uncertainty The personal and institutional risk inherent in introducing the innovation.

    Commitment The greater the commitment required to adopt and implement the innovation (i.e. the greater amount of time, money or human resources), the less likely the innovation will be implemented.

    Capacity for Successive Modification The capacity for the innovation to be updated.

Magnitude of the Change: Is School Health Promotion a Reform or an Innovation?


In the important process of understanding the nature of the change being sought in school health promotion programs, it is likely that advocates will confront the problem of deciding to seek transformational change (reform) or incremental change (innovation/improvement). McCall (1984) has described the differences in scope between these two changes.

A reform of the school systems implies a shift among or major change to one of its five basic functions (academic preparation, socialization, vocational preparation, custodial or social selection/differentiation). A shift of the school towards a comprehensive approach to school health should be considered a reform initiative. However, specific changes such as the introduction of prevention programs on specific health issues could be considered innovations.

The dilemma in regards to SH promotion becomes clearer as we analyze this differential size issue. Will small scale improvements in the health of a school (ie new prevention programs or policies) be sustainable without reform or rebalancing of the five functions of schooling?

Organizational Development Theories

Organizational Development (OD) has been defined (Rouda & Kusy, 1995) has been defined as “a planned, organization-wide, managed from the top effort to increase organization effectiveness and health through planned interventions in the organization’s processes, using behavioural-science knowledge. In essence, OD is a “planned system of change”.

The vast majority of school health studies have been focused on the impacts of narrowly-focused, issue-specific prevention programs rather than on if they were absorbed and institutionalized into the local school and public health systems.

Learning Organization Theory


The work of Peter Senge on the “learning organization” has been described in five parts or disciplines, including systems thinking, personal mastery, mental models, shared vision and team learning. His work has evolved into a fifth discipline that has these key concepts:
  • Organizations are products of the ways that people in them think and interact;
  • To change organizations for the better, you must give people the opportunity to change the ways they think and interact;
  • No one person, including a highly charismatic teacher or CEO, can train or command someone else to alter their attitudes, beliefs, skills, capabilities, perceptions, or level of commitment.
  • Instead, the practice of organizational learning involves developing and taking part in tangible activities that will change the way people conduct their work. Through these new governing ideas, innovations in infrastructure, and new management methods and tools people will develop an enduring capability for change.
Senge’s work is consistent with current efforts in the health promotion sector to “build capacity” through more effective knowledge transfer to front-line employees and within school systems to seek “continuous improvement”.

These knowledge oriented models have led to the development of a variety of knowledge transfer strategies, including professional networks, communities of practice, professional mentoring and coaching, self-directed and reflective professional practice and more.

6. Examples of Evidence-based Implementation Models

Within the realm of health promotion and education, there are evidence-based implementation models that have been well used in school health promotion and educational reform. These include:
  • PRECEDE/PROCEDE (Green) Green’s planning and action framework has been used extensively in health promotion and school health promotion. His pre-disposing, reinforcing and enabling factors are earlier versions of the risk and protective factors now commonly discussed in population health.
·
  • Concerns-Based Adoption Model (Hord)
    The CBAM approach to educational change has been used extensively in North America and promoted by the Association for Supervision and Curriculum Development, the prominent senior educational leadership group in the United States and other countries.

Active, Ongoing Staff Involvement

Well-planned training of front-line staff such as teachers, counsellors, principals, social workers, school psychologists, police officers and public health nurses is also an essential part of implementation planning.

  • Social Learning as basis for Teacher Development
    The early work that Levinson-Gingiss(1989) and others have done on teacher training has been applied by Han & Weiss (2005) on teacher training for school mental health programs. Kealey (2000) has described the teacher training process as behaviour change. Gingiss (1995) explains how teacher training needs to follow this social learning model if health teachers are to be well engaged.
  • Halbert, et al. (1993) have described some of the training required to help public health nurses to develop and implement population-based health promotion strategies. This program was implemented in the Hamilton-Wentworth Health Unit in Ontario. A series of workshops addressed the structural and systemic barriers to population health practices.
A number of American organizations (Taras et al, 2004) have suggested that inter-professional collaboration is critical to effective implementation. They suggest that education and consultation and open exchanges across disciplines enhance school staff members' understanding and ability to manage program-related and student-related issues.

Mentoring programs (Hooper et al, 1994) can be helpful to all school professionals (e.g., teachers, school nurses, school counselors), whether they are beginners, veterans in new assignments, or in need of remedial aid to improve their skills. Mentoring is an essential part of staff development and is a part of envisioning schools as professional learning communities

Community and Parent Involvement for Sustainability

Taras et al (2004) have also suggested that community input into health and safety messages sent home from school increases the likelihood that they will be helpful. When parents, families, and community members reinforce school health and safety programs and provide input into curricular decision making, these programs are more likely to be sustained. This should include a School District/Health Authority Advisory Council on School Health Matters

Informed parents can better advocate for and participate in effective implementation of school health programs. Effective strategies and potential barriers to such parental involvement have been summarized. The National Network of Partnership Schools defines six ways that families and community members can become involved in school and describes sample practices. Two of these, "Learning at Home" and "Decision Making," are useful for achieving the goal of this parent involvement.

Ongoing and effective communication between the school, parents and health service providers is essential for sustainable school health programs. Communication among school health professionals, other school staff, parents, and students' health care providers can result in earlier access to health, oral health and mental health services and a more comprehensive understanding (by all the aforementioned) of a student's health and safety needs and how best to manage these needs (Taras, 2004).

Regular Evaluation, Expert Review

The final aspect of a well-planned implementation strategy includes a defined evaluation plan and an external review by experts, community members, staff, parents and students. Taras et al (2004) suggest that SH planners conduct periodic and ongoing evaluation of coordinated school health and safety programs and their components. Include process evaluation and quality assurance, evaluation of programs' effectiveness (including performance measurements), and evaluation of programs' impact on the entire school population.

7. Successful Strategies in Implementation

This article has summarized the evidence-based theories and models that should be selected and used to plan the implementation and sustainability of school health programs. We have pointed to some proven examples and described some of the experiences in using these models. By necessity, this, article has made some general observations and conclusions. However, evidence and experience about evidence-based implementation also points to some successful, practical strategies. In other words, a good theory almost always provides practical advice. These suggestions include:
  • Identifying and engaging early adopters is one strategy for change.
  • Adopter concerns should be addressed directly through concerns-based adoption planning models.
  • The concept of critical mass for change may be particularly relevant to school health promotion, both in terms of introducing change but also in achieving enough of a dose for an appropriate duration sufficient for having an impact on health or learning.
  • The characteristics of the innovation (complexity, reversability, costs, familiarity etc) will affect adoption, implementation and institutionalization.
  • Linking the innovation directly to the core mandate of the organization and to current priorities is critical
  • Staff participation is also critical to success and effectiveness.
  • Professional learning communities and communities of practice that encourage staff mentorship and collegial reflection on practice are being used more in the education and health sectors.
8. Challenges and Barriers to be addressed

There are a number of problems that are common to all implementation and institutionalization process

  • Fidelity in implementation will compete with natural /inevitable tendencies to adapt innovations to local circumstances. This tension should be recognized from the outset in program planning.

9. Recommendations for Action at Different Levels

The following promising, good or better practices are suggested at different levels across several systems:

At All Levels
  • All programs, policies and services should be evaluated regularly (American NGOs)

At Government Ministries National and state/provincial Levels

  • Identify and promote an evidence-based list of promising practices and strategies as part of a work force development plan. (Centers for Disease Control US)

At the Local Agencies Level


At the Local School/Clinics/Local Professional/Neighbourhoods Level



10. Key Research References


Abrams L, Gibbs, JT, (2000) Planning for change: School-community collaboration in a full-service elementary school. Urban Education. 35(1), 79-103

Birch DA. (1996) Step by Step to Involving Parents in Health Education. Santa Cruz, CA: ETR Associates

Bond, L., Glover, S., Godfrey, C., Butler, H., & Patton, G.C. (2001). Building capacity for system-level change in schools: Lessons from the gatehouse project. Health Education and Behavior, 28(3), 368-383

Carolyn P, Carolyn W, McCarthy AR. (1998) Family and community involvement in school health. In: Marx E, Wooley SF, eds. Health is Academic: A Guide to Coordinated School Health Programs. New York, NY: Teacher's College Press; 67-95

Clarke, R. A Primer in Diffusion of Innovations Theory. Retrieved 6/25, 2006.

Han, S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33(6), 665-679

Hooper K, Lawson HA. (1994) Serving Children, Youth and Families Through Interprofessional Collaboration and Service Integration: A Framework for Action. Oxford, OH: The Danforth Foundation and the Institute for Educational Renewal at Miami University.

Johnson, K., Hays, C., Center, H., & Daley, C. (2004). Building capacity and sustainable prevention innovations: A sustainability planning model. Evaluation and Program Planning, 27, 135-149.

Kolbe, L.J. Iverson, D.C. (1981). Implementing comprehensive health education, educational innovations and social change. Health Education Quarterly, 8(1).

McCall, DS. (1982). Evolution and revolution: Secondary school changes for Ontario and Quebec. McGill Journal of Education, 17, 111-118.

National PTA (2000) . Building Successful Partnerships: A Guide for Developing Parent and Family Involvement Programs. Bloomington, IN: National Educational Services; 2000.

Payne, A.A., Gottfredson, D.C., & Gottfredson, G.D. (2006). School predictors of the intensity of implementation of school-based prevention programs: Results from a national study. Prevention Science, 7(2), 225-237.

Ringwalt, C.L., Ennett, S., Johnson, R., Rohrbach, L.A., Simons-Rudolph, A., Vincus, A., & Thorne, J. (2003). Factors associated with fidelity to substance use prevention. Curriculum guides in the nation’s middle schools. Health Education & Behavior, 30(3), 375-391

Rogers, E. M. (1995). Diffusion of drug abuse prevention programs: Spontaneous diffusion, agenda setting, and reinvention. NIDA Research Monograph, 155, 90-105.

Rouda, R.H., Kusy, Jr. M.E. Organization Development. The Management of Change.

Sobeck, J.L., Abbey, A., & Agius, E. (2006). Lessons learned from implementing school-based substance abuse prevention curriculums. Children and Schools, 28(2), 77-85

Senge, P. (1990). The Fifth Discipline: The Art and Practice of the Learning Organization. Currency Doubleday.

Swisher, J.D. (2000). Sustainability of prevention. Addictive Behaviors, 25, 965-973

Taras H, Duncan P, Luckenbill D, Robinson J, Wheeler L, Wooley S: Health, Mental Health and Safety Guidelines for Schools. (2004); Available at http://www.schoolhealth.org


Key Reports and Resources

(To be added)




dmccall
dmccall
Latest page update: made by dmccall , May 13 2011, 5:13 PM EDT (about this update About This Update dmccall Edited by dmccall

3 words added
1 word deleted

view changes

- complete history)
Keyword tags: None (edit keyword tags)
More Info: links to this page

Anonymous  (Get credit for your thread)


There are no threads for this page.  Be the first to start a new thread.