schools-for-all
 
  • Home
  • About
    • Operational Definitions used in this Web Site
    • Outlines for Summaries, Bibliographies & Studies/Stories
    • Guidelines for Participation in this Web Site
    • Map of this Web Site
  • Webinars
    • Upcoming Webinars
    • Webinars Archive
    • On-Line Discussions
  • Discussion Groups
    • IDG: Healthy Schools/ School Health Promotion
    • IDG: Monitor, Report, Evaluate, Improve (MREI)
    • IDG: Low Resource Countries & Communities
  • Wiki Summaries
    • Intro to Summaries
    • Common Topics & Terms >
      • Mini-Blog Common Terms & Topics
      • Education Equity, Inclusion & Success >
        • Whole Child Approach
        • Broad Range of Learning Opportunities
        • Cross Curricular Competencies
      • Intersectoral Policy-Program Coordination Frameworks (IPPCFs) >
        • IPPCF Capacity-Building Practices
        • WoG Practices to Support IPPCFs
      • Mult-Component Approaches >
        • Core Components of Approaches >
          • Macro & Specific Policies
          • Education Promoting HSPSSD
          • H&LS/PSH Curricula & Instruction
          • Extended Education Activities
          • Health, Social & Other Services
      • Multi-Intervention Programs (MIPs)
      • Single Interventions
      • Learning/Behaviour Models
      • Behaviour & Learning Theories - Overview
      • Government Inter-Sector Actions & Levers >
        • Whole of Government Strategies
        • National Action Plans
        • Declarations, Statements & Guidance on Coordination
        • Standards & Procedures
        • Inter-Ministry Coordination >
          • Inter-Ministry & Inter-Agency Committees
          • Inter-Ministry Coordinators
          • Inter-Ministry Agreements
          • Inter-Ministry Mechanisms
      • Systems Approaches
    • Accidental Injury Prevention
    • Behaviour & Learning Theories
    • Capacity & Capacity-Building >
      • Capacity & Capacity Building Overview
      • Organizational & System Capacity >
        • Coordinated Policy & Leadership
        • Assigned Coordinators-Not Focal Points
    • Community Schools
    • Disparities, Disadvantage & Determinants
    • Ecological Analysis, Comprehensive Approaches, Systems Change >
      • Systems Change - Overview
      • Incremental, Systems-focused Actions
    • Education in Emergencies
    • Education for Sustainable Development
    • Food & Nutrition >
      • Mini-Blog School Food & Nutrition
      • School Food & Nutrition (SFN) - Overview
      • SFN - Multi-Intervention Programs
      • School & Community Gardens
    • Healthy Schools
    • Implement, Maintain, Scale up & Sustain Programs (IMSS) >
      • Mini-Blog on Implement-Maintain-Scale Up-Sustain (IMSS)
      • IMSS Overview
      • Understand Context, Problems, Focus on Priorities >
        • Situation Assessment Tools
      • IMSS Rationale & Examples >
        • IMSS Reports and Reporting
      • Use of IMSS Models & Frameworks
      • Strengthen Tradiional IMSS Planning
      • Individual & Idiosyncratic Factors
    • Inclusion/Inclusive Schools
    • Indigenous School Health
    • Infectious Diseases >
      • Mini-Blog - Infectious Diseases
      • Overview
    • Integrate Within Education Systems >
      • Mini-Blog on Integrating H & S Programs Within Education
      • Integrate Within Education - Overview
      • Multi-Sector Commitments to a Whole Child Approach:
      • Different Type of Partnerships >
        • Education as Lead Partner
        • Reciprocal Partnerships
        • Shared Strategic Risks & Benefits
        • Relevant, Annually Reviewed
      • Understanding Education System Mandates, Constraints & Norms
      • Understanding Educator Backgrounds, Beliefs, Work Lives & Concerns
      • Other Ministry Commitments of Staffing & Funding in Schools
    • LGBT Students
    • Low Resource Contexts >
      • Mini-Blog Low Resource Contexts
      • WASH Programs (Overview) >
        • Handwashing & Hygiene
      • School Food & Nutrition in LRCs >
        • Healthy Diet/Eating in LRCs
    • Mental Health
    • Monitor, Report, Evaluate, Improve >
      • Mini-Blog on MREI
      • MREI Systems - Overview
      • MREI - Administrative Data Systems (EMIS)
      • MREI - Self Assessment Tools
      • MREI - School Accreditation & Award Programs
      • MREI - Policy/Program Surveys
      • MREI - Global, Regional, National Updates
      • MREI - School Recognition Programs
      • MREI - School Improvement Planning
      • MREI - Joint Sector Reviews
      • MREI - Continuous Improvement
    • Physical Activity
    • Safe Schools (Bullying, Violence) >
      • Bullying Prevention
    • Safe Schools (Buildings & Facilities))
    • School-based & School-Linked Services >
      • Mini-Blog on School-based & School-linked Services
      • School-based & School-Linked Services - Overview
    • Sexual Health & HIV/AIDS
    • Substance Abuse & Addictions
    • Teacher Education & Development
    • Understanding Education Systems >
      • Mini-Blog Understanding Education Terms
      • Adult Education Programs
      • Education Reform Commissions
      • Government Multi-Year Action Plans
      • Standards for Student Achievement & Curricula
  • Conferences
  • Global Initiatives, Blog & Calendar
  • Issue Topic Page Template
  • API Topic Page Template
  • Context/Pop Topic Page Template
  • Theory Topic Page Template
  • Discussion Group Template
  • Intro to set of topics template
  • Template for about pages
  • Test page
, You are here: Wiki-Summaries >> Monitor, Report, Evaluate, Improve  >> Overview
This Section: Monitor, Report, Evaluate, Improve (MREI)

Monitor, Report, Evaluate to Improve (MREI) - Overview

  • Glossary Term (GT)
  • Encyclopedia Entry (EE)
  • Handbook Section (HS)
  • Bibliography/Toolbox (BT)
  • Additional Resources (AR)
<
>
Monitoring, Reporting, Evaluation & Improvement (MREI) systems should inform policymakers, officials and practitioners in several sectors about student access to schooling and their success in learning about their health, personal and social development, about child and adolescent behaviours,  related determinants or factors and the reach and status of school-based and school-linked policies, practices and programs. MREI systems should track the capacities of various frameworks to coordinate these interventions, which include the physical conditions and psycho-social environments of schools, the accessibility and quality of school-based and school-linked student and staff services, the effectiveness of instruction and extended educational activities and the involvement of students, parents and communities in promoting the inclusion and equitable educational success of all children and the development of the whole child.  
Reliable indicators of relevant social, economic, cultural and family factors (context), student health and development status and behaviours (inputs), ministry, agency, school and professional practices, policies, programs and capacities (processes), equitable student access & success, in-school health, safety and behaviours and student learning about health/personal-social development (outputs) should be the basis of MREI systems. These school-related indicators should be linked and contribute to health and social development over the life course. However, school programs should not be expected achieve life-long and societal changes alone or in isolation from pre-school, post-secondary and other programs.
The essential purpose of MREI systems and activities should be to support self-directed, coherent, continuous improvement at all levels across several systems rather than impose external, arbitrary accountability on front-line professionals or schools. MREI systems should gather, analyze and act on data from a variety of sources and sectors. There are several monitoring & reporting strategies that can lead to systemic improvements, including commissioned reports in different formats and regular updates, school-focused award/accreditation programs and periodic policy/program surveys. Self-assessment tools and school recognition/incentive programs may motivate innovations but sustained improvements will come from data-driven, collaborative decision-making embedded within the established improvement planning procedures of ministries, agencies and schools such as school improvement planning and joint sector reviews. A better understanding of how MREI processes can be strengthened, how they can fit better within systems approaches and how MREI systems lead to well-planned, sustainable systems change strategies is needed.

This summary was first posted in June 2010 and revised in 2016 and 2021. Currently it has been posted as  a "first edition" version. The following individuals or organizations have contributed to the development of this topic; Albert Lee, Christine Beyer, Nancy Hudson, Candace Currie, Vivian Barnekow,Said Arnaout,Suleiman El Shehri, Raj’a Omar, Faten Ben Abdel Aziz, Lloyd J. Kolbe, Sean Slade, Seung Lee, Dean Brooks, Doug McCall. We encourage readers to submit comments or suggested edits by posting a comment on the Mini-blog & Discussion Page for this section or posting a comment below:
Monitoring, Reporting, Evaluation & Improvement (MREI) systems should inform policymakers, officials and practitioners in several sectors about student access to schooling and their success in learning about their health, personal and social development, about child and adolescent behaviours,  related determinants or factors and the reach and status of school-based and school-linked policies, practices and programs. MREI systems should track the capacities of various frameworks to coordinate these interventions, which include the physical conditions and psycho-social environments of schools, the accessibility and quality of school-based and school-linked student and staff services, the effectiveness of instruction and extended educational activities and the involvement of students, parents and communities in promoting the inclusion and equitable educational success of all children and the development of the whole child.  
Reliable indicators of relevant social, economic, cultural and family factors (context), student health and development status and behaviours (inputs), ministry, agency, school and professional practices, policies, programs and capacities (processes), equitable student access & success, in-school health, safety and behaviours and student learning about health/personal-social development (outputs) should be the basis and scope of MREI systems. These school-related indicators should be linked and contribute to health and social development over the life course. However, school programs should not be expected achieve such life-long and societal changes alone or in isolation from pre-school, post-secondary and other programs.
The essential purpose of MREI systems and activities should be to support self-directed, coherent, continuous improvement at all levels across several systems rather than impose external, arbitrary accountability on front-line professionals or schools. MREI systems should gather, analyze and act on data from a variety of sources and sectors, including those reporting on child and adolescent participation in schooling, health and social development. There are several monitoring & reporting strategies that can lead to systemic improvements, including regular reports and updates, school-focused award/accreditation programs and periodic policy/program surveys. Self-assessment tools and school recognition/incentive programs may motivate innovations but sustained improvements will come from data-driven, collaborative decision-making embedded within the established improvement planning procedures of ministries, agencies and schools. A better understanding of how MREI systems can be strengthened, fit better within systemsapproaches and lead to well-planned, sustainable systems change strategies is needed.
Better Data & Reasonable Comparisons
MREI processes should use reliable data sources to produce regular reports, data, advice and other resources based on carefully selected indicators which are related to system/ organizational performance over time as a tool to focus system reform and improvement. 
Effective MREI systems record changes over time in the local context, inputs, processes (programs, policies, practices) and outputs within or among students as well as changes in school conditions, improved policies and programs and increased organizational and professional capacities. (Note: School-based and school-linked programs can create short-term changes in health,social & emotional developments, knowledge, skills, social connections and attitudes. However these brief school programs (usually less than a year in duration) should not be seen as being responsible for long-term or life-long changes in behaviiours or conditions unless related interventions are continued later into the life course.)
Reasonable comparisons and practice-focused knowledge exchange can occur among countries and communities in similar circumstances. Mechanisms supporting these exchanges among similar jurisdictions should be encouraged. The traditional approach which monitors one population or program across all contexts or conglomerate reporting by UN agencies via their regional offices can also be modified to address a variety of countries and communities.
Better Information, Better Tools, Better MREI Practices
Self-assessment tools can be used to improve programs but they are poor substitutes for ongoing monitoring & reporting. School recognition/small incentives programs are also used widely as are “success stories” which highlight accomplishments and more realistic “practice stories and planned or post-hoc case studies or program evaluations. Regularly published global, regional and national updates often gather together various data, evidence and stories about interventions, programs or approaches. Accreditation/award systems are used in countries with adequate resources, suitable governance systems and traditions of school inspections. Regular global, national/state surveys of policies and programs should be used gather data from the national, sub-national, local agency, school and practitioner levels from all of the systems engaged in the multi-component approaches, multi-intervention programs or large-scale interventions being used in the jurisdiction.
Student learning in heath & life skills education should be among the subjects monitored in global, national and state education systems. Child and adolescent health, social, safety, environmental and other behaviours and attitudes as well as their connections with parents, schools, peers, community programs and employment/ training should be monitored by health, social protection and employment ministries through regular global, national and state surveys. Standardized teacher assessments of child and adolescent development can provide information on individual students for their teachers and on those cohorts of students to identify needed program adjustments.  Accurate student health, education and other records as well as administrative data, especially the national Education Monitoring and Information Systems (EMIS) and student out of school/dropout rates are basic to any MREI system. Required reporting of violent incidents, suspensions from school, outbreaks, injuries, and student selection of health & life skills education courses in later grades can also be a source of data for monitoring the reach, access and needs of different approaches, programs and populations. These data sources can be consolidated in periodic reports on child, adolescent and young adult educational progress, health and social development. The initial education, qualifications, access to ongoing development, attitudes, concerns and the capacities of education and other faculties to prepare teachers, other educators and professionals who work in or with schools should be part of ongoing MREI systems in educational success, health & social development.
Evaluating MREI Practices and Investments
MREI practices in school-based and school-linked equity, health and social development are under-developed and inadequately funded. Scarce resources often limit our capacity to evaluate programs, let alone monitoring their reach, implementation, required capacities or sustainability. Consequently, more applied research is needed to avoid repeating our mistakes in publishing one-time reports that are disconnected from systems-level decision-making.


This summary was first posted in May 2010 and revised in 2016 and 2021. Currently it has been posted as  a "first edition" version. The following individuals or organizations have contributed to the development of this topic; Albert Lee, Christine Beyer, Nancy Hudson, Candace Currie, Vivian Barnekow,Said Arnaout,Suleiman El Shehri, Raj’a Omar, Faten Ben Abdel Aziz, Lloyd J. Kolbe, Sean Slade, Seung Lee, Dean Brooks, Doug McCall. We encourage readers to submit comments or suggested edits by posting a comment on the Mini-blog & Discussion Page for this section or posting a comment below:
Text

This summary was first posted in June 2012. Currently it has been posted as  an "excerpt/adaptation", "first draft" or "revised draft" and "first or revised edition" version. The following individuals or organizations have contributed to the development of this topic.
We encourage readers to submit comments or suggested edits by posting a comment on the Mini-blog & Discussion Page for this section or posting a comment below:

Due to the length of Handbook Sections (similar to a book chapter) prepared for this web site and knowledge exchange program, we post these documents as separate documents. Click on this web link to access the draft or completed version on this topic. Come back to this page to post any comments or suggestions. 


 Bibliography/Toolbox on
Key research, reports and resources on this topic are highlighted below.  Many of the topics in this web site also have extensive bibliographies/toolboxes (BTs) published as separate documents. Click on this web link to access the full version of our Bibliography/Toolbox on this topic. These lists use our outline for these collections that we have developed over several years of curating these materials.
Research
Reports, Resources


Understand the Approach/ Program & Its Effectiveness in Different Contexts on Different Aspects of HPSD, Populations


How to Implement, Maintain, Scale Up, Sustain, Build Capacity, Leverage to Support Core Components.


How to integrate within Education Systems

Use of Ecological/ Systems Approach



Research Questions/
KDE Agenda




Understand the Approach/ Program & Its Effectiveness in Different Contexts on Different Aspects of HPSD, Populations


How to Implement, Maintain, Scale Up, Sustain, Build Capacity, Leverage to Support Core Components.


How to integrate within Education Systems

Use of Ecological/ Systems Approach



Research Questions/
KDE Agenda
The following additional resources are posted on this web site or published by other credible sources. Please send any suggested additions to i[email protected]


For updates and reader comments on this section, go to our Mini-Blog on Monitor-Report-Evaluate-Improve (MREI)

The number of summaries completed or drafted in this section are listed below)

- Overview
  • MREI of What: Student Learning? Youth Behaviours? Health & Development? Status of Policies and Programs?
  • Evidence, Reports & Data about the Impact of MREI Systems
  • Examples & Models of MREI Systems
- Key Definitions/Descriptions
  • Monitoring
    - Out of School/Dropout Data
    - Administrative Data Systems (EMIS)
    - Child & Adolescent Health & Development Status
    - Child & Adolescent Attitudes, Behaviours & Development
    - Teacher Norm-based Assessments of Student Development
    - School Physical Conditions & Resources
    - School Psycho-Socail Environment & Supports
    - Student Incidents, Suspensions & Injury Data
    - Student knowledge, skills, learning (Instruction & Extended Education)
    - Health, Development & Employment of Young Adults
    - Teacher Wellness, Work Lives, Supply, Qualifications, Development, Concerns
    - Education Faculty Programs/Capacity
    - Use, Training of Other Professionals
  • Reporting
    - Different Reporting Formats (Progress Reports, Success Stories, Practice Stories, Case & Cohort Studies, Inventories & Intervention Mapping, RCTs and Reviews)
    - Global, Regional, National Updates

    - School Accreditation/Award Programs
    - Policy/Program Surveys
    - Practitioner, Student,Parent or  Community Satisfaction Surveys
    - Consolidated Reports on Children, Adolescents & Young Adults
  • Evaluating/Assessing/Analyzing
    - Scheduled Program Evaluations

    - Planned or Post-Hoc Case Studies
    - School Inspections
    - Access, Reach, Response Times of School-based and School-Linked Services
    - Access, Reach, Breadth of Extended Education Activities
    - Student Knowledge, Skills & Attitudes in Health & Life Skills Education (tests and Surveys)
    - Health, Safety & Environmental Conditions in and Near Schools
  • Improving
    - Self-Assessment Tools
    - School Recognition Programs
    - Using Student, Parent, Neighbourhood & Teacher Satisfaction Surveys

    - Using School Improvement Planning
    - Using Joint Sector Reviews

    - Using Health, Social, Other Sector Quality Management Systems
- Key Concepts/Insights/Issues
  • Competition among Monitors
  • Accountability-Purposes, Politics, People, Shared
  • Indicators: Valid, Relevant or Convenient?
  • Continuous Improvement
  • Logic Models: Linear or Complex?
  • Data-driven decision-making
  • Intrinsic or Extrinsic Motivators within Systems
- How to Implement, Maintain, Scale Up, Sustain, Build Capacity, Adapt to Different Contexts, Leverage to Support Core Components
  • Data Sharing Across & Within Systems
  • Coordinated Data Collection & Analysis
  • Segmenting & Comparing Data by Country & Community Contexts
  • Building MREI Capacity in Countries
How to integrate within Education Systems
  • Educator Experiences with High-Stakes, Standardized Testing
  • Time Frames for Education Change vs Other Sector Programs
  • Teacher, Administrator & Other Adopter Concerns
- Implications of Ecological/ Systems Approach
  • Shared MREI in Multiple, Complex, Loosely Coupled Systems
  • Within Child/Youth Reporting Systems in other Sectors
  • Links with Early Childhood Education
  • Links with Post-Secondary Education
- Research Questions/Knowledge Development
  • Research Programs/Knowledge Centres
  • Impact on Student Learning
  • Cost Effectiveness, Cost Benefits
  • Research Methods & Data Collection Issues
This World Encyclopedia is built and maintained as a collaboration among several organizations and individuals. The International School Health Network (ISHN) is pleased to publish and facilitate our collective efforts to exchange knowledge.