Sign in or 
- EasyEdit
-
(what's this?What are these tools?
People just like you can add or edit the content on this site. If you want to try editing, but aren't ready to add to this site, try our demo area.
Read more about editing pages at Wetpaint Central.
) - Report page
Share this
Levels of Evidence and Experience Cited in this Web Site/ KE Program
This page describes the types and levels of evidence used to prepare summaries/entries in this Encyclopedia. .
Types & Levels of Evidence from Data, Research and Experience Used in Assessing the Concepts in this Encyclopedia
This Encyclopedia is seeking to capture the knowledge and wisdom from several different sources of evidence in its description of promising, good, better or best practices. Consequently, we seek to define in this document, the categories we have used to ascribe different levels of evidence based on those three sources of knowledge.
There is a usual practice among researchers and senior policy-makers to favour evidence based on research studies, especially those that have used random controlled trials that have grouped into systematic reviews and then analyzed by reviewers of the reviews. The evidence from these multiple studies is powerful but limited to the circumstances that have been controlled and studied. As well, the controlled conditions of the studies are usually not sustainable in the real world, so practitioners, administrators and government officials often turn to other sources, including data and experience.
Consequently, in this Encyclopedia, we will attempt to walk the talk about respecting other sources of expertise and analysis that are derived from the real world of those practitioners, administrators, and officials. Since this assignment of credibility is a departure from the usual academic discussion, we would welcome all comments and suggestions.
Data Sources
There are different levels of evidence, knowledge and wisdom that can be derived from survey and administrative data collected on individuals, environments and organizations. These levels have been arranged from less authoritative to more authoritative:
There are also different levels of evidence, knowledge and wisdom that can be derived from research studies examining individuals, populations, organizations, interventions. These levels have been arranged from less authoritative to more authoritative:
Experience from Practice
There are also different levels of evidence, knowledge and wisdom that can be derived from examining the experience and normal practices of individuals, populations, organizations, and systems. These levels (more tentative in nature) have been arranged from less authoritative to more authoritative
Types & Levels of Evidence from Data, Research and Experience Used in Assessing the Concepts in this Encyclopedia
This Encyclopedia is seeking to capture the knowledge and wisdom from several different sources of evidence in its description of promising, good, better or best practices. Consequently, we seek to define in this document, the categories we have used to ascribe different levels of evidence based on those three sources of knowledge.
There is a usual practice among researchers and senior policy-makers to favour evidence based on research studies, especially those that have used random controlled trials that have grouped into systematic reviews and then analyzed by reviewers of the reviews. The evidence from these multiple studies is powerful but limited to the circumstances that have been controlled and studied. As well, the controlled conditions of the studies are usually not sustainable in the real world, so practitioners, administrators and government officials often turn to other sources, including data and experience.
Consequently, in this Encyclopedia, we will attempt to walk the talk about respecting other sources of expertise and analysis that are derived from the real world of those practitioners, administrators, and officials. Since this assignment of credibility is a departure from the usual academic discussion, we would welcome all comments and suggestions.
Data Sources
There are different levels of evidence, knowledge and wisdom that can be derived from survey and administrative data collected on individuals, environments and organizations. These levels have been arranged from less authoritative to more authoritative:
- Content analysis of official documents
- Aggregation of data from similar or same self-assessment tools
- One-time survey data collection and analysis
- One time analysis of administrative data sources
- Regular ongoing surveys and analysis
- Regular, ongoing analyses of administrative data sources
- One time correlations data analysis
- Regular, ongoing correlations data analysis
There are also different levels of evidence, knowledge and wisdom that can be derived from research studies examining individuals, populations, organizations, interventions. These levels have been arranged from less authoritative to more authoritative:
- Open-ended descriptive studies, narrative inquiries
- Hypothesis focused descriptive studies and inquiries
- Case studies testing hypotheses in specific circumstances with experimental or quasi-experimental designs
- Replicated, random, controlled trials
- Random controlled trials replicated in a variety of circumstances
- Random controlled trials done in real world conditions (ie without external support such as staff training, technical assistance, coaching etc)
- Reviews of the peer reviewed published research
- Meta-analyses of the RCT case studies
- Meta-analyses of RCT studies done only in real world conditions
- Systematic reviews of the RCT case studies
- Systematic reviews of RCT's done only in real world conditions
- In-depth analysis and categorization of the systematic reviews
Experience from Practice
There are also different levels of evidence, knowledge and wisdom that can be derived from examining the experience and normal practices of individuals, populations, organizations, and systems. These levels (more tentative in nature) have been arranged from less authoritative to more authoritative
- Observations based on Personal Experience and Interactions
- Key informant interviews to identify emerging issues, trends and normal practices
- Environment scans to identify issues, practices, trends, normal practices
- Media and professional journal scanning to identify emerging and normal practices
- Surveys of populations, organizations or professionals to describe current, normal and emerging practices
- Analysis of consensus statements on desired practices
- Analysis or tracking of changes to professional or organizational guidelines, routines, structures
- Tracking of related events, meetings, decisions, workshops
- Issues, trends, emerging and normal practices identified by structured discussions/consultations, communities of practice, consultations with networks and other professional networks
dmccall |
Latest page update: made by dmccall
, Feb 3 2011, 12:22 PM EST
(about this update
About This Update
Edited by dmccall
14 words added 1 word deleted view changes - complete history) |
|
Keyword tags:
None
More Info: links to this page
|
There are no threads for this page.
Be the first to start a new thread.
