Objectives of Today’s Workshop
•
Define EBP
•
Review levels of evidence
•
Review of EBP proprietary and generic programs
•
State of EBP in Ohio
•
Issues in EBP
What is Evidence-based Practice?
(1) practices or programs that have been judged effective based on rigorous, scientific evaluations; and
(2) a process for insuring that an individual or group of individuals gets the best possible intervention, service, or support based on an assessment of needs, preferences, and available options (U.S.
DHHS)
‘Evidence-based practice cannot deliver certainties, just increase probabilities, and this is the most that any approach claiming to be ‘evidence-based’ can hope to achieve.’
(Newman et al 2005, pp.5)
Evidence-Based Practice
Uses scientific principles to assess the available evidence regarding program effectiveness, and develops principles for best practice in any particular field;
As opposed to practice based on
•
Experience
•
Unproven Theory
Draws Upon Experience in
•
Law: rules for assessing evidence
•
Engineering: codes & standards
•
Public Health: risk factors
•
Medicine: treatment decisions
•
Education: programs and org
•
Ratings for consumer products (i.e. Consumers’
Report, Car and Driver, Gearhead, etc.)
Benefits of EBP
•
Reducing crime
•
Saving money
•
Changing lives
•
Restoring dignity
•
Advancing integrity and professionalism
What EBPs have to offer
•
Proven effectiveness
•
Criminal justice cost savings
•
Blueprint
----------MAYBE ---------------------------
•
Implementing experience - coaching
•
Fidelity measures
•
Outcome tracking and reporting
An Important Qualification
•
Proven programs all require substantial training, ongoing quality assurance & monitoring
•
They only work when implemented with a high degree of fidelity
•
Proven programs account for only a small percentage of the treatment & rehabilitation market
Evidence Based Practice
Begins With A Basic
Logic Model
A Situation Inputs Outputs Outcomes
_____________________________________________________
Problem
Short Medium Long Term
Need
Crisis
Continuum of EBP
Demonstrated
Impact
Demonstrated
Ability to Replicate
Outcomes are consistent across replications
Evidence
Informed
Promising
Findings
Evaluations show better outcomes for participants than for a matched comparison or control group
Evaluations show positive outcomes for participants
--e.g. pre- and post-program evaluations
Research
Informed
The intervention design is based on research evidence about effective practice in this area – e.g. meta-analyses of effective interventions
A strong logic model ties the proposed intervention to what research tells us about how to impact child and family outcomes
Example: One component of a comprehensive parent education and support initiative
Situation: During a county needs assessment, majority of parents reported that they were having difficulty parenting and felt stressed as a result
INPUTS OUTPUTS OUTCOMES
Staff
Develop parented curriculum
Parents increase knowledge of child dev
Parents identify appropriate actions to take
Money
Partners
Deliver series of interactive sessions
Target parents attend
Parents better understanding their own parenting style
Parents use effective parenting practices
Research
Facilitate support groups
Parents gain skills in effective parenting practices
Assumptions: External factors:
Improved childparent relations
Strong families
A Review of Top Tier
Proprietary EBP And
Generic Models
Top Rated Proven Program Models
•
Functional Family Therapy (FFT)
•
Multisystemic Therapy (MST)
•
Multidimensional Treatment Foster Care (MTFC)
•
Nurse Family Partnership
Life Skills Training (LST): The Incredible Years; PATHS
Midwestern Prevention Project; Project Toward No Drug Abuse
Big Brothers Big Sisters: Olweus Bullying Prevention
$90 000
$80 000
$70 000
$60 000
$50 000
$40 000
$30 000
$20 000
$10 000
$0
Three of the Most Effective
Evidence-Based Approaches:
Benefits to Crime
Victims and
Taxpayers
Program Costs
Benefits Minus Costs
Per Participant
MTFC FFT MST
According to Washington State
Institute of Public Policy
$40 000
$20 000
$0
-$20 000
Evidence-Based Practices Versus
Common Alternatives:
Benefits to Taxpayers Minus Costs Per Participant
$100 000
MTFC
$80 000
$60 000
FFT
MST
Intensive
Probation
Intensive
Parole
Scared
Straight
Program Type According to Washington State
Institute of Public Policy
Family Functional Therapy (FFT)
Program:
•
An Empirically grounded, well-documented, and highly successful family intervention for juvenile offenders.
•
Utilizes clinicians in a specific three phase model to engage youth, motivate change, and create change in youths’ behavior.
Method:
•
Intervention ranges from 8-30 one hour direct service sessions with youth and family.
Family Functional Therapy
Accreditations:
•
High rates of effectiveness documented by:
•
Washington State Institute for Public Policy
•
Centers for Disease Control
•
US Surgeon General’s Report on Youth Violence
•
Office of Juvenile Justice and Delinquency Prevention (US DOJ)
•
Center for Substance Abuse Prevention
•
Blueprints (Center for the Study and Prevention of Violence at
University of Colorado)
Multisystemic Therapy (MST)
Program:
•
An individualized approach that targets those factors in each youth’s life that contribute to anti-social behavior.
•
MST interventions focus on caregiver discipline practices, youth associations, improving school performance, and the development of an indigenous support network.
Method:
•
The program requires 3-5 hours of face-to-face contact each week and typically lasts for 3-5 months.
MST Accreditations:
•
High rates of effectiveness documented by:
•
Washington State Institute for Public Policy
•
National Institute for Drug Addiction
•
Center for Substance Abuse Treatment
•
National Association of State Mental Health Program Directors
•
Office of Juvenile Justice and Delinquency Prevention (US DOJ)
•
Blueprints (Center for the Study and Prevention of Violence at
University of Colorado)
Multidimensional Treatment
Foster Care (MTFC)
Program:
•
MTFC addresses chronic antisocial behavior, delinquency, chronic and severe criminal behavior.
•
The MTFC model requires recruitment, training, and close supervision of community families who provide treatment and intensive supervision at home, in school, and in the community.
Method:
•
Live-in treatment with a trained foster family for 6-9+months.
MTFC Accreditations:
•
High rates of effectiveness documented by:
•
Washington State Institute for Public Policy
•
Blueprints (Center for the Study and Prevention of Violence at
University of Colorado)
•
Numerous peer reviewed research reports
Promising Programs
•
Behavioral Monitoring and Reinforcement
•
Brief Strategic Family Therapy (BSFT)
•
FAST Track
•
Good Behavior Game (GBG)
•
Guiding Good Choices (GGC)
•
I Can Problem Solve (ICPS)
•
Linking the Interests of Families
•
Teachers Triple P-Positive Parenting Program
•
Perry Preschool Project
Generic Models from Meta-Analysis
•
Cognitive Behavioral Therapy
•
Behavioral programs
•
Counseling/Psychotherapy
•
Pre-K education for low-income families
•
Teen Court
•
Family Counseling
•
Social skills training
•
Challenge programs
Programs & Strategies That
Do Not Work
•
D.A.R.E
•
Scared Straight
•
Working with at-risk youth in groups
•
Standard probation supervision
•
Punishment
•
Waiver to Adult Court
The State of
Evidence Based Practice
In Ohio
1.
Ohio’s Coordinating Centers of Excellence (CCOEs)
Established by ODMH
Includes Ohio Universities, consumer groups, local agencies
They include:
•
Supported Employment – Case Western Reserve
•
Wellness Management & Recovery – Southeast, Inc., University of
Toledo, and Lorain County MHB
•
Integrated Dual Disorder Treatment – SA/MI Focus – Case Western
Reserve
•
Center for Innovative Practice – Kent State
•
Mental Illness/Developmental Disabilities – Wright State
•
Criminal Justice – Summit County ADAMH Board and Northeastern Ohio
University’s College of Medicine
2.
Ohio Behavioral Health Juvenile Justice Program
Joint effort between ODYS and ODMH
Lucas, Summit, Cuyahoga, Franklin, Montgomery, and Hamilton
Counties
J J Youth with serious behavioral issues
Focus and employing EBP
Case Western Reserve is evaluator
Advancing EBP in
Ohio Juvenile Justice
Targeted Reclaim
•
Funding Metro Counties to employ EBP
H.B. 86 – Ohio’s sentencing reform bill
•
Effective September 30, 2011
•
Explicitly supports EBP
•
Restores judicial discretion
S.H. vs. Stickrath (now Reed)
•
Closed four institutions
•
50% population cut since 2008
•
Invested $57 million in targeted reclaim & BHJJ
•
Increases EBP
EBP and Sex Offender Registration and
Notification Act (SORNA) of Adam Walsh Act
Adam Walsh Act
•
A politically popular but wrong headed strategy
•
Requires sex offender registration based on offense – not risk
•
Research now proves that 97-99% of youthful sex offenders never commit another sex offense
•
Actually decreases public safety
AND NOW:
•
States are refusing to comply
•
Ohio does not comply fully
EBP Resources:
•
Campbell & Cochrane Collaboration Reviews
•
NREPP (SAMHSA)
•
Blueprints
•
CrimeSolutions
•
ChildTrends LINKS
•
Harvard Family Research Project
•
CA What Works Clearinghouse
•
National Child Traumatic Stress Network
Controversy in EBP
•
The great Mark Lipsey
•
Community –defined evidence
•
Push Back to developers
•
DMC (At the heart of Juvenile Justice Reform)