HomeMy WebLinkAboutreacheval-fy2022-2023-evalreport-final-reach10logo2022-2023 Evaluation Highlights
REACH Ashland Youth Center
Evaluation
Framework:
Results-Based
Accountability
How much did we do?
•Who did REACH serve?
•What trends or differences do these data show?
How well did we do it?
•How satisfied are youth with REACH?
Is anyone better off?
•How has REACH supported or helped youth?
•What proportion of youth who visit REACH report
that REACH has helped/supported them?
REACH
partners work
together to
achieve the
following
result areas…
•All youth are healthy physically, mentally, and
emotionally.
•Youth are supported by safe and nurturing
communities.
•Youth are actively involved in making decisions in their
community.
•Youth succeed academically and socially.
•Youth are prepared for and engaged in jobs leading
towards a career.
•Youth are supported by safe and nurturing families.
•Systems are integrated, and care is coordinated and
equitable.
Inquiry: Academics + Post-Graduation Opportunities
Fiscal Year 2022-2023 Evaluation: Youth Focus Group Highlights
Academics
+ Learning
at REACH
Four focus groups were conducted in May
2023 to explore youth perspectives,
challenges, successes, and recommendations
related to academic success.
Focus groups were organized by age:
1.7th/8th graders
2.9th/10 graders
3.11th/12th graders, and
4.Youth no longer in traditional high
school/ transitional age youth
Focus Group Findings
1.Academic success, success + options after
high school
2.REACH supports academic achievement +
post-high school pursuits
3.Youth emphasized the importance of
financial security
4.Youth lack information about options after
high school
1. Ideas about
Success
▪Youth defined academic success in academic
measures (e.g., maintaining a high GPA).
▪Many youth articulated hopes that one day
they could secure a well-paying job and have
financial security.
▪Some youth—especially youth from
immigrant families—underlined the
importance of maintaining a job to be able to
financially support their families now. They
explained that that was as important as their
academic performance.
“Being successful…
is just being able to
survive… being able to
afford things, to have a
roof over your head.”
—Transitional Age Youth Enrolled in
the Opportunity Academy at REACH
2. REACH supports academic achievement +
post-high school pursuits
•Youth identified that REACH
creates a safe space and
supportive environment overall.
•Youth also noted that HAT
ensured that youth had time
without distractions to check in
about and complete homework
assignments.
“I feel like when REACH was built, and when I
started coming here, it gave me a sense of
freedom where I could just be a kid. And honestly,
REACH is like family to me. And so I feel like every
time I come here, I could be weird and I could just
be myself… I feel like they accept me for who I am.
They accept everyone. I feel like this is what the
community needs. And I feel like there should be
more places like this.”
— 11th or 12th Grade Member
“This place kind of helped me turn my life
back [around]. I was at home doing nothing
and had no community [because] I didn’t
really have any friends like that. [REACH]
helped me open up my perspective with art,
and it helped me build skills…”
— 11th or 12th Grade Member
“[A specific REACH staff person and REACH
alum] is somebody I trust my education
with a lot… He says community college —
[so now I think] let’s do it.”
— 9th or 10th Grade Member
2. How REACH
Supports Academic
Achievement + Post-
High School Pursuits
Youth appreciated the
guidance, support, and
mentorship they have
received from REACH
staff.
2. How REACH
Supports Academic
Achievement + Post-
High School Pursuits
“I feel like [REACH staff] has been
a big help, for me and my sister.
For example, [REACH staff] helped
my sister apply to a college and
she helped my sister get her first
job, and she’s still trying to help
her. And for me, she’s trying to
help me with my resume so I can
start looking for a job.”
— 11th or 12th Grade Member
Youth reported
receiving encouragement
and support to find jobs
and internships at
REACH.
3. The Importance of Financial Security
•Across the focus groups, REACH members
expressed concern about future financial
stability, often because of financial hardship
and financial insecurity they experience at
home.
•Youth emphasized the importance of reducing
their family’s financial burdens, now and later
in adulthood.
•They identified a desire for financial
independence and an interest in learning skills
related to personal finance, including money
management, filing taxes.
•Many youth expressed an interest in
learning more about job skills and
career options. They explained that
they would like to learn how to:
▪Put together a resume
▪Apply for a job and navigate a job
interview
▪Get experience working
▪Run a business
4. Insufficient Information to Plan Effectively
Lack of understanding
of high school
graduation
requirements
1
Lack of information
regarding job/career
options + steps/
prerequisites
2
Lack of familiarity
with options for
higher education after
high school
3
Recommendations (Youth)
1.IN PROCESS! Lower Youth-to-Staff Ratios:Youth noted that they felt REACH staff were stretched thin, and that a greater youth-
to-staff ratio would benefit both staff and the youth. Likewise, a greater youth-to-staff ratio would allow youth and REACH staff
to form closer relationships and stronger support systems.
2.Mentors + Life Coaches:Across all focus groups, youth were interested in having individual mentors (or mentors with only a few
mentees) and life coaches. The youth emphasized that having someone to guide them and provide support throughout their
high school and college careers would be extremely beneficial. By having a personal mentor or life coach, they could develop a
close relationship with a role model that they could come to for additional advice and support outside of their school and
home.
3.Testimonies from Older or Past REACH Members:Many of the youth (especially the youth in middle school) were interested in
testimonies from older REACH members who benefitted from and utilized REACH resources, so that they can consider how to
best make use of the resources REACH has to offer.
4.IN PROCESS! More Information on REACH Resources:Youth expressed interest in more information about the range of
resources are available to them at REACH, especially related to paid internships and jobs. Most youth had heard of possible
internships from REACH staff or friends but did not have a clear understanding of how to apply for an internship.
Recommendations (Youth)
5.IN PROCESS! Provide workshops on a range of topics (mental health, procrastination, personal finance, job options/career
pathways, etc.)
•Mental health: Some youth discussed their struggles with mental health and depression, and how that has impacted their education.
•Procrastination:Many youth expressed challenges with procrastination, and noted a range of factors that contribute to their
procrastination, including distractions at home and feeling anxiety and/or uncertainty regarding many aspects of their schoolwork —
including how to choose courses and how to complete school assignments. The youth suggested that REACH could provide workshops that
explore strategies to tackle procrastination and discuss tools youth can develop and use to create healthy study habits (as well as provide
support to other REACH members).
6.Provide Evening/Weekend Hours + IN PROCESS! Programming for Older Members:The older youth expressed an interest in
keeping REACH open later to accommodate and attract older REACH members. This would also allow youth to have a safe place
to gather in the late afternoons.
7.IN PROCESS! Provide additional opportunities to explore career opportunities: Youth noted the importance of job fairs and
support to explore possible career options
8.IN PROCESS! Provide additional opportunities for youth internships
9.Consider dedicating a space in REACH for youth to do homework and to get additional academic support
Recommendations (Evaluator)
1.Increase middle school student awareness of high school options
2.IN PROCESS! Expose young people to critical thinking (for example, gaining
awareness and skills related to thinking critically about fake news, data sources, etc.)
3.IN PROCESS! Expand opportunities to a range of post-high school options
4.IN PROCESS! Expand opportunities for paid internships
5.Explore the possibility of establishing volunteer mentors (e.g., for youth 18+)
Questions?
REACH Attendance + Participation
Fiscal Year 2022-2023 Evaluation
How
much did
we do?
Five-Year Attendance Trend
1,833
798
1,003
81
1,438
615
787
79
983
186
768
76
1,438
371
1,030
80
2,062
575
1,474
87
0
500
1,000
1,500
2,000
All youth engaged through
REACH (including via Fuente)
Unduplicated youth
via REACH front door
and/or activities
Unduplicated
Fuente clients
Unduplicated youth
referrred to COST
FY 2018-2019 FY 2019-2020 FY 2020-2021 FY 2021-2022 FY 2022-2023
Participation in REACH Program Areas
152
207
224
164
189
12
0
50
100
150
200
250
Recreation Education Arts &
Creativity
Career &
Employment
Health &
Wellness
Leadership &
Advocacy
Number of REACH Members Participating in
Specific Program Areas in FY 2022-2023
Between 26% and 38% of
REACH Members active in
FY 2022-2023 participated
in each of the five main
program areas.
Average of 14.8 days at
REACH (per active member)
and 13.3 days with recorded
program participation.
19% of members do not
have data on activity
participation
Active REACH Members’ Primary Languages
Only a language other than English
16%
Language(s) not recorded
16%
English plus another language
21%
English only
47%
REACH Members Active in FY 2022-2023 (n=588)
Household Settings for Active REACH Members
Non-parent (not kin)
0.5%
Unclear (probably non-parent)
2%
Single father
2%Non-parent (kin)
5%
Two-parent
9%
Single mother
12%
Not recorded
14%
Parental (not specified)
56%
REACH Members Active in FY 2022-2023 (n=588)
Where Active Members Live: Communities*
0.2%
0.2%
0.2%
0.2%
0.2%
0.2%
0.2%
0.2%
0.3%
0.5%
0.5%
3%
5%
6%
10%
20%
52%
Berkeley
Fresno
Manteca
Modesto
Richmond
San Leandro
Vallejo
Waco, Texas
San Lorenzo
Fremont
Union City
Castro Valley
Not recorded
Oakland
San Lorenzo
Hayward
San Leandro
*Cities below reflect members’ mailing addresses and are not aligned with the
jurisdictional boundaries of the incorporated cities included in the list below
(n=588)
Where Active Members Live: ZIP Codes
0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%0%1%1%1%1%1%1%1%2%2%3%3%3%5%6%
10%
14%
45%
ZIP Codes Where REACH Members Live (n=588)
School Districts for Active Members
* COST referrals and OA students without Kid Trax/member IDs
** BUSD, NHUSD, parochial/private, community college, unspecified continuation HS
47%
26%
9%
5%
4%
4%2%2%1%
SLZUSD
No data recorded
ACOE (OA at REACH)
No Kid Trax data*
HUSD
SLUSD
OUSD
CVUSD
Other**
(n=58
8)
27
148
12
6
13
10
13
42
56
70
136
55
No Kid Trax data
No data recorded
Year Not Recorded
2015-2016
2016-2017
2017-2018
2018-2019
2019-2020
2020-2021
2021-2022
2022-2023
Not updated yet (OA at REACH)
Most recent school data in Kid Trax for active members
Grade Levels for Active Members
7
25 34 27 21 16 13 8
5
27 28 33
25 26 25 50
218
0
50
100
150
200
5th 6th 7th 8th 9th 10th 11th 12th No longer in
high school
Missing
data
2022-2023 Grade in Kid Trax Estimated Grade Level in 2022-2023 (based on available data)
Member Demographics: Race/Ethnicity
1%
1%
2%
2%
3%
4%
6%
11%
31%
39%
American Indian or Alaska Native
Native Hawaiian or other Pacific Islander
Other (unspecified)
Declined to state
White
Asian
Not recorded
Multiracial
Black or African American
Latino/a/x
(n=588)
87%
2%
8%3%
BIPOC
Declined to state
Not recorded
White alone (non-Latinx/Hispanic)
(n=588)
Member Demographics: Gender + Age
Male
46%Female
49%
Transgender
0.2%
Gender Queer
1%
Questioning
0.2%Decline to state
1%
Not recorded
3%
Gender (n=588)
2%
7%
14%
13%
12%
11%
10%
10%
4%
3%
4%
3%
2%
2%
1%
0%
3%
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
DOB missing
Active REACH Members by Age (n=588)
Free/Reduced Price School Meal Participation
64%
17%
19%
School Lunch Program Participation (n=588)
Yes No Not recorded
Additional Data: COST Referrals
65
25
15 12
3
Metal health/emotional
primary or secondary
reason for referral
Social primary or
secondary reason for
referral
Health/basic needs
primary or secondary
reason for referral
Academics primary or
secondary reason for
referral
Vocational/career
primary or secondary
reason for referral
Reasons for COST Referrals
Demographics for Youth Referred to COST
3%
9%
12%
11%
8%
14%
16%
7%
8%
2%
1%
6%
1%
2%
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Age (n=111)
38%
56%
1%
1%3%
1%
Gender (n=111)
Male
Female
Gender Queer
Transgender
Decline to state
Not recorded 1%
1%
2%
2%
3%
3%
10%
13%
29%
38%
Asian
Native Hawaiian or other Pacific…
American Indian or Alaska Native
Declined to state
Other (unspecified)
White
Multiracial
Not recorded
Black or African American
Latino/a/x
Race/Ethnicity (n=111)
Outcomes of COST Referrals
22%
55%
6%
1%
16%
Outcomes (n=111)
No COST referral but on CCM caseload in 22-23
referred + connected to services
referred but declined services
referred; declined/nonresponsive
referred; declined/non-responsive
Fuente Health Center: Clients + Visits
57%
41%
9%6%
Medical/Health
Education
Dental Behavioral
Health
Case
Management
Percent of Total Clients Utilizing Service
(n=1,474)
54%32%
10%4%
Percent of Total Visits
(n=5,572)
Medical/Health Education
Dental
Behavioral Health
Case Management
Note: There may be duplication errors across clients who received dental and other services.
Average number of visits
per client by visit type:
▪Medical/health education =
3.6
▪Dental = 2.9
▪Behavioral health = 4.2
▪Case management = 2.7
29%
66%
5%0%
Age (n=866)
Children (0-15)
TAY (16-24)
Adults (25-64)
Older Adults (65+)
62%
36%
0.2%1%1%
Gender (n=866)
Female
Male
Transgender
Non-binary
Another
12%
0%
6%
74%
1%
3%
4%
Race/Ethnicity (n=810)
African American/Black
American Indian &/or Alaskan
Native
Asian
Hispanic/Latino
Native Hawaiian &/or Other
Pacific Islander
White/Caucasian
Other (includes multiracial and
self-identified as other)
Fuente Patient/Client Demographics
Spring 2023 Member Survey Highlights + Trends
Fiscal Year 2022-2023 Evaluation
How well
are we
doing?
Additional Demographics for Members
32%
31%
28%
9%
English PLUS Another
Language
English ONLY
Null
Non-English ONLY
Languages Spoken at Home
(n=146)•Been arrested, in
jail/prison, or on
probation/community
supervision/parole
•Been in foster care or the
child welfare system
•Been homeless, lived in a
car or other vehicle, or
had an unstable/
temporary living situation
(e.g., transitional housing,
couch-surfing, living in a
motel)
19%
13%
64%
4%
Since you were born, have you and/or
any of your family members experienced
one or more of the following (see right)?
(n=105)
Yes I am not sure No I prefer not to answer
Experience at REACH
17%
33%
20%
9%
21%
Question 1: When did you first come to
REACH? (n=144)
In 2023 (Jan-present)
Between summer 2022 and Dec
2022
During the 2021-2022 school year
(July 2021-May 2022)
2-3 years ago / between summer
2020 and summer 2021
More than 3 years ago (during or
before spring 2020/beginning of
COVID-19 pandemic)
44%
43%
35%
31%
11%
8%
3%
2%
2%
0%
8%
Arts & Creativity programming
Recreation programming
Education programming
Career & Employment programming
Counseling services or therapy
Medical or dental services at FHC
Youth ERA
REACH-AYC TAY Resource Line
Restorative and/or Community Circles
The Nest / Kidango
None
What REACH programs, activities, or services
have you participated in or utilized in the past
12 months? (n=143)
Satisfaction Measures
98%
98%
91%
67%
The people who work at REACH treat me with
respect. (n=133)
The people who work at REACH expect me to
do my best. (n=130)
REACH programs/services address my needs
and interests. (n=132)
REACH has helped me understand how to get
resources for me and/or my family. (n=132)
How are
REACH
members
doing?
Additional Survey Data -Result Area 1: All youth
are healthy physically, mentally, and emotionally
27%
63%
10%
Have you felt so sad or hopeless almost every day for 2 weeks or more
that you stopped doing some usual activities? (n=108)
Yes No Not sure
Additional Survey Data -Result Area 2: Youth are
supported by safe and nurturing communities
98%99%
Other youth at REACH
generally treat me with
kindness and respect.
(n=133)
I feel safe at REACH.
(n=133)
REACH members reporting…
40%
38%
20%
2%
Do you feel safe in your neighborhood all
of the time, most of the time, some of the
time, or none of the time? (n=117)
All of the time
Most of the time
Some of the time
None of the time
Indicator of
success:
REACH
Members
speak up
against bullying
•All youth are healthy physically, mentally, and
emotionally.
•Youth are supported by safe and nurturing
communities.
•Youth are actively involved in making decisions
in their community.
•Youth succeed academically and socially.
•Youth are prepared for and engaged in jobs
leading towards a career.
•Youth are supported by safe and nurturing families.
76%
94%93%
2021
(n=54)
2022
(n=101)
2023
(n=129)
REACH Members try to stop bullying
when they see it happening
REACH Members Speak Up Against Bullying
For comparison: San Lorenzo Unified 2021-2022
California Healthy Kids Survey (CHKS) data
Overall (students in all racial/ethnic groups):
•30% of 7th graders
•22% of 9th graders
•25% of 11th graders
•34% of non-traditional students
Just for Black/African American (non-Hispanic) students:
•37% of 7th graders
•25% of 9th graders
•14% of 11th graders
Just for Latinx or Hispanic students:
•31% of 7th graders
•20% of 9th graders
•27% of 11th graders
12%
21%19%
36%
33%39%
38%30%
36%
14%16%
6%
0%
25%
50%
75%
100%
2021
(n=50)
2022
(n=98)
2023
(n=106)
Finishing my schoolwork without reminders
Very Difficult
Difficult
Easy
Very Easy
Increased Ease + Less Difficulty Finishing Schoolwork
Less Difficulty Planning Ahead to Finish Projects
12%
22%19%
41%
42%
37%
33%
26%41%
14%10%3%
0%
25%
50%
75%
100%
2021
(n=50)
2022
(n=98)
2023
(n=106)
Planning ahead so I can turn a project in on time
Very Difficult
Difficult
Easy
Very Easy
How Are
REACH
Members
Better Off?
76%73%70%
96%
76%
83%
2016
(n=45)
2017
(n=190)
2019
(n=43)
2021
(n=96)
2022
(n=101)
2023
(n=133)
Percentage reporting the people who work at
REACH help them do better in school
42%
41%
1%16%
2023 responses:
“The people who work at REACH
help me do better in school.”
Strongly Agree
Agree
Disagree
Strongly Disagree
Does not apply (I did not need help with this)
REACH Helps Youth Do Better in School
77%
85%83%
60%
70%
2017
(n=186)
2019
(n=110)
2021
(n=94)
2022
(n=101)
2023
(n=131)
Percentage reporting that REACH has helped
them get along with friends and peers
“REACH helped me
get along with friends
and other people.”
"The people who work at REACH
help me get along better with
friends or other people my age."
REACH Helps Youth Navigate Peer Relationships
27%
2023
(n=133)
Strongly Agree
Agree
Disagree
Strongly Disagree
Does not apply (I did not need help with this)
38%
2022
(n=101)
Additional Survey Data -Result Area 1: All youth
are healthy physically, mentally, and emotionally
79%
76%
68%
REACH has helped me be better able to cope
when things go wrong. (n=122)
Because of REACH, I have a place to go when I
need health and wellness services like a doctor,
dentist, or counselor. (n=123)
The program and/or the people who work at
REACH helped me learn how to deal with stress
or anxiety better. (n=133)
Additional Survey Data -Result Area 2: Youth are
supported by safe and nurturing communities
83%
2%16%
REACH has helped me consider different
perspectives and information when making a
decision. (n=121)
Strongly
agree/agree
Stongly
disagree/disagree
Does not apply 87%
0%13%
Because of REACH, I feel like there is an
adult who cares about me. (n=123)
Additional Survey Data -Result Area 3: Youth are actively
involved in making decisions in their community
76%82%
As a result of participating in
programs at REACH, I have become
actively involved in improving my
community. (n=123)
REACH has helped me understand
other people’s points of view (that
are different from mine). (n=122)
REACH members reporting…
77%
3%
20%
My ideas matter and help improve
REACH
Strongly
agree/agree
Stongly
disagree/disagree
Does not apply
Additional Survey Data -Result Area 5: Youth are prepared
for and engaged in jobs leading towards a career
80%
71%
53%
Feel prepared for a job. (n=123)
Have learned job skills. (n=122)
Have gotten a job or internship. (n=123)
As a result of participating in programs at REACH...
Additional Survey Data -Result Area 5: Youth are prepared
for and engaged in jobs leading towards a career
91%86%
77%
63%
77%
43%
Have learned job skills.Feel prepared for a job.Have gotten a job or
internship.
Youth Who Participated in Career & Employment Programming vs. Youth Who Did Not
Youth Who Participated
in Career &
Employment
Programming
Youth Who Did Not
Participate in Career &
Employment
Programming
On a scale of 0 to 10, how likely are you
to recommend REACH to a friend?
Not likely Very likely
9.04 / 10
Questions?