Quality Assurance
Checks and Balances
Identifies potential issues before significant systemic problems occur and determine the level of changes, needed to correct the deficiencies;
Office of Quality Assurance Monthly Newsletters
In 2016, the Alabama Department of Youth Services chose to be a part of the national Performance-based Standards (PbS) community. PbS provides a wealth of information about what happens daily in residential facilities and programs essential for ensuring the safety of youth and staff, for data-driven decision-making, demonstrating accountability, and reporting successes. PbS also describes the quality of life in facilities through timely, quantitative, and qualitative data showing change over time and performance in comparison to other facilities and programs across the country.
WHAT IS PERFORMANCE-based STANDARDS?
WHY PERFORMANCE-based STANDARDS?
DYS values youths’ constitutional rights to reasonable safety, adequate medical and mental health treatment, rehabilitative programming, and education.
DYS values youth input for information about the facility or program safety, quality of services, and staff relationships to provide a comprehensive picture of facility life.
Data on how youth, staff, and family members view the facility or program has; led to increased focus on improving practices that directly relate to positive outcomes for youth.
WHAT DOES PbS MEASURE?
The outcomes are derived from information collected from surveys:
- One administrative form to collect general information about the facility, population, procedures, and staff;
- All incident reports filed during each of the data collection months to provide the facility with the ability to analyze the frequency and kinds of incidents that are occurring;
- A minimum random sample of 30 youth records to capture information about the youths’ experiences and services received during their time at the facility;
- A minimum random sample of 30 surveys of youth and staff to gather feedback about facility conditions, quality of life, staff-youth relationships, and services;
- Surveys of all families of all youth leaving the facility to learn about the families’ experiences with the facility, relationships with staff, and ability to stay connected to their child; and
- Exit interviews of all youth released to provide a youth’s perspective on his or her experience while at the facility, programming, staff, and preparedness for leaving.
All PbS facilities are provided with a PbS coach, a juvenile justice expert who provides support throughout the year by telephone and email and who visits once a year to guide implementation of PbS. The coach works with facilities to use the data reports to develop Facility Improvement Plans (FIPs), which are entered into the PbS website and shared widely to engage agency leaders and staff in its implementation. Agency leaders, facility staff and the PbS coach monitors the FIP using on-line comments that create a living document for reform and records change strategy.
PbS uses data to provide the Alabama Dept. of Youth Services with outcome measure reports on a variety of areas including:
THE PbS DATA-DRIVEN IMPROVEMENT MODEL PROVIDES:
Goals & Standards
PracticeS & Policies
A blueprint of best practices and policies to implement to meet the standards.
Information architecture
Improvement Planning
Improvement plans guiding the steps necessary to use the outcomes and information to create successful and sustainable reforms.
Networking
A national network of professionals sharing information, tools, and approaches to provide the highest quality of life and services.
PbS INTEGRATION
Improvement Cycle
1. Data Collection
Twice a year PbS participants collect information by surveying youth, staff, and families, reporting administrative data, unusual incidents, and services offered by the facility or program. The information is entered into the PbS website or transferred using the PbS application program interface.
2. Analyzing Performance Outcomes and Summary Data Reports
At the end of each data collection period, PbS reports show how a facility’s services and performance meet the PbS standards in safety, order, security, programming (education), health/mental health services, justice, reintegration, and connection to family and social supports. Participants are given analysis tools to identify what works and what needs to be improved. For example, participants see outcome data compared to their previous data collections and to the PbS field. PbS also provides summary data reports for every data collection form that shows the total responses for each question and provides details that help diagnose outcome results. PbS Teams look at the reports, align the information with agency and facility goals and strategic plans, and identify specific areas and outcomes they want to improve.
3. Creating Improvement and Reforms
Using the analysis of the data, participants work with a PbS coach to develop an improvement plan that sets the targets for change and the strategy and individuals to implement the improvement plan. The improvement plan is entered into the website and monitored for effectiveness by staff, agency leaders, and the PbS coach. The plan becomes a living document for the PbS Team to measure successes and ensure the facility is meeting its goals and PbS standards.