Matt Crestsinger, District Administration, Director of Special Services in Marshalltown, IA, shares how the school district has implemented Collaborative Problem Solving and the results they are seeing.

Transcript:

 

How did you become interested in Collaborative Problem Solving?

I was reading some of the works by Bruce Perry, and at the end of the most recent edition of his book, The Boy Who Was Raised as a Dog, it actually speaks a little bit to the Collaborative Problem Solving (CPS) process. I love the book, you know, it made a lot of sense to me. It was highly engaging. And so when I hear this, I'm like, well, I need to learn more. I found some materials online and did just some general reading about it. And then, I found some of the YouTube videos that were published. One in particular, it's a little more than an hour long, and it's Dr. Ablon just doing a general overview about Collaborative Problem Solving.

Well, I wanted to learn even more. So, at the time, there was an online opportunity to take essentially an online course. And I brought myself and a group of principals, some of my school counselors, we have these kind of social work type positions, and we all enrolled, and we took these classes. And we got done, and I sat around the table and said, "What do you guys think?" And they absolutely said, "We love it. That's exactly what we were talking about. We need to learn more." So, then I decided I need to get a group of people who are actually through the training. I'd been reading the literature online. Let's see where we have a Tier 1 training and how many people I can send. And after that completed, they came back, and I said, "What did you hear? What did you learn? What are the things you're excited about?" And they continue to promote of, "yes, the more we hear about this, the further we get into it, the more we agree, it's a necessary fit for us."

Bring CPS to Your School

We can help you bring a more accurate, compassionate, and effective approach to working with children to your school or district.

Learn How

What makes Marshalltown, IA, a unique community and school district?

We're about 5,300 kids. We have 11 attendance centers. 71% of our kids this year are eligible for free or reduced lunch, which is the ninth highest in our state. 31% of our kids are within the continuum of the English Language Proficiency Scale, which is the third highest in Iowa, and third most saturated in the state. Culturally, about 54% of our kids identify with Hispanic/Latino. 30% of our kids identify as White or Caucasian. 7.5% of our kids identify as Asian. About three and a half percent of our kids identify as Black or African American. And then everyone else will identify in a multi-categorical way.

So, we were trying to figure out “How do we work with this unique population to Iowa?” And I went with the principals, I went with our intermediate agency, they're called AEA or Area Education Agencies, and a group of like 20 went to a summer Tier 1. And we all came back with just our minds spinning of, “This is our missing piece. What do we need to do?”

And then fate happened. About two weeks later, an EF3 tornado came through our community. And in a community like ours, that is really a very blue-collar community, it devastated things. It hit through some of our major businesses and residential area. And so, many of our families were displaced, and they were dealing with trauma. So, we decided to bring Dr. Ablon in and address all of our staff for the first day of school, as well as then ask him to do some parent groups in the evenings. We got such tremendous feedback off of it that we thought, this is something that makes sense here in Marshalltown. This is something we need to develop and grow. And since 2017/18, we've been working to do that as systematic as we can.

What has changed since implementing Collaborative Problem Solving in Marshalltown?

I would say we're still early in, and we definitely have people who have bought into it and understand it and see the result. And we still have people that we're trying to onboard because it's just such a different way of thinking about supporting kids and families. Those who have really bought into it. It has changed the focus of the discussion. It's moved from things like, "Well, they would if they wanted to," or kind of those dead-end ideas of "This family's always been this way. I've worked with other kids," or "I was a teacher for the parents, and they were this way when they were that age." To a reframing of "What's happened to this kiddo? What about this situation is so difficult for them that I've seen them do this before, but today they can't."

And it's really made our conversations in those situations more solution focused, and it also improves the relationship. Checking in with kids and letting them feel like they have a voice and they have a choice. You just can't put money in the bank quick enough that way so that when you have those days where you have to really hold to your own expectations, that relationship is in a place where you can get some buy-in from the kids as well. And they don't always feel like you're imposing your will on them. So, we're seeing in settings where people are really invested in it, good relationships, ability to have difficult conversations, and really a problem-solving philosophy.

What are some of the results you are seeing in Marshalltown?

So, the first I'll talk about is one of our elementary schools. Its name is Woodbury Elementary, and it's a preschool through fourth-grade school. Before we began our work in Collaborative Problem Solving, we tracked many of the things most schools do: How many kids go to the office? How many kids are so aggressive that they require physical restraint? How many kids are in a situation where safety is such a big issue that we have to use exclusionary timeout? What are the factors that make the learning environment safe? Which our state of Iowa has a universal survey they do. At Woodbury, which has really internalized this work, we've seen a decrease since 2018/19 to last year: office referrals are down over 36%. The number of students who have two or more office referrals are down 49%. The need to use seclusion and or restraint is down by 28%.

And most importantly, so our state of Iowa has what they call the Conditions for Learning Survey. Then it's a survey that goes out to our staff members, our kids, and our families that asks about the well-being and the learning environments, really around SEL. Before this, that survey showed that Woodbury Elementary was 7% below the state average on emotional safety, how safe did kids feel in that school. Last year they were 7% above the state average. So, we've seen this significant swing in kids are feeling connected, regulated, and that it's a safe learning environment. I guess the other unique thing about Woodbury Elementary is that it is a dual-language school. So, our families who go there they learn in Spanish for half a day, and then they learn in English for half a day. And the general population of that school is really those families who are moving into Iowa that are completely Spanish speaking, coming from Mexico and other countries.

The last, and probably my favorite story a few years ago, we identified that there are, there are kids in schools that have serious underlying mental health conditions. And those create the behaviors that we see that are unsafe and that we really worry about. In Iowa, there's not a lot of facilities to work with kids who are beyond what most schools can work with. So we tried to create our own, and we call it the therapeutic classrooms. And in there, we have integrated CPS as our primary model into a trauma-informed approach. And we work with kids that usually would be placed in residential treatment or day school programs, or out-of-state kind of psychiatric facilities. And we are seeing success with 96% of the kids in there. And they range from kindergarten through ninth grade.

And I mean by success is if they were in their comprehensive schools, on average, they may have four, five, six behavioral incidents a day. They may have two to three behavioral incidents a month now. They're not running out of school; they're not destroying property. They're engaged in their learning. In fact, on our most recent state-required literacy academic assessment, every one of our 18 students made growth in literacy. And they're excited to come to school. Their attendance is way up. Their families who we had a really difficult relationship with for a variety of reasons. We don't have that kind of difficult situation anymore. They love our teachers; they love our little program. They love that there's a place that their kids can grow and learn and get their needs met. So those are the places I would talk about as a system. We're doing it and doing it well and seeing those great outcomes.

How does Collaborative Problem Solving support students with disabilities?

I want to share a couple things thinking through the special education lens. So federal law around special education really does dictate a variety of things that seem very prescriptive on how you have to think and approach supporting kids who may have behavioral challenges. Collaborative Problem Solving has been a game changer in a lot of our situations with kids with disabilities who have those behavioral struggles because not only does it address some of those underlying conditions that we never thought about, but it helps us then create a pretty clear way to do checks and balances along the way. A Plan B conversation is a great way to see how are things going in this element of the instructional skill-building that you're trying to do.

How does Collaborative Problem Solving integrate with SEL and PBIS in your schools?

So, our district is really committed to providing a full continuum of services to our families on social-emotional learning. And as part of that, then, my job as the director who oversees it was to gain as much knowledge and skills as possible. So first, I've been through the inaugural cohort of CASLE, the Collaborative for Academic Social-Emotional Learning, and have completed their fellows program. I've also completed two cohorts with the National Superintendents Associations, both mental health work as well as their SEL cohort. So, working with these folks has provided me with a really strong foundation about what is evidence-based, research-based, social-emotional learning across the continuum. What happens at school-wide, what happens within the classrooms, what happens within the teacher's mindsets. And having that together, we have created an infrastructure to support our needs of our kids.

Foundationally, we had to get on the same page about what are our common beliefs about kids. Many school districts will talk about Positive Behavioral Interventions and Supports (PBIS). And what we've learned about PBIS is that first, it's very regulating to kids to know what's expected of them across settings. Many times their life is a little bit out of control at home, and there's a lot of chaos. But knowing that when I walk into this school, if I'm in the cafeteria, here's what's expected of me. If I'm in the classroom, here's what's expected. That brings down some of the anxiety, to begin with. Our next piece, though, is ensuring that everything we do is based on our thinking with Collaborative Problem Solving, is relational. So, we've moved away in many of our locations from that, that token economy system, that reward system when kids are meeting expectations, to those relational interactions.

How does Collaborative Problem Solving fit with other approaches?

I would also ask people to look carefully at the components of the other approaches that they're using. Within our district, we think about a multi-step process. And so I talked a little bit about PBIS as a regulating system for all kids across all settings. We also use classroom approaches. Responsive Classroom is something we use at the elementary, and we have found that CPS has such a great companion component to that Responsive Classroom model that they go hand in hand. It's not, "Are we doing this? Are we doing that?" We're supporting all kids under a common framework, and the language compliments each other. With our older kids, Capturing Kids' Hearts has been an approach that we've found really beneficial. And again, as the language of CKH and the language of Collaborative Problem Solving, they support each other and the framework and the thinking behind it. So, I would say within an integrated system, there are going to be a number of components. You know, you're, you're making a stew here, and you've got a bunch of ingredients in this stew. And I've found that CPS is integrated very well into our stew that also has evidence-based and research-based behind every piece of it.

How does Collaborative Problem Solving build future-ready skills?

When I went to high school, and I'm not going to say how old I am, but when I went to high school, the idea was, Matt, if you go to high school, you need to go to college. And if you can complete college, you will get a good job, and your job skills will be taught to you on-site. Many of the things that I thought were skills back then, now I can learn from YouTube, or there's a video somewhere to teach this. The things that weren't taught to me that now we're hearing kids need to have are conflict resolution skills, problem-solving skills, critical thinking skills, and an internal drive to be successful in something with a level of independence. And so, as we think about now, those are our umbrellas or goals for those soft skills; Collaborative Problem Solving lends itself perfectly to it. You know, it's teaching kids how to deal with difficult situations in not getting upset, essentially, staying regulated. Something has happened that I wasn't predicting, and so I'm going to get upset about it. Let's pause; let's keep ourselves regulated and start problem-solving. How do we address this issue, whether it's with a task, a situation, or another person? It's a very generalizable set of skills, I would say, across all those soft skills for employability.

How are you engaging families in this work?

So, we have been working on engaging parents in learning about Collaborative Problem Solving through what we call either watch parties or community wellness nights that we're doing once a quarter. And families can come into our schools and see and learn more about it. I think the most engaging part about all of this is not only are we continuing to try to teach them about it, but now when we have school board meetings, we have families showing up saying, "I absolutely love that my child that I was getting phone calls on all the time for whatever reason. The phone calls I get now are positive phone calls, and that I'm seeing that my child, when I'm having difficulty with him or her at home, I can kind of engage in that process and generally work through it. And even sometimes my kids are coaching me, even elementary kids so that we can try to work through this conversation in a regulated way for a mutually agreed upon solution."

What has been a challenge in implementing Collaborative Problem Solving?

The other thing, and I'm excited and also a little bit embarrassed to say this, the kids take to it well and quickly. The implementation delays are really about the adults and dealing with our own internal conflicts of how we were raised, what we believe should and shouldn't be behavioral strategies, classroom management, or just innate skills that any adult or child should have at some age. But for the kids, when we do this and do this well as an approach, they pick it up like that. As I work with kids or talk with some of the buildings that work with kids regularly in this approach, three or four conversations in the kids can start to tell you what that next component is. What's that next step that you're going to talk to them about? And they actually engage in it as long as they see it's successful for them being heard and feeling like they have some choice; they will take you there if you let them. So that was another real surprise, of it's the kids that this is, you know, going super easy with. It's the adults that we're going to have to work through a variety of different things to try to get their neurocognitive skills, skills aligned with what we're doing here.

What has been most powerful about Collaborative Problem Solving?

I'd begin with just a philosophy. Not only do I love that they have a philosophy, but when you hear, you know, Kids Do Well if They Can, if kids could do well, they would do well. And so, our job is to figure out what are the things getting in the way of them doing well, like just that general umbrella of thinking to every situation. It was an a-ha moment for so many of us who went through either the online training or went in person to Tier 1. Because, like so many, it wasn't our thinking was what happened to this child or what is getting in the way for this child? It was, oh, they're just being lazy or, what is the bigger carrot or stick I can wave at them to get them motivated to do this? What do I need to do to compel them to move forward? Instead of, "What do I need to do to lift them up and support them so they can move forward?" So that first part was just amazing a-ha for so many of us. And it's so simple. Yes, it is skill problems. You're right. If I look at them, they are trying harder than most other kids that these skills are already there for, and it happens easy.

The Value of Implementation Frameworks: Using Active Implementation Frameworks to Guide System‐wide Implementation of Collaborative Problem Solving

Alisha R. Pollastri Ph.D., Lu Wang Ph.D., Soo Jeong Youn, J. Stuart Ablon Ph.D., Luana Marques

Abstract

In the last decade, many implementation frameworks have emerged that consolidate the research on implementation science, guiding purveyors and service agencies in improving implementation of evidence‐based practices (EBPs). In this paper, we describe how Think:Kids utilized the active implementation frameworks (AIFs) to define and standardize strategies for site‐wide implementation of Collaborative Problem Solving. We illustrate what implementation looked like before and after using AIFs to understand implementation, as well as some ways in which using the AIFs helped the purveyor identify, and then overcome, barriers to implementation. This paper provides a model for others who seek to use AIFs to guide their implementation practices, or more broadly, an illustration of how to use any implementation framework to ensure best practices in implementation.

Bring CPS to Your Organization

Are you interested in bringing Collaborative Problem Solving to your organization? We follow Implementation Science best practices as we work with organizations, institutions, and schools to implement CPS.

Learn More

Request the Research Paper

"*" indicates required fields

Requested Papers*
Subscribe

Crossroads Children's Mental Health Centre is a community leader developing and delivering a range of individualized mental health services solely for children under the age of 12 and their loved ones in Ottawa, Canada. They are committed to developing and delivering a wide range of mental health services to help children and families struggling with severe emotional, behavioral, and social challenges. No case is too complicated, complex, or severe, and they never give up on a child.

In 2008, Crossroads, and the larger mental health community in Ottawa, decided to explore different treatment approaches to better serve their hardest to help children. Think:Kids had the opportunity to look back at Crossroads’ journey and use of Collaborative Problem Solving with its Executive Director, Michael Hone.

 

At Crossroads, we were experiencing very good outcomes with the treatment approaches we used, but we had a subset of families where we didn't have as much impact. These families, about 20% of the clients that we served, would continue to come through the organization year after year. For that population, we thought we needed something different from the traditional operant kinds of treatment approaches.

We had also done a system review using the System of Care Practice Review, a tool that allows us to dive deep into the client experience of service. One of the things that came out of that review was that families reported they felt things were disjointed. Their experience within the system felt like they were constantly stopping and then starting something new as they received services from different agencies. In addition to Crossroads and the schools, families often worked with multiple other agencies, and none of us spoke the same language. We'd have different ways of approaching the situation, making it challenging for families to understand how best to help their children. That prompted us to think about doing things differently as a community in the context of treatment, to create consistency between organizations and less of that stop-start feeling that the parents were expressing to us.

These findings created the second goal that we had, which was to try and get a consistent approach to treatment for these harder-to-serve kids and families across multiple organizations. With a consistent approach and language, when a family aged out of our care, we would be able to transfer that family to the next organization that works with kids over the age of 12, and they wouldn't have to start over with a completely different treatment approach. That was the ultimate reason we pulled together multiple organizations and then set up a Community of Practice.

Our initial Community of Practice consisted of seven staff from five different organizations, each member was a key decision-maker within their respective organization. After vetting a number of programs we decided to check out Collaborative Problem Solving (CPS). What attracted me to CPS was it was a good fit philosophically with Crossroads. Our philosophy at Crossroads is we take the hardest to serve and we don't give up on the family. It doesn't matter how severe, how significant the issues are. We'll stick it out. If they start with us at the age of three, they'll stay with us right through to their 12th year, if they have to, until we can get it right. So philosophically, Collaborative Problem Solving's motto of “Kids Do Well If They Can” matches up nicely to our philosophy of not giving up on kids and families and feeling that there is something that we can do, we just have to figure out what that something is. It also resonated well with our team and it had enough evidence behind it that it felt like it was something to get involved with. I remember having a conversation with one of our partners that had a similar philosophy to ours and we both concluded that CPS felt right. It feels like it's the right side of something to be on in terms of the CPS guiding principal of Kids Do Well If They Can, rather than if they want to.

We applied for and received a grant to support our training in Collaborative Problem Solving. We also received funding to have ongoing supervision and coaching provided by Think:Kids after our initial Tier 1 training. We felt that by having the additional consultation, it would get us moving along as a community in a consistent way. That coaching helped us to begin the implementation process. It was especially helpful in the context of multiple organizations wanting to implement at the same time in different ways within each organization. The next year, we again applied for and received funding to support attending Tier 2 training and ongoing support of our Community of Practice. The coaching we received shifted focus to helping us learn how to coach others as it relates to the treatment approach.

While we started with five organizations in the Community of Practice, it mushroomed pretty quickly. We ended up with about 15 organizations participating. Its growth also allowed us to bring the school boards into the Community of Practice more meaningfully. And that was important. Again, a goal for Crossroads at that time was, these kids are in school all day, every day for the most part, and what better way to have an impact than bring in the school boards. We have four local school boards here in Ottawa that became involved in the process and participated in the Community of Practice. We had mental health representatives from the school boards present and did lots and lots and lots of training. Shortly after that, a number of us made it through Collaborative Problem Solving Trainer Certification, which gave us the capacity, both internally and locally, to train staff and others to continue the implementation.

Each year after that, we ensured a training budget was available to train all of our mental health providers and partners in the Ottawa area. Over the years we have probably trained a few thousand staff in the school boards and the mental health system. They're all trained in Collaborative Problem Solving. The Community of Practice lasted well after the training and continued until a few years ago when there wasn't a need for it anymore because each organization had reached internal capacity for any needed training by having staff become certified in CPS.

Organizations have continued on their own with CPS. We still work with the schools to try to help whenever they need it. We do training about once a year now in Ottawa on CPS that is open to the school boards and mental health providers, and they're always full to keep people trained and able to provide CPS here in Ottawa.

The Impact

After we had implemented CPS at Crossroads for the 20% of those hardest-to-help children, we noticed that we had better outcomes using CPS than we were having with the operant approaches. So we decided to implement CPS across our entire organization, rather than just in this particular program where we struggled most. So all families then, unless they're under the age of three, go through CPS as our primary treatment modality. We have other things that we do as well, but the core is always CPS. The other thing that we've built into our structure is that any approach that we implement at Crossroads is reviewed through the lens of CPS. If it contradicts the approach philosophically, then it's not something we implement. For instance, we have no behavior management programs in any of our programs because it doesn't fit philosophically. We'll implement things like mindfulness and trauma-focused work, but again, only once reviewed through the lens of CPS. We always ask, "How does this fit with CPS? Does it contradict CPS? Is it going to create any headaches for us in the end?"

While we'll always have kids with challenging behavior that come back for service, it's not to the same degree as it was before we implemented CPS. I also know that the school boards, for example, really appreciate Collaborative Problem Solving and find it very helpful. As do the our other providers in the community; they continue to this day with CPS and still have very positive outcomes as a result. And ultimately CPS doesn’t just resonate with the schools and service providers but with the families we all serve. In the almost 30 years I have been doing this I never hear a family say "I really like Cognitive Behavioral Therapy," or "I really like system's approach to therapy." Interestingly though, the feedback we get from parents, even to this day, is "I really like Collaborative Problem Solving," which I think in and of itself speaks pretty highly to the approach. You just don't get that with other approaches.

Advice to Others

The advice I would give to other organizations looking at CPS is to pay critical attention to how you will implement. The implementation science side of things is really important. The training is wonderful, everybody who goes through the training will enjoy it. It's the implementation that becomes the big, big challenge. My advice would be to do the training and get the implementation supports necessary for you to implement properly.

The other thing for organizations to be aware of is the approach challenges organizations, consortiums, and groups to rethink their system. To rethink your system, you can't just decide, “oh, I'll just implement this over here and see what happens.” In a very purposeful way, you've got to know that you need a good two, three years to think through, from an implementation science perspective, what this ought to look like, and how you will sustain it and maintain it over that timeframe. It likely wouldn't have been as successful in the community, if not for that implementation science lens.

 

Youth Villages Staff Talk About Collaborative Problem Solving

About Youth Villages: Youth Villages (www.youthvillages.org) provides help for children and young people across the United States who face a wide range of emotional, mental and behavioral problems. We work to find solutions using proven treatment models that strengthen the child’s family and support systems and dramatically improve their long-term success.

 

Video Transcript:

What is a Level 4 facility?

Hanson Adeyinka, Assistant Director of Residential Service: Level four is our most secure residential facility that we have. We have key cards that allow you access once you get in the building to go through all the different courtyards. So, it’s a more restrictive environment than maybe a level three where you don’t have locks on the cottage doors. The kids can pretty much move freely throughout the campus without staff having to scan a door to enter and depart.

What kind of kids are in your courtyard?

Gilmore Tierra, Program Manager: We have different seasons. At one point, we’ll have a bunch of kids that may struggle with self-harm. We have kids that typically exhibit development behaviors, physically aggressive behaviors; we have some kids who may be on the autism spectrum. It varies.

How do you think implementing Collaborative Problem Solving (CPS) has changed relationships between staff and kids?

Hanson: I think it’s greatly increased it. You have to build that rapport with the child, and you can’t just take their points and move on. You have to; if it’s a behavior that needs to be addressed, you have that time to address it. I think a lot of the courtyards have planned time on the schedules where they focus on having Plan B conversations and just spending that time talking with the child.

Gilmore: I think that the report is greater on the courtyard. You can just see it. You can see the change in the TCs (Teacher Counselors), and you can see the way that the kids respond to the TCs. It’s a whole lot of conversation going on. And I think that the TCs can appreciate that because they don’t like for the kids to be angry with them or to have difficulties with the youth throughout the day because they felt like it’s their job to, from the arm because they did this wrong, they moved wrong. So I had to fill them the urn. And now they’re angry at me about it because I did my job now. They feel like they’re able to efficiently do their job because if they can address the issue without doing something that they feel is negative or is associated with negativity. The youth respond differently, and we’re able to talk to these kids and come up with a solution to whatever the problem or issue may be.

What have been the culture changes since implanting CPS?

Gilmore: I’m happy we’re using CPS. I mean, at first, I think, I think everybody was skeptical about it. Like I said, the culture of the building was points. And if the kids did something, you felt earned it; then you moved on to the next thing. I think that now, we’re able to help the kids work their treatment because that’s what we’re here to do. We’re here to keep the kids safe. We’re managing them, and it’s, it’s efficient. It doesn’t have to be a punitive thing. We’re able to build relationships with the kids. The kids are more willing and open to talk to us, and you can use CPS with the adults too. So it works. It comes in handy because there are several times where I’ve had to have collaborative problem conversations with my staff to figure out what problems they were encountering or why they were having certain issues with kids. And so I think just all around, it’s just beneficial to the culture of YV [Youth Villages] if we’re truly trying to make progress and move forward with helping these kids.

Hanson: I think overall it’s just been a good culture change for us at Youth Villages. Just being able to converse with the children about the issues that we see, or the problems, or the lagging skills. And like she mentioned, it’s I say culture because we’re now utilizing Collaborative Problem Solving with our staff. I think that just alleviates so much anxiety from people when you know that it’s going to be a conversation versus just immediate boom, I’m dropping the hammer on you, boom, I’m taking points, boom, I’m just giving you this write-up. I think it allows for conversation. It allows you to get to root issues of what is the real cause for whatever the unmet expectation is versus just automatically coming in, and I’m going to just come down on you. Building the rapport is eliminating future major crises that could occur. I think any time when you build that rapport between a staff member and a child, there’s an emotional deposit. It’s going both ways, from the staff to the child and also the child to the staff member. And that’s just so crucial when you have those chaotic crisis moments, and being able to pull from those deposits you will help keep things safer. So I think overall, that rapport that’s being built between the staff and the kids.

Edited for clarity.

Youth Haven was founded in 1972 to fulfill an immediate need for emergency shelter for children who had been removed suddenly from a traumatic home situation. They continue to provide services and programs for Southwest Florida’s abused, abandoned, and homeless children and teens. Youth Haven’s 25-acre therapeutic campus houses over 70 youth with offering around-the-clock specialized care.

Kimberly Weisberg, LCSW, Director of Programs at Youth Haven, contacted Think:Kids for assistance in unifying their efforts toward trauma-informed care. Youth Haven was seeking a milieu management model that could be used by all team members and one that would bring them up to speed with current thinking around trauma-informed and trauma-sensitive practices. They could have provided trauma-informed training for their staff but wondered how to best help their direct care staff interact with the kids in a way that aligns with those principles. They were particularly interested in approaches that minimized the use of holds/hands-on techniques as part of their trauma-sensitive practices.

“At Youth Haven, we often take in the children that no one else wants. Our children have had numerous failed foster care placements due to their extremely challenging behaviors. We were looking for an approach that would give our staff of varying educational backgrounds the tools to help our children grow by increasing positive relationships and decreasing challenging behavior. Collaborative Problem Solving (CPS) is just that! This approach has helped our staff build meaningful relationships with our youth while helping them build skills and reduce the challenging behaviors that often got them into trouble. CPS also helped increase our staffs’ job satisfaction and decrease staff burnout! My only regret is that we didn’t start CPS sooner!”

—Kim Weisberg, LCSW
Director of Programs, Youth Haven, Inc.

Additionally, Youth Haven was interested in moving away from the use of ineffective level systems that seemed at odds with trauma-sensitive work. Their existing milieu management system was entirely built upon point and level systems, and they were seeking an effective alternative. Lastly, Youth Haven wished to have a unifying common language, process, and philosophy across all team members, from clinical to the milieu.

The Think:Kids Partnership Program was the right fit for their needs. Youth Haven began working with Think:Kids in 2019 with a readiness assessment, which helped Think:Kids develop a customized implementation plan suited to the organization’s needs. All staff members received intensive training and ongoing coaching to learn and effectively use the Collaborative Problem Solving® (CPS) approach. A majority of team members proceeded to train in more advanced concepts with a subset continuing to Certification in CPS. With further study, individuals will receive a Certification in Training which will enable them to train and coach staff internally.

Youth Haven Kids

To ensure the organization successfully adopted CPS, Youth Haven invested in Think:Kids providing leadership consultation focused on change management and robust data collection and evaluation. Throughout the process, Think:Kids and Youth Haven partnered to identify and track the philosophy shift, development of staff skills, use of the model, and associated outcomes. This evaluation process guided the next steps in implementation roll-out and, through regular reporting, enabled leadership to see promising outcomes and helped team members become even further invested.

“Our work with Think:Kids and the Collaborative Problem Solving approach has had a huge impact on Youth Haven by increasing our youth’s satisfaction during their stay, improved staff/client relationships, increased staff moral and employee job satisfaction, reduced our need for restrictive behavior management, and help staff feel confident that they have the ability to help our youth build skills which will help them be successful in future placements.”

— Kim Weisberg, LCSW
Director of Programs, Youth Haven, Inc.

Youth Haven will wrap up their Partnership Program at the end of 2021; however, early results already show success across several fronts. Surveys of staff indicate a dramatic decrease in the average degree of burnout over the course of CPS implementation. This is a crucial outcome given the high burnout that is typical amongst direct care staff and the resulting high turnover rates. Before CPS implementation, rates of holds and critical incidents were trending upward. Data collection shows that since CPS implementation began, these trends have reversed and are now declining.

Youth outcomes were assessed by comparing CAFAS scores before and after CPS was implemented. Total Score and subscales of Moods & Emotions and Behavior Towards Others improved to a greater degree after CPS was implemented. From intake to 3 months, more youth were rated as improved, and fewer as more acute, after CPS was implemented compared to pre-CPS implementation.

Together, these data suggest clinical improvement in these key areas since Youth Haven has been using CPS. Youth Haven’s final focus of the multi-year collaboration is now on completing Certification of key staff so they can serve as culture carriers who provide the internal capacity necessary for sustainability. Through monthly continuing education with Think:Kids, those select staff will remain energized as internal champions for the work moving forward once Youth Haven’s participation in the Partnership Program is complete.

Clinicians Do Well If They Can (especially during COVID-19)

Traci McCarty, LISW-S, Clinical Director at The Village Network, a multi-discipline behavioral health organization in Ohio.

The COVID-19 crisis has demanded that we shift our practice in many ways, and staff have responded differently to those demands. I have found it helpful to remember that it is skill, not will, getting in the way for some staff, and to practice Plan B when problems arise.

Two weeks ago, upon order from Ohio’s Governor to shelter in place, our agency, like many, started the transition to telehealth; providing clinical services to youth and families remotely through use of technology. This process required our clinicians to learn how to use a new software application quickly and then immediately shift to the role of “teacher” to their clients.

Within a 5-day period, clinicians were trained in the new software application, state regulations, and best clinical practices to support the change to telehealth.

Simultaneously, these same clinicians were adjusting to working from home while also navigating through their own fears about community spread, home-schooling, and limited access to practical necessities like toilet paper.  Many clinicians wondered whether they could be successful counseling clients by phone or laptop when they typically depend on using sensory regulating tools and relational-based interventions to capture and maintain children’s attention. It seemed that the conditions of telehealth appointments would make it likely that challenges and challenging behaviors would arise. The transition to telehealth meant that each clinician’s own emotional regulation and cognitive flexibility skills were being put to the test.

I noticed that one clinician in particular had not signed on to any of the required telehealth webinars or to the new software application. Zero clients were on the clinician’s schedule for telehealth.

Now, prior to our recent focus on implementing the Collaborative Problem Solving approach into our agency’s supervision philosophy, my response to this clinician would likely have been very “Plan A.” I might have assumed that this staff member was simply being uncooperative; avoiding the transition to telehealth to avoid having to put in extra work.  My response might have included performance-based tracking forms and corrective actions.

However, since we have implemented Collaborative Problem Solving into both our clinical model and into our supervisory practices, we hold tightly to the philosophy that it is skill, not will getting in the way when our youth or our staff aren’t meeting expectations. I turned to Plan B to find out what was getting in the way of this clinician delivering services via telehealth to clients.

I started the Plan B conversation neutrally. “I noticed that you haven’t attended the telehealth webinars or started transitioning your clients to telehealth. What’s going on?”

In rapid fire, the clinician immediately expressed several concerns that were getting in the way of being able to transition to telehealth. First, they felt anxiety around using any new technology, and they were not able to find the necessary software application on the desktop. The clinician also cited doubts that elementary-school aged clients, most of whose families had limited financial resources, would be able to engage via telehealth, due to lack of access to WiFi, computers, and mobile phones; even the libraries where many clients and parents typically accessed internet are closed due to state orders. Finally, the clinician was very concerned that telehealth sessions would not be clinically useful, and that they would instead result in the clinician staring at carpet and ceiling fans via webcam. (Any aunt, uncle, or grandparent who has tried to face-time with a 6-year-old can probably relate to this!)

Wow, I thought. That’s a lot. And every one of those concerns was valid. In asking for this staff member’s perspective, I learned something new that would likely help me be a more effective leader in the confusing wake of COVID-19. I surmised that other clinicians were likely experiencing the same challenges. I made a mental note to follow up with others.

The calming effect of the first ingredient created the safety for the second ingredient: I expressed two concerns. First, our agency wanted to avoid contributing to a community spread of the virus. Second, continued contact with clients could be helpful to maintain the clinical relationship, to check for worries or other mental health needs related to the virus, and to keep an eye out for critical needs or the need for crisis intervention.

With both sets of concerns on the table, the clinician and I brainstormed several solutions. Some of the solutions were quick and easy. As it turned out, there was a technology glitch that impacted the software application from displaying on the clinician’s desktop. We solved it with just one email to the IT department. Once the clinician could actually see the software application, the novelty of the application became much less intimidating.

The clinician identified several other flexible strategies to provide consistent services during this time.  One idea was using a hybrid model of phone calls and the web application, depending on the client’s level of access to the internet. In addition, the clinician requested permission to still provide face-to-face sessions when truly in the best interest of the client, utilizing all physical distance protocols and personal protective equipment. Finally, the clinician suggested that it would be helpful to have a plan for accessing technology support or a supervisor for quick troubleshooting if (and when) technology failed.

All of the solutions posed by the clinician were reasonable and do-able, and they met both of our concerns. In fact, the flexible options for using hybrid methods to connect, and the reminders of how to access supervisors and tech support were rolled out to every clinician to assure that no client was left behind in our shift to telehealth.

When an agency is preparing to implement the Collaborative Problem Solving approach, their leadership teams frequently ask Think:Kids for advice about collecting data. This is an important question, as agencies are being increasingly held accountable for tracking positive outcomes related to new interventions.

If you are an agency using (or thinking about using) CPS, we encourage you to think early and often about program evaluation! Below are three pieces of advice that we find ourselves giving most often:

  1. Find a comparison group if possible.  Sure, you can compare this year’s data (with CPS) to last year’s data (without CPS). However, some will wonder whether there are other time-related changes that might account for your improved results. The best way to show that CPS is resulting in improved outcomes compared to the conventional treatment is to do a direct comparison. You may not be able to randomize children to receive or not receive CPS, however, consider a quasi-experimental design: If your agency has two campuses, you could start the intervention on one campus prior to the other, and track outcomes on both. If you only have one campus, you might collaborate with a local agency that is very similar to yours in order to compare your data with their de-identified comparison data.
  2. Think longitudinally.  Two time points are better than one, and three are often better than two. Most importantly, be sure to collect data prior to starting the CPS intervention, not just afterward!
  3. Spend time planning what variables are best to measure at your agency. On our website, you will find a list of measures that Think:Kids recommends using to assess outcomes, based on the domain you wish to measure (symptoms, skills, etc.), your setting (inpatient, residential, school, etc.), and from whom you will be collecting data (child, parent, teacher, etc.). This list includes measures that have been used previously to measure change related to use of CPS as well as other measures assessing domains that we feel are relevant. Two such measures, developed at Think:Kids, are also available on this webpage: a research version of the Thinking Skills Inventory (TSI-RS), and a parent-report measure designed to track change over time in family and parenting variables proximal to CPS (TK-COT).

Do you have additional questions about evaluating outcomes related to CPS?  If so, contact the Director of Research and Evaluation at Think:Kids.

For several years I had thought about implementing the Collaborative Problem Solving approach at Brown School, but I could never find traction to get the initiative rolling. A host of conventional thoughts prevented me from getting started; I don’t have the budget, my teachers are far too busy already, all that darn testing, how can we possibly find the time? In the spring of 2013, my school counselor attended the Collaborative Problem Solving all day workshop at a conference. She returned energized about a common sense, empathic approach to helping children solve problems. Her energy made me think of the old proverb, “The best time to plant and oak is thirty years ago. The next best time is, now.” In August of 2013 the faculty and staff of Brown School in Natick, Massachusetts began the Collaborative Problem Solving Journey.

For CPS to take hold in the school I knew I had to lead the initiative. I didn’t want the faculty and staff to think that this is an approach only for mental health professionals. I have taken several steps to demonstrate my commitment to CPS and how it could improve teaching and learning at Brown. First, Dr. Larry Epstein conducted a three hour training to begin the school year. He gave a comprehensive presentation that was energetic and engaging for the audience. Afterward, the faculty commented how valuable the training was for starting the school year. I reassured the staff that we would work on developing our CPS skills as the demand presented itself. In other words, “Don’t worry. I will help you with this initiative (reassurance).”

Later that year I attended the three day level one training with my school psychologist and guidance counselor. The training provided us the the structure and confidence we needed to begin making some deep attempts at CPS. We decided to give it a try. If our first attempts didn’t turn out so well, we would try again. That entire spring we worked with faculty and students using CPS to solve problems. We brought our learning back to the faculty and committed thirty minutes to every faculty meeting learning more about CPS.

It wasn’t long before an interesting dynamic began to happen. As teachers observed us working with students collaboratively, they began to ask more questions. Soon we were observing and coaching teachers while they worked on solving problems with students. It became more common for me to cover a teacher while she worked with a student on a problem.

At the same time I noticed that I was using CPS for difficult situations with adults. I quickly learned, “Adults will do well if they can!” It was amazing to experience the change in adult behavior when two people took the time to listen to each other. I once read a quote that said, “Are you listening to understand or listening to respond?” That quote has remained embedded in my thoughts and is present every time I sit down to have a difficult conversation. The beauty of CPS is; if you listen for understanding, your response has a much greater chance of making a difference.

Another way that CPS has impacted our school is in the child study process for academic, social, and emotional supports. Our conversations have shifted to identifying the lagging skill of the child and designing interventions that directly impact the lagging skills. Conventional talk has reduced and creative solutions for building skills has increased. The number of IEP referrals has dropped dramatically and I have only had six referrals from parents for special education in the last two years. Our IEP rate for students receiving learning center support has dropped to below 5%.

If principals really want to prepare their students and teachers for a new age then they need to teach them the problem solving skills that will help them solve problems that don’t exist today. I encourage all principals start Collaborative Problem Solving in their school NOW! Don’t wait thirty years.

Kirk Downing
Assistant Superintendent, Natick Public Schools, [former Principal, Brown Elementary School] Natick, MA

J. Stuart Ablon Ph.D.

Science tells us why spray and pray training doesn’t work.

I’ve spent the last 20 years traversing North America and beyond conducting trainings for all kinds of organizations. Some are one-day trainings, others intensive three-day workshops. When I started doing this, the field now known as implementation science didn’t even exist. But since then, much research has been done to study whether trainings like this are effective by examining whether people actually do anything different after learning new things. We’ve done our own empirical research as well. And the jury has been back in for a while now: spray-and-pray training doesn’t work! Trainers like me swoop in and spray training over a group of people and head back home praying that what we’ve taught will stick. The data going back almost twenty years now suggest that people’s knowledge of the content taught will definitely increase if they like the topic and presentation is interesting. However, very few people will actually do anything different. One study from 17 years ago in schools showed that only 5% of participants do anything different even though they learned a lot. Imagine all of the time and money we waste on professional development seminars that fall prey to this reality!

But don’t worry–there is good news! Best practices from implementation science provide a clear path forward that mirrors what I’ve learned the hard way over the past couple of decades. You need to pay attention to four key things if you want training to stick:

1. Start by Assessing Readiness

I’ve seen so much valuable time and resources wasted over the years by organizations jumping headfirst into training when they really weren’t ready yet to take on something new. If they had attended to some of the things getting in the way before launching, it would’ve gone much better. Sadly, if someone or someplace isn’t ready, their experience will be negatively impacted and they will think the training “doesn’t work” or “isn’t worth it,” and it may be hard to come back to it successfully again later.

2. Get Training AND Coaching

The good news here really shouldn’t be a surprise to us. When we try to teach ourselves to do new things, what we are really attempting to do is change our brains. And we’ve actually learned a lot in the past few decades about how to change the brain. We know that we must follow the principles of neuroplasticity which tell us that one massive dose of information (like a whole day) in an artificial environment (like an auditorium) without opportunity for real-time practice can’t possibly change the brain. On the contrary, we need to provide ourselves with lots of small doses with spacing in between and opportunities to practice in the actual environment in which we are trying to utilize the new skills we have learned.

Fortunately, that same research I cited above showed that if you follow training with access to regular coaching where people are practicing in their real environment, 95% of people start to implement what they’ve learned. Amazing! So, whether you are a leader who seeks out professional development for your staff or an individual looking to learn anything new, make sure to follow your initial dose of learning with opportunities to practice repetitively in small doses with guidance and feedback from an expert.

3. Monitor How It’s Going

If you are trying to learn to do something new, you better have a way of monitoring how well you are doing it. In implementation science, we call this “fidelity monitoring.” It’s amazing how often we spend lots of time and money trying to teach people new things but don’t invest in any way of evaluating whether it’s working, i.e., whether and how well people are doing that new thing. So, make sure you have a way of assessing how well people are doing it so you can adjust your training and coaching plan accordingly.

4. Become Experts

One of the most frustrating things I’ve witnessed in our work is how hard it is to make something stick for the long haul. Sustainability. We’ve had situations where we work with programs for years to get them really good at our approach, and then the leader retires, the second in command moves to another organization and all of a sudden all the progress fades away. The secret to sustainability is making sure you create a team of culture carriers who are your local experts and carry the torch long after the initial training and coaching are done. We accomplish this through our certification program where we ensure organizations end implementation with a team of certified experts.

Implementation Science and You

You can apply these lessons to anything you want to learn or any behavior you want to change. It is especially important to be mindful of these factors with the hardest things to make stick.

So, the next time you want to learn something new or change your own behavior, keep these four keys in mind. And if you are trying to do the tough work of changing a whole system, it’s even more important to follow these guidelines. Good luck!

 


References

Fixsen, D. et. al (2005), Implementation Research: A Synthesis of the Literature

Joyce, B., & Showers, B. (2002). Student Achievement Through Staff Development (3rd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.

Pollastri AR, Ablon, JS, Hone M, eds. Collaborative Problem Solving: An Evidence-Based Approach to Implementation Across Settings. New York, NY: Springer Science + Business Media, 2019.

As originally featured on the Changeable blog on Psychology Today

Skip to content