Author: Dr. Jeremy Sharp

  • 490. Google Reviews: Receiving, Responding, and Forgetting

    490. Google Reviews: Receiving, Responding, and Forgetting

    Would you rather read the transcript? Click here.

    Today, we’re tackling one of the trickiest aspects of running a psychological practice in the digital age—Google Reviews. Whether you love them or hate them, online reviews are a major factor in how potential clients perceive your practice. But as psychologists, we don’t have the same freedom as other businesses when it comes to managing them. We’ll dive deep into the ethical and legal concerns of online reviews, including the APA guidelines that prevent us from soliciting them. We’ll also discuss how to handle negative reviews without violating confidentiality, strategies for getting them removed when possible, and how to build a strong online presence that makes reviews less relevant in the first place. Here are some topics that we cover:

    • Why online reviews matter and how they impact potential clients’ decisions.
    • Whether you can (or should) ever ask for a review—and alternative reputation-building strategies.
    • The best ways to respond to negative reviews while staying ethical and professional.
    • How to optimize your Google Business Profile so that search results work in your favor.
    • What to do when you get a false or misleading review, and how to fight it.
    • Why focusing on referrals and SEO strategies may be your best long-term solution.”

    Cool Things Mentioned

    Featured Resources

    I am honored to partner with two AMAZING companies to help improve your testing practice!

    PAR is a long time supporter of the Testing Psychologist podcast, and I will continue to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 490 Transcript

    [00:00:00] Dr. Sharp: Hello, everyone. Welcome to The Testing Psychologist podcast. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    Many of y’all know that I have been using TherapyNotes as our practice EHR for over 10 years now. I’ve looked at others and I just keep coming back to TherapyNotes because they do it all. If you’re interested in an EHR for your practice, you can get two free months of TherapyNotes by going to thetestingpsychologist.com/therapynotes and enter the code “testing”.

    This episode is brought to you in part by PAR.

    The Personality Assessment Inventory Bariatric compiles the results of the PAI into a useful report for bariatric surgery candidates available on PARiConnect, PAR’s online assessment platform. You can visit parinc.com/products/pai-bariatric.

    Hey everyone. Welcome back [00:01:00] to the podcast. Today, we are tackling one of the trickiest aspects of running a practice in the digital age—Google Reviews. Whether you love them or hate them, online reviews are a major factor in how clients perceive your practice, but as psychologists, we don’t have the same freedom as other businesses when it comes to managing them.

    We’ll dive deep into the ethical and legal concerns of online reviews, including the APA guidelines that prevent us from soliciting them, we’ll also discuss how to handle negative reviews without violating confidentiality, strategies for getting them removed when possible and how to build a strong online presence that makes reviews less relevant in the first place.

    Here are some other topics that we’ll cover: We’ll talk about why online reviews matter and how they impact potential clients’ decisions, whether you can or should ever ask for a review, best ways to respond to negative reviews and staying ethical and professional, how to optimize your Google business profile so that search results work in your favor, what to do when you get a false or [00:02:00] misleading review and how to fight it, which happens sometimes, and why focusing on referrals and SEO strategy may be your best long term solution.

    So if you have dealt with negative reviews, we certainly have, this is the episode for you.

    If you want some support with your practice, I would be happy to help you. My mastermind groups are full at this point, but I am doing one-off strategy sessions for folks who want to dive in for an hour and work through as many questions as we can or dive deep on a specific topic. It’s relatively solution focused. I’ll send you away with some pretty, hopefully, helpful tips and ideas to move forward. So if that sounds good to you, you can check out thetestingpsychologist.com/consulting and book a strategy session right from the website.

    Alright y’all, let’s talk about Google Reviews.

    Okay, [00:03:00] everyone. We are back and we are talking about Google reviews. I have a story and a half to start off this conversation. The half story is that first of all, our Google reviews are generally terrible. I think the average is about 3.8 stars, something like that. Our reviews are pretty much universally divided into either 1 star or 5 stars. So if any of you run larger practices or somehow get a lot of Google reviews, you maybe experience the same thing.

    Just to set that out at the beginning to maybe normalize any experience, we have probably 25 or 30 reviews at this point. And like I said, they’re pretty evenly split between 1 star, which is largely folks who disagree with the [00:04:00] billing aspect of their evaluation and primarily, that’s insurance. They don’t understand what insurance means or how much they’re responsible for in spite of tons of communication from our practice, or 5 stars, and those are folks who love their evaluation and decided to let us know. So that’s the half story.

    The full story that I’ll tell you is I had a coach, probably 5 or 6 years ago, Ken Clark, who some of you may know. He had a great response when someone asked, “What do you do when you get a bad Google review?” The first thing he said was, “Roll my eyes.” Since then, I’ve taken a little softer approach, but if that gives you any indication of how much we should truly care about Google reviews, then that provides a little context.

    I am going to start this podcast talking about why Google Reviews [00:05:00] matter, but as an overarching theme for this discussion, just know, like I said, we have 25 or 30 reviews. It’s about 3.5 or 3.8 stars. We have plenty of business, that hasn’t affected us at all, but I would love for you to have a better experience with Google reviews and maybe learn to manage and respond to them appropriately.

    So let’s start with why do Google reviews even matter? Well, because people use them. So here’s the reality. Online reviews are a powerful tool these days. I’m sure that y’all have used online reviews to look at restaurants, movies, experiences and any number of other things.

    So that matches the research. Studies show that 84% of people trust online reviews as much as personal recommendations, and 90% of consumers read reviews before making a decision. This is 100% true for me. I will [00:06:00] research every decision to death, and reviews are a big part of that.

    However, as psychologists, we cannot operate like restaurants or retail businesses when it comes to reviews. The dilemma is that if you’re a private practice clinician, you know that word of mouth referrals are your bread and butter, but what happens when a potential client googles you and sees a low star rating or a single bad review?

    Even if you have years of experience and stellar credentials, that one review might be the only thing that they see, which just does not feel fair. But the challenge is that we’re ethically restricted from soliciting reviews and confidentiality prevents us from responding directly. So we’re going to dive into the nuances here and see if there is a little bit of room to navigate this tricky space.

    First topic, can you ask for reviews? Well, [00:07:00] no, you can’t. Here’s why. If we look at the APA code of ethics, there are several principles that apply here. One is confidentiality, which is section 4: we must protect client information at all costs. Even acknowledging someone as a client via a thank you reply or a response to a review is a breach of confidentiality.

    Section 3 talks about avoiding exploitation. So, asking for reviews, even from past clients might create undue influence. They might feel pressure to leave a review out of obligation, especially if there was a positive relationship.

    This is where I got hung up. I went down this path of thinking, oh, with an evaluation, we don’t have an ongoing relationship. What if I just reached out to people who haven’t been seen at our practice in a year?

    And as I dug into the [00:08:00] research, I’m sure you’ll get other answers. I’ve seen it in Facebook groups and whatnot. Some people are talking to their attorneys and their attorneys are saying, “Hey, it’s okay to do that. You can go ask for reviews from past clients in our situation.” But after doing a bunch of research for this episode, I landed in the opposite place. I think asking for reviews, even from past clients, is dicey.

    The other part of the code that is relevant is Section 5, where we talk about advertising and public statements. So ethical advertising has to be factual and not misleading. So encouraging reviews or soliciting reviews from clients could theoretically create a biased representation of services. Interesting. So that’s the dark horse here. I would not have thought about that necessarily. Confidentiality, avoiding exploitation, makes sense, but the last one provides a little extra context.

    So think about it, if you ask for reviews only from happy clients, [00:09:00] you are essentially creating a skewed portrayal of your services, which could be seen as misleading. What do you do instead? You could encourage professional colleagues to endorse your work, build credibility through community involvement and focus on SEO strategies to outrank third-party review sites.

    So as we transition here, just to wrap up, soliciting reviews from past clients still presents ethical risks under the APA ethics code, and should be avoided, but there are some alternative strategies that could be ethically and legally sound. So let’s dive in here. Are there any ethical ways to request reviews?

    Direct solicitation of clients is ethically risky, like we said, so here are some workarounds. One, you can solicit reviews from non-clients. So if you are out in the community and you [00:10:00] provide workshops, training or consultations to professionals, even parents or others in the community that are non-therapeutic, that do not run through the therapeutic or assessment aspect of your practice, you could ask for reviews about those services.

    An example might be, you’re out in the community and you provide a talk for teachers on classroom management of ADHD. You could certainly solicit reviews from them after the talk and invite them to write a review on your Google My Business profile.

    We’re going to talk a lot about your Google Business Profile, but that’s going to be a cornerstone of this approach. You want to make sure and have a Google Business Profile, and you can direct non-clients there to leave feedback on these educational or consultation services.

    Another way that you can get feedback is to [00:11:00] create an anonymous feedback system. So instead of public Google reviews, you could do a private feedback form. This is essentially the approach that we have taken recently. So we have a Google Form that we send out automatically to clients after they complete their evaluation. This allows you to collect testimonials while protecting client confidentiality.

    With explicit permission, you can display anonymous feedback. For example, “Parent of a 10-year-old child with ADHD,” rather than someone’s full name. And you can put that information on your website in a testimonial section. I have no problem whatsoever with an anonymous testimonial section on your website. I think it’s actually pretty helpful.

    3rd strategy is that you could encourage referrals, but not reviews. So instead of asking clients for reviews, you could put a statement in your informed consent or even the evaluation or final [00:12:00] paperwork that you send people. Something like, if you were satisfied with our services, we’d appreciate you referring others who might benefit from an evaluation.

    Keep it simple, keep it direct. It might feel a little salesy, but I’m a big fan of transparency the older I get. So I think you can say directly, hey, this is how our business runs. Word of mouth is really important. If you had a good experience, we’d love to help any of your friends and family that you think might be a good fit. So this avoids the public testimonials while still fostering that word of mouth growth.

    The 4th strategy is what I would call passive encouragement. So what you can do is create a general review page on your website where clients voluntarily leave feedback without being asked. An example, follow-up email after you finish the evaluation. You can include something like, we’re always looking to improve. If you’d like to share your experience, feel free to provide [00:13:00] feedback here, and then you link to that site.

    The key here is that it should be completely voluntary and non-directed. So you can’t say, would you leave us a Google review? It’s more like, help us get better. If you’d like to share your experience, go here. Again, this goes to your website. It does not go to Google Business Profile.

    There is this question about third-party review sites. Google Business Profile is the main one that people are going to be looking at, but there are these third-party sites that aggregate reviews and will show up in search results. So I’m talking about Healthgrades, Vitals or RateMDs, not really talking about Yelp. That’s in there, but I feel like it’s declining in popularity, but they will automatically create profiles for providers and then allow clients to leave unsolicited reviews.

    I [00:14:00] have reviews out there on a number of these sites. It’s frustrating because they automatically create profiles for you but here’s the ethical approach to handling these. Just make sure that your profile has accurate neutral information on it. Avoid soliciting reviews. If people leave them organically, that’s fine. And then do not respond publicly on these third-party sites because this can confirm their client status.

    So all that said, what do we do with negative reviews in order to handle negative reviews? In order to handle negative reviews ethically, there are two components: One is a no response rule. I think engaging with negative reviews is usually a [00:15:00] bad idea.

    And when I say engaging, I mean actually responding. We’ve already determined you can’t respond in any way that confirms that that individual is a client. There is always a confidentiality risk, even a neutral response can confirm that someone was a client if you give any indication whatsoever that you know them, you worked with them or anything like that.

    So no response in my mind is always the best response, but if you do respond, you keep it very general. You do not confirm or deny the client status, obviously. You offer a direct contact option to discuss concerns.

    An example, “Our practice values feedback, but due to confidentiality laws, we cannot confirm or discuss any client relationships. If you have concerns, we encourage you to reach out to us directly at the number or the email address.” [00:16:00] So if you have to respond, that’s an okay way to do it.

    My attorney advised me to do something slightly different and I’ll talk about this in the section on optimizing your Google Business Profile to minimize the impact of reviews. What she advised us to do is to put a statement in the Google Business Profile that just generally states, hey, due to confidentiality laws, we cannot respond to reviews or solicit reviews. If you would like to get a sense of our services, please talk to our practice or look on our website for testimonials.

    And this is almost the introduction text on our Google Business Profile. It’s a blanket statement that lets people know, hey, we can’t respond to reviews and we’re not even allowed to solicit reviews. So you’re going to see some negative reviews here, but just trust [00:17:00] we’re actually a nice practice and we’d love to show you how we operate.

    Let’s take a break to hear from a featured partner.

    Y’all know that I love TherapyNotes but I am not the only one. They have a 4.9 out of 5-star rating on trustpilot.com and Google, which makes them the number one rated Electronic Health Record system available for mental health folks today. They make billing, scheduling, note-taking and telehealth all incredibly easy. They also offer custom forms that you can send through the portal. For all the prescribers out there, TherapyNotes is proudly offering ePrescribe as well. And maybe the most important thing for me is that they have live telephone support seven days a week so you can actually talk to a real person in a timely manner.

    If you’re trying to switch from another EHR, the transition is incredibly easy. They’ll import your demographic data free of charge so you can get going right away. So if you’re [00:18:00] curious or you want to switch or you need a new EHR, try TherapyNotes for two months absolutely free. You can go to thetestingpsychologist.com/therapynotes and enter the code “testing”. Again, totally free. No strings attached. Check it out and see why everyone is switching to TherapyNotes.

    The Personality Assessment Inventory Bariatric or PAI Bariatric compiles the results of the PAI into a useful report just for bariatric surgery candidates. Log into PARiConnect, PAR’s online assessment platform where you can administer the PAI and select the bariatric score report to view results based on bariatric presurgical candidate norms. Learn more at parinc.com/products/pai-bariatric.

    Let’s get back to the podcast.

    All right, let’s talk about optimizing your Google Business Profile to minimize the impact of reviews. And then, [00:19:00] in a bit, we’ll talk about what to do if you get a false, misleading or unfair review.

    Here’s the thing, with Google Business Profile, Google is going to prioritize active, well-optimized business profiles. And if you don’t know what Google Business is, it’s easily googled. You should have a Google Business Profile.

    Here’s what you can do to help your practice stand out even without reviews:

    1. Fully complete your Google Business Profile. That means address, services, website link, contact information, et cetera. It’s very easy to sign up.

    2. You can use Google posts. These are weekly updates like blog links, FAQs or educational content. You can do a lot with Google posts and it’s pretty cool. A lot of people overlook it, but it’s an easy option to optimize your Google [00:20:00] Business Profile.

    3. Add high quality images and videos. You could take high quality pictures. You can hire someone to come in. There are plenty of people out there who will take photos of your office space. So office space, team photos, you can post your headshots, workshop presentations.

    Videos are great. If you, as the practice owner, want to make a short, less than 1-minute video that you can post to your profile, just describing your practice and what you do, that goes a long way.

    4. Utilize the Q&A feature. There’s a Q&A feature on Google Business Profile. You can preemptively add common questions and answers, like, do you take insurance? What’s your wait time? What are your specialties? Who do you like to work with? Things like that. So you can preemptively add common questions and answers to your profile.

    5. Build [00:21:00] citations on other professional directories. You can be active and do a Psychology Today profile, a TherapyDen profile, or even Healthgrades or RateMDs, those sites that I discussed earlier. You can proactively create profiles on those sites.

    6. And then the last thing is that you can drive website traffic through search engine optimization. So blogs, resources, appointment links, that kind of thing. You can post all those things to your Google Business Profile and it will help optimize it and minimize the negative impact of reviews.

    A lot of us, if you get a negative review, there’s always an outside chance that it is not correct, not fair or not accurate. I have a lot of stories of clients who just get upset and may or may not have even been seen by the [00:22:00] practice and they write a review.

    So let’s talk about what to do if you get a false or unfair review. First things first, what counts as a fake, defamatory, or misleading review? A fake review is something like a review left by a competitor or disgruntled individuals who were never clients. An example might be a negative review from someone you’ve never seen that says, “They misdiagnosed my child.” So that’s a fake review, pretty straightforward.

    A defamatory review is a false statement that damages your reputation. This would be a review saying, “This psychologist is a scam artist who lies on reports to help parents win IEP meetings.” This type of review might qualify for a legal removal request via Google, and I will talk through that policy here in just a second, but defamatory is going to make statements that damage your reputation.

    This did happen to [00:23:00] me on a third-party site. I think it was RateMDs, but someone posted a statement saying, it’s so interesting. In the statement, they said, “I don’t know this person, but he’s running a practice that is taking advantage of individuals and billing them inappropriately.”

    In this client’s case, they just didn’t understand the billing process and we billed them correctly, but here we are. So that threaded into the territory of defamatory.

    The third option here is misleading or confidentiality breaching reviews. This will be something that whether the client actually contains or includes personal health details. An example would be like, I saw Dr. Sharp for an ADHD evaluation and they got my diagnosis completely wrong. In this case, you can also flag that [00:24:00] review citing confidentiality violations.

    So here’s the thing. It’s going to be hit or miss as far as responding to anything that you flag. I think Google is often unresponsive and to be honest, your best bet is probably to bury the bad review by taking some of the actions that I described earlier rather than relying on the review getting removed.

    Let’s close by understanding Google’s review policies and instances that might count to get them reviewed. First of all, here’s what will not get removed. Google will not remove reviews simply because they are negative, even if misleading or if you can’t verify the reviewer was a client. Google now [00:25:00] allows anonymous reviews and we can’t break confidentiality anyway.

    What will Google remove? They will remove fake or spammy comments. So if they were left by bots, competitors or options like that, they are clearly fake. They will remove hate speech. So if there’s offensive language or discrimination in the review, they will possibly remove it.

    They will consider removing irrelevant content. So this is something that’s not related to your business, but like a personal attack, for example. And then they might remove confidentiality violations. So if a review discloses a diagnosis or private health details, you might have a case.

    So how do you do that? One, you go to your Google Business Profile and click reviews. You find the problematic review, and then there should be a three dot menu there and you can [00:26:00] select report review. You choose a violation reason like inappropriate content, fake, spam, or whatever. And then you ask colleagues, staff, or anybody you trust to also report the review because Google is likely to take action if multiple reports are filed.

    If the review includes PHI, Protected Health Information, mention that in your report. So you can say, this review contains personal health details violating confidentiality laws. As a psychologist, I’m legally prohibited from responding and this review puts my practice at risk of violating privacy regulations.

    So after you do that, what happens? Google may take weeks or just never respond. And if that happens, you can move to the next phase in the process. So you can escalate the review with Google support.

    So if flagging the review doesn’t work, you can escalate it. [00:27:00] You can go to your Google Business Profile help center, click contact us, select reviews and photos, and then manage customer reviews. And then you request a call or a chat or an email response.

    Once you get on the phone with them, just be professional, be concise, reference their review policies, especially if there’s PHI involved. Mention how you’re ethically restricted from responding, which makes the review unfair.

    If this doesn’t work, you have one last resort, and that is legal removal. So if the review is defamatory, false, or violates privacy laws, you can file a Google legal removal request.

    How do you do this? You go to Google’s content removal form. You select Google search and defamation of personal information. And then you have to clearly explain why the review is harmful, false, or problematic. And then if applicable, you can reference [00:28:00] HIPAA or the APA ethical guidelines.

    This might work if the review contains PHI or private information, or if it’s clearly defamatory and harms your professional reputation. Some attorneys have had some success sending formal demand letters to Google, though that approach is slow and rarely guarantees removal.

    All that said, is there a way to preempt future negative reviews? I think so. You can add a no online reviews disclaimer in your informed consent. Just saying to protect confidentiality, we do not request or respond to online reviews. If you have feedback, please contact us directly.

    And then you can encourage positive reputation reviews without asking specifically. So private feedback through surveys, like I mentioned, workshops, build relationships with other professionals [00:29:00] and so forth.

    There is a lot to take away here. This may be one of those episodes where you can check the transcript in the show notes, which will have links to each of the resources and sites that I mentioned.

    So here’s the thing, don’t ask for reviews from clients. I think it’s ethically risky no matter how you structure it. I would not respond at all to negative reviews, if you do, keep it incredibly generic and don’t even address the client directly.

    You can use your Google Business Profile to optimize your listing and direct traffic away from the negative reviews and rank higher in Google. And if you do get a negative review, there are lots of steps that you can take to try to get it removed or deal with it, or eventually just bury it with reviews from local professionals.

    [00:30:00] I would not rely on Google to remove the review for you. It never happens. I think I’ve requested two or three times and just never heard back on any of them.

    Thank you as always for listening and Godspeed when it comes to online reviews. I hope that you never get a negative review, but if you do, maybe now you have some sense of how to go on.

    All right, y’all. Thank you so much for tuning into this episode. Always grateful to have you here. I hope that you take away some information that you can implement in your practice and in your life. Any resources that we mentioned during the episode will be listed in the show notes so make sure to check those out.

    If you like what you hear on the podcast, I would be so grateful if you left a review on iTunes or Spotify or wherever you listen to your podcasts.

    And if you’re a practice owner or aspiring practice owner, I’d invite you to check out The Testing Psychologist mastermind groups. I have mastermind [00:31:00] groups at every stage of practice development; beginner, intermediate, and advanced. We have homework, we have accountability, we have support, we have resources. These groups are amazing. We do a lot of work and a lot of connecting. If that sounds interesting to you, you can check out the details at thetestingpsychologist.com/consulting. You can sign up for a pre-group phone call and we will chat and figure out if a group could be a good fit for you. Thanks so much.

    The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a [00:32:00] substitute for professional, psychological, psychiatric or medical advice, diagnosis or treatment. Please note that no doctor-patient relationship is formed here and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified advice of any mental health practitioner or medical provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 487 Transcript

    [00:00:00] Dr. Sharp: Hello, everyone. Welcome to The Testing Psychologist podcast. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    Many of y’all know that I have been using TherapyNotes as our practice EHR for over 10 years now. I’ve looked at others and I just keep coming back to TherapyNotes because they do it all. If you’re interested in an EHR for your practice, you can get two free months of TherapyNotes by going to thetestingpsychologist.com/therapynotes and enter the code “testing”.

    This podcast is brought to you in part by PAR.

    The NEO Inventories Normative Update is now available with a new normative sample that is more representative of the current U.S. population. Visit parinc.com/neo.

    Hey, everyone. I am back today with a business episode. I’m talking with Brie Chrisman from Boss Co. [00:01:00] She’s the founder and CEO Boss Co, which is an operations management company that works 100% virtually with mental health practice owners. She has over 15 years of experience in the project management operations fields, and she’s taken a different approach to making an impact on businesses.

    She has revolutionized the way businesses operate by introducing the solution for overwhelm for practice owners. Her commitment to being human first has led to her serving practice owners and folks in the mental health field specifically, which is a unique niche. And like I said in the episode, I’m very grateful for folks in these ancillary fields who have chosen to take us under their wings and help us with business things.

    So today we’re talking all about onboarding. When I say onboarding, I mean the whole process of getting clients into your practice and into their first appointment. You might think, okay, there’s not a whole lot to say about that, but as we dive into the episode, [00:02:00] that will become clear that there is quite a bit that goes into the onboarding process.

    So we start with an overview just of operations in general, and then quickly move into a deep dive about the onboarding process. So we’re talking about what should your website look like. What are your calls to action to get clients to reach out? What do you do with those calls to action?

    How often do you follow up to get people scheduled? How many follow-ups do you do? What does the onboarding process look like once they’re in your practice? How do you send paperwork? All kinds of questions like that. So if you have ever found yourself with questions or feel like there might be gaps in that process in your practice, this is a great episode for you.

    Before we get to the conversation, we are coming down to the wire as far as openings in my mastermind coaching groups, which start on the first week of February. So if you’re interested, if you’re a practice owner at any stage of development and you’d like to [00:03:00] join a group and get some support and some coaching to take your practice to whatever stage you’d like to take it to, you can go to thetestingpsychologist.com/consulting and get a pre-group call to see if it’s a good fit.

    All right, with that said, let’s get to my conversation with Brie Chrisman.

    Brie, hey, welcome to the podcast.

    Brie: Hey, thank you, Dr. Jeremy. I appreciate it.

    Dr. Sharp: Dr. Jeremy.

    Brie: Dr. Jeremy.

    Dr. Sharp: That’s really nice. I’ll take it. I usually just do Jeremy and any opportunity to bring in …

    Brie: Give the credit where credit’s due. I’ll do Jeremy the rest of the podcast, though.

    Dr. Sharp: That’s fair. That was my moment of glory here. Thanks. I’m excited to chat with you for many reasons. [00:04:00] One is because you live 10 minutes from where I grew up in the small town area of South Carolina, which is totally crazy. We figured that out and I feel a connection with you.

    Brie: It is such a small world.

    Dr. Sharp: Yeah, there really is. So there’s that, but then you’re also going to talk with me about operations and onboarding in our practices, and that’s also a topic that a lot of us need some help with. So I’m glad that you’re here. Thanks for being here.

    Brie: Thanks for inviting me. I was excited that we talked what month or two ago about what it would look like for me to come on the podcast, especially not being a therapist. And so being able to talk about something that we’re really passionate about, and also we can help therapists with is really great.

    Dr. Sharp: Yeah. We’re always grateful for you folks out there who choose to make a career out of helping us. That’s maybe a good place to start. I would love to know [00:05:00] why this is important. Why pick mental health psychologists or therapists for your target audience?

    Brie: It was a fluke, but it’s a fluke that I’m glad that happened. So when I first started my company almost five years ago, I got some clients that were therapists, and then our company grew solely off referrals. Of course, those referrals came from therapists and then we’re therapists. And then 90% of our clientele were therapists.

    And so we dug deep and figured out, okay, where do we want this to go? We love working with therapists of all kinds, we love being in the mental health space. I’m very passionate about mental health and making sure that we can advocate for ourselves and people who can’t advocate for themselves, and it was great. I wasn’t called to be a therapist. I was called to be an operations person. This is my way of [00:06:00] being able to make an impact.

    But why it’s important to us, this world that we live in is so chaotic and we’re getting bombarded all the time with so many situations, issues, and things. As a practice owner, there are 8,500 things that you have to do probably on a daily basis. You’re carrying such an emotional load with your clients, but then you have a business to run as well.

    So what I am passionate about is making sure that we can take the burnout out of owning a practice. So that way, practice owners’ mental health is a little bit better. And that trickle-down effect which you see all the time, when people’s mental health is improving, the trickle-down effect in their family and the people that they interact with, that trickles down to associate therapists, and that trickles down to their families, their clients, and so on and [00:07:00] so forth. So it’s our little rock in the pond of how we can help mental health.

    Dr. Sharp: I love that. I think we forget about that. As practice owners, I’m speaking for myself, it’s easy to take things on, keep going and end up maybe … I don’t know if I’d use the word burnout as something that has happened but even people have burnout as the rock bottom place or even leading up to that, like if you’re at 8/9 out of 10, you don’t have to be at a 10 out of 10 for it to affect your work, your employees and your clients.

    Brie: You don’t have to be a 5 out of 10. A lot of therapists that we work with are at that, they’ve hit that proverbial wall where they’re like, I [00:08:00] just want to burn it down and go back to being a solo provider with no EHR, just doing things on Google Docs and running with whatever app-based payment.

    Or they want to grow, but they can’t because they don’t have the systems in place or time to train people or way to onboard new people. And so they come to us and they’re like, I literally don’t know what to do, or they’ve grown too fast and then everything is breaking. So it’s one of those three things, and the solution is the same for every single one.

    Dr. Sharp: Oh, that sounds really nice. We’re going to talk about that.

    Brie: Yeah, it’s exciting.

    Dr. Sharp: I’ve experienced all of those things at different points. I’m guessing there are people out there who also have. So note to self, if you are considering burning everything to the ground and going to Google Docs and a paper calendar, [00:09:00] this might be for you.

    Just tell people what your company does. It’s probably nice to set the stage and then we’ll go a little bit deeper into this whole idea of operations and onboarding.

    Brie: My company is called Boss Co. We are a system strategy, growth and operations agency. We work with practice owners on the back end. So you think of practice growth, you think of marketing and you think of client acquisition, client retention, that sort of thing, but that’s not the only thing that is part of your practice. You have your operations on the back end.

    So we look at practices and see how efficient they’re running, how their company culture works, what the CEO’s day-to-day looks like, and helping practice owners remember that it’s not just a practice. They’re [00:10:00] not just a practice owner, they are a CEO. They are a business owner, even if you’re the only person in your practice, you’re still a CEO.

    And so being able to help them step into that CEO role, and be able to lead and empower their team, and also maximize the resources that they already have, whether that’s people or software or whatever you’re using to help you run your practice on a daily basis.

    Dr. Sharp: I love that you’re pointing out the whole CEO mindset right from the beginning. And it’s so true. Even solo practice owners, it’s hard to wrap our minds around that identity.

    Brie: So out of all the schooling that you go through, how many business classes did you get?

    Dr. Sharp: Zero.

    Brie: Exactly. You look on Instagram or Facebook or just do a quick Google search of how to run my practice. I can tell you, there’s probably pages on Google of different people that will tell you how to [00:11:00] start a practice, how to grow your practice on Instagram or marketing, networking, whatever but there’s no one to teach you how to run your practice; how to actually do the things you need to do to run your practice, because that’s a total different beast.

    And the ones that do still focus on and they’re like, we have operations, but it’s not really helpful or it’s DIY, and they just throw a bunch of information at you and it’s not helpful because it’s not translated into non-operations terms. So we’re trying to close that gap.

    Dr. Sharp: I’m glad that you’re out there. It’s exciting to think about marketing and getting people in the door and that kind of thing, but back-end operation stuff is not sexy exactly, so it’s easy to overlook it.

    Brie: So much. We think it’s sexy on our [00:12:00] end, but that’s because we’re operations people. You’re right, it’s not like the revenue income reports that you have on Instagram. People say, I’m completely booked out, I have X amount of clients or we’ve brought in this much, that’s great, but what does your bottom line look like? Because you could be bringing in a million dollars in revenue but you could still be in the red, depending on how you’re running your practice.

    And something that we’ve been honing in on with our clients and constantly banging our heads against the wall shouting to people is that if you keep your expenses low and you keep that bottom line low, then if you lose clients, you’re not in an oh crap mode. You’re not like, oh my gosh, I have to get so many more clients So that just makes your profits even higher.

    [00:13:00] I would say that the expenses side is more important. Obviously, revenue is important but when push comes to shove, expenses are easier to whittle down than adding more clients and it takes less time and energy.

    Dr. Sharp: Exactly. Just to zoom out a little bit more before we get into the details, what’s a good working definition of operations? We’ve used the back-end stuff, but how would you define operations for anybody who might be unclear?

    Brie: The way that we define operations is the systems, processes, or strategies that keep your business running smoothly. So for practice owners, that could be your intake process, that could be how you onboard new clinicians, that could be a checklist of things that you have to look through every day to send to your biller.

    [00:14:00] Essentially your operations and your processes are anything that is a repeatable task or that has more than one step, if you look at it that way. To go down to the nuts and bolts of it; it is repeatable tasks and anything that’s more than one step.

    It can be anything in your practice that’s not somebody that I talked to two months ago. It’s like the front end, they are sales and the back end feels like operations. And so anything that’s not bringing in revenue necessarily, truly clients marketing things like that are operations.

    Not to get too into it, but there’s also operations throughout those things as well but to make it as simplistic as possible, operations are part of the back-end, the expenses part of things, things that keep the cogwheels moving.

    Dr. Sharp: Right. So there’s a lot of [00:15:00] overlap with SOPs, standard operating procedures.

    Brie: We love an SOP.

    Dr. Sharp: Okay. I do too. A good SOP.

    Brie: It’s so good.

    Dr. Sharp: We’re going to focus on client onboarding more than anything, which I love. This is a really important process. It’s also one that a lot of folks are winging. I’m excited to get your perspective, having worked with so many practices and my sense is that you actually have some data and a process to talk about onboarding and measure onboarding, right?

    Brie: Absolutely. That’s the biggest thing that, and honestly, we’ve worked with clients in other industries as well. I just had a conversation with someone yesterday that’s a lawyer and he was like, “I’m having an issue with following up on contracts.” It was literally his client onboarding process.

    And [00:16:00] we talked about it, he’s like, “Okay, when we go to this meeting,” I was like, “Okay, backup, how do you get to the meeting?” “Oh, I sent them an email.” I’m like, “Okay, how did they find you?” And so we literally had to back up multiple times. It was like, where they find you, that’s where it starts.

    So that’s another thing too, is the client onboarding process, a lot of people think it’s, oh, when you’re sending paperwork and then you schedule them for the first appointment. No, it starts when the marketing ends, that’s where it gets taken in.

    Dr. Sharp: Let’s define that. What would you say is the first step in the onboarding process? And then where do we go from there? What are the major steps in the onboarding process?

    Brie: Inquiry. And without going into itty-bitty details, but inquiry, consult, confirming that they are going to onboard, paperwork, scheduling for session, going [00:17:00] through first session. And then that goes into clinical, and then going through; making sure that they stay on boarded so that way they’re not churning out at, some people do it’s after 6 appointments, some do after 8. What is your churn rate usually?

    Dr. Sharp: We’re lucky, just doing testing, there’s really no churn. Once people get in for the intake, they see the process through, which is great.

    Brie: That’s true. You get that full completion process. So that’s really it; inquiry, consult, typically follow-ups, confirming onboarding paperwork, scheduling that first appointment. And then with testing and stuff, I know there’s multiple appointments and all of that, but that transitions into existing clients and clinical and all of that.

    Dr. Sharp: Yes. I wonder if we maybe walk through each of [00:18:00] those steps in the process. I would love to hear things that you’re finding that work at each stage and things that are not working or pitfalls that people are running into at each stage. How about that?

    Brie: Yeah, absolutely. In the inquiry stage, we see a lot of people that just have their consults directly on their website, which I do think you should absolutely have, the smallest barrier to entry to just get people in the door.

    I had a client several years ago that was nervous about turning online scheduling on in her EHR. I was like, I promise you it will make your life so much easier. And it did. She hasn’t looked back since.

    I will say though that we find doing some sort of inquiry form before scheduling that consult is super beneficial for [00:19:00] screening those potential clients. If they say that they have a specific insurance that you don’t take, that’s not wasting their time or your time. So you can reach out to them and say, “Hey, unfortunately, I don’t take your insurance. I’m happy to see you out of network, but here’s what it is.” You don’t have to waste that 15 minutes’ slot, especially when you’re crazy busy.

    Also things, if somebody needs something that’s for, specifically, we work with a lot of social workers and so they get a lot of referrals for severe cases, and so a lot of those really need to be more inpatient or they need to see a specialist and so that’s not something that the clinicians that I work with are doing right now.

    So that’s another thing. For this one client that I work with, we get a lot of referrals [00:20:00] for teenagers. And so it’s their parents and they’re just getting out of an inpatient center and they’re having to do outpatient care. It’s stressful for the family.

    And so the faster that we can get them through that process and saying, hey, this is not us, but here are some referrals for people that we know do really well, that’s always great. And then you get the good rapport and then still get referrals from people because you’re going above and beyond, even though you’re not doing that consult. So having that inquiry form is definitely a good way to screen people.

    We had a client last year that was nervous about clients. She hadn’t had a client on board in a little bit and she wanted to fill her caseload and she’s like, “I think the barrier to entry is too high, so I’m going to take the inquiry form off and just go straight to consult.” [00:21:00] We, along with someone else on her team advised her, that’s probably not a good idea, but if you really want to do it, we’ll try it for 30 days.

    It caused so many issues. She had way more no-shows for consults. There was a lot more work on the back end because there wasn’t a way for us, part of my team as the admin support, because she’s one of our admin support clients, that we can’t see when she was getting consults. And so then she was having to do all the back and forth.

    It was creating more work for her. It was a cascade of things that just made everything worse. She’s like, “No, that was a bad idea. We’re going to bring the form on”

    Dr. Sharp: Bring back the form.

    Brie: Yes.

    Dr. Sharp: Let me get super granular here. When you say an inquiry form, is this typically just a form that people fill out on [00:22:00] the website? Clients come to the website, they fill out the form, they submit it and it goes to either the psychologist or the admin person.

    Brie: The process that we’ve created over 4.5 years, that works really well is having a form. Typically, it’s a Google Form and we have a BA with Google for all of our clients. We make sure they have that, which is really helpful.

    You click the link to schedule an appointment and it goes straight to this Google Form. Then from there, we’ll put on the confirmation page; thank you for filling out the form, click here to schedule your appointment. And so that will automatically allow them to go and schedule their consult. So that way it’s a smooth process.

    And then with Google Forms, it comes into a spreadsheet and then we have an email that goes directly to the admin support inbox that says that someone filled out the form. And so then we can go in and check and [00:23:00] see:

    1. If they’re the right fit.

    2. If they actually scheduled their consult in simple practice, because, let’s be honest, a lot of people will skip that step and close it out really fast, but because we have those checks in place, we’re able to follow up with them and say, hey, thanks for filling out the form. We noticed that you didn’t schedule your consult. Here’s the link. And so that way we’re able to do that a lot faster.

    But the form, since we’re getting granular, a lot of times the form is typical contact information, first and last name, email address, phone number, age. So that way we know if they’re a minors or not. Where are you located? Because a lot of our clients are licensed in multiple states. Because that’s a screener question. If they’re in a different state, then we can automatically tell them we’re not licensed there.

    Their session location preference; whether it’s in-person or virtual, which therapists they’re looking to have a consult with, any [00:24:00] details that might be helpful for the consult, and then payment preferences. If it’s out-of-pocket, out-of-network, some of the clinicians that we have are in-network, so we’ll put like their name and what insurance panel they’re in-network with, so that way people know, hey, so and so with Aetna, and so that way they can see who has what.

    Also ask their primary health insurance. These are questions that we’ve added throughout the years, because we’ve come into issues where people are like, oh, I have Aetna, but then don’t realize that it’s their secondary, and then it just causes a world of problems. I’m sure you’ve run into that.

    Dr. Sharp: I’m sure. Yes.

    Brie: And having a note on there, it’s like, heads up, this has to be your primary insurance. Another thing we’ve come across is third-party billing. Those 18, 19, 20-year-olds, 25-year-olds, 30 year [00:25:00] olds that their parents, grandparent or someone is paying for their care.

    We’ve run into situations in the past with clients that a 20-year-old was utilizing her grandmother’s credit card. The grandmother disputed the charges on her credit card. And so we ran into this whole thing. So now we have a process of third-party billing where we have an authorization so that way we can get release of information for HIPAA, and then we have that person sign all the forms as well so they know, hey, you’re on the hook for payment.

    Dr. Sharp: Got you. Great.

    Brie: So things like that, and of course, how did you find us? What’s your communication preference? Things like that. So it’s a lot of screener questions that we’ve just learned because from experience that, hey, we need to know this information upfront so that way we don’t get hit in the back end of like ooh, this is going to be an [00:26:00] issue. So all of that stuff can be done on the front end, which is great.

    Dr. Sharp: That is great. I’m guessing there are probably some folks out there who are like, oh my gosh, what did she even just say? You submit a form, it goes to a spreadsheet, and then it notifies somebody, but just trust, it’s easy. This takes 5 minutes to set up.

    Brie: Yes. Google Forms are super easy to set up. And then you literally just click a button that says export to spreadsheet and it automatically pulls it in for you. It’s a piece of cake.

    Dr. Sharp: Yes. Great.

    Brie: If you need help, just call us.

    Dr. Sharp: Sure. People can help. There are people to help.

    Brie: Asking for help is not a bad thing.

    Dr. Sharp: Right. So that’s the inquiry phase. Where do we go next?

    Brie: Obviously, if they didn’t schedule their consult. I will back up a little bit, if someone reaches out from like Psychology Today, My Well-being on Alma Headway, [00:27:00] all of the places or just emails directly on the website, I’m sending emails with the form.

    We have email templates that we have saved in Google that you can literally click buttons and just pop it right in. It says, thank you for inquiring. We’d love to schedule a 15-minute consult. Here’s what to expect. Here’s the link to fill out the form and then letting them know you will fill out the form and then be prompted to schedule your call so that way they know to look for that link.

    Our policy is to send, depending on what stage we’re in, three follow-up emails after that initial one because we do find that if someone is going to respond, they will typically respond by the third email.

    Dr. Sharp: Okay, I just want to highlight that because this is a big question people ask us a lot in a lot of different circumstances; how many times do I reach out to someone before I let it go? You’re saying [00:28:00] three responses. Is this coming from some kind of data that you know people maybe don’t respond to the first one, but they will respond by the third one somehow?

    Brie: It’s data that we have collected over the years. It’s not just therapy, it’s ad sales, it’s asking for sponsorships, it’s anytime that you’re trying to convince someone. The thing is, at the end of the day, therapy is a business.

    That’s very black and white, but you are technically selling something. And so it’s really the same process whether you’re selling ads, selling therapy, selling services because a lot of people are like, oh, that looks interesting. I’m just going to leave it in my inbox for a while and I’ll get to it later.

    Dr. Sharp: Yes.

    Brie: And then the second email, oh right, I need to do that. And then the third email, oh, shoot, I actually [00:29:00] need to do that. They’re not going to leave me alone. They’re reminding me. A lot of times people are like, oh, thank you so much. I’m going to schedule the consult.

    And then typically we send another one just in case that it goes into spam. A lot of times if you send multiple emails, especially if it’s on the same thread, it will kick you out of the spam folder into the main inbox. So that’s another reason why we do it. Typically, the second or third email, it will kick you out of the spam folder because that happens.

    Dr. Sharp: It does happen. I want to highlight that. Just to say that again that a lot of us, or at least a lot of my consulting clients, there’s a fear of pestering people or bothering people, being annoying, being salesy, being whatever, but the way you frame it makes a lot of sense.

    And that resonates with me personally. I get so many emails and I’m like, oh, that is interesting, [00:30:00] and then everything in my life happens and I forget about it. And then two more reminders, I’m like, okay. Good. Yes, I need to.

    Brie: It finally bumps up to the top of the list once you get that third follow-up. Another thing too, is you’re not cold calling people. These are people that have sent you an inquiry of some kind. They’re a warm lead. So you are doing your due diligence to follow up with them because they reached out to you for therapy, for testing, whatever. You are supporting them.

    Dr. Sharp: Exactly.

    Brie: Especially with therapy, asking for help is hard and so people might not be ready the first time you send it. And then it’s just sitting in their inbox and like do I, don’t I? I don’t know. And that it shows that you care too. Honestly, it’s not a pester. It’s the fact that you really want to help them.

    Dr. Sharp: Yes. Nice reframe.

    Brie: Yes. I will tell you in my [00:31:00] personal therapy experience, the amount of therapists that I’ve reached out to that don’t even email me back is insane.

    Dr. Sharp: I hear that so often. It’s crazy.

    Brie: Do you not want clients? And if you don’t, great, then put that on your Psychology Today profile that you’re not accepting new clients or just email me back. So just being dedicated and treating people with a modicum of respect.

    Dr. Sharp: Great.

    Brie: After that, obviously we have the inquiry, once they get that email, they go through the inquiry process where they fill out the form, they schedule their consult. If they schedule a consult 3 weeks or more out, we reach out to them and say, hey, maybe the clinician’s on vacation or something, but they have spots open on [00:32:00] them, we could manually schedule. And so we always ask them, hey, do you want to get in earlier? 8 times out of 10, they say, yes.

    It shows that you care. Throughout the whole process, you’ll see as we’re going through this that every single step is creating a great experience for the client. And so if they want to feel safe with their therapist, that needs to be companywide. It can’t just be while they’re in session. So creating that supportive net for them and making sure that they know that we’ve got their back is huge. And that starts at the first instance of communication.

    Dr. Sharp: I love that you mentioned that. Yes.

    Brie: So consult happens. Typically, all our clients do 15-minute consults and then we have, I’m using roughly the same client just as a [00:33:00] preface. For a lot of my examples, I’m using the same client because she’s been a client since I opened my company in July 2020 and she came on in September 2020, and she’s still around.

    She started her company in March 2020. So I’ve literally been there for pretty much the whole thing. She’s built a successful practice in New York City. She’s my Guinea pig. So anytime I want to test a new software, I’m like, “Hey, you up for it?” She’s like, “Yeah, absolutely.”

    Dr. Sharp: Nice.

    Brie: So she’s pioneering the operation stuff for us.

    Dr. Sharp: I love that. Oh, that reminds me, when you mentioned software, up to this point, I’m curious if you’re using any software outside of Google Workspace. There’s a lot of chatter about CRMs and how do we keep track of this stuff, is it anything like that or are we just keeping it simple?

    Let’s take a break to hear from a featured partner.

    [00:34:00] Y’all know that I love TherapyNotes but I am not the only one. They have a 4.9 out of 5-star rating on trustpilot.com and Google, which makes them the number one rated Electronic Health Record system available for mental health folks today. They make billing, scheduling, note-taking, and telehealth all incredibly easy. They also offer custom forms that you can send through the portal. For all the prescribers out there, TherapyNotes is proudly offering ePrescribe as well. And maybe the most important thing for me is that they have live telephone support seven days a week so you can actually talk to a real person in a timely manner.

    If you’re trying to switch from another EHR, the transition is incredibly easy. They’ll import your demographic data free of charge so you can get going right away. So if you’re curious or you want to switch or you need a new EHR, try TherapyNotes for two months absolutely free. You can go to thetestingpsychologist.com/therapynotes [00:35:00] and enter the code “testing”. Again, totally free. No strings attached. Check it out and see why everyone is switching to TherapyNotes.

    Our friends at PAR have released the NEO Inventories Normative Update. The NEO Inventories measure the five major dimensions of personality and the most important facets that define each with an updated normative sample that’s more representative of the current U.S. population and fewer components for easier purchasing. Visit parinc.com/neo.

    Let’s get back to the podcast.

    Brie: Up to this point, I’m just using Google. If you’re using Microsoft, run away really fast and get on Google please; Gmail, Google Sheets, and Google Forms so far, and then [00:36:00] whatever your website platform is.

    Dr. Sharp: Fantastic.

    Brie: Which could be like Weebly. It doesn’t have to be perfect. You can even create a Google Site if you really wanted to. So consult happens and then with our star client, what we do is the clinician has an email template that they send. It’s a follow-up email.

    Obviously, if the client says, hard, no, can’t do it. They’ll still send a follow-up email, thank you so much for your time. They CC the admin team, so the admin team knows what to do next. And so they’ll off board them from the EHR.

    We always put a little note. We use SimplePractice for most of our clients. We’ll put an admin note on there saying we’ll not onboard after consult. So that way when we go back through inactive clients, we can see who is this person? Why didn’t they not onboard? And then we know.

    [00:37:00] But the people that are thinking about it or are gung-ho about moving forward, they’ll be warm and say, we’re really excited to work with you. And then we’ll specify some information. So it’s like you were interested in having in-person sessions. We were looking at Wednesdays at 3.00 PM biweekly. My rate is XYZ, or you are looking to use your in-network benefits with Aetna.

    And so it has, especially the third party billing as well, you have another person that’s going to be in charge of billing. And so what that does is confirm everything in writing from the consult, which is really important. And then also just notifies the admin team so that the clinician doesn’t have [00:38:00] to send the email to the client and then send another email to the admin team letting them know what’s going on.

    So then the admin team takes it from there. We’ll respond within, usually, we give them a day or two and if they haven’t responded yet, we’ll follow up and say, “Hey, I’m so glad that you and so connected, please let us know how we can support you on onboarding or whatever.”

    So from there, if they say yes, I’d like to onboard, we get them scheduled for their appointment first, because we have been bitten in the butt with that. I’m sure you have where you send a bunch of paperwork and then they just ghost and don’t schedule an appointment, and then that’s more work for you.

    So we found, to get them on the schedule for that first appointment and then send all the paperwork and we have an onboarding email template that says, you’ll be getting an email from SimplePractice. This is your client portal, yada, yada. You have a bunch of paperwork, fill it out 24 hours before.

    For this practice specifically, as my [00:39:00] example, they use Alma for their in-network. So you’ll also be getting an email from Alma. This is where we submit claims and you’ll get all the information from that. So that way they know what to expect because if you’re just getting random emails with a bunch of paperwork, you’re like what is this? This is so overwhelming. And so letting the client know what to expect is so important too. And then making sure that you’re open for questions and everything like that.

    If they don’t respond right away, we send four follow-ups for that, because they’re already are more than a warm lead, they’ve gone through all this whole process, they’ve had the consult. A lot of times the clinician will be like, I don’t know why they didn’t respond because they were like, yes, let’s do it in the call, and then they just ghost, it happens.

    Dr. Sharp: I’m [00:40:00] curious why the clinician wouldn’t go ahead and book the appointment from the consult, why that extra friction to CC the admin team and then have them follow up?

    Brie: That is definitely a personal choice depending on how your practice is set up. With this practice specifically, the way that the practice owner wanted it set up is that the clinicians solely can focus on clinical. She set it up as a boutique practice and it’s to focus on the therapy. And so the admin support team takes care of everything else. They take care of scheduling, rescheduling, canceled as needed. We make sure there’s a boundary between anything clinical and anything admin. That’s why.

    Dr. Sharp: Got you. [00:41:00] Maybe asking for those solo practitioners out there or others who might want to do it different, do you see any downside to just booking straight into the appointment in the consult?

    Brie: No, as long as you have clear communication with whoever, obviously if you’re a solopreneur or a solo practitioner and you are doing everything yourself, then yeah, absolutely, go ahead while you’re on the consult call with them, book it, send the paperwork, just do it right on the call. It’ll take you 2 minutes. I’m sending it to you right now. You should expect it in your inbox. Make sure you give a timeline of, please fill it out 24 hours prior or 12 hours prior, whatever, just so you can look it over, and make sure there’s no outstanding weird things going on.

    If you have an admin support person of any kind, whether it’s a VA, a whole scheduling team, whatever, if you want them to send the paperwork, you just had to make sure you have clear, open lines of communication. So if you are booking the appointment or booking [00:42:00] the recurring appointment series, letting them know, hey, this person’s a go. I booked them for the first appointment. Can you do the rest?

    And so that way, you just communicate because that’s where we find where you have the consult and you go right into the next session, and then forget to tell the admin team, and then no one sends the paperwork and then it’s appointment time or the next day and it’s like, why didn’t you send the paperwork? Because you didn’t tell me to. So it’s about that open, transparent communication too.

    Dr. Sharp: Got you. Great.

    Brie: From there we keep a close eye on paperwork, make sure we’re following up. Typically, about three or four days prior to the first appointment, if their paperwork isn’t done, we’ll nudge them and say, “Hey, we noticed you haven’t done it. Do you have any questions?”

    And just keeping emails in a way that’s [00:43:00] not, “Hey, you haven’t done your paperwork yet. You have to get it done.” It’s like, “Hey, do you have any questions? We noticed that you haven’t finished it. Anything we can support you on.” Reframing it in a way that is supportive to them, but also like, hey, get your stuff done.

    Dr. Sharp: Right.

    Brie: And then they have their onboarding. And then from there, the clinician completely takes over. And then if they need anything with billing or scheduling, we have great communication.

    Dr. Sharp: Great. Let me ask you a question about the paperwork.

    Brie: Yes.

    Dr. Sharp: Have you found anything, because there’s a lot of debate about this and people ask this question a lot, basically, how much paperwork is too much? I feel like we have a million forms. We tried to simplify them, but it’s a lot. Our demographic form is pretty [00:44:00] long. So there’s a question of, do you do a longer demographic form or do a shorter and then do more of the intake? What have you found just in working with a bunch of practices in terms of people filling out paperwork?

    Brie: I’m going to come at this question from a perspective of as an operations person working with practices and also a person that has been to therapy and that has filled out 1.5 million forms for my child who is also in play therapy, OT, speech, physical therapy. I’ve done all of the intake processes. I’ve seen them all.

    I will say that when you’re talking about demographics or intake questionnaires, the quality of your paperwork is also important. [00:45:00] So from that point of looking at if you have a lot of open-ended questions, that can seem super overwhelming versus if there’s a way, instead of like, do you smoke? Instead of having an open-ended question, you could just have a drop-down or a multiple-choice question. That makes it feel less overwhelming. Something like that makes it feel a lot quicker too, and a lot more manageable.

    My son tried ABA therapy earlier in 2024. With ABA, you have to fill out all the forms ahead of time before you’re onboarded or before you even have a consult because they have to get you on the waitlist and they have to know enough information about you. It would take me 15 [00:46:00] minutes to fill out these intake forms. Of course, they’re all super negative because you have to be like what’s wrong with your child?

    Dr. Sharp: Oh gosh.

    Brie: I applied to 20 different waitlists and it took me days to fill those out. However, I will say the ones that were a lot easier were the ones that just had those multiple-choice questions and things like that.

    I will say from a business owner’s standpoint, whatever amount of paperwork gets you the information you need and covers you legally is the number of documents that you need. I have a client, her husband’s a lawyer, and [00:47:00] she’s paranoid about being ever audited or anything. She’s like, “I don’t want to be that person on the news that has the horrible malpractice” She’s like, “I’m not going to be the person on the news. I’m going to be locked so tight on legal. We have all of our policies in place. No one is going to be able to dispute charges, we are locked in.”

    And also a lot of information for clinicians. It’s 17 forms that go out for onboarding. There’s the DOS screener, the GAD-7, the PHQ, those are three of them but there’s a therapeutic process understanding, confidentiality, the HIPAA policy, things like that. There’s a COVID waiver because that’s required in New York. That’s a bunch right there that take you 5 minutes to sign. So it seems like a lot, but it’s oh, it’s a paragraph I have to read and sign. Okay, great.

    A lot of people [00:48:00] put all of that on one document, and it’s like 15 pages, that almost feels more overwhelming than 17 documents sometimes. I guess it depends on the person, but I will say that from almost the start of her company because I’ve been there for 4.5 years, we’ve had three people ever that said I cannot do these documents. It’s too much. That’s it, three people for four years. They average between 150 and 200 clients on their roster at a time.

    Dr. Sharp: Got you.

    Brie: We’re consistently onboarding 10 people per month. It’s a very small number. You have to remember that you’re a therapist, but also a business owner. So the last thing you want is having someone come after you for some reason [00:49:00] of probably no fault of your own, of someone, even an ex of a client that is abusive, or someone who’s mad about their daughter taking their credit card and then trying to sue you because, things like that, if you can cover yourself, then you’re not going to lose your livelihood. You’re not going to lose your reputation. You’re not going to lose your license.

    I think the right answer is however many documents you need to get the information you need for your client and to cover yourself legally and financially is what you need. It’s a very diplomatic answer.

    Dr. Sharp: Yeah, super diplomatic. It’s okay. There’s some of… it just depends as well.

    Brie: Yeah, it depends. There’s one therapist that I went to that didn’t have any, I didn’t even sign a HIPAA form. She’s like, let’s do therapy.

    Dr. Sharp: Here we go.

    Brie: Here we [00:50:00] go.

    Dr. Sharp: Are you cool? I’m cool. Let’s do it.

    Brie: If you want to burn down your company and just do paper calendar and stuff, do what you want to do.

    Dr. Sharp: That’s a good plan. Even this component of trying to eliminate open-ended questions from our forms, I get it. From a clinical standpoint, they’re helpful, but from a consumer standpoint …

    Brie: There’s definitely some that you need, but there are some that can be multiple choice or a multiple choice with a short answer depending on what. We redid all of the intake forms for the same client. I went through all of her forms in November and audited all of them before we did the new year paperwork.

    The intake forms, a lot of them were where I would be able to combine three questions into one where I could do one question and then for each answer, it could be like, you click yes [00:51:00] and then it pulls up another little box. It’s like, okay, tell me more information here.

    Dr. Sharp: Yeah, even having an eye toward simplicity, I think you’re right. There’s a lot that we could combine. There’s some fluff in there. We’re always trying to revise.

    Brie: Honestly, it even comes down to formatting.

    Dr. Sharp: Yes.

    Brie: Putting those little line spacers, headers, sections and bolding, italicizing, all of that, it just breaks it up so it doesn’t seem as overwhelming too.

    Dr. Sharp: Yes. It goes a long way.

    Brie: The psychology of paperwork too, if you want to get into it.

    Dr. Sharp: That would be a great podcast, the psychology of paperwork.

    Brie: I don’t think I’m qualified for that one.

    Dr. Sharp: If you find me someone, send them my direction.

    Brie: I will.

    Dr. Sharp: So big question, a lot of practices are collecting credit cards upfront upon booking, but then there are many, they’re saying, we don’t do that. We’re not going to do that. Any best practices [00:52:00] around that or ways you found to ease that process?

    Brie: I have a very polar answer to this. This might be an unpopular opinion, I don’t know. I do not like when someone asks for a credit card before a free consult. I feel like it feels overwhelming. It feels like, oh my gosh, why do they need my credit card? I haven’t even decided if I’m going to go with this person. I’m doing consults with two different people and then they’re going to have my credit card information, which I’m not super aggressive with but then I’m like, it’s just one more thing I’m going to have to delete out of their system and all of that.

    So from a personal standpoint but also from a business standpoint, I have seen where people don’t go through with the paperwork for the consult. It’s hard to get people to fill out paperwork for a consult, to be frank. And also I [00:53:00] have seen where people no show on consults because they don’t want to submit that information.

    When it comes to onboarding and scheduling that first appointment, heck yeah, make sure you have that credit card before. If they don’t have it before, we typically tell them, we have to reschedule your first appointment because we need all of your paperwork done.

    Dr. Sharp: That makes sense. Great.

    Brie: And feel free to disagree with me, getting people in for a consult for therapy is already tough. people have to be ready to go to therapy. and so then I feel like asking them to fill out a demographic form is one thing, but asking them to put their money where their mouth is and put the credit card on file for a free consult just seems [00:54:00] like it’s too much of a barrier to entry.

    Dr. Sharp: That’s fair. I’m totally with you. I should have clarified, I don’t know that we’re trying to do a credit card before the consult, but before booking an actual appointment.

    Brie: 100%. Oh, yeah. Because we book the first appointment before we send paperwork a lot of the time, we will say you have to have your everything done 24 hours prior to the first appointment. And then if it’s not, we reschedule that appointment out.

    I think we’ve gone to the policy where once you fill out your paperwork, we will schedule that first appointment. And so that way, they get one buffer where they’re like ah, we trust you to do the paperwork. And then if they don’t do it, we’re like, no, you have to show us that we can trust you.

    Dr. Sharp: Totally.

    Brie: Boundaries.

    Dr. Sharp: There you go. Trust but verify.

    Brie: Yes. Exactly.

    Dr. Sharp: Maybe [00:55:00] we start to wrap up with a question that is almost, I almost said on the flip side or an opposite problem, but it’s all part of the deal. And that question is, how do we work with a high volume of inquiries? I’m guessing you work with some practices and this, full transparency, this is very selfish question, because this is our main problem. That’s why I do these podcasts is just to answer my own questions.

    Brie: Why not?

    Brie: The question is; how do you deal with a really high volume of inquiries? I cannot just keep hiring admin staff to create more and more consult appointments or answer more phone calls. So I’m curious how you think about a problem like that where you’re getting way more inquiries than you have the time in a week to deal with.

    Brie: That is where I would bring a CRM in, so customer relationship [00:56:00] management. I will say I have used a lot of CRMs in my day. Before I started my company, I was in project management and event management, and so I’ve seen all of the project management tools, all of the CRMs.

    There’s one that I have recently discovered that I absolutely love and it’s therapist specific. It’s WisePractice. They soft-launched in April and then they fully launched in July, and they’ve done 20 iterations since then. It’s fantastic. And that’s coming from an operations person. If you need it, I’ll send you my affiliate link.

    Dr. Sharp: Hey, I would love to check it out.

    Brie: The thing that I love about a CRM like WisePractice is that it has workflows. Workflow, for anybody that doesn’t know what that is an automated process that can do the [00:57:00] steps for you. So what we can do, and for the client that I’ve been using for my examples, we used to have Zendesk for support tickets and things like that, where we can automate our follow-ups, which was really great.

    But Zendesk, their business model is terrible and their customer service is terrible and they’re super expensive, so I highly do not recommend them. However, something like WisePractice, you can have that communication where you connect your, it’s a two-way sync with your Gmail. It’s fully HIPAA compliant.

    You can do your workflows. You can do even documents through there. There’s other opportunities where if you do webinars and courses for other therapists using Kajabi or something like that, you can pull all of that in there. Jeremy’s oh my gosh, what is this?

    Dr. Sharp: Yeah. Seriously. I’m going to have to end our podcast now and go check out WisePractice. Sorry, Brie, sorry.

    Brie: No, that’s okay. As long as you use my affiliate code. I’m just [00:58:00] kidding. The cool thing and I’m excited to try it out in typical business owner fashion, I really want to bill 1 hour to test it out and I don’t have time. That’s my goal for Q1 of 2025 is to test it out.

    What we can do with it is have the inquiry form in WisePractice and once somebody submits it, we can send them a thank you email and send a reminder to schedule the consult automatically. And then we can send reminder emails automatically. It’s an if then; if they haven’t responded by this day, then send out this follow up and things like that.

    Also the cool thing about this is that, I’m sure you’re aware of this, some people email, some people text, some people call and you have to search, oh, did this person send me anything and you have to search in 10 different places in secure [00:59:00] messaging.

    In WisePractice, you can take all of the texting, the calling and the emailing and it’s all together in the client’s contact information. So you can see when they texted, when they emailed all in one spot, which is very cool. Even that extra 2 minutes or 5 minutes that it takes you to go on the three different platforms you need to check, it’s all right there.

    Dr. Sharp: It adds on. Fantastic. I am going to do some homework on WisePractice.

    Brie: Yes, definitely do. If you have any questions, let me know.

    Dr. Sharp: Great. This has been awesome. I love doing a deep dive into this one aspect of practice management.

    Brie: It’s an important one.

    Dr. Sharp: It is. Maybe the most important.

    Brie: One thing we didn’t talk about too, is the reason why you want to streamline your process [01:00:00] is that each person, because I feel like somebody listening to this episode will be like, okay, that’s great, but why am I doing all of this? That seems like way too much work.

    And so the reason you want to do this is:

    1. Making sure that every client has the same experience.

    2. If each client has a different experience, how are you tracking your numbers, your KPIs, your key performance indicators? How are you tracking where people are falling off in the process?

    So if you’re not onboarding people, you can look at if you have the process in a standard operating procedure, so written down and everybody follows the exact same process every single time, are they falling off after the inquiry form? Are you sending follow-ups? Are they falling off after the consult? What does your consultation look like? Maybe do a role-play and see what’s going on in your consult?

    Are you asking the right questions? Are you getting good vibe? And also making sure that they’re the right client for you, [01:01:00] because it’s both ways. It’s an interview both ways.

    And then looking at, okay, you sent the consult follow up. You scheduled their first appointment. Why are they ghosting and not doing paperwork? Do we need to send more follow ups? Why did they not show up for their first appointment? Things like that.

    And so you can really see where your issues lie and be able to fix those. You’re caring for your client all the way through the process, regardless of it’s in session or out of session.

    Dr. Sharp: I totally agree. I’ve said on the podcast many times before that a lot of anxiety can be solved with math. And this is just another extension of that. If you have data …

    Brie: Math and communication.

    Dr. Sharp: Math and communication, there we go. That’s so true though, tracking all these things gives you a lot of insight into what’s not working.

    Brie: Yeah, absolutely.

    Dr. Sharp: Or what is working?

    Brie: Yes. Exactly. Because that’s important too.

    Dr. Sharp: Sure.

    Brie: You got to celebrate those [01:02:00] wins.

    Dr. Sharp: Absolutely. Yes. This has been awesome. What can people do if they want to reach out or learn more about you, what’s the best way to do that?

    Brie: If you want to learn more about us, our website is chock full of information. It’s heybossco.com. You can email us at heybossco.com. We’re on Instagram dropping knowledge. We send out two newsletters a month with tips, tricks and knowledge of how you can support yourself and how to create efficiencies and just make your life a little easier. I’m excited for that too.

    Dr. Sharp: Sweet. All that will be in the show notes, go check it out.

    Brie: Oh, we also have in the show notes will be a freebie for anybody listening. It is a quick PDF of the client onboarding paperwork checklist so you can look at what you need for demographics, for therapeutic [01:02:00] processes, for billing, and all of that. So that way you can audit what you have and then see if you need anything else.

    Dr. Sharp: Love it. And like you said, we’ll make sure to put that in the show notes. So I’m going to close with the most important question of this whole conversation, which is, are you a Clemson or South Carolina fan?

    Brie: Neither, I am a Hokies fan.

    Dr. Sharp: Fine. We’re done.

    Brie: Delete the whole episode.

    Dr. Sharp: All right. Fine.

    Brie: Go Hokies all the way.

    Dr. Sharp: Okay. Seriously, I appreciate your time. This was fun. Thanks for being here.

    Brie: Thank you. It was a great conversation. I appreciate it, Jeremy.

    Dr. Sharp: All right, y’all. Thank you so much for tuning into this episode. Always grateful to have you here. I hope that you take away some information that you can implement in your practice and in your life. Any resources that we mentioned during the episode will be listed in the show notes so make sure to check those out.

    If you like what you hear on the [01:04:00] podcast, I would be so grateful if you left a review on iTunes or Spotify or wherever you listen to your podcasts.

    And if you’re a practice owner or aspiring practice owner, I’d invite you to check out The Testing Psychologist mastermind groups. I have mastermind groups at every stage of practice development; beginner, intermediate, and advanced. We have homework, we have accountability, we have support, we have resources. These groups are amazing. We do a lot of work and a lot of connecting. If that sounds interesting to you, you can check out the details at thetestingpsychologist.com/consulting. You can sign up for a pre-group phone call and we will chat and figure out if a group could be a good fit for you. Thanks so much.

    [01:05:00] The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric, or medical advice, diagnosis, or treatment. Please note that no doctor-patient relationship is formed here and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast.

    If you need the qualified advice of any mental health practitioner or medical provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 487. Deep Dive Into Client Onboarding w/ Brie Chrisman

    487. Deep Dive Into Client Onboarding w/ Brie Chrisman

    Would you rather read the transcript? Click here.

    Today, I’m here with Brie Chrisman from Boss Co. to discuss the importance of operations and onboarding in our practices. Brie shares insights on the client onboarding process, emphasizing the significance of effective communication and follow-up strategies to enhance the client experience. We tackle questions like:

    • What are “operations” in a psychologist’s practice?
    • What are the primary steps in the client onboarding process?
    • Where do we typically go wrong when onboarding clients?
    • How many follow-up calls is too many?

    If you’ve ever wrestled with knowing exactly how to onboard clients, this is the episode for you!

    Cool Things Mentioned

    Featured Resources

    I am honored to partner with two AMAZING companies to help improve your testing practice!

    PAR is a long time supporter of the Testing Psychologist podcast, and I will continue to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Brie Chrisman

    Brie Chrisman is the founder and CEO of Boss Co, an operations management company that works 100% virtually. With over 15 years of experience in the project management and operations fields, Brie has taken a different approach to making an impact on businesses. She has revolutionized the way businesses operate by introducing the solution for overwhelm for CEOs. Her commitment to being human-first has led her to serving CEOs in the mental health field.

    Get in Touch

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 486 Transcript

    [00:00:00] Dr. Sharp: Hello, everyone. Welcome to The Testing Psychologist podcast. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    Many of y’all know that I have been using TherapyNotes as our practice EHR for over 10 years now. I’ve looked at others and I just keep coming back to TherapyNotes because they do it all. If you’re interested in an EHR for your practice, you can get two free months of TherapyNotes by going to thetestingpsychologist.com/therapynotes and enter the code “testing”.

    This episode is brought to you by PAR.

    The new PAR training platform is now available and is the new home for PARtalks webinars, as well as on-demand learning and product training. Learn more at parinc.com\resources\par-training.

    Hey folks, welcome back to The Testing [00:01:00] Psychologist. I’m glad to be here with you in this new year, 2025. I know this isn’t the first episode of 2025, but it’s the first one that I’m recording, so there we go.

    Hey, I’m back with a clinical episode and I’m back with a return guest. Dr. Mariela Shibley is here. She’s a clinical and forensic psychologist, psychoanalyst, and expert in conducting immigration evaluations, which we’ll talk a lot about today.

    She has a private practice in San Diego, California, where she also trains and supervises mental health professionals. Dr. Shibley is the founder of the online training program PsychEvalCoach, which trains clinicians to conduct immigration evaluations. She authored the book, Conducting Immigration Evaluations: A Practical Guide for Mental Health Professionals published by Routledge in 2022. That was also the topic of her previous podcast episode, discussing the process of writing the book.

    Additionally, she serves as the Director of Mental Health at the University of California San Diego Student-Run Free Clinic and holds an [00:02:00] adjunct faculty position at the California School of Professional Psychology. Her latest endeavor involves establishing a non-profit organization to increase access to low or no-cost immigration evaluations by training mental health providers and partnering with attorneys and legal nonprofits to facilitate these services to individuals in need.

    As you can tell, Mariela is back today to talk about immigration evaluations. We’ve talked about immigration evaluations before on the podcast, and she is back because this discussion is very timely given some of the changes and potential changes in our immigration system over the next months, days or years.

    So we talk about how important immigration evaluations are going to be in the foreseeable future. Mariela talks about her personal experience as an immigrant [00:03:00] and mental health professional. We talk about a little bit of the historical context of immigration in the U.S., the current climate within immigrant communities, and we go into the various types of evaluations that might be needed for different immigration cases.

    We do talk through appropriate batteries and myths surrounding immigration evaluations. The idea here is that you will have plenty to take away if you choose to go this route. There’s a real opportunity for clinicians to both provide helpful services to the immigrant community and expand their businesses.

    Before we get to our full conversation, I think at this point in time, there may be one or two spots left in each of the cohorts of my mastermind groups. There’s a beginner group for folks starting out; an intermediate group, which I call the get your life back group for solo [00:04:00] practitioners who are overwhelmed, and there’s an advanced group for group practice owners with larger practices. They start in early February, and like I said, there may be a spot or two left in each one. So if you’re interested, reach out at thetestingpsychologist.com/consulting. You can schedule a call and we can talk about if it’s a good fit for you.

    But at this point in time, we are going to jump to my conversation with Dr. Mariela Shibley.

    Mariela, hey, welcome back.

    Dr. Mariela: Thank you. Glad to be back.

    Dr. Sharp: I’m glad to have you. We talked last time about your adventures in writing a book, and now you’re back to talk about immigration evaluations, which is a timely topic right now.

    Dr. Mariela: Indeed.

    [00:05:00] Dr. Sharp: Yes. I will start with the question that I always start with which is, why this and why now? Why is this important? Why spend your time, energy, life on this particular topic right now?

    Dr. Mariela: As a mental health professional, my goal from the get-go was to help people and to improve their quality of life. The way that I got involved in immigration evaluations was partly personal background. I’m an immigrant myself and I was undocumented for a few years. And so I know what it’s like, how hard it is, the whole process.

    Basically, I got contacted by immigration attorneys who knew my husband, who was an attorney and they asked me to do these evaluations. And the reason for that is because these evaluations can be so [00:06:00] helpful for a client’s case.

    The issue is that the U.S. immigration system is quite biased. It’s biased against the foreign nationals who want to settle, make a life, reside here lawfully. It’s very hard for someone who’s from another country to be able to get a green card to stay here, to visit even some countries, just to get a visa to come here can be really difficult.

    The rules in many ways, they’re very arbitrary. So they say you need to serve a penalty outside the country. You need to leave the country for 10 years unless you can prove that a loved one will suffer extreme hardship. Okay, what’s extreme hardship? What defines extreme? There’s no guide.

    And [00:07:00] so this is where we come in as evaluators. We try to bring a little more objectivity to this very subjective system with objective data, opinions, facts that we can provide as mental health professionals. Give it that psychological look at the situation, at the client so that it can substantiate their claims, their cases.

    Dr. Sharp: That’s fair. I don’t know if you know the answer to this question as you get into this topic. Do you know much about the history of immigration here in the country? Has it always been ambiguous and tough to go through this process or has it ebbed and flowed over time?

    Dr. Mariela: That is so interesting that you bring that up. I don’t know if I told you, but I did start writing a second book.

    Dr. Sharp: You [00:08:00] did. Yes.

    Dr. Mariela: It may not be published for a long time because I put that on hold because I have so many things to do, but chapter one is already written and chapter one is exactly on that. It’s on the history of our immigration system.

    So I’m not going to read the chapter, but I will tell you that yes, it dates back many years, but it’s always been inherently biased that they would ban groups of people in particular, Asians were not allowed to enter the country. They were very discriminatory. The categorical, it was from the get-go biased against foreign nationals who didn’t fit the ideal of a U.S. resident in their mind.

    Dr. Sharp: I see. Just to be [00:09:00] super clear, we’re talking about lawful and unlawful entry for lack of a better term. Is that right? Am I reading that correctly?

    Dr. Mariela: Yeah. So the U.S has had a long and complicated history with immigration. In the early days, immigration was pretty much unregulated. People came from all over looking for freedom, opportunity, but then things changed and as the country grew, there were economic anxieties and social tensions, and they led to the first restrictive laws.

    We saw things like the Chinese Exclusion Act, which was based on race and national origin. Basically, it banned Chinese people from coming in for a long time. And then later there were laws that limited people from certain countries, especially from Europe.

    They had quotas that were very restrictive. They basically limited how many people could come from each country. And they weren’t fair. They were based on the 1890 [00:10:00] census, which meant that countries with more people of European origin from that time got bigger quotas. And so this meant that people from Southern and Eastern Europe, and basically anyone who wasn’t from Western Europe, had a much harder time coming to the U.S. So it was really about trying to keep the country more white, which, of course, it’s a really unfair and discriminatory thing to do.

    So then things shifted again, the 1965 Immigration Act was a really big deal. It got rid of those old quotas and it started focusing more on family reunification. That’s when we saw a lot more people coming in from Asia, Latin America and other places but there’s always been this push and pull.

    There were concerns about how all these changes were affecting the country, the economy, even our culture. So we saw laws that would make it harder to come in, made it easier to deport people and things like that. Even today, it’s still a really [00:11:00] complex issue. They’re trying to balance things like security and the needs of our economy.

    Ideally, we would want to welcome people who want to come here for a better life but it is a constant work in progress. And with each administration, we see new trends. And now we have an upcoming administration where pretty much everybody’s frightened. Nobody knows what’s really going to happen.

    There are some messages out there about what they anticipate will happen, whether that actually ends up happening or not, we don’t know. I think a lot of these goals are somewhat unrealistic and impossible, but nonetheless the fear is very real. The fear in these communities is palpable.

    Dr. Sharp: I wanted to ask about that. [00:12:00] I don’t want to turn this into a highly political discussion necessarily, but it’s hard to avoid that. I am curious when you say there’s fear in these communities and obviously you work with these attorneys and a lot of folks involved in the community, can you say more just about the vibe, what people are worried about, and what’s making its way around?

    Dr. Mariela: The message is they’re going to deport all people who are here undocumented, which is a lot of people. A lot of these people live in families where one or more family members are actually U.S. citizens or lawful permanent residents. So this isn’t just affecting the foreign national and by any means, it’s affecting entire families, entire communities. This is your coworker, or this is the person the [00:13:00] you hire for help. These are your teachers. It’s everywhere.

    I’m seeing a repetition of what we saw in 2016. I work at a free clinic. It’s a UCSD-free clinic. It’s staffed by medical students and volunteers, and pretty much all our patients are undocumented. They’re individuals who don’t have insurance. We provide their services free of charge.

    And what happened back in 2016 is people were afraid to leave their homes because there was literally border patrol circling around their neighborhood and just picking people up. And that happened. That was real. And so a lot of people stopped going to work. They wouldn’t come to the [00:14:00] clinic.

    We had a support group. There was this thing about, they were advised to not congregate in groups because they’d be easily targeted. It was sad because now they’re anxious, they’re afraid, they’re suffering, and they’re all alone.

    So I anticipate something similar to that, unfortunately, at least at the beginning until we find out what’s going to happen. It’s also the uncertainty, you don’t know if you’re going to be allowed to stay or not.

    Dr. Sharp: Sure. We all know the stress of having a huge, I think of it as like an unclosed loop in your mind, this huge question, uncertainty.

    Dr. Mariela: There are hundreds of thousands of people in the U.S. who are here under temporary protected status, which is, the government [00:15:00] says because of the situation in your country, the political upheaval or natural disaster for whatever reason, you’re allowed to come and stay in the U.S. temporarily until things get better. These are renewable, so they’re for a certain amount of time, and then they get renewed until the circumstances improve in their native countries.

    So what happens is that once that protective status is lifted, then all those people have to leave. A lot of them have been living here for quite a few years, perhaps they already have children who were born in the U.S. Some of them were able to adjust their status to permanent residents, which is great, but some of them weren’t.

    And so now with this threat that they’re going to terminate temporary protective status for a lot of these countries, you can imagine these families who are just like, I can’t make long [00:16:00] term goals. I don’t know what’s going to happen. We can’t go back to our country, so where are we going to go?

    That’s a real source of stress that will keep you up at night, that will permeate into every aspect of your life. It is going to take a toll on people’s mental health and physical health, unfortunately.

    Dr. Sharp: Of course. It’s unimaginable. It’s terrible. So just to spell it out, how does that influence or impact our practice or the practice for clinicians who might offer these evaluations?

    Dr. Mariela: The evaluations can actually bring a little bit of that objectivity into this playing field because they’re saying, in order to stay, to avoid deportation, you can prove that a loved [00:17:00] one, who’s not just any loved one, it has to say a spouse, a child or a parent, in some situations, children don’t even count, they have to demonstrate that they would suffer exceptional and extremely unusual hardship. That’s for it to avoid deportation. Okay, can you define that for me what that is?

    Dr. Sharp: It’s tough.

    Dr. Mariela: And they don’t have a clear definition other than something along the lines of beyond what’s typically expected. Okay, what’s typically expected? It’s very up in the air. It’s very up to their discretion. And so the more evidence that the applicant has to show, that USCIS wants to see, the stronger their case is.

    They’ve always been pretty critical [00:18:00] of, they look at every piece of information, but I anticipate that with this new administration, they’re going to scrutinize everything that comes through their desks or that’s presented in court. And so the stronger their case is, the likelier they are to have a favorable outcome of their case. In other words, to be allowed to stay in the country.

    Dr. Sharp: It stands to reason that there are going to be an increase in referrals for these evaluations or an increase in need.

    Dr. Mariela: Yeah. I’ve already started seeing it. Another issue is that we don’t know which programs are going to stay on or not. So right now we have a program that’s called a provisional waiver that is for families where one person’s married to a U.S. citizen or lawful permanent resident, but they’ve been here [00:19:00] unlawfully for a certain number of years.

    In order to adjust their status, they need to waive this ground of inadmissibility that’s called unlawful presence, meaning they were here unlawfully for a long time. The only way to waive that is if they can prove that their spouse or a parent, U.S. citizen or lawful permanent resident, would suffer extreme hardship if they had to separate or if they had to relocate.

    And you do that while you’re here in the U.S. Whereas a lot of these waivers pardons, people are already separated. So one person’s abroad, the other one’s here. So this came out in 2013, mainly to keep families together because these waivers were taking months, if not years, to get adjudicated. So in order to avoid that temporary family separation, they would apply for them here. So the families still stay together, apply, [00:20:00] wait. Nowadays, it’s taking 4 years to adjudicate that waiver alone.

    Dr. Sharp: Oh my gosh.

    Dr. Mariela: 4 years of limbo, of you don’t know what’s going to happen. And then if that’s approved, then at that point they can leave the country to go to their consular interview in their country of citizenship, which is, your typical interview for the green card where they go and they’re asked questions, they verify that it’s a legitimate marriage, et cetera.

    And then luckily they come back unless they find another ground of inadmissibility. They bluff. They make a mistake in their interview. They say something, so many reasons why they get denied. But at any rate, that program, the provisional waiver, we don’t know if it’s going to stay or not. Nobody knows [00:21:00] really.

    So what’s happening now is I’m getting flooded with referrals because attorneys are telling their clients, do it now, get it in because even as they remove the program, they’re not going to cancel, whoever’s already in is staying in that path. So let’s get it in as soon as you can. So we’ve seen a significant increase in referrals for that program, for example.

    Dr. Sharp: I see. This might be a good time, since we’ve already mentioned two different circumstances, programs, waivers, et cetera, to do a quick overview of the different types of “immigration” evaluations because we hear this term and even for myself, I’m not an expert. I don’t think I could tell you the types with any accuracy. So that would probably be helpful here before we dive in deep.

    Dr. Mariela: Sure. I can start with those that I already mentioned. So the provisional [00:22:00] waiver or the waiver for that matter where the person that you’re evaluating is not actually the foreign national. It’s a U.S. citizen or a lawful permanent resident who’s coming in who needs to demonstrate to USCIS that they would suffer extreme hardship if they were to be separated or if they had to live abroad in order to stay together with her loved one.

    And so those people will come to us and we do a very thorough evaluation. What’s tricky about those evaluations is we’re speculating because they’re not separated already. So this isn’t about how you’re doing right now. It’s about based on how you’re doing right now, based on your history, your personality characteristics, the quality of your emotional bonds with your loved ones, we can anticipate how you will [00:23:00] fare in the face of separation from this person who also needs to demonstrate what they mean to you.

    Are they your main source of support system? Do you have already a family that’s built around perhaps specific roles? So one’s the breadwinner, the other one’s in charge of the family. So what would happen if one of the two has to leave? So those are the waiver. Some people call them the hardship waiver evaluation.

    Similarly, you have the cancellation of removal, which is pretty much the same referral question; what would happen if they had to separate? The difference is here they’re not separating for 10 years, they’re separating forever. If they’re deported, they’re not allowed back. This isn’t a temporary ban as with the other types.

    And the bar is set much higher in terms of what they need to prove for their suffering but for us, [00:24:00] it’s the exact same thing. In terms of evaluation, we’re evaluating the U.S. resident, U.S. citizen. There are some cases where we’ll evaluate the foreign national, but those are more specific in terms of what the referral question is. So it would be for a cancellation or removal, but it’s something more specific like rehabilitation or anything like that.

    And then you’ve got all the evaluations for cases of immigration relief. For example, asylum, people who are applying for asylum. That’s another thing; we don’t know what’s going to happen with asylum with this new administration, we don’t know what the requirements are going to be, if they’re going to even allow it, we really don’t know.

    There’s different types of asylum cases. And so in that case, we’re evaluating the foreign national. With asylum, for example, it could vary. It could be to document the [00:25:00] harm that they suffered as part of the persecution in their country of origin because that’s why they grant asylum, is they need to prove that they suffered persecution or they fear future persecution in part of the government or a group that the government is unable or unwilling to control. And that’s based on a number of race, gender, sexual orientation, et cetera.

    So in those cases, you are evaluating the foreign national, but the purpose of the evaluation might be to assess issues around credibility. So not so much about the harm they sustained but perhaps there were some inconsistencies in their testimony because a lot of these are handled in court, there were some things that perhaps the judge or the government attorney didn’t find them credible.

    I had one [00:26:00] recently where they said, “Well, every time he talked about it, he laughed.” And so they interpreted that as like oh, he thinks it’s funny. So it takes a mental health professional to be able to explain like, no, this is what happens when somebody’s recalling a trauma that’s really uncomfortable. Sometimes this anxiety gets manifested in nervous laughter that has nothing to do with something being funny or not funny.

    And then there’s other things like, for asylum, you need to apply within the first year of arriving to the country. So some people couldn’t do that, and so they need to demonstrate that there was a valid reason. It’s more specific but I’m summarizing it, that there was a valid reason that they didn’t apply on time. So we can explain that from a mental health perspective.

    Then you have evaluated victims of crimes [00:27:00] that occurred in the U.S. Those are called U visas victims of domestic violence under the under VAWA, Violence Against Women Act. It says women, but it applies equally to men, women and same sex relationships, marriages. So for those, we’re evaluating the foreign national who needs to substantiate their claim that they were victims of extreme cruelty at the hands of their spouse, their U.S. citizen or lawful permanent resident spouse.

    And then lastly, we have T visas. T visas are very popular recently. They changed the regulations last year. [00:28:00] And so they made it slightly easier for people to qualify for a T visa. It’s for victims of human trafficking.

    What’s interesting is that U visas, for example, have a cap of 10,000 per year. There is a waitlist of over 10, 15 years now because they always meet that cap really quickly but with T visas, the cap is 5,000 a year. As of now, they’ve never met that cap.

    That’s why, if they change the regulations, now all these attorneys are flooding, they’re just saying you qualify, let’s do this right now, let’s get in, before the waiting list develops and grows. So I think that’s another reason why we’ve been getting a lot of requests for those.

    And each evaluation is quite different in terms of what you need to focus on [00:29:00] and what you need to be mindful of. So you could include certain details that might seem monoecious to you as an evaluator, but that could jeopardize the client’s case.

    Dr. Sharp: Can you think of an example right off hand where we might be doing the best that we can and inadvertently put somebody in jeopardy?

    Dr. Mariela: Yeah. For example, you are trying to show how much a person suffered as a result of this intimate partner violence or a crime, et cetera, and the person discloses to you that they’ve had suicidal thoughts, no plan or intent, but passive suicidal ideation. You would think that’s great because that strengthens the report. It shows how much they’re suffering.

    It just so happens that if you mention suicide in a report to [00:30:00] USCIS, that’s going to trigger a need for clearance. They’re going to have to prove that they’re not a danger to themselves or others to immigration. So they’re going to get a letter, a request for more evidence, that says the doctor here is saying that you’re having thoughts of suicide. You need to prove to us that you’re not going to kill yourself.

    So very innocuous, very standard that you’re like, yeah, the more the better in terms of how we demonstrate how they’re doing. Something like that could really jeopardize a client’s case. At worst, it could also happen that the attorney catches it and says no, you can’t say that.

    They say that to the evaluator, the evaluator is like, I’m sorry. I wrote it. It’s what I wrote. It’s what I had to do. And so the attorney is going to say, okay, thank you, then we’re not going to use the report because we’re not going to jeopardize the client’s case. So then this [00:31:00] client came in, spent a bunch of money, time, and was hopeful about this helping and they’re not even going to use it, and the attorney is never going to refer a case to you again.

    So this is why it’s so important to know these little intricacies. Immigration law is the second most complex law in the country after tax law because it changes all the time. It’s constantly changing and so people need to keep up to date with the recent trends with regulations so that we don’t make these mistakes unknowingly.

    Dr. Sharp: Of course. Out of all the types of evaluations that you mentioned, at this point, which ones do you feel are the most in need or most in demand, most popular, if you want to think of it that way?

    Dr. Mariela: It depends [00:32:00] on the referral sources. So if you’re getting referrals from a legal nonprofit, you might get a lot of asylum requests. I think for the most part in general, I don’t even know if they have these statistics, but in my experience working about 17 years doing these evaluations, it’s the waivers that are the most popular because there are so many grounds of inadmissibility.

    There are so many reasons why the government will say you’re not allowed to stay or to enter the country and you need to cure those grounds of inadmissibility by proving certain things. And cancellation of removal. So what I anticipate now is cancellation of removal up to the roof, for sure.

    [00:33:00] Dr. Sharp: That makes sense. Maybe we dive into those. I’m thinking it would be helpful to provide some details, talk about what those look like, how to do a good evaluation, things like that.

    Dr. Mariela: For cancellation of removal, they need to prove this hardship to a qualifying relative, and that relative has to be either a son, daughter, spouse or parent, all of whom are U.S. residents or lawful permanent residents, U.S. citizens.

    What I get a lot is children. I get a lot of children’s referrals because it’s quite easy to prove that a child will suffer if you remove their parent, believe it or not. I’m being [00:34:00] sarcastic.

    Dr. Sharp: It makes sense.

    Dr. Mariela: It’s ridiculous that they need that. And so what I anticipate is that we’re going to be seeing a lot of these cases. I forgot your question, oh, about what these cases are like.

    Dr. Sharp: Yeah, diving a little deeper into what these evaluations look like, how to do them well, characteristics, details that we might need to know as practitioners if folks are out there like, hey, I’ve done two of these, I want to do more, or, oh, I see this huge need and opportunity, how do I get into that?

    Dr. Mariela: Yeah. There’s a lot of different types of mental health assessments that we do. Perhaps we’re used to going for a diagnosis, prognosis and recommendations. And in these immigration cases, sometimes the diagnosis is not as [00:35:00] important, or let me phrase it a different way; it’s very important if there is one, but sometimes there isn’t one.

    So you’re evaluating a child who’s happy-go-lucky. Parents are shielding them from what’s going on politically and with their immigration status, and they may not be at least consciously aware of what’s going on. So a child is not particularly anxious just yet, so they’re not going to meet the criteria for a diagnosis but there is so much you can say about this child if you start looking into their attachment style, their history; they had separation anxiety when they were little, all right, that’s a very good predictor for decompensating emotionally more so than they like to say the average person, if [00:36:00] they’ve separated from a parent.

    So is being able to focus on the referral question and honing in on that without adding extra information that’s unnecessary and that can cause these potential pitfalls that can jeopardize the case. I don’t know how much deeper you want me to go into.

    Dr. Sharp: Maybe we take almost like a big-picture overview of what the evaluation process looks like. So you get the referral from the attorney, presumably, and they say, I don’t know. What do they say?

    Dr. Mariela: First of all, it’s unlikely that you’ll get the call from the attorney. Yes. Typically, the client here is a person that’s coming in to see you. [00:37:00] And so the attorney referred them to you, but they’re the ones who are calling to schedule an appointment.

    And a lot of them don’t understand. They don’t know what it is that they need. For instance, I have an office manager here and she is very well-trained on all the different types of evaluations because she has to discern over the phone what type of evaluation they need. Is it for a VAWA? Is it for a cancellation of removal? Is it for a U visa? So she needs to know to ask the right questions because clients oftentimes have no idea. They will say, “My attorney told me to call and I need a letter.” It’s not a letter, it’s a report.

    And so once you figure out what type of case this is for, if it sounds weird and complicated, we end up calling the attorney and asking clarifying questions like what exactly do you want me to evaluate here? But that’s not the [00:38:00] norm. These attorneys have hundreds and hundreds of cases going at the same time and they usually have a sheet with check boxes; these are all the things that you need to get me, your fingerprints, your documents, your blah, blah, blah, and psychological evaluation. Here’s the number. Here’s the list of numbers to call and schedule it.

    So they would come in. I have them do a bunch of different tests and questionnaires, pencil and paper here in the office because I like to go over them with them afterward. So I like them to be done ahead of time before the interview. So they will do those.

    Dr. Sharp: Great. I was just clarifying the process. So this is happening before the intake, so to speak, for the interview.

    Dr. Mariela: Exactly. They come in and this is the first thing that they will do in addition to their consent forms et cetera. They will do a symptoms [00:39:00] checklist. A lot of people use back inventories or the SCL90, whatever it is that you want to use. We all have our preferences.

    And so it’s not overwhelming by any means. Of course, we have them in whatever languages they come in and those are the ones that we use meaning translate tests that are not originally in that language.

    I say that because we’re evaluating even in the cases where it’s a lawful permanent resident or a naturalized citizen, oftentimes they are immigrants themselves who just happen to adjust their status and they might prefer their native language. So we do those.

    And then they would come in for the interview which is around 2 hours long depending on the case. It’s [00:40:00] very focused on what’s going to be on the report because otherwise you would be here for hours on end. For instance, I’m not asking a lot of questions about their educational history, how they did it and what was their favorite subject. You don’t even go near there. It’s so irrelevant.

    That’s the interview. You want to have the referral question be the guide; how am I going to answer this referral question? What do I need? I think some people look at it as like everything’s coming from the client. They have all the information. I’m just going to organize it.

    The reason they come to us, mental health professionals, is because we can do a lot more than just regurgitate what the client is saying or even translate it into [00:41:00] some jargon. We can look beyond; we can connect the dots.

    You can say this person has this background, so that predisposed them to suffering later on. In particular, they have a propensity to compensate when they’re feeling abandoned or distant from a loved one. And that is super relevant to the referral question.

    Or this person, they’re telling you stories about their childhood. What they say in the interview, they give me a lot of information, but what I end up writing in the report is more concrete, it’s more specific. They might give me these instances of how when they were little, a kid stole something, stole their lunch, and they complained, and then they were the ones to get in trouble, and so from then on, they never spoke up for themselves again, because they knew that they would be the ones to get in [00:42:00] trouble.

    And now that person here is a victim of trafficking. And so you’re trying to explain how this impacted them. You can go back and connect the dots and say, this is a person who early on in life learned that speaking up for themselves was not only not going to do them any good, it could actually get them in trouble.

    So if your referral question is why didn’t they report this to the authorities? Well, here’s why. And that’s not something that if I were to ask the client, why didn’t you report it? And they’re going to say, “Oh, because when I was little, this happened.” They don’t make that connection.

    So it’s for us to realize these questions that might seem not that relevant, perhaps to the client, like why are you asking me about my childhood if what we’re here to talk about is what this person did to me two years ago? Then that’s why they come to us, [00:43:00] the mental health professionals, who know how to understand this.

    Dr. Sharp: Sure. This is a different flavor than I was anticipating with these evaluations. It is super interesting.

    The question that’s coming up for me, I’ll try to ask it in the right way is, just hearing you describe it, it sounds hard because you’re really looking pretty deeply and making connections that may or may not be obvious and certainly in this case of the specific evaluations, you’re projecting forward and guessing what someone might feel like. That just feels hard. I’m curious how it feels for you or if I’m off on?

    Let’s take a break to hear from a featured partner.

    Y’all know that I love TherapyNotes but I am not the only one. They have a 4.9 out of 5-star rating on [00:44:00] trustpilot.com and Google, which makes them the number one rated Electronic Health Record system available for mental health folks today. They make billing, scheduling, note-taking, and telehealth all incredibly easy. They also offer custom forms that you can send through the portal. For all the prescribers out there, TherapyNotes is proudly offering ePrescribe as well. And maybe the most important thing for me is that they have live telephone support seven days a week so you can actually talk to a real person in a timely manner.

    If you’re trying to switch from another EHR, the transition is incredibly easy. They’ll import your demographic data free of charge so you can get going right away. So if you’re curious or you want to switch or you need a new EHR, try TherapyNotes for two months absolutely free. You can go to thetestingpsychologist.com/therapynotes and enter the code “testing”. Again, totally free. No strings attached. Check it out and see [00:45:00] why everyone is switching to TherapyNotes.

    I’m excited to tell you about PAR’s all-new PAR training platform, an elevated online learning environment with everything you need in one place. This is the new home for PARtalks webinars, many of which offer APA and NASP-approved CEs, and also houses on-demand learning tools and PAR product training resources. Best of all, it is free. Totally free. To learn more, visit parinc.com\resources\par-training.

    All right, let’s get back to the podcast.

    Dr. Mariela: Sure. To me, at this point, it feels very second nature. I might add that I think I have the extra help of the fact that I’m a psychoanalyst. And so for me, [00:46:00] connecting the dots in the past and the unconscious is something that I’m very keen on.

    I think what’s really hard, to be honest, is staying objective and neutral, which is so important because here I am saying the U.S. immigration system is biased. Okay, I can’t be biased. I’m the one who brings the objectivity to the playing field.

    Dr. Sharp: It seems very hard.

    Dr. Mariela: Yes, it is hard, but it’s so meaningful, so important for these cases. I have research to back me up. We went to school for this, the officer reading the report didn’t and so we’re educating them in a way, but it’s very tactfully and in a way that we don’t come across as [00:47:00] advocates, because if you come across as an advocate, then the report loses its weight.

    Dr. Sharp: How do you do that? That seems very challenging.

    Dr. Mariela: It is challenging. It’s something that I’m constantly working on. What I do is I’m constantly in communication with immigration attorneys. I go to  AILA conferences, which is the American Immigration Lawyers Association, to learn about new trends and what’s happening.

    Just to give you one example, we had in-house training from an immigration attorney on T visas because they’re so new and we’re trying to do a good job. She explained to us why it’s so important to not put so much background information on these reports, to not describe the trafficking in detail, which might be counterintuitive.

    Dr. Sharp: That seems [00:48:00] counterintuitive.

    Dr. Mariela: Exactly, but she had a very valid explanation. I’m explaining it. The client is writing it in their declaration. We have other evidence. We don’t need you to repeat it, especially if that’s going to open the door to inconsistencies because they will latch on to any inconsistency to basically say were you lying then or are you lying now? That’s the attitude.

    The important thing, the reason we come to you is not for you to tell what happened, but to talk about how it impacted the person that only you as a mental health professional can do. You can have that perspective.

    Dr. Sharp: I’m just noticing the admiration and respect for clinicians who do this, because it seems like that takes so much self-awareness and monitoring because as human nature, what I’m gathering from [00:49:00] the way you describe this is like the USCIS, their vibe, so to speak, is to be pretty detail-oriented, they scrutinize and they’re not coming at this from a place of trying to help people really, it’s how can we screen out these individuals and get them out of the country?

    And so I think it’s human nature to want to push against that and do a counterbalancing approach. You just said if we come across as too much of an advocate, that’s going to set off alarm bells as well.

    Dr. Mariela: Exactly. They’ll say that you’re biased.

    Dr. Sharp: Yes.

    Dr. Mariela: How do we know you’re not exaggerating? How do we know that you took everything into consideration? A lot of these cases are not adjudicated in court. [00:50:00] They’re decided administratively. So you never get to talk to the adjudicator. The client never gets to talk to the adjudicator. It’s all paperwork. So you really have to get your point across.

    One thing that I always say is you need to be two steps ahead. You need to think like the reader and think what is a reader going to argue? Yes, but, and address it. Jump right into it and address it before they have that argument that might at best elicit a request for more evidence, which delays the whole process and costs more money, and at worst they can just decide against the case.

    Dr. Sharp: These evaluations seem like they are also rife for our own confirmation bias, mainly. The individuals are coming in, [00:51:00] you want to be an advocate, you want to be helpful. I’m curious how you work against that as well. It’s a similar question to how you stay objective, but I wonder, does anyone come in and you actually say, I don’t see any hardship here? I don’t see any evidence for that.

    Dr. Mariela: Thankfully, they’re properly screened. The attorneys that we work with, I created this screener that they can give to their clients to see if they would benefit from a psychological evaluation. And so some of them give it to them.

    They know that it costs money and it takes time. And if attorneys are sending them, they’re usually pretty good attorneys who know that a psychological evaluation would help. So it’s not as common as you would think, but it is.

    As a matter of fact, we had one [00:52:00] yesterday. One of my clinicians called me and she’s like, “I don’t know what to do. This guy is a total pro-Trumper who’s saying they need to build a wall and keep everybody outside except for his wife.” He went on a rant of 45 minutes and it was like, oh, wow, okay we can talk about it.

    I don’t have any more details about it, but I don’t know how good of a case this might be. And then in that case, we might end up either not writing the report and telling them that it’s not going to be in their favor or we might shift gears in that instead of addressing that referral question, we might turn it into a psychodiagnostic evaluation and let the attorney use it however they want to use it.

    So if we’re diagnosing this person suffers from anxiety and they need treatment, this is what’s going to happen if they don’t get treatment or whatever it is that they want us to do and then let the attorney work their skills into [00:53:00] fitting it in and making it helpful for their case. That’s not our job. The attorneys are the ones who know what to do.

    But for the most part, you’d be surprised because there’s so much secondary gain, but there’s very little malingering in this population. There’s some exaggeration, but we need to understand that the exaggeration is from a place of desperation because this is so unfair; how do I prove to you that this is going to hurt me, to ruin my life in some cases?

    So we need to look beyond that and not say he exaggerated, he was malingering. There’s not even need to mention that because you understand what that means and you can look beyond. That’s why all the self-report measures and stuff, they add that “objective” evidence. There’s nothing objective about a self-report measure, [00:54:00] but it looks good on paper.

    Ultimately, it’s your clinical judgment, in having years of working with human beings and understanding how their minds work, how their defenses pop up, how they react in the face of fear, in the face of uncertainty, and the aftermath of trauma, et cetera.

    Dr. Sharp: We haven’t talked much about the battery. You bring up self-report measures. We talked about the interview, the consult, and then the interview, what does the actual testing look like or the assessment process maybe?

    Dr. Mariela: Everybody’s different. I think some people don’t do any testing at all. It depends for the type of case. In general, I do the SCID, [00:55:00] the semi-structured clinical interview for DSM-5 disorders.

    I have a system where I give them a questionnaire of symptoms that I developed, that I came up with, and then based on their answers to that, then during the interview, I ask them more follow-up questions to get to the root of it. So you’re saying, I’m feeling sad, tell me more about that sadness. Is it more days than not? The flow chart of the SCID interview.

    I also give them an attachment measure to assess their attachment style in cases where it’s about the relationship. I like the projective testing because of my background, so I like sentence completion. You’d be surprised, I get so much from those responses. Just reading through, I notice some themes. I see what’s important to them, what their values are.

    [00:56:00] Of course, you’re not going to base any conclusions on any one test. And no test is going to taint the rest of the information that you have. So you take it all in the aggregate, and you look at it qualitatively as well. Are they second-guessing themselves a lot? Yeah, it says nothing about what they’re writing on the actual questionnaire, but it tells me something about them as a person, and their personality.

    In the “bigger” tests, I like the PAI, the Personality Assessment Instrument, because it talks more about their strengths or weaknesses, and their ways of relating with others. I find it to be quite accurate. I’ve done others, for instance, the MCMI, because it was normed in a clinical population, it tends to over pathologize or to [00:57:00] accuse people of minimizing denying when they’re totally okay and the PAI doesn’t do that.

    So that’s one that I really like. If I’m assessing trauma, the TSI, the Trauma Symptom Inventory-2. I really like that one. Both of those have validity scales as well that make them a lot more objective. I like that one because it goes beyond just symptoms. It talks about how they cope, how they see themselves, et cetera. So those are the two biggest ones, the longest ones that we give, I would say.

    Dr. Sharp: That’s fantastic.

    Dr. Mariela: And then I didn’t say, it doesn’t end with the interview, then we write the report for that. Then the clients, when they leave and then we write the report. I always follow the same [00:58:00] format. That’s just the stylization. There isn’t one way to write it.

    And then we can either send it to the client or they can sign a release and we send it directly to the attorney, which 99% of people prefer that just because they want to keep it all together in one place. I don’t know, they just prefer that.

    Dr. Sharp: Sure. That makes sense to me. So this is all happening essentially in one or two days and then you write the report.

    Dr. Mariela: Yeah. So people vary. Some people like to have separate interviews. Listen, I’m an analyst. I see people four times a week. So for me, the more the merrier. But for this population and for these cases, I’m also a forensic psychologist, so I go to jails and evaluate people in just one sitting and that’s enough. It’s enough for the court. That’s enough to answer the referral question.

    [00:59:00] So this is the same thing with the exception of some situations where they’re re-traumatized. It’s really hard to get through, or perhaps something happens that we need to interrupt and continue on a different day. I typically just do it in just one sitting.

    The reason that I do this is not for me, but more for them. Because these are people who are all typically working, or if they’re not working, they’re caring for a child, so coming to see me takes a big effort. They have to take time off work, they have to have somebody watch their children, they have to make their way down here, perhaps they don’t have transportation. And so I just want to make it easier on them.

    If it were up to me, yes, I’d stretch it out as long as I could, but I’m confident that I can get the information that I need to [01:00:00] answer the referral question in just one sitting. Why? Because I know what I’m doing. I know what I’m asking. I know what I’m looking for.

    Dr. Sharp: That makes sense. Well said. So maybe we start to close. This has been incredibly helpful. I wonder if we start to close with some myths around these evaluations because clinicians may be thinking about getting into this work. I think there are some myths that are worth addressing. Can you speak to this?

    Dr. Mariela: Some of the things that I hear a lot is they think that they have to be bilingual to do this type of work. First of all, you’re working with immigrants from all over the world, so you should be, what’s the word for people who speak more than five languages? I forget what it is, but anyway that’s impossible. Absolutely not.

    First of all, a lot of the evaluations are conducted in English because the people speak [01:01:00] English, especially the cancellation of removal or the waivers because it’s the U.S. citizen or U.S. resident that’s coming in to see you. So those are carried out in English.

    And then there’s also the use of interpreters. I have a lot to say about interpreters because I used to be an interpreter many years ago. And so I like to meet with them ahead of time, train them because this is very different than what they’re used to.

    Interpreters typically go to doctor’s offices, go to court. They’re are listening to some traumatic story that might elicit some feelings in them like their own trauma history because if they’re speaking the same language, it’s also likely that they come from the same region, especially if it’s a dialect. So very important to know how to work with that interpreter, but they are extremely helpful. You can do very good [01:02:00] interview with the aid of an interpreter.

    So yes, you don’t have to be bilingual. Of course, it helps if you speak another language. I speak Spanish and Portuguese and it’s great because a lot of the referrals that I get are in Spanish, but I also get referrals, people who speak Arabic, Vietnamese, Chinese or all kinds of different languages.

    Dr. Sharp: Great. I wonder if that’s another myth is that all of these evaluations are with Spanish-speaking individuals.

    Dr. Mariela: That’s definitely a myth but it depends on where you live. I’m in San Diego. We’re right next door to Mexico. So we do get a lot of Spanish speakers, absolutely. But we also have a very large Middle Eastern community here. So we have one interpreter who speaks Arabic and we work with her consistently. She’s almost part of the team because we’re working with those people so much.

    So depending on where you [01:03:00] live, it could be Punjabi, it could be Chinese, Portuguese, wherever you are, that might be the referrals that you get more of.

    Dr. Sharp: I see. So being bilingual, that’s a myth. What else? Are any other myths that you are seeing coming up? What about testifying? Are you going to court a lot?

    Dr. Mariela: Oh, yes. Okay, good. So the interesting thing about these cases is a lot of them are not adjudicated in court. So like waivers, a U visa, a T visa, they’re not going to court. So there’s absolutely no risk of testifying.

    And even those that do go to court like cancellation of removal and asylum, it’s not like in the criminal system where you get a subpoena and you have to go or you get deposed. It’s not adversarial like that at all.

    [01:04:00] Usually, what ends up happening, which I think is going to happen a lot more now, the attorney wants to cover all their bases and say you wrote a great report but just in case they have a question about it, I want to have you there as a witness. If they have any issues, I want to be able to say, oh, let’s call her in and she can testify.

    Or they may have gone in for a hearing and there were some issues with the report, with your opinion. And so the government attorney or the immigration judge might say we need some clarification on some things. And so they’ll invite you. You don’t get a subpoena.

    Again, I want to help my client’s cases. So yeah, you [01:05:00] would just go. It’s somewhat adversarial in the part where you know what deer that they do for any type of testimony where they try to demonstrate what qualifies you as an expert and then the opposing side is going to try to poke holes on that. So that’s not super pleasant but at the end of the day, you’re being very objective. You have the information that you got, you have your knowledge, and that’s what you’re speaking to. You’re not speaking for the client you’re, you do the best you can.

    And they’re bringing you in as the expert, as the one who knows about something that they don’t know about. Even with that, I have to say, I’ve testified about five times in my entire career. I’ve even signed off on more than [01:06:00] 2000 evaluations.

    So it’s not very common but I don’t know what’s going to happen this year with this administration. I don’t know if they’re going to want us there just in case, or if judges are going to be like, no, I want to talk to this doctor. I don’t want to just read the report. I really have no idea. So maybe we can meet back in a year and I can give you an update.

    Dr. Sharp: Yeah. I’d welcome that. Things are changing in the moment. Yes.

    Dr. Mariela: Yeah. And then along those same lines, if you’re a person who’s like, absolutely not, the thought of going into a courthouse frightens me, just don’t take cases that are adjudicated in court.

    Dr. Sharp: Sounds easy enough.

    Dr. Mariela: And then you’re good to go. Tell attorneys, “Hey, FYI, I’m doing this evaluation, I’ll write a great report but don’t ask me to testify, I can’t testify.” And they might say, “No, this case is pretty straightforward, we’re good.” Or they might say, “Okay, then maybe I’m going to go with [01:07:00] somebody else, just in case.” Either way, you don’t have to testify.

    Dr. Sharp: Great. Well said. Gosh, we have covered a lot of the logistical and philosophical or emotional components of this whole process. I think it’s incredibly timely, like you said, and for better, for worse, nothing else, clinicians can look at this as, hey, there’s a real opportunity here to do some good.

    Dr. Mariela: The cool thing about this work is that I train people and many of the people I train are perhaps clinical social workers, professional counselors, or MFTs and they never thought that they could get involved in the forensic field because they don’t have that training. But if you get the [01:08:00] adequate training for doing these evaluations, you have the training, the education, the knowledge, that’s all you need to qualify as an expert, it doesn’t matter what your degree is.

    Dr. Sharp: That’s important.

    Dr. Mariela: That’s what I really like about this is that it doesn’t close the door to other types of mental health professionals who want to do this work that’s very rewarding emotionally which again, don’t let that come across in the report, but it is rewarding. You’re doing a very good job.

    And quite frankly, it can’t be lucrative. It’s a great way to diversify your practice to instead of being dependent on or seeing number of patients per week, you might say, instead of so many patients, I might supplement with an evaluation. You don’t have to dedicate yourself to just do this. By all means, this is not all I [01:09:00] do.

    Dr. Sharp: That’s a great point. It has to be financially sustainable.

    Dr. Mariela: Right.

    Dr. Sharp: Nice. This is awesome. If people want to reach out, want to learn more, what is the best way to do that?

    Dr. Mariela: They can go on my website, which is psychevalcoach.com, and there I have a free guide. If they want more information on specific cases, what they entail, what this work looks like, I have a free guide, Introductory Guide to Immigration Evaluations, that they can download and learn a bit more about it.

    Dr. Sharp: Love it. We love free stuff. Thank you. No, I really appreciate it. It was great to connect with you again and talk through something that is super timely and important for our country right now. Great to see you again.

    Dr. Mariela: I agree. You too, Jeremy. Thank you.

    [01:10:00] Dr. Sharp: All right, y’all. Thank you so much for tuning into this episode. Always grateful to have you here. I hope that you take away some information that you can implement in your practice and in your life. Any resources that we mentioned during the episode will be listed in the show notes so make sure to check those out.

    If you like what you hear on the podcast, I would be so grateful if you left a review on iTunes, Spotify, or wherever you listen to your podcasts.

    And if you’re a practice owner or aspiring practice owner, I’d invite you to check out The Testing Psychologist mastermind groups. I have mastermind groups at every stage of practice development; beginner, intermediate, and advanced. We have homework, we have accountability, we have support, we have resources. These groups are amazing. We do a lot of work and a lot of connecting. If that sounds interesting to you, you can check out the details at thetestingpsychologist.com/consulting. You can sign up for a pre-group phone call [01:11:00] and we will chat and figure out if a group could be a good fit for you. Thanks so much.

    The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric, or medical advice, diagnosis, or treatment.

    Please note that no doctor-patient relationship is formed here and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified [01:12:00] advice of any mental health practitioner or medical provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 486. Immigration Evals as Advocacy w/ Dr. Mariela Shibley

    486. Immigration Evals as Advocacy w/ Dr. Mariela Shibley

    Would you rather read the transcript? Click Here.

    Dr. Mariela Shibley returns to discuss the critical role of immigration evaluations in the current immigration system. She shares her personal experiences as an immigrant and mental health professional, emphasizing the importance of these evaluations in providing objective data to support immigration cases. The discussion covers the historical context of immigration in the U.S., the current climate of fear within immigrant communities, and the various types of evaluations needed for different immigration cases. Mariela also highlights the challenges faced by mental health professionals in conducting these evaluations and offers insights into best practices for ensuring effective and supportive assessments. The conversation also addresses common myths about immigration evals, such as the necessity of being bilingual and the frequency of court appearances.

    Cool Things Mentioned

    Featured Resources

    I am honored to partner with two AMAZING companies to help improve your testing practice!

    PAR is a long time supporter of the Testing Psychologist podcast, and I will continue to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Mariela Shibley

    Dr. Mariela Shibley is a clinical and forensic psychologist, psychoanalyst, and expert in conducting immigration evaluations. She has a private practice in San Diego, California, where she also trains and supervises mental health professionals. Dr. Shibley is the founder of the online training program PsychEvalCoach, which trains clinicians to conduct immigration evaluations, and she authored the book, “Conducting Immigration Evaluations: A Practical Guide for Mental Health Professionals” published by Routledge in 2022. Additionally, Dr. Shibley serves as the Director of Mental Health at the University of California San Diego Student-Run Free Clinic and holds an adjunct faculty position at the California School of Professional Psychology. Dr. Shibley’s latest endeavor involves establishing a non-profit organization to increase access to low or no-cost immigration evaluations by training mental health providers and partnering with attorneys and legal nonprofits to facilitate these services to individuals in need.

    Get in Touch

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 484 Transcript

    [00:00:00] Hello everyone, and welcome to The Testing Psychologist podcast. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    Many of y’all know that I have been using TherapyNotes as our practice EHR for over 10 years now. I’ve looked at others and I keep coming back to TherapyNotes because they do it all. If you’re interested in An EHR for your practice, you can get two free months of TherapyNotes by going to the testingpsychologist.com/therapynotes and enter the code “testing”.

    This podcast is brought to you in part by PAR.

    The NEO Inventories Normative Update is now available with a new normative sample that is more representative of the current US population. Visit parinc.com/neo.

    Hey folks, welcome back to The Testing Psychologist. We’re here with another episode, but not just any episode y’all, it is the end of 2024, which means it is [00:01:00] time for another best of episode.

    2024 marks eight complete years for the podcast with no signs of slowing down, which is both exciting and unbelievable. I started in January 2017 and had no idea at that time that we would be almost 500 episodes down the road and eight years down the road, tons of guests, a lot of connection with brand new, amazing folks and all kinds of relationships formed over those years.

    2024 was a remarkable year for me. 

    On the testing psychologist side, I had the opportunity to interview several subject matter experts on a wide variety of clinical and business topics. I introduced Á La Carte strategy sessions in addition to my individual consulting packages and groups, which let me connect with and hopefully help practitioners in a new way as folks seem to appreciate a more [00:02:00] bite-sized version of consulting. The second annual Crafted Practice event was a success and really locked in my intent to offer an in-person gathering for testing folks every year as long as I possibly can.

    On the clinical side, many of you know if you’ve been listening that my clinical practice went through a big transition this year as we right-sized down from 40+ practitioners and staff to about 15 of us in pursuit of a little more joy and fun in my work. 2024 was also the year that me and my partner formally released Reverb, our AI-powered report-writing platform, and we saw it grow from virtually nothing to a user base of several hundred and getting great feedback with that. Personally, I’m fortunate my kids and wife are healthy and happy [00:03:00] right at the moment, and I’ll take that whenever I can get it.

    In short, there’s a lot to be grateful for. I am incredibly grateful for my guests here in 2024. You will hear quite an amazing list of best episodes from this year and no coincidence. I don’t think that none of these are solo episodes. These are all episodes with guests with good reason. I, like I said, I’ve had the great fortune to talk with any number of experts over the years and 2024 was no exception to that.

    Thank you all for listening to the podcast and being part of this Testing Psychologist world. For both new folks and long time super fans, super grateful for all of you. I’m excited for all that 2025 might bring for The Testing Psychologist and for all of you out there running practices and doing testing. For now, let’s review the [00:04:00] top five most downloaded episodes of 2024.

    Okay, folks, we are back and I am diving right into the best episodes of 2024. These are the top 5, like I said, most downloaded episodes of the year. There were a few surprises on here, I will say, and that’s always fun to go through. I don’t really check the statistics across the course of the year. I come to these end-of-the-year episodes, jump in, and see what was most popular. There’s usually some surprises but there were two that certainly were not surprising for me to see on this list. I’d be curious what you all think, but here we go, without further [00:05:00] ado.

    The number 5 most downloaded episode of 2024 was episode 442 titled The Risk and Vulnerability of Business Ownership with Scott Robson. Scott is a consultant and marketing expert. He jumped on the podcast to talk about his approach to marketing and consulting. He does a lot of that with mental health practice owners and other business owners. What is unique about Scott’s approach is that he focuses in on the underlying feelings of risk and vulnerability that go along with running a practice and business ownership in general. 

    The unique aspect of this podcast is that he was willing to participate in a live coaching session, essentially, where I presented him with a few concerns and he led me through a coaching exercise [00:06:00] to get at some of the vulnerability that may come up in this process. It was indeed pretty vulnerable for me to do that. I didn’t know where it was going to go, but I immediately felt totally secure with Scott leading the way and I think it turned out well. I’ve heard several folks since then mentioned that episode and have connected with Scott and worked with him and got nothing but great feedback from those folks. So, episode 442, The Risk and Vulnerability of Business Ownership with Scott Robson.

    The next most downloaded episode is number 447. Gender Affirming Assessment with Dr. Jae Purnell & Dr. Emily Trittschuh. The title says it all, I think. I waited a long time before doing an episode specifically on gender-affirming assessment, and I’m so glad that I did. I found [00:07:00] Jae and Emily on the programming for last year’s AACN conference doing a talk of a similar name and topic. They were willing to come on the show and talk through this content in a way that I thought was very accessible, fresh, and research-informed.

    The part that I love about this episode is that Jae and Emily bring a neuropsychological lens to gender-affirming assessment. There is plenty of science to back up their ideas, their strategies, and the discussion. And that, I think set it apart from some of the other conversations and environments that we talk about this topic in.

    There’s a ton of good content in this episode. We talk about what is meant by gender affirming assessment and [00:08:00] strategies for performing gender affirming assessment. We get into the issue of which norms to use for gender diverse folks. There was a ton of good content. This is a topic that will continue to be relevant, I think as we develop as clinicians and I hope that you will check it out: episode 447. Gender Affirming Assessment with Dr. Jae Purnell & Dr. Emily Trittschuh.

    The 3rd most downloaded episode for The Testing Psychologist in 2024 is episode 461. Decision Making and Clinical Judgment with Dr. David Faust. This was a little bit of a dark horse winner this year, reason being not because the content wasn’t incredibly informative and rich, but because this is a topic that is a little hard to access in my [00:09:00] mind.

    This particular podcast was, I think, chock full of great information and a bit dense, I would say, as a result. There’s a lot to sort through with this podcast. I’m just excited that so many folks decided to access it and dig into the content. It mirrored some of the content from Dr. Faust’s recent book, and in that he walks through his approach to clinical judgment, the role in decision-making and how we can employ, how would I phrase it? How we would employ empirical, research-informed techniques to make our clinical judgments and decisions limit bias in the work that we do.

    Certainly, check that out. It’s an important topic in the work that we do [00:10:00] because, like many physicians or health care practitioners, our work is rife with the possibility for bias and having some decision-making skills, clinical judgment rooted in research is exceptionally helpful. Episode 461. Decision Making and Clinical Judgment with Dr. David Faust. 

    Let’s take a break to hear from a featured partner.

    Y’all know that I love TherapyNotes, but I am not the only one. They have a 4. 9 out of 5-star rating on trustpilot.com and Google, which makes them the number one rated Electronic Health Record system available for mental health folks today. They make billing, scheduling, note-taking, and telehealth all incredibly easy. They also offer custom forms that you can send through the portal. For all the prescribers out there, TherapyNotes is proudly offering ePrescribe as well. And maybe the most important thing for me is that they [00:11:00] have live telephone support seven days a week so you can actually talk to a real person in a timely manner.

    If you’re trying to switch from another EHR, the transition is incredibly easy. They’ll import your demographic data free of charge, so you can get going right away. If you’re curious, or you want to switch, or you need a new EHR, try TherapyNotes for two months, absolutely free. You can go to thetestingpsychologist.com/therapynotes and enter the code “testing.” Again, totally free, no strings attached. Check it out and see why everyone is switching to TherapyNotes.

    Our friends at PAR have released the NEO Inventories Normative Update. The NEO Inventories measure the five major dimensions of personality and the most important facets that define each. Now with an updated normative sample, that’s more representative of the current US population and fewer components for easier purchasing. Visit parinc.com/neo.

    [00:12:00] Okay, folks. We are getting to the top two most downloaded episodes of 2024. The 2nd most downloaded episode is episode 466. Neurodiversity Affirming Assessment with Dr. Matt Zakreski. This was no surprise whatsoever and not a coincidence in my mind that we have two episodes in the top five with the word affirming in the title. Neurodiversity Affirming Assessment.

    Dr. Matt and I talked through several strategies that he employs to make the assessment process more affirming for neurodiverse folks. Matt specializes in working with gifted, 2E, and other neurodiverse individuals.

    We start with a definition of neurodiversity affirming and then get into specific [00:13:00] strategies and skills that I think a lot of us as clinicians can implement in our practice without a lot of effort and it all goes toward helping the environment and the process be more accessible and more friendly to a wider wider variety of folks who come through our doors. And this is super important.

    The neurodiversity movement has been strong for a number of years and is continuing to gain steam. I think it’s up to us as clinicians, it’s almost an imperative at this point to be looking at things through an affirming lens and have some of those tools in our kit to be able to provide an affirming assessment process. So episode 466. Neurodiversity Affirming Assessment with Dr. Matt Zakreski.

    Okay, y’all, thanks for hanging in with me [00:14:00] until this point. We are up to the time where we can talk about the number one most downloaded, most popular Testing Psychologist Podcast episode of 2024. I’m going to give you three seconds to think about which episode this might have been. And here it is. Number 443. A Deep Dive Into Continuous Performance Tests with Dr. Chris Mulchay.

    Now this one, I’m laughing because I’m just laughing y’all. The number one most downloaded episode is an episode on continuous performance tests. What one might consider an otherwise dry topic was I thought masterfully brought to life by Chris in this episode.

    When we say deep dive into continuous performance tests, it truly was a deep dive. We talked about the history of continuous performance tests, [00:15:00] the evolution of the CPT roots in the past, and where our current measures have come from. We get into the research supporting several of the most popular CPTs. Chris is a perfect individual to talk about these things. He has been researching and writing about CPTs for years now at this point and provides, like I said a nice, rounded clinically-informed and research-informed perspective on a pretty fraught topic. I think a lot of us wrestle with whether CPTs are “worth it” and if we need to have them in our practice, and if so, which one do we pick and any number of other questions and this episode, I think did a great job of tackling those questions and giving some specifically useful information if you are [00:16:00] considering the status of CPTs in your practice.

    Chris is a return guest, a friend, and a co-moderator of The Testing Psychologist Facebook Community. He does it all. I was, again, very grateful to have him here on episode 443, the most downloaded episode of 2024, A Deep Dive Into Continuous Performance Tests.

    So that’s it folks. That’s it. Thanks for tuning in. Thanks for listening for another year. Like I said, I know we have some new listeners, we have some old listeners, and I am just happy to be here with all of you and consider it a real honor to be able to spend time with you in this way a few times a month. If you have anything that you want to see in terms of Testing Psychologist podcast content in 2025, feel free to send me a message or post in the Facebook group. I do look at all of those and consider these topics pretty deeply as [00:17:00] I am planning my content for the next year.

    Of course, if you want any support in your assessment business, you’re welcome to reach out. You can go to thetestingpsychologist.com/consulting, get info on all the different ways that we could work together and we’ll connect and figure out if it makes sense to do so. In the meantime, I hope all of you get to enjoy some time off over the holidays. Maybe do a little planning for next year. Maybe not. Maybe you just rest. It’s okay too. I look forward to seeing you and talking with you in 2025.

    All right, y’all. Thank you so much for tuning into this episode. Always grateful to have you here. I hope that you take away some information that you can implement in your practice and in your life. Any resources that we mentioned during the episode will be listed in the show notes, so make sure to check those out.

    If you like what you hear on the podcast, I would be so grateful if you left a review on iTunes or [00:18:00] Spotify or wherever you listen to your podcasts.

    If you’re a practice owner or aspiring practice owner, I’d invite you to check out The Testing Psychologist mastermind groups. I have mastermind groups at every stage of practice development, beginner, intermediate, and advanced. We have homework, we have accountability, we have support, we have resources. These groups are amazing. We do a lot of work and a lot of connecting. If that sounds interesting to you, you can check out the details at thetestingpsychologist.com/consulting. You can sign up for a pre-group phone call and we will chat and figure out if a group could be a good fit for you. Thanks so much.

    [00:19:00] The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric or medical advice, diagnosis, or treatment. Please note that no doctor-patient relationship is formed here, and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified advice of any mental health practitioner or medical provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 484. The Best Episodes of 2024

    484. The Best Episodes of 2024

    Would you rather read the transcript? Click here.

    That’s right, everyone – it’s time for another “best of” episode! This marks EIGHT YEARS for the podcast, with no signs of slowing down.

    2024 was a remarkable year for me. On the Testing Psychologist side, I had the opportunity to interview several subject-matter experts on a wide variety of clinical and business topics. I introduced a la carte Strategy Sessions in addition to my individual consulting packages and groups, which let me connect with- and hopefully help practitioners in a new way as folks seemed to appreciate a more bite-sized version of consulting. The second annual Crafted Practice retreat was a success and cemented my intent to offer an in-person gathering for testing folks every year.

    On the clinical side, many of you know that my clinical practice went through a big transition as we right-sized down from 40+ to about 15 of us, in a pursuit of a little more joy and fun in my work. 2024 was also the year that me and my partner released Reverb, our AI-powered report-writing platform, and we saw it grow from virtually nothing to a user base of several hundred. Personally, my kids and wife are healthy and happy. 

    In short, there’s a lot to be grateful for. Thank you all for listening to the podcast and being a part of the Testing Psychologist world. I’m excited for all that 2025 might bring! For now, let’s review the top five most downloaded episodes of 2024.

    Cool Things Mentioned

    Featured Resources

    I am honored to partner with two AMAZING companies to help improve your testing practice!

    PAR is a long time supporter of the Testing Psychologist podcast, and I will continue to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing

    The Testing Psychologist podcast is approved for CEU’s!I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 483 Transcript

    [00:00:00] Dr. Sharp: Hello, everyone. Welcome to The Testing Psychologist podcast. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    Many of y’all know that I have been using TherapyNotes as our practice EHR for over 10 years now. I’ve looked at others and I just keep coming back to TherapyNotes because they do it all. If you’re interested in an EHR for your practice, you can get two free months of TherapyNotes by going to thetestingpsychologist.com/therapynotes and enter the code “testing”.

    This podcast is brought to you in part by PAR.

    The NEO Inventories Normative Update is now available with a new normative sample that is more representative of the current U.S. population. Visit parinc.com/neo.

    Hey, everyone. Welcome back to The Testing Psychologist podcast. I’m here with you for another clinical episode. Today, I am talking with Test [00:01:00] Developer, Dr. Andrey Vyshedskiy and Customer Solutions Director, Kevin Wolfe. They are the lead folks at Boston Cognitive.

    You may have heard of the Boston Cognitive Assessment. It is a brief cognitive measure for adults to determine whether there’s evidence of cognitive decline and reason for a more thorough battery. So if you’re in a practice working with adults, this can be cool tool. I tried it myself. It’s pretty elegant administration.

    We get into a lot of details around Boston Cognitive. We talk about the development, norm and standardization, clinical use cases, billing, anything that you might want to know about trying this measure. Of course, the hope is that it may fit into your practice.

    Let me tell you a little bit about the guests and then we’ll get to the conversation. Dr. Andrey Vyshedskiy got a PhD in Neuroscience from Boston University. He’s conducted [00:02:00] research in neuroscience, cardiopulmonary acoustics, optical vibrometry, and developmental psychology.

    He’s co-founded several successful companies, received numerous awards from the NSF, the NIH, and the DOD, and directed the development of several FDA-approved medical devices. He has authored over 100 scientific publications, book chapters, and conference presentations. His work has appeared in the New England Journal of Medicine, Thorax, Chest, the Journal of Neuroscience, and other leading scientific journals.

    His partner here, Kevin Wolfe, is the Director of Customer Solutions at Boston Cognitive. As you will hear on the episode, there’s a discount code for our users. It’s TESTPSYCH50. That’ll also be in the show notes, but you can email Kevin to learn how to get started with Boston Cognitive and make sure to get that code applied.

    Like I said, this is an interesting discussion. I know very little about the area of test [00:03:00] development, so being able to have a conversation with folks who have done that is always intriguing to me. I think you’ll be interested to hear the use cases for this measure and how it might fit into particularly a practice that specializes in adult neuropsychology.

    At this point in time, this should release in late December. So there may still be some spots or availability for The Testing Psychologist mastermind groups, which start in mid-January, late January, 2025. These are group coaching experiences for folks any level of practice development. You can get more information and sign up for a pre-group call at thetestingpsychologist.com/consulting.

    In the meantime, I will present to you my conversation with Dr. Andrey Vyshedskiy and Kevin Wolfe.

    [00:04:00] Andrey, Kevin, welcome to the podcast. First of all, when I have multiple guests, I always like to have folks just say a little bit about yourselves so that people can orient to your voice. They’ve already heard the full introduction so they have a good idea, theoretically, of who you are, but let’s, like I said, give them a chance to orient to your voice. So Kevin, if you want to go first.

    Kelvin: Hi, this is Kevin Wolfe. I’m the Sales Manager at Boston Cognitive. I came across their technology about a year ago and we are launching it to the commercial market with great success. I look forward to [00:05:00] more psychologists becoming aware that it’s there.

    Dr. Sharp: Fantastic. Andrey.

    Dr. Andrey: Hi, this is Andrey Vyshedskiy. My background is neuroscience. We developed this cognitive. assessment about 5 years ago. We spent a lot of time on it and we’re proud that it is finally finds interaction

    with a lot of clinicians and researchers.

    Dr. Sharp: Awesome. Yes. I’m glad to have you guys here on the podcast to talk about Boston Cognitive. It’s a really interesting measure. I think it occupies a unique space in the field that a lot of people are trying to occupy. So I’m really interested in a more in depth discussion here about the measure.

    I’ll start with the question that I always start with for folks, which is, why this? Out of all the things you could do with your time and energy in this field, why are you putting all of your [00:06:00] time and energy into this particular pursuit? Maybe Andrey, you can start.

    Dr. Andrey: Absolutely. The history of the development of this assessment is very interesting. We’ve been conducting observational clinical trial of a novel intervention for Alzheimer’s and we needed a tool to measure cognition online virtually, and there was really nothing available. We had to create our own tool.

    We spent probably three or four years thinking carefully and developing this measure, Boston Cognitive Assessment, and then we used it inside our observational clinical trial, which was successful. [00:07:00] We wanted an assessment that’s about 10-minute-long, that goes through multiple domains and that people feel comfortable with, people feel fun almost playing with it. So that’s what we’ve done.

    Dr. Sharp: Yes. Kevin, how about you?

    Kelvin: My story is a bit more personal. My father passed away last July from heart failure. He had moderate to severe dementia. He had been declining for years. I begged my mother to not let him drive anymore. I would not ride in the car with him. His primary care physician never tested him once, his cardiologist never said anything, and my mother to this day maintains dad did not have dementia because it wasn’t on his test.

    We have 10,000 Americans a day turning 65. The need for [00:08:00] an efficient, accurate, reputable assessment is needed more than ever. And so my mission is to try and get primary care physicians to further to neuropsychology, to neurology, get those patients tested, and get them the appropriate interventions.

    Dr. Sharp: I think that personal component, I would imagine a lot of people can identify with that just as our parents or grandparents or siblings now at this point are aging into that cohort. It’s just growing larger and larger, the number of folks who might need something like this.

    Let’s go back to the beginning. I would love to have some insight into the development process. I have a sense of [00:09:00] how you came up with the idea, but how you even got started on developing something like this. We can dive into some details as we go along.

    Dr. Andrey: That is very interesting. We started with many possible cognitive tasks that we can try. They were about maybe 20 or more. I still have a file with all of them saved. Slowly but surely, some of them are unusable in a virtual administration environment.

    The context is very important. This is a self-driven, self-motivated test, so we have to be very clear on the directions. We have to be almost entertaining [00:10:00] to a participant. So we got rid of everything that didn’t fit. And what we’re left with are eight domains that are very relevant, almost orthogonal, and provide different aspects of cognition. On the other hand, the test is not long. It’s 10 minutes, so it’s manageable.

    We aimed for 10 minutes, particularly for the purposes of being able to assess memory. At the beginning of the test, we provide five names of animals. We make sure that a participant remembers those animals, but that is the short-term memory. [00:11:00] That is the memory that is only dependent on the neocortex and independent of the hippocampus, but what we really want to test, we want to test the hippocampal function.

    And so at the end of the assessment, in about 10 minutes, we come back and ask the same five animals, and the magic happens. Most people can easily remember all five animals. When people cannot remember one or two or three animals, that’s a good sign that something happens to the hippocampus.

    And that is reflected in the score. And the score can be measured longitudinally over time. And that creates an opportunity to try novel treatments and look at the effect of [00:12:00] different lifestyle changes.

    So being able to do this test every week or even every day creates an excellent context, excellent feedback tool for you to try to improve your life, improve your diet, improves your social connections, and maybe cognitive involvement and so on, and see how your global cognition changes over time.

    Dr. Sharp: I like that we’re dipping into the structure of the measure of the test. Let’s provide a little bit more context for folks just so they know exactly what we’re talking about. You’ve mentioned that it’s self-administered and it’s relatively short. I should have asked on the very beginning, but give me the big picture overview, what is the Boston [00:13:00] Cognitive and what can clinicians expect when they look at it?

    Dr. Andrey: The test starts, as I mentioned, with short-term memory test with these five animal names. And then it continues to a language measure that measures language comprehension ability in participants.

    I should say that every item in the test is gradually increasing in difficulty. For the language test, there will be 5 steps of difficulty. And then after the language test, there is a mental rotation, so that measures the ability of the lateral prefrontal cortex to control the posterior cortex, and that comes in [00:14:00] 5 steps.

    I also should say that every item is preceded by the training item. So participants are trained on the simplest possible variation of that item. So participants are trained and then there are five levels. So that’s the third domain. The fourth domain is attention. We are asking participants to repeat numbers forward and backward in multiple steps of difficulty.

    Another domain is arithmetic domain. We’re going through multiple levels of difficulty in mental arithmetic. And finally, there is orientation domain. We check if the participant [00:15:00] remembers the year, the month, and the day of the week. The final is the launch of memory where we ask the participant to recall the five animals that were presented in the first item.

    Dr. Sharp: How do you arrive at these specific domains and tasks?

    Dr. Andrey: We started with about 30 different tasks and then we expelled everything that is hard to measure online. Basically, whatever left is whatever can be used online, technologically. So these are the eight best.

    Dr. Sharp: The thing that caught my eye is the self-administration. [00:16:00] Maybe one of you could talk a bit about that, just the delivery method and the idea that it’s delivered on a phone or tablet or computer maybe, I’m guessing a little bit here. You can speak to that.

    Kelvin: Certainly. That’s actually part of what really interested me in their technology when I found them is that there’s zero computer skills required. A lot of people think it’s actually AI, it’s not, it’s just really well written because right from the get go on the sound check, the software makes sure that you can hear the instructions clearly.

    It gives you have a random number. If you could get the number, obviously you could hear what’s going on. And then essentially you simply listen to the verbal instructions which are very clear, and then you choose the most appropriate answer, one right after another.

    It’s something that my 81-year-old mother can do even though [00:17:00] she struggles with texting these days. When she took it, she didn’t have any problems following the instructions and cleaning the assessment.

    She was absolutely thrilled to find out even though she’s a little compromised, she is above normal for her age. So that’s something I hope we’ll get a chance to elaborate on. It’s not just a raw score because that cannot tell the whole story. Would you agree, Andrey?

    Dr. Andrey: Yes, absolutely. What we do, we have a model that compares the raw score to your peers of the same age, same gender, and comes up with a percentile. Percentile is much more informative; the raw score is much less informative. So who cares if you’re 25 or 24 out of 30, if you are better than 99% of your peers, [00:18:00] who are considered cognitively normal, then you are in a good shape.

    Dr. Sharp: Sure. Maybe we could detour for just a bit into that aspect of the development; the standardization sample or how you came up with the norms. What did that component of development look like for test measure?

    Dr. Andrey: We always start with a lot of participants. You get students to test all the participants they can find. And this is the paper that we published in BMC Neurology. In that paper, we compared BoCA to MoCA. [00:19:00] We looked at the influence of age and education in BoCA and we didn’t find any or very little. So BoCA is not influenced by age or education much.

    And then we created norms out of that data. We used that norms to generate a model to calculate percentile. When you finish the test, you get a report with all your domains and the total score placed on the bell curve. So you are visually seeing where you are on the bell curve compared to your peers of the same age and same gender.

    Dr. Sharp: I love that. So is it coming up with a standard score in addition to the percentile or is it a [00:20:00] different metric?

    Dr. Andrey: Raw score, standard score, and the percentile.

    Dr. Sharp: Got you. That was one thing that jumped out to me because I got the sample of the test. I still don’t know how I compared my peers because I apparently didn’t complete it appropriately, but I will do that. I was struck by how easy it was to complete.

    And like you said, Kevin, it’s a really elegant design just from a software standpoint as someone, I’m a co-owner in a software business now and understand how hard it can be to make this look really good and function really well. And it does both of those things. I pass along some congratulations to the development team and everybody involved in that, because it looks great and it’s easy to administer and understand, which is fantastic.

    Dr. Andrey: Thanks, Jeremy. It was not easy.

    Dr. Sharp: Software is not easy. [00:21:00] That’s a statement. Yes. So tell me, how do you decide, because that generates a whole, gosh, host of issues or hurdles to get over when you decide to administer something in-house or have someone be able to self-administer a measure on their phone without a clinician involved? So tell me about the decision-making process there and how you solve some of those problems of making sure people could understand the test like software or hardware issues. I’m curious about that whole process.

    Let’s take a break to hear from a featured partner.

    Y’all know that I love TherapyNotes, but I am not the only one. They have a 4.9 out of 5-star rating on trustpilot.com and Google, which makes them the number one rated electronic health record system available for mental health folks today. They make billing, scheduling, note-taking, and [00:22:00] telehealth all incredibly easy. They also offer custom forms that you can send through the portal.

    For all the prescribers out there, TherapyNotes is proudly offering ePrescribe as well. And maybe the most important thing for me is that they have live telephone support seven days a week so you can actually talk to a real person in a timely manner.

    If you’re trying to switch from another EHR, the transition is incredibly easy. They’ll import your demographic data free of charge, so you can get going right away. If you’re curious or you want to switch or you need a new EHR, try TherapyNotes for two months, absolutely free. You can go to thetestingpsychologist.com/therapynotes and enter the code “testing”. Again, totally free, no strings attached. Check it out and see why everyone is switching to TherapyNotes.

    Our friends at PAR have released the NEO Inventories Normative Update. The NEO Inventories measure the five major dimensions of personality and [00:23:00] the most important facets that define each. Now with an updated normative sample that’s more representative of the current U.S. population and fewer components for easier purchasing. Visit parinc.com/neo.

    Dr. Andrey: You make all the buttons big. That’s the most important thing; make buttons bigger. There is redundancy between verbal instruction as well as written instruction as well as very intuitive interface and participants being able to confirm their choice. So participants on most tasks have to click twice to confirm their choice before the results are submitted.

    [00:24:00] The training level is very important because, for every item, we have a training level where participant can take this level as many times as participant needs until that training is passed. We do not use the results of training to calculate total score. So these are small things that have to be right, but as always, all these small things together make a difference.

    Dr. Sharp: Yeah, they absolutely do. Tell me about the use case a little bit. How is this coming into play in the real world? How are clinicians using it? We’ll talk about billing, of course.

    Dr. Andrey: I’ll introduce Kevin just a second. What happened historically is that the test was created first and then we [00:25:00] created an environment around this cognitive test, the portal. I’m sure Kevin is eager to tell us about the portal.

    Kelvin: Yeah, so going from research that it was originally designed forward to something that functions really well in a clinical environment, that was part of my role. I’ve been in medical sales for about 25 years. I’ve been behind the front desk of many clinics and I know what type of search functions they’re going to want.

    I know they’re going to want to be able to do a bulk upload of their patients, making things really easy to implement in a practice. Even that part of it takes very little instruction. My training sessions are 10, 15 minutes long and you’re up and running with both. So they’re very simple to implement in your practice.

    When it comes to psychologists, when you ask them, how is it being [00:26:00] used? The value seems to be in getting the patient to take an accurate test prior to coming in that will give you an understanding of what’s really going on with that patient right now. Does this look like one of the worried well who had complaints to their primary care physician? And then now do you really want to block out four hours of your day or what are you going to do with this patient?

    We have some really good quotes on our website from psychologists on how they’re using it, and it’s really determining where that patient is at and what further tests do we want to set up before the patient walks through the door to save time and make the most efficient use of your appointment.

    Dr. Sharp: That’s another interesting component here. I wanted to clarify with y’all, when I hear, okay, they take this before they come into the office, I [00:27:00] wonder, so do you see this as like a screener or a full-fledged measure? How does this fit in the neuropsychologist arsenal of tests, so to speak?

    Kelvin: I would say, yes, it’s a bit of a screener for the worried well but also it’s scientifically valid and it’s going to provide you useful information on eight cognitive domains. As I mentioned earlier, for some primary care physicians who aren’t qualified to do full neuropsychological testing, it gets enough information that when they refer that patient, they have a valid reason other than patient complaint to send that patient over to you.

    They have that numerical score that your primary care physician wants. They’re used to seeing the blood pressure readings to know to prescribe the medication, et cetera. They need that very easy out-of-the-box solution [00:28:00] to have clinically appropriate referrals to neurology and neuropsychology.

    Dr. Andrey: I should also mention that all the items, all the tasks in the test are created dynamically. And so they do not repeat from one administration to another. So unlike MoCA, for example, BoCA can be taken every day and there is no learning effect. This is another thing that we published.

    So it can be used as a screener first before patients arrive at the door, but then it can be used again in the office to confirm the global assessment or it is very useful to be used in any clinical trial that is trying new treatment because you can do this test every week and see [00:29:00] changes of the score over the time course. Also in intervention.

    Dr. Sharp: Does the software have anything built in to do statistical comparison between results from week to week or month to month or anything like that? How does a clinician know if functioning has changed significantly?

    Dr. Andrey: Every report has a graph of the total score and every domain over time, day by day. And that can be used to figure out what is going on with the with this score.

    Dr. Sharp: I see. Yes. So maybe it’s up to us to look at it and say, okay, this has changed by a standard deviation over six months or something like [00:30:00] that.

    Kelvin: Right. A longitudinal graph is what we provide, so no actual statistics, but you can see the comparison obviously down, up, flat.

    Dr. Sharp: Right. Yes. This raises all kinds of questions about billing as well. I’m sure clinicians out there are thinking, okay, how do I get reimbursed for this time? So maybe we could speak to that for a bit. How does this fall in the whole billing world?

    Kelvin: It falls under 96132 for the provider and that has the minimum number of minutes spent reviewing the results, speaking to the patients, a case of primary care doctors making referrals out to neuropsychology or neurology, making those [00:31:00] conversations with family would be appropriate and done for depending on whether it’s administered by a technician or a clinician, the 96138 would be appropriate.

    Dr. Sharp: Okay.

    Kelvin: No CPT codes.

    Dr. Sharp: I got you.

    Kelvin: The main difference is; we’re only going to have one unit. It’s not four to six hours. It’s not going to be more than a unit.

    Dr. Sharp: Of course. You mentioned the feedback with the family. Are you finding that most clinicians are doing feedback or discussion of results after each instance of taking the test? Maybe that’s a bigger question. I’ll step back even one layer further and talk about clinician involvement throughout this process. So how is the clinician introducing the test and then [00:32:00] guiding through the test, answering questions about the test, and then discussing results after the test?

    Kelvin: I guess I’d like to clarify, are you referring to primary care physicians or psychologists?

    Dr. Sharp: That’s a good question. I don’t know a ton about how primary care, maybe we talk about the primary care aspect first and then if it’s different for neuropsychologists, we could talk about that as well.

    Kelvin: So in the realm of primary care, they don’t have a lot of training in this area, yet they’re the ones that are touching all these patients. So what we have is a free four-question subjective screen that they can screen every patient as they come through the clinic.

    Medicare guidelines do require primary care physicians to do an annual cognitive screening. But then if the patient has out of the four questions, three of them in the positive direction, does [00:33:00] that still mean that they’re experiencing cognitive impairment?

    What’s interesting is we took a look at initial data and the patients who are scoring as impaired on the raw score with BoCA had an average of 1.6 of the subjective questions in the positive direction, while patients who still scored in the normal range on BoCA had an average of 2.4 questions in the positive on the subjective screen.

    So that’s what’s interesting. That’s the challenge that the primary care is facing, is this a worried well, or is this somebody who really needs a referral? So we’re trying to provide that triage. You’ve got the free screen. If there’s questions in the affirmative, do the objective validation with BoCA. Let’s give them a clear-cut point, yes for sure, no, you’re fine for now, we can revisit this in a year or two if you still have concerns.

    So that’s how it’s being used in the [00:34:00] world of primary care. If you go to the website, you’ll also see that we have a cognitive care plan software which is an additional step primary care doctors can do where they are doing things like questions about a drive and evaluation, safety at home, number of falls, things that would fall into that primary care world. And so it’s a screen measure that manages the approach for primary care.

    What I’m hearing from the psychologist is they like to prescreen the patients before they come in to help prepare for the initial visit. That’s the primary role of BoCA for psychology.

    Dr. Andrey: I should also mention the logistics of test administration. So in some offices, they use a dedicated iPad. They go in their portal or they go into the patient, click the button start test on this [00:35:00] device and boom, the BoCA starts on this iPad. They give iPad to the patient and patient can complete whole BoCA assessment right there.

    In other practices, they are preferring to use patient’s device and so our portal has a button, send patient an SMS with BoCA link. And so when a clinician or the technician is clicking that button, the patient receives an SMS with the link to the test. They click on the SMS. The test opens on the patient’s iPhone or Android inside their own browser and they can use their own phone to complete the test.

    We have measured the [00:36:00] performance on the smartphone versus larger screen like an iPad, a laptop, and there is no difference.

    Dr. Sharp: That’s great.

    Dr. Andrey: So people can do it on their own smartphones and the results are the same.

    Dr. Sharp: I think that’s one of the benefits. It’s easy to administer. It’s really easy. I get there is the requirement that someone can operate a smartphone or a tablet, but it seems we’re getting to the point where that’s a pretty low bar to clear.

    I’m thinking of my own parents who are in their early 70s and are very smartphone literate at this point. I think we’re getting to that point where the older generation is, growing up with smartphones over the last 15 years or so, they’ve had some time to practice. So that cohort of folks who don’t know how to operate a smartphone is getting [00:37:00] smaller and smaller over time. Great.

    There are so many advantages of this. Where have y’all seen the most success? If there are any types of practices that you found are really benefiting from it. And then on the flip side, we could talk about practices where it may not be a great fit as well, but let’s start with the ones that seem to really be benefiting.

    Kelvin: The feedback I’m getting from providers in the field is that it’s a huge time saving device. Most providers already have a backlog of six months or more. The ability to triage patients, I’ve got to get this patient in and it looks like they’re going to need a little bit more time versus this patient looks more like the worried well.

    As far as where it’s not being used, I think they just haven’t heard about this yet. [00:38:00] I haven’t had anyone say I tried this in my practice and it just isn’t a fit. It’s one of those things that there seems to be a level of excitement around BoCA that it makes us very optimistic for where we’re going in the next two years, just based on the, like I said, we’ve launched just recently in the last six months and we’re getting initial feedback and it’s highly positive, is the word I’m going to use.

    Dr. Sharp: Right. Let me ask a question I should have asked way back, but what is the age range for the BoCA?

    Kelvin: Andrey?

    Dr. Andrey: Yes. We have norms for BoCA starting from 19 years of age, but the test is applicable [00:39:00] to individuals starting from about 7 years of age. I don’t know if there is any reason for a 7-year-old to take it. It would be something like an IQ test, but there is definitely a possibility of taking this test even with children and there is no upper limit, of course.

    Dr. Sharp: Okay. Can you clarify just a little bit when you say there are norms down to 19 but it is possible for a 7-year-old to take it? I would ask, what’s the value of having a 7 to 18-year-old take it? Are there norms for them or it’s just a qualitative data point?

    Dr. Andrey: I don’t [00:40:00] know. I really never thought about it and nobody asked about it; measuring this in children. All our participants who are adults. I have no idea, but if somebody comes in and interested in monitoring children, that is a possibility as well. I never thought about it.

    Dr. Sharp: I don’t know that I have a use case for it in kids either. I was just curious about the normative data. If somebody tried to do it, would it be useful in that way?

    It’s got me thinking when you talked about the worried well, Kevin, we got a lot of referrals for “neuropsychological evaluations” for adults from probably 25, 30 years old who were concerned about memory loss or cognitive decline, things like that. And we spent a fair amount of [00:41:00] time.

    I think there are a lot of practices out there you probably would know that we are trying to screen these individuals out and figure out do we need to bring them in for a full neuropsychological evaluation? The likelihood that this is actual cognitive decline is very low in a 30-year-old. So what is this about? How do we still help them? Are you seeing some of those?

    Kelvin: I wish I was recording that. That’s perfect sales pitch. That’s exactly it.

    Dr. Sharp: We are recording this.

    Kelvin: But that’s exactly it. If there is something going on, you’ll know it. From the 8 domains, you’ll have an idea of what areas are being most affected and if they still have 30 out of 30, I don’t know.

    But what do you do from there clinically? Do you have a conversation with the patient? Do you bring them in for a briefer evaluation and not block out your whole day? Everybody wants to spend their [00:42:00] time wisely and everybody has a massive backlog of patients. So that’s what I’m hoping we can help address first though for psychology and neuropsychology.

    Dr. Sharp: Of course. That makes me think about the validity of the results. I know it’s hard to build everything into a short measure like this, but is there any gauge of validity or effort in the measure?

    Dr. Andrey: Yeah, we’re working on that. It will come in a year or two. We are in certain methods to measure embedded validity, patient’s effort basically, not yet there, but it will be there.

    Dr. Sharp: That’s great to hear. I’m guessing that’s a question a lot of people are wondering about or something like this.

    So let me go back. I know I’m bouncing around, but just filling in some gaps here as far as the use case and workflow for this. Theoretically, I’m thinking about our own [00:43:00] practice where we’re booked six months out for evaluations. You said something earlier, Kevin, about uploading patients. So could we theoretically comb through our list and isolate the patients 30 to 50 years old who are booked for a neuropsychological evaluation and send a bulk invitation to take this test before they come in?

    Kelvin: That’s a good question. Yes, to the bulk upload of patients. We do not have a bulk delivery system. You click on the name, click on the assessment, click the method of sending. We have three choices. They can take it in front of you in clinic. They can take it via text, SMS, or we could send an email if for some reason you don’t have a cell phone number.

    That’s yours to associate. Click on the patient, click on the task, click on the method of delivery, and you’re off and running. And to [00:44:00] that point, would it be an excellent tool for triage? Without question. Absolutely. It’ll help prioritize the patients who really need to get NWC.

    Dr. Sharp: That’s a good way to think of it. We started to dip into future directions. Maybe that’s a good note to start to close on. I’m curious, what do y’all have in the pipeline that you can actually talk about? What are you excited about in the next year or two as far as development for the measure?

    Dr. Andrey: In terms of the test itself, several things are coming in, budget validity that we just mentioned. New even softer implementation, more pleasant, more gamey, more things that are gamified if you want, that is coming as well. We will continue to improve the [00:45:00] portal, and improve the ability of doctors to manage large number of patients like bulk send, for example, and other features, Kevin.

    Kelvin: I’m sorry. I was distracted. I was thinking about a few things I have to mention before we wrap up. One of the things that makes Boston unique is, I think we’re in the pricing, you can start using Boston by going to the website, entering a handful of information about your practice.

    And for $99, you have access to four Boston Cognitive Assessments. You can start using immediately. Again, very little training. We have training videos and written directions right there in your welcome email, so getting up and running, it’s [00:46:00] very easy to try it. $99 total risk. If you never use it again, no harm, no foul.

    It’s even better than that, for members of your group, there is a 50% discount code. Will that be posted in the notes, Dr. Jeremy?

    Dr. Sharp: Sure. Yeah. I’ll always put that in the show notes so people can access it really easily.

    Kelvin: And so now we’re down to $49.50. We call it a bundle, just buy a bundle or two to try it out, get started. If it’s working out for you, we do even steeper discounts on a monthly or annual subscription. And that’s further discounted for your group versus the rest of the world.

    So we can work with a provider who’s only going to do one or two a month, and we can work for a provider that’s part of a large group who’s going to do 100 of 400 a month. The pricing will be appropriate at every level. So even if you’re a smaller provider, a lot [00:47:00] of software packages you got to buy in, you got to buy in big. We’re the exact opposite when you start for $99 or in your case, $49.50, and it gets even cheaper from there.

    Dr. Sharp: Tell me about the pricing a little bit more. Is it a per-usage model or is it a subscription? How does this work?

    Kelvin: We sell it in bundles of four. We wanted to give people more than one instance of use so they could see it across multiple patients and try and figure out where does this best fit in their practice and they can buy as many bundles as they will.

    So once they sign up, they have to use up to four. You can continue to keep administering BoCA as many as you want throughout the month. At the end of the month, we just run the numbers, if you purchased one BoCA but then you used three more, another 12 assessments, we just bill you for the additional assessments at the end of the month.

    You don’t have to do anything extra to keep using it. Make it as simple as possible. [00:48:00] But we also think that most people like to avoid the per-use charge. So we try to come with an even lower price to say, hey, look, if you’d like a flat monthly payment with just use it as you need it, we’ll give you a steeper discount

    And if you’re willing to pay upfront for the year, it gets cheaper. So make it really simple to use BoCA often and wherever you feel is clinically appropriate without any additional cost.

    Dr. Sharp: That’s fantastic. So then just give me a ballpark of what those monthly and annual subscriptions are.

    Kelvin: That is a great question. If somebody is only going to be using it once or twice a month, the hobby, Starbucks money. That’s it. So if it’s 400 and 500 times a month, then obviously it is billable and reimbursable under insurance.

    In many cases, we have [00:49:00] psychologists that are doing runoff evaluations for court cases they’re doing, so it’s part of a larger evaluation for many different reasons. It was essentially just value-driven and we will work with anybody to get a price that makes business sense as well as political sense.

    Dr. Sharp: That sounds good. It tells me it’s somewhat negotiable. Is that …?

    Kelvin: Oh, it’s super flexible. I honestly want to get it out there, get it used. It’s flexible. That’s a great word.

    Dr. Sharp: That sounds good. Thanks. As we start to wrap up, what have I missed? I don’t know if there are any other future directions to highlight or components to highlight in the current software before we wrap up.

    Dr. Andrey: I can, [00:50:00] go ahead, Kevin.

    Kelvin: I don’t know if we got into the fact that it is auto-scored. It’s immediately available. It’s one of those things that patient takes it in the lobby. It’s right there. You’ve got the raw score, the standardized score, the bell curve. At a glance, you know where you’re going next.

    So even if you’re doing it as that patient comes in for that first visit, or if you’re doing it from home ahead of time, I think we provide a lot of clinical value with saving you a lot of time. It’s a huge time-saving device, one of the main values.

    Dr. Andrey: And the patients feel that they’re taken care of. That somebody does monitor them, technician, and that’s important.

    Dr. Sharp: I could see that being an added benefit, sort of an ancillary benefit of just knowing [00:51:00] that they get to take this measure regularly and get a regular check-in from their clinician. There’s a client care aspect there that may feel really good, which brings up another question for me, which is, can you schedule regular sessions or regular administrations of the measure?

    Kelvin: Not at this time. As a reimbursable assessment, it is something that has to be ordered by a provider and for a specific reason. If you have a standing order that you want the front desk for here’s the batch of patients that I want tested monthly, great, go for it.

    Dr. Sharp: I see. That makes sense. I appreciate you guys coming on. I know there’s so much that we could get into as far as development and experience with the measure, but [00:52:00] from what you’ve said so far and with my personal experience as well, admittedly limited, but it stands out as really easy to take, pretty easy to administer and if it’s reimbursable, that’s fantastic as well. That’s always a key factor for most of us.

    So thanks for the time. Thanks for discussing all of this and for sharing the discount code with our audience. I hope that folks will try it out and see if it works in their practice.

    Kelvin: I think they’ll be hooked if they try it. So that’s why we want to go really low barrier of entry $49.50. Yes, they’ll know it. I don’t even have to sell it once they try it.

    Dr. Sharp: That sounds great. Yes. Thank you guys again. I really appreciate it.

    Dr. Andrey: I appreciate the time. Thank you.

    Kelvin: Thank you, Jeremy.

    Dr. Sharp: All right, y’all. Thank you so much for tuning into this episode. Always grateful to have you here. I hope that you take away some [00:53:00] information that you can implement in your practice and in your life. Any resources that we mentioned during the episode will be listed in the show notes, so make sure to check those out.

    If you like what you hear on the podcast, I would be so grateful if you left a review on iTunes, Spotify, or wherever you listen to your podcast.

    And if you’re a practice owner or aspiring practice owner, I’d invite you to check out The Testing Psychologist mastermind groups. I have mastermind groups at every stage of practice development; beginner, intermediate, and advanced. We have homework, we have accountability, we have support, we have resources. These groups are amazing. We do a lot of work and a lot of connecting. If that sounds interesting to you, you can check out the details at thetestingpsychologist.com/consulting. You can sign up for a pre-group phone call and we will chat and figure out if a group could be a good fit for you. Thanks so much.

    [00:54:00] The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric, or medical advice, diagnosis or treatment.

    Please note that no doctor-patient relationship is formed here and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified advice of any mental health practitioner or medical [00:55:00] provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 483. Boston Cognitive Assessment w/ Dr. Andrey Vyshedskiy & Kevin Wolfe

    483. Boston Cognitive Assessment w/ Dr. Andrey Vyshedskiy & Kevin Wolfe

    Would you rather read the transcript? Click here.

    This conversation delves into the Boston Cognitive Assessment, a self-administered cognitive test designed to measure various cognitive domains efficiently. The assessment aims to provide valuable information for both patients and healthcare providers, especially in the context of aging populations and cognitive decline. The discussion features insights from Kevin Wolfe and Dr. Andrey Vyshedskiy about the motivation behind the assessment’s development, its structure, user experience, real-world applications, and billing considerations for clinicians. It highlights the role of clinicians in administering cognitive tests, the challenges faced in identifying cognitive impairment, and the importance of effective triage. The guests share success stories from various practices, address concerns about the validity of results, and explore future innovations in cognitive testing. We end our conversation with insights on the accessibility and affordability of the BOCA tool for providers.

    Key Points

    00:00 Introduction to Boston Cognitive Assessment

    02:48 The Motivation Behind the Development

    06:03 Development Process of the Assessment

    09:55 Structure and Domains of the Test

    12:12 Self-Administration and User Experience

    20:05 Real-World Applications and Use Cases

    24:41 Statistical Analysis and Monitoring Progress

    25:31 Billing and Reimbursement for the Assessment

    26:28 Introduction to Cognitive Testing in Primary Care

    29:57 The Role of Clinicians in Cognitive Assessment

    32:32 Success Stories and Challenges in Implementation

    36:10 Understanding the Worried Well: Cognitive Concerns in Young Adults

    39:44 Future Directions and Innovations in Cognitive Testing

    45:14 Conclusion and Final Thoughts on BOCA

    Cool Things Mentioned

    Featured Resources

    I am honored to partner with two AMAZING companies to help improve your testing practice!

    PAR is a long time supporter of the Testing Psychologist podcast, and I will continue to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing

    The Testing Psychologist podcast is approved for CEU’s!I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Andrey Vyshedskiy

    Dr. Andrey Vyshedskiy received a Ph.D. in Neuroscience from Boston University, and has conducted research in neuroscience, cardiopulmonary acoustics, optical vibrometry, and developmental psychology. He has co-founded several successful companies, received numerous awards from the NSF, the NIH, and the DOD, and directed the development of several FDA approved medical devices. He has authored over 100 scientific publications, book chapters, and conference presentations. His work has appeared in the New England Journal of Medicine, Thorax, Chest, the Journal of Neuroscience and other leading scientific journals.

    About Kevin Wolfe

    Kevin Wolfe is the Director of Customer Solutions at Boston Cognitive. Please email Kevin to learn how to take advantage of the 50% discount and start using Boston Cognitive assessments in your practice.

    Get in Touch

    • Website: https://bostoncognitive.com

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]