Blog

  • 217. Dynamic Assessment with Second Language Learners w/ Dr. Esther Geva

    217. Dynamic Assessment with Second Language Learners w/ Dr. Esther Geva

    Would you rather read the transcript? Click here.

    Dr. Esther Geva is here to talk through her work with assessing English language learners. She has worked for years in this arena and has literally co-written the book on culturally and linguistically diverse children. Esther shared a number of meaningful stories and case examples to really bring these principles to life. Here are just a few things that we cover during our discussion:

    • The distinction between testing and assessment
    • Defining “dynamic assessment.”
    • Examples of a dynamic assessment
    • How to write reports that encompass the principles of dynamic assessment

    Cool Things Mentioned

    Featured Resource

    I am honored to partner with PAR for 2021 to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    Dr. Esther Geva

    Esther Geva (Ph.D., Psych) is a Full Professor at OISE, University of Toronto. Her extensive research, publications, and graduate teaching focus on (a) the development of language and literacy skills in students from diverse linguistic backgrounds, (b) L2 students with learning difficulties, and (c) cultural perspectives on children’s psychological problems. She has presented her work internationally, served on numerous advisory, policy, and review committees in the US and Canada concerned with assessment and policy issues concerning culturally and linguistically diverse children and adolescents.
    In applied practice, she is interested in community-based approaches to prevention and intervention in minority groups, and options in assessment, instruction for ELL and other L2 learners, and culturally sensitive work with families coming from diverse linguistic and cultural backgrounds.

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 216 Transcript

    [00:00:00] Dr. Sharp: Hello, everyone. Welcome to The Testing Psychologist podcast, the podcast where we talk all about the business and practice of psychological and neuropsychological assessment. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    This podcast is brought to you by PAR. PAR offers the SPECTRA Indices of Psychopathology, a hierarchical-dimensional look at adult psychopathology. The SPECTRA is available for paper and pencil assessment or administration and scoring via PARiConnect. Learn more at parinc.com\spectra.

    For a limited time, you can get one free administration and score report for the SPECTRA on PARiConnect by calling PAR at (855) 856-4266. Just mention promo code S-P-E-C.

    [00:01:00] Hey, everyone. Welcome back to the Summer Slam series for 2021. If anybody did not catch Summer Slam number 1 last Thursday, I would invite you to go back and listen to that episode not only because I’m talking all about how to revisit and read your schedule to be more ideal, but also because I talk about how I used to watch  Pro Wrestling as a kid and how it came up with this Summer Slam name. Anybody who watched Pro Wrestling knows that Summer Slam was a big event in the wrestling world. So, totally stealing it.

    The Summer Slam Series is meant to be a series of short, actionable episodes where you can take some tips and put them into practice right away.

    In this second episode of the Summer Slam Series, I am talking about revising your battery. This [00:02:00] is something that some of us do frequently, some of us do not so frequently. I’m really speaking into those of you who collect myself might be in a rut with some of the measures that you are administering. We’re going to talk about ways to determine if you need to revise your battery. We’re going to talk about some examples of how to revise your battery and I will discuss some things that we’re doing in our practice to revise our batteries.

    So, without further ado, let’s jump into a discussion on polishing up your battery.

    [00:03:00] Okay, here we are back talking about revising your battery. This is going to be a pretty short episode like the other Summer Slam episodes. The reason being that this is pretty straightforward. I think that it’s really easy for us to get into routines and to administer tests that are familiar, known, and common even if those measures are not necessarily working well for us or for our clients. So let’s start there first.

    Again, this is meant to be pretty actionable, pretty quick. The intent here is that you might sit down for an hour or two and spend some time going through your battery to figure out if it’s working for you and for your clients. So when [00:04:00] you sit down to do that, you can start with the question of, is it working for you? Now, what I mean is it working for you? There are a few facets to that.

    One, are you able to easily and efficiently administer the measures that you’re administering? So this might mean looking at are these measures published by a company that you enjoy working with? Is it easy to access the materials? Is it easy to purchase more of the materials? Is it easy to distribute those materials if you are engaged in telehealth assessment or using sending rating scales online, things like that? So just asking, does it work for you from a very practical standpoint?

    Another piece of that is the cost. Are these measures [00:05:00] cost-effective? Are they the best use of your money? Are there other options that might work better in that regard?

    Another facet of whether the measures are working for you is, do you enjoy giving the measures? Now, this is a tricky topic. I don’t know if there are any measures that I truly just love to give. There are some. I don’t want to sell any measure short, but I think part of the job is that we are going to have some rote administration of some measures, right? But think to yourself again, are there other measures out there that are clinically relevant, valid and reliable, of course, that might allow you to get at the same skills or attributes in a way that is more [00:06:00] enjoyable for you? This might take a little research, a little digging around, but I think it’s worth considering, is your battery working for you?

    The second question though is, is your battery working for your clients? Now, what I really mean here are a couple of things. There are two points to consider. One, similar to whether it’s working for you, is your battery somewhat enjoyable for your clients to go through? The answer might be no, and that’s okay. Our tests aren’t really meant to be fun necessarily. But the idea is are you administering a battery that is at least as engaging as it could be? Is it overly lengthy? Are there measures that can get at the same thing without [00:07:00] totally torturing your client? And in many cases, I think there are alternative options to measure similar constructs, right? So, checking that out and making sure that you are not unnecessarily turning this cruise on your client and making the process more boring than it needs to be.

    Let’s take a quick break to hear from our featured partner.

    The SPECTRA Indices of Psychopathology provides a hierarchical-dimensional look at adult psychopathology. Decades of research into psychiatric disorders have shown that most diagnoses can be integrated into a few broad dimensions. The SPECTRA measures 12 clinically important constructs of depression, anxiety, social anxiety, post-traumatic stress, alcohol problems, severe aggression, antisocial behavior, drug problems, psychosis, paranoid ideation, manic activation, and grandiose ideation, and organizes them into the three higher-order psychopathological [00:08:00] SPECTRA of Internalizing, Externalizing and Reality-impairing. These scores provide a quick assessment of the overall burden of an individual psychiatric illness also known as the P factor.

    The SPECTRA is available for paper and pencil assessment or administration and scoring via PARiConnect-PAR’s online assessment platform. Learn more at parinc.com\spectra. And for a limited time, get one free administration and score report for the SPECTRA on PARiConnect by calling PAR at (855) 856-4266 and mention the promo code S-P-E-C.

    All right, let’s get back to the podcast.

    The other component though is from a clinical standpoint. [00:09:00] Do the measures that you have settled on actually do a good job at answering the clinical questions that you tend to have to answer or are there measures out there that could be better? Are there measures out there that can answer those questions better? Have any measures been updated? Have there been any new tests released that you want to dive into? Are there any measures that you need to add to your battery where you might say give a broadband measure but then you need something to really dive into a more narrow band set of skills? These are all great questions to be asking yourself. Is it working for your client?

    After you have gone through those questions, of course, the action item is to do some research [00:10:00] and potentially purchase or obtain new measures. I believe that some of the test publishing companies, PAR comes to mind, and I hope that I’m not misquoting them here. I’m sure they’ll let me know if I am, but I believe that some of the test publishers will allow you to test drive certain measures and return them if you don’t like them. So make sure to ask if that’s a possibility so you don’t get roped into such a huge investment for something that you may not enjoy.

    You can also ask questions in The Testing Psychologist Facebook Community. There is a monthly recurring post or thread called All About the Measures where you can ask questions about specific measures if you have questions or thinking about purchasing. So you can post questions there.

    You can also pursue structured consultation [00:11:00] with another psychologist or neuropsychologist. There are a lot of folks out there who provide consultation. Stephanie Nelson at the Peer Consult provides one-on-one consultation. If you want to get another opinion on updating your battery, she’s a great resource. There are other folks who may post in The Testing Psychologist Community, particularly on the Supervision Sunday thread. You can search for that and find supervisors who are willing to consult in your area of interest as well.

    I want to close with some examples from our practice that we have been using a lot more. Over the past year, we’ve gone through this process and revised a little bit. We obtained the RIAS-2 which is a BRIEF intelligence measure. I have really been enjoying giving that [00:12:00] over the past several weeks. Like I said, a little briefer, a little shorter than the WISC or the WAIS and easy to administer, easy to score. That’s been helpful.

    We’ve been doing a lot more MIGDAS in our autism assessments. We haven’t thrown out the ADOS by any means. We still do the ADOS, but we’ve been doing a lot more MIGDAS as well. And as you’ve heard in some prior episodes, we’ve been making a big push over the last several months to include more PVTs in our battery as well. We tend to use the MSVT to gauge effort during our assessments. So those are just a few examples from our practice that have been pretty relevant over the last year or so.

    But we were just in a discussion the other day in a staff meeting about the WRAML3 [00:13:00] and the ChAMP to look at memory. So, it’s an ongoing discussion. And I think this area of measure development is only picking up steam as we have more and more access to electronic means of administering tests. So I think this is going to be a more frequent conversation as time goes on. We’re not really going to be able to get away with just doing the same tests for years and years at a time.

    All right. So. Just to recap, the action item from today is to revisit your battery, ask yourself some questions, see if the tests are working for you, if they’re working for your clients and if there are any viable options that you want to consider. So just make a shortlist of any tests that you might want to investigate. And you can certainly [00:14:00] check with colleagues. You can post on listservs. You can post in The Testing Psychologist Facebook community. You can pursue consultation if you want to get opinions and get some guidance on some of the measures that you might be considering.

    Okay, that is it. Summer Slam #2. I hope that you found this helpful. If you have not subscribed to the podcast, I would love for you to do that. It’s super easy. In iTunes, you just hit subscribe. In Spotify, you hit follow and you will be locked in and get automatic downloads of all the episodes.

    All right, y’all, I will be back on, what is today? You will be hearing us on a Thursday. I’ll be back on Monday. I’ve got that summer brain going on. I’ll be back on Monday with a clinical episode. I hope y’all have a great weekend. I’ll talk to you then.

    [00:15:00] The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric, or medical advice, diagnosis, or treatment. Please note that no doctor-patient relationship is formed here, and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified advice of any mental health practitioner or medical provider, please seek one in your area. [00:16:00] Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 216. Summer Slam #2: Revisit Your Battery

    216. Summer Slam #2: Revisit Your Battery

    Would you rather read the transcript? Click here.

    Welcome to Summer Slam #2! If you didn’t catch Summer Slam #1 on building your ideal schedule, make sure to go back and listen. The Summer Slam series is meant to be a few short, easy-to-implement tips to fine tune your practice over the next few months. 

    For Summer Slam #2, we’re talking about revising your battery. How many of us have been giving the same measures year after year, with little thought to how they work for US or work for the CLIENT? Today, I’m challenging you to dig in and see if your battery is truly what you want it to be. 

    Cool Things Mentioned

    Featured Resource

    I am honored to partner with PAR for 2021 to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 215. Cognitive Testing for Preschoolers w/ Dr. Stephanie Meyer

    215. Cognitive Testing for Preschoolers w/ Dr. Stephanie Meyer

    Would you rather read the transcript? Click here.

    “There are two purposes of an evaluation in my mind: preservation of self-esteem for the child and peace of mind for parents.”

    Preschool assessment is a relatively untouched topic here on the podcast, but that changes with today’s episode! Dr. Stephanie Meyer is here to chat with me about her extensive work in assessing children under five years old. We cover a wide range of topics, from her general approach to testing all the way to specific measures that she uses. Here are a few other topics that come up during the discussion:

    • Why Stephanie doesn’t charge for missed testing sessions or late cancels
    • Contextual factors that could impact testing results
    • Why Stephanie loves the Feifer Assessment of Reading
    • The earliest that Stephanie diagnoses ADHD

    Cool Things Mentioned

    Featured Resource

    I am honored to partner with PAR for 2021 to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Stephanie Meyer

    Dr. Meyer earned her Ph.D. from the Institute of Child Development at the University of Minnesota. Over the years, she’s conducted research at NIMH, Harvard Medical School, and UCLA. Since 2009, she’s been in private practice specializing in comprehensive evaluations of young children.

    Contact info:

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 215 Transcript

    [00:00:00] Dr. Sharp: Hello, everyone. Welcome to the Testing Psychologist podcast, the podcast where we talk all about the business and practice of psychological and neuropsychological assessment. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    This episode is brought to you by PAR. On June 3rd, PAR is holding the first-ever PAR talks. A one-day online event offering free NASP CPD credits. Learn more at partalks.parinc.com.

    Welcome back, everybody. Glad to be with you again.

    Today, I have a fantastic guest, Dr. Stephanie Meyer. Stephanie got her Ph.D. from the Institute of Child Development at the University of Minnesota.

    Over the years, she’s conducted research at NIMH, Harvard Medical School, and UCLA. Since 2009, she’s been in private practice, specializing in comprehensive evaluations of young children. That [00:01:00] is exactly what we’re talking about today. So if you are a kid-person and are interested in the ins and outs of cognitive assessment with preschoolers, today is your day.

    Stephanie and I tackle a number of topics in that realm. Some things that we talk about include: why she doesn’t charge for missed testing sessions in preschoolers, contextual factors that can impact testing results, why she loves the Feifer Assessment of Reading, and the earliest age that she might diagnose ADHD in a young child among many other things.

    So, there’s a lot to take away from this episode. I hope that you will stay tuned and listen all the way to the end so that you don’t miss anything.

    Now, at the time of this release, I believe we might have one spot left in the Advanced Practice Mastermind Group, [00:02:00] possibly, possibly not. If you are trying to sneak in at the last minute, the next cohort of the Advanced Practice Mastermind Group starts on June the 10th. This is a group coaching and accountability experience for psychologists who are trying to move beyond that beginner phase of practice. So, these are folks who really want to work on taking your practice to the next level either financially or by hiring folks or just by working less and getting your systems to a more efficient place, things like that. If that sounds interesting to you, you can get more information at thetestingpsychologist.com/advanced.

    All right, let’s jump to my conversation with Dr. Stephanie Meyer.

    [00:03:00] Hey, Stephanie, welcome to the podcast.

    Dr. Stephanie: Thank you so much. I am incredibly honored to be here. I just want to say that I’m a super fan of the podcast. I think that it’s been such a gift to so many of us who are in private practice during the pandemic, just kind of a lifeline and guiding light. So, I’m very grateful and honored to be here.

    Dr. Sharp: Likewise. I am so glad to have you here. And it is because of fantastic guests like yourself that I think this is helpful for people. So, thanks for being a part of that.

    Dr. Stephanie: Absolutely.

    Dr. Sharp: Yeah, I’m really thrilled to have this conversation with you. We haven’t really talked a lot about assessment with preschoolers here on the podcast. It’s funny stumbling into[00:04:00] these topics. I’m like, “I’ve done 200 episodes. How have I not talked about this very much?” So yeah, I think there’s a lot to say. I’m glad we’re going to cover some of these things.

    Dr. Stephanie: Yeah.

    Dr. Sharp: Traditional questions starting off. Just tell me why is this important? Why this area in our field out of everything?

    Dr. Stephanie: I think there are three layers to how I landed in early childhood assessment psychology. The first layer is genetics. Psychology in general is probably in my genes. My dad is a psychiatrist. My mom is an occupational therapist, so I came by it naturally. And then the question of assessment versus therapy or research. I was a research psychologist for the beginning [00:05:00] of my career and definitely went to a research program at the University of Minnesota.

    And I have that brain. I love data. I love detective work and the process of understanding how certain information maps onto the world of scientific knowledge and literature. I’m not good with gray areas. I always say, I’m not a good therapist but I love working with people and I love working with kids. This is just such a good fit for my brain.

    And then in terms of early childhood, as a child development researcher, I always understood the importance of early intervention. But when I opened my practice in 2009, I didn’t have a specific age in mind. I just opened my doors.[00:06:00] And the first three kids who came to see me just happened to be preschool age. It was two boys. First was two boys and then a girl. And in each instance, somebody had wondered, does this child have autism? But none of them actually met the criteria for autism.

    So just for clarity, I think autism is a very helpful diagnosis when it fits. I think it’s a legitimate diagnosis. And I certainly have kids that I see who have autism. But I became interested in the question of, who are these kids who can seem like they have autism during recess or during a pandemic or in the company of certain people because autism isn’t a sometimes diagnosis. It’s not a time-limited[00:07:00] diagnosis. It’s a pervasive developmental disorder.

    I got really interested in that question of what’s contributing to this variability in presentation. And that question just really continues to compel me and has led me to really focus in my practice on young children.

    And it’s been interesting because, in our field, not a lot of people focus on this age range. So parents, when they’re looking for guidance, there are definitely people and institutions who have a broad-strokes approach to like, does your child have autism or not but not many people are doing a deep dive into the nuances of that question.[00:08:00] And so parents are often told like, “Well, wait and see. Or he’ll probably grow out of it.” Or at the other extreme, it’s close enough to autism. Let’s just call it that and see where things are in a few years.

    I take a really different approach than that approach. And I just love the opportunity to be the first point of contact and to be on this journey with kids and families who are seeking these more nuanced answers, and approach to understanding.

    Dr. Sharp: Yeah. Gosh, you said so much good stuff just in that little introduction. So, I’m just going to go with the flow here and leap on that question of your approach to assessing autism and little kids right off the bat since that is a complex area. I’m curious. When you say you take a different approach than [00:09:00] some of the ones you’ve mentioned, what do you mean by that?

    Dr. Stephanie: I use the same gold standard measures. I do the ADOS™-2 and I do the ADI-R. I do it in a very standardized manner. But I’m not just looking at that question of, yes, no. I’m looking at the way that this child responding, because with the ADOS™-2, just for people who aren’t familiar with it, it’s a series of activities and scenarios where there are expected ways in which a child is going to respond and then there are less effective ways. And so I’m rating how this child is responding to bubbles and things like that.

    [00:10:00] I can give an example. Years ago, I worked with a little guy who was two years old. He was 2 years and 11 months old. And he had just come from a major Institution in our area and actually the parents hadn’t told me that he was coming to me with a diagnosis of autism. But they told me later on that they were fine with the diagnosis, but it didn’t feel right. And they just wanted a second opinion with fresh eyes.

    So as I was doing the ADOS-2 with him, what struck me was that it was almost like when you’re watching a movie and the audio and the visual are on different tracks, they’re not quite aligned. And so like I would do the bubbles or I would do the various scenarios and he would have the appropriate response[00:11:00] 30 seconds later than unexpected.

    So, I’m looking at not just yes/no, but how is this child responding? And I said to the parents afterward. I said, “Technically, he’s going to get a certain score on this but I really want you to go get his hearing checked because something is going on where he is having the expected response. It’s just delayed.”

    And so they went, there’s a specialty clinic here for little kids who need a hearing check and he failed the test, and then he had to do a test under general anesthesia. It turned out he was missing all the sounds in the upper ranges. He got a hearing aid and things dramatically changed for him. So, that’s kind of an example of like really looking at the child’s behavior[00:12:00] not just, what’s the number?

    Dr. Sharp: Sure. I see what you mean. So when you talk about taking a little bit of a different approach, it’s not just like, Hey, I’m going to administer the ASDS and the ADOS-2 and maybe a checklist or two, and look at the scores and then black or white, yes or no. It’s a little bit more of a nuanced deep dive and thinking about other factors that may be. Sure.

    Dr. Stephanie: Yeah. It is a similar approach but a different conclusion. The tests are the same. I actually think the ADOS-2 is a really interesting task. I enjoy giving it. I think I get a lot of information from it. It gives me a lot of information about a child’s social and emotional development more broadly than the question of autism, yes or no.

    Dr. Sharp: Well, I appreciate you talking about that. I know that we didn’t necessarily plan to dive straight into autism assessment, but since you brought it up, I know a lot of people [00:13:00] are really curious about that process. I do want to talk about though just generally the idea of assessing preschoolers. So, maybe we could start with just why. Why in general is it helpful to even test down young. And I’m guessing we’re talking like maybe 2 to 5years old. Is that what you’d consider?

    Dr. Stephanie: Well, I might have tested some… my youngest I think was 14 months. An amazing broad dark girl.

    Dr. Sharp: When we’re testing that young, there are so many factors like, is it even going to be stable or is this going to give us any useful information? So, I’m curious from your perspective, what is the value or utility in assessing kids that young, let’s say outside the question of autism,[00:14:00] because that I think is pretty clear. Early identification. We’re always trying to do that. But if there’s not a question of autism, what’s the purpose here of testing young kids?

    Dr. Stephanie: So I always think that the purpose of doing an evaluation of any kind at any age is twofold. One, the preservation of self-esteem in the child. And two, peace of mind for parents. With those goals in mind, the earlier you can get started on that journey, the better. So that’s where I see a great deal of value. We know the power of early intervention and I see it in my daily life just how much change you can see when a child is[00:15:00] 0 to5 and 6 to 7, and beyond. But you really see the pace of change is tremendous at the younger ages.

    And we also know that in keeping with this idea of preserving self-esteem, a child’s reputation among their peers and their teachers begins the first moments of kindergarten. So, if we can identify any asynchronous patterns of cognitive development early on before they start to cause problems, then that is a huge reason to start early.

    And there’s also just the logistics of [00:16:00] in that period that leads up to kindergarten. It’s just a really… sometimes I get calls from parents second half of  Pre-K or even at the beginning of Pre-K and I just love that period of time, those months leading up to kindergarten because we have this wonderful opportunity to look under the hood, understand what’s going on, and set this child up for success so they can hit the ground running and not just cross our fingers and hope, but actually take proactive steps.

    And the other thing is that people will often call and say, I know you’re not supposed to do an IQ test until 6 or 7 years and that they’re not really stable, but my read on literature is that there is a great deal of stability [00:17:00] in IQ from early on, but that young children are more susceptible to contextual factors that can impact their performance.

    So because the literature suggests that there is more variability in a child’s performance, therefore, you might see more instability in IQ over time, my goal as an early child testing person is to minimize any contextual factors that could impact a child’s performance. So, I have a policy that I don’t charge for missing sessions. I encourage parents to contact me up until the very last minute if their child has even a slight cold, a stomach ache, they didn’t get a good night’s sleep because what I see when a child has a slight cold[00:18:00] that has zero impact on the rest of their life, is that when we’re in the midst of an IQ test, what you see is that the things that come easily to that child are still going to come easily to them. But the things that are hard are going to be so much harder.

    So you see, stamina is just really low. And so, there will be a bigger discrepancy between the strengths and weaknesses. And you get to do it once a year and I want to know what this child is capable of, not what they can do when they’re sick or feeling tired or cranky.

    And then the other thing is that I only do preschool assessments in the morning. I don’t do afternoon assessments because kids are at their freshest,[00:19:00] most alert, first thing in the morning. And I don’t really want to bump up against lunch either. So usually my testing is like 8:00 to 10:00 or 10:00 AM to 12:00 PM. And so what’s been exciting to see actually is that when you do minimize contextual factors, the stability of IQ is striking.  I’m going to share my graphs because I’d like to share my graph with you.

    Dr. Sharp: Yes, and just for the listener who can’t see the graphs, we will put copies of the graphs in the show notes so that you can download them and check them out on your own. But yeah, we talked before we started recording about your love of graphs. And so this will not be complete without looking at graphs.

    Dr. Stephanie: Yes. [00:20:00] Can you see this?

    Dr. Sharp: Oh, yes.

    Dr. Stephanie: Okay. So this is a repeat IQ test for a girl who first came to see me when she was 3 years old and then came back when she was 6 years old. When she was 3 years old, I was still using the  WPPSI-III, not the WPPSI™-IV. And so this is actually a comparison of her performance on the WPPSI-III and the WISC-V. So that’s a lot of space between those two tests, right? So what made them more comparable is that she was three and the WPPSI-III performance IQ is only Visual-Spatial tasks.

    So the comparison is much easier than if she were 4 years or 5 years between the tests. That’s a testing issue. But look at this. Look at the stability. And this is pretty typical. So what you can see[00:21:00] is that her verbal skills are like, there’s no space between the top graph and the ceiling. And then her visual-spatial skills are average to high average. And there are only a few points, maybe one or two points here, but in full-scale IQ or General Ability Index, depending on… so that I think it gets incredible.

    And I try not to remind myself of what the previous scores were. So I’m not trying to get any kind of score. I don’t want to influence anything unconsciously. But what’s really interesting then is when you have minimized the impact of contextual factors, then when there are changes, they’re meaningful. So, I’m thinking of kids who have [00:22:00] a semi or partially-treated learning disability.

    I don’t know if you’re familiar with it, I’m sure you are. What’s the term like Matthew effect? So if for kids who have an untreated or partially treated reading disability, what you would expect to see between kindergarten and 2nd grade is a decrease in their vocabulary score. And if there’s a math difference, what you’d expect to see potentially is a decrease in matrix reasoning and other fluid reasoning tasks.

    So then it’s still meaningful because we have a valid preschool assessment. But it’s not a good business model. It’s a terrible business model only doing this testing in the mornings and not charging[00:23:00] for cancellations. I don’t mind it. For me, it’s so important that kids have the opportunity to do their best. So in that way, it is a good business model.

    Dr. Sharp: Right. Let me ask a little bit more about this. So I love this idea. I love the way that you frame this, that if you’re limiting the impact of these contextual factors then IQ gets a lot more stable over time. What are some of those other contextual factors that we might want to be aware of that could impact a kid’s functioning?

    Dr. Stephanie: So a big one is, are they comfortable with the tester? So sometimes people will say, “I took my child for IQ. It doesn’t feel right. The results don’t feel like the child I know.” And I say, “Well, were they excited for this? Did they vibe with the tester?” And they’ll say, “No,[00:24:00] she seemed like she was rushed. She seemed impatient or it was at 4:00 PM” Especially with kids who are young and very sensitive, I always say, you want to choose your assessment person the same way that you would think about a therapist. Is this person going to be a good fit for your child because you’re going to get really different results?

    Sometimes parents will call and say, I want to understand my child’s potential, but know I’m going to bring him in and he’s going to refuse to answer any of your questions or he’s going to give you silly answers that are the wrong answers. I see that all the time. My job is to get past[00:25:00]  that. I can see those dynamics, I can document those dynamics, but I want to know what is beyond those dynamics. What’s really in there, not what he’s willing to give me when he feels scrutinized or tested. I want to know what his potential actually is.

    And so, prior to the pandemic, I had an office. During the pandemic, I’ve actually been doing in-home testing. But prior to the pandemic, I had an office that I had intentionally set up. My first criteria was, I don’t want anything in this office that is precious or breakable or that I even in any way feel nervous about anyone touching. I want there to be no zones that are off-limits. And I want it to be just incredibly[00:26:00] compelling, but not distracting.

    I find that when kids… Well, let me backup for a second. The way that I encourage parents to say, because parents will say, “How do I explain what we’re doing?” I encourage parents to be honest about why they’re bringing their child for testing, but at the same time, present it in the most compelling way possible, because I want kids to not feel that they have to come to these sessions but that they get to come to these sessions. But these are like a special occasion that they are excited and their siblings are a little bit jealous that they get to come for the session.

    Dr. Sharp: I love that. How do you do that?

    Dr. Stephanie: So [00:27:00] this is the best feedback that I can get ever. I’m still glowing for this feedback. A mom who had brought 3 of her sons to see me said that whenever they talk about Stephanie Meyer, it’s like they’re talking about Disneyland. We did IQ testing and they’re brilliant boys. But I think a big part of it is… what is it? I think that a lot of the kids that I see in my practice are, it may sound silly but even if they’re 4 years old, they don’t suffer fools very well. Like they’re onto you.[00:28:00] And if they feel that there’s even a little bit of hypocrisy going on or somebody has a therapist voice or something that feels false, they will shut down.

    I really enjoy working with young kids. And the way that I just naturally am with young kids is that I don’t think of them as young kids. I mean, this is who I’m hanging out with this morning and it’s standardized. Like, I don’t want to create the impression that in some way that it’s not standardized. It’s absolutely. I’m a stickler for things being standardized. But at the same time, I think that the kids feel really respected and there’s even something, I always[00:29:00] start with the IQ test because it feels to me like a great icebreaker because it’s closed-ended rather than like a verbal fluency task, which is like every child that I see, it’s their Achilles heel to say, like how the animals you can think of in one minute. The close endedness of the IQ test is very comforting, I think.

    Well, I guess the other thing is that I was told in grad school, and this was not a compliment, this was a critique, was that I have a really expressive face and that maybe I need to tone it down. And I think that there might be something about that just makes me a good tester for young kids.

    Dr. Sharp: I’ve been told the same thing, Stephanie. So this is very validating. And I think that is really helpful with kids when you can just be how you are and a little more, I don’t know if animated[00:30:00] is the right word, but that goes a long way.

    Dr. Stephanie: Yes. I like to have little… one, I do have a candy shelf that you’re going to earn something really great at the end. So that’s one thing. It could all be that. And I could be deluding myself that there’s anything special about me. It could be the candy shelf.

    Dr. Sharp: It could be.

    Dr. Stephanie: Yeah. But I’m always thinking… I have these huge bean bags in my office that are like you can just dive into them, be piled into them, planted in them. And I had a, I call it like my wiggle machine where if you need to get wiggles out, I have this wiggle machine and I have erasable Magic Art Markers and just fun things that we can do when we’re taking our breaks.

    [00:31:00] Dr. Sharp: Well, that gets to one of the other questions that I don’t know if you have more to say about this, but you used the phrase compelling but not distracting in describing your office setup. Is there anything else in that realm that you might share with folks who are looking to create a similar space in their own offices?

    Dr. Stephanie: Yeah. A lot of the kids that I see really love to move. The movement is really big. So all of the furniture in my office moves in a really interesting way. So, I have two leather chairs that are fine for adults or kids and they spin. There’s not anything flashy about that. [00:32:00] And after IQ tests, parents are often mortified because their child is spinning or running or jumping because the reverberations of an IQ test are pretty profound.

    And I have a convertible couch so that it also turns into a flatbed. And I had a table kind of like a Lazy Susan, but it was also called an infinity table. So when it was fully open, they would come in and I’d be like, “Okay, I’m going to give you a tour of my office. This is the area where we take breaks.” And I have games. I don’t have a huge shelf of games where it’s something they’re all in a cabinet, but I also love the furniture. I have a really modern sensibility in terms of how I like to decorate. So my office is modern and so I love being there.

    [00:33:00] And then I think that translates. It was also huge and had a big window. I’d say, this is the area where we take breaks and there are games over here. And then this is the area where we can sit and chat. Look at this table, it actually opens up into an infinity sign. And this is the most important. This is a candy area. This is what you get to…for kids who come and play learning games with me, you get to pick something out from there.

    So, I give them a tour but I don’t have a lot of things on my wall. The only things on my wall are drawings that kids have done. And then I had a really just like a perfect photograph that my mom had taken[00:34:00] of purple flowers. And parents would often look at it and go, I don’t know, there’s something so calming about that photograph. I can’t stop looking at it. And honestly, I don’t personally have a good sense of […]. It’s just not in me. I’m not a good three-dimensional planner, but I had my cousin and my cousin’s wife come and set it up.

    And I was terrified that I was going to break… that I would need to replace a piece of furniture because honestly, I didn’t know how to do it if it wasn’t exactly the way they had set it up. So for like seven years, my office did not change. And even when I did have to replace pieces of furniture, I got the exact same one.

    Dr. Sharp: That’s great. I’m guessing I’m not the only one hearing you describe this who wants to see this furniture? Maybe if[00:35:00] we can, I don’t know if there’s a way to send me the links to this furniture. I can put them in the show notes for anybody who might want to check it out because that sounds very unique.

    Dr. Stephanie: Well, and I got really lucky because somebody, a set designer, was having a big home sale and I somehow came across it on Craigslist. So I just benefited from his amazing taste. But yeah, I will definitely.

    Dr. Sharp: Maybe we could talk about some practicalities here. Do you have a standard or semi-standard battery that you’re thinking of with most preschoolers who come into your office? And if so, what’s included in that?

    Let’s take a quick break to hear from our featured partner.

    I’d like to take a moment to let our listeners know about an upcoming event that I am pretty excited about. [00:36:00] On June 3rd, our good friends at PAR are holding the first-ever PAR talks- a one-day online event focused on helping you prepare for in-person schooling with three free sessions offering NASP CPD credits.

    One session features Steve Feifer, author of the Feifer family of assessment tools who will present the neuropsychology of stress and trauma. How to develop a trauma-informed assessment. He will explore the neural underpinnings of stress, trauma, and emotional dysfunction in children and their impact on learning. Register or learn more at partalks.parinc.com.

    All right, let’s get back to the podcast.

    Dr. Stephanie: Yeah, so I would say that I have a pretty standard battery and then I bring in some other things. I start with an IQ test and then I do the NEPSY-II select[00:37:00] subtests from the NEPSY-II.

    Dr. Sharp: Can I jump in real quick, just with the IQ. Are we talking WPPSI-IV?

    Dr. Stephanie: Yeah, so I do the WPPSI-IV and then I do the NEPSY-II. When kids are in Pre-K, 4years and above, I do pre-academic testing. And so I’ll do the Woodcock-Johnson and then the FAR. And I really like the auditory processing test that is designed for young kids called the ASA. I really like that. So, if I’m suspecting something in the auditory where I am, I will because I don’t feel qualified to do [00:38:00] the other. This one is just really simple. It doesn’t feel like I need to calibrate anything. It gives me just a sense of there’s something there.

    Dr. Sharp: What is the full name of the ASA?

    Dr. Stephanie: The auditory I looked it up actually, what is it? The auditory assessment.

    Dr. Sharp: I’m going to guess auditory skills assessment. I just don’t know if that’s the one.

    Dr. Stephanie: Yeah, that’s what it is.

    Dr. Sharp: Is that really it?

    Dr. Stephanie: yeah.

    Dr. Sharp: Great, okay. That really was a guess.

    Dr. Stephanie: Yeah. I get into the abbreviations. We had talked a little bit before about favorite tests. I love the tests I get. I love[00:39:00] the FAR- the Feifer assessment reading. Doing the FAR with 4-year-olds is one of the great joys. I love everything about it. I love the color of it. I love that it’s given me a tool that is so precise and so clear that I’m able to pinpoint things at a level that I wasn’t ever able to before, and I can conceptualize what’s going on. So can I show you a graph?

    Dr. Sharp: Of course.

    Dr. Stephanie: Okay.

    Dr. Sharp: And I’ll do a little description once it pops up here. I’ll try to describe for our listeners what’s going on here. While you’re pulling that up, I know people are probably curious too about how you make these graphs because[00:40:00] they look really nice. I’m curious how this is happening?

    Dr. Stephanie: Yeah. So, I use numbers, which is one of the apple programs and it’s super easy. And I will just take… once I figured out a great template for a graph, I just save it for the next child and then just plug in the numbers in. But so I’m now showing Jeremy a graph of the FAR profile of sub-test scores. And I honestly feel like this is the closest thing we have to an x-ray. So in this instance, what you can see is, let me backup, these are the index scores for this child.

    [00:41:00] So you wouldn’t be in any way alarmed by this because it’s like, oh, they’re right. Where they should be everything. And then you look here and it’s like a missing tooth in certain places. And so this was actually for a girl in 3rd grade, just a little bit older. But what you see here is that phonemic awareness, strong; fluency, there are these gaps in rapid naming, visual perception, and irregular word reading.

    And so what was happening that nobody picks up, and I think of it as like the princess and the pea, like there’s something that’s under 12 mattresses but nobody picks up on this until there’s an issue with comprehension. [00:42:00] So the other areas of comprehension are strong, but the compensation that’s happening over here is depleting the brain resources that would allow you to actually understand what you’re reading. So nobody picks up on it until 3rd or 4th grade when you have to start really comprehending at a high level. So this is where graphs just are so helpful.

    Dr. Sharp: Yeah. I love this. I love the visuals. And there’s so much… I was actually talking with somebody just yesterday about the research around the visual presentation of information. People love that. It really helps understand information. So yeah, the graphs are awesome. Is this just a matter of course with all of your evaluations that you are plugging the scores in and generating these graphs?

    Dr. Stephanie: Yes, every report I[00:43:00] do. So here is IQ. This one I just think is so beautiful. What you can see is that pretty much every domain, the full-scale IQ, all the domain scores are at the ceiling. And then you’ve got processing speed, which is average but it’s clearly… and this is okay, so I think what’s so beautiful about this is like…

    We talked about perfectionism, and people think that parents cause perfectionism, right? This kind of profile is what causes perfectionism. I always think about like, if all of these scores are up here and then I’m looking down on this processing speed score going, like, what the heck are the hands doing? How is that happening? They can see how they want their handwriting[00:44:00] to look but they can’t make their hand do it. And it’s where it’s going. It’s not automatic or it’s slower.

    So this just creates a visual I think that is so powerful. I’m such a visual person. When I see something like this, I’m like, “It’s right there. It’s so exciting.” And then here this little dye, so the question of the common wisdom that you should wait until the child is 7 years old before you do a dyslexia assessment, right? So here’s a little guy in kindergarten where parents were told his reading and writing is right where they should be. We don’t have any worries. But he does get distracted and silly when he has to read out loud but[00:45:00] otherwise nothing.

    So we take a look at his… It was actually hard to get him to do much in the way of reading because he was self-protective. But look, his phonemic awareness is at the ceiling and then we’ve got rapid naming and visual perception way down here.

    Dr. Sharp: And just for people listening, his percentile rank for phonemic awareness looks at 99.9, and then rapid automatic naming and visual perception are down below 10. Both are below 10.

    Dr. Stephanie: Yeah. It’s so exciting to catch this before there’s a problem, right? And by the way, he was really excited to hear that. And his mom is just[00:46:00] incredible because I told her what I was finding and she was able to convey the information to him in such a way that… usually, I do that. She just somehow knew how to do it. I have stealth dyslexia. I said stealth dyslexia because nobody has picked up on it. He’s young. It’s hidden.

    And stealth dyslexia for people who don’t know, if you have a very bright child who has maybe average reading skills, and if you look under the surface of how they’re reading, the patterns are similar to somebody with dyslexia, you call it stealth dyslexia because they’re putting in so much effort and so much deflection and compensation that people don’t pick up on it.

    So he was so excited by the idea that he had stealth dyslexia. He was telling everyone. So[00:47:00] we were able to intervene, right? So these are his fluency scores before and after. His parents just got right on it. You can barely see the original scores. So this was August 2020,  now March 2021.

    Dr. Sharp: So, less than a year of intervention.

    Dr. Stephanie: Less than a year. And so I just actually did a follow-up reading just to see where is his reading? So his reading went from… this was during the pandemics when I first tested him. …his reading skills had literally stopped at kindergarten 6, which is when the pandemic hit. Now his reading is at a 6th-grade level actually. And so he[00:48:00] was applying to go to a new school and he had this interview and he said, they said, is there anything we should know about you? He said, I have stealth dyslexia but I overcame it. It’s so exciting and…

    Dr. Sharp: That’s a great story. Let me ask you. This is a little bit of a departure I think from generally what we’re talking about, but since it’s coming up, I know there’s a lot of debate or discussion around the concept of stealth dyslexia. And I think this example you’re giving is a fantastic one to talk about this just for a bit because in his story he said, and I overcame it and we’re looking at these scores, right? And it’s like, they went up from almost 0 up to at least average or above. So I’m curious how you[00:49:00] reconcile that. I have two questions. Did you originally make a diagnosis of dyslexia? Or was it more just, Hey, these readings are really weak. We need to watch this and get an intervention. So that’s the first question. What are your thoughts?

    Dr. Stephanie: The diagnosis of dyslexia requires that a child has had 6 months of some reading instruction remediation. So, when I see scores like this in his original Feifer scores, when I see them at 4 years old in Pre-K, what I say is they don’t meet the duration criteria but what we’re seeing places them at very high risk if [00:50:00] these patterns continue.

    And then what I’m saying to parents is, this really… and it’s not just these graphs. We think about dyslexia as just being this isolated reading issue, but there are so many things that go along with dyslexia. There’s a multi-sensory imbalance that you see. There are challenges with procedural learning. There are sometimes articulation issues, Proprioceptive issues, motor issues. So there’s a lot that goes along with it.

    And so I’m looking at a whole pattern. I’m not just looking at like, oh, I have these beautiful graphs. I’m looking for patterns. But I’ll say, look, this is looking very strong. This is what’s going on. But I don’t [00:51:00] call it dyslexia until a child has had those six months. So with this particular child who had been in kindergarten and had actually finished kindergarten, I did give him a diagnosis of stealth dyslexia. Where was I going with that?

    Dr. Sharp: Well, maybe my second question will help guide us toward wherever you are going. Maybe it’s the same place. Which is, what happens now? Like when a kid gets this intervention and these scores leap so dramatically when they come back or if they come back, do you still say, yes, this was dyslexia. We just mediated it. Or was this maybe just lack of instruction or developmental variability. How do you conceptualize that?

    Dr. Stephanie: So [00:52:00] what I find over and over again is that if you intervene early with dyslexia, reading is not a long-term problem. And I’m talking about kids, not kids who have phonemic awareness issues and orthographic because that’s going to take more, but when it’s one or the other, and what I often see is as a pattern like what you see in the graph where phonemic awareness in kids who are gifted, I see this unbelievable phonemic awareness but they rely so much on their phonemic awareness for reading. So they’re reading by ear, but they can’t just glance at a word that’s fairly new and just know what it is. They are having to[00:53:00] rely on context and their phonemic awareness. So, oh again, I forgot where I was going.

    Dr. Sharp: That’s all right. There’s so much to sort through here.

    Dr. Stephanie: I know.So I give the diagnosis. I’ll give an example. So a girl came to see me at 4.5 years old. She had a profoundly gifted IQ, just off the charts. She came back to see me at the end of kindergarten and she still had this IQ but she was not able to read at all. And so she was great at faking it, incredible at faking it, but she couldn’t read. So I sent her to… and I’m very impatient about this. I want to get it[00:54:00] done. I have seen it, you can get it done fast or you can get it done slowly. And if we’re still thinking about preservation of self-esteem, it makes all the sense in the world to get it done fast.

    I am a super fan of Lindamood-Bell. We have some magical Lindamood-Bell here in Los Angeles in particular. I don’t know the quality of all Lindamood Bells, but these two in particular are just very special. And so this girl, I sent her to Lindamood-Bell for the summer after kindergarten. Her reading clicked. She became an avid reader and she never had to go back to do any other kind of anything.

    She came back recently in 3rd grade because the other aspects [00:55:00] of dyslexia were tripping her up. So, math fact fluency and spelling were still. So it’s the automaticity of being able to just know your math facts and be able to apply the rules of spelling and punctuation and capitalization without thinking about it. Those aspects of dyslexia were still there, but I didn’t call it dyslexia anymore. And we don’t even need you because it’s just a specific learning disorder, and now it was a specific learning disorder with impairment in math, fact fluency and written language. So, I don’t feel the need to continue to call it dyslexia because that would imply that she and her reading is off the charts.

    Dr. Sharp: Right.

    [00:56:00] Dr. Stephanie: But what I find with young kids is that they are closer to the beginning of reading. They don’t have the compensatory strategies that are so entrenched and there’s just a greater willingness to do the intervention and there’s much less resistance. And the power of it is unbelievable because it’s gone.

    Dr. Sharp: Right. Well, and we all know that reading is such a big part of elementary school and can really get wrapped up in a kid’s identity. So early intervention is great.

    Dr. Stephanie: Early intervention is great. We think about the social and emotional aspects of dyslexia as being stemming from the fact that you’re [00:57:00] in the lowest reading group or you’re not, but the way that I see it is that the more that… What I see is that the cognitive support structures that underlie successful reading are the same cognitive support structures that underlie social-emotional development. And so if you intervene in terms of reading, you’re going to see a huge benefit in terms of social and emotional because it’s the mind’s eye. It’s strengthening the mind’s eye, which is what allows you to take perspective. It allows you to regulate your emotions.

    And then actually, if we look here, particularly in girls, what I see is that girls and boys with dyslexia have difficulty with verbal fluency. So if I say, tell me as many[00:58:00] animals as you can think of in one minute they really struggle with that because they’re not relying on their mind’s eye to picture the ocean and picture a safari there. So, honestly, they’re looking around the room, going like, cup, couch, pillow, and they can’t access those visualizing strategies.

    And so you also see that in terms of, with girls, with dyslexia, this is what I worry about. They can’t access their own story when somebody else has a competing narrative. They can’t speak up for themselves or self-advocate. So I’ll say like, I worry about this girl who’s so empathic and just so giving falling in with the wrong crowd and somebody pointing to her and saying like, “She’s [00:59:00] the one who robbed the bank” and her not being able to say, “No, I didn’t. This is what happened.” Because of not being able to access the movie of her past. That makes sense.

    Dr. Sharp: That’s fascinating. Yeah. I feel like we could have an entire discussion just about that concept.

    Dr. Stephanie: That concept is just so important. And when you look at it, just to bring it back, can you see the graphs? Verbal fluency, this is a boy, but still in his case you see him now being able to speak up for himself in ways that he wasn’t before.

    This is a girl who I saw at the end of 1st grade who did Lindamood-Bell [01:00:00] the summer after 1st grade, she came back to see me a month after finishing Lindamood-Bell, and her story recall and her verbal fluency had gone up so much and it was apparent in her everyday life. She was able to tell her story in the face of loud counter-narratives. So to me, I think of Lindamood-Bell as a social and emotional intervention more than anything, because that’s what they teach in Lindamood-Bell, that’s what they’re teaching. They are building the muscle that allows you to look inward at what you’re seeing.

    Dr. Sharp: Yeah, this is amazing. They should be paying you to generate these graphs for them because they seem very compelling.

    Dr. Stephanie: I know. And these are  100%.[01:01:00] This was from a few years ago, this graph. I sent it to my colleagues at Lindamood-Bell and I was just jumping up and down. For a little while I had it on my phone as my backdrop or whatever because it’s so important. It’s everything.

    Dr. Sharp: That’s great. Well, I know that we’re getting close time-wise and I want to at least touch on the construct of ADHD assessment in little kids. We get a number of referrals. I think a lot of people get a number of referrals where there’s a question or a rule out of ADHD in a 3-year-old or a 4-year-old or a 5-year-old. And I am really curious how you approach that process with little kids.

    Dr. Stephanie: Yeah. So this is one area where I do take a little bit more of a wait and see[01:02:00] because the AAP says you can diagnose as young as 4 years and ACAP also you can diagnose this thing as 4years old. But I’m in the camp of proceed with caution until 5 years old because when kids are little, things like jumping around, climbing on things can be so many different things. Having difficulty following directions can be stemmed from so many other things. As they start to stretch and grow, it becomes so much clearer where that’s coming from.

    I am of the camp where I take a wait and see more cautious approach. I want to see, like if we address anxiety, is some of that heightened need for the movement going to [01:03:00] decrease? If we address the learning challenges, are we going to see a reduction in some of the avoidance or difficulty with attention?

    But once a child turns 5 years, I have no problem making the diagnosis. But to me, I’m kind of a stickler for that. Again, similar to with dyslexia, I’ll say, look, I’m seeing a lot of risks here. And I think when he or she turns 5 years, I think we should do a mini just check in on attention or have parents and teachers every three months do rating scales. So we’re really closely tracking it. We’re not letting it go, but I also don’t want to call it too soon.

    Dr. Sharp: Yeah. I think I take a similar approach.[01:04:00] There are some very rare cases when I might diagnose ADHD in a kid who’s younger than kindergarten. I mean, if there’s a very clear family history, if it’s happening all over the place, if there’s maybe a sibling. It’s going to be pretty unique. 

    Dr. Stephanie: It’s got to be kind of classic. Yes. 

    Dr. Sharp: No other risk factor. Diet and sleep are good. All those. But otherwise, I’m in the same boat. I like to at least wait until kids are in some formal schooling environment just to get some sense of how they compare to other kids among other things.

    Dr. Stephanie: Yeah. Exactly. And you’re supposed to have that… It has to be in multiple settings. And if they’ve been in… a lot of times maybe it’s something seen in multiple settings of a child like in a play-based preschool. But there are certain instances where I will say,[01:05:00] I know that in six months, I’m probably going to be calling this ADHD, but I just would like to wait.

    Dr. Sharp: Right. This hearkens back to… we’ve had a number of discussions on the podcast just about the willingness or ability of a clinician to say, I don’t know yet. And this is one of those cases, I think, where it’s super appropriate where you can say, hey, these signs point in this direction but let’s give it six months. Let’s wait a year. Let’s track that behavior.

    Dr. Stephanie: Exactly. 

    Dr. Sharp: Gosh, you’ve shared a lot of info and…

    Dr. Stephanie: I needed people to talk to during the pandemic. Clearly, I have been socially deprived.

    Dr. Sharp: Hey, likewise. This is like pretty much my only social outlet each week. So yeah, I’m right there with you.

    This is a good discussion. I feel like we covered a lot of ground. [01:06:00] I think a lot of us probably dabble in early childhood assessment, but to be able to speak with you knowing that you’ve really specialized in this for a while, it’s so valuable. I just can’t thank you enough.

    Click here to listen instead!

  • 214 Transcript

    [00:00:00] Hello, everyone. Welcome to The testing Psychologist Podcast, the podcast where we talk all about the business and practice of psychological and neuropsychological assessment. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    The BRIEF®2 ADHD Form uses BRIEF2 scores to predict the likelihood of ADHD. It is available on PARiConnect-PAR’s online assessment platform. Learn more at parinc.com.

    Hey, welcome back, everyone. I am happy to be here with you. We are firmly in the summertime here in Colorado, which is saying a lot because there’s always the threat of snow here in Colorado through the end of May. So the fact that we have made it to June, we can let out a collective breath and trust that it will not snow again, at least until September. [00:01:00] So we’ve got a few months to enjoy the warm weather. That’s what’s happening here. It is hot. We are at the pool most days and it feels like a totally different world than really the past 18 months.

    Now, in honor of the summertime, I am doing a short series called Summer Slam. If any of you watched Pro-Wrestling as a kid, you might remember that they would do a mega wrestling event called Summer Slam. This is where all the stars got together. There were these crazy high-profile matches. It was a ton of fun. Of course, there were a lot of pageantries and a big to-do about everything in the wrestling world, especially during the Summer Slam. So, when I was looking for a name for my series, [00:02:00] I’d already done a Summer Sprint a few years ago, so I didn’t want to repeat that. Summer Slam seemed like a natural choice.

    So, what is the Summer Slam? The Summer Slam is a series that will give you just a few quick-to-point episodes with really simple, actionable tips that you can put in place immediately.

    The episode today is all about your schedule. This is an ongoing concern for a lot of us, keeping our schedules intact. I would like to use this opportunity to give you an opportunity to take back your schedule and make some deliberate changes to get yourself to a better place over the next several months. So, if that sounds interesting to you, stay tuned.

    Now, if you are interested in getting CE credits for your practice, you can visit athealth.com and search for The Testing [00:03:00] Psychologist, you will be able to find most of the clinical episodes there, and you can take a short quiz, pay a nominal fee and get some CE credits for a podcast that you’re already listening to. If you use the code TTP 10, you will get a discount off of any CE credits that you purchase. So, keep that in mind and get some CEs.

    Okay, let’s dive in and talk about getting your schedule under control.

    All right, let’s dig right into this idea of creating your ideal schedule or at least revisiting your schedule. So again, this is [00:04:00] something that I do at least quarterly. And the reason I do it so often is because what I found in my practice is that my schedule does not shift overnight by any means. I often liken changing my schedule to turning the titanic. You’ve probably heard that phrase before in that it just takes forever because I have things that are always booked out. I have clinical meetings that are booked out. Podcast stuff that’s booked out. Any number of obligations. Speaking engagements. Things get booked out.

    So, when I think about changing my schedule or revisiting my schedule, I’m often talking about changes that can happen 3 to 6 months down the road. You may or may not be in that circumstance, but that’s the reason that I do it so regularly. It’s because I’ve just found that if I get the urge to change my schedule, it usually [00:05:00] means that it feels kind of urgent and that I’m tired of something or overwhelmed or overworked, and I’m trying to head that off before it gets to be a real big problem. So, looking ahead can be a good way to do that.

    So, in this exercise, what I would like for you to do to try to revisit and get your schedule under control is basically to take a look at what you’re doing right now. So, look back at the last let’s say a month, maybe two months, and just go through your calendar. First of all, look at all the things that you engaged in or found yourself enrolled in that you did not want to do. This might be not just testing appointments, it could be testing appointments, but I’m thinking more. Are there meetings you took on? Are there people that you got together with? Are there things you [00:06:00] committed to? Anything like that that you have gotten yourself involved in that you do not want to be doing anymore.

    Once you identify some of those things, that’s sort of point number one. That’s the first thing that you’re going to try to change in your future schedule is eliminating the things that you really don’t want to be doing.

    The next thing that you can do in this process is taking a good hard look at your availability for the things that matter for you. So, do you have enough time in your days or in your weeks to do those personal activities that bring you joy, that help you rejuvenate, that give you energy? Do you have [00:07:00] the time to do those things? So, if you are looking back at your schedule and recognizing that you haven’t got to work out in X number of weeks, or haven’t gone on a date or a hike or read a book or whatever it might be in a certain period of time, that is some good information.

    So, that’s the second thing that you’re going to write down is figuring out what are some of the things that you personally love to do that you’re not doing enough of? And that’s going to be guidepost number two as you devise a more ideal schedule.

    Let’s take a quick break to hear from our featured partner.

    The BRIEF®2 ADHD Form is the latest addition to The BRIEF Family of Assessment Instruments using the power of the BRIEF2, the gold standard grading forum for executive function. The BRIEF2 ADHD form uses BRIEF2 scores and classification statistics within an evidence-based [00:08:00] approach to predict the likelihood of ADHD and to help determine the specific subtype. It can also help evaluators rule in ADHD and rule out other explanations for observed behaviors. Please note that the BRIEF2 parent and or teacher forum scores are required to use this form. The BRIEF2 ADHD form is available on PARiConnect- PAR’s online assessment platform. You can learn more by visiting parinc.com\brief2_adhd.

    All right, let’s get back to the podcast.

    The last thing that I want you to look at is just the amount of clinical work that you’re doing. Now, all these things are related, obviously. You can’t have one without the other. It is at least time-wise a little bit of a zero-sum game. So, taking something away creates an opening for something else. But look at your clinical work and just be honest with yourself. [00:09:00] Are you doing the amount of clinical work that you would like to? That’s the first question. Are you doing that clinical work on a schedule that works for you? By which I mean, do you have your days blocked? Are you sticking to the same activity each day so that you’re not task-switching over and over and over?

    I like to do all of my intakes on the same day. Testing happens on the same day. Report writing happens on the same day. And I really don’t mix those things at all. So, really take a good hard look and figure out if your schedule is laid out the way that you would like it to be. And again, you also want to figure out if you are doing the kind of work that you want to do or if you are working too much, for example. A big one, of course, is that [00:10:00] people don’t set aside time for report writing. So, this is an excellent time to revisit and try to restructure your schedule so that you have time set aside to write reports when you need to.

    After you have these 3 or 4 points written down or in your mind, then you just take that information and roll it forward to the next time on your calendar that you can feasibly change things and bend your schedule a bit more to your liking. The best way to do this is just to flip ahead to whenever you have an open calendar where you can manipulate your appointments and literally go in and put blocks of time for the events that you would like to engage in each week.

    There’s a lot of good research around increasing the likelihood that you’re going to do something simply by putting it on your schedule. So that’s what this is about. You go in. You block off that time. Do not leave it to chance. Eliminate any temptation that you might have by staring at an open calendar to put things in those openings that you don’t want to put. It sounds kind of crazy, but even when your schedule is “open,” it should look pretty full because you have blocked out the time to match the way that you want to spend your weeks.

    So that’s the challenge. This should be a pretty short exercise for you. You should be able to do this in probably an hour if you are focused. So that’s the challenge here. I would love to have you find an hour sometime in the next week where you can go in and [00:12:00] restructure your schedule a little bit.

    I know some people, you’re probably saying like, “Oh, I can’t do that. I have to keep working. It’s financially motivated.” I have these families to help. There’s such a need. There is any number of reasons that we would just continue to maintain the status quo and engage in a schedule that is not ideal for us. So, my challenge to you again is to put some of those voices to rest and really strive to create a schedule that will at least incrementally improve your quality of life. So, if you can’t change everything, at least change one thing that’s going to make a difference in your life.

    I hope that you can engage in this exercise. I hope that you found it helpful. Like I said, this is Summer Slam number one. [00:13:00] In the upcoming Summer Slam episodes, we will be talking about revising your test battery and possibly raising your rates. So, stay tuned for those. They’ll be coming out in the coming weeks on Thursdays, like all business episodes.

    In the meantime, if you need CE credits for your license renewal, I know ours is coming up here in Colorado. You can get CE credits for The Testing Psychologist podcast over athealth.com Just search The Testing Psychologists.

    Thanks as always for listening to these episodes. I hope you are also enjoying the summer and doing well. Otherwise, I will catch you on Monday.

    [00:14:00] The information contained in this podcast and on The Testing Psychologist website are intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric, or medical advice, diagnosis, or treatment. Please note that no doctor-patient relationship is formed here. And similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified advice of any mental health practitioner or medical provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with an expertise that fits your needs. 

    Click here to listen instead!

  • 214. Summer Slam #1: Revisit Your Schedule

    214. Summer Slam #1: Revisit Your Schedule

    Would you rather read the transcript? Click here.

    Did anyone else watch pro wrestling as a kid? My brother, cousin, and I would gather around the TV and watch anything from the WWF, WCW, WWE…whatever we could find. Then we would re-enact the moves using our stuffed animals and, sometimes, one another. So when I was searching for a name for this short summer series of podcasts, “Summer Slam” was an obvious choice!

    The Summer Slam series will have a few quick, to-the-point episodes with simple, actionable tips for you to put in place immediately. The strategies will mirror my own areas of focus from my last quarterly retreat.

    For Summer Slam #1, we’re talking about revisiting your schedule. Is it working for you, or are you working too much? If it’s the latter, now’s the time to look ahead and build out more of an ideal schedule.

    Cool Things Mentioned

    Featured Resource

    I am honored to partner with PAR for 2021 to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 213 Transcript

     [00:00:00] Dr. Sharp: Hello, everyone. Welcome to The Testing Psychologist podcast, the podcast where we talk all about the business and practice of psychological and neuropsychological assessment. I’m your host, Dr. Jeremy Sharp, licensed psychologist, group practice owner, and private practice coach.

    This episode is brought to you by PAR. The Feifer Assessment of Writing examines why students may struggle with writing. The FAW and the FAW screening form are available on PARiConnect-PAR’s online assessment platform. Learn more at parinc.com\faw.

    All right, y’all. Here we are with another podcast episode. This one is another episode from the archives and it is a good one. This is from way back maybe four years ago. Dr. Ben Lovett joined me to talk [00:01:00] through a lot of the content from his book called Testing Accommodations for Students with Disabilities. You’ll see, or you will hear rather the full intro of Ben once the episode gets going.

    We talk about when to have individuals take medication or not prior to testing. We talk about the most research-supported accommodations for things like ADHD, learning disorders, and mood concerns. We discussed some myths around testing accommodations. And we talk through a “formula” to increase the likelihood that your accommodations requests will be granted for some of the major testing entities.

    So, as always, if you did not catch it the first time, you’re in for a treat. If you did catch it the first time, the stuff is super relevant and I can guarantee that you’ll continue to take information. I’m sure you’ll [00:02:00] learn some new stuff the second time around.

    If you need CE credits for your license, you can get CE credits for The Testing Psychologist podcast at www.athealth.com just search the testing psychologist. Most of the clinical episodes are available there for a small fee. All you have to do is take a test. It should be pretty easy if you’ve already listened to the episode.

    All right. Let’s transition to my episode from 2017, I think, with Dr. Ben Lovett.

    Today’s guest is Dr. Ben Lovett. This is [00:03:00] my first repeat guest with good reason. Dr. Lovett and I had a conversation back in episode 44 originally meant to dive into his book Testing Accommodations for Students with Disabilities, but we ended up on a discussion about ADHD assessment and the role of behavior checklist versus neuro-psych tests. It was a great discussion, but we didn’t talk about his book at all. So he has come back today to talk all about his book. I have a link to the book in the show notes.

    Just to give a refresher, if you haven’t heard that past episode, Dr. Lovett is an associate professor of psychology at SUNY at Cortland- State University of New York. His research focuses on the diagnosis of individuals with ADHD, learning disabilities, and related issues, as well as the provision of testing accommodations to students with those disorders. He has published over 70 papers on these topics, and again, he has written a book [00:04:00] literally on this topic. Ben has served as a consultant to numerous testing agencies and schools on disability and assessment issues.

    So, he is super knowledgeable, very clearly versed in the research around learning issues, ADHD, psychiatric issues, and test accommodations. So I hope you will enjoy this podcast. Let’s do it.

    First and foremost, welcome back.

    Dr. Lovett: Thank you. I’m very happy to be back. Thanks for having me again. And it was a lot of fun last time. Even though our discussion was about ADHD, I’m always happy to talk about that too.

    Dr. Sharp: Sure. I really appreciate that you were willing to come back. And you’re right, it was fun. We had a good discussion. It generated a lot of talking in the Facebook group. So I would imagine this one will too.

    I’m excited to dig into your book. I talked a fair bit about the book last time, [00:05:00] but can you just maybe give a brief overview of the book and what led you to write it, and then we’ll dig into some of those specifics?

    Dr. Lovett: Yeah, absolutely. So it’s been about 12 years or so since I started to do research on accommodations. My doctoral advisor, Larry Lewandowski who became the co-author of the book, we both felt that there really wasn’t a resource that actually based accommodation recommendations and other sorts of accommodations decision theory on actual research.

    And as of 12 years ago, there wasn’t that much research out there. And in the interim, we were privileged to be able to do some of that research on certain things, especially extended time accommodations. But the more research that kept coming out, we felt like the decisions really should be based on those empirical results.

    That was probably 2011 or 2012 when we first developed the idea. And then two years later, the book came out. So, even though some research has certainly come out since the book, [00:06:00] we feel that it’s still a pretty good review of the research and a lot of the decision theory and other sorts of information. It’s certainly based on empirical research. So, we’re very happy to have that out there. 

    Dr. Sharp: Yeah, absolutely. Sorry, a dumb question, but when you say decision theory, how does that play? 

    Dr. Lovett: I’m really just referring to the theory of how accommodations decisions should be made. So one of the frameworks that we adopt in the book is actually from 1994. There was an educational measurement professor at Michigan State University at the time. She’s now a full-time consultant, Susan Phillips. And she had proposed five questions that she felt were very important in determining whether or not an accommodation was appropriate in any given situation. And so we use that framework throughout the book to talk about those things that might be helpful for our discussion today. I don’t know if it’ll be helpful if I briefly mention them. They might be things that we could come back to.

    One of the things that Phillips talked about was, are scores that are obtained [00:07:00] with the accommodation comparable in terms of their meaning to scores that are obtained under standard testing conditions? If you give a student that extended time to finish a task, do the students who get extended time, do they have scores that are similarly reliable and valid in terms of being able to predict things, for instance? So, students who take extra time on the SAT, for instance, do their scores just as well predict how they’ll do in college as scores that are obtained under standard conditions? So, that’s one thing.

    Another thing that Phillips talks about is, is the test still the same in terms of measuring the same fundamental skills? So for instance, if a student receives a read-aloud accommodation, someone reads them the test, then it’s a still may measure say United States history knowledge in a high school, but it wouldn’t be appropriate to measure reading comprehension that way. You’ve changed the constructs to a listening comprehension test. That’s always a question we should be asking. Are we maintaining the ability of the test to measure the skills that it was designed to [00:08:00] measure?

    Another thing Phillips asks is, are the benefits of the accommodation specific to individuals who have disabilities? If anyone would benefit from the accommodation, and there’s some research to suggest that happens with extended time, if the benefits aren’t specific, then we have to be very careful about assigning that accommodation. Is it really fair to give it to some folks but not others who would still benefit from it?

    Another thing that she brings up, her fourth question is whether or not students with disabilities can adapt to standard testing conditions. So are we providing accommodations because the student truly can’t access the test under typical conditions, or is it just that they would feel more comfortable or prefer to have a separate room or extended time? Is it really based on a need or just a preference?

    And then finally she asks whether or not that decision procedures are really following some standardized reliable tool, or if we’re really just basing our accommodations decisions off of what we think would help without any standardized [00:09:00] procedure for determining that?

    When I encountered those questions, again, that was back in maybe 2005, I felt like they just encompassed everything that we want to know about the accommodations. And so, a lot of my research since that time has been trying to search for research and sometimes conducting it, exploring those five issues.

    Dr. Sharp: Okay. Yeah, that’s fascinating. I’d never heard of her or those criteria, but I could see that that seems like a great set of criteria to guide your decision-making process, right?

    Dr. Lovett: Um-hum.

    Dr. Sharp: Yeah. So, in terms of the research that comprises the book, was that original research that you did yourself, or was it more compiling research that was out there or some both, or?

    Dr. Lovett: It was almost entirely done by other researchers. Larry Lewandowski, myself, and other collaborators who we’ve worked with, there might be 10 or 20 citations to studies that we had [00:10:00] done or other papers that we had published, but certainly, most of it was published by other research teams, some of whom were specifically looking at accommodations and their effects, but other times the researchers were looking at things like the effect of test anxiety on performance or whether or not disability diagnoses are made accurately because all that plays into whether or not the accommodations decisions are appropriate.

    Dr. Sharp: Sure. So maybe that’s a good segue to talk about the book a little bit. What is in the book? Let’s pretend. Well, maybe we don’t have to pretend actually. A lot of people probably have not seen your book. So, can you just give an overview of what y’all cover in the book?

    Dr. Lovett: Certainly. Absolutely. We have a few preliminary chapters just introducing the topic, really defining what an accommodation is, talking about the framework of Phillip’s questions, thinking about legal issues- which laws and regulations, and things like special education and disability law, protect individuals and [00:11:00] ensure that appropriate accommodations are provided.

    And after those few preliminary chapters, we transition to talking about different kinds of disabilities, what sort of accommodations might be appropriate for them, and we do a detailed review of the literature across a few more chapters just looking at different accommodations. What has research shown about timing and scheduling accommodations? What has research shown about presenting information in a different format like a read-aloud accommodation? What has the research shown about setting accommodations, being able to take your test in a different location, and response format accommodations- if you have a scribe to write down your answers, or you don’t need to bubble things into a Scantron sheet, you’ve got to just circle them in the test workbook. So, we review those topics in the center of the block.

    And then we have a few more chapters on things like for instance, interventions. When is it appropriate to provide remediation or psychotherapy or some other sort of intervention to help the students so that they may not even need accommodations after the intervention is provided?

    [00:12:00] Some later chapters are also on things like post-secondary issues. We’ve found with a lot of, there were quite books, but a lot of articles and book chapters on accommodations focus just on the K to 12 accommodations area. And so, both Larry and I have worked with independent testing agencies that are often trying to help make sure that their exams are accessible to individuals at the college level, graduate professional school level, certification and licensure level, things like that and beyond. So I really wanted to have stuff like that in the book too.

    Dr. Sharp: Got you. So you really run across the lifespan as much as you can?

    Dr. Lovett: Exactly.

    Dr. Sharp: That’s fantastic. I think this is such a needed resource. I’m sure I’m going to say that again before we’re done today.

    Dr. Lovett: I appreciate it.

    Dr. Sharp: Yeah, it’s nice to pull all that information together. I mean, you’re right. Admittedly, I went through grad school. I think a lot of people probably went through grad school where we maybe were [00:13:00] given recommendation banks or templates and maybe learn from a supervisor, but I certainly was never presented with any research behind certain accommodations. It just seemed to make sense anecdotally what we’re recommending.

    Dr. Lovett: To be fair, there are certain accommodations where we have little or no research. And there are times when you can use logic and intuition for certain types of disabilities to state it’s likely that this accommodation would benefit the person.

    That’s the case for sensory and physical disabilities. You do need to have a lot of expertise in accommodations theory to say that if someone is visually impaired, if they have a visual impairment, then a typical paper and pencil form for an exam would be inappropriate. And so, depending on that particular student’s skills, if that student is failing in Braille, that might be an appropriate accommodation. Depending on the student’s vision [00:14:00] level, a large print accommodation may be appropriate. Even our a read-aloud accommodation depending on the student.

    For sensory and physical disabilities, I think accommodations are somewhat different. I don’t want to make too broad a generalization here, but for students who have sensory and physical disabilities, often, it’s very clear that they’re unable to access the test under standard testing conditions? And if you administer the tests under those conditions, that would not be a fair representation of what that student knows and what their skills are.

    And the problem is we often take that model, the client with learning disabilities, cognitive disabilities, psychiatric disabilities, and the issues are clear. A student has an anxiety disorder, generalized anxiety disorder, and they report that they will have a panic attack let’s say, or a severe anxiety attack if someone else finishes the test before they do when they’re taking the SAT. Is that a basis for a separate room? [00:15:00] How to really determine this? Is there objective evidence to suggest that that person will be unable to continue taking the test? It’s hard to know. It’s not quite the same thing as a sensory or physical disability.

    Dr. Sharp: Sure. Well, I think you’re teasing a lot of topics already. So, let’s just jump into it. Maybe we could start at the beginning. For me, the beginning is the assessment process because that guides recommendations. Would you agree with that or is there another beginning that we should start?

    Dr. Lovett: Yeah. To me from a psychologist’s point of view, and I think that’s really our audience here, the assessment process should be where things start. The referral process is the first step of that. One thing that I always say when I present to evaluators or psychologists who are performing assessments, who might recommend accommodations, I always say, it’s very important to be clear about the context of their hurdle is.

    [00:16:00] There are times when I read reports by psychologists and there’s this really nice crystal clear background about what brought the person to you today. There are other times when the reason for referral is something like so-and-so and his or her family were interested in obtaining an updated portrait of their cognitive and academic functioning.

    I don’t know how many people do that for fun. I’m always wondering what exactly brought us here because often, what brought someone to your office is some problem that they’re dealing with, a type of impairment, a functional impairment, doing poorly somewhere. That’s really helpful to know. And so, I would recommend being very specific about that in detail.

    Dr. Sharp: Okay, that’s good to know. So, you got the referral question and making sure that we’re pretty explicit about that in the report right off the bat. So, let’s [00:17:00] say, we jump into the assessment process. We talked about ADHD, certainly last time. I would to maybe chat about some of the other disabilities that you discuss in your book. So from an assessment standpoint, what would you say are the standards for assessing learning disorders, psychiatric concerns when we’re thinking about accommodations?

    Dr. Lovett: Absolutely. So for learning disabilities, very common, the condition is very much just like ADHD, especially when those folks are applying for accommodations.

    Again, I’ll go back to the DSM-V which I think has some really helpful information about what they call specific learning disorders, what we tend to think of learning disabilities more generally. So, one thing the DSM-V is very clear about is that we need to see substantially below-average academic skills.

    There are older models [00:18:00] of diagnosing learning disabilities. One that was very popular was the IQ achievement discrepancy, but you could sort of almost attract someone’s achievements from their IQ score. If they had an IQ of 120 and the reading score was only 95, that might be a severe discrepancy. And so, that might suggest a learning disability. DSM-V criteria were in part written to actually ensure that that discrepancy model was gotten rid of because research really is not supportive of it in terms of being reliable or valid for diagnosing learning disabilities.

    Someone may perform below what our expectations are, but that doesn’t mean that they have a learning disability. And so, we really expect to see below-average performance on standardized measures of academic skills and some impact of that in the person’s real role functioning educationally, if it’s an adult, occupationally where’s the impact of those below-average academic skills. So reliable, validated achievement tests. Measures like the [00:19:00] Woodcock-Johnson, the WIAT, the Wechsler Scales, The Kaufman Test of Educational Achievement, similar sorts of tools are really helpful for measuring those academic skills.

    And then for documenting the impact in a real-world setting, it’s very important to be detailed about exactly how the person is performing. If we’re talking about a student who’s still in school, whether it’s K to 12 or college or graduate school, exactly how are they doing? What are their grades? How are they performing on tests, other sorts of academic assignments, rather than just, if a person reports that they are struggling or that they’re experiencing difficulty, that certainly may be their honest, subjective perception, but they may be feeling like they’re struggling because they’re getting a B+? That will not generally indicate education on them.

    Dr. Sharp: Sure. That’s great.

    Dr. Lovett: Those two components, the below-average academic skills as shown by diagnostic achievement tests and [00:20:00] the actual impact in a real-world setting are what we expect to see. And then I would just also note for say high school kids or beyond that college students and adults, the history is very important. Learning disabilities don’t start when someone’s 15 or 20 years old, there’s something that is present early on. And so we expect to see some trouble with the initial acquisition of academic skills as well. 

    Dr. Sharp: I have two questions from everything you just said. One, does IQ testing then have any place in the assessment of a learning disorder?

    Dr. Lovett: Yeah, that’s a good question. And it’s certainly a controversial one. So, one thing that if we just look at the DSM-V or we’re doing a core evaluation of just a learning disability, the real purpose of an IQ test or an IQ screener would be to rule out something like intellectual disability if that’s actually a concern.

    Personally, my opinion is that [00:21:00] IQ test results don’t generally show us a lot about whether or not a learning disability is present. They can give a lot of information about a student’s cognitive skills that might help inform interventions and even at times accommodations, but to me, if you’re just trying to check if a learning disability is there, the main purpose would be to rule out at least borderline intellectual functioning, if not an intellectual disability. And in many cases, that’s not a concern. It’s not an issue.

    So to me, that’s not an especially important part of a core evaluation, determining if a learning disability is present. I don’t know. I should say there are some testing agencies that expect to see an IQ test as part of the documentation.

    Dr. Sharp: Yeah, I’ve definitely seen them.

    Dr. Lovett: That’s obviously a different issue. I don’t honestly know if that’s more for to rule out for general low academic ability or things like that, but I do something, of course, to pay attention to determining whether or not a [00:22:00] learning disability is present. To me, it’s academic skills and educational impairments that are much more important than cognitive issues.

    And admittedly, I know it is a debated issue. There are certain models for diagnosing learning disabilities, not only the IQ achievement discrepancy model, but one that’s also popular in some settings as the PSW, the pattern of strengths and weaknesses model that requires that there be some below-average in academic skill, but also a cognitive deficit that underlines that academic deficit.

    I certainly respect researchers, scholars, and practitioners who are trying to make sense of the student’s unique profile using those patterns of strengths and weaknesses models. But in my opinion, the research hasn’t necessarily been all that supportive of them.

    There are two ways to apply that pattern of strengths and weaknesses model. Some folks will apply it very rigorously using even software that’s been developed. Dawn Flanagan and her colleagues have one PSW model, the cross battery [00:23:00] assessment approach, a very rigorous software that you can use to determine whether or not there is indeed a pattern.

    The other way that some folks apply the pattern of strengths and weaknesses model is just to say, is there a profile? And then, can I find some logical relationship between lower academic scores and some low cognitive scores? And I think that really capitalizes on chance. It’s really easy after the fact to look at any profile of cognitive and achievement tests and find a pattern of strengths and weaknesses. Obviously, this is motivated, but it’s very easy to say, well, this score was an 88 on this particular achievement subtest when I gave 12 different subtests. And I guess that connects to working memory, which was also a little bit low.

    And so, there are times when I see that being used in the learning disability diagnosis. I think when the PSW model is not applied rigorously, it could lead to a diagnosis [00:24:00] with pretty much anyone.

    Dr. Sharp: Yeah, I see what you’re saying. Again, anytime we stray from data, that can get you into trouble.

    Dr. Lovett: Absolutely. So again, I acknowledged that the cognitive measures are viewed by some as important.

    I don’t necessarily see the research as supporting them, especially as part of a core evaluation to just see can we define if a learning disability is present. Really academics and educational impact are much, much bigger issues unless we’re trying to rule out more general global low ability.

    Dr. Sharp: Okay. That sounds good. Let’s move on to maybe psychiatric concerns. What’s does the assessment look like there?

    Dr. Lovett:  Yeah, absolutely. Of course, it depends a lot on the nature of a referral concern. Is there suspicion of problems with anxiety/mood? Is it something that’s instead an externalizing problem like oppositional [00:25:00] defiant disorder?

    The main thing that I would say for any type of concern or any type of disorder is that it’s really helpful to have

    broadband measures being used that are assessing concerns behind what the perhaps initial referral area is. Let’s say for instance that you have a child who’s referred for anxiety-related concerns, it would still, in my opinion, be very important to do a screening for mood problems, or behavior disorder problems, things like that beyond there.

    And there are times when you find that what’s initially a concern about anxiety, the anxiety actually is related to a desire to… Reports of anxiety or being used to get your way and things like that. So sometimes measuring those other issues turn out to be the bigger problem.

    So I definitely recommend the use of norm-reference standardized behavior rating scales from multiple raters just like when the ADHD. So using measures like the BASC or CBCL, I think is very [00:26:00] helpful as a start. And then using those, have a conversation with the raters to try to find out again, what are some specific examples of these sorts of things that you rated? How was that causing impact to the person’s life? To be able to do a good differential diagnosis of what the underlying problem is.

    So many symptoms can be common to different sorts of disorders. A big one which I often think of related to ADHD is inattention. So, there are reports of inattention. Many folks will lead to ADHD as a possible diagnosis. And that’s not wrong of course, but pretty much every disorder causes inattention. Anxiety causes inattention, depression causes inattention, trouble concentrating things like that. Schizophrenia causes inattention.

    So, we shouldn’t really leap from a particular symptom to a particular diagnosis, except in rare cases where there’s not much of a differential to do.

    Dr. Sharp: Yeah, that makes sense. So what about the role of personality assessment [00:27:00] in psychiatric issues for older kids and young adults?

    Dr. Lovett: So clinical personality measures like the MMPI and things like that, I think they definitely can be helpful in understanding the person. That’s something that I don’t have as much expertise or experience in using clinically. I certainly was trained with them and I have given them at times, but it’s not something that I…

    I again, tend to view a diagnosis as the first step towards accommodations. And so, I tend to think what are the measures that would be most helpful in determining whether DSM criteria are met? And so, personality tests in my experience, aren’t generally as key to the core features of the DSM construct.

    Self-reports, I should say can be very helpful, but of course, the behavior and symptom rating scales also usually have self-report versions, but in terms of clinical personality measures, although they might be really helpful in [00:28:00] understanding the child, and I should say I’m referring to object. Personality measures projectives are a whole different kettle of fish entirely. And so, thinking about the objective measures, I just don’t know if that is key to the diagnostic constructs.

    Dr. Sharp: Yeah, that makes sense. I do struggle with that sometimes, especially with these young adults, how much the personality measures contribute above and beyond a BASC and a good interview and maybe some more specific measures.

    Dr. Lovett: One thing I will say for some of them is that they have very good symptom validity measures compared to some of the rating scales. At least we have more research, I think, on some of them. So for instance, if we’re trying to see if someone’s trying to make a positive or a negative impression, a clinical personality measure like the MMPI can have a lot of different validity indices to see whether or not [00:29:00] someone’s taking the measure seriously, to see whether they are trying to present themselves in an unusually favorable or unfavorable way, to see if they’re reporting a number of very rare symptoms that there doesn’t seem to be other evidence for, those sorts of things.

    Even though there are validity checks in the behavior rating scales, I have seen very little independent research on them showing them to be all that effective. I can’t say that they’re not, but the main ones that seem to me to be perhaps effective are really just looking at whether or not the form is filled out consistently.

    So some of those validity traps will look for pairs of items that are pretty similar. A rater rates one symptom is extremely often experiencing it, but then the other symptom that’s almost the same thing, it’s almost never happening. I wonder if they’re filling it out actually carefully, but I don’t know that those rating scales are as good at detecting symptom exaggeration, which may be an issue of someone is trying to demonstrate a need for accommodations, just because of an [00:30:00] honest desire to demonstrate, look, I think I am impaired. I really do need this. 

    Dr. Sharp: Oh, sure. So following from that, is there a place for actual symptom validity testing like the TOMM or the MSVT or something like that? Do y’all take that into account when you’re say considering? 

    Dr. Lovett: I certainly think that. And I would usually consider using those performance validity measures.  I know that the terms are used kind of inconsistently. I’ll just give a brief overview of how I think about them. The distinction is often made between symptom validity, which is honest reporting of symptoms, and performance validity, which is putting forth good effort during an evaluation on measures of maximal performance, cognitive, academic, and neuropsychological tests.

    For SVTs or symptom validity tests, again, the way I tend to use the term, it really refers to added indices in personality and behavior rating scales. [00:31:00] Things like the F scale on the MMPI and things like that. Whereas performance would be tests that you were mentioning, like the TOMM, the Word Memory Test, things like that, some of them can be embedded like the Reliable Digit Span (RDS) on the WISC or WAIS, but a lot of them are, as you mentioned, standalone measures.

    And for her learning disabilities like ADHD, I do think research supports the use of them. There seems to be this almost like a limit of about 50% sensitivity if we want to maintain 90% specificity. So if we only want to make a false accusation of exaggeration or malingering 10% of the time, we seem to be able to detect about 50% of individuals who are exaggerating. And that’s still something. I mean, that’s still a lot. So I do think that they’re helpful for that reason.

    Dr. Sharp: Okay. Yeah, I know that’s an ongoing growing area as well research-wise.

    Dr. Lovett: I really would encourage clinicians to not think of themselves as [00:32:00] neuropsychologists to look at the neuropsychology literature on performance validity tests. There is so much stuff out there validating different measures, both embedded and otherwise.

    There was one recent study that just came out last year. A very interesting study on using the processing speed measures on the WAIS as embedded effort indicators suggesting…

    Dr. Sharp: Oh, that’s interesting.

    Dr. Lovett: …that if someone is getting scales scores on coding and symbol search of 5 or below, that could certainly suggest low effort, things like that, or even certainly just low processing speed index scores in folks who don’t have obvious neurologic impairments and it appears to be rather rare, but you actually find really low processing speed scores if someone is putting forward their full effort. 

    Dr. Sharp: Got you. Yeah, I know that’s a whole can of worms that we could jump into. I was just curious about your thoughts on that.

    Dr. Lovett: Yeah, that’s the one thing I’ve mentioned again, though. The one thing I’d add with [00:33:00] regard to performance measures is you really want to ask yourself if the person has a motive for perhaps exaggerating, which could be psychological or psychiatric. It could be that there’s some sort of material benefit, like a student who’s trying to avoid going back to school after having a concussion or something like that. It might not be accommodations-related, but if there is some sort of incentive, does the performance validity test task relate to how the person might strategize to perform poorly?

    I think about this a lot with someone who might be working slowly to demonstrate a need for an extended time. If the performance validity test is time, then that’s going to be a better indicator of whether someone is working slowly. So that’s why I was really interested in the processing speed index and the processing speed scale scores as a potential validity indicator, whereas a lot of the memory-based PVTs are not necessarily heavily timed. [00:34:00] So if someone’s working slowly, that might not catch them. So, it’s something to consider.

    A resource that I would definitely recommend there was a book published back, I think it was 2015 edited by Kirkwood and published by Guilford. […] in Colorado?

    Dr. Sharp: Yeah, he’s just down the road.

    Dr. Lovett: Okay. Yeah, absolutely. He has a wonderful book to be edited with a number of contributors on symptoms and performance validity testing measuring effort and things like that in children and adolescents because so much of the early work was conducted with adults. There was even this myth that children and adolescents would be putting forth adequate effort and would not think to misrepresent symptoms, and that’s certainly not the case. And I think that the book has a lot of wonderful chapters on various topics related to that. 

    Dr. Sharp: Yeah, I agree. I’ve seen some of those, certainly. It’s very useful. I’ll [00:35:00] list that in the show notes for anybody who might be interested in that.

    Let’s dive into some of the actual accommodations. I’m really curious to hear from a research standpoint which accommodations actually make sense, which ones are supported, and which ones aren’t?

    Let’s take this quick break to hear from our featured partner.

    The Feifer Assessment of Writing or FAW is a comprehensive test of written expression that examines why students may struggle with writing. It joins the FAR and the FAM to complete the Feifer family of diagnostic achievement test batteries, all of which examine subtypes of learning disabilities using a brain-behavior perspective.

    The FAW can identify the possibility of dysgraphia as well as the specifics subtype. Also available is the FAW screening form, which can be completed in 20 minutes or less. Both the FAW and the FAW screening form are available on [00:36:00] PARiConnect-PAR’s online assessment platform, allowing you to get results even faster. Learn more at parinc.com\faw.

    All right, let’s get back to the podcast.

    Dr. Lovett: The most common accommodation by far is extended testing time. We see that in requests at the post-secondary level. We see it on the K to 12 level. One of the reasons it’s so common is that students who receive other accommodations often receive extended time just to use the other accommodations. So, it’s sometimes a very common accommodation.

    In the United States, we tend to give extended time allotments of either 50% or 100% extended time. I say in the United States because interestingly, there are some other countries where we see testing accommodations but the extended time allotments are not really that much.

    In the United Kingdom, for [00:37:00] instance, in Britain, there tend to be lower levels. Some things like 10 minutes per hour of extended time are more common. Some standardized testing agencies have added 25% extended time as an option here in the United States though. So that’s a recent thing that you’ll sometimes see. I know I’ve seen that being given to the folks on the MCAP, for instance, as well. So 25% extended time is a more recent addition, but we tend to get a 50% or 100% extended time.

    So what might be the evidence that would support such an accommodation? One of the big ones is someone who has reading-related problems or whose reading speed is substantially below what is typical. I would say that even more important than reading speed per se would be their time reading comprehension skills. If the student is unable to read and comprehend text and make sense of it within a standard amount of time, and the test is not designed to measure their time reading comprehension, the test that they want accommodations on, then that [00:38:00] would generally be one piece of evidence, but a sound basis for requesting additional time.

    The student generally would be expected to be able to read and understand texts at least as well, or within the average range compared to most other examinees. And so, if someone has really substantially below-average time to reading comprehension, that could be definitely a part of an extended time request.

    But the one thing that I think we have to be careful about it is that we don’t want to extend the time to become an unfair advantage because there actually is a lot of research showing that when non-disabled students are given extended time on time pressure tests, unsurprisingly, they do better. So, if your accommodations benefits are not necessarily specific and that’s particularly the case on standardized tests as opposed to teacher-made tests in schools.

    So there is a myth out there that you’ll sometimes hear that benefited from extended time means that […] I would say that’s very similar to the myth that if [00:39:00] your cognition benefits from taking stimulant medication, that means you have ADHD. In the same way, extended time is something that is desired by many students who don’t have disabilities.

    And the survey study that Larry Lewandowski, myself and a number of other researchers did, I think it was published back in 2013 or so, we talk about that in the book, we found that out of 600 and some students, over 85% of those with and without disabilities felt that they would improve their score on a standardized test with extended time. And the research shows that there’s a good basis for those expectations. On time-pressure tests, it does appear that most folks will benefit from an extended time.

    In our laboratory settings, we actually will give students with and without ADHD or with and without learning disabilities a standard time limit, see how they’re doing. We ask them to circle where they are, or sometimes we actually switch what type of color or pencil they’re using so that we can see exactly which items they solved [00:40:00] during the standard time limit and then with extended time. And we tend to find that both groups benefit from the extended time.

    Now, in some educational settings on teacher-made tests, the tests may not be time pressure. And so, in that case, it’s unlikely that most students with or without disabilities would benefit from extended time. But on time-pressure standardized tests, we tend to see effects for both groups.

    Dr. Sharp: Yeah. I know that a lot of folks recommend extended time for ADHD as well, but I feel like I’ve read some things saying that that’s not actually helpful or as helpful as we thought it was.

    Dr. Lovett: Yeah. One thing to keep in mind, of course, is that ADHD is comorbid to some degree with reading problems. So some portion of students with ADHD will have low timeframe apprehension. So that could still be a very sound basis for the request. If the individual is so distractible that they’re unable to get through a passage without getting distracted and [00:41:00] have to go and re-read it many times, then again, there are times on extended time for the appropriate, but the decision really has to be made on an individual basis.

    So we should never assume that because someone has ADHD, even if it’s validated ADHD, we should never assume that they need extended time on tests. There should always be specific evidence of that access deficit, that deficit in access skills. So again, we would expect to see time-reading comprehension performance that’s poor. We would expect to see evidence from real-world settings of teachers saying that they’re unable to complete their exams when all of the other students are and things like that.

    And so, we really need to do it on a very individual basis. There is some basis for it in some students with ADHD, but we should never assume that it usually means extended time. And that’s why we really have to get away from this menu or list of accommodations that go with a disability condition. It really needs to be made on an individualized basis.

    Dr. Sharp: I see. [00:42:00] So what are some other common accommodations that are actually supported by research?

    Dr. Lovett: All right. So you know one accommodation, the read-aloud accommodation as I mentioned earlier. The research shows that the benefits of read-aloud tend to be specific to individuals who have access skill deficits. Students who are non-disabled don’t generally benefit from read-aloud accommodations. If anything, they don’t like them.  And I think that’s easy to understand. If you’re a competent reader, you’re trying to read the test and someone insists on reading it to you, that’s not very pleasant. It’s kind of distracting and things like that. So that would be appropriate.

    And the big caveat is we need to make sure the test is not trying to measure reading skills. In my own state of New York, a policy was changed for the state exams that students take at the elementary and middle school levels so that students who have severe reading disabilities could actually be read the English language access.

    Dr. Sharp: That seems problematic.

    Dr. Lovett: Yeah, it definitely [00:43:00] is. I think that there are reasons why it happened. Basically, students who have disabilities are forced to take these tests, and parents and schools are understandably complaining saying, my students are able to read. The idea that they should have to sit through this reading test is silly.

    I agree with that. It is silly. In my opinion, they should in fact take that test, but reading the test to them invalidates their score if that test is supposed to measure their reading skills at all. We can turn a reading comprehension test into a listening comprehension test.

    So, if we’re not trying to measure reading skills, then a read-aloud accommodation will generally be appropriate in those cases where someone has documented severe reading problems, especially decoding issues. So poor reading fluency or poor time reading comprehension would, in general, be enough for a read-aloud accommodation, but we would expect that the person has trouble decoding individual words,[00:44:00] I can say. I really expect to see that.

    Dr. Sharp: Okay. Fair enough.

    Dr. Lovett:  So that’s one accommodation that we see increasingly at the K to 12 level, but sometimes on higher-level exams as well. The SAT for a long time has at times provided audio recordings of the test items. We do see that there too.

    Another accommodation that’s very common that unfortunately, we don’t have much research on is separate room accommodations.

    Dr. Sharp: Oh, that’s interesting.

    Dr. Lovett […]for a wide variety of reasons. The biggest one by far is distractability. ADHD and other conditions may report that they are so distractable that they’re not able to pay attention to the test if they hear noise or they see something in their visual field other than the test, that’s something that would distract them. And it takes them a lot of time to get back to the test mentally. So distractible is one reason we sometimes see. Another one is students who have reading problems may report that they benefit from reading aloud.

    Dr. Sharp: Right. Reading aloud [00:45:00] to themselves?

    Dr. Lovett: Exactly. And so, they’ll say, I need to be in a separate room so I can read the text aloud. I find that really helpful.

    Another really common reason is anxiety. People will say, as I mentioned, that they get very anxious if other people are taking the test with them. They get upset if someone finishes the test before them. They’re just generally hyper-aroused in terms of anxiety and the extra people in the room adds to that. So we have lots of rationales that sound in a sense, superficially reasonable, but we have very, very little research looking at that.

    Larry Lewandowski and his colleagues, I wasn’t involved with this study, but they did do one study looking at whether non-disabled college students would benefit from being in a private room. And they did not find any benefit, which is good. I mean, if someone does benefit, then perhaps it is because of their unique disability-related issues. We don’t really have research to support that as being the case. I don’t know of any studies that have looked at private room accommodations on a realistic [00:46:00] test for students with any of those issues, ADHD, reading problems, or anxiety.

    I’m involved in one project now that’s hoping to get that, but we don’t really have any basis for that, unfortunately. But we were in a separate room accommodation, I think we always have to look at the specific rationale and say, is there evidence to support that?

    One of the pieces of evidence that I like to see is that when the person has had to take exams in the presence of others, they are unable to access the exam. So the accommodations are needed. What’s this person’s history of test performance. So it’s often the case that clinicians will recommend accommodations without even referencing the person’s history of test performance.

    Often the individual has never had the accommodations in the past. How were they doing? If this is an initial diagnosis of ADHD, for instance, and the person has no history of testing accommodations and the clinician recommends a separate room, well, it sounds easy enough to implement, like why [00:47:00] not get someone a separate room, it’s just could be very challenging. There are schools that run out of rooms on state test days. 

    Dr. Sharp: Yeah, I’ve heard stories about that, certainly.

    Dr. Lovett: If you have 20 or 30 students in the school who will each need a separate room, that doesn’t really work. There are certain high-stakes exams for certification and licensure where a room has to be rented for the individual. It’s again, very logistically complicated. If it’s actually needed to access the exam, that absolutely should be done, but it’s not an accommodation just to make willingly just to say, it’s not a big deal, why not give them a separate room?

    It can be difficult to implement logistically. And so, if you really want to take the responsibility as a clinician to say, I’m saying this person requires this to access tests, there really should be evidence of that.

    Dr. Sharp: Absolutely. Yeah, I think that’s one theme that’s come through both of our conversations so far is just that having as clear a relationship as possible between the history and real-life and the test [00:48:00] results and the accommodations that you’re requesting. You need to make that explicit.

    Dr. Lovett: Yeah. It’s just very easy to have an accommodations list or a menu as I call it and to check them off in your report template, but there’s not always a sound basis for those in the person’s diagnosis. Even assuming that that diagnosis is accurate, it is not always necessarily a sound basis. ADHD doesn’t mean that a person requires a separate room or extended time as we were discussing.

    Another thing for ADHD that I would mention is, what’s the person’s test-taking ability when they’re on medication if they are taking medication? Medication could very well change whether or not that person needs accommodations to access tests.

    Dr. Sharp: So how do we address that? How do we get at that in making recommendations?

    Dr. Lovett: Right. One thing that we would want to do is get a sense, usually from interviews or other sorts of information about what the person’s symptoms are like when they’re on or off medication.

    Dr. Sharp: Okay. [00:49:00] So it could just be history gathering?

    Dr. Lovett: Yeah. I do think this is an area that’s under-researched. It’s not uncommon that clinicians will ask me, I’m seeing someone for an evaluation who already has a diagnosis of ADHD. They’ve already been put on medications. At least they have a diagnosis from a physician, and they want to confirm that, but they’re already taking medication. Should they be on medication on the day of the testing?

    And that’s a common question. I wish we had more research on that point. There are a lot of things to consider in making that judgment, but what I would say is what are you expecting the evaluation day to do? If you’re hoping to observe, or if you’re hoping to observe symptoms of ADHD, then the person being on their medication will attenuate those symptoms.

    So if you’re expecting their test session-like behavior, whether that’s their performance on cognitive measures, or you’re just behavioral observations to be diagnostic [00:50:00] of ADHD, then the person being on their medication for the evaluation will be problematic.

    If on the other hand, the primary purpose of your evaluation is to determine whether or not the person needs accommodations on an upcoming high-stakes test, and they’re going to be taking their medication when they’re taking that on how many high stakes tests, in that case, it would seem appropriate for them to be taking their medication on the day of their evaluation, and so on.

    Dr. Sharp: Sure. That does make sense.

    Dr. Lovett: I would say it really depends on what the primary purpose is. I know there are some clinicians who actually do the testing over multiple days, so they’ll actually have the person be on medication one day, and off another day. So there are certain advantages to that. We just need to consider things like if there are any withdrawal effects and how long we’ve waited between those things. 

    Dr. Sharp: Of course. There are a lot of nuances to ADHD testing. I’m glad you brought that up, actually. I think that’s important. We tend to have people stay off [00:51:00] medication, but it’s a lot of initial diagnoses, it’s not so much follow-up for accommodations.

    Dr. Lovett: And when you say stay off medication, I would indicate that many of them were already being prescribed that even went out of that diagnosis, right?

    Dr. Sharp: Right.

    Dr. Lovett: It’s so interesting. The one thing I always say is safety first. Obviously, if you have concerns that someone who has severe ADHD without medication, that young adult is driving themselves, I always would recommend asking them, are you able to do things without accommodations so that you can safely get here and stuff like that. 

    Dr. Sharp: Of course, that’s a good reminder. We don’t want anybody getting a wreck on the way to testing.

    Dr. Lovett:  Exactly, because the clinician told me not to be on medication. 

    Dr. Sharp: Right. So let’s see. Are there any other maybe more obscure accommodations that you feel like are very well supported that we might not be thinking of?

    Dr. Lovett: To go back to the issue of sensory [00:52:00] and physical disabilities, there’s not as much research on accommodations for them, things like braille accommodations, things like that. There is some research that’s actually somewhat older. I’m not as familiar with at least recent research on this topic, but those are combinations also tend to be less controversial.

    They’re not accommodations that are desired by non-disabled individuals. So they tend not to be something that’s highly sought after. It’s not as though someone that’s perceived as giving someone an unfair advantage. And so those are accommodations we tend not to worry as much about. Instead, the difficulty in those accommodations is often finding the right software, the right logistics to implement. And so that’s often a conversation with the school or the testing agency, or whoever’s going to be providing the accommodations.

    So some students who would have vision problems, at times hearing impairments, if there are issues related to that and they’re going to be some sort of audio [00:53:00] or oral administration of a test, then that would also pose some kind of issue. But those are the sorts of things that can often be worked out on an individual basis with whoever is providing the accommodations.

    So, I don’t have to worry as much about those, but also, it’s good to be fair. I just have less expertise with those. I rarely work with testing entities over those sorts of accommodations. In the schools, they are just far less common. So if look at a distribution of students receiving special education, the biggest categories are students who have learning disabilities, speech and language problems, the other health impaired category which has a lot of ADHD, those sorts of things. It’s far, far, far, fewer students who have sensory and orthopedic impairments, according to the special education statistics.

    Dr. Sharp: Right. That makes sense.

    Dr. Lovett: Yeah, we can have many accommodations that I think are really worth a lot of research effort towards are [00:54:00] extended time, which is certainly the most controversial one, and some of the difficult ones, like, as I’m saying a separate room, read aloud accommodations, things like that.

    Dr. Sharp: Yeah. So I do want to talk about accommodations that are not well-supported. So are there any common requests that you would say just are almost like myths that they’re actually helpful for certain concerns?

    Dr. Lovett: Interesting. I wouldn’t tend to think of a particular accommodation as being good or bad or supported or unsupported. It really is about in which case it’s supportive and in which case it isn’t. To get back to extended time, something that I think is a myth is that a student who has a low or lower score on processing speed metrics, therefore needs extended time accommodations.

    [00:55:00] So I see that assumption made all the time and I understand why. We have these diagnostic tests called processing speed measures. It sounds as though the score on those diagnostic tests is getting up the face of the mental speed of the person’s mind. So if that were the case, then low processing speed scores would suggest a need for extended time on everyone as long as we don’t care about how fast someone is.

    However, the empirical research really does not support that. Low scores on processing speed measures, although they are normed commonly in students who have learning problems, ADHD who may need extended time, a low processing speed scores per se do not indicate a need for extended time on typical academic tests.

    In the research that I and my colleagues have done, we have found processing speeds to be a very important predictor of how long students will take on typical reading-based exams [00:56:00] where someone has to read test items to answer them. And if you think about what those diagnostic tasks on processing speed measures are, they are nothing like taking a realist academic test.

    If a student has low processing speed but their reading fluency is fine, their time reading comprehension is fine, all of those things are fine, their writing fluency, whatever it is that’s relevant to the real world academic tests, that should not be a sound basis for an extended time request unless you can show that the person needs the extent of time because of visual-motor problems. And if that’s the case, then why did those visual-motor problems not impact their reading skills, their writing skills, things like that?

    Dr. Sharp: This is great. What is processing speed measuring then? And how does that translate to the real world?

    Dr. Lovett: That’s a good question. I don’t know that there’s much research supporting it as measuring anything in particular, given that we use very simple clerical [00:57:00] visual-motor tests. I don’t know that processing speed measures tell us very much about how you do on things other than processing speed measures. 

    Dr. Sharp: That’s really interesting. So is there any value in using it as a proxy for anxiety or depression?

    Dr. Lovett: Yeah, I think there’s certainly a lot of things that can cause low processing speed, low motivation, fatigue, boredom, possibly anxiety, there’s some research to suggest maybe distractability things like that, but the test than measuring any of those things, I can’t say that I would trust processing speed measures to be a strong measure, if anything, other than clerical visual-motor speed.

    Dr. Sharp: Okay. And then the translation from that to a real-life task is

    Dr. Lovett: very, very weak. Essentially when we have diagnostic tests in our armamentarium that are much closer to a real-world academic task.

    [00:58:00] And so that’s why I would say, similarly, let’s say that the student has good or better than average processing speed but they have poor time reading comprehension, we would never want to deny that student needed accommodations if they need them because of the processing speed score.

    Dr. Sharp: That’s a great point.

    Dr. Lovett: And for what it’s worth, I don’t see evaluators doing that, but I see all the time folks who are saying, well, the process speed score is low and so they need extra time, and then the evaluator goes on to ignore the average and above-average time reading based diagnostic test scores.

    Dr. Sharp: That doesn’t really hang together for me anyway. That’d be a tough sell.

    Dr. Lovett: I mean, good clerical visual-motor speech should not suggest that the person doesn’t need accommodations on a test and neither with poor visual-motor clerical speed suggest they do.

    What I would ask is, the [00:59:00] person is preparing to take teacher-made exams, or they’re preparing to take the SAT, they’re not going to have to search words and symbols on the SAT as quickly as possible. I would say maybe they are slow at that. Maybe the low processing speed score is a genuine weakness on those tasks that I tend to take a behavioral approach to interpreting diagnostic test performance in the sense that I view it as that test as a sample of your behavior, it’s a sample of your responses. You appear to be below average of making that particular response.

    If it’s a processing speed measure, then okay, you’ll report visual matching or something like that. Is that really what the SAT is measuring? No.

    Dr. Sharp: Sure, it’s really that question, what are we actually getting out here? And how does that translate to the test you’re taking? That’s fascinating. Let me know when you figure out what those processing [01:00:00] speed tests are measuring.

    Dr. Lovett: I will. I wouldn’t hold your breath., I’m not sure if we’ll ever find out exactly that. We know that the processing speed measures don’t load, especially high on general ability either, which is what IQ is supposed to be getting here

    Dr. Sharp: Sure. That’s a whole other episode I feel like. Do you know Ellen Braaten? She’s at Mass Gen?

    Dr. Lovett: Yeah. I know Ellen but I’ve never personally met her, really.

    Dr. Sharp: She wrote that book, Bright Kids Who Can’t Keep Up. I talked with her a few episodes ago here on the podcast about that.

    Dr. Lovett: I definitely have to listen to her.

    Dr. Sharp: It was good. It was really good. We talked all about processing speed and how it shows up in real life. There’s a lot to sort through with this and how we measure it and how that translates to real life. So, [01:01:00] yeah, it’d be interesting. I’d love to get your take on that if you listen to the episode.

    Dr. Lovett: I definitely will. I just think we have to be clear that I think a lot of times we switch back and forth from the operational definition of the score to some much more abstract concept of mental speed.

    What I think it’s even coming to be called sluggish cognitive tempo, which is sort of related to inattention and things like that, if someone has slow mental speed and we see that in a variety of different contexts, and we see that on different sorts of tasks, the idea that that would be very impactful on the person’s life, that’s an idea I […]. That’s not a claim that I would think to dispute. If someone tends to be generally slow mentally, then that would be a problem. And that could be very functionally limiting. And that could lead to a need for accommodations. But my question would be, are low scores on processing speech sufficient to make that judgment about the [01:02:00] person?

    Dr. Sharp: Yeah, that’s a great question. That is the question.

    Dr. Lovett: If someone can’t keep up to use that phrase, then they can’t keep up on more than coding and civil service.

    Dr. Sharp: Right. So we should see that other. 

    Dr. Lovett: Exactly. So why is there reading fluency 112? 

    Dr. Sharp: Yeah, that’s a great question. Well, let’s see. This is great. Maybe we’ll have to do a round three.

    Dr. Lovett: I really appreciate it. That’s all right.

    Dr. Sharp: We just have a few more minutes. Let me see. I’m checking to see if there was any other info I really wanted to touch on. I don’t know. I’ll turn it over to you. What have we not talked about that feels important to put out there about accommodations and test-taking recommendations?

    Dr. Lovett: I think we’ve covered so many different things and I really appreciate the [01:03:00] opportunity to talk about these issues. I hope it’s beneficial for the community and the audience.

    One thing that I might add is that we should always be giving accommodations as part of a general response to someone who has a functional paramedic disability, a disorder, or more than one. And so, accommodations should never be the sole recommendation. One of the things that we should always be thinking about when possible is intervention, especially for learning, cognitive and psychiatric disorders.

    So, thinking that the accommodations are needed right now for someone, especially for a younger child, an elementary school student who has slow reading skills, are we also putting in place something that will allow the individual to improve their reading fluency?

    Dr. Sharp: That’s a great question.

    Dr. Lovett: If we’re providing accommodations for anxiety, though there are times when that may be warranted, but are we also recommending some evidence-based treatment for anxiety, which is often your responsive to that[01:04:00] kind of treatment?

    Dr. Sharp: Absolutely.

    Dr. Lovett: Especially in educational settings and when the student is still in K-12 schooling, we’re trying to increase their skills. We’re trying to increase their autonomy. And there are times when testing accommodations are a part of that. And there are other times when testing accommodations can actually impede the development of those skills. And so, I would really just ask clinicians to think, what can they do in the best long-term interest of the client in terms of recommending things?

    Dr. Sharp: Yeah, I like that you brought that up. And I know that that probably depends a lot on training and philosophy with assessment. Some people tend to lean more heavily on the cognitive recommendations versus the psych recommendations, but I think you’re just emphasizing that point that it’s important to look at the whole picture and recognize all the different pieces that might help someone be successful.

    Well, [01:05:00] let’s see. And I know that you address that in your book a little bit as well, is that right?

    Dr. Lovett: Yes. We do have a whole chapter on accommodations and interventions and how they were laid. I think that’s a unique aspect of the book. I would say generally those two camps have been sort of kept apart. And as someone who was trained in school psychology, I found it really unusual that that field, school psychology, has really tried over the past few decades to move towards intervention and away from assessment being the sort of sole stereotype of what a school psychologist does. And at the same time, I find testing accommodations being used and recommended in an unquestioned way when interventions would actually be more appropriate.

    Dr. Sharp: I see. Just off the top of your head, are there any cases where you could say that’s usually the case where we should go more toward?

    Dr. Lovett:  Yeah, certainly for anxiety, I would say that that should be the… Our default response to anxiety should be intervention [01:06:00] and not accommodations. Accommodations are needed for a time. Often they’re provided because of discomfort rather than genuine need in the case of accommodations.

    And the accommodations can actually provide the message to the child that the testing situation is, in fact, dangerous. And they do provide those messages that in fact, things are really much worse than they are, elevating the person’s anxiety and then saying, you can’t do this without accommodations. There are times when that’s the case. Someone can’t do something without accommodations, but in the case of anxiety, that’s often not true.

    Dr. Sharp: Yeah, just being cognizant of that and walking that line is really important. Well, like I said, this has been another fantastic discussion.

    Dr. Lovett: I really appreciate it. I’m very happy to be the first return guest.

    Dr. Sharp: Yeah. I am really happy to have you back and I’m glad that you agreed. And like I [01:07:00] said, maybe we’ll do it again when you write your next book. Or figure out what processing speed tests are measuring, then I’ll have you back on. Thank you.

    Dr. Lovett: […]

    Dr. Sharp: That sounds great. Yeah, I really appreciate it, Ben. Like I said, this is a great book. I’ll have it in the show notes. And I’ll just recommend again, that folks check it out. It’s research-driven, which is I think really important in what we do, and you clearly have delved into this research really thoroughly. So thank you. Thank you for your time and your thoughts.

    All right. Thanks, y’all for listening to this episode. Like I said, classic that is still relevant with much of the information shared here able to be applied with many students that we are working with, young adults and college students, in particular.

    I think this dovetails well with some of the information shared [01:08:00] in my interview with Dr. Julie Suhr and Dr. Allyson Harrison from two months ago. And if you want more information around research-supported intervention or rather research-supported assessment of ADHD, that would be a great one to check out. It is linked in the show notes as well.

    So thanks as always for listening. If you have not subscribed or followed the podcast, I would love for you to do that. And if you need CE credits, you can get those for just listening to the podcast and taking a short test at athealth.com.

    Okay. I hope you’re all doing well. I will catch you next time.

    [01:09:00] The information contained in this podcast and on The Testing Psychologist website is intended for informational and educational purposes only. Nothing in this podcast or on the website is intended to be a substitute for professional, psychological, psychiatric, or medical advice, diagnosis, or treatment.

    Please note that no doctor-patient relationship is formed here, and similarly, no supervisory or consultative relationship is formed between the host or guests of this podcast and listeners of this podcast. If you need the qualified advice of any mental health practitioner or medical provider, please seek one in your area. Similarly, if you need supervision on clinical matters, please find a supervisor with expertise that fits your needs.

    Click here to listen instead!

  • 213. Research-based Testing Accommodations With Dr. Ben Lovett (Replay)

    213. Research-based Testing Accommodations With Dr. Ben Lovett (Replay)

    Would you rather read the transcript? Click here.

    Dr. Ben Lovett is back and talking all about his book, Testing Accommodations for Students with Disabilities. He has a stellar command of the research in this field from having done it himself and reviewed so much of it while writing the book. Here are a few things that we talked about:

    • When to have individuals take medication (or not) prior to testing
    • The most research-supported accommodations for things like ADHD, learning disorders, and mood concerns
    • Myths around testing accommodations (spoiler: processing speed doesn’t always equal extra time!)
    • A “formula” for increasing the likelihood that your accommodation requests will be granted

    Cool Things Mentioned in This Episode

    Featured Resource

    I am honored to partner with PAR for 2021 to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Ben Lovett

    Dr. Ben Lovett is an associate professor of psychology at the State University of New York (SUNY) at Cortland, where his research focuses on the diagnosis of individuals with ADHD, learning disabilities, and related conditions, as well as the provision of testing accommodations to students with these disorders. He has published over 70 papers on these topics, as well as a full-length book, Testing Accommodations for Students with Disabilities: Research-Based Practice (APA Press). He has served as a consultant to numerous testing agencies and schools on disability and assessment issues, and he is a licensed psychologist in New York.

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]

  • 212. A “Checklist Manifesto” Approach to Testing

    212. A “Checklist Manifesto” Approach to Testing

    Would you rather read the transcript? Click here.

    How many times have you entered the testing room, started the battery, and figured out that you left something crucial in another office (for me, it’s always my phone/stopwatch)? Or how many times have you sent out a report only to get an email back from the client asking why there’s another name on the report? Yikes! Both of these – and many other slip-ups – are mistakes that could have been avoided with a little preparation or double-checking. Today’s episode is a commentary on mistakes and how to avoid them. It draws heavily on material from Atul Gawande’s book, The Checklist Manifesto. Turns out a simple checklist can go a long way!

    Cool Things Mentioned

    Featured Resource

    I am honored to partner with PAR for 2021 to bring you featured items from their catalog! Listen to each episode for specific product recommendations and links. Learn more at www.parinc.com.

    The Testing Psychologist podcast is approved for CEU’s!

    I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!

    About Dr. Jeremy Sharp

    I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

    As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

    Ready to grow your testing services? Click below to schedule a complimentary 30-minute pre-consulting call!

    [x_button shape=”square” size=”large” float=”none” href=”https://app.acuityscheduling.com/schedule.php?owner=13476033&appointmentType=2843005″ target=”blank” info=”none” info_place=”top” info_trigger=”hover”]Schedule Your Call[/x_button]