Dr. Jeremy Sharp (01:16)
Hey everyone, welcome back. We’ve got a clinical episode for you today. I am talking with Dr. Alberto Fernandez about cross-cultural neuropsychology, test adaptation, and test development. So, Dr. Fernandez is a clinical neuropsychologist. He is an assistant professor at Loyola Marymount University in Los Angeles, California. He’s published dozens of articles in scientific journals.
several book chapters. His publications have been cited over 1700 times, according to Google Scholar. He’s developed or adapted several neuropsychological tests. The main one that we will talk about today is the multicultural neuropsychological scale. You will hear me during the episode refer
to it as the MNS once or twice. The acronym is actually the U N S or MUNS, and Alberto graciously corrects me on that during the interview. So just naming that here as well.
We talk about the Cordoba naming test and several other measures during the course of this interview. He’s given dozens of lectures at various events around the world, and he is the secretary of the International Neuropsychological Society. So Alberto is a fantastic guest. we tackle a lot during this episode, per usual. We talk about test adaptation versus test construction and why he
Ultimately moved from adaptation to construction. We talk about cultural biases in the Boston naming test and the creation of the Cordoba naming test. We talk about in quite a bit of detail, we talk about the MUNS or the multicultural neuropsychological scale, core objectives,
subtests, and rationale behind the development and choices in the development process. gosh, what else do we talk about? we talk about the challenge of selecting culturally fair.
Testing stimuli, the role of time tests in different cultures, and how those may or may not be culturally fair. We talk about how to apply clinical judgment when you know deciding between measures to administer or not administer. And we talk a little bit at the end about future directions for cross-cultural neuropsych research. So as usual, rich conversation, plenty to take away from this discussion.
And I hope that you enjoy this conversation with Dr. Alberto Fernandez.
Dr. Jeremy Sharp (03:44)
Alberto, hey, welcome to the podcast.
Alberto Fernandez (03:47)
Thank you for having me, Jeremy.
Dr. Jeremy Sharp (03:50)
Yeah, yeah. Thank you. Thank you for being here. I’m excited to talk to you about all kinds of things in this world of multicultural neuropsych and test development and all kinds of things. So appreciate your time. I’ll start with with a question that I always start with, which is, you know, of all the things that you could do with your professional life, why why this?
Alberto Fernandez (04:12)
Well, I started working in this field motivated for different things, but I think that the most important was when I started working in neuropsychology many years ago in Argentina,
Dr. Jeremy Sharp (04:26)
Mm-hmm.
Alberto Fernandez (04:26)
I noticed that most of the tests that we we were using at the time they were imported from other cultures, from other cultural environments.
and they were not well really well prepared for our population.
Dr. Jeremy Sharp (04:41)
Mm-hmm.
Alberto Fernandez (04:42)
So when I had to make a diagnosis, work with the specific patients, I had some difficulties in selecting the tests and that was a serious limitation. So that’s I would say that was the main reason why I started working on this. Then other things happen.
you know, over
Dr. Jeremy Sharp (05:01)
That’s how it goes.
Alberto Fernandez (05:02)
over time, but yeah, that that was the main reason. And the evolution led me to other different ideas and and things I I I’m I’m pretty sure we’re gonna discuss today.
Dr. Jeremy Sharp (05:13)
Yeah, yeah, I was gonna say I think we’ll probably touch on a lot of that evolution as we go along. But it may be helpful to to start in the beginning to some degree. You know, I’m curious, like in your early career it seemed like you focused more on test adaptation before doing original test construction. I would love to hear like what led you to to make that leap, you know, from adaptation to construction.
Alberto Fernandez (05:39)
Yeah, I think that’s a very interesting question. I started working on adaptation. I I took a seminar in the year two thousand, I think on test adaptation. And I thought that was initially the way to go.
Dr. Jeremy Sharp (05:54)
Mm-hmm.
Alberto Fernandez (05:55)
but I I have s as I have expressed in some of my book chapters, that’s an endless job.
it’s you’re never you’re never gonna be able to adapt all the tests that you need in the first place. So
Dr. Jeremy Sharp (06:10)
Right. Right.
Alberto Fernandez (06:12)
adapting tests is a very laborious work. It takes a lot of time and resources and it’s endless because there are so many tests. I’m I’m and you’re not going to adapt every existing test because there are thousands of them probably.
But just thinking about what you need is i it’s just very difficult. And on top of that, some of the adaptations demand so many changes to the original test that sometimes it doesn’t make sense to adapt an existing test and it’s a better idea to
start from scratch with a new test that is targeted of the specific population you’re working with. and in the third place there is also commercial reason which is copyright so many of the current tests or the tests that people use are copyrighted so you have to ask for permission
to the editori to the publishers and that is a difficult process sometimes and what happens in the end even when you do the work you still don’t have the right to use the test unless you purchase materials so you’re basically doing all the work for the publishers but then you’re still obliged to
but to purchase the materials. So all these reasons led me to the idea of developing some tests from from scratch specific for the population. So for example, the Cordova naming test is a test that was specifically thought for Spanish speakers. Because we could have worked on adapting the Boston naming test
But as I mentioned before, adapting that test would have implied so many changes to the original test that it’s almost like developing a new test.
Dr. Jeremy Sharp (08:11)
Yeah, yeah. Since you brought that up, can you give some specific examples, even just like to give folks a little bit of a a window into test adaptation, like like on the Boston naming test, for example, w w what what changes would you have had to make to to make it relevant, you know, for
Alberto Fernandez (08:28)
Yeah. Well, I don’t know if the the listeners are familiar with the Boston naming test, but the Boston naming test is a naming test, which is
Dr. Jeremy Sharp (08:35)
Sí, sí, sí.
Alberto Fernandez (08:36)
basically a confrontation naming test. So the rationale of these tests are some people have some difficulties retrieving words in some specific conditions like
Semantic dementia, Alzheimer’s disease, aphasia. In these conditions, people have difficulty retrieving names. So that’s called anomia. And one way to measure anomia is given a a naming test or confrontation naming test. In these tests, you show pictures of different objects and the patient has to name the object.
Dr. Jeremy Sharp (09:10)
Mm-hmm.
Alberto Fernandez (09:11)
So what happens with the Boston imminent test? It was developed in Boston in the 70s, and it it has a lot of very cultural specific stimuli. So, for example, one of those is Welltrees. I don’t know if there is even a word for that in other languages, or the pretzel, or the beaver.
the beaver is an animal that is unknown to many people. So when you’re testing naming, you wanna expose the patient to a stimuli that are familiar to them. They they know how to name. So you wanna test if they can retrieve the word or not. If they
Dr. Jeremy Sharp (09:51)
Mm-hmm.
Alberto Fernandez (09:52)
don’t know the the object or or if they don’t have a word for that in their language.
You cannot name it. on top of that, the version that was published in the Spanish was an adaptation they did in Spain. they the the published version replaced some of the original items, but there was no indication of why and how they decided these replacements.
So I found that the original version was different to than this version. So what they did in Argentina initially, they worked with this Spanish version of the Boston Emin test, and they some a group of colleagues they gave the test and reordered the test in terms of the level of difficulty of each item.
Because the rationale the here is that the items are all organized in order of difficulty. So you start
Dr. Jeremy Sharp (10:50)
Mm-hmm.
Alberto Fernandez (10:51)
with the easier items to name to the most difficult items to name. So they found that the or original order didn’t work for the Argentinian population, so they reordered the test or the the pictures of a test, but that wasn’t enough.
some of the tests still have problems. Some of the items are still had problems like the igloo.
Dr. Jeremy Sharp (11:17)
Mm-hmm.
Alberto Fernandez (11:18)
Some
people mistaken the glue or they they thought it was a matte oven which is common in that region. It’s very similar to that one. And
Dr. Jeremy Sharp (11:29)
Mm-hmm.
Alberto Fernandez (11:29)
as a consequence,
People would say this is a mad open, but that was not the actually the original intent of the test. They were it were thought as an image of an igloo. So if you say Matt Obam was correct and incorrect at the same time. So those kind of items were very problematic. there are many
Dr. Jeremy Sharp (11:55)
That makes sense.
Alberto Fernandez (11:55)
adaptations of this test across the world.
And they have made many changes. Like for example, the Australian version, instead of bread salt, they have a pizza.
Dr. Jeremy Sharp (12:06)
Okay.
Alberto Fernandez (12:07)
And instead of a beaver, they have a platypus, which is an animal that you can only find in Australia.
Dr. Jeremy Sharp (12:13)
Uh-huh.
Uh-huh. I see. I see. Yeah, I mean, that makes sense. I the even though that’s just one test, you know, it’s easy to name several examples that you are problematic right off the bat that you know create some hurdles when you’re trying to adapt it. So you decided to go the route more of developing original measures, which is I which seems like a lot of work to me.
As well, you know, you said that adapting’s a lot of work. I don’t know, designing a measure from scratch also seems like a lot of a lot of work. So, I mean, I’m curious if you did you run into any tension, I guess, you know, in terms of like maintaining like construct equivalence when you were designing tests from scratch. what what was that process like?
Alberto Fernandez (12:58)
Yeah, well you’re right. i it it’s developing a new test is as laborious as adapting one. But I think the advantage is is in that you when you think about the items, do you think specifically the items that you want to include in terms of being culturally appropriate, for example.
And so you can save some steps in a way, but you still have to run all the psychometric studies, like the validity studies, the reliability, and you have to collect normative data, all that stuff. basically I when we developed the cord overnaming test, I basically took the same model of the
Boston Mintels in terms of a confrontation emintest with black and white pictures,
Dr. Jeremy Sharp (13:47)
Mm-hmm.
Alberto Fernandez (13:47)
different drawings. but we ran a pilot study. The the innovation was
basically the running the pilot study to select some
Some pictures that were not ambiguous in terms of the interpretation or or of names of these different objects. So we got rid of some items that were too easy or too difficult or the interpretation was not clear. So for example, we came up with a neuron and some people thought it was a tree. So
It was similar to the tree, so we had
Dr. Jeremy Sharp (14:23)
Yes, sir.
Alberto Fernandez (14:23)
to discard that one. but the the other element that we introduced as an innovation was we wanted to have a more normal distribution in terms of scores. So one of the problems with the Boston Amy test is that it’s quite easy for most people.
So you have a very skewed distribution and that makes that if you are testing someone who who has a high level of education, they may pass the test even when they s have some difficulties or when they have experiencing some naming difficulties. But because the test is easy to pass or to obtain high scores.
you can still obtain high scores with that. So what we did with the Cordoban Amin test was trying to include more a few more difficult items just to make sure that we have a more normal distribution. And that worked really, really well. and the other thing is to make it shorter because see Boston has 60 items which is kind of extends
so we decided to shorten it to thirty items. But the rest of the procedure instructions were was very similar to the to the Boston MIT test. I think there I looked into the the literature and I found not many examples of
Confrontation naming tests.
So we I started with adaptations, then I moved to developing specific tests. but then when thinking about cross-cultural examinations
There were several problems. I mean I’m most of the tests again if you have to adapt the test to every culture, it’s it’s an endless endless task. There are so many well, defining a culture in the first place is a very difficult topic. And then
Dr. Jeremy Sharp (16:18)
Uh-huh. Hmm.
Alberto Fernandez (16:19)
if you wanted to come up with different
versions in different languages.
There are more than seven thousand languages in the world. So and even if you think it just about the most widely spoken languages, it’s an enormous number of tests that you should be adapting.
Dr. Jeremy Sharp (16:39)
Sure.
Alberto Fernandez (16:41)
So that approach is not going to work. And the problem is on top of that
You also have the problem that you don’t have the resources in some environments to develop these tests. You don’t have the financial resources or the human resources because you need trained people to give the tests, to collect the data, and all that requires a lot of effort and resources. In some countries, you have very few neuropsychologists.
So thinking with data scope, the idea was to come up I’m based on the existing literature, to come up with a test that you can
design from the onset to be applied in different cultures, to be appropriate
Dr. Jeremy Sharp (17:27)
Mm-hmm.
Alberto Fernandez (17:28)
culturally appropriate for different cultures. And
Dr. Jeremy Sharp (17:30)
Mm-hmm.
Alberto Fernandez (17:31)
the best way to do that is to use universal stimuli. So you stimuli that people can recognize across different cultures. I try to avoid the term universal because it
Dr. Jeremy Sharp (17:45)
Yeah.
Alberto Fernandez (17:46)
probably
won’t work in every existing culture in the world. So if you go to you know s probably some more isolated or traditional cultures living in rural areas, in some countries, well, they might not be able to or these psychometric techniques might not work in these situations. But for the most part, these stimuli are known to most people in the world.
Let’s put it that way. so we came up with the idea of making a test that it would be there. Were some experiences, but most of these tests with the same approach. But most of these tests were designed to test people with dementia so and older people. So
We wanted to design a test that would be able to be applied in younger populations that would be able to be easily translated into different languages. that you you can have also universal stimuli or there’s a stimuli that people can recognize across cultures and also
We wanted to have a test that could could be applied to patients with higher and lower education. Because the most of the current tests are prepared for people with higher education. And then we
Dr. Jeremy Sharp (19:05)
Mm-hmm.
Alberto Fernandez (19:05)
have to test people with lower education. there are there are not very many appropriate tools for that. And there is a large population of people with lower education. so these were
And also we wanted to make it robust in terms of psychometric properties, trying to make it sensitive, and to give us more information than just a screening test. So
Dr. Jeremy Sharp (19:31)
Mm-hmm.
Alberto Fernandez (19:31)
all these were the goals. also to make it accessible for an
for most people not to come up with something that is very sophisticated or or very expensive in terms of the materials. so that that was the other concept behind the development of the months.
Dr. Jeremy Sharp (19:54)
I gotcha. Can I go back to one thing that you said and just you know, trying to determine, you said you don’t like the term universal, which is fine, you know, but trying to d trying to find, I guess, culturally fair stimuli.
Alberto Fernandez (20:07)
Mm-hmm.
Dr. Jeremy Sharp (20:08)
did you have any can you think of any examples where you were trying to choose between stimuli and like had some trouble figuring out like is this truly fair or is this actually like
Could we trace this back to being, you know, bound to a western culture primarily? You know, were there any things that you kind of wrestled with in in that regard?
Alberto Fernandez (20:29)
Yes. well first of all you don’t wanna include letters, for example, of the alphabet. ’cause there are different alphabets and and that’s something you must e exclude. you don’t wanna include currency, you don’t wanna include historical figures,
fruits and the names of the fruits change so much even in the same language.
Dr. Jeremy Sharp (20:53)
Mm-hmm. Mm-hmm.
Alberto Fernandez (20:57)
so in our case when we were designing some of one of the subtests which is a party subtest, we had a discussion about including the cake or dessert. So is it universal or culturally fair
Test. So we started to think about and then doing some research about what happened in different cultures. And it seems that most people across cultures they have some kind of dessert or cake. So it seems that that is not a problem so far. that I think that was the main element. And also we didn’t want to include timed
Because time is not you know applying that kind of tests is not very appropriate in some cultures in which and in those cultures in where people are not used to being asked to work fast and accurate. so we
Dr. Jeremy Sharp (21:52)
Hmm. That’s a
Alberto Fernandez (21:55)
wanted to avoid that.
Dr. Jeremy Sharp (21:56)
Yeah, yeah. I’m glad that you mentioned that. I did not necessarily consider that as a as a factor, but of course that makes sense. Like that the concept of like work as fast as you can is not a universal concept.
Alberto Fernandez (22:11)
No, that is a very common concept in in societies where are they have a psychometric traditions where people are used to that kind of tests and they are exposed to that kind of tests since elementary school. but that is not common in some other cultures in which people would say probably, Well, if you want me to make it
If you want me to be accurate, just give me time. don’t don’t rush me.
Dr. Jeremy Sharp (22:39)
I mean that’s a great point. Yeah. Yeah.
Alberto Fernandez (22:42)
Yeah, but
what happened, Jeremy, is when we came up with the attention subtest, we had a couple of failed attempts trying to come up with a sensitive test for attention disorders. So we came up first with the steps, footsteps and horns subtest. It was an auditory test.
And it didn’t work. People
Dr. Jeremy Sharp (23:04)
Yes.
Alberto Fernandez (23:05)
confused the sounds, and then we came up with the arrows test, in which people had to count the series of arrows. But it turned out that and we wanted to avoid timing. but it turned out that the test
was too difficult. So we it wasn’t sensitive to discriminate between controls and clinical population. So it was even for the control population was difficult. So the third version of the attention test, I had to review very carefully the literature, and it turns out that it seems that it’s not possible to measure accurately or to come up with a
sensitive test for attention that is not including time. so you need some kind of pressure to complete the test and that will be more sensitive if there are difficulties with attention. So we came out with the arrows cancellation ty test, which actually it it is a time subtest and is the only one in the in the scale. But
I finally had to accept that maybe that subtest won’t work in some cultural environments.
Dr. Jeremy Sharp (24:18)
I hear you. Yeah. You anticipated my next question, which was yeah, how do you get around this attention executive functioning question if there’s no timed component whatsoever? That seems tough.
Alberto Fernandez (24:29)
Yes. I mean I couldn’t honestly I couldn’t find any other solution that is not a time test. because eventually if you don’t put that kind of pressure on the patient,
you can compensate the for the diff the attentional difficulties somehow.
So
Dr. Jeremy Sharp (24:48)
Mm, mm, mm.
Alberto Fernandez (24:50)
it seems that failures in attention are more evident and more apparent when you are in a situation in which you are supposed to focus very much and perform you know at your best in terms of attention.
Otherwise you can compensate that and then the test is not sensitive.
Dr. Jeremy Sharp (25:16)
I see. I see. So we started talking about the the multicultural neuropsychological scale. I’m gonna call it the S from this point forward. But we started talking about that. What are the wal walk us through the other subtests in the in the measure just to give people a
Alberto Fernandez (25:32)
Sure.
Dr. Jeremy Sharp (25:32)
good idea of what it contains?
Alberto Fernandez (27:45)
Yeah, there are seven subtests. three of them are memory, so there’s a high load on memory, which is one of the most sensitive measures when people have cognitive impairment. Two of them are verbal memory, one of them has a format of a story, so people have to remember a story about a a virtual or fictitious character.
And that’s a personage subtest. And then the other one is the word list learning subtest, which is the it has the basic format of the a list of words that you are read to the patient and they are asked to remember this list of words. The innovation here was that we took all these words for both tests from the Swadesh list. Swadesh was an anthropologist who
Dr. Jeremy Sharp (28:39)
Hmm.
Alberto Fernandez (28:39)
came up with a list of words that are allegedly that they exist in every language. So we c he
Dr. Jeremy Sharp (28:47)
I see.
Alberto Fernandez (28:48)
came up with a list of around a hundred words. but this this has been modified and over time.
So we wanted to make sure that the words that we include in the list can be translated into different languages. Because that is what happens. Sometimes there is no word for that. there is no equivalent word in other languages for the original word that you include in your test. and that those those are and the other innovation is these two tests are
have a different length di depending on the educational level. So for people for people with a lower education, we give a shorter version of each test. And it’s longer for people with higher education. So you can use the same test as a way, but with a longer version or a shorter version.
according to the education to avoid ceiling effects or floor effects.
Dr. Jeremy Sharp (29:45)
Mm-hmm.
Alberto Fernandez (29:45)
Then we have the visual memory subtest, individual memory subtest. we selected four culturally fair images. One is a leaf, a flower, a hand, and a building. if people are exposed to
These images one by one. They have sort certain parts are shaded in, so they expo they are exposed for ten seconds and then they have to indicate in a blank piece with the same picture. they have to indicate the parts that were shaded in. So this is pretty much
We try to come up with a very pure visual memory, trying to remove the motor component. That’s you can find in some other
In some other tests. and you have an immediate and a delayed trial. Then we have this attention subtest, which is the arrows cancellation that I described before. So you have two pages, in one page there are a set of arrows pointing at different in directions. people have
to cross out some specific arrows pointing upwards and to the right. and then that there’s a second sheet with the arrows and but in this case these arrows are disorganized. In the first one they are organized in rows and columns and they have one minute for each trial. For the parties of test
is a planning test and an executive function test but it’s mostly measuring i think planning and organization so they I presented with a map of a fictitious you know city where they have different places where they they have to organize a party and they have different items that they must collect
So they must they must trace the route where they they will take, where they will buy all these items. They have a limited budget, which is 100 coins, and they have to keep and we said coins just to avoid any specific prices.
Dr. Jeremy Sharp (31:56)
I notice uhhuh.
Alberto Fernandez (31:58)
and they have different prices. So people have to decide between coming up with a balanced
route in or a balanced plan in which they you don’t wanna make a road
But you also because that is one of the specific instructions that you have to take the shortest route possible. And they have to buy all the items. I don’t have to exceed the budget. So you have to think about different things at the same time. And they have a starting point and an end point. so basically there you count how long is the route and also how many items they bought.
Then we have the constructional praxis test, which is the dots and lines. It consists of a series of different designs that they have to copy. designs that include dots and lining lines linking these dots, and they have
Dr. Jeremy Sharp (32:58)
Mm-hmm.
Alberto Fernandez (32:59)
to copy this. And this does
The goal here were twofold. It was twofold. the goal was to come up with a test that
You could avoid some subjectivity in terms of the scoring that happens with other tests, in which, for example, the origin people are asked to copy a figure, and so the copy might may be smaller or bigger than the model, and maybe small rotations, or and then it’s difficult to score that. So in this case, by using this dozen lines.
every equal line to the original model is a correct answer. and we also made symmetrical designs in the same set of points just to make sure that we could capture neglect if the person is having some kind of neglect which is ignoring one part of visual field
You can capture with this assignment.
then f I think the last one, I’m not forgetting anything, is the animal subtest, which is a language subtest, a verbal fluency subtest. It is probably the only cross cultural language test that you can come up.
Because languages vary so much in terms of grammar, syntax, vocabulary, pronunciation, alphabet, and so on and so forth. So the animal sub test according to different studies seems to be pretty universal in terms of it’s verbal fluency and it’s a semantic verbal fluency test.
So it seems to be quite cross-culturally fair. So people tend to perform equally across different languages. The only innovation we did in this subtest is usually people give one minute for that, we gave them two minutes. Because in different languages,
the names of the animals might is longer. So for example, if you compare Spanish and English, cat in Spanish is one syllable in in English is one syllable in Spanish is two. Dog the same. Horse is even worse. So
Dr. Jeremy Sharp (35:20)
Three. Yeah. Yeah.
Alberto Fernandez (35:21)
I think most of and names of animals in Spanish
Are longer than in English,
so if you have one minute probably you could produce more items in Spanish, but you have this one minute limit, so probably that is not allowing you to express more. So that’s why we decided to extend it to two minutes to give the opportunity to equalize these different differences in terms of how long it takes you to pronounce the name of the animal.
Dr. Jeremy Sharp (35:53)
I see. Yeah. So who would be the or what’s the I would say ideal clinical application of the MUNS?
Alberto Fernandez (36:02)
basically we are expecting to cover two populations. Well the months was designed specifically for those environments in which neuropsychology is not well established and so people don’t have
appropriate tools. They don’t have local tests or adapted tests. So the months could be a way to easily translate a test without much difficulty and the because the univers the stimuli are culturally fair, that that shouldn’t be a problem.
And the second population is in those countries in which a neuropsychology is well established to be applied with immigrants. So, for
Dr. Jeremy Sharp (36:46)
Mm-hmm.
Alberto Fernandez (36:46)
example, here in the US, you have to test someone from a very different culture, that person does not speak English very well. So, well, you can translate the instrument into the language of the patient and then give it in that
in that language. Of course you need a translator for that, person who are able a person who is able to to give the test in that language.
But that those would be the main targets.
Dr. Jeremy Sharp (37:20)
That makes sense. Yeah. The since you bring up the translation component, how amenable is the MUNS to translate it to being translated, if need be?
Alberto Fernandez (37:33)
Well we we already have several translations done. We have a well we have a in English, Spanish, we have a version in Africans, we have a version in Polish. we are working on a version in Portuguese and so on. it is quite easy to translate, Jeremy. because the instructions are very simple and
Dr. Jeremy Sharp (37:55)
Mm-hmm.
Alberto Fernandez (37:55)
So we the translation is it’s not really a big big deal. probably translating the manuals will take more
time if the administrator can’t speak English, for example, can cannot understand English, so you will have to translate. We’re working actually now on a translation to Chichegua, which is a an language and spoken in Malawi in Africa because we are planning to collect data there. So
Dr. Jeremy Sharp (38:25)
Mm-hmm, mm-hmm.
Alberto Fernandez (38:26)
the translation is is pretty easy to do.
Dr. Jeremy Sharp (38:30)
Yeah, that’s great to hear.
You know, we talked a bit about this this question. I I feel like this comes up anytime I wade into the broad topic of culturally fair assessment or multicultural assessment, you know. y’all have done a lot with this measure, it seems like to make it widely accessible, which is fantastic. but I still, you know, I always have this question, you know, of when we’re maybe we
we don’t have the appropriate measures or it doesn’t quite fit, you know, is basically like is something better than nothing in the assessment world, right? Like are we better off yeah trying to adapt what we do have, even if it’s like clunky or or not? I’d love to get your thoughts on
Alberto Fernandez (39:12)
Yes, thank you for the question. when you have a patient in front of you, you have to come up with a an answer. You just can say, Well, I can’t do anything for you. I don’t have
Dr. Jeremy Sharp (39:23)
Yeah.
Alberto Fernandez (39:23)
appropriate tools. I’m sorry I cannot do anything for you. so in many cases the the answers that we could provide and the services that we will be able to provide will be
less than the ideal of course, and they will not meet the standards that you can have in other situations where the tools are appropriate for the patient in terms of cultural appropriateness. but you could have a a range of different situations in in
between something very inappropriate and something like absolutely appropriate.
I would say that most neuropsychologists will rely on using cognitive tests, using psychometric tests, because it reduces a lot of subjective judgments, because it usually we feel more secure when we use these numbers and these tools.
Dr. Jeremy Sharp (40:22)
True. Mm-hmm.
Alberto Fernandez (40:25)
But of course, if the instrument is not really appropriate, you have to be very careful in the interpretations of the numbers. And many of the other, it’s not just about the instrument, but the whole situation of the assessment. How is the communication between the patient and the professional? How is the report between them?
the approach of the patient to this examination, which is usually unusual for them. So there’s a a lot of other variables to consider the language communication language proficiency of the patient, if if they understand the language of the professional, if there are
interpreters involved or not. So there’s a lot of other variables that you should consider beyond testing. But I think using testing has that that main advantage that it’s much more objective. however that being said in some cases
This could be very inappropriate, applying it applying the test would be very inappropriate because if you are dealing with a person who’s has very few years of education, come from a very different culture where they are not used to be tested or they’re not used to psychometric procedures, well trying to apply a test could be much more misleading.
Than using a test. So in those cases, probably the best option is to resort to behavioral assessment, trying to come up with different ways to assess the cognitive ability of the patient. And the risk there is that that requires a lot of training and that requires a lot of knowledge.
And you
Dr. Jeremy Sharp (42:20)
Mm-hmm.
Alberto Fernandez (42:21)
are still using some kind of internal measure to determine
if this behavior is within the normal range or not. so
Dr. Jeremy Sharp (42:32)
Right.
Alberto Fernandez (42:34)
i i it entails a lot of risks.
Dr. Jeremy Sharp (42:38)
Yeah, I mean you anticipated my question there. Yeah, which is, you know, how do we gauge what’s appropriate or not? And like you said, there’s there’s still a lot of internal subjectivity, it sounds like. Are there I mean, are there any any structured or formal strategies that you engage in or suggest that people engage in, you know, and trying to trying to make that call, or is it truly just subjective and we do our best?
Alberto Fernandez (43:03)
Well,
yeah, unfortunately I think is a is a judgment called. and i it has to do with the information you get in in your interview and how you see this patient. That there are so many variables in between, Jeremy.
first as I told you be first before what is the approach of a person to the the whole process, if they’re willing to do it, if they trust you, if they or not, if they see if they see any value in this procedure. because some people may think that it’s just western medicine and they don’t trust it.
Dr. Jeremy Sharp (43:38)
Mm-hmm.
Alberto Fernandez (43:40)
If they understand, I mean the the language portion of this situation, how well they can understand each other if the person is really able to follow the instructions for for some basic test. So all these variables need to be considered, and unfortunately, I don’t think there’s a blueprint for that. but I think the main judgment is
is if I give psychometric tests, are these information going to be reliable enough to make some judgments about the cognitive performance of a person? And and I think and probably you could try to give them some tests and see what happens. And maybe you s you find that that information is not
reliable and you have to discard it.
Dr. Jeremy Sharp (44:34)
Sure. Sure.
Alberto Fernandez (44:36)
Yeah, I mean it’s a
Dr. Jeremy Sharp (44:38)
It’s a tough question. Yeah.
Alberto Fernandez (44:39)
It’s a
yeah, it’s a tough question and unfortunately I don’t think there is a specific formula for that.
Dr. Jeremy Sharp (44:46)
Yeah, yeah. That’s all right. I’m a concrete person. I’m always looking for formulas and black and white rules and they’re just not there all.
So I’ll keep zooming out. I feel like we started you know, kind of micro and talking about test development and you know, in the months and whatnot, but we’ll keep zooming out and I have a question around just like cross cultural neuropsych research in in general. So I think historically, at least my understanding is that a lot of the research is focused on differences between cultural groups. But again, my understanding is that you’re maybe more of an advocate for cross cultural
Equivalency or similarities, maybe. Can you talk through that a bit and what led you to advocate for that approach?
Alberto Fernandez (45:29)
Yes, and and your perception is right. Your perception is correct. Yes.
Dr. Jeremy Sharp (45:32)
Yeah, okay. Sure.
Alberto Fernandez (45:36)
well I think initially twenty, twenty-five years ago, thirty years ago, neuropsychology n needed to focus on differences because probably neuropsychologists most neuropsychologists didn’t think about cultural influence.
And they
Dr. Jeremy Sharp (45:53)
Yeah.
Alberto Fernandez (45:54)
they didn’t think that this was an issue. It was a variable that would be affecting their pr the their practices. So the focus was very much on showing that there are differences and recognizes recognizing these differences. But over time, I think that’s already established.
And we and I think we cannot just base the practice on recognized differences and because of on many of the things that we have talked about before. developing local tools, developing normative data.
developing a local neuropsychology is not realistic in many settings,
Dr. Jeremy Sharp (46:35)
Mm-hmm.
Alberto Fernandez (46:36)
in many environments, because
Dr. Jeremy Sharp (46:38)
Mm-hmm.
Alberto Fernandez (46:38)
there are no resources. There’s that’s not that’s not possible. Simply you don’t have the financial resources or the human resources. So in my opinion if we continue insisting on developing local normative data
the the the field is not gonna
Especially you’re not gonna be able to provide any solution to the people consulting your psychologists because you don’t you didn’t have it you didn’t have the normative data twenty years ago and you don’t have them now. what means the it’s obvious that it
There has been some growth, there have been there has been some improvement over time, but it’s really far from what we need. So my position then is rather than keep insisting on finding difficulties, why don’t we try to find the commonalities across cultures and try to come up with culturally fair instruments
Dr. Jeremy Sharp (47:43)
Yeah.
Alberto Fernandez (47:44)
and culturally fair normative data.
I I actually have submitted a paper with that proposal to the scientific journal
Dr. Jeremy Sharp (47:53)
Yeah.
Alberto Fernandez (47:54)
and based on this and other arguments why it is possible to develop some cross-cultural normative data.
Of course, there is no perfect instrument and that is not the perfect solution and it probably won’t be appropriate for many situations. Like for example, if you have to test a patient for a fascia, you need tests heavy you need to test language heavily and you need
And you cannot create a cross-cultural test for a phasure because the languages vary so much. So
Dr. Jeremy Sharp (48:30)
Mm.
Alberto Fernandez (48:31)
this approach won’t be useful in that situation. but at least if you have other instruments that that can cover cross-cultural memory attention, executive functions, construction practice, at least to a certain degree, that’s better than nothing.
That’s better than just applying tests that were not created for that for that capture or trying to run adaptations that are never ended.
it there are books. there is a book by some colleagues in South Africa about cross-cultural normative data in Africa. They made a beautiful work and very ex extense research trying to collect different normative data. And for the most part they were able to collect I think that normative data for the six sixteen countries
out of 52 and normative data for some specific tests and some of them were are not even normative data are data from a control group so that’s
Dr. Jeremy Sharp (49:37)
Mm-hmm.
Alberto Fernandez (49:37)
how difficult it is and that’s just one region of the world
Dr. Jeremy Sharp (49:41)
Right.
Alberto Fernandez (49:42)
so that’s why I think that approach is not really
fruitful.
We have been trying that approach for more than 20 years and the progress is so slow. that’s that’s why I I’m thinking we need to come up with a different approach. Even when we won’t have a perfect instrument instruments of
to test everything or every cognitive function we want to, I think that would be better than the the current situation.
Dr. Jeremy Sharp (50:17)
Yeah, that’s fair. I mean, you’re right. It sounds it’s a huge undertaking, but worthwhile. That sounds very worthwhile.
Alberto Fernandez (50:21)
Mm-hmm.
Dr. Jeremy Sharp (50:22)
Yeah. As we start to a close here, I would love to get your thoughts just on the direction of the field over the next, you know, three, five, ten years, you know, if we’re thinking about cross cultural assessment. Like where do you where do you see the field headed? Where do see the research headed as we move ahead?
Alberto Fernandez (50:41)
That’s a very good question and a very difficult
Dr. Jeremy Sharp (50:42)
Yeah.
Alberto Fernandez (50:43)
one to answer, Jeremy. ’cause I think it’s just very closely related to my l last answer.
Dr. Jeremy Sharp (50:52)
Mm-hmm.
Alberto Fernandez (50:53)
personally I am working on again and on and I I’m not the only one, by the way. I mean there are other colleagues working in this direction, trying to come up with
cross cultural instruments that can be applied in different settings. But there are other there is another sector, another group of neuropsychologists who don’t agree with this approach. So in those cases there is a still
direction towards the finding the differences. so
Dr. Jeremy Sharp (51:25)
I see.
Alberto Fernandez (51:26)
hopefully I think the field will evolve to I I think there’s there’s been a lot of research in in trying to come up with culturally appropriate tests or adapting tests. I think that’s the what
most research has been focused on in the last years. And I think that that is the
the future. The other things that I think are growing up is this is becoming people are becoming increasingly aware of these situations and how much they need how much is needed in terms of training. So how much training cultural training neuropsychologists need.
They need to be aware of these difficulties. I think that is where the the field is heading this these days. And hopefully I would like to see development trying to understand much more precisely what the contribution of different cultural variables are.
The contributions in terms of how much can these different cultural variables affect the assessment process, including testing. Like for example, the different cultural values. there’s a lot of anecdotal information in terms of that. How much is the the influence of language?
when you have to perform a task. If you speak a different language than me, is it is it expected that you will have a better or a worse performance than me based on that? There is some information on that, but I think we need much more than that. and many other variables that would be very long to to list here. but that’s
Dr. Jeremy Sharp (53:17)
Course.
Alberto Fernandez (53:18)
that’s more wishful thinking.
Probably.
Dr. Jeremy Sharp (53:22)
Hey, that’s where all the good good work starts, I think, is wishful thinking. You know, we gotta dream a little bit and then it may take a while to become reality, but
Alberto Fernandez (53:30)
Yeah.
Dr. Jeremy Sharp (53:32)
that’s how it goes. Yeah. Yeah. I appreciate all these thoughts and you know, I appreciate the rich conversation and I feel like we we covered a lot and hopefully this has been has been helpful for folks. If they would like to, you know, find more of your work or even reach out, get in touch, what’s what’s the best way to do that?
Alberto Fernandez (53:50)
they can email me. I will give you all the information.
Dr. Jeremy Sharp (53:54)
Sure.
Alberto Fernandez (53:55)
A lot of my papers you can find them on ResearchGate or Google Scholar. but if you want to reach out to me and and have a direct consultation then just need to email me. That would be the easiest way.
Dr. Jeremy Sharp (54:11)
Fantastic. Yeah. And we’ll make sure to put that in the show notes if you’re comfortable sharing. Yeah.
Alberto Fernandez (54:15)
Yeah, sure. Absolutely.
Dr. Jeremy Sharp (54:17)
Great. Well, I really appreciate it. Yeah. Thanks for thanks for a rich discussion and just for the time, you know, to share your expertise with us today.
Alberto Fernandez (54:25)
Thank you very much, Jeremy, for having me and it’s been a a real pleasure to share this information with you and the audience.
Dr. Jeremy Sharp (54:34)
Fantastic, yeah.
Take care, Alberto.
Click here to listen to the podcast instead.
