Therapist perceptions of their own measurement-based, problem-specific effectiveness

Patient-reported outcomes data reveal differences both in therapists' global effectiveness across their average patient (between-therapist effect) and in treating different problems within their caseload (within-therapist effects). Yet, it is unclear how accurately therapists perceive their own...

Full description

Saved in:
Bibliographic Details
Published inJournal of consulting and clinical psychology Vol. 91; no. 8; p. 474
Main Authors Constantino, Michael J, Boswell, James F, Coyne, Alice E, Muir, Heather J, Gaines, Averi N, Kraus, David R
Format Journal Article
LanguageEnglish
Published United States 01.08.2023
Subjects
Online AccessGet more information
ISSN1939-2117
DOI10.1037/ccp0000813

Cover

Loading…
Abstract Patient-reported outcomes data reveal differences both in therapists' global effectiveness across their average patient (between-therapist effect) and in treating different problems within their caseload (within-therapist effects). Yet, it is unclear how accurately therapists perceive their own measurement-based, problem-specific effectiveness and whether such self-perceptions predict global between-therapist performance differences. We explored these questions in naturalistic psychotherapy. For 50 therapists, we drew on data from a mean of 27 past patients (total = 1,363) who completed a multidimensional outcome measure-Treatment Outcome Package (TOP)-at pre- and posttreatment. For each of 12 outcome domains (e.g., depression, anxiety), TOP data classified therapists as historically "effective," "neutral," or "ineffective." Unaware of their data-driven classifications, therapists rated their perceived effectiveness for each domain. We conducted chi-square analyses to determine whether therapists predicted their own measurement-based effectiveness classifications to a level greater than chance. We then used multilevel modeling to test whether therapists' problem-specific perceptions predicted global between-therapist performance differences. For all but one outcome domain, therapists were no better than chance at predicting their measurement-based effectiveness classification. Additionally, controlling for patient baseline impairment, therapists who consistently overestimated their problem-specific effectiveness had patients who reported worse global outcomes than patients whose therapist more accurately estimated their effectiveness. Conversely, therapists who underestimated their problem-specific effectiveness had patients who reported better outcomes than patients whose therapist over- or accurately estimated their effectiveness. Therapist humility may differentiate the most from least globally effective therapists, and this virtue should be cultivated in clinical trainings. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
AbstractList Patient-reported outcomes data reveal differences both in therapists' global effectiveness across their average patient (between-therapist effect) and in treating different problems within their caseload (within-therapist effects). Yet, it is unclear how accurately therapists perceive their own measurement-based, problem-specific effectiveness and whether such self-perceptions predict global between-therapist performance differences. We explored these questions in naturalistic psychotherapy. For 50 therapists, we drew on data from a mean of 27 past patients (total = 1,363) who completed a multidimensional outcome measure-Treatment Outcome Package (TOP)-at pre- and posttreatment. For each of 12 outcome domains (e.g., depression, anxiety), TOP data classified therapists as historically "effective," "neutral," or "ineffective." Unaware of their data-driven classifications, therapists rated their perceived effectiveness for each domain. We conducted chi-square analyses to determine whether therapists predicted their own measurement-based effectiveness classifications to a level greater than chance. We then used multilevel modeling to test whether therapists' problem-specific perceptions predicted global between-therapist performance differences. For all but one outcome domain, therapists were no better than chance at predicting their measurement-based effectiveness classification. Additionally, controlling for patient baseline impairment, therapists who consistently overestimated their problem-specific effectiveness had patients who reported worse global outcomes than patients whose therapist more accurately estimated their effectiveness. Conversely, therapists who underestimated their problem-specific effectiveness had patients who reported better outcomes than patients whose therapist over- or accurately estimated their effectiveness. Therapist humility may differentiate the most from least globally effective therapists, and this virtue should be cultivated in clinical trainings. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Author Constantino, Michael J
Gaines, Averi N
Boswell, James F
Muir, Heather J
Coyne, Alice E
Kraus, David R
Author_xml – sequence: 1
  givenname: Michael J
  orcidid: 0000-0003-3126-2575
  surname: Constantino
  fullname: Constantino, Michael J
  organization: Department of Psychological and Brain Sciences, University of Massachusetts Amherst
– sequence: 2
  givenname: James F
  orcidid: 0000-0001-6214-0787
  surname: Boswell
  fullname: Boswell, James F
  organization: Department of Psychology, University at Albany, State University of New York
– sequence: 3
  givenname: Alice E
  orcidid: 0000-0002-5950-0486
  surname: Coyne
  fullname: Coyne, Alice E
  organization: Department of Psychological Sciences, Case Western Reserve University
– sequence: 4
  givenname: Heather J
  surname: Muir
  fullname: Muir, Heather J
  organization: Department of Psychological and Brain Sciences, University of Massachusetts Amherst
– sequence: 5
  givenname: Averi N
  orcidid: 0000-0001-5856-7059
  surname: Gaines
  fullname: Gaines, Averi N
  organization: Department of Psychological and Brain Sciences, University of Massachusetts Amherst
– sequence: 6
  givenname: David R
  surname: Kraus
  fullname: Kraus, David R
  organization: Outcome Referrals Inc
BackLink https://www.ncbi.nlm.nih.gov/pubmed/37104803$$D View this record in MEDLINE/PubMed
BookMark eNo1j81KAzEYRYMo9kc3PoDkAUxNJplJspRiVSh0M65LkvlCI51MSFLFt7eg3s2BszhwF-gyThEQumN0xSiXj84lep5i_ALNmeaaNIzJGVqU8nH2rKPtNZpxyahQlM9R3x8gmxRKxQmyg1TDFAuePK4HCBlPXxGPYMopwwixEmsKDA845ckeYSQlgQs-OAzeg6vhEyKUcoOuvDkWuP3jEr1vnvv1K9nuXt7WT1tiuNSVSA_SQSdEo4QQygzaaqq8Ys53ovXUctVaGIxsteHAZKMp5ZoZ6KzhnRiaJbr_7aaTHWHYpxxGk7_3__eaH_iLUjs
CitedBy_id crossref_primary_10_1007_s10488_024_01351_9
crossref_primary_10_1017_S1754470X24000321
crossref_primary_10_1080_28324765_2024_2305405
crossref_primary_10_1080_28324765_2023_2277920
crossref_primary_10_1080_28324765_2024_2379248
crossref_primary_10_1007_s10488_023_01302_w
crossref_primary_10_1080_10503307_2023_2262099
crossref_primary_10_1080_10503307_2024_2352735
crossref_primary_10_1007_s10488_024_01360_8
crossref_primary_10_1080_10503307_2024_2310635
ContentType Journal Article
DBID CGR
CUY
CVF
ECM
EIF
NPM
DOI 10.1037/ccp0000813
DatabaseName Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
DatabaseTitle MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
DatabaseTitleList MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Psychology
EISSN 1939-2117
ExternalDocumentID 37104803
Genre Journal Article
GrantInformation_xml – fundername: American Psychological Association; Society for the Advancement of Psychotherapy (Division 29)
– fundername: Patient-Centered Outcomes Research Institute (PCORI)
GroupedDBID ---
-DZ
-ET
-~X
.-4
.GJ
07C
0R~
186
29K
2FS
354
3EH
53G
5GY
5RE
5VS
6TJ
6TS
7RZ
85S
9M8
AAAHA
AABCJ
AAIKC
AAMNW
AAQQT
AAWTL
ABCQX
ABDPE
ABIVO
ABNCP
ABPPZ
ABVOZ
ACGFO
ACHQT
ACNCT
ACPQG
ACTDY
ADMHG
AEHFB
AETEA
AFFNX
ALMA_UNASSIGNED_HOLDINGS
AWKKM
AZXWR
BKOMP
CGNQK
CGR
CS3
CUY
CVF
D-I
ECM
EIF
EPA
F5P
FTD
HVGLF
HZ~
H~9
ISO
L7B
LPU
LW5
MVM
N4W
NHB
NPM
O9-
OHT
OPA
OVD
P-O
P2P
PHGZT
PQQKQ
ROL
RXW
SES
SKT
SPA
TAE
TEORI
TN5
TWZ
UBC
UHB
UHS
UPT
WH7
XJT
XOL
XZL
YCJ
YHZ
YQT
YR5
YYQ
YZZ
ZCA
ZCG
ZGI
ZHY
ZPI
ID FETCH-LOGICAL-a379t-7fe7ce644284448ad9b908f81cf645f0b385beda759a3e172900391ae6ba364d2
IngestDate Thu Apr 03 07:08:12 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 8
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-a379t-7fe7ce644284448ad9b908f81cf645f0b385beda759a3e172900391ae6ba364d2
ORCID 0000-0002-5950-0486
0000-0003-3126-2575
0000-0001-5856-7059
0000-0001-6214-0787
PMID 37104803
ParticipantIDs pubmed_primary_37104803
PublicationCentury 2000
PublicationDate 2023-08-01
PublicationDateYYYYMMDD 2023-08-01
PublicationDate_xml – month: 08
  year: 2023
  text: 2023-08-01
  day: 01
PublicationDecade 2020
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle Journal of consulting and clinical psychology
PublicationTitleAlternate J Consult Clin Psychol
PublicationYear 2023
SSID ssj0001605
Score 2.5149055
Snippet Patient-reported outcomes data reveal differences both in therapists' global effectiveness across their average patient (between-therapist effect) and in...
SourceID pubmed
SourceType Index Database
StartPage 474
SubjectTerms Anxiety
Humans
Outcome Assessment, Health Care
Professional-Patient Relations
Psychotherapy - methods
Treatment Outcome
Title Therapist perceptions of their own measurement-based, problem-specific effectiveness
URI https://www.ncbi.nlm.nih.gov/pubmed/37104803
Volume 91
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8NAEF5aBelFfL9lD97qapvdJLtHLUoR6qmCt7JJdkHQNmhF6v_w_zr7yMNqQb2EkE1CyDeZ-WYyD4ROhM44mO2McK0pYUpzwoMuJYnIOkyDTWShKXAe3Eb9O3ZzH943Gh-1rKXXaXKWvv9YV_IfVOEY4GqqZP-AbHlTOAD7gC9sAWHY_hbjZ5kDUKb7cJGf4v_6m_D_27j9VMUAibFYFlA_RYaYMkuTKuSzOrziW8BXU1Os-TgtihrLksq8UKFlcL7nOCecOqll5lc_oC4nL0Uutk3SbdcGL898hPURFFhVJTF4fXh2RtISVn8rH6wIaJkqB7bGKVhBBQGnM65rYDevy0sar6lT5ib4fFPzrlFAmuaW8rpi1hre-ZMFnAJ7Yrzzi9W5ltvFUhM1wfkw01RNCMib9y44gEWfWxqfVw_RQivFhXM-iuUqwzW06kHDF05i1lFDjTdQq7R1s000LEUH10QHTzS2ooNBdPA30TnF84KDvwjOFrq7vhr2-sQP2CCSxmJKYq3iVAEjBo4CbrrMRCI6XPNuqiP4RjsJ5WGiMhmHQlIFVFfYgQJSRYmkEcuCbbQ0nozVLsJahqGES8NICxYFsdCB1EkU6G7GBFPBHtpxb2SUuy4qo-Jd7S9cOUCtSoYO0bKGz1YdAQecJscWk0_GvWD7
linkProvider National Library of Medicine
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Therapist+perceptions+of+their+own+measurement-based%2C+problem-specific+effectiveness&rft.jtitle=Journal+of+consulting+and+clinical+psychology&rft.au=Constantino%2C+Michael+J&rft.au=Boswell%2C+James+F&rft.au=Coyne%2C+Alice+E&rft.au=Muir%2C+Heather+J&rft.date=2023-08-01&rft.eissn=1939-2117&rft.volume=91&rft.issue=8&rft.spage=474&rft_id=info:doi/10.1037%2Fccp0000813&rft_id=info%3Apmid%2F37104803&rft_id=info%3Apmid%2F37104803&rft.externalDocID=37104803