On "Some factors predict successful short-term outcomes..." Mintken PE, Cleland JA, Carpenter KJ, et al. Phys Ther. 2010;90:26-42/Author Response
The problem is that these phantom degrees of freedom usually are forgotten when computing the standard errors and P values, resulting in data that often are too good to be true.2,3 Cohen et al2 recommended that all predictor variables considered for inclusion at the beginning of a study also should...
Saved in:
Published in | Physical therapy Vol. 90; no. 4; p. 643 |
---|---|
Main Authors | , , , , , , , |
Format | Journal Article |
Language | English |
Published |
Washington
Oxford University Press
01.04.2010
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | The problem is that these phantom degrees of freedom usually are forgotten when computing the standard errors and P values, resulting in data that often are too good to be true.2,3 Cohen et al2 recommended that all predictor variables considered for inclusion at the beginning of a study also should be included when running the regression model, meaning not just the variables that were selected by the computer program. A common problem that often occurs later when computing regression coeffi cients is that the phantom degrees of freedom are forgotten, resulting in overfi tting of the data.2-7 Overfi tting occurs when a researcher uses too many predictor variables (46 in this study) with too few study participants.3 The recommended ratio of number of participants (n) to predictor variables (k) when running a normal (simultaneous or forced) regression usually is 15-20/1.7 When running a stepwise regression, most statistical experts recommend an n/k value of no less than 40/1.2.7 For logistic regression, which Mintken and colleagues used in their study, Peduzzi et al6 advocated an events-per-variable (EPV) value greater than 10, where the EPV value is the number of successful outcomes versus nonsuccessful outcomes divided by the number of predictor variables. Not taking these phantom degrees of freedom into account often will create a number-to-predictor (n/k) ratio that is highly infl ated, thereby making the ratio look better than it really is.3 Overfi tting can create signifi cant validity problems, in that the results of the study may be valid only for the particular sample that was used.3 Therefore, in studies where a clinical prediction rule is developed, care must be taken when applying rules from overfi tted samples to the population. |
---|---|
AbstractList | The problem is that these phantom degrees of freedom usually are forgotten when computing the standard errors and P values, resulting in data that often are too good to be true.2,3 Cohen et al2 recommended that all predictor variables considered for inclusion at the beginning of a study also should be included when running the regression model, meaning not just the variables that were selected by the computer program. A common problem that often occurs later when computing regression coeffi cients is that the phantom degrees of freedom are forgotten, resulting in overfi tting of the data.2-7 Overfi tting occurs when a researcher uses too many predictor variables (46 in this study) with too few study participants.3 The recommended ratio of number of participants (n) to predictor variables (k) when running a normal (simultaneous or forced) regression usually is 15-20/1.7 When running a stepwise regression, most statistical experts recommend an n/k value of no less than 40/1.2.7 For logistic regression, which Mintken and colleagues used in their study, Peduzzi et al6 advocated an events-per-variable (EPV) value greater than 10, where the EPV value is the number of successful outcomes versus nonsuccessful outcomes divided by the number of predictor variables. Not taking these phantom degrees of freedom into account often will create a number-to-predictor (n/k) ratio that is highly infl ated, thereby making the ratio look better than it really is.3 Overfi tting can create signifi cant validity problems, in that the results of the study may be valid only for the particular sample that was used.3 Therefore, in studies where a clinical prediction rule is developed, care must be taken when applying rules from overfi tted samples to the population. |
Author | Carpenter, Kristin J Bieniek, Melanie L Harrell, Frank E Cleland, Joshua A Mintken, Paul E Keirns, Mike Cibulka, Michael T Whitman, Julie M |
Author_xml | – sequence: 1 givenname: Michael surname: Cibulka middlename: T fullname: Cibulka, Michael T – sequence: 2 givenname: Frank surname: Harrell middlename: E fullname: Harrell, Frank E – sequence: 3 givenname: Paul surname: Mintken middlename: E fullname: Mintken, Paul E – sequence: 4 givenname: Joshua surname: Cleland middlename: A fullname: Cleland, Joshua A – sequence: 5 givenname: Kristin surname: Carpenter middlename: J fullname: Carpenter, Kristin J – sequence: 6 givenname: Melanie surname: Bieniek middlename: L fullname: Bieniek, Melanie L – sequence: 7 givenname: Mike surname: Keirns fullname: Keirns, Mike – sequence: 8 givenname: Julie surname: Whitman middlename: M fullname: Whitman, Julie M |
BookMark | eNqNjM1KAzEUhYNUcKq-w2XWnZifse3oqpSKVKSldl_C9A7TmiZjbrLwMXxjs_ABXBzOge_jjNnIeYdXrJCPel5NZ6oesUIILatGKH3DxkRnIYSc1U3BfjYOyg9_QehMG30gGAIeT20ESm2LRF2yQL0PsYoYLuBTbLNNnPMS3k8ufqKD7WoCS4vWuCOsF3mbMKDLPrytJ4ARjOWw7b8J9j0GDkpI8dyIJzWtavWwSDH_ww5p8I7wjl13xhLe__UtK19W--VrNQT_lZDi4exTcBkdlNIyp57rf0m_wh1UDw |
ContentType | Journal Article |
Copyright | Copyright AMERICAN PHYSICAL THERAPY ASSOCIATION Apr 2010 |
Copyright_xml | – notice: Copyright AMERICAN PHYSICAL THERAPY ASSOCIATION Apr 2010 |
DBID | 3V. 7RQ 7RV 7TS 7X7 7XB 88C 88E 88I 8AO 8FI 8FJ 8FK 8G5 ABUWG AFKRA AZQEC BEC BENPR CCPQU DWQXO FYUFA GHDGH GNUQQ GUQSH HCIFZ K9- K9. KB0 M0R M0S M0T M1P M2O M2P MBDVC NAPCQ PQEST PQQKQ PQUKI PRINS Q9U S0X U9A |
DatabaseName | ProQuest Central (Corporate) ProQuest Career & Technical Education Database ProQuest Nursing & Allied Health Database Physical Education Index ProQuest Health & Medical Collection ProQuest Central (purchase pre-March 2016) Healthcare Administration Database (Alumni) Medical Database (Alumni Edition) Science Database (Alumni Edition) ProQuest Pharma Collection Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) Research Library (Alumni Edition) ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials eLibrary AUTh Library subscriptions: ProQuest Central ProQuest One Community College ProQuest Central Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student Research Library Prep SciTech Premium Collection Consumer Health Database ProQuest Health & Medical Complete (Alumni) Nursing & Allied Health Database (Alumni Edition) Family Health Database (Proquest) Health & Medical Collection (Alumni Edition) Health Management Database (Proquest) PML(ProQuest Medical Library) ProQuest research library ProQuest Science Journals Research Library (Corporate) Nursing & Allied Health Premium ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China ProQuest Central Basic SIRS Editorial |
DatabaseTitle | Research Library Prep ProQuest Central Student ProQuest Central Essentials SIRS Editorial elibrary ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College Research Library (Alumni Edition) ProQuest Pharma Collection ProQuest Family Health (Alumni Edition) ProQuest Central China Physical Education Index ProQuest Central Health Research Premium Collection Health and Medicine Complete (Alumni Edition) ProQuest Central Korea ProQuest Research Library ProQuest Medical Library (Alumni) Career and Technical Education (Alumni Edition) ProQuest Science Journals (Alumni Edition) ProQuest Central Basic ProQuest Science Journals ProQuest Family Health ProQuest One Academic Eastern Edition ProQuest Health Management ProQuest Nursing & Allied Health Source ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Hospital Collection (Alumni) Nursing & Allied Health Premium ProQuest Career and Technical Education ProQuest Health & Medical Complete ProQuest Medical Library ProQuest One Academic UKI Edition ProQuest Health Management (Alumni Edition) ProQuest Nursing & Allied Health Source (Alumni) ProQuest One Academic ProQuest Central (Alumni) |
DatabaseTitleList | Research Library Prep |
Database_xml | – sequence: 1 dbid: BENPR name: AUTh Library subscriptions: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Physical Therapy |
EISSN | 1538-6724 |
ExternalDocumentID | 2007002991 |
Genre | Commentary |
GroupedDBID | --- -~X .55 04C 0R~ 123 18M 1HT 1TH 29O 2QV 2WC 36B 3EH 3V. 48X 5RE 5VS 5WD 6NX 6PF 7K8 7RQ 7RV 7TS 7X7 7XB 85S 88E 88I 8AO 8FI 8FJ 8FK 8G5 8GL 8R4 8R5 AABZA AACZT AAOGT AAPQZ AAPXW AARHZ AAUAY AAVAP AAWTL ABDBF ABJNI ABNHQ ABPQP ABPTD ABQNK ABUWG ABWST ABXVV ACFRR ACGFO ACGFS ACGOD ACIHN ACYHN ADBBV ADGZP ADHKW ADIPN ADOJX ADQBN ADRTK ADVEK AEAQA AEMDU AENEX AENZO AETBJ AEWNT AFFZL AFKRA AFOFC AFXAL AGINJ AGQXC AGUTN AHMBA AJEEA ALIPV ALMA_UNASSIGNED_HOLDINGS APIBT AQUVI ATGXG AZQEC BAWUL BAYMD BCGST BCR BCRHZ BCU BEC BENPR BES BEYMZ BKEYQ BKNYI BKOMP BLC BMSDO BPHCQ BTRTY BVXVI CCPQU CDBKE CS3 DAKXR DU5 DWQXO DXH E3Z EAP EAS EBB EBC EBD EBS EBX ECF ECT EHN EIHBH EJD EMB EMK EMOBN ENB ENC ENERS ENX EPL ESX EVS EX3 F5P FD6 FECEO FLUFQ FOEOM FOTVD FQBLK FYUFA GAUVT GICCO GJXCC GNUQQ GUQSH GX1 H13 HCIFZ HF~ HMCUK IAO IBB IEA IGG IHR IHW IMI INH INR IOF IPO IPT IRD ISE ISN ISR ITC ITF ITG ITH IVC K9- K9. KBUDW KOP KQ8 KSI KSN L7B M0R M0T M1P M2O M2P MBDVC MHKGH N4W NAPCQ NOMLY NOYVH NVLIB O9- OAUYM OCZFY ODMLO OHT OJZSN OK1 OPAEJ OWPYF P2P PAFKI PCD PEA PEELM PQEST PQQKQ PQUKI PRINS PROAC PSQYO Q2X Q9U RHF ROX ROZ RUSNO S0X SJFOW SJN SV3 TJX TPT TR2 TUS TWZ U5U U9A UHB UKHRP VQP W8F WH7 WOQ WOW WQ9 X6Y X7M YAYTL YCJ YKOAZ YNT YXANX ZT4 |
ID | FETCH-proquest_journals_2231223483 |
IEDL.DBID | BENPR |
ISSN | 0031-9023 |
IngestDate | Thu Oct 10 19:05:53 EDT 2024 |
IsPeerReviewed | false |
IsScholarly | false |
Issue | 4 |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-proquest_journals_2231223483 |
PQID | 223122348 |
PQPubID | 40771 |
ParticipantIDs | proquest_journals_223122348 |
PublicationCentury | 2000 |
PublicationDate | 20100401 |
PublicationDateYYYYMMDD | 2010-04-01 |
PublicationDate_xml | – month: 04 year: 2010 text: 20100401 day: 01 |
PublicationDecade | 2010 |
PublicationPlace | Washington |
PublicationPlace_xml | – name: Washington |
PublicationTitle | Physical therapy |
PublicationYear | 2010 |
Publisher | Oxford University Press |
Publisher_xml | – name: Oxford University Press |
SSID | ssj0001749 |
Score | 3.222971 |
Snippet | The problem is that these phantom degrees of freedom usually are forgotten when computing the standard errors and P values, resulting in data that often are... |
SourceID | proquest |
SourceType | Aggregation Database |
StartPage | 643 |
SubjectTerms | Carpal tunnel syndrome Physical therapy Validation studies Variables |
Title | On "Some factors predict successful short-term outcomes..." Mintken PE, Cleland JA, Carpenter KJ, et al. Phys Ther. 2010;90:26-42/Author Response |
URI | https://www.proquest.com/docview/223122348 |
Volume | 90 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NT8JAEN0IXLz4bVSUTIhHCoVut60eDBIIgYCImHAj7XYbjdhiP36I_9idduHggUOTNk262dntm-m81zxC7pnj6pYjPM3uBFyTm4LjO2dq3BFcZlwWeHlDfzJlw3c6WppLpc1JlKxyi4k5UPsRxx55S6axtjyo_bT50dA0CslV5aBRIpVOmyJLW3nuT2fzHRTLcruofw3UIaAl0T_AzbPI4IQcqfIPusV6nZIDEZ6R45kKFiyKf_zPye9LCPW36FuAMsSBTYyUSgpJllscBtkakg9ZO2uIrRBlqZyG_OhtNusw-QzTLxHCrN-A3lqgdhFGXXmOXAsGEsajBogUZN0NOHY-bhOQsn509IcOk-FsYfMsimFeiGjFBakP-oveUNtObaW2YbLaBc24JOUwCsUVAd03mctMGvi6S5lBXeoLh_ncsDxmc1Nck-qeB93svVslhwW7jsqWW1JO40zcyaSdejVSspZWTS2QvBq_2n8gEp6V |
link.rule.ids | 315,786,790,12083,21416,31752,33777,43343,43838,74100,74657 |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LT8JAEJ4oHvTi26j4mBCPFCrdLlQPhhAI8pIoJtxIu91GI7ZI2x_iP3anXTh44NBkkybd7OzszOx8X_MB3HHHNeuO9IxGLRCGcgpBZ842hCOFyrg88LKG_nDEu--sN7WnmpsTa1rlKiZmgdqPBPXIqyqN3auHNZ4WPwaJRhG4qhU0tmGHWRYjN69P1_ct5Wu6-rWIhUCCRP_CbZZDOoewr4s_bOa7dQRbMjyGg7E2FU7yP_xP4PclxNJb9C1Ry-HgYkmASoJxmgkcBukc4w9VORsUWTFKE7UIdeWtVEo4_AyTLxniuF3G1lwScxF7TTUmpIXMiP1eGWWCqupGmjubt4IEWD865kONK2NWqXUWLfE1p9DKUyh12pNW11gtbaadMJ6tTWadQSGMQnkOaPo2d7nNAt90GbeYy3zpcF9YdY83hC0voLjhQ5cb397CbncyHMwGz6N-EfZynJ04LldQSJapvFbpO_Fusk36A42EnkA |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LT8JAEJ4oJsaLb6PiY0I8Uqi0XageDEEIgiBRTLiRdruNRm2Rlh_iP3amXTl44NCkSZNud2Z2Znbm634AV8L1zLqrfKNRC6VBRiF5zTmGdJWkiCtCPyvoD4ai-2r3Js5EHymUaFjln0_MHHUQS66RVymMXdNlN6qhRkWM7jt3s2-DCaS40arZNNZhg4KkySwO9cly70V2pzNhixEJTE70z_Vm8aSzC9s6EcRmrrk9WFPRPuyMtNhwnP_tfwA_TxGWXuIvhZoaB2dzbq6kmCwyskP6UEzeKIs22MtivEhpQrT9rVRKOHiP0g8V4ahdxtanYhQj9pp0z10XFin2e2VUKVIGjjx2Nm4FuXl965o3NUGCrXIZLZ7jcw6nVYdQ6rTHra7xN7WpNshkuhSfdQSFKI7UMaAZOMITjh0GpmcLy_bsQLkikFbdFw3pqBMornjR6cqnl7BJ-pk-Pgz7RdjKW-4MdzmDQjpfqHOK5Kl_kenoF1Nnomw |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=On+%22Some+factors+predict+successful+short-term+outcomes...%22+Mintken+PE%2C+Cleland+JA%2C+Carpenter+KJ%2C+et+al.+Phys+Ther.+2010%3B90%3A26-42%2FAuthor+Response&rft.jtitle=Physical+therapy&rft.au=Cibulka%2C+Michael+T&rft.au=Harrell%2C+Frank+E&rft.au=Mintken%2C+Paul+E&rft.au=Cleland%2C+Joshua+A&rft.date=2010-04-01&rft.pub=Oxford+University+Press&rft.issn=0031-9023&rft.eissn=1538-6724&rft.volume=90&rft.issue=4&rft.spage=643&rft.externalDBID=HAS_PDF_LINK&rft.externalDocID=2007002991 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0031-9023&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0031-9023&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0031-9023&client=summon |