Paper or Plastic? Data Equivalence in Paper and Electronic Diaries

Concern has been raised about the lack of participant compliance in diary studies that use paper-and-pencil as opposed to electronic formats. Three studies explored the magnitude of compliance problems and their effects on data quality. Study 1 used random signals to elicit diary reports and found c...

Full description

Saved in:
Bibliographic Details
Published inPsychological methods Vol. 11; no. 1; pp. 87 - 105
Main Authors Green, Amie S, Rafaeli, Eshkol, Bolger, Niall, Shrout, Patrick E, Reis, Harry T
Format Journal Article
LanguageEnglish
Published United States American Psychological Association 01.03.2006
Subjects
Online AccessGet more information

Cover

Loading…
Abstract Concern has been raised about the lack of participant compliance in diary studies that use paper-and-pencil as opposed to electronic formats. Three studies explored the magnitude of compliance problems and their effects on data quality. Study 1 used random signals to elicit diary reports and found close matches to self-reported completion times, matches that could not plausibly have been fabricated. Studies 2 and 3 examined the psychometric and statistical equivalence of data obtained with paper versus electronic formats. With minor exceptions, both methods yielded data that were equivalent psychometrically and in patterns of findings. These results serve to at least partially mollify concern about the validity of paper diary methods.
AbstractList Concern has been raised about the lack of participant compliance in diary studies that use paper-and-pencil as opposed to electronic formats. Three studies explored the magnitude of compliance problems and their effects on data quality. Study 1 used random signals to elicit diary reports and found close matches to self-reported completion times, matches that could not plausibly have been fabricated. Studies 2 and 3 examined the psychometric and statistical equivalence of data obtained with paper versus electronic formats. With minor exceptions, both methods yielded data that were equivalent psychometrically and in patterns of findings. These results serve to at least partially mollify concern about the validity of paper diary methods.
Author Bolger, Niall
Shrout, Patrick E
Rafaeli, Eshkol
Green, Amie S
Reis, Harry T
Author_xml – sequence: 1
  fullname: Green, Amie S
– sequence: 2
  fullname: Rafaeli, Eshkol
– sequence: 3
  fullname: Bolger, Niall
– sequence: 4
  fullname: Shrout, Patrick E
– sequence: 5
  fullname: Reis, Harry T
BackLink http://eric.ed.gov/ERICWebPortal/detail?accno=EJ735350$$DView record in ERIC
https://www.ncbi.nlm.nih.gov/pubmed/16594769$$D View this record in MEDLINE/PubMed
BookMark eNo9j81KAzEUhbOo2B99AEEkLzBjbpJJZlai7fhHwS4U3JWb5BYi02nNTIW-vYVqVwfO-fjgjNmg3bTE2BWIHISytyBKmVVl9ZkD5JCXdsBGp27Ixl33JQRoVepzNgRTVNqaasQeFrilxDeJLxrs-ujv-Ax75PX3Lv5gQ60nHlt-pLANvG7I92nTRs9nEVOk7oKdrbDp6PIvJ-zjsX6fPmfzt6eX6f08Qw2iz6yxQRqvJShUUK3QFSE4o0tjtXIaTZBBobSqACGdBCBXkhOWPAWjA8oJuzl6tzu3prDcprjGtF_-nzkA10eAUvSnuX49KFUh5C8ZNFQz
CitedBy_id crossref_primary_10_1017_S0033291712002279
crossref_primary_10_1002_job_2106
crossref_primary_10_1016_j_schres_2012_06_010
crossref_primary_10_2466_02_04_09_10_16_21_PR0_107_5_425_440
crossref_primary_10_1016_j_beth_2016_06_001
crossref_primary_10_1097_ADM_0000000000000365
crossref_primary_10_1111_j_1475_6811_2008_00194_x
crossref_primary_10_1016_j_ijom_2008_07_005
crossref_primary_10_1017_S0033291710001558
crossref_primary_10_1017_S0033291707002322
crossref_primary_10_1111_j_1475_6811_2008_00204_x
crossref_primary_10_1007_s10902_017_9880_z
crossref_primary_10_1002_job_1934
crossref_primary_10_1080_10615806_2012_657182
crossref_primary_10_1016_j_schres_2012_10_003
crossref_primary_10_1177_0146167206294872
crossref_primary_10_1016_j_ejpain_2009_03_007
crossref_primary_10_1007_s10608_011_9434_3
crossref_primary_10_1017_S0033291711002728
crossref_primary_10_1027_1866_5888_a000009
crossref_primary_10_1371_journal_pone_0199838
crossref_primary_10_1123_japa_2020_0391
crossref_primary_10_1111_j_1600_0447_2008_01263_x
crossref_primary_10_1186_1472_6947_6_42
crossref_primary_10_1111_j_1475_6811_2010_01277_x
crossref_primary_10_1371_journal_pone_0054653
crossref_primary_10_1111_j_1751_9004_2009_00170_x
crossref_primary_10_1016_j_tourman_2025_105141
crossref_primary_10_1111_j_1600_0447_2010_01596_x
crossref_primary_10_4140_TCP_n_2007_472
crossref_primary_10_1002_per_2046
crossref_primary_10_1017_S0033291708004947
crossref_primary_10_1007_s10902_012_9347_1
crossref_primary_10_1024_1661_4747_56_3_169
crossref_primary_10_1016_j_yhbeh_2011_03_003
crossref_primary_10_1080_09658211_2015_1018276
crossref_primary_10_1027_1015_5759_23_4_248
crossref_primary_10_1111_joop_12206
crossref_primary_10_1016_j_brat_2007_11_007
crossref_primary_10_1016_j_addbeh_2019_106146
crossref_primary_10_1007_s10461_016_1359_0
crossref_primary_10_1177_08902070221104636
crossref_primary_10_1027_1016_9040_14_2_153
crossref_primary_10_1177_1073191114540320
crossref_primary_10_1016_j_lisr_2022_101192
crossref_primary_10_1002_per_726
crossref_primary_10_3389_fpsyg_2021_580684
crossref_primary_10_1016_j_psyneuen_2006_10_001
crossref_primary_10_1186_s13104_017_2850_z
crossref_primary_10_1002_job_1803
crossref_primary_10_1080_00222216_2014_11950346
crossref_primary_10_1111_j_1530_0277_2007_00590_x
crossref_primary_10_1108_OIR_11_2021_0593
crossref_primary_10_1097_AJP_0b013e3181965578
crossref_primary_10_1007_s11205_006_9054_6
crossref_primary_10_1002_ab_70019
crossref_primary_10_1017_sjp_2019_6
crossref_primary_10_1002_mar_22206
crossref_primary_10_1007_s11031_007_9068_7
crossref_primary_10_1097_CIN_0000000000000641
crossref_primary_10_1111_j_1540_4560_2011_01712_x
crossref_primary_10_1348_014466510X508677
crossref_primary_10_1007_s10461_007_9206_y
crossref_primary_10_1111_j_1467_6494_2011_00728_x
crossref_primary_10_1016_S1701_2163_16_35018_6
crossref_primary_10_2196_19536
crossref_primary_10_1002_meet_14505001071
crossref_primary_10_1097_AUD_0000000000001071
crossref_primary_10_1093_workar_waw033
crossref_primary_10_21529_RECADM_2023011
crossref_primary_10_1016_j_psychres_2009_10_020
crossref_primary_10_1007_s10865_019_00099_0
crossref_primary_10_1016_j_ijnurstu_2016_02_010
crossref_primary_10_1097_GME_0000000000000685
crossref_primary_10_1111_j_1600_0447_2010_01594_x
crossref_primary_10_1002_da_23043
crossref_primary_10_1371_journal_pone_0062514
crossref_primary_10_1348_096317908X310256
crossref_primary_10_1521_jscp_2010_29_7_797
crossref_primary_10_1093_schbul_sbr186
crossref_primary_10_31363_2313_7053_2022_56_3_97_112
crossref_primary_10_1002_nur_20369
crossref_primary_10_1111_j_1475_6811_2008_00203_x
crossref_primary_10_1007_s10608_018_9941_6
crossref_primary_10_1080_10400410903579601
crossref_primary_10_1111_j_1475_6811_2011_01355_x
crossref_primary_10_1016_j_jarmac_2018_09_002
crossref_primary_10_3389_fpsyg_2019_01097
crossref_primary_10_1080_13854046_2017_1360946
crossref_primary_10_1002_hrm_22240
crossref_primary_10_1111_j_1751_9004_2007_00034_x
crossref_primary_10_1111_jopy_12475
crossref_primary_10_1111_j_1758_0854_2011_01058_x
crossref_primary_10_1016_j_janxdis_2014_09_022
crossref_primary_10_1037_1082_989X_11_1_123
crossref_primary_10_1016_j_appet_2014_06_010
crossref_primary_10_1016_j_jvb_2010_11_007
crossref_primary_10_1111_acps_12078
crossref_primary_10_1111_j_1465_3362_2008_00002_x
crossref_primary_10_1111_j_1530_0277_2009_01115_x
crossref_primary_10_1016_j_cpr_2006_09_005
crossref_primary_10_2486_indhealth_2016_0150
crossref_primary_10_1016_j_healthplace_2022_102849
crossref_primary_10_1146_annurev_orgpsych_032414_111335
crossref_primary_10_1017_S0033291711000602
crossref_primary_10_1007_s11205_010_9578_7
crossref_primary_10_1007_s12160_009_9087_6
crossref_primary_10_1037_1082_989X_11_1_119
crossref_primary_10_3758_BF03192784
crossref_primary_10_1027_1016_9040_14_2_98
crossref_primary_10_1177_0146167206293492
crossref_primary_10_1016_j_psychres_2013_02_011
crossref_primary_10_1037_1082_989X_11_1_112
crossref_primary_10_1146_annurev_clinpsy_3_022806_091415
crossref_primary_10_1097_DBP_0b013e3181e416ae
crossref_primary_10_3758_s13428_012_0287_9
crossref_primary_10_1016_j_cct_2014_12_007
crossref_primary_10_1080_02678373_2017_1330782
crossref_primary_10_1097_OPX_0b013e3181ff9b80
crossref_primary_10_1080_09638288_2022_2089920
crossref_primary_10_1007_s10151_011_0713_5
crossref_primary_10_1007_BF03256686
crossref_primary_10_1027_1016_9040_a000511
crossref_primary_10_1348_014466510X491397
crossref_primary_10_1037_1082_989X_11_1_106
crossref_primary_10_1016_j_psychres_2016_08_057
crossref_primary_10_1016_j_brat_2010_04_008
crossref_primary_10_1177_0149206320964570
crossref_primary_10_1002_meet_2011_14504801085
crossref_primary_10_1016_j_yebeh_2008_12_011
crossref_primary_10_1016_j_paid_2012_03_006
crossref_primary_10_1136_sextrans_2013_051472
crossref_primary_10_1186_s12911_022_01818_5
crossref_primary_10_1080_03004430_2011_646725
crossref_primary_10_1044_2024_AJA_23_00249
crossref_primary_10_1016_j_beth_2011_10_001
crossref_primary_10_1002_mpr_276
crossref_primary_10_1111_jsm_12840
crossref_primary_10_1093_schbul_sbr137
crossref_primary_10_1177_0018726712447832
crossref_primary_10_1080_1359432X_2015_1128414
crossref_primary_10_1192_bjp_bp_111_104414
crossref_primary_10_1007_s11205_011_9892_8
crossref_primary_10_1080_17538157_2021_1877140
crossref_primary_10_1016_j_jrp_2011_12_006
crossref_primary_10_1111_j_1600_0447_2010_01566_x
crossref_primary_10_1111_j_1756_2589_2009_00011_x
crossref_primary_10_1111_apps_12069
crossref_primary_10_1111_acps_12151
crossref_primary_10_1007_s10902_022_00570_x
crossref_primary_10_1080_13594320701506054
crossref_primary_10_1016_j_math_2009_12_004
crossref_primary_10_1016_j_paid_2010_11_014
crossref_primary_10_1007_s10508_012_9939_1
crossref_primary_10_1080_17439760_2013_830765
crossref_primary_10_1007_s10865_016_9808_9
crossref_primary_10_1177_0146167217700605
crossref_primary_10_2217_pmt_11_32
crossref_primary_10_1093_geronb_gby044
crossref_primary_10_1016_j_pain_2014_04_017
crossref_primary_10_1177_0146167211400620
crossref_primary_10_3758_s13428_012_0205_1
crossref_primary_10_1177_0146167210394204
crossref_primary_10_1177_1087054713493318
crossref_primary_10_1097_j_pain_0000000000000101
crossref_primary_10_1017_S003329171200219X
crossref_primary_10_1111_j_1475_6811_2011_01375_x
crossref_primary_10_1177_0265407517743076
crossref_primary_10_1026_0932_4089_a000244
crossref_primary_10_1177_1077559508320680
crossref_primary_10_3758_s13428_021_01777_1
crossref_primary_10_1080_10705511_2023_2259105
crossref_primary_10_1371_journal_pone_0062688
crossref_primary_10_3109_10826084_2011_521399
crossref_primary_10_1097_PSY_0b013e3182545470
crossref_primary_10_7603_s40742_014_0014_6
crossref_primary_10_2196_formative_9922
crossref_primary_10_1080_08870446_2013_822078
crossref_primary_10_1016_j_jenvp_2014_02_001
crossref_primary_10_1093_workar_waz026
crossref_primary_10_1177_0193841X07307829
crossref_primary_10_1016_j_ijresmar_2018_01_002
crossref_primary_10_1177_1049732318816081
crossref_primary_10_1002_job_672
crossref_primary_10_1016_j_ejpain_2010_02_011
crossref_primary_10_1111_j_1600_0447_2009_01427_x
crossref_primary_10_3389_fpsyg_2019_01365
crossref_primary_10_1075_forum_00031_sun
crossref_primary_10_1080_1359432X_2017_1301428
crossref_primary_10_1007_s12671_012_0167_5
crossref_primary_10_1371_journal_pone_0191883
crossref_primary_10_1016_j_apergo_2014_02_004
crossref_primary_10_1016_j_chb_2016_11_024
crossref_primary_10_1016_j_drugalcdep_2013_02_017
crossref_primary_10_1016_j_psychres_2014_11_046
crossref_primary_10_1002_jclp_22037
crossref_primary_10_1007_s10902_017_9954_y
crossref_primary_10_1016_j_psychres_2018_02_032
crossref_primary_10_1007_s00127_014_0859_3
crossref_primary_10_1007_s10865_014_9598_x
crossref_primary_10_1007_s11136_006_9158_0
crossref_primary_10_1016_j_psychres_2010_06_014
crossref_primary_10_1111_j_1532_7795_2007_00543_x
crossref_primary_10_1080_08870440903337622
crossref_primary_10_1177_0149206307308911
crossref_primary_10_1016_j_jrp_2014_12_006
crossref_primary_10_3389_fpsyt_2018_00747
crossref_primary_10_1016_j_pain_2006_09_004
crossref_primary_10_1177_14705931211004665
crossref_primary_10_1016_j_psychsport_2017_07_011
crossref_primary_10_1177_239700221402800105
crossref_primary_10_1016_j_biopsycho_2010_12_011
crossref_primary_10_1080_02699930902851302
crossref_primary_10_1177_0146167208323742
crossref_primary_10_1108_EJM_04_2022_0272
crossref_primary_10_1007_s10869_018_9560_y
crossref_primary_10_1080_02678373_2015_1074955
crossref_primary_10_1007_s12020_023_03628_9
crossref_primary_10_1177_0894439312441577
crossref_primary_10_1111_j_1755_5949_2010_00213_x
ContentType Journal Article
Copyright ((c) 2006 APA, all rights reserved).
Copyright_xml – notice: ((c) 2006 APA, all rights reserved).
DBID 7SW
BJH
BNH
BNI
BNJ
BNO
ERI
PET
REK
WWN
CGR
CUY
CVF
ECM
EIF
NPM
DOI 10.1037/1082-989X.11.1.87
DatabaseName ERIC
ERIC (Ovid)
ERIC
ERIC
ERIC (Legacy Platform)
ERIC( SilverPlatter )
ERIC
ERIC PlusText (Legacy Platform)
Education Resources Information Center (ERIC)
ERIC
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
DatabaseTitle ERIC
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
DatabaseTitleList ERIC
MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
– sequence: 3
  dbid: ERI
  name: ERIC
  url: https://eric.ed.gov/
  sourceTypes: Index Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Psychology
ERIC EJ735350
ExternalDocumentID 16594769
EJ735350
Genre Comparative Study
Research Support, Non-U.S. Gov't
Journal Article
Research Support, N.I.H., Extramural
GrantInformation_xml – fundername: NIMH NIH HHS
  grantid: MH60355
GroupedDBID ---
--Z
-~X
.-4
07C
0R~
123
29P
354
53G
5VS
7RZ
7SW
ABIVO
ABNCP
ABVOZ
ACHQT
ACPQG
AEHFB
AETEA
ALMA_UNASSIGNED_HOLDINGS
AWKKM
AZXWR
BJH
BNH
BNI
BNJ
BNO
CGNQK
CS3
EPA
ERI
F5P
FTD
HVGLF
HZ~
ISO
LW5
O9-
OHT
OPA
OVD
P2P
PET
PHGZM
PHGZT
REK
ROL
SES
SPA
TEORI
TN5
UHS
WWN
XJT
YNT
ZPI
CGR
CUY
CVF
ECM
EIF
NPM
ID FETCH-LOGICAL-a410t-767d26c4213a319fab5ddb6486743b4a6d2d3a2735102b211eb8eb07eced64da2
IEDL.DBID ERI
ISSN 1082-989X
IngestDate Thu Jan 02 22:02:12 EST 2025
Fri Aug 01 12:18:43 EDT 2025
IsDoiOpenAccess false
IsOpenAccess false
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License ((c) 2006 APA, all rights reserved).
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a410t-767d26c4213a319fab5ddb6486743b4a6d2d3a2735102b211eb8eb07eced64da2
PMID 16594769
PageCount 19
ParticipantIDs pubmed_primary_16594769
eric_primary_EJ735350
PublicationCentury 2000
PublicationDate 2006-03-00
2006-Mar
PublicationDateYYYYMMDD 2006-03-01
PublicationDate_xml – month: 03
  year: 2006
  text: 2006-03-00
PublicationDecade 2000
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle Psychological methods
PublicationTitleAlternate Psychol Methods
PublicationYear 2006
Publisher American Psychological Association
Publisher_xml – name: American Psychological Association
References 16594770 - Psychol Methods. 2006 Mar;11(1):106-11; discussion 123-5
16594771 - Psychol Methods. 2006 Mar;11(1):112-8; discussion 123-5
16594772 - Psychol Methods. 2006 Mar;11(1):119-22; discussion 123-5
References_xml – reference: 16594770 - Psychol Methods. 2006 Mar;11(1):106-11; discussion 123-5
– reference: 16594771 - Psychol Methods. 2006 Mar;11(1):112-8; discussion 123-5
– reference: 16594772 - Psychol Methods. 2006 Mar;11(1):119-22; discussion 123-5
SSID ssj0014384
Score 2.3245885
Snippet Concern has been raised about the lack of participant compliance in diary studies that use paper-and-pencil as opposed to electronic formats. Three studies...
SourceID pubmed
eric
SourceType Index Database
StartPage 87
SubjectTerms Adolescent
Adult
Bias
Compliance (Psychology)
Computer Mediated Communication
Computers, Handheld - statistics & numerical data
Data Interpretation, Statistical
Diaries
Emotions
Female
Humans
Interpersonal Relations
Male
Mathematical Computing
Measurement Techniques
Medical Records - statistics & numerical data
Paper (Material)
Patient Compliance - statistics & numerical data
Psychological Studies
Psychometrics
Reproducibility of Results
Self-Assessment
Surveys and Questionnaires
Time Factors
Validity
Writing
Title Paper or Plastic? Data Equivalence in Paper and Electronic Diaries
URI http://eric.ed.gov/ERICWebPortal/detail?accno=EJ735350
https://www.ncbi.nlm.nih.gov/pubmed/16594769
Volume 11
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07TwMxDI4KLF0QjwLlpQysqe6SXHI3IaCtqkqtOlCpW2U3OanLtaAy8O9x7iUxILFkyGuw49hf7NiMPeVGgfcIwminhN4oJ1CjFCokO0lzixmEB_3Z3EyWerpKVh3WVHH8b0Tl1KpEBah-JGXUgJ7ad6BVWWc4JuUmsjRbNb5MFT6Z1310UwziQWrLH-nVXm3A8y_zslQz4zN2WtuH_KVi6Dnr-OKCddtr6vuSvS5g7z_57pMvyPKlac98CAfgo4-vLR2bIKl8W_BqFhSOj9pKN3y4LaFxjy3Ho_e3iagrIQjQcXQQ1lgnzUbLWAHJTA6YOIcmZMvTCjUYJ50CskRIwiQSpvOYeoys33hHTAB5xY6LXeFvGE-TyCGgTpwiVBwp9CY1IRTUYkqkM33WC2RY76tkF-uGPH12XdGlHYlNkmlrsts_VtyxbvVeEQK27tlJTvLkH0iFH_Cx5Bi188XsB5fylZk
linkProvider ERIC Clearinghouse on Information & Technology
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Paper+or+Plastic%3F+Data+Equivalence+in+Paper+and+Electronic+Diaries&rft.jtitle=Psychological+methods&rft.au=Green%2C+Amie+S&rft.au=Rafaeli%2C+Eshkol&rft.au=Bolger%2C+Niall&rft.au=Shrout%2C+Patrick+E&rft.date=2006-03-01&rft.pub=American+Psychological+Association&rft.issn=1082-989X&rft.volume=11&rft.issue=1&rft.spage=87&rft_id=info:doi/10.1037%2F1082-989X.11.1.87&rft.externalDocID=EJ735350
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1082-989X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1082-989X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1082-989X&client=summon