Studying programmer behavior experimentally the problems of proper methodology

The application of behavioral or psychological techniques to the evaluation of programming languages and techniques is an approach which has found increased applicability over the past decade. In order to use this approach successfully, investigators must pay close attention to methodological issues...

Full description

Saved in:
Bibliographic Details
Published inCommunications of the ACM Vol. 23; no. 4; pp. 207 - 213
Main Author Brooks, Ruven E.
Format Magazine Article
LanguageEnglish
Published 01.04.1980
Online AccessGet full text
ISSN0001-0782
1557-7317
DOI10.1145/358841.358847

Cover

Abstract The application of behavioral or psychological techniques to the evaluation of programming languages and techniques is an approach which has found increased applicability over the past decade. In order to use this approach successfully, investigators must pay close attention to methodological issues, both in order to insure the generalizability of their findings and to defend the quality of their work to researchers in other fields. Three major areas of methodological concern, the selection of subjects, materials, and measures, are reviewed. The first two of these areas continue to present major difficulties for this type of research.
AbstractList The application of behavioral or psychological techniques to the evaluation of programming languages and techniques is an approach which has found increased applicability over the past decade. In order to use this approach successfully, investigators must pay close attention to methodological issues, both in order to insure the generalizability of their findings and to defend the quality of their work to researchers in other fields. Three major areas of methodological concern, the selection of subjects, materials, and measures, are reviewed. The first two of these areas continue to present major difficulties for this type of research.
Author Brooks, Ruven E.
Author_xml – sequence: 1
  givenname: Ruven E.
  surname: Brooks
  fullname: Brooks, Ruven E.
  organization: Univ. of Texas Medical Branch, Galveston
BookMark eNp1j8tLAzEYxINUcFs9et-7pOb9OErxBQUP6nn5dpPUyD5KNor739u6ngRPPwZmhpklWvRD7xG6pGRNqZDXXBoj6PoH-gQVVEqNNad6gQpCCMVEG3aGluP4fpBEKlmgq-f84abY78p9GnYJus6nsvZv8BmHVPqvvU-x832Gtp3O0WmAdvQXv1yh17vbl80D3j7dP25utrhhXGcsSABDg7PKMkekoUo5DVowTWzwNXUQHJcWOHeWKslY3TQCrFFCGulqzVeIz71NGsYx-VA1MUOOQ58TxLaipDr-rea_M44p_Ce1P0yHNP3j_wY4sFej
CitedBy_id crossref_primary_10_1145_57669_57675
crossref_primary_10_1016_j_ijhcs_2019_06_009
crossref_primary_10_1016_S0020_7373_89_80019_7
crossref_primary_10_1145_356835_356840
crossref_primary_10_1016_0164_1212_88_90007_6
crossref_primary_10_1177_154193128603000519
crossref_primary_10_1145_1005913_1005915
crossref_primary_10_1145_129617_129621
crossref_primary_10_1177_154193129904300503
crossref_primary_10_1007_BF00368701
crossref_primary_10_1109_32_6179
crossref_primary_10_1145_1005937_1005946
crossref_primary_10_1080_07421222_1998_11518195
crossref_primary_10_1016_j_infsof_2012_09_005
crossref_primary_10_1057_ejis_2008_42
crossref_primary_10_1145_1010884_1010888
crossref_primary_10_1080_07421222_1998_11518196
crossref_primary_10_1145_2168696_2047861
crossref_primary_10_1016_S0164_1212_00_00052_2
crossref_primary_10_1016_S0020_7373_05_80030_6
crossref_primary_10_1145_118014_117969
crossref_primary_10_1145_5465_5470
crossref_primary_10_1145_182_358458
crossref_primary_10_1016_S0020_7373_86_80081_5
crossref_primary_10_1145_31726_31777
crossref_primary_10_1145_248448_248456
crossref_primary_10_1016_S0020_7373_88_80052_X
crossref_primary_10_1016_0164_1212_89_90019_8
crossref_primary_10_1016_S0020_7373_88_80069_5
crossref_primary_10_1007_s10664_022_10160_3
crossref_primary_10_1145_2398857_2384666
crossref_primary_10_1016_S0020_7373_84_80057_7
crossref_primary_10_1080_08886504_1994_10782096
crossref_primary_10_1002_tea_3660230505
crossref_primary_10_1016_S0020_7373_89_80009_4
crossref_primary_10_1080_01449298708901854
crossref_primary_10_1145_147114_147123
crossref_primary_10_1080_08886504_1990_10781925
crossref_primary_10_1016_j_jss_2017_07_010
crossref_primary_10_1016_0164_1212_91_90017_Z
crossref_primary_10_1145_1015579_810956
crossref_primary_10_1016_S0020_7373_85_80054_7
crossref_primary_10_1016_S0950_5849_98_00100_1
crossref_primary_10_1016_0252_7308_84_90048_5
crossref_primary_10_1016_0164_1212_95_00074_7
crossref_primary_10_1016_0378_7206_86_90028_5
crossref_primary_10_1109_32_6180
crossref_primary_10_1016_S0164_1212_99_00042_4
crossref_primary_10_1145_65294_71206
crossref_primary_10_1016_0306_4573_84_90050_5
crossref_primary_10_2190_V5YJ_76DX_ECL6_R851
crossref_primary_10_1049_ip_sen_19990600
crossref_primary_10_1016_0950_5849_88_90064_X
crossref_primary_10_1016_0165_6074_85_90032_8
crossref_primary_10_1016_S0020_7373_83_80005_4
crossref_primary_10_1016_0306_4573_84_90052_9
crossref_primary_10_1109_32_799939
crossref_primary_10_1016_0732_118X_84_90018_7
crossref_primary_10_1016_j_dss_2008_11_009
crossref_primary_10_1080_01449298208914451
crossref_primary_10_1109_PROC_1986_13596
crossref_primary_10_1016_S0164_1212_02_00136_X
crossref_primary_10_1109_17_865899
crossref_primary_10_1016_0747_5632_94_00034_F
crossref_primary_10_2190_BC76_8479_YM0X_7FUA
crossref_primary_10_1109_MC_1984_1658997
crossref_primary_10_1007_BF00127447
crossref_primary_10_1109_32_926174
crossref_primary_10_1109_TSE_2008_89
crossref_primary_10_1007_s11219_015_9303_5
crossref_primary_10_1016_S0020_7373_05_80116_6
crossref_primary_10_1007_s11219_020_09512_3
crossref_primary_10_1016_0164_1212_91_90044_7
crossref_primary_10_1109_32_922713
crossref_primary_10_1109_PROC_1980_11813
crossref_primary_10_1016_0164_1212_81_90029_7
crossref_primary_10_1007_BF03172928
crossref_primary_10_1016_S0164_1212_02_00088_2
crossref_primary_10_3758_BF03203551
crossref_primary_10_1016_j_infsof_2004_08_005
crossref_primary_10_1016_S0950_5849_96_01139_1
crossref_primary_10_1016_j_jss_2003_12_019
crossref_primary_10_1017_S0269888900004483
crossref_primary_10_1109_TSE_1984_5010252
crossref_primary_10_1145_1006258_1006275
crossref_primary_10_1109_TSMC_1986_289308
Cites_doi 10.5555/800099.803210
10.1002/spe.4380010203
10.1177/001872087401600307
10.1177/001872087401600308
10.1016/S0020-7373(74)80027-1
10.1016/S0020-7373(77)80045-X
10.1177/001872087401600108
10.1016/0010-0285(73)90004-2
10.1145/359605.359610
10.1016/S0020-7373(76)80010-7
10.1109/TSE.1976.233837
10.1016/S0020-7373(77)80046-1
10.1016/S0020-7373(73)80011-2
10.1016/S0020-7373(75)80005-8
10.1111/j.2044-8325.1977.tb00363.x
10.1145/359763.359800
10.1016/S0020-7373(77)80014-X
ContentType Magazine Article
DBID AAYXX
CITATION
DOI 10.1145/358841.358847
DatabaseName CrossRef
DatabaseTitle CrossRef
DatabaseTitleList CrossRef
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Mathematics
Computer Science
EISSN 1557-7317
EndPage 213
ExternalDocumentID 10_1145_358841_358847
GroupedDBID --Z
-DZ
-ET
-~X
.4S
.DC
.GJ
1OL
29F
2FS
3R3
4.4
4R4
53G
5GY
5VS
6J9
85S
8US
8VB
9M8
AAFWJ
AAIKC
AAKMM
AALFJ
AAMNW
AAWTO
AAYFX
AAYOK
AAYXX
ABEFU
ABFSI
ABPPZ
ACBMB
ACGFO
ACGOD
ACM
ACNCT
ACTDY
ADBCU
ADL
ADMLS
ADXHL
AEBYY
AEFXT
AEGXH
AEJOY
AEMOZ
AENEX
AENSD
AETEA
AFWIH
AFWXC
AGHSJ
AGNAY
AHQJS
AI.
AIAGR
AIDUJ
AIKLT
AKRVB
AKVCP
ALMA_UNASSIGNED_HOLDINGS
ARCSS
ASPBG
AVWKF
BAAKF
BDXCO
BKOMP
CCLIF
CITATION
CS3
DU5
E.L
EBE
EBO
EBR
EBS
EBU
EDO
EJD
EMK
EPL
F5P
FEDTE
FJW
GUFHI
HF~
HGAVV
H~9
I-F
I07
IAO
IBB
ICD
IEA
IGS
IMI
IOF
IPO
ITC
K1G
L7B
LHSKQ
LXL
LXN
MK~
ML~
MVM
N95
NEJ
NHB
OHT
P1C
P2P
PQQKQ
QWB
RNS
ROL
RWL
SC5
TAE
TH9
TN5
TUS
UHB
UKR
UPT
VH1
VOH
WH7
XH6
XJT
XOL
XSW
YXB
YYP
ZCA
ZCG
ZHY
ZL0
ZRQ
ZY4
~02
ID FETCH-LOGICAL-c237t-40fa81fd9692d058166d7a742709feb1dafd359a33d916522bcc4a9864585db73
ISSN 0001-0782
IngestDate Thu Jul 03 08:43:47 EDT 2025
Thu Apr 24 22:56:00 EDT 2025
IsPeerReviewed false
IsScholarly false
Issue 4
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c237t-40fa81fd9692d058166d7a742709feb1dafd359a33d916522bcc4a9864585db73
PageCount 7
ParticipantIDs crossref_citationtrail_10_1145_358841_358847
crossref_primary_10_1145_358841_358847
PublicationCentury 1900
PublicationDate 1980-04-01
PublicationDateYYYYMMDD 1980-04-01
PublicationDate_xml – month: 04
  year: 1980
  text: 1980-04-01
  day: 01
PublicationDecade 1980
PublicationTitle Communications of the ACM
PublicationYear 1980
References Curtis B. (e_1_2_1_4_2) 1979
e_1_2_1_22_2
e_1_2_1_23_2
e_1_2_1_20_2
e_1_2_1_21_2
e_1_2_1_26_2
Weissman L. (e_1_2_1_24_2) 1974
Sheppard S.B. (e_1_2_1_16_2) 1978
Sackman H. (e_1_2_1_15_2) 1970
e_1_2_1_6_2
e_1_2_1_7_2
e_1_2_1_5_2
e_1_2_1_2_2
e_1_2_1_11_2
e_1_2_1_3_2
Halstead M.H. (e_1_2_1_10_2) 1977
e_1_2_1_12_2
Winer B. (e_1_2_1_25_2) 1971
e_1_2_1_1_2
e_1_2_1_13_2
e_1_2_1_14_2
Sheppard S.B. (e_1_2_1_17_2) 1979
e_1_2_1_19_2
e_1_2_1_8_2
e_1_2_1_9_2
e_1_2_1_18_2
References_xml – ident: e_1_2_1_2_2
  doi: 10.5555/800099.803210
– ident: e_1_2_1_14_2
– ident: e_1_2_1_11_2
  doi: 10.1002/spe.4380010203
– volume-title: McGraw- Hill
  year: 1971
  ident: e_1_2_1_25_2
– volume-title: Va.
  year: 1978
  ident: e_1_2_1_16_2
– start-page: 12
  year: 1979
  ident: e_1_2_1_17_2
  article-title: Modern coding practices and programmer performance
  publication-title: Computer
– volume-title: Auerbach
  year: 1970
  ident: e_1_2_1_15_2
– ident: e_1_2_1_1_2
  doi: 10.1177/001872087401600307
– ident: e_1_2_1_13_2
– ident: e_1_2_1_7_2
  doi: 10.1177/001872087401600308
– volume-title: Amer. Elsevier Pub. Co.
  year: 1977
  ident: e_1_2_1_10_2
– ident: e_1_2_1_26_2
  doi: 10.1016/S0020-7373(74)80027-1
– ident: e_1_2_1_22_2
  doi: 10.1016/S0020-7373(77)80045-X
– ident: e_1_2_1_23_2
  doi: 10.1177/001872087401600108
– ident: e_1_2_1_3_2
  doi: 10.1016/0010-0285(73)90004-2
– ident: e_1_2_1_18_2
  doi: 10.1145/359605.359610
– ident: e_1_2_1_5_2
  doi: 10.1016/S0020-7373(76)80010-7
– ident: e_1_2_1_12_2
  doi: 10.1109/TSE.1976.233837
– ident: e_1_2_1_20_2
  doi: 10.1016/S0020-7373(77)80046-1
– ident: e_1_2_1_21_2
  doi: 10.1016/S0020-7373(73)80011-2
– start-page: 356
  volume-title: Proc. 4th Internat. Conf. on Software Eng., IEEE
  year: 1979
  ident: e_1_2_1_4_2
– ident: e_1_2_1_8_2
  doi: 10.1016/S0020-7373(75)80005-8
– ident: e_1_2_1_9_2
  doi: 10.1111/j.2044-8325.1977.tb00363.x
– volume-title: Univ. of Toronto
  year: 1974
  ident: e_1_2_1_24_2
– ident: e_1_2_1_6_2
  doi: 10.1145/359763.359800
– ident: e_1_2_1_19_2
  doi: 10.1016/S0020-7373(77)80014-X
SSID ssj0000565
Score 1.1501623
Snippet The application of behavioral or psychological techniques to the evaluation of programming languages and techniques is an approach which has found increased...
SourceID crossref
SourceType Enrichment Source
Index Database
StartPage 207
Subtitle the problems of proper methodology
Title Studying programmer behavior experimentally
Volume 23
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1NT8IwGG4ULnpBUSN-ZQfjBYewtis7EsQQI16EhBtp1_WigoFx0F_v23Xdh3JALxssZWR9lvejfZ_nRejaD7rJBp0bChy5RITSFSHR9Q4epypSvsKa7zx69ocT8jil07zdX8IuiUUr_NrIK_kPqnANcNUs2T8gm90ULsBnwBeOgDAct8JYFwF-Gjp5UmX1Hi0z3n1Ju_-ttHlbIoWsbJVAr58twkBuvng1SzBrMIbNQStfHOjAtBdqSqzB67g6CjDmPrVxlLkMG8qkNYKG9JuCTYoWzTSlTZ2jZ4ijv-0u0RIVWLNeO63kxHIHYzfVf_idrBrQcKPpzPzcnNguqnoMcs0KqvbuR08vuXulvmlLkT6ZFU4l9K70_4VAoxAxjA9QzUp3Oz0D3CHaieZ1VLN9NJzUrNbRfkEUEr6NMiXd1RFqWoydHGPHYuyUMT5Gk4fBuD900wYXbuhhFkPurni3o2TgB55sU72FKxlnxGPtQIETlVxJTAOOsYQoHiJlEYaEa0F9SPKkYPgEVeaLeXSKHO5hQjhkw0xxoqIu5yKiWGDp-dyHkQ10a2djFqbq77oJydts4-w30E02_MPInmweeLbtwHO0l7-gF6gSL9fRJcRzsbhKEf4G-KBF6g
linkProvider EBSCOhost
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Studying+programmer+behavior+experimentally&rft.jtitle=Communications+of+the+ACM&rft.au=Brooks%2C+Ruven+E.&rft.date=1980-04-01&rft.issn=0001-0782&rft.eissn=1557-7317&rft.volume=23&rft.issue=4&rft.spage=207&rft.epage=213&rft_id=info:doi/10.1145%2F358841.358847&rft.externalDBID=n%2Fa&rft.externalDocID=10_1145_358841_358847
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0001-0782&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0001-0782&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0001-0782&client=summon