Noisy Non-Adaptive Group Testing: A (Near-)Definite Defectives Approach

The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. We study the noisy version of this prob...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on information theory Vol. 66; no. 6; pp. 3775 - 3797
Main Authors Scarlett, Jonathan, Johnson, Oliver
Format Journal Article
LanguageEnglish
Published New York IEEE 01.06.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text

Cover

Loading…
Abstract The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. We study the noisy version of this problem, where the outcome of each standard noiseless group test is subject to independent noise, corresponding to passing the noiseless result through a binary channel. We introduce a class of algorithms that we refer to as Near-Definite Defectives (NDD), and study bounds on the required number of tests for asymptotically vanishing error probability under Bernoulli random test designs. In addition, we study algorithm-independent converse results, giving lower bounds on the required number of tests under Bernoulli test designs. Under reverse Z-channel noise, the achievable rates and converse results match in a broad range of sparsity regimes, and under Z-channel noise, the two match in a narrower range of dense/low-noise regimes. We observe that although these two channels have the same Shannon capacity when viewed as a communication channel, they can behave quite differently when it comes to group testing. Finally, we extend our analysis of these noise models to a general binary noise model (including symmetric noise), and show improvements over known existing bounds in broad scaling regimes.
AbstractList The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. We study the noisy version of this problem, where the outcome of each standard noiseless group test is subject to independent noise, corresponding to passing the noiseless result through a binary channel. We introduce a class of algorithms that we refer to as Near-Definite Defectives (NDD), and study bounds on the required number of tests for asymptotically vanishing error probability under Bernoulli random test designs. In addition, we study algorithm-independent converse results, giving lower bounds on the required number of tests under Bernoulli test designs. Under reverse Z-channel noise, the achievable rates and converse results match in a broad range of sparsity regimes, and under Z-channel noise, the two match in a narrower range of dense/low-noise regimes. We observe that although these two channels have the same Shannon capacity when viewed as a communication channel, they can behave quite differently when it comes to group testing. Finally, we extend our analysis of these noise models to a general binary noise model (including symmetric noise), and show improvements over known existing bounds in broad scaling regimes.
Author Johnson, Oliver
Scarlett, Jonathan
Author_xml – sequence: 1
  givenname: Jonathan
  orcidid: 0000-0003-1403-9160
  surname: Scarlett
  fullname: Scarlett, Jonathan
  email: scarlett@comp.nus.edu.sg
  organization: Department of Computer Science, National University of Singapore, Singapore
– sequence: 2
  givenname: Oliver
  orcidid: 0000-0002-3645-6670
  surname: Johnson
  fullname: Johnson, Oliver
  email: O.Johnson@bristol.ac.uk
  organization: Department of Mathematics, University of Bristol, Bristol, U.K
BookMark eNp9kL1PwzAQxS0EEm1hR2KJxAJDytlxPswWFSiVqrKE2XKcC7gqcbBTpP73uGrFwMB0H3rvfqc3Jqed7ZCQKwpTSkHcV4tqyoDBlIkcaMFPyIimaR6LLOWnZARhFwvOi3My9n4dRp5SNiLzlTV-F61sF5eN6gfzjdHc2W0fVegH070_RGV0u0Ll4rtHbE1nBoxCg3ov9VHZ984q_XFBzlq18Xh5rBPy9vxUzV7i5et8MSuXsWaCDnESuHmbacYbqrFJCwDG6yTLFNMcgULTpkWSgWoalmlB64bVSgmsAXWNKSYTcnO4G7Bf2_CiXNut6wJSMg5ZDlAwCCo4qLSz3jtsZe_Mp3I7SUHu45IhLrmPSx7jCpbsj0WbQQ3GdoNTZvOf8fpgNIj4yylEzjllyQ9dxHf8
CODEN IETTAW
CitedBy_id crossref_primary_10_1109_TIT_2021_3138489
crossref_primary_10_1109_TIT_2022_3140604
crossref_primary_10_1109_TSP_2022_3198179
crossref_primary_10_1017_S0963548324000336
crossref_primary_10_1109_TCOMM_2024_3366813
crossref_primary_10_1371_journal_pone_0283874
crossref_primary_10_1016_j_tcs_2022_03_026
crossref_primary_10_3390_a16010025
crossref_primary_10_1109_TIT_2022_3218174
crossref_primary_10_3390_a15110437
crossref_primary_10_1093_imaiai_iaac031
crossref_primary_10_3390_info14010048
Cites_doi 10.1109/JSTSP.2018.2844818
10.1007/BF02124750
10.1109/TIT.2017.2659619
10.1109/TIT.2014.2314472
10.1109/TIT.2018.2861772
10.1109/TIT.2016.2606605
10.1109/TIT.2002.1013122
10.1145/1250790.1250824
10.1109/Allerton.2011.6120391
10.1109/TIT.2019.2902397
10.1561/0100000099
10.1109/TIT.2018.2883604
10.1016/S0166-218X(97)80002-9
10.1080/01621459.1972.10481257
10.1007/978-3-642-22006-7_47
10.1109/ALLERTON.2010.5707018
10.1109/ACSSC.2008.5074574
10.1109/ICASSP.2012.6288622
10.1007/BF01104893
10.1109/TIT.2017.2748564
10.1109/TIT.2011.2178156
10.1109/TIFS.2015.2440190
10.1145/1061318.1061325
10.1214/aos/1176346079
10.1109/TIT.1985.1057026
10.1007/11496137_15
10.1109/ISIT.2002.1023694
10.1109/ISIT.2013.6620712
10.1016/j.jcss.2009.06.002
10.1137/1.9781611973075.91
10.1109/ISIT.2016.7541823
10.1137/1.9781611974331.ch4
10.1109/TIT.2014.2310477
10.1016/j.dam.2012.07.022
10.1007/s00453-013-9816-x
10.1214/aoms/1177731363
10.1007/s10878-015-9951-1
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/TIT.2020.2970184
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Xplore
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Computer Science
EISSN 1557-9654
EndPage 3797
ExternalDocumentID 10_1109_TIT_2020_2970184
8974412
Genre orig-research
GrantInformation_xml – fundername: National University of Singapore (NUS) Startup Grant
  funderid: 10.13039/501100001352
GroupedDBID -~X
.DC
0R~
29I
3EH
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABFSI
ABQJQ
ABVLG
ACGFO
ACGFS
ACGOD
ACIWK
AENEX
AETEA
AETIX
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
AKJIK
AKQYR
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
E.L
EBS
EJD
F5P
HZ~
H~9
IAAWW
IBMZZ
ICLAB
IDIHD
IFIPE
IFJZH
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
PQQKQ
RIA
RIE
RNS
RXW
TAE
TN5
VH1
VJK
AAYOK
AAYXX
CITATION
RIG
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c291t-30147f6c24d1ced580024b366a2c4e010df58360add26c91bd2baa9eb0ecbe5e3
IEDL.DBID RIE
ISSN 0018-9448
IngestDate Mon Jun 30 06:55:57 EDT 2025
Thu Apr 24 23:04:29 EDT 2025
Tue Jul 01 02:16:14 EDT 2025
Wed Aug 27 02:39:05 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 6
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-30147f6c24d1ced580024b366a2c4e010df58360add26c91bd2baa9eb0ecbe5e3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-1403-9160
0000-0002-3645-6670
PQID 2406700820
PQPubID 36024
PageCount 23
ParticipantIDs ieee_primary_8974412
crossref_primary_10_1109_TIT_2020_2970184
proquest_journals_2406700820
crossref_citationtrail_10_1109_TIT_2020_2970184
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2020-06-01
PublicationDateYYYYMMDD 2020-06-01
PublicationDate_xml – month: 06
  year: 2020
  text: 2020-06-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on information theory
PublicationTitleAbbrev TIT
PublicationYear 2020
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref35
ref13
ref12
ref37
ref15
ref36
ref14
ref31
ref30
ref33
ref11
motwani (ref43) 2010
ref10
ref2
ref1
ref17
ref38
ref19
ref18
anta (ref3) 2013; 67
ash (ref44) 1990
malyutov (ref25) 1980; 29
lee (ref32) 2015
ref24
ref45
ref23
ref26
ref20
ref42
ref41
ref22
ref21
ref28
ref27
ref29
ref8
ref7
bondorf (ref34) 2019
ref9
ref6
madej (ref39) 2003
ref5
ref40
erlich (ref4) 2015
coja-oghlan (ref16) 2019
References_xml – ident: ref19
  doi: 10.1109/JSTSP.2018.2844818
– ident: ref42
  doi: 10.1007/BF02124750
– volume: 29
  start-page: 109
  year: 1980
  ident: ref25
  article-title: Screening designs for non-symmetric response function
  publication-title: Mat Zametki
– ident: ref31
  doi: 10.1109/TIT.2017.2659619
– ident: ref12
  doi: 10.1109/TIT.2014.2314472
– ident: ref15
  doi: 10.1109/TIT.2018.2861772
– year: 2010
  ident: ref43
  publication-title: Randomized Algorithms
– ident: ref27
  doi: 10.1109/TIT.2016.2606605
– ident: ref41
  doi: 10.1109/TIT.2002.1013122
– ident: ref9
  doi: 10.1145/1250790.1250824
– ident: ref23
  doi: 10.1109/Allerton.2011.6120391
– ident: ref33
  doi: 10.1109/TIT.2019.2902397
– ident: ref1
  doi: 10.1561/0100000099
– ident: ref20
  doi: 10.1109/TIT.2018.2883604
– ident: ref38
  doi: 10.1016/S0166-218X(97)80002-9
– ident: ref21
  doi: 10.1080/01621459.1972.10481257
– ident: ref36
  doi: 10.1007/978-3-642-22006-7_47
– ident: ref29
  doi: 10.1109/ALLERTON.2010.5707018
– ident: ref8
  doi: 10.1109/ACSSC.2008.5074574
– ident: ref30
  doi: 10.1109/ICASSP.2012.6288622
– start-page: 1
  year: 2019
  ident: ref16
  article-title: Information-theoretic and algorithmic thresholds for group testing
  publication-title: Proc of Int Colloq on Automata Languages and Programming (ICALP)
– ident: ref26
  doi: 10.1007/BF01104893
– ident: ref14
  doi: 10.1109/TIT.2017.2748564
– ident: ref10
  doi: 10.1109/TIT.2011.2178156
– ident: ref18
  doi: 10.1109/TIFS.2015.2440190
– year: 1990
  ident: ref44
  publication-title: Information Theory
– year: 2015
  ident: ref32
  article-title: SAFFRON: A fast, efficient, and robust framework for group testing based on sparse-graph codes
  publication-title: arXiv 1508 04485
– ident: ref7
  doi: 10.1145/1061318.1061325
– ident: ref45
  doi: 10.1214/aos/1176346079
– ident: ref40
  doi: 10.1109/TIT.1985.1057026
– ident: ref5
  doi: 10.1007/11496137_15
– ident: ref24
  doi: 10.1109/ISIT.2002.1023694
– ident: ref11
  doi: 10.1109/ISIT.2013.6620712
– ident: ref6
  doi: 10.1016/j.jcss.2009.06.002
– ident: ref37
  doi: 10.1137/1.9781611973075.91
– ident: ref28
  doi: 10.1109/ISIT.2016.7541823
– year: 2019
  ident: ref34
  article-title: Sublinear-time non-adaptive group testing with O(klogn) tests via bit-mixing coding
  publication-title: arXiv 1904 10102
– ident: ref13
  doi: 10.1137/1.9781611974331.ch4
– ident: ref17
  doi: 10.1109/TIT.2014.2310477
– year: 2015
  ident: ref4
  publication-title: Biological Screens From Linear Codes Theory and Tools
– start-page: 237
  year: 2003
  ident: ref39
  article-title: An application of group testing to the file comparison problem
  publication-title: Proc 9th Int Conf Distrib Comput Syst
– ident: ref35
  doi: 10.1016/j.dam.2012.07.022
– volume: 67
  start-page: 295
  year: 2013
  ident: ref3
  article-title: Unbounded contention resolution in multiple-access channels
  publication-title: Algorithmica
  doi: 10.1007/s00453-013-9816-x
– ident: ref2
  doi: 10.1214/aoms/1177731363
– ident: ref22
  doi: 10.1007/s10878-015-9951-1
SSID ssj0014512
Score 2.4668279
Snippet The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 3775
SubjectTerms Algorithms
Analytical models
Channel noise
Error probability
Group testing
information-theoretic limits
Lower bounds
Matching pursuit algorithms
Noise
Noise level
Noise measurement
Pattern matching
performance bounds
sparsity
Testing
Z channel
Title Noisy Non-Adaptive Group Testing: A (Near-)Definite Defectives Approach
URI https://ieeexplore.ieee.org/document/8974412
https://www.proquest.com/docview/2406700820
Volume 66
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDLZgJzjwGCAGA-XAASTStV3aLtwmYAwkdhoSt6pJPIRAHWLdAX49TtpOvIS4RWpSRXHsfI6dzwBHJqZdQkcPFwS_uVDa5z0UCTcBapEkMlEuN-d2FA_vxM19dL8Ep4u3MIjoks_Qs00XyzdTPbdXZZ0egV9hSwovk-NWvtVaRAxEFJTM4AEpMPkcdUjSl53x9ZgcwdD3QpnQZ_HlCHI1VX4YYne6DNbhtp5XmVTy5M0L5en3b5SN_534BqxVMJP1y32xCUuYN2G9LuHAKo1uwuonPsItuBpNH2dvbDTNed9kL9YSMnc5xcaWjCN_OGN9djwi5eAnFzh5tHiVUaM0mjPWrwjKt-FucDk-H_Kq0gLXoQwKbv2qZBLrUJhAo4ksihSqG8dZqAWSy2YmkX3tQcYwjLUMlAlVlklUPmqFEXZ3oJFPc9wFFkQTRILsEUopUGVKS3KZlFRISMTosAWdevFTXdGQ22oYz6lzR3yZkrhSK660ElcLThYjXkoKjj_6btnVX_SrFr4F7Vq-aaWjs9RimcRBoL3fR-3Div13mRjWhkbxOscDgiCFOnR77wMWkdXK
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDLYQHIADb8R45sABJLK1JW0Jt4nXeKynInGrmsRDE6hDbDvAr8dJ24mXELdITdQoju3PifMZYN9EtEvI9XBB8JsLpT1-giLmxkct4ljGyuXmdJOocy9uHsKHKTiavIVBRJd8hk3bdHf5ZqDH9qisdULgV9iSwjPk90O_fK01uTMQoV9yg_ukwhR11JeSnmyl1ymFgoHXDGRMn8UXJ-Sqqvwwxc6_XC5Ct55ZmVby1ByPVFO_fyNt_O_Ul2ChApqsXe6MZZjCYgUW6yIOrNLpFZj_xEi4ClfJoD98Y8mg4G2Tv1hbyNzxFEstHUfxeMra7CAh9eCH59jrW8TKqFGazSFrVxTla3B_eZGedXhVa4HrQPojbiOruBfpQBhfowktjhTqOIryQAukoM30Qvveg8xhEGnpKxOoPJeoPNQKQzxeh-liUOAGMD_sIRJoD1FKgSpXWlLQpKRCwiJGBw1o1Yuf6YqI3NbDeM5cQOLJjMSVWXFllbgacDgZ8VKScPzRd9Wu_qRftfAN2K7lm1VaOswsmokdCNr8fdQezHbS7l12d53cbsGc_U-ZJrYN06PXMe4QIBmpXbcPPwBo3NkT
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Noisy+Non-Adaptive+Group+Testing%3A+A+%28Near-%29Definite+Defectives+Approach&rft.jtitle=IEEE+transactions+on+information+theory&rft.au=Scarlett%2C+Jonathan&rft.au=Johnson%2C+Oliver&rft.date=2020-06-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0018-9448&rft.eissn=1557-9654&rft.volume=66&rft.issue=6&rft.spage=3775&rft_id=info:doi/10.1109%2FTIT.2020.2970184&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9448&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9448&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9448&client=summon