Noisy Non-Adaptive Group Testing: A (Near-)Definite Defectives Approach
The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. We study the noisy version of this prob...
Saved in:
Published in | IEEE transactions on information theory Vol. 66; no. 6; pp. 3775 - 3797 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
New York
IEEE
01.06.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. We study the noisy version of this problem, where the outcome of each standard noiseless group test is subject to independent noise, corresponding to passing the noiseless result through a binary channel. We introduce a class of algorithms that we refer to as Near-Definite Defectives (NDD), and study bounds on the required number of tests for asymptotically vanishing error probability under Bernoulli random test designs. In addition, we study algorithm-independent converse results, giving lower bounds on the required number of tests under Bernoulli test designs. Under reverse Z-channel noise, the achievable rates and converse results match in a broad range of sparsity regimes, and under Z-channel noise, the two match in a narrower range of dense/low-noise regimes. We observe that although these two channels have the same Shannon capacity when viewed as a communication channel, they can behave quite differently when it comes to group testing. Finally, we extend our analysis of these noise models to a general binary noise model (including symmetric noise), and show improvements over known existing bounds in broad scaling regimes. |
---|---|
AbstractList | The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. We study the noisy version of this problem, where the outcome of each standard noiseless group test is subject to independent noise, corresponding to passing the noiseless result through a binary channel. We introduce a class of algorithms that we refer to as Near-Definite Defectives (NDD), and study bounds on the required number of tests for asymptotically vanishing error probability under Bernoulli random test designs. In addition, we study algorithm-independent converse results, giving lower bounds on the required number of tests under Bernoulli test designs. Under reverse Z-channel noise, the achievable rates and converse results match in a broad range of sparsity regimes, and under Z-channel noise, the two match in a narrower range of dense/low-noise regimes. We observe that although these two channels have the same Shannon capacity when viewed as a communication channel, they can behave quite differently when it comes to group testing. Finally, we extend our analysis of these noise models to a general binary noise model (including symmetric noise), and show improvements over known existing bounds in broad scaling regimes. |
Author | Johnson, Oliver Scarlett, Jonathan |
Author_xml | – sequence: 1 givenname: Jonathan orcidid: 0000-0003-1403-9160 surname: Scarlett fullname: Scarlett, Jonathan email: scarlett@comp.nus.edu.sg organization: Department of Computer Science, National University of Singapore, Singapore – sequence: 2 givenname: Oliver orcidid: 0000-0002-3645-6670 surname: Johnson fullname: Johnson, Oliver email: O.Johnson@bristol.ac.uk organization: Department of Mathematics, University of Bristol, Bristol, U.K |
BookMark | eNp9kL1PwzAQxS0EEm1hR2KJxAJDytlxPswWFSiVqrKE2XKcC7gqcbBTpP73uGrFwMB0H3rvfqc3Jqed7ZCQKwpTSkHcV4tqyoDBlIkcaMFPyIimaR6LLOWnZARhFwvOi3My9n4dRp5SNiLzlTV-F61sF5eN6gfzjdHc2W0fVegH070_RGV0u0Ll4rtHbE1nBoxCg3ov9VHZ984q_XFBzlq18Xh5rBPy9vxUzV7i5et8MSuXsWaCDnESuHmbacYbqrFJCwDG6yTLFNMcgULTpkWSgWoalmlB64bVSgmsAXWNKSYTcnO4G7Bf2_CiXNut6wJSMg5ZDlAwCCo4qLSz3jtsZe_Mp3I7SUHu45IhLrmPSx7jCpbsj0WbQQ3GdoNTZvOf8fpgNIj4yylEzjllyQ9dxHf8 |
CODEN | IETTAW |
CitedBy_id | crossref_primary_10_1109_TIT_2021_3138489 crossref_primary_10_1109_TIT_2022_3140604 crossref_primary_10_1109_TSP_2022_3198179 crossref_primary_10_1017_S0963548324000336 crossref_primary_10_1109_TCOMM_2024_3366813 crossref_primary_10_1371_journal_pone_0283874 crossref_primary_10_1016_j_tcs_2022_03_026 crossref_primary_10_3390_a16010025 crossref_primary_10_1109_TIT_2022_3218174 crossref_primary_10_3390_a15110437 crossref_primary_10_1093_imaiai_iaac031 crossref_primary_10_3390_info14010048 |
Cites_doi | 10.1109/JSTSP.2018.2844818 10.1007/BF02124750 10.1109/TIT.2017.2659619 10.1109/TIT.2014.2314472 10.1109/TIT.2018.2861772 10.1109/TIT.2016.2606605 10.1109/TIT.2002.1013122 10.1145/1250790.1250824 10.1109/Allerton.2011.6120391 10.1109/TIT.2019.2902397 10.1561/0100000099 10.1109/TIT.2018.2883604 10.1016/S0166-218X(97)80002-9 10.1080/01621459.1972.10481257 10.1007/978-3-642-22006-7_47 10.1109/ALLERTON.2010.5707018 10.1109/ACSSC.2008.5074574 10.1109/ICASSP.2012.6288622 10.1007/BF01104893 10.1109/TIT.2017.2748564 10.1109/TIT.2011.2178156 10.1109/TIFS.2015.2440190 10.1145/1061318.1061325 10.1214/aos/1176346079 10.1109/TIT.1985.1057026 10.1007/11496137_15 10.1109/ISIT.2002.1023694 10.1109/ISIT.2013.6620712 10.1016/j.jcss.2009.06.002 10.1137/1.9781611973075.91 10.1109/ISIT.2016.7541823 10.1137/1.9781611974331.ch4 10.1109/TIT.2014.2310477 10.1016/j.dam.2012.07.022 10.1007/s00453-013-9816-x 10.1214/aoms/1177731363 10.1007/s10878-015-9951-1 |
ContentType | Journal Article |
Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
DOI | 10.1109/TIT.2020.2970184 |
DatabaseName | IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Xplore CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
DatabaseTitleList | Technology Research Database |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering Computer Science |
EISSN | 1557-9654 |
EndPage | 3797 |
ExternalDocumentID | 10_1109_TIT_2020_2970184 8974412 |
Genre | orig-research |
GrantInformation_xml | – fundername: National University of Singapore (NUS) Startup Grant funderid: 10.13039/501100001352 |
GroupedDBID | -~X .DC 0R~ 29I 3EH 4.4 5GY 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABQJQ ABVLG ACGFO ACGFS ACGOD ACIWK AENEX AETEA AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD F5P HZ~ H~9 IAAWW IBMZZ ICLAB IDIHD IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ O9- OCL P2P PQQKQ RIA RIE RNS RXW TAE TN5 VH1 VJK AAYOK AAYXX CITATION RIG 7SC 7SP 8FD JQ2 L7M L~C L~D |
ID | FETCH-LOGICAL-c291t-30147f6c24d1ced580024b366a2c4e010df58360add26c91bd2baa9eb0ecbe5e3 |
IEDL.DBID | RIE |
ISSN | 0018-9448 |
IngestDate | Mon Jun 30 06:55:57 EDT 2025 Thu Apr 24 23:04:29 EDT 2025 Tue Jul 01 02:16:14 EDT 2025 Wed Aug 27 02:39:05 EDT 2025 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 6 |
Language | English |
License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c291t-30147f6c24d1ced580024b366a2c4e010df58360add26c91bd2baa9eb0ecbe5e3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0000-0003-1403-9160 0000-0002-3645-6670 |
PQID | 2406700820 |
PQPubID | 36024 |
PageCount | 23 |
ParticipantIDs | ieee_primary_8974412 crossref_primary_10_1109_TIT_2020_2970184 proquest_journals_2406700820 crossref_citationtrail_10_1109_TIT_2020_2970184 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2020-06-01 |
PublicationDateYYYYMMDD | 2020-06-01 |
PublicationDate_xml | – month: 06 year: 2020 text: 2020-06-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | New York |
PublicationPlace_xml | – name: New York |
PublicationTitle | IEEE transactions on information theory |
PublicationTitleAbbrev | TIT |
PublicationYear | 2020 |
Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
References | ref35 ref13 ref12 ref37 ref15 ref36 ref14 ref31 ref30 ref33 ref11 motwani (ref43) 2010 ref10 ref2 ref1 ref17 ref38 ref19 ref18 anta (ref3) 2013; 67 ash (ref44) 1990 malyutov (ref25) 1980; 29 lee (ref32) 2015 ref24 ref45 ref23 ref26 ref20 ref42 ref41 ref22 ref21 ref28 ref27 ref29 ref8 ref7 bondorf (ref34) 2019 ref9 ref6 madej (ref39) 2003 ref5 ref40 erlich (ref4) 2015 coja-oghlan (ref16) 2019 |
References_xml | – ident: ref19 doi: 10.1109/JSTSP.2018.2844818 – ident: ref42 doi: 10.1007/BF02124750 – volume: 29 start-page: 109 year: 1980 ident: ref25 article-title: Screening designs for non-symmetric response function publication-title: Mat Zametki – ident: ref31 doi: 10.1109/TIT.2017.2659619 – ident: ref12 doi: 10.1109/TIT.2014.2314472 – ident: ref15 doi: 10.1109/TIT.2018.2861772 – year: 2010 ident: ref43 publication-title: Randomized Algorithms – ident: ref27 doi: 10.1109/TIT.2016.2606605 – ident: ref41 doi: 10.1109/TIT.2002.1013122 – ident: ref9 doi: 10.1145/1250790.1250824 – ident: ref23 doi: 10.1109/Allerton.2011.6120391 – ident: ref33 doi: 10.1109/TIT.2019.2902397 – ident: ref1 doi: 10.1561/0100000099 – ident: ref20 doi: 10.1109/TIT.2018.2883604 – ident: ref38 doi: 10.1016/S0166-218X(97)80002-9 – ident: ref21 doi: 10.1080/01621459.1972.10481257 – ident: ref36 doi: 10.1007/978-3-642-22006-7_47 – ident: ref29 doi: 10.1109/ALLERTON.2010.5707018 – ident: ref8 doi: 10.1109/ACSSC.2008.5074574 – ident: ref30 doi: 10.1109/ICASSP.2012.6288622 – start-page: 1 year: 2019 ident: ref16 article-title: Information-theoretic and algorithmic thresholds for group testing publication-title: Proc of Int Colloq on Automata Languages and Programming (ICALP) – ident: ref26 doi: 10.1007/BF01104893 – ident: ref14 doi: 10.1109/TIT.2017.2748564 – ident: ref10 doi: 10.1109/TIT.2011.2178156 – ident: ref18 doi: 10.1109/TIFS.2015.2440190 – year: 1990 ident: ref44 publication-title: Information Theory – year: 2015 ident: ref32 article-title: SAFFRON: A fast, efficient, and robust framework for group testing based on sparse-graph codes publication-title: arXiv 1508 04485 – ident: ref7 doi: 10.1145/1061318.1061325 – ident: ref45 doi: 10.1214/aos/1176346079 – ident: ref40 doi: 10.1109/TIT.1985.1057026 – ident: ref5 doi: 10.1007/11496137_15 – ident: ref24 doi: 10.1109/ISIT.2002.1023694 – ident: ref11 doi: 10.1109/ISIT.2013.6620712 – ident: ref6 doi: 10.1016/j.jcss.2009.06.002 – ident: ref37 doi: 10.1137/1.9781611973075.91 – ident: ref28 doi: 10.1109/ISIT.2016.7541823 – year: 2019 ident: ref34 article-title: Sublinear-time non-adaptive group testing with O(klogn) tests via bit-mixing coding publication-title: arXiv 1904 10102 – ident: ref13 doi: 10.1137/1.9781611974331.ch4 – ident: ref17 doi: 10.1109/TIT.2014.2310477 – year: 2015 ident: ref4 publication-title: Biological Screens From Linear Codes Theory and Tools – start-page: 237 year: 2003 ident: ref39 article-title: An application of group testing to the file comparison problem publication-title: Proc 9th Int Conf Distrib Comput Syst – ident: ref35 doi: 10.1016/j.dam.2012.07.022 – volume: 67 start-page: 295 year: 2013 ident: ref3 article-title: Unbounded contention resolution in multiple-access channels publication-title: Algorithmica doi: 10.1007/s00453-013-9816-x – ident: ref2 doi: 10.1214/aoms/1177731363 – ident: ref22 doi: 10.1007/s10878-015-9951-1 |
SSID | ssj0014512 |
Score | 2.4668279 |
Snippet | The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is... |
SourceID | proquest crossref ieee |
SourceType | Aggregation Database Enrichment Source Index Database Publisher |
StartPage | 3775 |
SubjectTerms | Algorithms Analytical models Channel noise Error probability Group testing information-theoretic limits Lower bounds Matching pursuit algorithms Noise Noise level Noise measurement Pattern matching performance bounds sparsity Testing Z channel |
Title | Noisy Non-Adaptive Group Testing: A (Near-)Definite Defectives Approach |
URI | https://ieeexplore.ieee.org/document/8974412 https://www.proquest.com/docview/2406700820 |
Volume | 66 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDLZgJzjwGCAGA-XAASTStV3aLtwmYAwkdhoSt6pJPIRAHWLdAX49TtpOvIS4RWpSRXHsfI6dzwBHJqZdQkcPFwS_uVDa5z0UCTcBapEkMlEuN-d2FA_vxM19dL8Ep4u3MIjoks_Qs00XyzdTPbdXZZ0egV9hSwovk-NWvtVaRAxEFJTM4AEpMPkcdUjSl53x9ZgcwdD3QpnQZ_HlCHI1VX4YYne6DNbhtp5XmVTy5M0L5en3b5SN_534BqxVMJP1y32xCUuYN2G9LuHAKo1uwuonPsItuBpNH2dvbDTNed9kL9YSMnc5xcaWjCN_OGN9djwi5eAnFzh5tHiVUaM0mjPWrwjKt-FucDk-H_Kq0gLXoQwKbv2qZBLrUJhAo4ksihSqG8dZqAWSy2YmkX3tQcYwjLUMlAlVlklUPmqFEXZ3oJFPc9wFFkQTRILsEUopUGVKS3KZlFRISMTosAWdevFTXdGQ22oYz6lzR3yZkrhSK660ElcLThYjXkoKjj_6btnVX_SrFr4F7Vq-aaWjs9RimcRBoL3fR-3Div13mRjWhkbxOscDgiCFOnR77wMWkdXK |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDLYQHIADb8R45sABJLK1JW0Jt4nXeKynInGrmsRDE6hDbDvAr8dJ24mXELdITdQoju3PifMZYN9EtEvI9XBB8JsLpT1-giLmxkct4ljGyuXmdJOocy9uHsKHKTiavIVBRJd8hk3bdHf5ZqDH9qisdULgV9iSwjPk90O_fK01uTMQoV9yg_ukwhR11JeSnmyl1ymFgoHXDGRMn8UXJ-Sqqvwwxc6_XC5Ct55ZmVby1ByPVFO_fyNt_O_Ul2ChApqsXe6MZZjCYgUW6yIOrNLpFZj_xEi4ClfJoD98Y8mg4G2Tv1hbyNzxFEstHUfxeMra7CAh9eCH59jrW8TKqFGazSFrVxTla3B_eZGedXhVa4HrQPojbiOruBfpQBhfowktjhTqOIryQAukoM30Qvveg8xhEGnpKxOoPJeoPNQKQzxeh-liUOAGMD_sIRJoD1FKgSpXWlLQpKRCwiJGBw1o1Yuf6YqI3NbDeM5cQOLJjMSVWXFllbgacDgZ8VKScPzRd9Wu_qRftfAN2K7lm1VaOswsmokdCNr8fdQezHbS7l12d53cbsGc_U-ZJrYN06PXMe4QIBmpXbcPPwBo3NkT |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Noisy+Non-Adaptive+Group+Testing%3A+A+%28Near-%29Definite+Defectives+Approach&rft.jtitle=IEEE+transactions+on+information+theory&rft.au=Scarlett%2C+Jonathan&rft.au=Johnson%2C+Oliver&rft.date=2020-06-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=0018-9448&rft.eissn=1557-9654&rft.volume=66&rft.issue=6&rft.spage=3775&rft_id=info:doi/10.1109%2FTIT.2020.2970184&rft.externalDBID=NO_FULL_TEXT |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0018-9448&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0018-9448&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0018-9448&client=summon |