Methods and apparatus for computing estimated quantiles for streaming data over sliding windows
Estimated quantiles and/or percentiles for streaming data are computed over a sliding window. An exemplary method comprises obtaining a stream of data values; obtaining a summary of a distribution of previously processed data values; adding streamed data values to a buffer; and when the buffer reach...
Saved in:
Main Authors | , |
---|---|
Format | Patent |
Language | English |
Published |
16.06.2020
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Estimated quantiles and/or percentiles for streaming data are computed over a sliding window. An exemplary method comprises obtaining a stream of data values; obtaining a summary of a distribution of previously processed data values; adding streamed data values to a buffer; and when the buffer reaches a predefined fullness threshold, performing the following steps: processing tuples in the summary to apply a decay function to each tuple using the number of items in the stream in the stream at the time the tuple is created and a minimal rank bound; for each item in the buffer, creating a tuple; adding the tuple to the summary, and removing the item from the buffer; and building a search tree that is used to process one or more of percentile queries and quantile queries. The summary is optionally compressed by merging consecutive tuples that satisfy a predefined invariant constraint. The decay function maintains, for example, one or more of a predefined recent number of items or a predefined recent time window of items in the summary. |
---|---|
AbstractList | Estimated quantiles and/or percentiles for streaming data are computed over a sliding window. An exemplary method comprises obtaining a stream of data values; obtaining a summary of a distribution of previously processed data values; adding streamed data values to a buffer; and when the buffer reaches a predefined fullness threshold, performing the following steps: processing tuples in the summary to apply a decay function to each tuple using the number of items in the stream in the stream at the time the tuple is created and a minimal rank bound; for each item in the buffer, creating a tuple; adding the tuple to the summary, and removing the item from the buffer; and building a search tree that is used to process one or more of percentile queries and quantile queries. The summary is optionally compressed by merging consecutive tuples that satisfy a predefined invariant constraint. The decay function maintains, for example, one or more of a predefined recent number of items or a predefined recent time window of items in the summary. |
Author | Blatt, Marcelo Shachar, Rafael |
Author_xml | – fullname: Shachar, Rafael – fullname: Blatt, Marcelo |
BookMark | eNqNyj0KwkAQQOEttPDvDuMBhARRUiuKjZVahyE70YXszJqZmOtr0ANYPXh8UzdiYZq48kz2EK-A7AFTwhatU6ilhUpi6izwHUgtRDTy8OyQLTT0FWotYRyER0OQF31eE_xw-sBeep27cY2N0uLXmVseD9f9aUVJStKEFTFZebvk2bbYZHmxy9f_mDcsqT-X |
ContentType | Patent |
DBID | EVB |
DatabaseName | esp@cenet |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: EVB name: esp@cenet url: http://worldwide.espacenet.com/singleLineSearch?locale=en_EP sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine Chemistry Sciences Physics |
ExternalDocumentID | US10685018B1 |
GroupedDBID | EVB |
ID | FETCH-epo_espacenet_US10685018B13 |
IEDL.DBID | EVB |
IngestDate | Fri Jul 19 15:54:29 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-epo_espacenet_US10685018B13 |
Notes | Application Number: US201615192165 |
OpenAccessLink | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20200616&DB=EPODOC&CC=US&NR=10685018B1 |
ParticipantIDs | epo_espacenet_US10685018B1 |
PublicationCentury | 2000 |
PublicationDate | 20200616 |
PublicationDateYYYYMMDD | 2020-06-16 |
PublicationDate_xml | – month: 06 year: 2020 text: 20200616 day: 16 |
PublicationDecade | 2020 |
PublicationYear | 2020 |
RelatedCompanies | EMC IP Holding Company LLC |
RelatedCompanies_xml | – name: EMC IP Holding Company LLC |
Score | 3.2796159 |
Snippet | Estimated quantiles and/or percentiles for streaming data are computed over a sliding window. An exemplary method comprises obtaining a stream of data values;... |
SourceID | epo |
SourceType | Open Access Repository |
SubjectTerms | CALCULATING COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS |
Title | Methods and apparatus for computing estimated quantiles for streaming data over sliding windows |
URI | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20200616&DB=EPODOC&locale=&CC=US&NR=10685018B1 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NS8NAEB1K_bxpVbR-sILkFmyazdocitCkoQj9wLbSW9lsElAwiSalf9-ZNbVe9LpZlmRgMu8lb94A3PHwQSTctk3HcUKTI2U2pVRIVlzeiiIuQ6FHJwxHYjDnTwtnUYO3TS-M9glda3NEzCiF-V7q93W-_Yjla21lcR--4lL2GMy6vlGxY-LHljD8Xrc_Gftjz_C87nxqjJ4R64oOedf1kCntEIwmn_3-S4-6UvLfJSU4gt0JnpaWx1CL0wYceJvJaw3YH1Y_vBuwpxWaqsDFKguLE1gO9djngsk0YjLX7t2rgiH8ZEoPacByxMg9A9FoHLGPFUYPk_97BzWHyHfaQeJQRgpOhliTShhbI0HP1sUp3Ab9mTcw8Z6XPwFazqfbx7PPoJ5maXwOLGm7yo64K2Ucc2VZbsJ5S7ap_73jCGVdQPPvc5r_XbyEQwo2SaYscQX18nMVX2NxLsMbHdUvrliVIA |
link.rule.ids | 230,309,786,891,25594,76906 |
linkProvider | European Patent Office |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NT8JAEJ0Qv_CmqFH8WhPTWyOl24UeiAktBJUCETDcmu22JJpY0Jbw951ZQbzodbvZtJNM5732zRuAWx7VxJTbtuk4TmRypMymlArJissrccxlJPTohKAnOmP-OHEmBXhb98Jon9ClNkfEjFKY77l-X883H7F8ra3M7qJXXJrdt0cN31ixY-LHljD8ZqM16Pt9z_C8xnho9J4R64o6edc1kSlt18idl6DTS5O6Uua_S0r7AHYGeFqaH0IhSUtQ9NaT10qwF6x-eJdgVys0VYaLqyzMjiAM9NjnjMk0ZnKu3bsXGUP4yZQe0oDliJF7BqLRJGYfC4weJv_3DmoOke-0g8ShjBScDLEmlTC2RII-W2bHcNNujbyOifcc_gQoHA83j2efwFY6S5NTYNOqq-yYu1ImCVeW5U45r8gq9b_XHaGsMyj_fU75v4vXUOyMgm7Yfeg9ncM-BZ7kU5a4gK38c5FcYqHOoysd4S_RTJgN |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Apatent&rft.title=Methods+and+apparatus+for+computing+estimated+quantiles+for+streaming+data+over+sliding+windows&rft.inventor=Shachar%2C+Rafael&rft.inventor=Blatt%2C+Marcelo&rft.date=2020-06-16&rft.externalDBID=B1&rft.externalDocID=US10685018B1 |