Data stream processing method and system and computer equipment
The invention discloses a data stream processing method and system and computer equipment, and relates to the technical field of data processing.The method comprises the steps that function tasks are distributed to service data streams; carrying out parameter loading on each function task; judging w...
Saved in:
Main Authors | , , |
---|---|
Format | Patent |
Language | Chinese English |
Published |
06.01.2023
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | The invention discloses a data stream processing method and system and computer equipment, and relates to the technical field of data processing.The method comprises the steps that function tasks are distributed to service data streams; carrying out parameter loading on each function task; judging whether all the function tasks are completed or not; starting multi-thread sub-task allocation execution for the uncompleted function task until all the sub-tasks are completed; and cleaning and processing the service data flow and then inserting the service data flow into a database. Through the method provided by the invention, the full-flow processing of the business data flow from the beginning of collection to the end of storage can be realized, and the development cost can be greatly reduced.
本发明公开了一种数据流处理方法、系统及计算机设备,涉及数据处理技术领域,其中,所述方法包括:对业务数据流进行功能任务分配;对各所述功能任务进行参数装载;判断各所述功能任务是否全部完成;对未完成的所述功能任务启动多线程分配子任务执行,直至所述子任务全部完成;对所述业务数据流进行清洗及处理后插入数据库中。通过本发明的方法可实现业务数据流从开始收集到入库结束的全流程处理,可大幅降低开发成本。 |
---|---|
AbstractList | The invention discloses a data stream processing method and system and computer equipment, and relates to the technical field of data processing.The method comprises the steps that function tasks are distributed to service data streams; carrying out parameter loading on each function task; judging whether all the function tasks are completed or not; starting multi-thread sub-task allocation execution for the uncompleted function task until all the sub-tasks are completed; and cleaning and processing the service data flow and then inserting the service data flow into a database. Through the method provided by the invention, the full-flow processing of the business data flow from the beginning of collection to the end of storage can be realized, and the development cost can be greatly reduced.
本发明公开了一种数据流处理方法、系统及计算机设备,涉及数据处理技术领域,其中,所述方法包括:对业务数据流进行功能任务分配;对各所述功能任务进行参数装载;判断各所述功能任务是否全部完成;对未完成的所述功能任务启动多线程分配子任务执行,直至所述子任务全部完成;对所述业务数据流进行清洗及处理后插入数据库中。通过本发明的方法可实现业务数据流从开始收集到入库结束的全流程处理,可大幅降低开发成本。 |
Author | ZHAO SONGGENG ZHAO SHAOLING LIU JIANHAO |
Author_xml | – fullname: LIU JIANHAO – fullname: ZHAO SONGGENG – fullname: ZHAO SHAOLING |
BookMark | eNrjYmDJy89L5WSwd0ksSVQoLilKTcxVKCjKT04tLs7MS1fITS3JyE9RSMxLUSiuLC5JzQUzk_NzC0pLUosUUgtLMwtyU_NKeBhY0xJzilN5oTQ3g6Kba4izh25qQX58anFBYnJqXmpJvLOfoaGpqbmZmbmJozExagDA5zMO |
ContentType | Patent |
DBID | EVB |
DatabaseName | esp@cenet |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: EVB name: esp@cenet url: http://worldwide.espacenet.com/singleLineSearch?locale=en_EP sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine Chemistry Sciences Physics |
DocumentTitleAlternate | 一种数据流处理方法、系统及计算机设备 |
ExternalDocumentID | CN115576674A |
GroupedDBID | EVB |
ID | FETCH-epo_espacenet_CN115576674A3 |
IEDL.DBID | EVB |
IngestDate | Fri Jul 19 14:31:10 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | Chinese English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-epo_espacenet_CN115576674A3 |
Notes | Application Number: CN202211329240 |
OpenAccessLink | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230106&DB=EPODOC&CC=CN&NR=115576674A |
ParticipantIDs | epo_espacenet_CN115576674A |
PublicationCentury | 2000 |
PublicationDate | 20230106 |
PublicationDateYYYYMMDD | 2023-01-06 |
PublicationDate_xml | – month: 01 year: 2023 text: 20230106 day: 06 |
PublicationDecade | 2020 |
PublicationYear | 2023 |
RelatedCompanies | SHENZHEN TONGXUE TECHNOLOGY CO., LTD |
RelatedCompanies_xml | – name: SHENZHEN TONGXUE TECHNOLOGY CO., LTD |
Score | 3.5767112 |
Snippet | The invention discloses a data stream processing method and system and computer equipment, and relates to the technical field of data processing.The method... |
SourceID | epo |
SourceType | Open Access Repository |
SubjectTerms | CALCULATING COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS |
Title | Data stream processing method and system and computer equipment |
URI | https://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230106&DB=EPODOC&locale=&CC=CN&NR=115576674A |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8NAEB5qfd60KlofrCC5BdNkuyaHUOympQhNi1TprWTzoBVMo0kR_PXOblLrRW_LLAzDwOw8duYbgFtBA4GptKmbzGE6tWmsB8JI9Egutm0lVkIVdufQZ4Nn-jhtT2vwup6FUTihnwocES0qRHsv1HudbYpYnuqtzO_EAknLTn_ielqVHWM8jSmO5nXd3njkjbjGuct9zX9yMfDByJrd04ct2JZhtMTZ77105VRK9tul9A9hZ4zc0uIIal_zBuzz9ea1BuwNqw_vBuyqDs0wR2JlhfkxdLygCIic8gjeSFZ2-qMHIuU2aBKkESkBmtUxrPY2kPh9tVDdQSdw0-9N-EBHmWY_CphxfyO-dQr1dJnGZ0DssEUTYYUSRZ4mVtthsXAMx4zaTtSyDescmn_zaf53eQEHUpmq1MAuoV58rOIrdL6FuFZa-wbwuYg4 |
link.rule.ids | 230,309,786,891,25594,76906 |
linkProvider | European Patent Office |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8NAEB5qfdSbRkXrawXJLdg02zQ5hGI3LVXbtEiU3ko2D6xgGm2K4K93dptaL3pbZmEYBmbnsTPfAFxzGnBMpeta3bRNjVo01gJeS7RILLbVEyOhErtz4Jm9J3o_boxL8LqahZE4oZ8SHBEtKkR7z-V7na2LWK7srZzf8CmSZq2u77hqkR1jPI0pjuq2nc5o6A6ZypjDPNV7dDDwwcjabNLbDdhsCnReETo9t8VUSvbbpXT3YGuE3NJ8H0pfLwpU2GrzmgI7g-LDW4Ft2aEZzpFYWOH8AFpukAdETHkEbyRbdvqjByLLbdAkSCOyBGiWx7DY20Di98VUdgcdwlW347OehjJNfhQwYd5afOMIyuksjY-BWKFOE26EAkWeJkbDNmNu1-x61LAj3aoZJ1D9m0_1v8tLqPT8QX_Sv_MeTmFXKFaWHcwzKOcfi_gcHXHOL6QGvwF4kYsl |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Apatent&rft.title=Data+stream+processing+method+and+system+and+computer+equipment&rft.inventor=LIU+JIANHAO&rft.inventor=ZHAO+SONGGENG&rft.inventor=ZHAO+SHAOLING&rft.date=2023-01-06&rft.externalDBID=A&rft.externalDocID=CN115576674A |