Soft real-time load balancer
The present disclosure is based on a multi-core or multi-processor virtualized environment that comprises both time-sensitive and non-time-sensitive tasks. The present disclosure describes techniques that use a plurality of criteria to choose a processing resource that is to execute tasks. The prese...
Saved in:
| Main Authors | , , , , |
|---|---|
| Format | Patent |
| Language | English |
| Published |
17.04.2012
|
| Online Access | Get full text |
Cover
Loading…
| Abstract | The present disclosure is based on a multi-core or multi-processor virtualized environment that comprises both time-sensitive and non-time-sensitive tasks. The present disclosure describes techniques that use a plurality of criteria to choose a processing resource that is to execute tasks. The present disclosure further describes techniques to re-schedule queued tasks from one processing resource to another processing resource, based on a number of criteria. Through load balancing techniques, the present invention both (i) favors the processing of soft real-time tasks arising from media servers and applications, and (ii) prevents "starvation" of the non-real-time general computing applications that co-exist with the media applications in a virtualized environment. These techniques, in the aggregate, favor the processing of soft real-time tasks while also reserving resources for non-real-time tasks. These techniques manage multiple processing resources to balance the competing demands of soft real-time tasks and of non-real-time tasks. |
|---|---|
| AbstractList | The present disclosure is based on a multi-core or multi-processor virtualized environment that comprises both time-sensitive and non-time-sensitive tasks. The present disclosure describes techniques that use a plurality of criteria to choose a processing resource that is to execute tasks. The present disclosure further describes techniques to re-schedule queued tasks from one processing resource to another processing resource, based on a number of criteria. Through load balancing techniques, the present invention both (i) favors the processing of soft real-time tasks arising from media servers and applications, and (ii) prevents "starvation" of the non-real-time general computing applications that co-exist with the media applications in a virtualized environment. These techniques, in the aggregate, favor the processing of soft real-time tasks while also reserving resources for non-real-time tasks. These techniques manage multiple processing resources to balance the competing demands of soft real-time tasks and of non-real-time tasks. |
| Author | Singh, Navjot Lee, Min Krishnakumar, Anjur Sundaresan Yajnik, Shalini Krishnan, Parameshwaran |
| Author_xml | – sequence: 1 givenname: Anjur Sundaresan surname: Krishnakumar fullname: Krishnakumar, Anjur Sundaresan – sequence: 2 givenname: Parameshwaran surname: Krishnan fullname: Krishnan, Parameshwaran – sequence: 3 givenname: Min surname: Lee fullname: Lee, Min – sequence: 4 givenname: Navjot surname: Singh fullname: Singh, Navjot – sequence: 5 givenname: Shalini surname: Yajnik fullname: Yajnik, Shalini |
| BookMark | eNrjYmDJy89L5WSQCc5PK1EoSk3M0S3JzE1VyMlPTFFISsxJzEtOLeJhYE1LzClO5YXS3AwKbq4hzh66pcUFiSWpeSXF8elFiSDKwMLQzNDE0tCYCCUALVYl_w |
| ContentType | Patent |
| CorporateAuthor | Avaya Inc |
| CorporateAuthor_xml | – name: Avaya Inc |
| DBID | EFH |
| DatabaseName | USPTO Issued Patents |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: EFH name: USPTO Issued Patents url: http://www.uspto.gov/patft/index.html sourceTypes: Open Access Repository |
| DeliveryMethod | fulltext_linktorsrc |
| ExternalDocumentID | 08161491 |
| GroupedDBID | EFH |
| ID | FETCH-uspatents_grants_081614913 |
| IEDL.DBID | EFH |
| IngestDate | Mon Mar 06 18:58:40 EST 2023 |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-uspatents_grants_081614913 |
| OpenAccessLink | https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8161491 |
| ParticipantIDs | uspatents_grants_08161491 |
| PatentNumber | 8161491 |
| PublicationCentury | 2000 |
| PublicationDate | 20120417 |
| PublicationDateYYYYMMDD | 2012-04-17 |
| PublicationDate_xml | – month: 04 year: 2012 text: 20120417 day: 17 |
| PublicationDecade | 2010 |
| PublicationYear | 2012 |
| References | Xen.Org, "Credit-Based CPU Scheduler", "Xen Wiki http://www.wiki.xensource.com/xenwiki/CreditScheduler Jun. 23, 2010", Nov. 15, 2007, Publisher: Citrix Systems, Inc. Bekooij (2008/0022288) 20080100 Santos et al., "Bridging the Gap between Software and Hardware Techniques for I/O Virtualization", "2008 USENIX Annual Technical Conference http:www.usenix.org/events/usenix08/tech/ful-papers/santos/santos.pdf", , Publisher: USENIX Association. Altmejd et al. (6795927) 20040900 McCarthy et al. (7140020) 20061100 Lee et al, Supporting Soft real-Time tasks in the Xen Hypervisor, VEE'10. Palmer et al. (2008/0141048) 20080600 Xen Credit-Based CPU Scheduler, http://wiki.xensource.com/xenwiki/CreditScheduler[Apr. 27, 2010]. Arnt et al. (7743140) 20100600 Mastronarde et al. (7035984) 20060400 Brenner (7065766) 20060600 Brenner et al. (2003/0236815) 20031200 Balasubramanian (6687257) 20040200 Mathai,Jacob, "Xen Wiki-Xen Scheduling", "http://wiki.xensource.com/xenwiki/Scheduling[Nov. 23, 2009 11:44:24 AM]", Jun. 9, 2007. Fedorova (2008/0134185) 20080600 Liu et al., "High Performance VMM-Bypass I/O in Virtual Machines", "Annual Tech '06: 2006 USENIX Annual Technical Conference http://www.usenix.org/events/usenix06/tech/full-papers/liu/liu.pdf", , Publisher: USENIX Association. Yoo et al., "A Step to Support Real-time in Virtual Machine", "http://os.korea.ac.kr/publication-papers/inter-confer/shyoo-CCNC-2009.pdf", 2009, Publisher: IEEE Xplore. Cascaval et al. (2008/0059968) 20080300 Brenner et al. (2003/0110204) 20030600 Govindan et al., "Xen and Co.: Communication-aware CPU Scheduling for Consolidated Xen-based Hosting Platforms", "Virtual Execution Environments 2007 San Diego, California", Jun. 13-15, 2007, Publisher: Association for Computing Machinery. Xen Hypervisor-leading Open Source Hypervisor for Servers, http://www.xen.org/products/xenhyp.html[Apr. 27, 2010]. (1536335) 20050600 Liao et al, "Software Techniques to Improve Virtualized I/O Performance on Multi-Core Systems", "ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS) 2008 San Jose, California", Nov. 6-7, 2008, Publisher: Association for Computing Machinery. Singh et al. (2010/0125851) 20100500 "How Does Xen Work", "http://www.xen.org/files/Marketing/HowDoesXenWork.pdf Jun. 23, 2010", Dec. 2009. Thibault, Samuel, "Stub Domains-A Step Towards Dom0 Disaggregation", "http://www.xen.org/files/ xensummitboston08/SamThibault-XenSummit.pdf", , Publisher: Xen Summit. Willen et al. (2004/0054999) 20040300 Cherkasova et al. (2008/0022284) 20080100 "Xen Summit Asia 2008", "http://www.xen.org/xensummit/xensummit-fall-2008.html[Nov. 23, 2009 11:23:18 AM]", Nov. 20-21, 2008, Publisher: xen.org. Stackhouse et al. (7437728) 20081000 Esfahany et al. (7979863) 20110700 Willmann et al., "Concurrent Direct Network Access for Virtual Machine Monitors", "HPCA 2007". Calandrino et al., "Soft Real-Time Scheduling on Performance Asymmetric Multicore Platforms". Gupta et al, "XenMon: QoS Monitoring and Performance Profiling Tool", "Technical Report HPL-2005-187", Oct. 18, 2005, Publisher: Hewlett-Packard Development Company, LP. Raj et al., "High Performance and Scalable I/O Virtualization via Self-Virtualized Devices", "IEEE International Symposium on High Performance Distributed Computing (HPDC) 2007 Monterrey, California", Jun. 25-29, 2007, Publisher: Association for Computing Machinery. Kagi et al. (7797699) 20100900 Tobias et al. (2007/0283176) 20071200 U.S. Appl. No. 12/686,719, filed Jan. 13, 2010. Zhang et al., "Optimizing Xen VMM Based on Intel Virtualizatio Technology", "2008 International Conference on Internet Computing in Science and Engineering", 2008, Publisher: IEEE Xplore. Wikipedia online, Multiprocessor Scheduling, http://en.wikipedia.org/wiki/Multiprocessor-scheduling[Apr. 27, 2010]. "How to Enable Xentrace Logging and Format With Xentrace-Format", "Citrix Knowledge Center CTX121583 http://support.citrix.com/article/CTX121583", , Publisher: Citrix Systems, Inc. "Bin packing problem", "Wikipedia http://www.wikipedia.org/wiki/Bin-packing-problem", May 31, 2010, Publisher: Wikimedia Foundation, Inc. Kim et al. "Guest-Aware Priority-Based Virtual Machine Scheduling for Highly Consolidated Server," 2008, pp. 285-294. Kim et al., "Task-aware Virtual Machine Scheduling for I/O Performance", "Virtual Execution Environments 2009 Washington, DC", Mar. 11-13, 2009, Publisher: Association for Computing Machinery. Malkevitch, Joseph, "Bin Packing, Feature Column Archive, American Mathematical Society" "http://www.ams.org/featurecolumn/archive/bins1.html[Apr. 27, 2010]". Zolnowsky (6779182) 20040800 Kubala et al. (6985951) 20060100 Oi et al., "Performance Analysis of Large Receive Offload in a Xen Virtualized System", "2009 International Conference on Computer Engineering and Technology", 2009, Publisher: IEEE Xplore. Chekuri et al. (6779183) 20040800 Harrison et al. (5701482) 19971200 Menon et al., "Optimizing Network Virtualization in Xen", (Alternative Source). Brenner et al. (6658449) 20031200 Ongaro et al., "Scheduling I/O in Virtual Machine Monitors", "Virtual Execution Environments 2008 Seattle, Washington", Mar. 5-7, 2008, Publisher: Associaton for Computing Machinery. Chen et al. (5392430) 19950200 Candan et al. (2005/0091399) 20050400 Brenner et al. (2003/0195920) 20031000 Savoor et al. (2009/0077257) 20090300 Patnaik et al., "Performance Implications of Hosting Enterprise Telephony Application on Virtualized Multi-Core Platforms", "IPTCOMM 2009 Conference Georgia Tech Atlanta, Georgia", Jul. 7-8, 2009, Publisher: Association for Computing Machinery, Published in: US. Houlihan et al. (2008/0320122) 20081200 Malkevitch, Joseph, "Bin Packing and Machine Scheduling, Feature Column Archive, American Mathematical Society, "https://www.ams/org/samplings/feature-column/fcarc-packings1[Apr. 27, 2010]. Apparao et al., "Characterization of network processing overheads in Xen", "Second Annual Workshop on Virtualization Technology in Distributed Computing (VTDC 2006)", 2006, Publisher: IEEE. Menon et al., "Optimizing Network Virtualization in Xen", "http://www.usenix.org/events/usenix06/tech/menon/menon-html/paper.html", http://infoscience.epfl.ch/getfile.py?docid=8044&name=usenix06&format=pdf&version=1, 2006. Branda et al. (7904691) 20110300 Gopalan et al. (2009/0031317) 20090100 Cofer et al. (2005/0028160) 20050200 Riska et al. (7904673) 20110300 Haeri (7793294) 20100900 Barham et al., "Xen and the Art of Virtualization", "Symposium on Operating System Principles 2003 Bolton Landing, New York http://www.cl.cam.ac.uk/research/srg/netos/papers/2003-xensosp.pdf", Oct. 19-22, 2003, Publisher: Association for Computing Machinery, Published in: US. Greene et al. (2010/0100877) 20100400 Brent et al. (2010/0131955) 20100500 Sugumar et al. (7673113) 20100300 Tannenbatum et al. "Condor-A Distributed Job Scheduler", ACM, 2001, p. 1-44. "Series P: Telephone Transmission Quality, Telephone Installations, Local Line Networks ", "ITU-T Recommendation P.862", Feb. 2001. Nishiguchi, Naoki, "Evaluation and consideration of credit scheduler for client virtualization", "http://www.xen.org/files/xensummit-tokyo/15/NaokiNishiguchi-en.pdf Other info at http:www.xen.org/xensummit/xensummit-fall-2008. html", 2008, Publisher: Fujitsu Laboratories Limited. Brenner et al. (2003/0191794) 20031000 Rhine (2006/0195845) 20060800 Ackaouy, Emmanuel, "[Xen-devel] New CPU scheduler w/ SMP load balancer", "http://lists.xensource.com/archives/html/xen-devel/2006-05/msg01315.html", May 36, 2006, Publisher: xensource.com. "P.862 Perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of", 2008, Publisher: International Telecommunication Union (ITU). Menon et al., "Diagnosing Performance Overheads in the Xen Virtual Machine Environment", "http://www.hpl.hp.com/techreports/2005/HPL-2005-80.pdf", 2005, Publisher: Association for Computing Machinery. Cleary et al. (2004/0148390) 20040700 Brenner et al. (2003/0110203) 20030600 Apparao et al., "Characterization & Analysis of a Server Consolidation Benchmark", "Virtual Execution Environments Conference 2008 Seattle, Washington", Mar. 5-7, 2008, Publisher: Association for Computing Machinery. |
| References_xml | – year: 20071200 ident: 2007/0283176 contributor: fullname: Tobias et al. – year: 19950200 ident: 5392430 contributor: fullname: Chen et al. – year: 20060400 ident: 7035984 contributor: fullname: Mastronarde et al. – year: 20040300 ident: 2004/0054999 contributor: fullname: Willen et al. – year: 20040800 ident: 6779183 contributor: fullname: Chekuri et al. – year: 20050400 ident: 2005/0091399 contributor: fullname: Candan et al. – year: 20040700 ident: 2004/0148390 contributor: fullname: Cleary et al. – year: 20100900 ident: 7793294 contributor: fullname: Haeri – year: 20080100 ident: 2008/0022288 contributor: fullname: Bekooij – year: 20050200 ident: 2005/0028160 contributor: fullname: Cofer et al. – year: 20030600 ident: 2003/0110204 contributor: fullname: Brenner et al. – year: 20040900 ident: 6795927 contributor: fullname: Altmejd et al. – year: 20100500 ident: 2010/0131955 contributor: fullname: Brent et al. – year: 20081000 ident: 7437728 contributor: fullname: Stackhouse et al. – year: 20080600 ident: 2008/0134185 contributor: fullname: Fedorova – year: 20100900 ident: 7797699 contributor: fullname: Kagi et al. – year: 20100500 ident: 2010/0125851 contributor: fullname: Singh et al. – year: 20040200 ident: 6687257 contributor: fullname: Balasubramanian – year: 20060600 ident: 7065766 contributor: fullname: Brenner – year: 20060100 ident: 6985951 contributor: fullname: Kubala et al. – year: 20050600 ident: 1536335 – year: 20100600 ident: 7743140 contributor: fullname: Arnt et al. – year: 20110700 ident: 7979863 contributor: fullname: Esfahany et al. – year: 20110300 ident: 7904673 contributor: fullname: Riska et al. – year: 20031200 ident: 2003/0236815 contributor: fullname: Brenner et al. – year: 20080100 ident: 2008/0022284 contributor: fullname: Cherkasova et al. – year: 20100300 ident: 7673113 contributor: fullname: Sugumar et al. – year: 20090300 ident: 2009/0077257 contributor: fullname: Savoor et al. – year: 19971200 ident: 5701482 contributor: fullname: Harrison et al. – year: 20080600 ident: 2008/0141048 contributor: fullname: Palmer et al. – year: 20080300 ident: 2008/0059968 contributor: fullname: Cascaval et al. – year: 20030600 ident: 2003/0110203 contributor: fullname: Brenner et al. – year: 20031000 ident: 2003/0191794 contributor: fullname: Brenner et al. – year: 20090100 ident: 2009/0031317 contributor: fullname: Gopalan et al. – year: 20040800 ident: 6779182 contributor: fullname: Zolnowsky – year: 20081200 ident: 2008/0320122 contributor: fullname: Houlihan et al. – year: 20060800 ident: 2006/0195845 contributor: fullname: Rhine – year: 20100400 ident: 2010/0100877 contributor: fullname: Greene et al. – year: 20110300 ident: 7904691 contributor: fullname: Branda et al. – year: 20031200 ident: 6658449 contributor: fullname: Brenner et al. – year: 20061100 ident: 7140020 contributor: fullname: McCarthy et al. – year: 20031000 ident: 2003/0195920 contributor: fullname: Brenner et al. |
| Score | 2.8439927 |
| Snippet | The present disclosure is based on a multi-core or multi-processor virtualized environment that comprises both time-sensitive and non-time-sensitive tasks. The... |
| SourceID | uspatents |
| SourceType | Open Access Repository |
| Title | Soft real-time load balancer |
| URI | https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8161491 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3BSgMxEB1qEdSTomJrlRy8RuN20mzOpcsiKIVW6K1kN1kvdVt2t_j7zmxL8VKvCbwkDJl5Q95MAJ5cQBPn1shc-0hirry0qMkgOtghjjA4w7XD7x-j9BPfFnrRgfRQC_NN10huaC_187beNOtWXEnufWd4uWv-zD0CS-4-8FOu1s5PffESE3VBLmM_iRVL-yZJegFnBEGUrWzqP0EjuYTTaTt6BZ1QXsNgRh5PEEdbSf7QXTCkyFhZmIfqBkQymY9TeYBaflUsUVmq_ZLDW-hSqh7uQBD78GSaAq1RiM7FlKNlIVLGF9pGJvSgdxSm_8_cPZxToI74FePVDKDbVNvwQMGwyR7bk_4CWj1pCg |
| link.rule.ids | 230,309,783,805,888,64367 |
| linkProvider | USPTO |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NT8MwDLWmgWCcQIAYbJAD10DpnKY5s1Xla6oESLtVaZNyGd3UduLvz-nQtAtcE-klkRW_Z8V2AG61RRnmSvJcGJ9j7hmuUJBBhFUjDNBq6WqH36ZB_InPMzHrQLythfmma8SXtJf6blUvm0WbXEnufWN4vmn-7HoElq77wE85X2iTmOI-JOmCrox9jzg2aEOyKD6CQwIh0VY29Q5tRMewn7SjJ9Cx5SkM3snnMVJpc-6-dGcOlGUutzC31RmwaPLxGPMtVPpVuSSV1PtddHQOXQrW7QUw0h-GjFOgkh6i1iFFaZn1PWkKoXxp-9D_E-byn7kbOEjGUfr6NH25gh6xtu-eNB7kALpNtbJDYsYmu24PvQazLWwH |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Apatent&rft.title=Soft+real-time+load+balancer&rft.inventor=Krishnakumar%2C+Anjur+Sundaresan&rft.inventor=Krishnan%2C+Parameshwaran&rft.inventor=Lee%2C+Min&rft.inventor=Singh%2C+Navjot&rft.inventor=Yajnik%2C+Shalini&rft.number=8161491&rft.date=2012-04-17&rft.externalDBID=n%2Fa&rft.externalDocID=08161491 |