An Adaptive Resource Sharing Platform for Internet Data Center
Internet applications are diverse, such as online web services, offline data analysis jobs and so on. To make different types of applications work effectively, many programming models and computing frameworks are designed, such as MapReduce, Dryad, and Hadoop. How to support the emerging application...
Saved in:
Published in | 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing pp. 1179 - 1186 |
---|---|
Main Authors | , , , |
Format | Conference Proceeding |
Language | English |
Published |
IEEE
01.11.2013
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Internet applications are diverse, such as online web services, offline data analysis jobs and so on. To make different types of applications work effectively, many programming models and computing frameworks are designed, such as MapReduce, Dryad, and Hadoop. How to support the emerging applications and computing frameworks with high resource utilization is a serious challenge. In this paper, we present a resource sharing platform which can support different types of applications and computing frameworks by adopting a job-resource description protocol. To improve the resource utilization without impairing the performances of applications, we propose a job-resource matching algorithm, called JRMatching, which deploys those different types of jobs on one node hybridly to reduce resource fragments, and a mechanism to provide resources adaptively, which can reduce resource waste caused by fixed resource allocation. The experiments show that the performances of applications sharing resources in one node are close to running exclusively and the resource utilization of the internet data center also can be improved. |
---|---|
AbstractList | Internet applications are diverse, such as online web services, offline data analysis jobs and so on. To make different types of applications work effectively, many programming models and computing frameworks are designed, such as MapReduce, Dryad, and Hadoop. How to support the emerging applications and computing frameworks with high resource utilization is a serious challenge. In this paper, we present a resource sharing platform which can support different types of applications and computing frameworks by adopting a job-resource description protocol. To improve the resource utilization without impairing the performances of applications, we propose a job-resource matching algorithm, called JRMatching, which deploys those different types of jobs on one node hybridly to reduce resource fragments, and a mechanism to provide resources adaptively, which can reduce resource waste caused by fixed resource allocation. The experiments show that the performances of applications sharing resources in one node are close to running exclusively and the resource utilization of the internet data center also can be improved. |
Author | Dan Meng Bibo Tu Qing Li Yong Li |
Author_xml | – sequence: 1 surname: Qing Li fullname: Qing Li email: liqing@ncic.ac.cn organization: Inst. of Comput. Technol., Beijing, China – sequence: 2 surname: Yong Li fullname: Yong Li email: liyong@ncic.ac.cn organization: Inst. of Comput. Technol., Beijing, China – sequence: 3 surname: Bibo Tu fullname: Bibo Tu email: tubibo@iie.ac.cn organization: Inst. of Comput. Technol., Beijing, China – sequence: 4 surname: Dan Meng fullname: Dan Meng email: mengdan@iie.ac.cn organization: Inst. of Comput. Technol., Beijing, China |
BookMark | eNotjM1KAzEYACMoqHWfQIS8wK7J5v8iLLHaQsGi9VyS9IsG2mzJRsG3V9HLDHOZS3SaxwwI3VDSUUrM7WJtbefyrpu_2q4nlHVUqhPUGKWJkkYIorU8R800JU96qSQzylyguyHjYeeONX0CfoZp_CgB8Mu7Kym_4fXe1TiWA_4BXuYKJUPF9646bOE3r9BZdPsJmn_P0OZhvrGLdvX0uLTDqk1Uidp64kOgMlLNdfSEcGFo4ELwyHsCQUTutaFMQfSKqd5JJqlzQTolOI-RzdD13zYBwPZY0sGVr63UrCfcsG-0-UoP |
CODEN | IEEPAD |
ContentType | Conference Proceeding |
DBID | 6IE 6IL CBEJK RIE RIL |
DOI | 10.1109/HPCC.and.EUC.2013.167 |
DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
EISBN | 9780769550886 0769550886 |
EndPage | 1186 |
ExternalDocumentID | 6832049 |
Genre | orig-research |
GroupedDBID | 6IE 6IL ALMA_UNASSIGNED_HOLDINGS CBEJK RIB RIC RIE RIL |
ID | FETCH-LOGICAL-i175t-b0bcc16f1848fb004591c4554f420ec5f4b89137efb7372a6361aac6a7544ff3 |
IEDL.DBID | RIE |
IngestDate | Wed Dec 20 05:19:06 EST 2023 |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-i175t-b0bcc16f1848fb004591c4554f420ec5f4b89137efb7372a6361aac6a7544ff3 |
PageCount | 8 |
ParticipantIDs | ieee_primary_6832049 |
PublicationCentury | 2000 |
PublicationDate | 2013-Nov. |
PublicationDateYYYYMMDD | 2013-11-01 |
PublicationDate_xml | – month: 11 year: 2013 text: 2013-Nov. |
PublicationDecade | 2010 |
PublicationTitle | 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing |
PublicationTitleAbbrev | hpcc_euc |
PublicationYear | 2013 |
Publisher | IEEE |
Publisher_xml | – name: IEEE |
SSID | ssib026763979 |
Score | 1.558101 |
Snippet | Internet applications are diverse, such as online web services, offline data analysis jobs and so on. To make different types of applications work effectively,... |
SourceID | ieee |
SourceType | Publisher |
StartPage | 1179 |
SubjectTerms | Arrays Games internet data center job-resource description protocol job-resource matching algorithm Protocols Resource management resource utilization scalability Servers Web services |
Title | An Adaptive Resource Sharing Platform for Internet Data Center |
URI | https://ieeexplore.ieee.org/document/6832049 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Na8JAEB3UU09t0dJv9tBjE7Nx3WQvBUkVKVg8KHiT2XUXSksUWS_99Z1N1NLSQy8hhJBkvzJv38ybAXhAleYSjYu05iIiRExrjqx4pIzRmGeKLESgBiavcjwXL4v-ogGPRy2MtbYKPrNxOK18-au12QWqrCtp-hGibUIzT9Jaq3WYO6nMKhfVXqTDE9UdT4sipu14PJwXIYarF3P5s4hKZUNGpzA5vL0OHXmPd17H5vNXYsb_ft4ZdL7Vemx6tEPn0LBlG54GJRuscBP-ZuzA0bOQnpnuYdMP9AGtMjqwmhS0nj2jRxboXrvtwGw0nBXjaF8rIXojAOAjnWhjuHS0YctdWIp9xY0grOBEmljTd0IHh2RmnQ6FaVD2JEc0EkMCPOd6F9Aq16W9BJai5gpljjRUgkBtnjjUigudWHqGwytoh6YvN3U2jOW-1dd_X76Bk9D1tXrvFlp-u7N3ZMa9vq_G7wtVHJzx |
link.rule.ids | 310,311,786,790,795,796,802,27958,55109 |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3NT8IwFH9BPOhJDRi_7cGjG-soZbuYkAmZCoQDJNzIa2kTIxmEjIt_va8bYDQevCzNtmxtXtvfr-8T4AHjMJKoracUFx4xYlpzhOJerLXCqB0TQjjVwGAo04l4nbamFXjcx8IYYwrnM-O7ZmHLny_1xqnKGpKmHzHaAzgknA_iMlprN3tC2S6MVNswHXreSEdJ4tOB3O9OEufF1fS5_FlGpUCR3gkMdv8vnUc-_E2ufP35KzXjfzt4CvXveD022iPRGVRMVoOnTsY6c1y5_YzttPTMJWimd9hogbnjq4wurFQLmpw9Y47MKXzNug7jXnecpN62WoL3ThQg91SgtObS0pEtsm4xtmKuBbEFK8LA6JYVypkk28YqV5oGZVNyRC3RpcCztnkO1WyZmQtgISoeo4yQhCWI1kaBRRVzoQJD37B4CTU39NmqzIcx24766u_b93CUjgf9Wf9l-HYNx04MZSzfDVTz9cbcEqjn6q6Q5RfP0aBH |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2013+IEEE+10th+International+Conference+on+High+Performance+Computing+and+Communications+%26+2013+IEEE+International+Conference+on+Embedded+and+Ubiquitous+Computing&rft.atitle=An+Adaptive+Resource+Sharing+Platform+for+Internet+Data+Center&rft.au=Qing+Li&rft.au=Yong+Li&rft.au=Bibo+Tu&rft.au=Dan+Meng&rft.date=2013-11-01&rft.pub=IEEE&rft.spage=1179&rft.epage=1186&rft_id=info:doi/10.1109%2FHPCC.and.EUC.2013.167&rft.externalDocID=6832049 |