Weighted locality-sensitive scheduling for mitigating noise on multi-core clusters
Recent studies have shown that operating system (OS) interference, popularly called OS noise can be a significant problem as we scale to a large number of processors. One solution for mitigating noise is to turn off certain OS services on the machine. However, this is typically infeasible because fu...
Saved in:
Published in | 2011 18th International Conference on High Performance Computing pp. 1 - 10 |
---|---|
Main Authors | , , |
Format | Conference Proceeding |
Language | English |
Published |
IEEE
01.12.2011
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Recent studies have shown that operating system (OS) interference, popularly called OS noise can be a significant problem as we scale to a large number of processors. One solution for mitigating noise is to turn off certain OS services on the machine. However, this is typically infeasible because full-scale OS services may be required for some applications. Furthermore, it is not a choice that an end user can make. Thus, we need an application-level solution. Building upon previous work that demonstrated the utility of within-node light-weight load balancing, we discuss the technique of weighted micro-scheduling and provide insights based on experimentation for two different machines with very different noise signatures. Through careful enumeration of the search space of scheduler parameters, we allow our weighted micro-scheduler to be dynamic, adaptive and tunable for a specific application running on a specific architecture. By doing this, we show how we can enable running scientific applications efficiently on a very large number of processors, even in the presence of noise. |
---|---|
AbstractList | Recent studies have shown that operating system (OS) interference, popularly called OS noise can be a significant problem as we scale to a large number of processors. One solution for mitigating noise is to turn off certain OS services on the machine. However, this is typically infeasible because full-scale OS services may be required for some applications. Furthermore, it is not a choice that an end user can make. Thus, we need an application-level solution. Building upon previous work that demonstrated the utility of within-node light-weight load balancing, we discuss the technique of weighted micro-scheduling and provide insights based on experimentation for two different machines with very different noise signatures. Through careful enumeration of the search space of scheduler parameters, we allow our weighted micro-scheduler to be dynamic, adaptive and tunable for a specific application running on a specific architecture. By doing this, we show how we can enable running scientific applications efficiently on a very large number of processors, even in the presence of noise. |
Author | Bhatele, A. Kale, V. Gropp, W. D. |
Author_xml | – sequence: 1 givenname: V. surname: Kale fullname: Kale, V. email: vivek@illinois.edu organization: Dept. of Comput. Sci., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA – sequence: 2 givenname: A. surname: Bhatele fullname: Bhatele, A. email: bhatele@llnl.gov organization: Center for Appl. Sci. Comput., Lawrence Livermore Nat. Lab., Livermore, CA, USA – sequence: 3 givenname: W. D. surname: Gropp fullname: Gropp, W. D. email: wgropp@illinois.edu organization: Dept. of Comput. Sci., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA |
BookMark | eNpFUMFKAzEUjFrBtvYDxEt-IDXvZZO3OUqxVigoUvBYttm3bWS7K5ut0L-3YsG5DDPDzGFGYtC0DQtxB3oKoP3DIr7NpqgBpg4sEuKFGEFmicBb7S_FEF2mlTbgrv4DoIEYntqZIrTuRkxS-tQnOOfBZkPx_sFxu-u5lHUbijr2R5W4SbGP3yxT2HF5qGOzlVXbyf3J3Rb9r2zamFi2jdwf6j6q0HYsQ31IPXfpVlxXRZ14cuaxWM2fVrOFWr4-v8welyqCMagyRCgsVZQbDYjoKZiNQYOBnKYyVJ4pz53dgCciX9pca8qsC7ryxgYzFvd_s5GZ119d3BfdcX2-xvwA7RhUlw |
ContentType | Conference Proceeding |
DBID | 6IE 6IL CBEJK RIE RIL |
DOI | 10.1109/HiPC.2011.6152722 |
DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Xplore url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Computer Science |
EISBN | 1457719509 9781457719493 9781457719509 1457719495 |
EISSN | 2640-0316 |
EndPage | 10 |
ExternalDocumentID | 6152722 |
Genre | orig-research |
GroupedDBID | 29H 29O 6IE 6IF 6IL 6IN ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK OCL RIE RIL |
ID | FETCH-LOGICAL-i1332-4221a57f7830122297c3b3232c7607dcf9e78865b197779d58007456c0f935c3 |
IEDL.DBID | RIE |
ISBN | 1457719517 9781457719516 |
ISSN | 1094-7256 |
IngestDate | Wed Jun 26 19:28:26 EDT 2024 |
IsDoiOpenAccess | false |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | true |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-i1332-4221a57f7830122297c3b3232c7607dcf9e78865b197779d58007456c0f935c3 |
OpenAccessLink | https://www.osti.gov/biblio/1093933 |
PageCount | 10 |
ParticipantIDs | ieee_primary_6152722 |
PublicationCentury | 2000 |
PublicationDate | 2011-Dec. |
PublicationDateYYYYMMDD | 2011-12-01 |
PublicationDate_xml | – month: 12 year: 2011 text: 2011-Dec. |
PublicationDecade | 2010 |
PublicationTitle | 2011 18th International Conference on High Performance Computing |
PublicationTitleAbbrev | HiPC |
PublicationYear | 2011 |
Publisher | IEEE |
Publisher_xml | – name: IEEE |
SSID | ssj0000669154 ssj0020125 |
Score | 1.8319602 |
Snippet | Recent studies have shown that operating system (OS) interference, popularly called OS noise can be a significant problem as we scale to a large number of... |
SourceID | ieee |
SourceType | Publisher |
StartPage | 1 |
SubjectTerms | Dynamic scheduling Load management Noise Operating systems Processor scheduling Program processors Tuning |
Title | Weighted locality-sensitive scheduling for mitigating noise on multi-core clusters |
URI | https://ieeexplore.ieee.org/document/6152722 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV09T8MwELVKJ6YCLeJbHhhxGyd2HM8VqEIqqlAR3arauUoRkCLaLPx67py0CMTAFkeRkjjOvXe-u3eMXSMsUMFnJHLrY6Fy5YRFoyhIrCgDqUCmVDs8fkhHT-p-pmctdrOrhQGAkHwGfToMsfx85SvaKhuk1IM1RoO7l0VxXau1209B6LSSoLFxttDw6hDptEoYxPVQ1KWNkUgpzFbrqRmnTbgTLx6MismwVvZs7vaj7UpAnbsOG2-ft042eelXG9f3n7-kHP_7Qges913fxyc75DpkLSiPWGfb4IE3_3uXPT6HjVPIeYA8JOxiTQnvZCI5usUIU1TNzpH48reiVuvAYbkq1sBXJQ_ZioKEMrl_rUiSYd1j07vb6XAkmiYMokD3FT9fHMuFNkuTJRSFi63xiUuQh3mTRib3SwvoRafaSWSSxuY6I1aiUx8tcQ345Ji1y1UJJ4xb0kZD_rXQEpSJMhcryNXC2QQyr6U7ZV2aofl7LbMxbybn7O_T52w_bO-GzJIL1t58VHCJ_GDjrsLC-AL2MbDD |
link.rule.ids | 310,311,786,790,795,796,802,27958,55109 |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV09T8MwELWqMsBUoEV844ERt3ESx_FcUQVoqwoV0a2qHVeKgATRZuHXc-ekRSAGtjiKlMRx7r3z3b0j5BpgAQs-PZYq47MwDTVTYBQZihXFloeWR1g7PBpHyVN4PxOzBrnZ1sJYa13yme3ioYvlp4UpcausF2EPVh8M7g7gvKeqaq3tjgqAp-IIjrW7BaZXuFinCpkEZHdlXUJKDqRCbtSe6nFUBzzh4l6STfqVtmd9vx-NVxzuDFpktHniKt3kpVuuddd8_hJz_O8r7ZPOd4UfnWyx64A0bH5IWpsWD7T-49vk8dltndqUOtADys5WmPKORpKCYwxAhfXsFKgvfcsqvQ4Y5kW2srTIqctXZCiVSc1riaIMqw6ZDm6n_YTVbRhYBg4sfEDf5wshlzIOMA7nK2kCHQATMzLyZGqWyoIfHQnNgUtKlYoYeYmIjLeEVWCCI9LMi9weE6pQHQ0Y2EJwG0ov1n5o03ChVWBjI7g-IW2cofl7JbQxryfn9O_TV2Q3mY6G8-Hd-OGM7LnNXpdnck6a64_SXgBbWOtLt0i-AIMWtBk |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2011+18th+International+Conference+on+High+Performance+Computing&rft.atitle=Weighted+locality-sensitive+scheduling+for+mitigating+noise+on+multi-core+clusters&rft.au=Kale%2C+V.&rft.au=Bhatele%2C+A.&rft.au=Gropp%2C+W.+D.&rft.date=2011-12-01&rft.pub=IEEE&rft.isbn=9781457719516&rft.issn=1094-7256&rft.eissn=2640-0316&rft.spage=1&rft.epage=10&rft_id=info:doi/10.1109%2FHiPC.2011.6152722&rft.externalDocID=6152722 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1094-7256&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1094-7256&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1094-7256&client=summon |