Asymmetric Random Projections

Random projections (RP) are a popular tool for reducing dimensionality while preserving local geometry. In many applications the data set to be projected is given to us in advance, yet the current RP techniques do not make use of information about the data. In this paper, we provide a computationall...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Ryder, Nick, Zohar Karnin, Liberty, Edo
Format Paper Journal Article
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 22.06.2019
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Random projections (RP) are a popular tool for reducing dimensionality while preserving local geometry. In many applications the data set to be projected is given to us in advance, yet the current RP techniques do not make use of information about the data. In this paper, we provide a computationally light way to extract statistics from the data that allows designing a data dependent RP with superior performance compared to data-oblivious RP. We tackle scenarios such as matrix multiplication and linear regression/classification in which we wish to estimate inner products between pairs of vectors from two possibly different sources. Our technique takes advantage of the difference between the sources and is provably superior to oblivious RPs. Additionally, we provide extensive experiments comparing RPs with our approach showing significant performance lifts in fast matrix multiplication, regression and classification problems.
AbstractList Random projections (RP) are a popular tool for reducing dimensionality while preserving local geometry. In many applications the data set to be projected is given to us in advance, yet the current RP techniques do not make use of information about the data. In this paper, we provide a computationally light way to extract statistics from the data that allows designing a data dependent RP with superior performance compared to data-oblivious RP. We tackle scenarios such as matrix multiplication and linear regression/classification in which we wish to estimate inner products between pairs of vectors from two possibly different sources. Our technique takes advantage of the difference between the sources and is provably superior to oblivious RPs. Additionally, we provide extensive experiments comparing RPs with our approach showing significant performance lifts in fast matrix multiplication, regression and classification problems.
Random projections (RP) are a popular tool for reducing dimensionality while preserving local geometry. In many applications the data set to be projected is given to us in advance, yet the current RP techniques do not make use of information about the data. In this paper, we provide a computationally light way to extract statistics from the data that allows designing a data dependent RP with superior performance compared to data-oblivious RP. We tackle scenarios such as matrix multiplication and linear regression/classification in which we wish to estimate inner products between pairs of vectors from two possibly different sources. Our technique takes advantage of the difference between the sources and is provably superior to oblivious RPs. Additionally, we provide extensive experiments comparing RPs with our approach showing significant performance lifts in fast matrix multiplication, regression and classification problems.
Author Ryder, Nick
Zohar Karnin
Liberty, Edo
Author_xml – sequence: 1
  givenname: Nick
  surname: Ryder
  fullname: Ryder, Nick
– sequence: 2
  fullname: Zohar Karnin
– sequence: 3
  givenname: Edo
  surname: Liberty
  fullname: Liberty, Edo
BackLink https://doi.org/10.48550/arXiv.1906.09489$$DView paper in arXiv
BookMark eNotj81Kw0AURgdRsNY-gAux4Drxzr0z05llKf5BQZHuwyS5gQSTqTOp2Le3tq6-zeHjnCtxPoSBhbiRkCurNTz4-NN-59KBycEp687EBIlkZhXipZil1AEAmgVqTRNxu0z7vucxttX8ww916OfvMXRcjW0Y0rW4aPxn4tn_TsXm6XGzesnWb8-vq-U68067zDSWjbQ1VOCZvNJEtibWzpSGlDIsJUPJBqpF3aDVTjpfNbUvlUG78Jqm4u50e3QvtrHtfdwXfw3FseFA3J-IbQxfO05j0YVdHA5OBaIyWiFZpF8HEUm8
ContentType Paper
Journal Article
Copyright 2019. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
http://arxiv.org/licenses/nonexclusive-distrib/1.0
Copyright_xml – notice: 2019. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0
DBID 8FE
8FG
ABJCF
ABUWG
AFKRA
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
HCIFZ
L6V
M7S
PIMPY
PQEST
PQQKQ
PQUKI
PRINS
PTHSS
AKY
EPD
GOX
DOI 10.48550/arxiv.1906.09489
DatabaseName ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central (Alumni)
ProQuest Central
ProQuest Central Essentials
ProQuest Central
Technology Collection
ProQuest One Community College
ProQuest Central Korea
SciTech Premium Collection
ProQuest Engineering Collection
Engineering Database
Publicly Available Content Database
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
Engineering Collection
arXiv Computer Science
arXiv Statistics
arXiv.org
DatabaseTitle Publicly Available Content Database
Engineering Database
Technology Collection
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
ProQuest Engineering Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
Materials Science & Engineering Collection
ProQuest One Academic
Engineering Collection
DatabaseTitleList
Publicly Available Content Database
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
– sequence: 2
  dbid: 8FG
  name: ProQuest Technology Collection
  url: https://search.proquest.com/technologycollection1
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 2331-8422
ExternalDocumentID 1906_09489
Genre Working Paper/Pre-Print
GroupedDBID 8FE
8FG
ABJCF
ABUWG
AFKRA
ALMA_UNASSIGNED_HOLDINGS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
FRJ
HCIFZ
L6V
M7S
M~E
PIMPY
PQEST
PQQKQ
PQUKI
PRINS
PTHSS
AKY
EPD
GOX
ID FETCH-LOGICAL-a959-6f8e618d0c0ae3a45338d3e596b63446e11e0be60c7df285919acfdab46287a53
IEDL.DBID BENPR
IngestDate Mon Jan 08 05:40:51 EST 2024
Fri Sep 13 07:32:33 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a959-6f8e618d0c0ae3a45338d3e596b63446e11e0be60c7df285919acfdab46287a53
OpenAccessLink https://www.proquest.com/docview/2246542382/abstract/?pq-origsite=%requestingapplication%
PQID 2246542382
PQPubID 2050157
ParticipantIDs arxiv_primary_1906_09489
proquest_journals_2246542382
PublicationCentury 2000
PublicationDate 20190622
2019-06-22
PublicationDateYYYYMMDD 2019-06-22
PublicationDate_xml – month: 06
  year: 2019
  text: 20190622
  day: 22
PublicationDecade 2010
PublicationPlace Ithaca
PublicationPlace_xml – name: Ithaca
PublicationTitle arXiv.org
PublicationYear 2019
Publisher Cornell University Library, arXiv.org
Publisher_xml – name: Cornell University Library, arXiv.org
SSID ssj0002672553
Score 1.7363064
SecondaryResourceType preprint
Snippet Random projections (RP) are a popular tool for reducing dimensionality while preserving local geometry. In many applications the data set to be projected is...
Random projections (RP) are a popular tool for reducing dimensionality while preserving local geometry. In many applications the data set to be projected is...
SourceID arxiv
proquest
SourceType Open Access Repository
Aggregation Database
SubjectTerms Classification
Computer Science - Learning
Mathematical analysis
Matrix methods
Multiplication
Statistics - Machine Learning
SummonAdditionalLinks – databaseName: arXiv.org
  dbid: GOX
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV1LSwMxEB7anryIotJqK3vwGs3mtdljEWsRfCAV9rbkCR5WpVuL_nuT7BYP4jVMDpMJ-eaR-QbgwhCLvaUYacYKxJQskaSiRNpxqVUcdutjRff-QSxf2F3FqwFku14Ytf563Xb8wLq9CmglLkMAIsshDAmJX7ZuH6uuOJmouHr5X7ngY6alP09rwovFAez3jl427yxzCAP3dgSzefvdNHGIlcmeQwz_3mRPXSokWv8YVoub1fUS9QMKkIrZM-GlE7m02GDlqGLBc5KWOl4KLWgIs1yeO6ydwKawPhHFlcp4q3TsBy0UpycwCjG-G0MmVEG0VCay2TMdGQMdV05wT6z1tCATGCe16o-Og6KOGtdJ4wlMd5rW_f1r60gTx4OnJMnp_zvPYC_AfyQhQIRMYbRZf7pZgNiNPk_n_AMP_HpB
  priority: 102
  providerName: Cornell University
Title Asymmetric Random Projections
URI https://www.proquest.com/docview/2246542382/abstract/
https://arxiv.org/abs/1906.09489
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8NAEB7aBsGbT1ptSw9e0yS7yWZzEpU-EFpLqdBb2FfAQx-2VfTib3dnm-pB8BLY7GmSZR7f7HwfwI0iOiw0DX0Zx6kfC575nLLMlybhUqDYbYEd3dGYDZ_jx3kyr8DwMAuD1yoPPtE5ar1SiJEHSHyW2NjPSSAkogBqF9yuX33Uj8I-aymmUQWPRDE2bL373ngy_cFbCEtt9kz3jU1H4xWIzcfLe9dGRNa1RQ4KvXvu1R-37GJN_wS8iVibzSlUzPIMjtwVTbU9h9bd9nOxQAEs1Zna-n-16Ez2MAqenAuY9Xuzh6Ffihv4ApE3VnDDIq5DFQpDRWyzLq6pSTImGbUlmokiE0rDQpXqwpHMZUIVWkicJU1FQi-htlwtTR06TKREcqGQCT-WyDZoEmFYUhCtC5qSBtSdWfl6z1-Ro8W5s7gBzYOleXl2t_nvl776f_sajm36gCQGPiFNqO02b6ZlQ_ROtqHK-4N2-Q_savA0t8_RV-8bWYeS_g
link.rule.ids 228,230,786,790,891,12792,21416,27958,33408,33779,43635,43840
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LTwIxEJ4oG6M3nwEF5eC1sLS73e7JqIGgAiEEE26bvjbxwEMWjf57O2XVg4nX9jRtM49vpt8HcK2pCXPDQqKiKCGRFCkRjKdE2VgoiWK3OXZ0hyPef44eZ_GsBNyKcqzy2yd6R22WGjHyNhKfxS72C3qzeiWoGoXd1VJCYxeCiLlSpQLBXXc0nvygLJQnLmdm23amJ-9qy_XHy3vLxUHecqUNyrsHfumPM_YRpncIwViu7PoIduziGPb8YKYuTqBxW3zO5yh7pZsTV_Uv583xFjzB93IK0153et8npaQBkYi38VxY3hEm1KG0TEYu1xKG2TjlijNXmNlOx4bK8lAnJvfUcqnUuZEKf5AmMmZnUFksF7YKTS4TqoTUyH8fKeQYtLG0PM6pMTlLaA2q3qxstWWtyNDizFtcg_q3pVn5Yovs93zP_9--gv3-dDjIBg-jpws4cAkE0hgQSutQ2azfbMMF6Y26LG_iC6Hwjws
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Asymmetric+Random+Projections&rft.jtitle=arXiv.org&rft.au=Ryder%2C+Nick&rft.au=Zohar+Karnin&rft.au=Liberty%2C+Edo&rft.date=2019-06-22&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.1906.09489