Sparsely Observed Functional Time Series: Estimation and Prediction
Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may...
Saved in:
Published in | arXiv.org |
---|---|
Main Authors | , |
Format | Paper Journal Article |
Language | English |
Published |
Ithaca
Cornell University Library, arXiv.org
09.12.2019
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may well happen that the data available to the analyst are not the actual sequence of curves, but relatively few and noisy measurements per curve, potentially at different locations in each curve's domain. Under this sparse sampling regime, neither the established estimators of the time series' dynamics, nor their corresponding theoretical analysis will apply. The subject of this paper is to tackle the problem of estimating the dynamics and of recovering the latent process of smooth curves in the sparse regime. Assuming smoothness of the latent curves, we construct a consistent nonparametric estimator of the series' spectral density operator and use it develop a frequency-domain recovery approach, that predicts the latent curve at a given time by borrowing strength from the (estimated) dynamic correlations in the series across time. Further to predicting the latent curves from their noisy point samples, the method fills in gaps in the sequence (curves nowhere sampled), denoises the data, and serves as a basis for forecasting. Means of providing corresponding confidence bands are also investigated. A simulation study interestingly suggests that sparse observation for a longer time period, may be provide better performance than dense observation for a shorter period, in the presence of smoothness. The methodology is further illustrated by application to an environmental data set on fair-weather atmospheric electricity, which naturally leads to a sparse functional time-series. |
---|---|
AbstractList | Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may well happen that the data available to the analyst are not the actual sequence of curves, but relatively few and noisy measurements per curve, potentially at different locations in each curve's domain. Under this sparse sampling regime, neither the established estimators of the time series' dynamics, nor their corresponding theoretical analysis will apply. The subject of this paper is to tackle the problem of estimating the dynamics and of recovering the latent process of smooth curves in the sparse regime. Assuming smoothness of the latent curves, we construct a consistent nonparametric estimator of the series' spectral density operator and use it develop a frequency-domain recovery approach, that predicts the latent curve at a given time by borrowing strength from the (estimated) dynamic correlations in the series across time. Further to predicting the latent curves from their noisy point samples, the method fills in gaps in the sequence (curves nowhere sampled), denoises the data, and serves as a basis for forecasting. Means of providing corresponding confidence bands are also investigated. A simulation study interestingly suggests that sparse observation for a longer time period, may be provide better performance than dense observation for a shorter period, in the presence of smoothness. The methodology is further illustrated by application to an environmental data set on fair-weather atmospheric electricity, which naturally leads to a sparse functional time-series. Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may well happen that the data available to the analyst are not the actual sequence of curves, but relatively few and noisy measurements per curve, potentially at different locations in each curve's domain. Under this sparse sampling regime, neither the established estimators of the time series' dynamics, nor their corresponding theoretical analysis will apply. The subject of this paper is to tackle the problem of estimating the dynamics and of recovering the latent process of smooth curves in the sparse regime. Assuming smoothness of the latent curves, we construct a consistent nonparametric estimator of the series' spectral density operator and use it develop a frequency-domain recovery approach, that predicts the latent curve at a given time by borrowing strength from the (estimated) dynamic correlations in the series across time. Further to predicting the latent curves from their noisy point samples, the method fills in gaps in the sequence (curves nowhere sampled), denoises the data, and serves as a basis for forecasting. Means of providing corresponding confidence bands are also investigated. A simulation study interestingly suggests that sparse observation for a longer time period, may be provide better performance than dense observation for a shorter period, in the presence of smoothness. The methodology is further illustrated by application to an environmental data set on fair-weather atmospheric electricity, which naturally leads to a sparse functional time-series. |
Author | Rubín, Tomáš Panaretos, Victor M |
Author_xml | – sequence: 1 givenname: Tomáš surname: Rubín fullname: Rubín, Tomáš – sequence: 2 givenname: Victor surname: Panaretos middlename: M fullname: Panaretos, Victor M |
BackLink | https://doi.org/10.48550/arXiv.1811.06340$$DView paper in arXiv https://doi.org/10.1214/20-EJS1690$$DView published paper (Access to full text may be restricted) |
BookMark | eNotj81Kw0AYRQdRsNY-gCsHXCfOf2bcSWhVKFRo9mEy8xVS0iTONMW-vWnq6i7u4XLPA7ptuxYQeqIkFVpK8mrDb31KqaY0JYoLcoNmjHOaaMHYPVrEuCeEMJUxKfkM5dvehgjNGW-qCOEEHq-G1h3rrrUNLuoD4C2EGuIbXsZjfbCXBtvW4-8Avp7AR3S3s02ExX_OUbFaFvlnst58fOXv68RKphNlhQMKJgPjnDXCV4Zl1ImMOEalAk-Ik1rrSmoqiWVsp7xkyoBVIpNe8jl6vs5OhmUfxjfhXF5My8l0JF6uRB-6nwHisdx3QxhFYsnoCBhljOZ_EPtXKA |
ContentType | Paper Journal Article |
Copyright | 2019. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. http://arxiv.org/licenses/nonexclusive-distrib/1.0 |
Copyright_xml | – notice: 2019. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0 |
DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS EPD GOX |
DOI | 10.48550/arxiv.1811.06340 |
DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials ProQuest Central Technology Collection ProQuest One ProQuest Central Korea SciTech Premium Collection ProQuest Engineering Collection Engineering Database ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection arXiv Statistics arXiv.org |
DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest Central (New) ProQuest One Academic ProQuest One Academic (New) Engineering Collection |
DatabaseTitleList | Publicly Available Content Database |
Database_xml | – sequence: 1 dbid: GOX name: arXiv.org url: http://arxiv.org/find sourceTypes: Open Access Repository – sequence: 2 dbid: 8FG name: ProQuest Technology Collection url: https://search.proquest.com/technologycollection1 sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Physics |
EISSN | 2331-8422 |
ExternalDocumentID | 1811_06340 |
Genre | Working Paper/Pre-Print |
GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS EPD GOX |
ID | FETCH-LOGICAL-a528-6a4ce1e97e9cca94db9271c470c2156ed00c5888b58150a22f6d5269ea6475d53 |
IEDL.DBID | BENPR |
IngestDate | Wed Jul 23 02:02:51 EDT 2025 Mon Jun 30 09:30:50 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-a528-6a4ce1e97e9cca94db9271c470c2156ed00c5888b58150a22f6d5269ea6475d53 |
Notes | SourceType-Working Papers-1 ObjectType-Working Paper/Pre-Print-1 content type line 50 |
OpenAccessLink | https://www.proquest.com/docview/2134096998?pq-origsite=%requestingapplication% |
PQID | 2134096998 |
PQPubID | 2050157 |
ParticipantIDs | arxiv_primary_1811_06340 proquest_journals_2134096998 |
PublicationCentury | 2000 |
PublicationDate | 20191209 |
PublicationDateYYYYMMDD | 2019-12-09 |
PublicationDate_xml | – month: 12 year: 2019 text: 20191209 day: 09 |
PublicationDecade | 2010 |
PublicationPlace | Ithaca |
PublicationPlace_xml | – name: Ithaca |
PublicationTitle | arXiv.org |
PublicationYear | 2019 |
Publisher | Cornell University Library, arXiv.org |
Publisher_xml | – name: Cornell University Library, arXiv.org |
SSID | ssj0002672553 |
Score | 1.7099596 |
SecondaryResourceType | preprint |
Snippet | Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete... Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete... |
SourceID | arxiv proquest |
SourceType | Open Access Repository Aggregation Database |
SubjectTerms | Atmospheric electricity Confidence Frequency domain analysis Predictions Smoothness Statistics - Methodology Time series |
SummonAdditionalLinks | – databaseName: arXiv.org dbid: GOX link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV1NSwMxEB1qT15EUWm1Sg5eo9k0yW68SWktglawQm9LspmCILX0Q_TfO8lu8SAes2QPO8nOe2-SmQG4CplTNg-eo_SaK_KTnFhRzo2pjKCRUS4mCj8-mfGrepjpWQvYLhfGrb7ePuv6wH59Q_CTXROIKhLle1LGK1v3k1l9OJlKcTXzf-cRx0yP_rjWhBejQzhoiB67q1fmCFq4OIbBy5KEJL5_s4mP4VAMbETAUsfjWEzHYDFchetbNqR_r04rZCT22fMqnqjE4QlMR8PpYMybNgbcaVlw41SFGdocLVnLquCtzLNK5aIiuDUYhKg06VCvCyJnTsq5CbHtNzqjch10_xTai48FdoCJyhbO94Ps29iOW3iJCkWYa5d56b3tQid9fLmsK1WU0S5lsksXejt7lM0uXZexmhtJGFJcZ_-_eQ77RBJSzwRhe9DerLZ4QUC88ZdpNX4AulWHTg priority: 102 providerName: Cornell University |
Title | Sparsely Observed Functional Time Series: Estimation and Prediction |
URI | https://www.proquest.com/docview/2134096998 https://arxiv.org/abs/1811.06340 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8NAEF5sg-DNJ63WkoPXtMlmd5P1IlgSi9AHWqG3sK-CIG1MqujF3-5skupB8BKY5JTZZL6Zb3fmQ-hKB4LwSEvPYEk9AnHSg6wo8hhTzAeLEWEbhSdTNn4i90u6bAi3sjlWuYuJVaDWG2U58qGdPAbpNlQHN_mrZ1Wj7O5qI6HRQg6E4BiKL-c2mc4fflgWzCLImcN6O7Ma3jUUxcfz-wCALRgAPFvSw6lu_QnGFcKkh8iZi9wUR2jPrI_RfnUwU5UnaPSYQ-lpXj7dmbQEqtFuClBUM3iubeBwLcFlyms3gb-1bkR0xVq788LuwVjzFC3SZDEae43wgScojj0miDKB4ZHh4F9OtOQ4ChSJfAUAzYz2fUWhcpU0hnROYLxi2gqFG8FIRDUNz1B7vVmbDnJ9xWMhQ41DbgW8fYkNMb5eURFILCXvok718llez7bIrF-yyi9d1Nv5I2u-6zL7XYXz_x9foANILSqlBZ_3UHtbvJlLgO-t7KNWnN71m5UC6262hOvkK_kGVxGcmw |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT8MwDI7QJgQ3ntpgQA5wLLRpmi5IiMNYGbABEkParUqaTEJC3djGYz-K_4idrnBA4sYx7aW1E_uzHfsj5NAEisvYaM8yHXkc7KQHqCj2hMiEDyvBFTYK925F55FfD6LBEvkse2HwWmVpE52hNqMMc-QnOHkM4DZEB-fjFw9Zo7C6WlJoFNvixs7fIWSbnl1dgH6PGEva_VbHW7AKeCpiTU8ontnAythK-HjJjZYsDjIe-xl4P2GN72cRhIU6agJWUowNhUEWbqsEjyODJBFg8as8DCUeqGZy-Z3SYSIGgB4WtVM3KexETT6e3o7BiwbHgAUww1J1j35ZfufOkjVSvVdjO1knSzbfIMvuFmg23SSthzHEufZ5Tu80ZmutoQn4vSJdSLFbhGI2zU5PaRtMQ9H1SFVu6P0ECz643CL9_5DHNqnko9zWCPUz2VQ6NCyUyBbua2a59c0wUoFmWss6qbmfT8fFII0U5ZI6udRJo5RHujhE0_RH5Tt_vz4gK51-r5t2r25vdskqYBpH8eDLBqnMJq92D3DDTO87bVGS_vPu-AKvptMr |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Sparsely+Observed+Functional+Time+Series%3A+Estimation+and+Prediction&rft.jtitle=arXiv.org&rft.au=Rub%C3%ADn%2C+Tom%C3%A1%C5%A1&rft.au=Panaretos%2C+Victor+M&rft.date=2019-12-09&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.1811.06340 |