Sparsely Observed Functional Time Series: Estimation and Prediction

Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Rubín, Tomáš, Panaretos, Victor M
Format Paper Journal Article
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 09.12.2019
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may well happen that the data available to the analyst are not the actual sequence of curves, but relatively few and noisy measurements per curve, potentially at different locations in each curve's domain. Under this sparse sampling regime, neither the established estimators of the time series' dynamics, nor their corresponding theoretical analysis will apply. The subject of this paper is to tackle the problem of estimating the dynamics and of recovering the latent process of smooth curves in the sparse regime. Assuming smoothness of the latent curves, we construct a consistent nonparametric estimator of the series' spectral density operator and use it develop a frequency-domain recovery approach, that predicts the latent curve at a given time by borrowing strength from the (estimated) dynamic correlations in the series across time. Further to predicting the latent curves from their noisy point samples, the method fills in gaps in the sequence (curves nowhere sampled), denoises the data, and serves as a basis for forecasting. Means of providing corresponding confidence bands are also investigated. A simulation study interestingly suggests that sparse observation for a longer time period, may be provide better performance than dense observation for a shorter period, in the presence of smoothness. The methodology is further illustrated by application to an environmental data set on fair-weather atmospheric electricity, which naturally leads to a sparse functional time-series.
AbstractList Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may well happen that the data available to the analyst are not the actual sequence of curves, but relatively few and noisy measurements per curve, potentially at different locations in each curve's domain. Under this sparse sampling regime, neither the established estimators of the time series' dynamics, nor their corresponding theoretical analysis will apply. The subject of this paper is to tackle the problem of estimating the dynamics and of recovering the latent process of smooth curves in the sparse regime. Assuming smoothness of the latent curves, we construct a consistent nonparametric estimator of the series' spectral density operator and use it develop a frequency-domain recovery approach, that predicts the latent curve at a given time by borrowing strength from the (estimated) dynamic correlations in the series across time. Further to predicting the latent curves from their noisy point samples, the method fills in gaps in the sequence (curves nowhere sampled), denoises the data, and serves as a basis for forecasting. Means of providing corresponding confidence bands are also investigated. A simulation study interestingly suggests that sparse observation for a longer time period, may be provide better performance than dense observation for a shorter period, in the presence of smoothness. The methodology is further illustrated by application to an environmental data set on fair-weather atmospheric electricity, which naturally leads to a sparse functional time-series.
Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless, as is often the case with independent functional data, it may well happen that the data available to the analyst are not the actual sequence of curves, but relatively few and noisy measurements per curve, potentially at different locations in each curve's domain. Under this sparse sampling regime, neither the established estimators of the time series' dynamics, nor their corresponding theoretical analysis will apply. The subject of this paper is to tackle the problem of estimating the dynamics and of recovering the latent process of smooth curves in the sparse regime. Assuming smoothness of the latent curves, we construct a consistent nonparametric estimator of the series' spectral density operator and use it develop a frequency-domain recovery approach, that predicts the latent curve at a given time by borrowing strength from the (estimated) dynamic correlations in the series across time. Further to predicting the latent curves from their noisy point samples, the method fills in gaps in the sequence (curves nowhere sampled), denoises the data, and serves as a basis for forecasting. Means of providing corresponding confidence bands are also investigated. A simulation study interestingly suggests that sparse observation for a longer time period, may be provide better performance than dense observation for a shorter period, in the presence of smoothness. The methodology is further illustrated by application to an environmental data set on fair-weather atmospheric electricity, which naturally leads to a sparse functional time-series.
Author Rubín, Tomáš
Panaretos, Victor M
Author_xml – sequence: 1
  givenname: Tomáš
  surname: Rubín
  fullname: Rubín, Tomáš
– sequence: 2
  givenname: Victor
  surname: Panaretos
  middlename: M
  fullname: Panaretos, Victor M
BackLink https://doi.org/10.48550/arXiv.1811.06340$$DView paper in arXiv
https://doi.org/10.1214/20-EJS1690$$DView published paper (Access to full text may be restricted)
BookMark eNotj81Kw0AYRQdRsNY-gCsHXCfOf2bcSWhVKFRo9mEy8xVS0iTONMW-vWnq6i7u4XLPA7ptuxYQeqIkFVpK8mrDb31KqaY0JYoLcoNmjHOaaMHYPVrEuCeEMJUxKfkM5dvehgjNGW-qCOEEHq-G1h3rrrUNLuoD4C2EGuIbXsZjfbCXBtvW4-8Avp7AR3S3s02ExX_OUbFaFvlnst58fOXv68RKphNlhQMKJgPjnDXCV4Zl1ImMOEalAk-Ik1rrSmoqiWVsp7xkyoBVIpNe8jl6vs5OhmUfxjfhXF5My8l0JF6uRB-6nwHisdx3QxhFYsnoCBhljOZ_EPtXKA
ContentType Paper
Journal Article
Copyright 2019. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
http://arxiv.org/licenses/nonexclusive-distrib/1.0
Copyright_xml – notice: 2019. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0
DBID 8FE
8FG
ABJCF
ABUWG
AFKRA
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
HCIFZ
L6V
M7S
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
EPD
GOX
DOI 10.48550/arxiv.1811.06340
DatabaseName ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
ProQuest Central Essentials
ProQuest Central
Technology Collection
ProQuest One
ProQuest Central Korea
SciTech Premium Collection
ProQuest Engineering Collection
Engineering Database
ProQuest Central Premium
ProQuest One Academic (New)
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
Engineering Collection
arXiv Statistics
arXiv.org
DatabaseTitle Publicly Available Content Database
Engineering Database
Technology Collection
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Engineering Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
Materials Science & Engineering Collection
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
Engineering Collection
DatabaseTitleList Publicly Available Content Database

Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
– sequence: 2
  dbid: 8FG
  name: ProQuest Technology Collection
  url: https://search.proquest.com/technologycollection1
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 2331-8422
ExternalDocumentID 1811_06340
Genre Working Paper/Pre-Print
GroupedDBID 8FE
8FG
ABJCF
ABUWG
AFKRA
ALMA_UNASSIGNED_HOLDINGS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
FRJ
HCIFZ
L6V
M7S
M~E
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
EPD
GOX
ID FETCH-LOGICAL-a528-6a4ce1e97e9cca94db9271c470c2156ed00c5888b58150a22f6d5269ea6475d53
IEDL.DBID BENPR
IngestDate Wed Jul 23 02:02:51 EDT 2025
Mon Jun 30 09:30:50 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a528-6a4ce1e97e9cca94db9271c470c2156ed00c5888b58150a22f6d5269ea6475d53
Notes SourceType-Working Papers-1
ObjectType-Working Paper/Pre-Print-1
content type line 50
OpenAccessLink https://www.proquest.com/docview/2134096998?pq-origsite=%requestingapplication%
PQID 2134096998
PQPubID 2050157
ParticipantIDs arxiv_primary_1811_06340
proquest_journals_2134096998
PublicationCentury 2000
PublicationDate 20191209
PublicationDateYYYYMMDD 2019-12-09
PublicationDate_xml – month: 12
  year: 2019
  text: 20191209
  day: 09
PublicationDecade 2010
PublicationPlace Ithaca
PublicationPlace_xml – name: Ithaca
PublicationTitle arXiv.org
PublicationYear 2019
Publisher Cornell University Library, arXiv.org
Publisher_xml – name: Cornell University Library, arXiv.org
SSID ssj0002672553
Score 1.7099596
SecondaryResourceType preprint
Snippet Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete...
Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete...
SourceID arxiv
proquest
SourceType Open Access Repository
Aggregation Database
SubjectTerms Atmospheric electricity
Confidence
Frequency domain analysis
Predictions
Smoothness
Statistics - Methodology
Time series
SummonAdditionalLinks – databaseName: arXiv.org
  dbid: GOX
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV1NSwMxEB1qT15EUWm1Sg5eo9k0yW68SWktglawQm9LspmCILX0Q_TfO8lu8SAes2QPO8nOe2-SmQG4CplTNg-eo_SaK_KTnFhRzo2pjKCRUS4mCj8-mfGrepjpWQvYLhfGrb7ePuv6wH59Q_CTXROIKhLle1LGK1v3k1l9OJlKcTXzf-cRx0yP_rjWhBejQzhoiB67q1fmCFq4OIbBy5KEJL5_s4mP4VAMbETAUsfjWEzHYDFchetbNqR_r04rZCT22fMqnqjE4QlMR8PpYMybNgbcaVlw41SFGdocLVnLquCtzLNK5aIiuDUYhKg06VCvCyJnTsq5CbHtNzqjch10_xTai48FdoCJyhbO94Ps29iOW3iJCkWYa5d56b3tQid9fLmsK1WU0S5lsksXejt7lM0uXZexmhtJGFJcZ_-_eQ77RBJSzwRhe9DerLZ4QUC88ZdpNX4AulWHTg
  priority: 102
  providerName: Cornell University
Title Sparsely Observed Functional Time Series: Estimation and Prediction
URI https://www.proquest.com/docview/2134096998
https://arxiv.org/abs/1811.06340
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8NAEF5sg-DNJ63WkoPXtMlmd5P1IlgSi9AHWqG3sK-CIG1MqujF3-5skupB8BKY5JTZZL6Zb3fmQ-hKB4LwSEvPYEk9AnHSg6wo8hhTzAeLEWEbhSdTNn4i90u6bAi3sjlWuYuJVaDWG2U58qGdPAbpNlQHN_mrZ1Wj7O5qI6HRQg6E4BiKL-c2mc4fflgWzCLImcN6O7Ma3jUUxcfz-wCALRgAPFvSw6lu_QnGFcKkh8iZi9wUR2jPrI_RfnUwU5UnaPSYQ-lpXj7dmbQEqtFuClBUM3iubeBwLcFlyms3gb-1bkR0xVq788LuwVjzFC3SZDEae43wgScojj0miDKB4ZHh4F9OtOQ4ChSJfAUAzYz2fUWhcpU0hnROYLxi2gqFG8FIRDUNz1B7vVmbDnJ9xWMhQ41DbgW8fYkNMb5eURFILCXvok718llez7bIrF-yyi9d1Nv5I2u-6zL7XYXz_x9foANILSqlBZ_3UHtbvJlLgO-t7KNWnN71m5UC6262hOvkK_kGVxGcmw
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT8MwDI7QJgQ3ntpgQA5wLLRpmi5IiMNYGbABEkParUqaTEJC3djGYz-K_4idrnBA4sYx7aW1E_uzHfsj5NAEisvYaM8yHXkc7KQHqCj2hMiEDyvBFTYK925F55FfD6LBEvkse2HwWmVpE52hNqMMc-QnOHkM4DZEB-fjFw9Zo7C6WlJoFNvixs7fIWSbnl1dgH6PGEva_VbHW7AKeCpiTU8ontnAythK-HjJjZYsDjIe-xl4P2GN72cRhIU6agJWUowNhUEWbqsEjyODJBFg8as8DCUeqGZy-Z3SYSIGgB4WtVM3KexETT6e3o7BiwbHgAUww1J1j35ZfufOkjVSvVdjO1knSzbfIMvuFmg23SSthzHEufZ5Tu80ZmutoQn4vSJdSLFbhGI2zU5PaRtMQ9H1SFVu6P0ECz643CL9_5DHNqnko9zWCPUz2VQ6NCyUyBbua2a59c0wUoFmWss6qbmfT8fFII0U5ZI6udRJo5RHujhE0_RH5Tt_vz4gK51-r5t2r25vdskqYBpH8eDLBqnMJq92D3DDTO87bVGS_vPu-AKvptMr
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Sparsely+Observed+Functional+Time+Series%3A+Estimation+and+Prediction&rft.jtitle=arXiv.org&rft.au=Rub%C3%ADn%2C+Tom%C3%A1%C5%A1&rft.au=Panaretos%2C+Victor+M&rft.date=2019-12-09&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.1811.06340