Sparse Inverse Gaussian Process Regression with Application to Climate Network Discovery

Description

Regression problems on massive data sets are ubiquitous in many application domains including the Internet, earth and space sciences, and finances. Gaussian Process regression is a popular technique for modeling the input-output relations of a set of variables under the assumption that the weight vector has a Gaussian prior. However, it is challenging to apply Gaussian Process regression to large data sets since prediction based on the learned model requires inversion of an order n kernel matrix. Approximate solutions for sparse Gaussian Processes have been proposed for sparse problems. However, in almost all cases, these solution techniques are agnostic to the input domain and do not preserve the similarity structure in the data. As a result, although these solutions sometimes provide excellent accuracy, the models do not have interpretability. Such interpretable sparsity patterns are very important for many applications. We propose a new technique for sparse Gaussian Process regression that allows us to compute a parsimonious model while preserving the interpretability of the sparsity structure in the data. We discuss how the inverse kernel matrix used in Gaussian Process prediction gives valuable domain information and then adapt the inverse covariance estimation from Gaussian graphical models to estimate the Gaussian kernel. We solve the optimization problem using the alternating direction method of multipliers that is amenable to parallel computation. We demonstrate the performance of our method in terms of accuracy, scalability and interpretability on a climate data set.

Resources

Name Format Description Link
33 3775 (Das, K).pdf https://c3.nasa.gov/dashlink/static/media/publication/3775_Das_K.pdf
21 Search results for publications that cite this dataset by its DOI. https://scholar.google.com/scholar?q=10.5067%2FQ06P5TZ8CBU5
21 NASA's newest search and order tool for subsetting, reprojecting, and reformatting data. https://search.earthdata.nasa.gov/search?q=SV19MA_LID+V001
21 Direct download via HTTPS protocol. https://cmr.earthdata.nasa.gov/virtual-directory/collections/C3286116930-NSIDC_CPRD
21 Provides access to data, documentation, tools, citation information, support, and other resources. https://doi.org/10.5067/Q06P5TZ8CBU5
21 Includes a user's guide, supplemental documents like ATBDs and academic papers, How Tos, FAQs, etc. https://doi.org/10.5067/Q06P5TZ8CBU5
33 3775 (Das, K).pdf https://c3.nasa.gov/dashlink/static/media/publication/3775_Das_K.pdf

Tags

  • dashlink
  • nasa
  • ames

Topics

Categories