Practical and Rigorous Uncertainty Bounds for Gaussian Process Regression
Gaussian Process regression is a popular nonparametric regression method based on Bayesian principles that provides uncertainty estimates for its predictions. However, these estimates are of a Bayesian nature, whereas for some important applications, like learning-based control with safety guarantees, frequentist uncertainty bounds are required. Although such rigorous bounds are available for Gaussian Processes, they are too conservative to be useful in applications. This often leads practitioners to replacing these bounds by heuristics, thus breaking all theoretical guarantees. To address this problem, we introduce new uncertainty bounds that are rigorous, yet practically useful at the same time. In particular, the bounds can be explicitly evaluated and are much less conservative than state of the art results. Furthermore, we show that certain model misspecifications lead to only graceful degradation. We demonstrate these advantages and the usefulness of our results for learning-based control with numerical examples.},
Author(s): | Fiedler, Christian and Scherer, Carsten W. and Trimpe, Sebastian |
Book Title: | The Thirty-Fifth AAAI Conference on Artificial Intelligence, the Thirty-Third Conference on Innovative Applications of Artificial Intelligence, the Eleventh Symposium on Educational Advances in Artificial Intelligence |
Volume: | 8 |
Pages: | 7439--7447 |
Year: | 2021 |
Month: | May |
Publisher: | AAAI Press |
Bibtex Type: | Conference Paper (inproceedings) |
Address: | Palo Alto, CA |
Event Name: | Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021), Thirty-Third Conference on Innovative Applications of Artificial Intelligence (IAAI 2021), Eleventh Symposium on Educational Advances in Artificial Intelligence (EAAI 2021) |
Event Place: | Virtual |
URL: | https://ojs.aaai.org/index.php/AAAI/article/view/16912 |
Electronic Archiving: | grant_archive |
ISBN: | 978-1-57735-866-4 |
BibTex
@inproceedings{Fiedler_Scherer_Trimpe_2021, title = {Practical and Rigorous Uncertainty Bounds for Gaussian Process Regression}, booktitle = {The Thirty-Fifth AAAI Conference on Artificial Intelligence, the Thirty-Third Conference on Innovative Applications of Artificial Intelligence, the Eleventh Symposium on Educational Advances in Artificial Intelligence}, abstract = {Gaussian Process regression is a popular nonparametric regression method based on Bayesian principles that provides uncertainty estimates for its predictions. However, these estimates are of a Bayesian nature, whereas for some important applications, like learning-based control with safety guarantees, frequentist uncertainty bounds are required. Although such rigorous bounds are available for Gaussian Processes, they are too conservative to be useful in applications. This often leads practitioners to replacing these bounds by heuristics, thus breaking all theoretical guarantees. To address this problem, we introduce new uncertainty bounds that are rigorous, yet practically useful at the same time. In particular, the bounds can be explicitly evaluated and are much less conservative than state of the art results. Furthermore, we show that certain model misspecifications lead to only graceful degradation. We demonstrate these advantages and the usefulness of our results for learning-based control with numerical examples.}, }, volume = {8}, pages = {7439--7447}, publisher = {AAAI Press}, address = {Palo Alto, CA}, month = may, year = {2021}, slug = {fiedler_scherer_trimpe_2021}, author = {Fiedler, Christian and Scherer, Carsten W. and Trimpe, Sebastian}, url = {https://ojs.aaai.org/index.php/AAAI/article/view/16912}, month_numeric = {5} }