TR2024-046

Violation-Aware Contextual Bayesian Optimization for Controller Performance Optimization with Unmodeled Constraints


    •  Xu, W., Jones, C., Svetozarevic, B., Laughman, C.R., Chakrabarty, A., "Violation-Aware Contextual Bayesian Optimization for Controller Performance Optimization with Unmodeled Constraints", Journal of Process Control, DOI: 10.1016/​j.jprocont.2024.103212, Vol. 138, April 2024.
      BibTeX TR2024-046 PDF
      • @article{Xu2024apr,
      • author = {Xu, Wenjie and Jones, Colin and Svetozarevic, Bratislav and Laughman, Christopher R. and Chakrabarty, Ankush},
      • title = {Violation-Aware Contextual Bayesian Optimization for Controller Performance Optimization with Unmodeled Constraints},
      • journal = {Journal of Process Control},
      • year = 2024,
      • volume = 138,
      • month = apr,
      • doi = {10.1016/j.jprocont.2024.103212},
      • url = {https://www.merl.com/publications/TR2024-046}
      • }
  • MERL Contacts:
  • Research Areas:

    Control, Machine Learning, Optimization

Abstract:

We study the problem of performance optimization of closed-loop control systems with unmodeled dynamics. Bayesian optimization (BO) has been demonstrated to be effective for improving closed- loop performance by automatically tuning controller gains or reference setpoints in a model-free manner. However, BO methods have rarely been tested on dynamical systems with unmodeled constraints and time-varying ambient conditions. In this paper, we propose a violation-aware contextual BO algorithm (VACBO) that optimizes closed-loop performance while simultaneously learning constraint-feasible solutions under time-varying ambient conditions. Unlike classical constrained BO methods which allow unlimited constraint violations, or ‘safe’ BO algorithms that are conservative and try to operate with near-zero violations, we allow budgeted constraint violations to improve constraint learning and accelerate optimization. We demonstrate the effectiveness of our proposed VACBO method for energy minimization of industrial vapor compression systems under time-varying ambient temperature and humidity.