Statistical Theory and Related Fields (Jul 2024)

Partially fixed bayesian additive regression trees

  • Hao Ran,
  • Yang Bai

DOI
https://doi.org/10.1080/24754269.2024.2341981
Journal volume & issue
Vol. 8, no. 3
pp. 232 – 242

Abstract

Read online

Bayesian Additive Regression Trees (BART) is a widely popular nonparametric regression model known for its accurate prediction capabilities. In certain situations, there is knowledge suggesting the existence of certain dominant variables. However, the BART model fails to fully utilize the knowledge. To tackle this problem, the paper introduces a modification to BART known as the Partially Fixed BART model. By fixing a portion of the trees' structure, this model enables more efficient utilization of prior knowledge, resulting in enhanced estimation accuracy. Moreover, the Partially Fixed BART model can offer more precise estimates and valuable insights for future analysis even when such prior knowledge is absent. Empirical results substantiate the enhancement of the proposed model in comparison to the original BART.

Keywords