Adaptive Boosting (AdaBoost) based meta learning algorithms generate an accurate classifier ensemble using a learning algorithm with only moderate accuracy guarantees. These algorithms have been designed to work in typical supervised learning settings and hence use only labeled training data along with a base learning algorithm to form an ensemble. However, significant knowledge about the solution space might be available along with training data. The accuracy and convergence rate of AdaBoost might be improved using such knowledge. An effective way to incorporate such knowledge into boosting based ensemble learning algorithms is presented in this paper. Using several synthetic and real datasets, empirical evidence is reported to show the effectiveness of proposed method.Significant improvements have been obtained by applying the proposed method for detecting roads in aerial images.