The article aims in addressing the issue of ensemble feature selection problem by modeling it as a multicriteria decision making technique. To build such a model, initially, aggregation operators such as weighted arithmetic, weighted geometric, ordered weighted arithmetic, ordered weighted geometric aggregation of Hamacher, Einstein and Dombi operators in the q-rung orthopair hesitant fuzzy environment are proposed. The properties of these operators are also discussed to provide a more elaborate understanding of them. Such an approach to ensemble feature selection has not yet been carried out in the literature which adds to the novelty of our work. Validation is provided through comparison of the performance metrics with existing and base feature selection methods and also by carrying out statistical tests. Through this article, a model for ensemble feature selection incorporating the advantages of Einstein, Hamacher, Dombi and q-rung orthopair hesitant fuzzy set was constructed which was reflected in the results.