The presented paper describes the main problems associated with the influence of the human factor on decision-making process in automated systems for assessing the effectiveness of scientific and technical solutions and possible ways to resolve them. As an example of a criteria set for analyzing the effectiveness of scientific and technical solutions in the field of electric power industry the authors present the case study based on the data of grant applications uploaded into automated decision support system developed by the authors on the basis of artificial intelligence approach. The results of the analysis of the information content of the criteria and the accuracy of pattern recognition are analyzed.