Competências e experiência em avaliação: uma análise dos avaliadores externos do SINAES

Abstract

By contributing to the improvement of university management in the administrative and academic sphere, evaluation has a relevant role in the policies of College Education in Brazil and, therefore, the competence and experience of the evaluator are fundamental elements in this process. The development of competencies and experience in evaluation are important factors for the effective execution of evaluation, contributing to the provision of quality services in teaching, research and extension for all society. Therefore, this research aimed to analyze the relationship between the development of self-reported evaluation competencies by external SINAES evaluators and their evaluation experience, based on the hypothesis that the greater the experience in evaluation, the greater the evaluator's agreement in relation to the development of competencies. This objective was achieved by identifying the competencies in evaluation that are most appropriate to SINAES context, verifying the agreement of BASis external evaluator in relation to full development of evaluation competencies and verifying the relationship between the agreement of assessors in relation to the development of competencies in evaluation and the experience of the evaluator in the execution of evaluations. The data collection process took place by a method called Delphi method, through which the experts, by consensus, chose the competencies most appropriate to SINAES evaluation context; and after, by a survey, with external evaluators, through which data were collected on the evaluator's profile, the evaluation experience and their degree of agreement in relation to the full development of competencies in evaluation selected on the Delphi. The survey results showed that most of the sample's evaluators: are women, hold a doctorate and has between 21 and 49 years old and fully agree that they have fully developed competencies in all theoretical dimensions of evaluation competencies. It was also evidenced that the higher is the amount of evaluations made, the greater is the evaluator's confidence in reporting that has fully developed the competencies. From the results obtained, it follows that had a direct relationship between the experience in evaluation and the report of the evaluator's competencies development. In this way, the lists of evaluation competencies obtained by the experts can be used in the improvement of the evaluators' training courses of BASis evaluators, and this study can stimulate research that approach the relationship between evaluation experience and development of competencies on each theoretical dimension of evaluation competencies.