Teacher Behavior Checklist’s psychometric properties: A study with Brazilian undergraduates
DOI:
https://doi.org/10.21615/cesp.6371Keywords:
college teachers, teacher behavior, performance assessment, validity, reliabilityAbstract
The Teacher Behavior Checklist (TBC) is an internationally recognized instrument to conduct formative assessment for teachers. The TBC has been specifically adapted for Brazilian undergraduates to ensure that its psychometric properties are satisfactory to this target population. However, it is not clear whether the two-factor model is adequate and to what extent different degrees of teacher performance are detected by the use of TBC. The objective of this study was to investigate additional evidence of the TBC’s psychometric properties. The data was collected in a sample of 676 undergraduate students. They rated one of three types of teachers: poor, average, or good. We identified the feasibility of multi-factor models but advocate the use of a one-factor model and a two-factor model. We also verified a difference between the three types of teachers, indicating that the TBC differentiates teachers’ performance. Additional reliability evidence was found. These data indicate that the TBC can be a useful resource to assist college teachers’ formative assessment.
Downloads
References
Ambiel, R. A. M., & Carvalho, L. de F. (2017). Definições e papel das evidências de validade baseadas na estrutura interna em psicologia [Definitions and role of validity evidence based on internal structure in psychology]. In: B. F. Damásio, J. C. Borsa (Orgs.), Manual de desenvolvimento de instrumentos psicológicos (pp. 85-100). São Paulo: Vector.
Buskist, W., & Keeley, J. W. (2018). Searching for universal principles of excellence in college and university teaching. New Directions for Teaching and Learning, 156, 95-105. https://doi.org/10.1002/tl.20321
Buskist, W., Sikorski, J., Buckley, T., & Saville, B. K. (2002). Elements of master teaching. In S. F. Davis & W. Buskist (Eds.), The teaching of psychology: Essays in honor of Wilbert J. McKeachie and Charles L. Brewer (pp. 30-39). New York: Psychology Press.
Cassettari, N. (2014). Avaliação de professores: Uma questão de escolhas [Teacher assessment: A matter of choice]. Estudos em Avaliação Educacional, 25(57), 166-197. https://doi.org/10.18222/eae255720142829
Costin, F., Greenough, W. T., & Menges, R. J. (1971). Student ratings of college teaching: Reliability, validity, and usefulness. Review of Educational Research, 41(5), 511-535. https://doi.org/10.3102/00346543041005511
Cunha, C. M., Almeida-Neto, O. P. de, & Stackfleth, R. (2015). Principais métodos de avaliação psicométrica da validade de instrumentos de medida [Main psychometric 14 evaluation methods of the validity of measuring instruments]. Revista de Atenção de Saúde, 14(47), 75-83. https://doi.org/10.13037/ras.vol14n47.3391
Damásio, F. B., & Dutra, D. F. (2017). Análise fatorial exploratória: Um tutorial com o software Factor [Exploratory factor analysis: A tutorial with the Factor software]. In B. F. Damásio, & J. C. Borsa (orgs.), Manual de desenvolvimento de instrumentos psicológicos (pp. 241-265). São Paulo: Vetor.
Dueber, D. M. (2017). Bifactor Indices Calculator: A Microsoft Excel-Based tool to calculate various indices relevant to bifactor CFA models. https://doi.org/10.13023/edp.tool.01
Field, A. (2009). Descobrindo a estatística usando o SPSS. Porto Alegre: Artmed.
Ferrando, P. J., & Lorenzo-Seva, U. (2017). Program FACTOR at 10: origins, development and future directions. Psicothema, 29(2), 236-241. http://dx.doi.org/10.7334/psicothema2016.304
Gusso, H. L., Archer, A. B., Luiz, F. B., Sahão, F. T., Luca, G. G. de, Henklain, M. H. O., Panosso, M. G., Kienen, N., Beltramello, O., & Gonçalves, V. M. (2020). Ensino Superior em tempos de pandemia: Diretrizes à gestão universitária. Educação & Sociedade, 41, e238957. https://doi.org/10.1590/es.238957
Hair, J. F. Jr., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis. Upper Saddle River, NJ: Pearson Prentice Hall.
Henklain, M. H. O., Carmo, J. S., Haydu, V. B., & Muniz, M. (2018a). Brazilian faculty and student perspectives on excellent teaching. New Directions for Teaching and Learning, 156, 31-39. https://doi.org/10.1002/tl.20314
Henklain, M. H. O., Carmo, J. S., Haydu, V. B. (2018b). Contribuições analítico-comportamentais para descrever o repertório de professores universitários eficazes. [Behavior-analytical contributions to describe the repertoire of effective university teachers]. Revista Brasileira de Orientação Profissional, 19(2), 197-207. https://www.redalyc.org/journal/2030/203059271008/
Henklain, M. H. O., Carmo, J. S., Haydu, V. B., Muniz, M., Buskist, W., & Keeley, J. W. (2020). Teacher Behavior Checklist: Psychometric evidence in teacher assessment by Brazilian college students. Paideia, 30(e3025), 1-11. https://doi.org/10.1590/1982-4327e3025
Keeley, J., English, T., Irons, J., & Henslee, A. (2013). Investigating halo and ceiling effects in student evaluations of instruction. Educational and Psychological Measurement, 73, 440-457.
Keeley, J., Furr, R. M., & Buskist, W. (2010). Differentiating psychology students’ perceptions of teachers using the Teacher Behavior Checklist. Teaching of Psychology, 37, 16–20. https://doi.org/10.1080/00986280903426282
Keeley, J., Smith, D., & Buskist, W. (2006). The Teacher Behaviors Checklist: Factor Analysis of its utility for evaluating teaching. Teaching of Psychology, 33(2), 84-91. https://doi.org/10.1207/s15328023top3302_1
Missunaga, D. H., Bovo, S. R. P., Abbas, K., & Ziroldo, L. (2021). Avaliação de docentes em instituições de ensino superior: Tendências, contribuições e oportunidades de investigação. [Teachers' evaluation in higher education institutions: Trends, contributions and research opportunities]. Brazilian Journal of Quantitative Methods Applied to Accounting, 8(1), 55-71. https://revistas.fucamp.edu.br/index.php/contabilometria/article/view/2134
Piolli, E., Silva, E. P., & Heloani, J. R. (2015). Plano Nacional de Educação, autonomia controlada e adoecimento do professor [National Education Plan, controlled autonomy, and teacher illness]. Caderno Cedes, 35(97), 589-607. https://doi.org/10.1590/CC0101-32622015154849
R Development Core Team. (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
Schneider, M., & Preckel, F. (2017). Variables associated with achievement in higher education: A systematic review of meta-analyses. Psychological Bulletin, 143(6), 565-600. http://dx.doi.org/10.1037/bul0000098
Vieira-Santos, J., & Henklain, M. H. O. (2020). Instrumentos com evidências psicométricas para avaliar o desempenho de professores universitários: Revisão de literatura [Instruments with psychometric evidence to evaluate college teachers’ performance: Literature review]. Revista Psicologia para América Latina, 34, 143-158. https://bit.ly/3dtm7LM
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Marcelo Henrique Oliveira Henklain, Monalisa Muniz, João dos Santos Carmo, Verônica Bender Haydu, Jared W. Keeley, William Buskist
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Each manuscript is accompanied by a statement specifyingThat the materials are unpublished, that have not been previously published in printed formatElectronic and that they will not be presented to any other means before knowing the decision of the magazine. ThroughoutIn case, any previous publication, sea in printed or electronic form, must be made known to the editorial staffWriting The authors attach a signed statement stating that, and the manuscript is acceptedFor publication, the rights of reproduction are the exclusive property of the Journal CES Psychology.Article metrics | |
---|---|
Abstract views | |
Galley vies | |
PDF Views | |
HTML views | |
Other views |