Keywords
social representations
use of student ratings
teaching improvement
How to Cite
Abstract
This study examines social representations (SR) of university professors about a student questionnaire for rating their performance, and the use of its results to improve teaching. SR are systems of values, ideas, and practices, socially elaborated, which enable people to orient themselves, manage their world, and communicate with members of a given group. The content and organization of the SR were derived quantitatively from responses given by a sample of 175 professors to a self-administered questionnaire. There was noticeable variability between professors in their cognitions about the student questionnaire, and in their use of its results to improve teaching. However, there were some positive and negative predominating cognitions. The RS were characterized by a well organized structure that comprised three inter-correlated conceptions: (1) the validity of data obtained through the questionnaire, (2) management of results, and (3) professors‘ use of results to improve teaching. Generally, the first conception was more positive than the second. Lastly, the conception about the professor‘s use of the questionnaire results to improve teaching was typically of modest magnitude.
How to cite:
Collazo-Rodríguez, A. (2011). Representaciones sociales de profesores universitarios acerca del cuestionario estudiantil sobre su desempeño y el mejoramiento de la enseñanza a partir de los resultados obtenidos. Pedagogía, 44(1), 59-94. Retrieved from https://revistas.upr.edu/index.php/educacion/article/view/16560
References
Abric, J. C. (1993). Central system, peripheral system: Their functions and roles in the dynamics of social representations. Papers on Social Representations, 2, 75-78. Disponible en http://www.psych.lse.ac.uk/psr
American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement and Education (NCME). (1999). Standards for educational and psychological testing. Washington, DC: AERA.
Alzamora, S. & Campagno, L. (2006). Entrevista a la Dra. Denise Jodelet. Educación, Lenguaje y Sociedad, 4(4), 157-175.
Ander-Egg, E. (1977). Introducción a las técnicas de investigación social. Buenos Aires, Argentina: Editorial Hvmanitas.
Arreola, R. A. (2007). Developing a comprehensive faculty evaluation system: A guide to designing, building, and operating large-scale faculty evaluation systems. San Francisco, CA: Anker Publishing.
Banchs, M. A. (2000). Aproximaciones procesuales y estructurales al estudio de las representaciones sociales. Papers on Social Representations, 9, 3.1-3.15. Disponible en http://www.psych.lse.ac.uk/psr
Barnett, C. W., & Matthews, H. W. (1997). Student evaluation of classroom teaching: A study of Pharmacy faculty attitudes and effects on instructional practices. American Journal of Pharmaceutical Education, 61, 345-350.
Beran, T. N., & Rokosh, J. L. (2009). Instructors‘ perspectives on the utility of student ratings of instruction. Instructional Science, 37, 171-184.
Beran, T., & Violato, C. (2005). Ratings of university teacher instruction: How much do student and course characteristics really matter? Assessment & Evaluation in Higher Education, 30, 593-601.
Beran, T., Violato, C., Kline, D., & Frideres, J. (2005). The utility of student ratings of instruction for students, faculty, and administrators: A "consequential validity" study. The Canadian Journal of Higher Education, 35, 49-70.
Bierer, S. B., & Hull, A. L. (2007). Examination of a clinical teaching effectiveness instrument for summative faculty evaluation. Evaluation & the Health Professions, 30, 339-361.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. NY: The Guilford Press.
Bryden, P. J., & Fletcher, P. C. (2007). Personal safety practices, beliefs and attitudes of academic faculty on a small university campus: Comparison of males and females (Part 1). College Student Journal, 41, 613-622.
Butti, F. (s.f.). Representaciones sociales de los maestros y fracaso escolar: Hacia una propuesta metodológica. Recuperado de http://www.unne.edu.ar/Web/cyt/cyt/sociales/s-030.pdf
Cabanellas-Pazzi, S, & Pozzi, M. (2009). Representaciones de la física, su enseñanza y aprendizaje: Un estudio con estudiantes de nivel secundario y universitario. Recuperado de http://ice.uab.cat/congresos2009/eprints/cd_congres/propostes_htm/propostes/art-1372-1375.pdf
Campbell, J. P. (2005). Evaluating teacher performance in higher education: The value of student ratings. Dissertation presented at the University of Central Florida (UMI No. AAT 3188108).
Carugati, F., Selleri, P. & Scappini, E. (1994). Are social representations an architecture of cognitions? A tentative model for extending the dialog. Papers on Social Representations, 3 (2), 1-18. Disponible en http://www.psych.lse.ac.uk/psr
Cashin, W. E. (1988). Student rating of teaching: A summary of the research. IDEA Paper No. 20. Manhattan, KS: Kansas State University, Center for Faculty Evaluation and Development.
Cashin, W. E. (1990). Student ratings of teaching: Recommendations for use. IDEA Paper No. 22. Manhattan, KS: Kansas State University, Center for Faculty Evaluation and Development.
Cashin, W. E. (1995). Student rating of teaching: The research revisited. IDEA Paper No. 32. Manhattan, KS: Kansas State University, Center for Faculty Evaluation and Development.
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.
Centra, J. A. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. San Francisco: Jossey-Bass.
Cohen, J. (1988). Statistical power and analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
Collazo, A. A. (2010). Validación de las puntuaciones del Cuestionario de Opinión Estudiantil (COE). Informe preparado para el Comité Institucional de Evaluación del Personal Docente (CIEPD). Universidad de Puerto Rico, Recinto de Mayagüez. Documento inédito.
Conklin, M. H., & Desselle, S. P. (2007). Job turnover intentions among Pharmacy faculty. American Journal of Pharmaceutical Education, 71, 1-9.
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of Psychopathology. Journal of Consulting Psychology, 24, 349-354.
Davis, B. G. (2002). Student rating forms. Recuperado de http://teaching.berkeley.edu/bgd/ratingforms.html
Duven, G. (1994). Unanalysed residues: Representations and behaviors. Papers on Social Representations, 3 (2), 1-6. Disponible en http://www.psych.lse.ac.uk/psr
Duven, G. (2001). Introduction: The power of ideas. En S. Moscovici (Ed.), Social representations: Explorations in Social Psychology. NY: New York University Press.
Heckert, T. M., Latier, A., Ringwald, A., & Silvey, B. (2006). Relation of course, instructor, and student characteristics to dimensions of student ratings of teaching effectiveness. College Student Journal, 40, 195-203.
Hemphill, J. F. (2003). Interpreting the magnitudes of correlation coefficients. American Psychologist, 58. 78-79.
Howell, A. J., & Symbaluk, D. G. (2001). Published student ratings of instruction: Revealing and reconciling the views of students and faculty. Journal of Educational Psychology, 93, 790-796.
Jodelet, D. (1986). La representación social: fenómenos, conceptos y teoría. En: S. Moscovici (Compilador), Psicología social II (pp. 469-494). Barcelona: Paidós.
Jodelet, D. (2008). El movimiento de retorno al sujeto y el enfoque de las representaciones sociales. Cultura y Representaciones Sociales, 5(5), 32-63.
Kline. R. B. (2011). Principles and practice of structural equation modeling. NY: The Guilford Press.
Lacolla, L. H. (2005). Representaciones sociales: una manera de entender las ideas de nuestros alumnos. Revista Electrónica de la Red de Investigación Educativa (en línea), 1(3), 1-17. Disponible en http://revista.iered.org
Lang, J. W. B., & Kersting, M. (2007). Regular feedback from student ratings of instruction: Do college teachers improve their ratings in the long run? Instructional Science, 35, 187-205.
Lewis, K. G. (Ed.). (2001). Techniques and strategies for interpreting student evaluations. San Francisco: Jossey-Bass.
Marsh, H. W. (1987). Students‘ evaluations of university teaching: A multidimensional perspective. Higher Education: Handbook on theory and research (Vol. 8, pp. 143-234). NY: Agathon.
Marsh, H. W., & Roche, L. A. (1993). The use of students‘ evaluations and an individually structured intervention to enhance university teaching effectiveness. American Educational Research Journal, 30, 217-251.
Marsh, H. W., & Roche, L. A. (2000). Effects of grading leniency and low workload on students‘ evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92, 202-228.
Martínez-Sierra, G. (2010). ¿Qué son las matemáticas? Un estudio de las representaciones sociales que estudiantes de nivel superior tienen sobre las matemáticas. Recuperado de http://www.cormie.org.mx/congreso/memoria/v10/pdf/area_tematica_01/ponencias/1136-F.pdf
Messick, S. (1989). Validity. En: R. L. Linn (Ed.) Educational measurement (3rd ed., pp. 13-103). New York: Macmillan.
Messick, S. (1995). Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice, 14, 5-8.
Murray, H. G. (2005, June). Student evaluation of teaching: Has it made a difference? Paper presented at the annual meeting of the Society for teaching and Learning in Higher Education, Charlottetown, Prince Edwards Island.
Moscovici, S. (1979). El psicoanálisis, su imagen y su público. Buenos Aires: Ed. Huemul.
Moscovici, S. (1993). Introductory address. Papers on Social Representations, 2(3), 1-11. Disponible en http://www.psych.lse.ac.uk/psr
Nasser, F., & Fresko, B. (2002). Faculty views of student evaluation of college teaching. Assessment and Evaluation in Higher Education, 27, 187-198.
Ory, J. C. & Ryan, K. (2001). How do student ratings measure up to a new validity framework? En M Theall, P. C. Abrami & L. A. Mets (Eds.), New Directions for Institutional Research, 109, 27-44.
Page, S., & Alexitch, L. (1997). Faculty members‘ attitudes and perceptions about quality of university education. Canadian Journal of Education, 22, 82-88.
Parayitam, S., Desai, K. & Phelps, L. D. (2007). The effect of teacher communication and course content on student satisfaction and effectiveness. Academy of Educational Leadership Journal, 11, 91-105.
Penny, A. R. (2003). Changing the agenda for research into students‘ views about university teaching: Four shortcomings of SRT research. Teaching in Higher Education, 8, 399-411.
Rodríguez-Rincones, Y., Domínguez-Pérez, E. & Mejía-Ortega, M. A. (2009). Representación social de la educación ambiental en estudiantes de la Universidad del Magdalena. Revista de la Facultad de Ciencias de la Salud, 7(1), 41-48. Recuperado de http://arimaca.unimagdalena.edu.co/editorial/revistas/index.php/duazary/article/viewFile/204/217
Rodríguez-Salazar, T. (2003). El debate de las representaciones sociales en la psicología social. Relaciones, 24(93), 51-80.
Rokosh, J. L. (2007). Instructors‘ perspectives on the utility of student ratings of instruction. Tesis de maestría inédita, Universidad de Calgary, Alberta, Canada.
Ryan, J. J., Anderson, J. A., & Birchler, A. B. (1980). Student evaluation: The faculty responds. Research in Higher Education, 12, 317-333.
Tanner, J. R., Noser, T. C., & Totaro, M. W. (2009). Business faculty and undergraduate students‘ perceptions of online learning: A comparative study. Journal of Information Systems Education, 20, 29-39.
Wagner, W. (1993). Can representations explain social behavior? A discussion of social representations as rational systems. Papers on Social Representations, 2(3), 236-249. Disponible en http://www.psych.lse.ac.uk/psr
Witte, E. H. (1994). The social representation as a consensual system and correlation analysis. Papers on Social Representations, 3(1), 1-5. Disponible en http://www.psych.lse.ac.uk/psr
Yao, Y., Weissinger, E., & Grady, M. (2003). Faculty use of student evaluation feedback. Practical Assessment, Research & Evaluation, 8(21). Recuperado de http://PAREonline.net/getvn.asp?v=8&n=21
The contents published in the Puerto Rico Journal of Education is freely distributed under open access practices, in accordance with the Creative Commons license, Attribution-NonCommercial 4.0 International (CC BY-NC 4.0). Through these principles, the journal and its authors allow readers to access, reproduce and share articles in full text. Users should give credit to authors in a reasonable way without suggesting they have their support. Under no circumstances, readers may make use of the contents for commercial purposes. The authors retain copyright on their works.