University Management with Focus on Multicriteria Performance Evaluation: Illustration in the Brazilian Context

Abstract

Public universities have been facing situations that impel them to improvements in its management towards excellence in reaching, with quality, the objectives for which they were constituted, i.e., to offer teaching, research and extension. In this context, it is up to the managers of the universities to act proactively. The literature points out that the internal control systems are managerial tools capable of providing information for the manager’s actions in his/her activity; however we notice that the academic literature devoted to this demand is still scarce, especially as regards support for decision-making considering organizational specificities. Given the importance of the manager's activity and the lack of literature about the subject, it becomes important to develop tools to support the decision of those managers. For this purpose, we see Performance Evaluation, with a multicriteria focus, as a tool capable of filling this gap. Thus, this study proposes the construction of a performance evaluation model, through the Methodology Multicriteria Decision Aid – Constructivist (MCDA-C), to support the management and decision making of managers in a Brazilian public university. To illustrate the proposal for a university management we developed a case study in the Federal Technological University in southern Brazil. Among the main findings of this exploratory research we can mention: 129 aspects (indicators) were identified, grouped in the areas of Operational Support, Budget Management, Administrative Management and Transparency/Accountability, which account for the performance evaluation of DIRPLAD/UTFPR; the performance evaluation was proceeded and resulted in a score of 21 points on a scale from 0 to 100; it was shown how the built model serves as a management tool demonstrating how the manager can establish new action strategies to improve the performance of  DIRPLAD /UTFPR.
PDF

References

Albuquerque, J. M. (2011). "Avaliação dos controles internos de uma instituição pública de ensino superior à luz da metodologia MCDA-Construtivista". Revista Contemporânea de Contabilidade, 8(15), 129-150.

Allen, D. K. Wilson, T. D. (1996). "Information strategies in UK Higher Education Institutions". International Journal of Information Management, 16(4), 239-251.

Aranha, E. A., Garcia, N. A. P. (2014). "Dimensions of a metamodel of an entrepreneurial university". African Journal of Business Management, 8(10), 336-349.

Azevedo, R., Lacerda, R. T. O., Ensslin, L., Jungles, A., Ensslin, S. (2013). "Performance Measurement to Aid Decision Making in the Budgeting Process for Apartment-Building Construction: Case Study Using MCDA-C." Journal of Construction Engineering and Management, 139(2), 225–235.

Azma, F. (2010). "Qualitative Indicators for the evaluation of universities performance". Procedia Social and Behavioral Sciences., 2(2), 5408–5411.

Bana e Costa, C. A. Vansnick, J. C. (1997) "Applications of the MACBETH Approach in the Framework of an Additive Aggregation Model". Journal of Multi-criteria Decision Analysis, 6(2), 107-114.

Behn, R. D. (2003). "Why measure performance? Different purposes require different measures". Public Administration Review, 63(5), 586-606.

Bortoluzzi, S. C., Ensslin, S. R. & Ensslin, L. (2011). "Avaliação de desempenho multicritério como apoio à gestão de empresas: Aplicação em uma empresa de serviços". Gestão Prod., v.18, n.3, p.633–650.

Buys, F. Nkado, R. (2006). "A survey of maintenance management systems in South African tertiary educational institutions". Journal of Construction Management and Economics, 24 (10), 997-1005.

Casu, B. Thanassoulis, E. (2006). "Evaluating cost efficiency in central administrative services in UK universities". Omega-International Journal of Management Science, 34(5), 417-426.

Cavalluzzo, K. S. Ittner, C. D. (2004). "Implementing performance measurement innovations: evidence from government". Accounting, Organizations and Society, 29(3-4), 243-267.

Chen, S. H.; Wang, H. H. Yang, K. J. (2009). "Establishment and application of performance measure indicators for universities". TQM Journal, 21(3), 220-235.

Creswell, J. W. (2014). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4 th ed. SAGE Publications, Inc.

Duarte, A. R., Sandulli, F., Baker, P. M. (2014). "Un marco de análisis para la adopción de Sistemas de Gestión de Aprendizaje en las Universidades". Globalización, Competitividad y Gobernabilidad de Georgetown/Universia, 8(1).

Dutra, A. (2005). "Metodologias para avaliar o desempenho organizacional: revisão e proposta de uma abordagem multicritério". Revista Contemporânea de Contabilidade, [S.l.], v. 2, n. 3, p. 25-56, jan. 2005. ISSN 2175-8069.

Ensslin, L., Dutra, A. Ensslin, S.R. (2000). "MCDA: A constructivist approach to the management of human resources at a governmental agency", International Transactions in Operational Research, 7, 79-100.

Ensslin, L.; Montibeller, G. N. Noronha, S. M. (2001). "Apoio à Decisão: Metodologias para Estruturação de Problemas e Avaliação Multicritério de Alternativas". Ed. Insular.

Ensslin, L., Giffhorn, E., Ensslin, S.R., Petri, S. M. & Vianna, W.B. (2010). "Avaliação do Desempenho de Empresas Terceirizadas com o Uso da Metodologia Multicritério de Apoio à Decisão-Construtivista", Revista Pesquisa Operacional, 30(1), 125-152.

Ensslin, S. R.; Ensslin, L.; Back, F. Lacerda, R. T. O. (2013). "Improved decision aiding in human resource management: A case using constructivist multi-criteria decision aiding", International Journal of Productivity and Performance Management, Vol. 62 Iss: 7, pp.735 - 757. DOI: 10.1108/IJPPM-04-2012-0039.

Ensslin, S.R.; Ripoll-feliu, V.M.; Ensslin, L. Dutra, A. (2014). "Performance evaluation to Support the University Management Activity". Pensee Journal (Paris), ISSN: 0031-4773, 76(8), 2-17.

Galbraith, P. L. (1998). "System dynamics and university management". System Dynamics Review, 14 (1), 69-84.

Habib, M. (2011). "An exploratory analysis of educational management for the universities". International Journal of Engineering Business Management, 3(3), 16-24.

Heinrich, C. J. (2002) "Outcomes-based performance management in the public sector: Implications for government accountability and effectiveness". Public Administration Review, 62( 6), 712-725.

Igarashi, D. C. C.; Paladini, E. P. & Ensslin, S. R. (2007) "A Metodologia Multicritério de Apoio à Decisão Construtivista como subsídio para o gerenciamento interno: Estudo de caso no PPGC/UFSC". Organização & Sociedade, v. 14, p. 133-149.

Keeney, R. L. (1992). "Value Focused-Thinking: A Path to Creative Decision-making". Cabridge: Harvard Univ. Press.

Lacerda, R.T.O., Ensslin, L. Ensslin, S.R. (2011). "A performance measurement framework in portfolio management: A constructivist case", Management Decision, 49(3-4), 648-668.

Lacerda, R. T. D. O.; Ensslin, L.; Ensslin, S. R.; & Dutra, A. (2014) "A Constructivist Approach to Manage Business Process as a Dynamic Capability". Knowledge and Process Management, v. 21, n. 1, p. 54-66.

Lee, S-H. (2010). "Using fuzzy AHP to develop intellectual capital evaluation model for assessing their performance contribution in a university". Expert Systems with Applications, v.37, p. 4941–4947.

Leroux, K. & Wright, N. S. (2010). "Does Performance Measurement Improve Strategic Decision Making? Findings From a National Survey of Nonprofit Social Service Agencies". Nonprofit and Voluntary Sector Quarterly, 39(4), 571-587.

Lyrio, M. V. L.; Brotti, V.; Ensslin, S. R. Ensslin, L. (2008). "Proposta de um Modelo para Avaliar o Grau de Transparência das Demonstrações Financeiras publicadas por uma Instituição Pública de Ensino Superior Brasileira: a abordagem da Metodologia Multicritério de Apoio à Decisão Construtivista". Contabilidade, Gestão e Governança (Revista UnB Contábil), 11(1-2), 170-186.

Marra, A. V.; Melo, M. C. O. L. (2005). "A prática social de gerentes universitários em uma Instituição pública". Revista de Administração Contemporânea (RAC), v. 9, n. 3, p. 9-31.

Neely, A. (2005). "The evolution of performance measurement research: Developments in the last decade and a research agenda for the next". International Journal of Operations & Production Management, 25(12), 1264-1277.

Oliveira, C. E. M.; Turrioni, J. B. (2006). "Medidas de desempenho na gestão pública: Estudo de caso em uma Instituição Federal de Ensino Superior. " In: Simpósio de Administração da Produção, Logística e Operações Internacionais, IX, 2006. São Paulo/SP. Anais Eletrônicos. São Paulo/SP: FGV-EAESP, 2006. Disponível em: < http://www.simpoi.fgvsp.br/index.cfm?FuseAction=arquivo.monta&ID_EdicaoArquivo=2006&Pagina=busca_det&ID=514 >. Acesso em: 27 ago. 2014.

Philbin, S. P. (2011). "Design and implementation of the Balanced Scorecard at a university institute". Measuring Business Excellence, 15(3), 34-45.

Rosa, F. S.; Ferreira, A. C. S.; Ensslin, S. R.; Ensslin, L. (2010). "Evidenciação Ambiental (EA): Contribuição da Metodologia Multicritério para Identificação dos Aspectos Financeiros para a Gestão Ambiental". Contabilidade Vista & Revista, v. 21, p. 27-61.

Roy, B. (1993). "Decision science or decision-aid science?" EJOR, v. 66, n./2. p 184-203.

Sanderson, I. (2001) "Performance management, evaluation and learning in 'modern' local government". Public Administration, 79(2), 297-313.

Sarrico, C. S. Dyson, R. G. (2000). "Using DEA for planning in UK universities - an institutional perspective". Journal of the Operational Research Society, 51( 7), 789-800.

Sheehan, N. T.; Vaidyanathan, G. Kalagnanam, S. (2009). "A balanced scorecard for state U's facilities management division? " Accounting Perspectives, 8(1), 69-83.

Silva, R. M., Senna, E. T., Senna, L. A. (2014). "Governance of logistics platforms: The use of a survey for building a framework of performance indicators". African Journal of Business Management, 8(10), 350-365.

Tahar, S.; Niemeyer, C. Boutellier, R. (2011) "Transferral of Business Management Concepts to Universities as Ambidextrous Organisations". Tertiary Education and Management, 17(4), 289-308.

Tapinos, E.; Dyson, R. G. Meadows, M. (2005). "The impact of the performance measurement systems in setting the 'direction' in the University of Warwick". Production Planning & Control, 16(2), 189-198.

Tasca, J. E.; Ensslin, L.; Ensslin, S. R. (2012). "A avaliação de programas de capacitação: um estudo de caso na administração pública". Revista de Administração Pública, 46, 647-675.

Wu, H. Y.; Lin, Y. K. Chang, C. H. (2011). "Performance evaluation of extension education centers in universities based on the balanced scorecard". Evaluation and Program Planning, 34(1), 37-50.

Yang, K. F. Hsieh, J. Y. (2007). "Managerial Effectiveness of Government Performance Measurement: Testing a Middle-Range Model". Public Administration Review, 67(5), 861-879.

Zakaria, Z. Selvaraj, S. D. (2006). "Internal auditors: Their role in the institutions of higher education in Malaysia". Managerial Auditing Journal, 21(9), 892-904.