Educational evaluation

Burocracia Científica e Pluralismo Cultural

by Paulo Ferreira da Cunha

in "Revista Internacional d'Humanitats", n.º 24, São Paulo / Barcelona,  jan.-abril 2012,

Those who really know the University of today do also know that it's too much excitement. Professors are suffocating... more Those who really know the University of today do also know that it's too much excitement. Professors are suffocating with too much activities. They have almost no private lives (some can not even have one). Nevertheless, actual results of such a hurry are not too positive. It is the kingdom of quantity, not quality.

Some of the vectors that contribute to this gap between the effort and occupation on the one hand, and the training results of the other, are of a cultural nature. Universities tend to copy a single model,  a single thought, and they are thus not adapted to each area of knowledge; they have no dialogue with their own contextual cultural area.

Devil in the detail: using a pupil questionnaire survey in an evaluation of out-of-school classes for gifted and talented children

by Mike Lambert

Education 3-13, 36(1) February 2008, 69-78.

The use of questionnaires to evaluate educational initiatives is widespread, but often problematic. This paper... more The use of questionnaires to evaluate educational initiatives is widespread, but often problematic. This paper examines four aspects of an evaluation survey carried out with very able pupils attending out-of-school classes: ethics, design, bias and interpretation. There is a particular focus on the interpretation and analysis of pupils’ answers to open questions. Conclusions are drawn from this analysis which will help teachers and others to take a careful and critical approach to their use of questionnaires in educational evaluation.

Author profile: http://www.wlv.ac.uk/default.aspx?page=13209

[A limited number of eprints of this article are available - send me a message if you require one].

Transitions of Truants: Community Truancy Board as a Turning Point in the Lives of Adolescents

by Kevin Wright

Johnson, Charles L, Kevin A. Wright, and Paul S. Strand (2012). "Transitions of Truants: Community Truancy Board as a Turning Point in the Lives of Adolescents." Journal of Juvenile Justice, 1(2), 34-51.

School dropout represents a major turning point in a person’s life that could be seen as an initial step on a... more School dropout represents a major turning point in a person’s life that could be seen as an initial step on a difficult pathway to reduced conventional opportunities. The challenge is to identify interventions that can successfully reintegrate students back into a school setting in a manner that encourages continued attendance and involvement. One such program is the West Valley Community Truancy Board in Spokane, Washington. In addition to the truancy board process, the program employs a court-appointed officer to mentor students and manage the overall process of identifying and attending to the risks and needs that promote truancy. Guided by Sampson and Laub’s (1993) age-graded theory of informal social control and Cullen’s (1994) application of social support to delinquency, the current analysis seeks to determine the overall effectiveness of the truancy board based on both quantitative analyses of outcomes and qualitative interviews with key actors. We discuss the implications for the ongoing theoretical, empirical, and policy debates surrounding truancy intervention.

Analysing video and audio data: existing approaches and new innovations

by Elizabeth FitzGerald (née Brown)

Full citation:
FitzGerald, E. (2012) Analysing video and audio data: existing approaches and new innovations. Short paper submitted to the Surface Learning Workshop 2012, 18-20 March 2012, Bristol, UK.

Across many subject disciplines, video and audio data are recorded in order to document processes, procedures or... more Across many subject disciplines, video and audio data are recorded in order to document processes, procedures or interactions. These video and audio data are consequently analysed using a number of techniques, in order to try and make sense of what was happening at the time of the recording, sometimes in relation to initial hypotheses or sometimes in terms of a 'post hoc' analysis where a more grounded approach is used. This paper contains an overview of tools and techniques for examining video data and looks at potential new methods borrowed from the field of learning analytics, related to discourse analysis. Discourse analysis, where conversations and the spoken word are explored and dissected in detail, can provide us with information about the learning context and the ways in which learners interact with people and other resources in their environment.

Technology Enhanced Learning in Higher Education: results from the design of a quality evaluation framework

by Diogo Casanova

Casanova, D., Moreira, D. & Costa, N. (2011). Technology Enhanced Learning in Higher Education: results from the design of a quality evaluation framework. Procedia - Social and Behavioral Sciences, 29, 893-902. (ISSN 1877-0428). (http://www.sciencedirect.com/science/article/pii/S1877042811027807)

This paper presents an ongoing research that deals with the development of a quality framework of reference for... more This paper presents an ongoing research that deals with the development of a quality framework of reference for Technology Enhanced Learning in Higher Education. We will present the design of the methodology used for building our framework linked to a collection of internal and external references. We will also present criteria derived from this data collection phase. We will set landmarks for discussing what determines quality in Technology Enhanced Learning and what dimensions must be considered to evaluate its quality.

Augmenting the field experience: A student-led comparison of techniques and technologies.

by Elizabeth FitzGerald (née Brown)

Full citation:
Priestnall, G., Brown, E., Sharples, M. and G. Polmear (2010) Augmenting the field experience: A student-led comparison of techniques and technologies. In: Brown, E. (ed) Education in the Wild: A report from the STELLAR Alpine Rendez-Vous workshop series. University of Nottingham: Learning Sciences Research Institute (LSRI). ISBN 9780853582649: pp 43-46.

In this study we report on our experiences of creating and running a student fieldtrip exercise which allowed students... more In this study we report on our experiences of creating and running a student fieldtrip exercise which allowed students to compare a range of approaches to the design of technologies for augmenting landscape scenes. The main study site is around Keswick in the English Lake District, Cumbria, UK, an attractive upland environment popular with tourists and walkers. The aim of the exercise for the students was to assess the effectiveness of various forms of geographic information in augmenting real landscape scenes, as mediated through a range of techniques and technologies. These techniques were: computer-generated acetate overlays showing annotated wireframe views from certain key points; a custom-designed application running on a PDA; a mediascape running on the mScape software on a GPS-enabled mobile phone; Google Earth on a tablet PC; and a head-mounted in-field Virtual Reality system. Each group of students had all five techniques available to them, and were tasked with comparing them in the context of creating a visitor guide to the area centred on the field centre. Here we summarise their findings and reflect upon some of the broader research questions emerging from the project.

Standardization of the Saudi Secondary School Certificate Examinations and the anticipated impact on Foreign Language Education

by Dr. Ahmed Gumaa Siddiek

Published in "International Journal of Humanities and Social Science Vol. 1 No. 3; March 2011" - USA

Scholastic Achievement tests are standardized in form and content to fairly serve all the audience - who take them -... more Scholastic Achievement tests are standardized in form and content to fairly serve all the audience - who take them - under similar circumstances. Therefore, they are reliable tools for measuring the performance of the examinees. On the other hand, proficiency tests are intended to measure the overall abilities of the learners. So they cannot serve as yardstick to tell us about the degree of the attainment of the national educational objectives embedded in the textbooks. The Education authority is advised to recall the national certificate examinations which qualify learners for higher education, under fair national competition. The role of other proficiency tests should be integrative to the major role of the Ministry of Education, who alone should have the right to interpret the usefulness and credibility of secondary school certificate, and how to use this national document in the assessment of students' performance at the personal, national or international level.

Evaluation of the Sudan School Certificate English Examiantions

by Dr. Ahmed Gumaa Siddiek

Published in "English Language Teaching Vol. 3, No. 2; June 2010" CANADA

Examinations - among other things - are tools of quality control by which we can measure the attainment of the... more Examinations - among other things - are tools of quality control by which we can measure the attainment of the national educational goals. High-quality examinations are means of evaluation that can help teachers modify their teaching techniques as well as helping learners adjust their learning strategies. Examinations are also benchmarks that can help decision makers to judge the success of their educational, social and political aims. This paper explores the features of the Sudan School Certificate English Examinations (SSC) from the perspective of content validly and comprehensiveness. The data was collected through a questionnaire and analytically processed by machine to come out with some findings that: the (SSC) English Examinations in their recent forms are incomprehensive and lack content validity. They are proficiency tests rather than scholastic standardized achievement examinations. Therefore, they have negative backwash on language education development in our country.

Standardization of the Saudi Secondary School Certificate Examinations and the anticipated impact on Foreign Language Education

by Dr. Ahmed Gumaa Siddiek

Published in "International Journal of Humanities and Social Science Vol. 1 No. 3; March 2011" - USA

Scholastic Achievement tests are standardized in form and content to fairly serve all the audience - who take them -... more Scholastic Achievement tests are standardized in form and content to fairly serve all the audience - who take them - under similar circumstances. Therefore, they are reliable tools for measuring the performance of the examinees. On the other hand, proficiency tests are intended to measure the overall abilities of the learners. So they cannot serve as yardstick to tell us about the degree of the attainment of the national educational objectives embedded in the textbooks. The Education authority is advised to recall the national certificate examinations which qualify learners for higher education, under fair national competition. The role of other proficiency tests should be integrative to the major role of the Ministry of Education, who alone should have the right to interpret the usefulness and credibility of secondary school certificate, and how to use this national document in the assessment of students' performance at the personal, national or international level.

The Impact of (Qiyas) Examinations on Students' Educational Achievements and Future Career.

by Dr. Ahmed Gumaa Siddiek

Work in progress

Abstract
This research aims at investigating the opinions and attitudes of the students in the Community College... more Abstract
This research aims at investigating the opinions and attitudes of the students in the Community College in Dawadami – about the credibility and reliability of the (Qiyas) Proficiency and Achievements Tests and the impact of these tests on their life career. There was not any previous survey–to the best of my knowledge-investigated the impact of these tests on the students' achievements. This survey is an attempt to reflect the students' opinion through a questionnaire of six statements, from which we aim to realize the attitudes of these young men on this issue. It is found that most examinees said that (Qiyas) had negatively affected their lives as it ignored their achievements of twelve years in their general schooling. It is also found that students were also aware of the fact of the poor reputation of the Saudi School Certificate at the local and international level, as it is no longer seen as a document of high credibility by both:local and international institutions.

The attitudes of the Students of the Community College in Shaqra University towards the Decentralization of the Secondary School Leaving Certificate Examinations

by Dr. Ahmed Gumaa Siddiek

Work in Progress

Abstract: Contemporary education requires educational authorities to look for the ideal and keep pace with scientific... more Abstract: Contemporary education requires educational authorities to look for the ideal and keep pace with scientific and technological progress to achieve successful learning outcomes. Examinations are means of measurement and evaluation of the work carried out by the teaching force to promote the level of students' achievement, and determine the degree of assimilation and understanding of subjects taught to them. A test is an essential device to help achieve educational goals; it is also an effective tool to reflect the effectiveness of teaching, the success of the curricula and usefulness of the textbooks. The decentralization of secondary school certificate examinations in Saudi Arabia has brought about some complications at the local and international level. The impact on the credibility of the secondary school certificate Arabia as a criterion for learning outcomes and effective tool for measuring educational outcomes, has become a controversial issue. The decentralization resulted in the creation of another assessment mechanism (Qiyas), which led to more complications and dissatisfaction among students and parents as it ignores 12 years of student's achievements in high school. This research is an attempt to explore the opinions and attitudes of students about the effects of decentralization of the secondary school examinations and its relationship with their recent and previous learning achievements.

The General Certificate Examinations as a Tool of Measurement & Quality Control of Educational Objectives in Some Arab Countries with Special Reference to Saudi Arabia

by Dr. Ahmed Gumaa Siddiek

It will appear on May 2012 in American International Journal of Contemporary Research - USA

National examinations are means by which learners' academic achievements can be judged, through national competitions... more National examinations are means by which learners' academic achievements can be judged, through national competitions of standardized examinations. The General Certificate of Education (GCE) is an effective tool for the assessment of educational objectives; as from the results achieved by students in these examinations, we can measure: the degree of their performance, to see the points of strength to reinforce them or to spot weaknesses to cure them. These tests can also tell us about the effectiveness of the teaching force in their practice in classrooms, as well as telling us about the success of the teaching units (curriculum). The (GCE) is a tool of quality control, through which the organization (state, government, institute) can achieve social, cultural and political agendas. The decentralization of the Saudi school certificate - as an example - was expected to serve national objectives, but it has yielded negative impact on education, due to the implementation of controversial examining criteria of students' performance, as a result of absence of uniformity of measuring devices within the teachers' community. The (GCE) is an important educational document. It is a means of assessment, control device, as well as a symbol of national pride; with local and international implications.

The Design of a Meta-Evaluation Study of Learning and Teaching Projects in Higher Education

by Elaine Huber

Huber, E. & Harvey, M. (2012). published in Proceedings of Global TIME 2012 (pp. 71-77). AACE.

Within Higher Education there exists a body of work on the how and why of evaluation of educational programs. Academic... more Within Higher Education there exists a body of work on the how and why of evaluation of educational programs. Academic teaching staff are also highly conversant in the processes and benefits of evaluation of their own teaching. However there is little evidence in the literature of the evaluation of learning and teaching projects in the Higher Education sector, the majority of which are carried out by academic staff. A preliminary search of the literature indicates a trend towards guidelines on how and what to evaluate. There is little written on how effective these prove to be or whether they are even adhered to. This paper will outline the three phases of a mixed-methods research study that investigates the evaluation strategies used in learning and teaching projects in higher education and the reasons for the apparent limited systematic evaluation of such projects. The study will produce an interactive (online) evaluation, planning and implementation tool, which aims to build efficiencies into the evaluation process.

Educational Evaluation in the Sudan

by Dr. Ahmed Gumaa Siddiek

http://www.lulu.com/product/hardcover/assessment-of-the-sudan-school-certificate-english-examinations/5559687 - United Kingdom

Education in the Sudan today has to witness radical changes in the entire educational system and in the establishment... more Education in the Sudan today has to witness radical changes in the entire educational system and in the establishment of new educational objectives, which are to be carried out to secure the nation's aspiration for an active and effective education system. Many educational conferences are expected to take place to discus educational issues. This part of my book may add some historical perspectives of assessment in the country

Technology for school-based assessment and assessment for learning: Development principles from New Zealand

by Gavin Brown

This paper was first presented at an APEC colloquium in Kuala Lumpur and distills the thinking behind the asTTle project and our recommendations as to how similar products could be developed elsewhere.

full citation:
Hattie, J. A. C., & Brown, G. T. L. (2008). Technology for school-based assessment and assessment for learning: Development principles from New Zealand. Journal of Educational Technology Systems, 36(2), 189-201.

National assessment systems can be enhanced with effective school-based assessment (SBA) that allows teachers to focus... more National assessment systems can be enhanced with effective school-based assessment (SBA) that allows teachers to focus on improvement decisions. Modern computer-assisted technology systems are often used to deploy SBA systems. Since 2000, New Zealand has researched, developed, and deployed a national, computer-assisted SBA system. Eight major principles for the development of an SBA system are derived from those experiences and outlined. These principles focus on curriculum alignment, calibration, innovative communication, choice, low consequences, and local control. Incremental design and deployment of computer technology ensures success. We argue that these principles can be used in any nation to bring about effective improvements in learning and teaching outcomes, while providing quality assurance to governments and citizens.

Veje til fremtidens skolebibliotek

by Roland Hachmann

Evaluating the needs and potentials of school libraries of the future. (This paper is in danish)

I projekt Fremtidens Skolebibliotek deltager 13 skolebiblioteker fra Region Syddanmark. Projektet har som mål at... more I projekt Fremtidens Skolebibliotek deltager 13 skolebiblioteker fra Region Syddanmark. Projektet har som mål at flytte en række af skolebibliotekets aktiviteter fra den analoge til den digitale platform. Projekt Fremtidens Skolebibliotek koordineres af Center for Undervisningsmidler, Aabenraa og er støttet af Styrelsen for Bibliotek og Medier. Projektet afvikles i skoleåret 2010-2011. Projektet evalueres af University College Syddanmark.

l'évaluation au coeur des apprentissages

by Olivier Rey

From the development to the evaluation of students' competences

by Pedro Reis

Creativity Evaluation through Latent Semantic Analysis

by Eve Forster

Evidence-based school counseling: Making a difference with data-driven practices

by Trish Hatch

Co-Authored with Carey Dimmitt and John C. Carey