238-Article Text-546-1-10-20210707
238-Article Text-546-1-10-20210707
238-Article Text-546-1-10-20210707
Abstract
This study investigated teachers' reflective perspectives regarding
assessment practices of revised teachers’ training programs in the Punjab
province by employing qualitative approach. Faculty members of the two
universities and their affiliated colleges (N=18) where these programs are
introduced were interviewed and the texts were coded and analyzed
qualitatively by employing Grounded Theory Approach (Creswell, 2003).
The main perspectives that emerged as a result of analysis are graded
activities, criteria for marks allocation for formative assessment,
summative assessment, concept of rubrics, evaluation of student ability,
freedom of academic sharing, satisfaction level, problems that are
encountered by the teacher educators during assessment practices and
suggestions for improvement. In a nutshell, the interview data revealed
dissatisfaction of the teacher educators with the assessment system of
revised teachers’ training programs.
Keywords: Assessment Practices, Rubrics, Teacher Educators, Prospective
Teachers, Grounded Theory Approach, Thematic Analysis.
INTRODUCTION
Assessments are an essential component of the instructional process. The success of
any education system directly depends on the efficient practice of its assessment
process. This process helps the teachers and educationists to make judgments about
students’ academic performance. For effective functioning of the instructional
process, the teachers require information regarding the levels of students’
achievement. Through this information gathering process, the teacher can locate the
under achievers and students who are capable and ready for the next class. The
National Education Policy 2009 being the latest, proposed phasing out the teacher
education certification programs PTC and CT courses with a 4 year B. Ed by 2018.
The bridging program of Associate Degree in Education (ADE) was being introduced
__________________
Prof. Dr. Bushra Iqbal Chohan
Department of Education, Government College for Women, Zafar ul Haq Road,
Rawalpindi, Pakistan.
E-mail: [email protected]
Dr. Mussaret Anwer Shiekh
Ex-HoD, department of Education, Fatima Jinnah Women University, Rawalpindi
100 Sheikh & Chohan
The universities which introduced B. Ed (Hons) and ADE programs have prescribed
assessment policies to do away with the traditional method of declaring the students
fail or pass. Keeping in view this changed scenario, the basic aim of this study was an
exploration of teachers' reflective perspectives regarding revised teachers training
programs in the Punjab. The current study was conducted in 2012. Two universities
and their affiliated colleges teaching B. Ed (Hons) and ADE programs were selected
randomly with all the teachers in the sample institutions being the population of the
study. A total of 18 teacher educators were selected as sample of the study. In order to
elicit in-depth information regarding assessment practices, these teacher educators
(N=18) were interviewed. The epistemological position of the research team also
suggested that for generating in-depth data, they would have to interact with the
teachers as key informants, talk to them, listen to them and gain access to their
insights and articulations in order to capture their “lived experiences” (Hesse-Biber &
Leavy, 2006, p.317). A semi-structured interview (SSI) protocol was prepared to
obtain in-depth information as to how the assessment instruments were assembled by
the teachers in the first place. The interview protocol for teacher educators from
colleges and universities was developed to understand the process followed by
teacher educators in constructing assessment tools. Teacher educators were probed to
elicit responses regarding test blue prints; rubrics for allocating weight to each
cognitive trait and criteria for deciding the number of items relevant to each cognitive
trait included in the mid-term and final term papers.
Teachers' Perspectives and Challenges 101
Research Questions
1. What is the degree of alignment between the content and cognitive traits
embedded in the course objectives and those being assessed by the formal
assessment activities in B. Ed (Honors) and ADE Programs in the Punjab, as
measured against Bloom’s Taxonomy?
a) What content and cognitive traits are embedded in the course objectives
of the pre-service teacher preparation courses?
b) What content and cognitive traits are assessed in the selected courses
through the two most heavily weighted formal assessment instruments
administered in the selected courses of B. Ed (Hons.) and ADE?
Stage-1
The first stage involved the following steps:
1. Development of interview protocol.
2. Procurement of formal approvals from all the concerned university officials
including the selected teacher educators.
3. Development and training of research teams for the collection and analysis of
data.
Stage-2
At the next stage, for developing an in-depth understanding of the processes involved
in the development of the instruments, we conducted SSI with a sample of teacher
educators (N=18) drawn from the population of teacher educators teaching in selected
institutions.
For the purpose of qualitative analysis of the interview, transcripts of the participant
teachers, codes and categories were sorted, compared, and contrasted until no new
codes or categories were produced. This was followed by “a procedure called
‘discriminant sampling’ where the researcher posed questions that relate the
categories and then returns to the data and looks for evidence, incidents and events
that support or refute the questions, thereby verifying the data” (Creswell, 1998,
p.209). The entire text was then organized in terms of major themes that arose from
the data analysis. “Themes are typically ‘big ideas’ that combine several codes in a
way that allows the researcher to examine the foreshadowed questions guiding the
research” (Lodico, et al., 2006, p. 307). The pattern of themes characterizes “a
necessary dialogue between data and researcher, which emerges from and then helps
to further make sense of data, and to provide a structure for writing” (Holliday, 2007,
p.94).
Several themes emerged from the interviews of teacher educators. These themes were
later grouped together into larger perspectives that provide an answer to the
qualitative research question (Creswell & Clark, 2007). The main perspectives that
emerged as a result of analysis are graded activities, criteria for marks allocation for
formative assessment, summative assessment, concept of rubrics, evaluation of
student ability, freedom of academic sharing, satisfaction level and problems that are
encountered during assessment practices and suggestions for improvement. The
detailed description of these themes is as follows:
Graded Activities
Participants were asked about the graded activities in their B. Ed(ADE) and ADE
programs. It was revealed by the responses of the informants that various types of
graded activities were practiced in different institutions. There is no homogenous
practice in institutions in this regard, and institutions were not restricted to any
specific pattern by the university. Following are the activities which were practiced to
assess the students of B. Ed (Hons.) and ADE programs in sample institutions.
• Mid Term paper
• Final Paper
• School based task
• Home Assignments
• Presentations
• Projects
• Portfolio
• Class Participation
• Class quiz
• Reflective journal
Teachers' Perspectives and Challenges 103
Mid-term 10%
Assignment 5%
Presentation 3%
Attendance 2%
The participants of university 2 revealed that they had different criteria for marks
allocation for formative and summative assessments:
Final-term 60%
Mid Term 20%
Portfolio 10%
Class Participation 10%
Concept of Rubrics
Rubrics can be used in assessment process, and individual student assignments and
projects. Wolf and Stevens (2007) defined rubric as “a scoring tool used to evaluate a
performance in a given outcome area based on a list of criteria describing the
characteristics of products or performances at varying levels of accomplishment (p.4).
The concept of Rubrics was clear to most participants although there was some
misconception in usage of rubrics i.e. they perceived marks division for different
parts of questions as rubrics. Division of rubrics was done in terms of content,
handwriting, relevant material and references. Most of the instructors also expressed
that they share rubrics with students. However, this sharing was only for the portfolio.
At the same time, some participants revealed that the activities or assignments are not
designed in the line of some defined rubrics, nor are shared with the students in
written form; instead they verbally inform students about their marking criteria.
“We discuss with other faculty members while constructing mid-term papers
and other assignments in a formal meeting held for this purpose.”
Satisfaction level
Most of the participants were not satisfied because of lack of instructions on marking
criteria, instructions regarding exam papers, no intimation of the schedule for final
exam.
“Pattern has not been given by the university about the percentage of marks
in objective as well as subjective.”
The thematic analysis of the interview transcripts of teacher educators revealed that
the teachers assessed their students’ abilities through different types of activities such
as presentations, projects, portfolios and class participation. Data also revealed that
majority of the teachers did not have a clear concept of rubrics. Mid-term papers were
set by the respective teachers, but the teachers focused mainly on final-term exam
preparation, instead of measuring students’ abilities. The hard copies presented by the
teacher educators of the portfolios and projects etc. during interview sessions also
reflected that they only assess their Remembering and Understanding abilities.
Participants’ data also expressed their dissatisfaction regarding the marks allocation
policies of the two universities, since university 1 had given comparatively more
freedom to the affiliated colleges for internal assessment. However all the participants
agreed that at least half the share should go to the internal assessment system. They
believed that the respective teachers can assess students’ abilities more accurately.
As far as university 2 is concerned it gave only 20% weightage of the total marks for
internal assessment of the affiliated colleges whereby 10% was reserved for mid-term
test, and the remaining 10% assigned for all other activities such as projects,
presentations, class participation etc. The participants from university 2 were
thoroughly dissatisfied with this small percentage and complained that they could not
assess students’ abilities properly through this restricted allocation of marks.
The present study provides information of how teachers can handle problems related
to assessment practices. The personal experiences of the research team during the
whole research process and especially in the data collection process suggest that there
is still a large gap to be filled in for enhancing and improving the prevailing
assessment practices of teacher education. Prospective teachers should know how to
promote and assess critical thinking across curriculum. Wright, et al., (2012) have
stated that faculty adhere to traditional methods of sharing work and thus may be
unwilling to try new, innovative methods of co-creating writing products, which can
be more efficient and manageable (p.43).
Teachers' Perspectives and Challenges 107
CONCLUSION
The quality of teacher education is of primary concern in the present era of
globalization and educational standardization. Central to the idea of a quality
education is the quality of teaching provided by teachers to the students. Assessment
practices are directly related to quality education. Therefore, prospective teachers
should be exposed to appropriate assessment practices. They should also be explicitly
taught about multimodal assessment practices during their pre-service and in-service
teachers’ trainings. Research studies also give practicable suggestions in this regard.
Wilson and Scalise (2006) proposed process for discussion named moderation and
explained that:
A follow up may therefore be done with the National Curriculum Review Committee
to examine if the curriculum objectives of all courses in the 4 year B. Ed and 2 year
ADE programs adhere to the assessment practices that encourage students to think
analytically and critically, with understanding by applying knowledge in a creative
manner.
Recommendation
Participants proposed that the instructors should be given an opportunity of sharing
assessment practices with other faculty members and educational experts. In this
regard, they further proposed that senior faculty members from affiliated colleges
should be consulted while constructing final term assessment papers. Participants also
suggested that frequent meetings should be arranged especially at the start of the
semester to set the criteria of rubrics for all the assessment practices. All participants
expressed their dissatisfaction with the marks allocation criteria. They proposed that
at least 50% marks should be allocated for the internal assessment of the affiliated
colleges, so that they can assess their students properly.
108 Sheikh & Chohan
REFERENCES
Biggs, J. (1996). Enhancing Teaching Through Constructive Alignment. Higher
Education, 32(3), pp.347-364.http://www.jstor.org/stable/.Accessed: 08/01/2013
Brownstein, E. M., Allan, E., Ezrailson, C. M., Hagevik, R. A., Shane, J. W., & Veal,
W. R. (2009). Alignment of the 2003 NSTA Standards for Science Teacher
Preparation with the NCATE Assessment System. Journal of Science Teacher
Education, 20(5), 403-413.http://www.jstor.org/stable/.Accessed: 21/02/2013
Wolf†, K & Stevens, E (2007) The Role of Rubrics in Advancing and Assessing
Student Learning, The Journal of Effective Teaching, 7, (1) pp.3-14Accessed:
14/03/2013