Critical Evaluation Skills PDF
Critical Evaluation Skills PDF
Table of contents
Purpose of this toolkit ............................................................................................ 3
Why your students need skills in critical evaluation .............................................. 5
What employers, graduates and students say about critical evaluation ................ 7
Teaching tips - How to develop your students skills in critical evaluation ............. 9
Assessing students critical evaluation skills ....................................................... 25
Principles of effective analysis and critical evaluation skills ................................ 31
Where to go for help ........................................................................................... 33
Additional resources on analysis and critical evaluation skills ............................ 34
Appendix A- Student handouts ........................................................................... 35
NOTE: The URLs listed in this toolkit were current at the time of retrieval. However, please note these may
change with time as websites update.
Critical Evaluation Skills Toolkit
Page 2
This Toolkit, Critical Evaluation Skills, focuses on how students can develop these skills
at university and apply them in other contexts.
This toolkit, together with others in the series (as shown in the following table) can be
accessed via the Griffith Institute for Higher Education webpage, the URL of which is
listed on the following page.
GRADUATE
ATTRIBUTES
DESCRIPTOR
TOOLKIT
(1)
Knowledgeable
and Skilled in
their
Disciplines
n/a
An interdisciplinary perspective
Interdisciplinary Skills
Information Literacy
Professional Skills
(2)
Oral Communication
Effective
Communicators
and Team
Members
Written
Communication
Teamwork Skills
Page 3
GRADUATE
ATTRIBUTES
DESCRIPTOR
TOOLKIT
(3)
Creativity and
Innovation*
Critical Evaluation
Research Skills
Creativity and
Innovation*
Problem Solving
Further Learning
To be developed
Global and
International
Perspective and
Awareness*
Global and
International
Perspective and
Awareness*
Innovative and
Creative, with
Critical
Judgement
(4)
Socially
Responsible
and Engaged in
their
Communities
(5)
Competent in
Culturally
Diverse and
International
Environments
Page 4
Definition
Skills in analysis and critical evaluation enable the refinement of problems and issues
into their component parts, so that their significance and inter-relationships can be
examined before being synthesised back into a whole. Critical evaluation is about
proving a point, interpreting information and resolving problems. The ability to make
informed judgments or evaluations about the worth, validity and reliability of opinions,
ideas and knowledge is crucial in this process.
When we think critically, we are evaluating the outcomes of our thought processes.
Halpern, D.F. (1997). Critical Thinking Across the Curriculum: A Brief Edition of Thought and Knowledge.
Mahwah, NJ: Lawrence Erhlbaum & Associates, p. 4
Business Council of Australia and Australian Chamber of Commerce and Industry. (2002).
Employability Skills for the Future. Canberra: AGPS. (Retrieved from the World Wide Web on 1
September, 2004)
http://www.dest.gov.au/sectors/training_skills/publications_resources/other_publications/
Critical Evaluation Skills Toolkit
Page 5
Academic excellence
At university, students are expected to be able to:
Check whether the evidence and argument provided really support the
conclusions.
Palgrave Macmillan. (n.d.). Critical/Analytical Skills. (Retrieved from the World Wide Web on 2
September, 2004) http://www.palgrave.com/skills4study/html/studyskills/critical.htm
Facione, P. (2010). Critical Thinking: What It Is and Why It Counts. (Retrieved from the World Wide Web on
1 November 2010) http://www.insightassessment.com/pdf_files/what&why98.pdf
Page 6
Analysis and critical evaluation would have to be two of the most important skills we
look for, because we believe that graduates already have learned the content
knowledge. What they then need is the ability to apply that knowledge. If they can
analyse and evaluate the knowledge they have, then they can apply it in the workplace.
(Employer of Griffith Engineering Graduates, 2003)
We have a lot of graduate analyst roles: manufacturing analyst roles, sales analyst
roles, etc. And all these roles have an element where they need to analyse data, they
need to analyse trends in our business. With some of the roles, they actually need to
analyse other business units, other departments and think outside the box. Were not
looking for old styles of thinking. Were looking for graduates with fresh blood and new
ways of thinking, so thats where those kind of skills come in.
(Employer of Griffith Graduates, 2004)
I look for critical evaluation skills within the workplace context because thats the kind of
thing that will help take the organisation forward. They [new graduates] represent a new
breed of thinking. Also, dealing with the political environment that they work in I think
that is one of the major things people have to learn.
(Employer of Griffith Criminology and Criminal Justice Graduates, 2002)
Page 7
Graduates comments
The importance of analysis and critical thinking is apparent in daily life. It can help you
avoid the mindset of Well, thats the way Ive always done it. Behaviours, habits, tasks
and even the way one goes about making decisions can be critically analysed and
evaluated. That doesnt mean that each daily decision has to become a laborious
analytical nightmare. But it does mean that maybe if youre not happy with certain
recurring outcomes, you might need to take a critical approach to the process.
(Griffith Graduate, 2002)
Students comments
As an undergraduate, it can be easy to be intimidated by academic discourse. The fear
is that you will simply be parroting a standard line or that your inability to deconstruct an
argument will be apparent. Developing critical thinking and evaluation skills is definitely a
learned quality that needs to be practised.
(Griffith Student, 2003)
Assignment work at university has really developed my critical thinking and analytical
skills. This is because Im required to analyse and interpret information, filter out
information that isnt relevant and use it to form an intelligent argument.
(Griffith Student, 2003)
Page 8
Organise ideas in a logical, but not rigid, structure that can be updated.
Read widely on the subject to identify 10-15 key concepts or ideas and several
examples. (Use different colours to distinguish concepts and examples);
Write ideas on a large sheet of paper with the most abstract ones at the top and
the most specific at the bottom. Dont include the examples yet. (Do this step on
post-it notes so that you can move the concepts around);
If possible, arrange the concepts so that ideas go directly under ideas that they
are related to (hierarchically). Duplicate the post-its to show overlap. Add
concepts that help explain, connect, or expand the ideas;
Connect the abstract concepts at the top to the specific concepts lower down or
on the same level. Rearrange the post-its during this stage;
Page 9
On the connecting lines, write words or phrases that explain the relationship
between the concepts. Continue to rearrange the pieces of paper until the
relationships are clear;
Put the examples under the concepts they belong with, and connect the concept
to the example with a phrase such as for example.
Georgia Perimeter College. (n.d.). Concept Mapping. (Retrieved from the World Wide Web on 1
November, 2010)http://facstaff.gpc.edu/~shale/humanities/composition/handouts/concept.html
Why not:
Take 15 minutes of a lecture to ask students to break into groups of four and pool
their understanding of how your course or subject fits in the overall design of the
degree program by concept mapping.
Then draw your own understanding on the board and check students concept maps
against it.
Some further information and software tools for concept mapping
Page 10
DOGS
are
need
MAMMALS
are often
are
sometimes
have
CARE
includes
FOOD
HAIR
PETS
suckle
their
can have
YOUNG
PERSONALITIES
WATER
SHELTER
Figure 1. An example of a simple concept map. This map illustrates some of the key
characteristics of concept maps.
Fraser, K. (1996). Student Centred Teaching: The Development and Use of Conceptual Frameworks.
Herdsa Green Guide. ACT, Australia: HERDSA, p.3.
Page 11
Oral test on basic (subject-specific) vocabulary: One complex tactic that aids
student learning is the oral test. Students are given a vocabulary list. They are put
into groups of twos or threes and are asked to take turns explaining what the words
mean.
The Critical Thinking Community. (n.d.). Structures for Student Self-Assessment. (Retrieved from the
World Wide Web on 1 November, 2010)
http://www.criticalthinking.org/page.cfm?PageID=458&CategoryID=64
Oral communication
Structuring an argument
Page 12
Negative
Page 13
Education:
The welfare of the child is of more importance than the rights of parents.
Questioning
Theres more to questioning students than just checking their understanding. Simple
questions require students to define, list, classify, recall or do something. Complex
questions ask them to explain, challenge, compare or contrast, analyse, evaluate
things, or hypothesise about them.
Blooms Taxonomy (1956) categorises the way people learn into three domains.
One of these is the cognitive domain, which emphasises intellectual outcomes. This
domain is further divided into sub-categories or levels. The key words used and the
type of questions asked can encourage critical thinking, especially at the higher
levels.
Level 1:
Knowledge
Exhibits previously learned material by recalling facts, terms, basic concepts and
answers.
Key words
Who, what, why, when, omit, where, which, choose, find, how, define, label, show, spell, list,
match, name, relate, tell, recall, select.
What is ?
When did ?
How is ?
Can you recall ?
Where is ?
How would you show ?
When did .happen?
Can you select ?
How did . happen?
Who were the main ?
How would you explain ?
Can you list three ?
Why did ?
Which one ?
How would you describe?
Who was ?
Questions
Page 14
Level 2:
Comprehension
Key words
Compare, contrast, demonstrate, interpret, explain, extend, illustrate, infer, outline, relate,
rephrase, translate, summarize, show, classify.
How would you classify the type of ?
Which statements support?
How would you compare ? contrast ?
Can you explain what is happening
what is meant?
Will you state or interpret in your own words
?
What can you say about?
How would you rephrase the meaning of?
Which is the best answer ?
What facts or ideas show ?
How would you summarise ?
What is the main idea of ?
Questions
Level 3:
Application
Key words
Apply, build, choose, construct, develop, interview, make use of, organize, experiment with,
plan, select, solve, utilize, model, identify.
How would you use ?
How would you apply what you learned,
to develop ?
What examples can you find to ?
What other way would you plan to ?
How would you solve using what you
have learned ?
What would result if ?
How would you organise to show ?
Can you made use of the facts to ?
How would you show your understanding of
What elements would you choose to
?
change ?
What approach would you use to ?
What questions would you ask in an
interview with ?
Questions
Level 4:
Analysis
Key words
Analyse, categorise, classify, compare, contrast, discover, dissect, divide, examine, inspect,
simplify, survey, take part in, test for, distinguish, list, distinction, theme, relationships,
function, motive, inference, assumption, conclusion.
What are the parts or features of ?
How would you classify ?
How is related to ?
How would you categorise ?
Questions
Page 15
Level 5:
Synthesis
Key words
Questions
Level 6:
Evaluation
Key words
Questions
Metropolitan Community College. (n.d.). Critical Thinking Across the Curriculum Project. (Retrieved from the
World Wide Web on 2 September, 2004) http://www.kcmetro.cc.mo.us/longview/ctac/blooms.htm
Page 16
Using questions to encourage critical thinkingQuestions can be open or closed (requiring just a simple Yes/No answer),
procedural (in laboratories), confrontational, probing, or prompting. The following
table outlines some of the more effective ways to ask questions to encourage critical
thinking in class.
Questioning Strategy
Example
There are three questions here, the last two of which the student
would very likely forget before answering:
Can you explain how the principles of classical rhetoric were
manifested in the political speeches made by world leaders
during the war with Iraq, and what the likely implications might
be for future politicians, giving some examples to illustrate your
main points?
Would you like to take two minutes to write your answer down
first?
From all the discussion weve had, Karen, can you summarise
the main points?
Gross Davis, B. (1993). Tools for Teaching. San Francisco: Jossey-Bass, pp. 85-88.
ask students to prepare their questions before the class and come with them
written down;
ask students to give you an example in their response so you know they
understand;
listen closely to the students question and test your understanding by seeing
if the group agrees or disagrees with it;
Page 17
show your attention to the students questions by eye contact and other nonverbal gestures;
emphasise the quality of the question or response, not the student who asked
or gave it; and
if certain questions are better dealt with in a later class, or after class, say so.
Gross Davis, B. (1993). Tools for Teaching. San Francisco: Jossey-Bass, pp. 85-88.
Page 18
Paul, R. (1993). Critical thinking: How to prepare students for a rapidly changing world. In Tutorial
on Problem-Based Learning/Taxonomy of Socratic Questioning. (Retrieved from the World Wide
Web on 1 November, 2010) http://www-ed.fnal.gov/trc/tutorial/taxonomy.html
Sample, K. (1998). The Socratic Method. (Retrieved from the World Wide
Web on 1 November, 2004)
http://www.str.org/site/News2?page=NewsArticle&id=5631
Coffey, H. (n.d.). Socratic Method. (Retrieved from the World Wide Web on 1
November, 2010) http://www.learnnc.org/lp/pages/4994
Page 19
An effective team has the potential to produce better results than any individual;
Students are exposed to different perspectives while clarifying their own ideas;
and
University of Waterloo Centre for Teaching Excellence. (n.d.). Promoting and Assessing Critical Thinking.
(Retrieved from the World Wide Web on 1 November, 2010)
http://cte.uwaterloo.ca/teaching_resources/tips/promoting_and_assessing_critical_thinking.html
Why not:
Create some critical thinking writing activities that
give students raw data and ask them to write an argument or analysis based
on the data;
think of a controversy in your field, and have the students write a dialogue
between characters with different points-of-view. Select important articles in
your field and ask the students to write summaries or abstracts of them.
Alternately, you could ask students to write an abstract of your lecture; and
University of Waterloo Centre for Teaching Excellence. (n.d.). Promoting and Assessing Critical
Thinking. (Retrieved from the World Wide Web on 1 November, 2010)
http://cte.uwaterloo.ca/teaching_resources/tips/promoting_and_assessing_critical_thinking.html
Why not:
Explore what textual analysis involves. Ask your students to:
Page 20
Identify analogies.
Lipman, M. (1991). Thinking in Education. Cambridge: Cambridge University Press, cited in Slade, C.
(1995). Higher order thinking in institutions of higher learning. Unicorn, 21(1), pp. 39.
Evaluation involves:
Giving reasons for beliefs and decisions and choosing how to act;
Lipman, M. (1991). Thinking in Education. Cambridge: Cambridge University Press, cited in Slade, C.
(1995). Higher order thinking in institutions of higher learning. Unicorn, 21(1), pp. 39.
Page 21
Check other sources to see if the information presented has been validated;
Monitor how often they question and challenge information, and how often they
dont;
Identify what they think gives an author credibility and authority on the topic; and
Page 22
evidence, which must be accurate, complete, relevant and adequate to prove the
point.
Syllogism: a construction such as the one above, in which the various parts
(premises and terms), have precise functions within a consistent schema.
Assumption: a belief, that the person making the argument feels is self-evident
and does not need to be proved.
Fallacy: a premise that is clearly faulty (e.g., All exposure to the sun leads to
sunburn).
Proposition: the claim that will be considered in the argument (this can either be
true or false, and has to be supported by evidence in order to be proved).
San Jose University Institute for Teaching and Learning. (n.d.). Mission
Critical. (Retrieved from the World Wide Web on 1 November, 2010)
http://www2.sjsu.edu/depts/itl/graphics/main.html
Page 23
Page 24
have reflected on their conclusions and made their own judgement about their
value.
Reflective journals that track developments in the students thinking are useful,
either as non-assessable or assessable components of the course.
Useful resources
identified the component parts of the task (whether concrete or abstract) and
disaggregated them for close examination?
Page 25
used relevant and reliable evidence to support their own claims or propositions?
What assumptions were challenged by the incident and how was the
accuracy of those assumptions checked? and
Page 26
Critical debate
Frame an issue as a debate motion. Then ask:
for volunteers for and against the motion, then appoint volunteers to the
group they didnt choose;
Brookfield, S. (1997). In A. Rose and M. Leahy (eds.). Assessing Adult Learning in Diverse Settings:
Current Issues and Approaches. San Francisco: Jossey-Bass, pp. 7-9.
Students, in groups of four, choose the best paper, then join with a second group
and choose the best of the two. This last paper is read to the class as a whole
and a class-wide discussion is held about the strengths and weakness of the
papers chosen, leading to the class voting on the best paper of the day;
Students in groups of three or four take turns reading their papers and discuss
the extent to which they have, or have not, fulfilled the performance criteria
relevant to the paper;
One students paper is read aloud slowly to the class while the instructor leads a
class-wide discussion on how the paper might be improved. Then the students
work in groups of two or three to try to come up with recommendations for
improvement for the students in their group (based on the model established by
the instructor).
The Critical Thinking Community. (n.d.). Structures for Student Self-Assessment. (Retrieved from the World
Wide Web on 1 November, 2010) http://www.criticalthinking.org/page.cfm?PageID=458&CategoryID=64
Page 27
Page 28
Fail (F)
Inadequate understanding of the basic course content; failure to develop relevant
skills; insufficient evidence of interpretive and analytical ability; and failure to achieve
some or all major and minor objectives of the course.
Griffith University. (n.d.). Assessment Policy. (Retrieved from the World Wide Web 1 November, 2010).
http://www62.gu.edu.au/policylibrary.nsf/binders/65e95921348eb64c4a256bdd0062f3b0?opendocume
nt
Page 29
High level
(High
Distinction)
Student is not analysing issues clearly, not formulating information clearly, not accurately
distinguishing the relevant from the irrelevant.
The students work does not display discernible reasoning and problem-solving skills.
Though critical thinking terms and distinctions are sometimes used effectively, sometimes
they are used quite ineffectively.
The student only occasionally analyses issues clearly and precisely; formulates information
clearly; recognises key questionable assumptions; identifies relevant competing points-ofview and reasons carefully.
On the whole, students work shows only modest, weak and inconsistent reasoning and
problem-solving skills.
Students work represents demonstrable achievement in grasping what critical thinking is,
along with the clear demonstration of a range of specific critical thinking skills.
On the whole, critical thinking terms and distinctions are used effectively. The work
demonstrates a mind beginning to take charge of its own ideas, assumptions, inferences,
and intellectual processes.
The student often analyses issues clearly and precisely, recognises key questionable
assumptions.
Students work demonstrates real achievement in grasping what critical thinking is, along
with the clear development of a range of specific critical thinking skills or abilities.
The Critical Thinking Community. (n.d.). Grading Policies. (Retrieved from the World Wide Web on 1
November 2010) http://www.criticalthinking.org/resources/HE/ct-class-grading-policies.cfm
Page 30
concept maps;
debating;
questioning;
take a big picture view of ideas and concepts and where they fit in the scheme
of things;
Page 31
identified the component parts of the task (whether concrete or abstract) and
disaggregated them for close examination;
used relevant and reliable evidence to support their own claims or propositions.
Page 32
Information Services
Analysis and critical evaluation is an area where the University has recognised that
support is crucial. Information Services, Teaching and Learning has teams of
learning advisers here to work with you. They can:
There are also services to which you can refer your students so that they can
independently develop their critical evaluation skills. These include:
workshops;
self-help resources.
For more information on these services, contact Information Services, Learning and
Teaching.
Page 33
Bell, Eunice A. (1991). Debate: A Strategy for Teaching Critical Thinking. Nurse
Educator, 16 (2), 6-7.
Nisbett, R. E., Fong, G.T., Lehman, D.R., and Cheng, P.W. (1987). Teaching
reasoning. Science, 238, 625-631.
Web resources
Page 34
Page 35
concept maps;
debating;
questioning;
take a big picture view of ideas and concepts and where they fit in the scheme
of things;
Page 36
Analysis and critical evaluation would have to be two of the most important skills we
look for, because we believe that graduates already have learned the content
knowledge. What they then need is the ability to apply that knowledge. If they can
analyse and evaluate the knowledge they have, then they can apply it in the workplace.
(Employer of Griffith Engineering Graduates, 2003)
We have a lot of graduate analyst roles: manufacturing analyst roles, sales analyst
roles, etc. And all these roles have an element where they need to analyse data, they
need to analyse trends in our business. With some of the roles, they actually need to
analyse other business units, other departments and think outside the box. Were not
looking for old styles of thinking. Were looking for graduates with fresh blood and new
ways of thinking, so thats where those kind of skills come in.
(Employer of Griffith Graduates, 2004)
I look for critical evaluation skills within the workplace context because thats the kind of
thing that will help take the organisation forward. They [new graduates] represent a new
breed of thinking. Also, dealing with the political environment that they work in I think
that is one of the major things people have to learn.
(Employer of Griffith Criminology and Criminal Justice Graduates, 2002)
Page 37
Graduates comments
The importance of analysis and critical thinking is apparent in daily life. It can help you
avoid the mindset of Well, thats the way Ive always done it. Behaviours, habits, tasks
and even the way one goes about making decisions can be critically analysed and
evaluated. That doesnt mean that each daily decision has to become a laborious
analytical nightmare. But it does mean that maybe if youre not happy with certain
recurring outcomes, you might need to take a critical approach to the process.
(Griffith Graduate, 2002)
Students comments
As an undergraduate, it can be easy to be intimidated by academic discourse. The fear
is that you will simply be parroting a standard line or that your inability to deconstruct an
argument will be apparent. Developing critical thinking and evaluation skills is definitely a
learned quality that needs to be practised.
(Griffith Student, 2003)
Assignment work at university has really developed my critical thinking and analytical
skills. This is because Im required to analyse and interpret information, filter out
information that isnt relevant and use it to form an intelligent argument.
(Griffith Student, 2003)
Page 38
ChecklistsDeveloping critical
evaluative skills to assess text and
web resources
Checklist to develop critical evaluation skills
How relevant is this text to my research needs?
What is the authors stance in relation to the topic? Are they for it or against it, or neutral
towards it? Is there evidence of the authors personal, political or cultural bias in the text?
Do I accept or challenge their stance?
How do I know whether the author has academic credibility?
Where does the article/text fit in the context of the broad issue? Is it dated or current? Does it
present a new perspective or possible solutions?
What is the author really saying? Can I write it down in one thesis statement? Is it argued
consistently throughout the article?
What are the main issues and the sub-issues dealt with? Can I use a concept map to show
how they all fit together?
Is this article/text convincing or persuasive?
What are its strengths and weaknesses?
What else will I need to know before I can make a judgement about this text?
Checklist for evaluating web sites
Who is the author an individual or an organisation? Are their credentials listed? Email
address? Is there any bias?
Do they give references for their source material? If links are provided, do they work and are
they current?
Do the graphics serve a purpose or are they primarily decorative? Are the icons meaningful?
Does the site download quickly? Does it present problems for older browsers?
When was it produced, updated or revised?
Does it seem to give comprehensive information?
Page 39
Page 40
skills; satisfactory interpretive and analytical ability and achievement in all major
objectives of the course.
Fail (F)
Inadequate understanding of the basic course content; failure to develop relevant
skills; insufficient evidence of interpretive and analytical ability; and failure to achieve
some or all major and minor objectives of the course.
Griffith University. (n.d.). Assessment Policy. (Retrieved from the World Wide Web 1 November, 2010).
http://www62.gu.edu.au/policylibrary.nsf/binders/65e95921348eb64c4a256bdd0062f3b0?opendocume
nt
Page 41
High level
(High
Distinction)
Student is not analysing issues clearly, not formulating information clearly, not accurately
distinguishing the relevant from the irrelevant.
The students work does not display discernible reasoning and problem-solving skills.
Though critical thinking terms and distinctions are sometimes used effectively, sometimes
they are used quite ineffectively.
The student only occasionally analyses issues clearly and precisely; formulates information
clearly; recognises key questionable assumptions; identifies relevant competing points-ofview and reasons carefully.
On the whole, students work shows only modest, weak and inconsistent reasoning and
problem-solving skills.
Students work represents demonstrable achievement in grasping what critical thinking is,
along with the clear demonstration of a range of specific critical thinking skills.
On the whole, critical thinking terms and distinctions are used effectively. The work
demonstrates a mind beginning to take charge of its own ideas, assumptions, inferences,
and intellectual processes.
The student often analyses issues clearly and precisely, recognises key questionable
assumptions.
Students work demonstrates real achievement in grasping what critical thinking is, along
with the clear development of a range of specific critical thinking skills or abilities.
The Critical Thinking Community. (n.d.). Grading Policies. (Retrieved from the World Wide Web on 1
November 2010) http://www.criticalthinking.org/resources/HE/ct-class-grading-policies.cfm
Page 42