Level B Pack
Level B Pack
Level B Pack
Psychological Society
Level B
in Occupational Testing
Register of Competence
General Information
Pack
Certificate of Competence in
Occupational Testing (Level B)
Level A covers general foundations of testing, and the performance skills associated with test administration
and interpretation of ability tests.
Level B complements Level A. It increases the scope of the scheme to cover personality assessment, and the
interpretation and use of personality tests.
Together, Level A and Level B provide a set of standards which define the competent user of psychological
tests in occupational settings.
Other relevant FREE publications are available on our website or by contacting the Society:
■ Leaflet describing the BPS Review of Ability and Aptitude Tests (Level A) for use in Occupational Settings
■ Leaflet describing the BPS Review of Personality Assessment Instruments (Level B) for use in Occupational Settings
The Society holds no other information on Tests, other than those which appear in the above two Reviews.
2
Contents
Page
3
Level B Standards in Occupational Testing
Level B has been designed to complement Level A.Together they provide a set of standards which define the competent user
of psychological tests in occupational settings.While Level A covers general foundations of testing and the performance skills
associated with test administration and interpretation for group ability tests, Level B is intended to increase the scope to
cover personality assessment and the interpretation and use of personality tests.
Level B Modularity
The Level B Verifiers’ Group have resolved that Level B would comprise five modules as indicated below:
Modules B1 and B2 covering LB Units 1–5 for one personality measure – Intermediate Level B.
Module B3 covering LB Units 3–5 for a second personality measure – Intermediate Plus Level B.
Module B4 covering LB Units 6–9 and Module B5 Diary Record and Project Report – Full Level B.
Description of Level B
The Full Level B standards define:
■ a broad knowledge base with expertise sufficient to evaluate a range of approaches;
■ use of at least two appropriate instruments in a range of contexts;1
■ an actual appreciation of the role of formalised personality assessment procedures in occupational assessment;
■ the ability to make informed recommendations and choices among instruments as to their suitability for use in various
occupational settings.
As the nature of the instruments at Level B are more diverse than that of those at Level A, there are difficulties designing an
all-encompassing general qualification. For these reasons Level B indicates (a) breadth of relevant knowledge and possession
of certain core skills, together with (b) practitioner competence in the use of at least one (Intermediate Level B) or at least
two (Full Level B) specific instruments.2
The knowledge and understanding relating to personality assessment has been divided into two broad aspects of competence
for Level B: Foundation knowledge, and the knowledge and understanding required for Test Choice and Evaluation. Foundation
knowledge is deemed to underpin the acquisition of competence in the use of specific instruments. Ideally, coverage of these
foundation units would take place before, or as part of, test-specific training courses. However, the competence criteria do
not make any formal stipulations about how competence is acquired or in what order elements are covered.
The knowledge and understanding required for Test Choice and Evaluation build on the foundation knowledge and the expertise
in the use of assessment instruments. In training terms, coverage of these Units would most effectively follow on from training in
the use of two or more specific instruments, usually after a period spent in gaining experience with those instruments.
Beyond Level A
Level A covers the basic underpinning knowledge of psychometrics and practical skills associated with the use of tests
(administration, scoring and analysis).The practical elements of Level A focus on tests of ‘maximum performance’. Level B extends
this to include tests of ‘typical performance’ – especially those requiring interpretation in terms of psychological theories or models.
Level B is considered to incorporate and build on Level A. It is not an alternative qualification: the Level B standards do not,
therefore, repeat elements contained in Level A except where matters covered at Level A need to be reconsidered in relation
to issues associated with tests of ‘typical performance’, or where the basic issues of test choice and evaluation have to be
faced.
1 In general, an appropriate instrument is one, the use of which, can provide evidence of competence sufficient to cover all elements contained in
Units 3, 4 and 5.
2 Competence in the use of at least two instruments is necessary but not sufficient for a Full Level B qualification.
4
Although the main focus in the standards is on instruments designed to assess personality, most of the practical – and many of
the knowledge-based – elements of Level B cover a broader domain (e.g. measures of interest, motivation, values, beliefs and
attitudes).
Level B encompasses a number of broad issues, which build on the content of Level A:
■ What makes the assessment of personality and interests different from that of ability/aptitude?
■ How and why is personality assessment used?
■ How can we ensure that assessment tools are used in an ethical and professional manner with due regard for their
limitations and for the rights and responsibilities of assessor, candidate and client?
It is important here to distinguish between knowledge of various instruments and competence in the use of those
instruments. For Level B, people should:
■ Have knowledge of a broad range of different types of instrument – to provide a good frame of reference within which
to locate particular ones (this knowledge is covered initially in Foundation Units 1 and 2 and developed further in Test
Choice and Evaluation Units 6 to 9).
■ Be able to demonstrate competence as a practitioner through their skill in using specific instruments (covered mainly in
Test Use Units 3 to 5).
Clearly, the specific instruments used in training need to be of a sufficient standard to enable the competences to be met.
Anyone who has trained people to meet the standards set out for Level B should then find it very difficult to persuade them
to purchase poorly constructed or poorly validated tests! Thus, rather than specify actual instruments, the elements specify
specific competences which can be evidenced through use of one or more particular instruments.
In short, the standards specify the generic competences. Evidence that someone meets these standards will need to be obtained
from performance with appropriate specific instruments (together with relevant background and underpinning knowledge).
With Full Level B the emphasis is on experience in the use of personality testing in a range of contexts i.e. the application of
broad, in-depth knowledge skills and attitudes (e.g. ethical and equal opportunity considerations) across a range of
occupational contexts.
For this reason it is necessary to submit additional evidence of practice and application of knowledge in the form of a Diary
Record and Project Report.
Through the accumulation of relevant Units, people can obtain either the Level B Intermediate Certificate or the Level B
Intermediate Plus Certificate or the Level B Full Certificate.
The Units define three broad aspects of competence:
■ The Foundation units (Units 1 and 2 – Module B1) focus on the broad knowledge of assessment issues relating to
personality which underpin competent use of personality assessment instruments. Units 1 and 2 cover the main body
of knowledge and understanding required as a foundation for using personality assessment.
5
■ The Test Use units (Units 3, 4 and 5 – Module B2) (and B3 in the case of a second instrument) concern the practical
skills relating to using personality assessment in occupational settings. Unit 3 deals with test administration, Unit 4 with
interpretation and Unit 5 with feedback. It is in relation to these units that evidence of competence in relation to at
least two different appropriate instruments is necessary for the Level B Full Certificate, while one may be sufficient for
the Level B Intermediate Certificate.
■ The Test Choice and Evaluation units (Units 6 to 9 – Module B4) concern the knowledge and skills required for
evaluating tests and the practical skills associated with making choices among them as to their fitness for purpose. Units
6 and 7 are more knowledge-based, dealing with measurement issues, test construction, reliability and validity. Unit 8
focuses on issues associated with computer-based assessment and Unit 9 with a practical appreciation of the situations
under which personality assessment methods can be used and their limitations.
As with Level A, Chartered Psychologists wishing to assess people for Level B need to register with the Society as Assessors
and agree to be subject to the verification and quality control procedures adopted by the Society.
One potential difficulty with the Level B Test Use Units will be the question of whether or not competence in use of a
particular instrument can provide sufficient evidence of competence.This may be controversial in the case of some
instruments.Wherever questions of adequacy of coverage, quality or quantity of evidence arise, such matters will need to be
dealt with by negotiation, in the first instance, through the verification process. In due course,‘case law’ will help establish a
clear set of precedents.
However, it is important to stress that the focus for Level B Certification is on the evidence of competence provided by the
test user and not on the technical merits or demerits of the test they are using to provide evidence of that competence.The
latter will be addressed by the test reviewing process (e.g. the BPS Review of Personality Assessment Instruments (Level B)).
6
In many cases Trainers are also Assessors, but not necessarily so.
A list of training courses is published in each issue of the Selection and Development Review (SDR). Lists of Level B Intermediate
and Level B Full Assessors are available from the Society’s website (www.psychtesting.org.uk) or through the Society’s office
by contacting the RCOT Desk on direct line no. 0116 252 9530.
Before starting any training, you should check with the Trainer that the course will lead to eligibility for the issue of the
appropriate Certificate and that the Assessor holds a current Assessor’s Certificate.The Certificate is available to those who
have had their competences affirmed by Assessors who in turn have had their assessment methods verified for the
appropriate Units of Competence.
CRITICAL PATHWAY
LEVEL B
(CANDIDATES)
LEVEL A
▼
Level B Units 1–2 (Module B1) + Units 3–5 (Module B2)
INTERMEDIATE CERTIFICATE
(or previously acquired Intermediate Statement)
▼
▼
For detailed guidance on Modules B4 and B5 see Guidance for Assessors Level B (Units 6–9)
Figure 1
7
Eligibility for an Intermediate Plus Certificate
■ Hold a Statement/Certificate of Competence in Occupational Testing Level B Intermediate (Modules B1 and B2).
■ Provide sufficient evidence to a Verified Assessor, of competence in Units 3–5 of the Level B Units (Module B3).
B1. Intermediate Certificate holder Nominates what they want their No action required by Assessor.
– application form has two first instrument to be. Specifies the
instruments which are second instrument and applies for
*‘sufficiently different’ and an Intermediate Plus Certificate.
signed off on two separate
occasions.
B2. Applicant assessed by the same Nominates what they want their Ensures applicant has been fully
Assessor on two *‘sufficiently differ- first instrument to be. Requests the assessed and affirmed on both
ent’ instruments on one affirmation Assessor to sign off Units 3–5 for a instruments.
form. second instrument which should be
*‘sufficiently different’ and applies
for Intermediate Plus Certificate.
Figure 2
In all cases applicants will need to seek assessment and affirmation for Units 6–9, Diary Record and Project Report following any
required training.
*Figure 4 on page 9 demonstrates the concept of ‘sufficiently different’ instruments.
8
ROUTES TO LEVEL B FULL
1. All assessees need to decide which category (A, B or C on page 7) applies to them.
2. If Category A
Intermediate Statement holder – application form Intermediate Certificate holder – application form
has or had one instrument, or family OR has or had one instrument, or family
of instruments of instruments.
Specify instrument.
Seek assessment and affirmation for Units 6-9, Diary Record and Project Report following any training.
3. If Category B
Intermediate Certificate holder application based on two sufficiently different instruments.
OR
Signed off on two sufficiently different instruments Signed off on two sufficiently different instruments
on two separate occasions. on one occasion.
Apply for Intermediate Plus Certificate. Request the Assessor to sign off Units 3–5 for
second instrument and affirm fully assessed for both
first and second instrument and apply for
Intermediate Plus Certificate.
Seek assessment and affirmation for Units 6–9, Diary Record and Project Report following any training.
Figure 3
9
4. If Category C
Intermediate Statement holder – application based on two or more sufficiently different Level B instruments.
Seek affirmations of current and competent use Seeks assessment and affirmation in a
of a second instrument from appropriately OR second instrument (training not essential).
verified Assessor.
Seek assessment and affirmation for Units 6–9, Diary Record and Project Report following any training.
Figure 3 (continued)
Classification criteria: Please circle all that apply for each instrument
Figure 4
10
For any two instruments to be regarded as sufficiently different, the applicant is required to show differences on at least two
criteria.
Measures belonging to the same ‘family’ would not usually be considered sufficiently different. Similarly, full and short forms of
the same measure would not usually be considered sufficiently different.
The Assessor will need to affirm to the Society that the applicant is currently using the nominated second instrument and is
competent to do so.
NB: In the event of any discovery that applicants have fabricated any evidence of competence, they will be excluded from
applying for a Full Level B Certificate. Further action may be taken if and when any code of conduct for Certificate holders is
introduced.
Chartered Psychologists who are Assessors are reminded that under the Society’s Code of Conduct they will be subject to
disciplinary proceedings should they act beyond their verified competence.
Where there is any ambiguity regarding any aspect of the affirmation process,Assessors should contact the Senior Verifier for
guidance.
Integrated assessment of Units 6–9 (Module B4) plus Diary Record and Project Report (Module B5)
Level B Intermediate is designed to provide practitioners with the minimum competence necessary to use a particular
instrument for specific purposes. Full Level B is designed to produce competent decision makers. Full Level B represents
considerable added value for test takers who need to be able to make evaluative judgements about personality based tests
and testing across a full range of instruments and approaches and who need to be able to question and justify decisions in a
rational and informed manner.
In addition, Full Level B is also necessary for those who wish to make appropriate and competent use of computerised
administration and report generating systems.
Portfolio Evidence
Apart from evidence of competence in Units 6–9 candidates will also need to submit evidence that they have completed a
portfolio which has also been assessed.The portfolio consists of two elements: the Diary Record and Project Report.
The relationship between the Diary Record and the Project Report
The Diary Record is likely to contain, among other things, reference to the stages involved in completing the work associated
with the Project Report.The Project Report itself, however, is likely to be more detailed, reflective and discursive than the
Diary Record.Whereas the Diary Record provides a broad picture of the candidate’s relevant experience since completing
Intermediate Level B, together with a description of how this maps onto the competences, the Project Report is a method
which enables the candidate to ‘spotlight’ and amplify specific aspects of their experience. By completing both, the candidate
11
has the potential to show that their practical activity since Intermediate Level B reflects both the breadth and depth of their
understanding of Units 6–9.
April 14 Attended 1 day workshop Gained understanding of different 8.1, 8.2, 8.3, 8.4 To be decided
on computer-based approaches adopted by narrative
assessment. Covered systems and consolidated in note
administration and report form: gained clearer grasp of ethical
writing software. issues arising in different uses of
Different approaches to narrative reports. Action point:
narrative writing intend to develop company policy
compared. to cover range of acceptable uses
of narrative, and intend to write
this up as minor project for Full
Level B.
May 25 Assessed 4 candidates for Developed and wrote up rationale 7, 9.1, 9.2 To be decided
a senior position (Sales for selection of 16PF in this
Director) using range of exercise. Main other advantage
ability tests and was to enable me to gain ‘flying
personality questionnaire hours’ in feedback and report
(16PF). Selected 16PF writing.Two of the profiles 3, 4, 5
from 3 possible options. associated with high MD scores – (2nd measure)
Wrote reports for both gained more experience for probing
the candidates and the for work related evidence in these
selection panel. cases. Action point: need to work
Gave feedback to on presentation of scales to
candidates on all ensure value free descriptions
psychometric measures offered. Action point: following 7.11
used. Discussed outcomes discussion and request, need to
of testing session with provide guidance to HR Director
panel; advised on fit of on implications of mixed gender
candidates to job norming.Write this up as 2 minor
description and person projects – one on test choice, and
spec provided. Discussed one on policy development.
implications of choice of
norms and equal
opportunities issues.
* Activities may include relevant learning experiences such as attending a conference, participating in a training workshop, formal
study, informal reading or any practical activity relevant to Units 6 to 9. Some of these activities will be described in greater detail in
the candidate’s Project Report.
Figure 5
12
The Register of Competence in Occupational Testing
The Society makes positive efforts to encourage employers only to use competent test users, and the Register is their basic
source guide to check the credentials of individuals they intend to consult or employ.
Selection and Development Review (SDR) is published six times a year under the aegis of the Society’s Division of Occupational
Psychology.The annual fee for entry to the Register is £20. Registrants automatically receive SDR free and are encouraged to
contribute to the publication.The Register is the best way for competent test users to keep in touch with developments in
the field.
There is no facility for advertising tests, courses or services beyond the existing paid listing of appropriate upcoming courses
in SDR.
Other services for registrants will be developed over time and as numbers increase.
Registrants’ details are held on the Society’s database. Details are available to enquirers who mention a person by name, but
not available as part of a more general listing.
Names and addresses of Chartered Psychologists who appear on the Register and whose verification methods have been
confirmed by the Society appear on the appropriate list of Assessors.
If you wish to check if a person is or is not on the Register, please contact the RCOT Desk on direct line no: 0116 252 9530.
For a list of Assessors visit our website at www.psychtesting.org.uk or contact the RCOT desk.
Affirmations of competence for Certificates must be carried out by Chartered Psychologists who hold a Certificate or
Statement of Competence in Occupational Testing Level B and who have had their assessment practices Provisionally Verified
or Confirmed.Verification information packs (Intermediate, Intermediate Plus and Full) may be obtained from the Society’s
Office.
The Assessor must initial each item on the Checklist.Where all the items on the Checklist for each UNIT have been
initialled, the Affirmation of Competence in that UNIT should be signed and dated.
Some general guidance on the level of competence expected is given in the introduction to each of the three aspects of
competence.
13
The terms ‘client’ and ‘candidate’ are used as follows:
■ Client – the person or organisation for whom the assessment is being carried out; generally, the person who has
sponsored the assessment, who pays for it and who requires access to the information produced.
■ Candidate – the person who is the subject of the assessment process.
Note that in some assessment contexts, the candidate and the client will be the same person (for example, in personal
guidance on career development). In most other instances, the client and candidate will be different people.
14
Test Use: LB Units 3, 4 and 5 (Module B2 for first instrument and B3 for subsequent instrument(s))
Competence relating to Test Use should be assessed in relation to a specific substantive instrument or instruments.The focus
of the assessment is on the assessee’s competence as a practitioner to demonstrate a good understanding of the strengths
and weaknesses of the instrument, to make appropriate use of it in different assessment contexts and to weight information
obtained from it appropriately with other information about the candidate.
Test Use Units 4 and 5 require evidence of competence in interpretation and providing feedback to both clients and
candidates in each of two types of context:
Client-oriented, assessment contexts (where the prime reason for the assessment is to provide the client or client
organisation with information about the candidate):
■ report to a client organisation for selection, promotion or inclusion/exclusion in a team;
■ feedback to candidate(s) on the above.
Candidate-oriented assessment contexts (where the prime reason for the assessment is to provide the candidate with
information about him or herself):
■ report to a client on the development/career potential etc of a candidate;
■ report to candidate(s) on the above.
It is realised that candidate-oriented situations may arise (a) where it is not appropriate to provide feedback to the client
organisation, or (b) where the distinction between client and candidate does not apply as they are the same person.
The evidence obtained must cover both of these types of context and include instances of verbal feedback to a candidate and
instances of written feedback both to a client and to a candidate.The evidence should be collected under realistic working
conditions.
15
Test Use LB Unit 5: Providing feedback
The assessee:
■ Demonstrates sufficient knowledge of the instrument to provide competent interpretation and oral feedback
to at least two candidates in each case and to produce balanced written reports for:
(a) the candidate, and
(b) the client – where the assessment is being carried out for a third party.
■ Provides non-judgmental oral feedback of results to candidates with methodical use of the feedback interview
to help confirm/disconfirm hypotheses generated from the pattern of individual test results.
■ Provides an indication to the candidate and to the client (when there is a third party involved) of the status and
value of the information obtained and how it relates to other information about the candidate’s personality.
■ Produces written reports which integrate the information on personality with that on ability and other relevant
aspects of the person to provide an overall balanced view related to the context for which the information
is sought.
■ Ensures that neither organisational nor personal decisions are based solely upon the interpretation of data from
one personality inventory.
Unit 7 extends the coverage of reliability and validity issues dealt with in Level A and – as with all the Level B Units – assumes
an underlying competence at Level A.
For Unit 9, evidence should be provided that the assessee has a knowledge base on which to make choices which is broader
than that covered by the specific instruments on which their Test Use Units are based.
16
Test Choice and Evaluation: LB Unit 7.Validity and reliability issues
The assessee can:
■ Explain the difference between dependability, stability and internal consistency.
■ Explain how internal consistency is affected by trait breadth and explain the relative advantages and disadvantages
of highly homogeneous versus broad scales.
■ Explain the need for periodic reassessment and why information about personality may become ‘outdated’.
■ Describe the factors which contribute to unreliability in personality assessment, distinguishing between factors which
affect variability in scores and factors which affect variability in the interpretations given to those scores.
■ Provide a reasoned consideration of the evidence for validity associated with two different instruments in relation to
their:
(a) content (i.e. internal) validity,
(b) construct validity, and
(c) criterion-related (i.e. external) validity.
■ Give examples of two substantive criterion-related validity studies associated with personality or interest assessment
instruments used in one or more areas of occupational assessment.
■ Explain the relative merits of information obtained about the validity of a scale from validation against local criteria and
from validity generalisation meta analysis.
■ Understand issues associated with the validation and interpretation of (a) linear and (b) non-linear relationships
between individual personality scales and external criteria.
■ Describe examples of composite scores based on weighted combinations of scales (e.g. adjustment specification
equations; criterion-referenced prediction equations; and so on) and show a clear appreciation of the difference
between those which are actuarial (based on empirical data) and those which are clinical (conceptual or based on
judgements about scale contents).
■ Explain the importance of corroborating information about personality obtained using one type of instrument with
information obtained from other sources to avoid misinterpreting ‘method-variance’ as ‘trait-variance’.
■ Discuss how current legislation and guidelines relating to fairness in the use of tests affect the use of personality
measures in occupational settings.
Test Choice and Evaluation: LB Unit 8. Computer-based assessment and computer-generated reports
The assessee can:
■ Discuss issues of test equivalence, reliability and test-taking attitude in relation to differences between paper-and-pencil
and computer-based test administration procedures.
■ Compare the relative advantages and disadvantages (in relation to reliability, validity, acceptability, cost and usability) of
computer-generated interpretative reports with those written by human experts.
■ Explain in outline the main techniques used by computer-based report generators to produce their reports.
■ Describe how the validity of computer-generated personality reports can be formally assessed.
■ Outline the practical and professional issues associated with the use of computer-generated reports:
(a) as an aid for the test user;
(b) as a report to the client; and
(c) as a report to the candidate.
Test Choice and Evaluation: Unit 9.When and how to use personality and interest assessment
instruments
The assessee can:
■ Evaluate the applicability and limitations of two instruments in relation to each of the range of assessment functions. In
each case:
– Discuss factors which limit the practicality and appropriateness of using various different types of instrument
(ipsative, non-ipsative; self-report, behavioural etc).
– Explain how and why information about personality and/or interests should and should not be used.
■ With reference to at least three different assessment functions, for each one:
– Identify and justify the use of one personality and/or interest assessment instrument.
– Describe what corroborative information about personality and/or interests could be collected using other methods.
– Discuss how current legislation and guidelines relating to fairness in the use of tests relates to the use of the instrument.
Range of assessment functions:
(a) Selection;
(b) Promotion;
(c) Redundancy/Outplacement;
(d) Individual personal development;
17
(e) Team development;
(f) Career Guidance;
(g) Counselling.
Project Report
■ Take steps to ensure that they are able to meet all the standards of competence defined by the Society for the relevant
Certificate(s) of Competence in Occupational Testing, and to endeavour, where possible, to develop and enhance their
competence as test users.
■ Monitor the limits of their competence in psychometric testing and not to offer services which lie outside their
competence nor encourage or cause others to do so.
■ Use tests only in conjunction with other assessment methods and only when their use can be supported by the
available technical information.
■ Administer, score and interpret tests in accordance with the instructions provided by the test distributor and to the
standards defined by the Society.
■ Store test materials securely and to ensure that no unqualified person has access to them.
■ Keep test results securely, in a form suitable for developing norms, validation, and monitoring for bias.
■ Obtain the informed consent of potential test takers, making sure that they understand why the tests will be used,
what will be done with their results and who will be provided with access to them.
■ Ensure that all test takers are well informed and well prepared for the test session, and that all have had access to
practice or familiarisation materials where appropriate.
■ Give due consideration to factors such as gender, ethnicity, age, disability and special needs, educational background and
level of ability in using and interpreting the results of tests.
■ Provide the test taker and other authorised persons with feedback about the results in a form which makes clear the
implications of the results, is clear and in a style appropriate to their level of understanding.
■ Ensure test results are stored securely, are not accessible to unauthorised or unqualified persons and are not used for
any purposes other than those agreed with the test taker.
18
THE SOCIETY
RCOT2/03.02