Psychometric Tests and Assessment at Work

Human Resource Management & Business Psychology Resource

PsyAsia answers your human resource, business psychology and psychometric assessment questions at assessmentcentral.com

Over the years, PsyAsia International has placed tremendous effort into putting together a knowledgebase at our website as well as a knowledge blog at assessmentcentral.com.  We continue to add to and develop these further.  We’re now offering you the opportunity to ask questions pertinent to you and for our psychologists to answer them at our blog.  Your question should be related to human resource management or business psychology. It can be under the categories listed at this blog or you may request a new category.  We may also open some questions/answers up for discussion and general comment if we feel relevant.  Please keep in mind that your question should be able to be answered within a blog submission (i.e., don’t ask anything that might require a very complex or long response!!).  Our psychologists will aim to respond to one question per day and the target time for the response is 10-15 minutes.  Answers will be posted at assessmentcentral.com and the PsyAsia knowledgebase

Please feel free to submit your questions now by emailing our ONLINE LEARNING SECTION. You must complete all details in the form accurately. We will not answer questions from those who enter FREE email addresses such as yahoo/google/msn etc or where a company name is not provided.  However, we will not mention your personal details in the response in order to protect your privacy. Thank you for your participation!

What is a behavioral indicator in an Assessment Centre?

A behavioral indicator is used in an assessment or development centre to provide an objective description of the behavior that you might view from the candidate that provides evidence that they either have or do not have the competence that you are assessing.  Behavioral indicators can therefore be positive or negative.

For example, if you were to assess the competence of “manages conflict well”, having defined the actual competency to ensure it is fully understood by all assessors or observers, you would then need to produce a list of possible positive and negative behavioral indicators for this competency.  In this example, some of the indicators might be:

Positive Behavioral Indicator: asks other people for their perspective, draws out the feeling of the group, listens to others before evaluating

Negative Behavioral Indicator: makes decisions without considering the views of others, makes excessive “I” statements rather than working towards satisfying mutual interests

During the assessment or development centre, the assessors or observers will keep a list of which of these indicators arise and when; this will enable objective and easy scoring of the candidates on the competency under assessment.

Choose real Psychological Consultancies such as PsyAsia International for Psychometric Tests and Assessment Centre Exercises rather than companies jumping on the bandwagon of selling assessments but without the appropriate expertise to back up their offerings.

In Singapore, Hong Kong and across Asia we notice an increasing stream of companies who are joining the ‘bandwagon’ of selling psychometric assessment tools. They see these tools as another commodity to be sold and promise all kinds of gains. Some of them have no idea about what lies behind a psychometric test. Some of them have been on short training courses and see themselves as experts and even have a stab at designing their own tests on that basis!! We know because we have seen these people in action!! However, they have not have the more than 6 years of training in psychology that our psychologists have had. They were not subject to 2 or more years of supervised practice like us (yes, very similar to the requirements for medical degrees and practice!).  They are not members of professional psychological associations like us. They are not bound to register with professional bodies like us and they do not have the same focus on and passion for science in their solutions. Rather we see them as motivated by both money and a passion to be consultants but without appropriate training (and typically they would not get away with this in the West!!).

Choose PsyAsia International rather than non-Psychologist consultancies for Psychometric Tests because:

  • We are REAL PSYCHOLOGISTS.

  • When using tests you’ll have lots of questions about their proper and effective use. Only real psychologists can competently and reliably provide this expert advice.  Try asking some technical questions of a non-Psychologist provider and watch them stumble!

  • We have undergone a minimum of 6 years of training in Psychology followed by supervised practice - this has made us experts. Those who undertake short 1-6 day courses in psychology or psychometrics are not experts.

  • Due to our high level qualifications and experience, we are licensed by the Australian Psychological Society to co-brand. We are therefore answerable to the society and undertake to abide by their code of ethics.

  • As fully registered psychologists (we register internationally where rules and registration requirements are more strict than in Asia), we must undertake continuous professional development - we must attend conferences, training and presentations, and read our professional journals constantly. Many non-Psychologist “consultants” rely on small snippets of knowledge that they collect over time, rather than the above.

  • A number of our psychologists are actually lecturers in Asian universities

  • We are Scientists. Most modern Psychology degrees are degrees in Science (i.e., BSc, MSc). As scientists, we value evidence-driven solutions. We’ve seen many of our competition designing non-scientific assessment tools in order to make money but without sufficient attention to evidence and science to ensure the system works as it should. We know how to not only scientifically design assessments, but also how to scientifically assess their continued effectiveness.  If you were to place most of our competition in front of our statistical analysis software they would have no idea where to start - meaning that you can never be confident that the tools you purchase from them are valid!!

  • A number of our Psychologists have had their Scientist status endorsed by the British Psychological Society and are actually Chartered Scientists - an honour bestowed upon only a very few!  In addition, our director (a doctor of psychology) was awarded the British Psychological Society Prize for Scientific Contribution to Occupational Psychology for his Psychometric Assessment work in the UK!

  • Finally, because we know our stuff, we’ve had the honour of publishing in international peer reviewed journals.  Sure, our non-psychologist competition can write their daily blogs with information often taken from other parts of the web.  We rarely if ever see their own original work published in top-tier international journals though.

We trust that you will see from the above how PsyAsia International’s Psychologists have a wealth of experience, education and expertise in Psychology and Psychometrics as well as other forms of assessment.  Usually our expertise is in far greater measure than those companies whose main focus is not in applying Psychology to the workplace or employing psychologists.

Organisational Psychology in HRM: A PsyAsia Seminar

Wondering what organisational psychology is and how it relates to HRM?  Come along to our seminar on 24 July in Causeway Bay.  The seminar will be run in Cantonese and English (2 sessions).  Registration is managed by the Hong Kong Institute for HRM.  Click below for more details and registration:

http://www.hkihrm.org/ihrm_eng/ih_eve_mon_read_01.asp?id=466

PsyAsia International launches Online Learning Centre

PsyAsia International has launched an Online Learning centre.  At the current time the Centre houses a free seminar “Putting Psychometric Tests to Work”. The seminar includes narration as presented in real-life in both Hong Kong and Singapore during February and March 2008. 

PsyAsia will gradually add more seminars as well as full e-learning courses.  The full courses will be specially adapted versions of our popular in-house and public training programs. In addition to slides and narration, we will offer interactive content that will make learning fun, as well as end of segment quizzes and final course assessments.  Those who pass the end of course assessments will be able to apply for a hard-copy certificate signed by a registered psychologist.

Now, people from anywhere in the world interested in developing various organizational psychology or human resource skills can benefit from our renowned training.  Our training, which is always current, based on science and designed by top, government-registered organizational psychologists, is recognized as being exceptional.

Registering in our online programs will enable busy professionals to access this training on their own schedule and work at their own pace from any location equipped with the internet.

PsyAsia is also pleased to offer the design of custom e-learning courses. We will put together a course especially for your organization in the area of your choice (within our competency range) and allow access only by your employees!  For organizations who hire our psychologists to deliver real-life in-house training, we offer the additional free benefit of publishing the slides and quizzes to the Online Learning Centre for 2 weeks following the course to enable review and reflection of the material.

Have a great learning experience with PsyAsia International’s Online Learning Center.

Assessment & Development Centers in Employee Selection & Development

An assessment center is a methodology (rather than a place) for thoroughly assessing a candidate for a job. A development center follows similar principles, but rather than selection, its primary purpose is to aid in the development of a current job-holder.

Owing to the costs associated with assessment and development centers, they are typically used for higher level jobs. For example, they are used as part of graduate selection exercises for fast-track programs or for executive and managerial development. Also, as a result of costs, assessment and development centers are tools associated more with medium to large sized organizations and especially multi-nationals.

The expense of assessment and development centers comes from the thorough process, time and competence required to run them. The centers incorporate a number of different types of assessments throughout a one, two or even three day period.

Candidates will have the opportunity to show and explore their talents over a range of different exercises and within each exercise, a number of competencies are usually being assessed.

A major benefit of centers which run over multiple days is that it becomes more difficult for candidates to fake characteristics (such as extraversion, social boldness, friendliness) which are often faked at interview.

The familiar job or performance appraisal interview may form part of the centre, but will be run in a standardized, structured manner. Group discussions, negotiation and team-working exercises, in addition to presentations, in-tray (realistic work simulations) exercises and psychometric assessments of personality and ability are all found within a typical assessment or development center.

Each center that is run is unlikely to assess a large number of people in one go. It is typical to assess around 8-12 individuals and there will be a high assessor-assessee ratio (at least one assessee per assessor and often more than this!).

Exercises are either developed by experienced assessors in-house, or they can be purchased from specialist exercise vendors. The purchased exercises can be rather expensive, many times costing in excess of US$1000 per exercise. Others will charge a fee per assessee and even this can amount to the same fee of US$1000 per assessee depending on the exercise.

Another option is the purchase of computer software which contains a number of validated exercises in addition to the facility to schedule and manage the complete logistics of the centre.

Where exercises are developed in-house, there is always the question of validity. That is, do they really consistently assess what they were designed to and purport to assess? Of course most organizations will not conduct the necessary validity studies to support this due to cost and/or competence issues!

Turning to “validated” off-the-shelf exercises however may also not always be wise. Whilst they may have been shown to be valid in Organization X using managers from Division Y for example, this does not necessarily mean the same exercise(s) will be valid in your company and your division!

Given the costs associated with designing the assessment or development center, running it and ensuring that all assessors are appropriately trained and competent, it is necessary to ensure that there is a return on investment…or in other words, that this is money well spent that will be returned two-, three- or many-fold!

Generally, business-case studies, research studies and common-sense show that well designed and run centers do provide a good return on investment.

From the common-sense perspective, if you are being more through in your selection process, it would seem that you are more likely to select the appropriate employee.

From a business-case perspective, this follows through. If an organization continues to select on the basis of its current selection system (say an interview and a personality test), at best, we would expect them to reproduce current performance levels.

However, if the organization becomes more choosey and opts for a well-thought-out assessment centre composed of various team exercises, presentations, tests, interviews and so forth…assuming the center was competently designed and run, and the exercises accurately assessed the attributes they were supposed to assess…surely, that organization would be more accurate in their selection of the right person to do the job!

Now, what if that person were to take on a job that for ease of argument managed assets worth say US$1 million? Given that the organization has a better person in place by way of the more rigorous selection process, we can perhaps expect to see a conservative 3% increase in performance. That would amount to US$30,000 (all else being equal!).

If we further assume that this person remains in the job for longer, let’s say three years (because they are the right person for the job and thus happy with it), we can multiply that return by 3, taking the gain to US$90,000!

Assume we select 3 people from the center and they all perform similarly, we can further multiply by 3 and our gain triples to US$270,000. This gain is likely to be at least 15 times the initial cost of the assessment center!

So, even though assessment centers are expensive and labor intensive, they are likely to provide an excellent return on that investment.

The same can be said for development centers. Again, we can assume that without introducing a development center, the employee will develop at their current rate. With the introduction of the center, development may multiply and bring with it a massive return for the business.

All of this is of course dependent upon the level at which the candidate is in the organization and the influence that his or her competence and further development has upon success.

Research shows that assessment centers are one of the most predictive forms of assessment for performance at work (e.g., Robertson & Smith, 2001) and that they have incremental validity over and above supervisor ratings for predicting promotion (Chan, 1996).

Of course, this only works if those who design the centers are appropriately trained not only to design the exercises, but to run the centers, ensure accurate and fair ratings of candidates and to be able to translate center results into hypotheses about performance at work.

Further, in the case of development centers, the responsible person also needs to be able to sensitively discuss the implications of the results with the candidate and know how to assist that candidate in embarking upon a development program that will lead to tangible results.

References:

Robertson, I. T., & Smith, M. (2001). Personnel selection. Journal of Occupational and Organizational Psychology, 74(4), 441-472.

Chan, D. (1996). Criterion and construct validation of an assessment centre. Journal of Occupational and Organizational Psychology, 69(2), 167-181.

About the Author (text)

Dr. Graham Tyler is an award-winning registered (organizational) psychologist specializing in selection and development. His company, PsyAsia International, offers Assessment & Development Center training programs in Asia and beyond. Find out more at http://www.psyasia.com

Are Assessment Centers cost effective?

Employers rate assessment centres as worth the high cost

More than nine out of 10 employers using assessment centres believe they are a very (47%) or fairly (48%) effective means of recruiting* staff to fill vacancies, according to research by Employment Review (UK).

The survey of HR practitioners in 91 companies and public sector bodies also found that more than half (53%) believe the often considerable costs of assessment centres are justified.

Assessment centres bring job applicants together in a group so they can be subject to a range of selection methods including group exercises and role play, individual interviews and psychometric tests.

This article first appeared in Personnel Today magazine and can be read in full at:

http://www.personneltoday.com/Articles/2007/08/21/41933/employers-rate-assessment-centres-as-worth-the-high-cost.html

*Editorial note: technically speaking, assessment centres are for selecting, not recruiting staff. We have left the article unedited as we did not write it!

Assessment & Development Centre Training Courses in Asia

Our partner, PsyAsia International, is pleased to announce new dates for their assessment and development centre training course in both Hong Kong and Singapore:

Hong Kong: 5-7 Sept 2007

Singapore: 29-31 Oct 2007

For more details, please go to: http://psyasia.com/assessment_development_centre_training_course.htm

To register, please go to: www.psyasia.com/register

Assessment & Development Centre Training Course - We’ll SMS you the dates!

    Assessment & Development Centre Training Course

Our partner, PsyAsia International is working on dates for their next Assessment & Development Centre training course. Please email them your mobile number and tell them where you are based and they will SMS you as soon as the dates are published. Alternatively, join their mailing list. They are looking to September 2007. Course will be held in Singapore and/or Hong Kong.

Why use an assessment/development center?

  • Comprehensive evaluation
  • Valid; better predictor
  • Less adverse impact
  • Training effect for raters
  • Training effect for candidates
  • Multiple uses
  • More information for decision-making
  • Participants like it (despite nerves)!

However, keep in mind the following disadvantages of assessment/development centres:

  • Expensive
  • Time-consuming
  • Multiple rooms required
  • Many assessors/observers required
  • Training requirement for assessors/observers
  • Exercise design and validation takes time and competence and is costly
  • Update required when job changes
  • Feedback must be handled well otherwise may result in motivation issues in development centres
  • Process must be seen as fair in order to avoid image problems for the organization

Next Page »