Wednesday, 30 March 2011
Is your organisation ready for 360? Think again...
Saturday, 8 January 2011
How fine should the fine print in competency frameworks be?
Research by James Meachin and Stephan Lucks (recently reported in the BPS’s Assessment and Development Matters, Vol. 2 No. 3, 2010) explored the optimal level of ‘granularity’ for competency frameworks when used as predictor measures and assessment criteria. Research into the effectiveness of various personality constructs to predict job performance suggests that some of the broad measures, such as the Big Five, have limited predictive validity, but that this might be improved when you correlate job performance with some of the finer-grain sub-traits, such as ‘dependability’. This would suggest that better predictions of job performance are made by fine-grain, or more specific, behavioural criteria.
Based on the literature, Meachin and Lucks hypothesised that assessment centre ratings which were based on a fine-grain competency framework would produce better correlations between conceptually-matched job performance measures (line manager ratings). In other words, they’d result in a more accurate prediction of high performance on the job. Interestingly, what they actually found is that the predictor measures showed stronger correlations with line manager performance ratings as they became broader, not narrower. Aggregating the competency scores into a general, overall measure of performance seemed to be a more reliable way of predicting high-performing individuals than picking on their performance in specific competency areas.
For practitioners, this is useful information. In order to create robust assessment processes, which differentiate between higher and lower performing candidates, a job analysis or competency framework has to provide depth and a level of detail which makes explicit the behaviours and competencies which are important to success or which demonstrate effectiveness. Undoubtedly, in the arena of assessment for development purposes, the value is in the detail – in helping people understand the specific aspects of their performance or behaviour which makes them more or less effective. But in recruitment, by being overly reliant on the detail and by honing in on one or two areas which may be deemed to be crucial to the job, we could be missing the bigger potential picture.
So, perhaps the optimal situation is to have a detailed, granular competency framework, which sets out the specific behavioural indicators across a number of competencies (no less than 6, and no more than 12?). By collecting assessment data against your framework (through performance appraisal, assessment processes, or 360 degree feedback), you should then perform a factor analysis on your competencies to determine whether there are any higher-order (or coarse-grained) factors underlying it (this may result in a general, overall performance construct or perhaps two or three clusters of competencies). Aggregating competency scores in line with these underlying factors and making decisions based on these broader measures is likely to improve the reliability of the framework, and ensure that you’re not letting potentially good candidates slip through the net.
Monday, 27 September 2010
Why do some 360 degree feedback programmes have more impact than others?
This is a theme with which we at Head Light Communications are familiar; we’ve written previously on the subject of making the most of your investment in 360 and Morison’s study supports many of our views in this area. He used 11 organisations as case studies and interviewed 84 participants, exploring individual experiences of receiving 360 degree feedback in different environments. From his interview data, he identified the factors which determined a difference in the perceptions regarding the 360 degree process, finding many of these to be cultural. However, some pertained to the attitudes and personality of the feedback recipient, and Morison used the work of London and Smither (Human Resource Management review, 2001) to provide a framework for exploring reactions to 360. London and Smither cited two key factors:
- The ‘feedback culture’ of the organisation
- The ‘feedback orientation’ of the individual
Morison’s study supports our view that it is the interaction between a number of these factors that determine ‘success or failure’ of a 360 programme. The main factors emerging from his research as being the critical determinants of success were:
- The design and management of the feedback process; Morison, like us, sees this as a ‘hygiene factor’. It’s important to get it right, since it will be cited as a derailer if things go wrong. This would include ensuring that the questions are clear and easy to understand, that the process was intuitive and easy to use, that the feedback is relevant to the individual’s job and that the questionnaire is psychometrically sound. However, it’s not enough, on its own, to ensure that a 360 programme is successful.
- Organisational Justice Perception; individuals need to believe in and accept the organisation’s motives for using 360 degree feedback. If there are doubts as to how the data will be used, people are less likely to engage positively in the process.
- Perceived Organisational Support; the follow-up to 360 is critical. Follow-up support activities would include integrating the data into coaching, having an in-depth one-to-one feedback discussion with an experienced feedback facilitator (our work with our clients would also strongly support this as being a key enabling factor) and reviewing progress against focused personal development plans.
- Leader-Member Exchange; this looks at the interaction between manager and subordinate. If the manager is responsible for following-up a 360 with feedback and action planning, then it is important that they have a positive and constructive relationship with the individual.
- Feedback Intervention Theory; Morison says that 360 feedback needs to focus on specific behaviours and raise the motivation to change by identifying performance gaps. In our work on 360, we ensure that these gaps are made clear in our reports, but we also see the identification of clear strengths as being important – it’s too easy to focus on the critical feedback and overlook the more positive aspects. Our PAPU-NANU feedback model helps people to understand both their strengths and their performance gaps.
- Is the 360 tool easy and clear?
- How significant is the feedback programme (“so what??”)
- Is it fair? Do participants get a say in it at any point?
- What help will they get?
- Is it easy for recipients to talk to their managers about their feedback?
- Does it fit with what people would expect to be asked about in their roles?
- What will the feedback actually tell people? Will they be able to act on it?
Friday, 24 September 2010
Top Ten Tips - Creating Competence Frameworks
Developing such a competency framework can be a costly and lengthy process, especially if you are creating a bespoke model that is genuinely focused on high performance within your organisation. We offer here ten lessons as tips for your own work in this area. This is based on our extensive work and research with public and private sector organisations, large and small.
1. Do it back to front!
2. It’s a competency framework, not a job description....
3. Is that a good thing, or a bad thing?
4. ‘Yes’ to one thing, but not the other…
5. From 7 to 11
6. It’s supposed to change....
7. I dare you to ask them!
8. Can you see what it is yet?
9. “If only you knew the power of the Dark Side, Luke”
10. Position Vacant: Only Super Man or Wonder Woman need apply
For the detail behind each of these headings, see our article here.
A Competence Framework can ‘come alive’ when applied to the business in the context of talent management processes such as performance management, succession planning, high potential identification and development planning.
Your competence framework, combined with our Talent® suite of software products can help you do just that.
Monday, 24 May 2010
Talent Management specialists wanted
Contact us via our Information Request page.
Tuesday, 11 May 2010
Is there a connection between Employee Engagement and Talent Management?
In this blog we draw on research conducted by the Institute of Employment Studies (IES) in both 2003 & 2007 (Drivers of Engagement) and 2008 (Human Capital Measurement), Henley Management College’s own study in 2005 and our own work in this field.
What is employee engagement?
Employee engagement has risen in popularity over the past few years. Some enthusiastic pundits have made categorical statements that a more engaged employee leads to better business results and anecdotally there is evidence that this is so – intuitively this would of course make sense. However, there is also evidence that there is little or no correlation whatsoever with business performance – a recent study by Henley Management College concluded that in their research in the corporate world, no such relationship exists.
We have also seen commentary relating to engagement that focuses on the notion of how to get that ‘extra discretionary effort’, i.e. to create employees that are willing to put in more work for altruistic reasons. We think that this focus on singularly attempting to get more out of people is both cynical and short-termist. Having said all this, a more productive, motivated, happy and ‘easier to get on with colleague’ is better than one who isn’t and engagement studies have sought to attempt to analyse and decode what makes this ‘better’ employee.
Consequently, employee engagement has developed into a complex and multi-dimensional concept that has gone much further than the simple notions of motivation, the psychological contract and employee satisfaction, yet it draws on elements of each of these ideas. It also has much in common with the extensively researched concepts of commitment and organisational citizenship behaviour (OCB). With these last two, there are some important differences – engagement is a two-way process: organisations engage people (intentionally or otherwise) through their systems and processes and they in turn choose the level of reciprocal engagement.
Do read our article in our last newsletter ‘Are your Talent Management Processes Fair?
http://www.head-light.co.uk/Articles/Fair_Talent_Management.pdf
So what does an engaged employee ‘look like’? From an HR perspective, the typical behaviours demonstrated by the engaged employee are:
- A belief in the organisation and its purpose
- A desire to work to make things better
- An understanding of business context and the ‘bigger picture’
- Being respectful of, and helpful to, colleagues
- A willingness to ‘go the extra mile’ , and
- Keeping up to date with developments in their field.
If only it was so straightforward that we could ask employees these questions directly and get reliable candid responses!
This is where Occupational Psychologists can add real value and develop (and validate) engagement-oriented behavioural indicators, not dissimilar from those used in 360 reviews. Subtlety and deftness can be achieved with careful wording that ask the important questions in the right way and a combination of positive and negative statements together with some discretion as who to ask for feedback, makes for an insightful diagnostic.
Ask us for some examples.
Monday, 10 May 2010
Appraisals - what do enployees think of them?
Let’s review a typical example of how the appraisal process is viewed.
It’s appraisal time again and line managers are not looking forward to having to spend the time completing the paper work and employees generally aren’t looking forward to the dreaded appraisal meeting itself. Unresolved issues that have been under the surface most of the year are going to be dragged out and documented and the usual unbearable ‘schmoosing’ upward to management will start if it hasn’t already behind closed doors. Everyone will get given a ‘rating’ or score that they don’t understand and by some 360 process that is shrouded in secrecy. Some say that the score is used for bonus; some say a bad score will put you ‘into the departure lounge’. It’s not good that John (a colleague) and I haven’t been seeing eye to eye lately and if he’s going to be giving me some sort of a score, he’ll put the knife in. Best I do too then. I’m not sure the forms we use really apply to my role and my Manager doesn’t really understand the realities of the job I do, so we end up with these circular or inconclusive discussions that inevitably require me to sign off on some vague actions we all know won’t happen. After all of this, it gets filed away and only used again if they want to stop me suing them if I get sacked or made redundant. The output of all of this seems pointless at best and everyone would rather not do it, but we have no choice on how, when and whether it’s done.
If it’s not working, why are we doing it like this? Discuss...