In a candidate short market with high levels of competition for top talent, it’s more important than ever to create an engaging and human candidate experience. But you need to balance that with finding the best talent for your role.
Skill testing can give recruiters a competitive advantage in today’s job market. Candidates who are hired on merit, rather than background, tend to stay longer and perform better over the long term. Here’s how to useskills assessmentsto fill your open positions, no matter how many applicants you are dealing with.
What is a Skill Test?
A skills test is an assessment used to provide an unbiased, validated evaluation of a candidate’s ability to perform the duties listed in the job description.
Typically, a skills test asks a variety of questions in different formats to see how candidates perform on-the-job tasks. A good skills test includes questions that are capable of being answered by someone already doing the job and can accurately measure key performance metrics. Questions should also be specifically tailored to relate to the responsibilities of an open position. Many skills tests includeimmersive experiences, like coding challenges orjob simulations, to mimic how a candidate performs when faced with a real-life scenario.
Other types of job-readiness evaluations deploy validatedpsychometric assessmentsto identify those in-demandsoft skills: things like motivation, conscientiousness, resilience, and emotional intelligence. A personality assessment varies from a skills test in that it predicts how a person will behave in a specific scenario, rather than their ability to complete a task.
Related: Should You Use Psychometric Tests for Hiring?
While skills test cover task-related abilities, like coding, copywriting, or sales, some pre-employment assessments integrate the less tangible capabilities – things like teamwork and leadership. These qualities are sought after by executives at more than 900 companies, according to aWall Street Journal surveyof executives.
Yet, 89% of those surveyed said they have a “very or somewhat difficult time finding people with the requisite attributes.” Where traditionalhiring methodsfall short, a skills test can easily clarify a candidate’s true talent.
“Many service companies, including retailers, call centers, and security firms, can reduce costs and make better hires by using short, web-based tests as the first screening step. Such tests efficiently weed out the least-suitable applicants, leaving a smaller, better-qualified pool to undergo the more costly personalized aspects of the process.”
Research by John Bateson, Jochen Wirtz, Eugene Burke and Carly Vaughan via Harvard Business Review
Overall, skills tests can play a critical role in predicting on-the-job success. More so than resumes or job interviews, a skills test can assess the true potential of a new hire to go the distance with the company. Here’s howskill testingworks, and why more companies than ever are starting to integrate skill testing into the recruitment and hiring process.
How Skill Testing Works
Skill testing works best when the questions being asked are specifically crafted to the role and needs of the team hiring the new candidate. In designing a skills test, combine different types of questions to get a 360-degree view of how a candidate will perform in different scenarios.
There are a variety of ways to set up a skills test – and we’ll get into the mechanics of how to actually run the assessment in the next section. But, designing a thoughtful aptitude test takes some initial foresight on behalf of the hiring manager and team.
Research byDeloittesuggests this sample process for selecting and implementing skill testing questions:
- Define the “human elements” needed to perform the job
- Compile questions that will measure and predict these human elements
- Use the data gathered by the skills assessments to empower the next round of the screening process
- Post-hiring, evaluate the efficacy of the hiring assessment to ensure the questions delivered the best result.
Ultimately, the best use for a skills assessment is to help recruiters move away from the resume and allow candidates to prove they are the real deal. Crafting the right series of questions should be a collaborative process between the recruiting team and the team hiring the new employee. Here’s how these teams can set up and run a skills test.
How to Set Up and Run a Skill Test
In designing a skills test orpre-employment assessment, there are a few specific steps to take in order to thoughtfully structure your questions.
Related: 5 Steps to Creating an Engaging Skill Assessment
Based on our work with over 8,000 customers, we recommend following thesebest practicesin setting up and running your skills test. These tips can help with candidate engagement and lead to high rates of completion.
- Your skills test should include a minimum of six questions; somewhere in the eight to ten range is best.
- At least a few questions should require text answers; start with a text-based response in the first question, rather than a video or immersive question.
- Include an “immersive” style question, in which the candidate edits a document, spreadsheet, or presentation.
- To retain a candidate over the entire experience, start with easier questions and build up to more difficult ones later in the assessment.
- 尽量减少使用计时器占technical difficulties and give the candidate the best chance of success.
We also suggest that video responses not be timed; there are too many technical issues that can result from a candidate trying to film aone-way video interview. If you do wish to set a time limit, make sure it’s at a minimum of five minutes.
Running a skills test through Vervoe, or any other platform, is relatively straightforward. Vervoe’s skills assessments let you select questions from a library of assessment tools, or design your own questions based on the specific needs of your company. TheExpert Assessment Libraryoffers questions and trials created by experts in their fields, meaning they have at least 3+ years of experience in their specific area of expertise. The assessment library contains various skill tests from various industries includingadmin and office,customer service,human resources,marketing,sales,software developmentand more. You can preview questions from any of the assessments and add them seamlessly through the Vervoe platform.
Now that you know how to set up an assessment, when should you deploy this tool during the hiring process?
Using Skill Tests During Hiring
Timing is everything when it comes to adding a skill assessment to your hiring process.
Research byHarvard Business Reviewrevealed that skills tests should come early in the hiring process. According to their study, “Many service companies, including retailers, call centers, and security firms, can reduce costs and make better hires by using short, web-based tests as the first screening step. Such tests efficiently weed out the least-suitable applicants, leaving a smaller, better-qualified pool to undergo the more costly personalized aspects of the process.”
Skill tests should be used to screen candidates in, not out. The issue many recruiters face is that thevolume of candidatesmakes it impossible to carefully consider each person’s ability. Smart algorithms and AI tools can turbo-charge candidate assessments by scoring results quickly andremoving human biasfrom the equation.
Vervoe’s algorithm scores candidates using a multi-layered approach. Candidates are ranked based on how well they performed, rather than filtered out if they didn’t achieve a certain benchmark. The top candidates easily rise to the top; but no one misses out on being considered for the next round. When used early in the hiring process, skill tests can select a morediverse pool of applicantsto continue onto the next phase.
Skill Test Examples and Templates
There are many ways to set up a skills test, depending on the position for which you are hiring.Pre-employment skills testscan cover a range of positions:administrative assistant, finance and accounting,call center reps, andsoftware engineersare just a few roles that companies hire for using skills assessments.
Excel skill tests, coding skill tests, typing skill tests, and other computer skill tests are the most common forms of pre-employment assessments. Some companies focus on questions that are task-related, e.g. “Create a Powerpoint Slide that has a video embedded in the presentation.” Questions can get hyper-specific to test a niche skill, like a coding language, or be posed more broadly to test the general requirements for success at a certain level.
Some companies choose to focus on verifying the skills that will help a candidate succeed beyond the immediate position. This approach skews closer to apre-employment assessment, with questions designed to reveal if a candidate can climb the corporate ladder, adapt in a challenging work environment, or respond under pressure.
For example, one call center rep test included questions such as, “You have an elderly customer on the phone who is having trouble understanding your instructions. A colleague is also trying to transfer a call from a customer you served before, and you have a scheduled follow-up call happening in 5 minutes. How would you handle and prioritize in this situation?”
Multiple choice, open-ended questions, and pre-recorded video responses are all great ways to see if a candidate has what it takes to do the job well. But, do candidates enjoy answering these types of questions?
新员工技能喜欢做测试?
By most accounts, candidates appreciate the opportunity to showcase what makes them great at their job.Orica,世界最大的商业explo提供者sives, integrated skill-testing into their interview process to the delight of their job candidates. In revamping the interview process for graduate students looking to join the Orica team, recruiters consolidated their online evaluation components into one platform, Vervoe. The skill assessment combined questions focusing on skills, logic, and values.
An average of86% of candidatescompleted the online process, and the reviews were mostly positive. Here’s what the candidates had to say about the skills test:
“The tests required total engagement and thought, and were a clear demonstration of what makes Orica different from any other company.”
“I think the questions were very diverse and it allowed me to showcase myself, my skills and abilities in different ways.”
“它给了我一个机会展示我是谁well as challenge my skills”
This is just one example of how a skill test can change the entire interview process for a potential new hire. In a job market where people spend anaverage of 11 hours a weeklooking for a new job, it’s easy to get burned out, fast. Every job description starts to look the same; every interview begins to feel stale.
When given the opportunity to showcase their talent throughreal-world tasks,求职者会抓住机会engaged with the job description, rise above their resume, and challenge themselves. Companies that use Vervoe’s assessments experience a 97% candidate completion rate, which is among the highest engagement rates in the industry. Candidates love the opportunity to stand out from the crowd. Even if they aren’t hired, skills testing offers a break from the repetition of the stale interview experience.
What are the benefits of a skill test?
The benefits of a skills test aren’t limited to the candidate experience.
Recruiters looking to hire diverse, high-performing teams with better efficiency and consistency can use pre-employment tests to their advantage. Skills tests are a better predictor of performance than resume screenings or traditional interviews alone. Resume screenings are bad for three reasons. First, studies suggest that it’s common forcandidates to lie on their CV.The person you think you’re hiring may not actually possess the qualifications you think they do.
“We just wouldn’t be able to interview 2000 people in two weeks. But what we could do is utilize Vervoe to more accurately and in quite an unbiased way, assess everybody’s application during that period.
Rather than just assess the first 200 [applicants] and maybe hire 150 of them, Vervoe allowed us to actually assess all 3000 applicants in a two week period and still be able to select the best 150.”
Jeremy Crawford, Head of Talent Acquisition at Medibank
Second, resumes only provide a high-level view of a candidate’s credentials and work experience. These items don’t offer qualitative insight into actualon-the-job performance. Coupled with recruiting biases that are built into the process, the third threat is that recruiters are privileging candidates based on background and demographics, rather than talent. Perhaps this is why new hires crash out as often as they do. According to one study,46% of new hires “fail”within the first 18 months of being hired.
Skill tests can help take some of thebias out of the interview process, give recruiters a new evaluation metric to consider, and lead to happier, long-term hires. There’s ample evidence to suggest they really do work better than many of theother traditional hiring methodsrecruiters have relied on in the past.
Related: How to Avoid the 12 Kinds of Hiring Bias
Do skill tests work?
In our experience, skill testing works better than traditional hiring methods – with some caveats.
Without a doubt, aptitude tests can be used toreplace resume screening. This style of sorting through candidates increases the chance that the best candidates will be unfairly eliminated. Good people get screened out, rather than screened in. So-called “pedigree proxies” – resumes and cover letters – are not indicative of job performance, yet they are often the quickest way a recruiter or algorithm can think of to cut down on their stack of candidate resumes.
Skills tests improve time to hire while allowing the hiring manager to see how someone will do the job, before they get the offer. This reduces turnover costs, which add up quickly: the cost of making the wrong hire can be up to 2.5x salary, easily over $100,000. Working with Vervoe’s skills assessments, on the other hand, can help a recruiter identify the best people at under $100 per hire.
Thebest skills tests, however, need the right formula tohelp the candidates succeed. Somerecruiters focus narrowly on the skills that will help a new hiresucceed in the immediate position for which they are hiring. Yet, many CEOs emphasize theimportance of soft skills– things like leadership and teamwork.
Related: 5 Ways To Turn Rejected Candidates Into Allies
New hires may end up being disappointed and leaving because they lacked the soft skills needed toadapt to their new team, not necessarily the skills to perform the job. Recruiters must integrate questions into their skill assessment that focus on critical soft skills that predict long-term success. These validatedpsychometric assessmentsare key to assessing “culture fit” without defaulting to recruiter bias.
Is skill testing valid?
With any kind of assessment, there’s a common concern that’s quite commonly raised: is this assessment valid?
In summary:
- Any test that directly mimics what a person will do on the job can be considered “validated.”
- 人格测试and soft skills are a riskier prospect even when they are “validated,” because they often lack the proper validation required to be EEOC compliant.
- Positive candidate experience and perceived fairness are two of the primary reasons whyskill testing is an effective and expedient hiring practice.
There are many types of validity, and it’s rare that a test will satisfy every type. Looking specifically at tests for finding job fit, there are a few different types of validity that are particularly relevant, not just to ensure that the hire is a good one, but to ensure compliance with EEOC regulations.
Types of Validity
Face validity
The most basic form of validity, and sometimes the only one that can be obtained when a test is first created. Face validity essentially asks whether the test looks like it’s assessing what it claims to measure.
一个例子是测试一个人的算术技能. A set of math problems would have more face validity in this instance than, say, a word problem because a word problem is assessing both arithmetic skills and comprehension.
Content validity
For skill tests used in recruitment, the question of validity should be most focused on this kind of validity. Content validity asks whether the test covers the full range of the construct that it’s supposed to measure.
This means that in any assessment, the group of questions being asked needs to cover a wide enough range of skills, so that the person evaluating can be sure that the results show the candidate is capable of doing the tasks required on the job.
Construct Validity
When people ask if a test is “validated” or has “psychometric validity,” this is the kind of validity that they’re usually talking about. Construct validity asks whether the test actually measures the theory-based construct that it claims to measure.
So, if you’re testing for general cognitive ability or personality, construct validity is absolutely essential, because they are indirectly related to whether someone can perform the job.
But when it comes to testing skills that used directly on the job, face and construct validity are far more important.
Predictive/External Validity
This kind of validity is about whether or not the assessment predicts performance in other situations. So, if someone scores highly on the test, does that mean they’ll perform well on the job?
There’s a big difference between tasks that are assessed without context, and tests reflect the day-to-day skills and tasks someone would need to have to perform the role.
Related: Skill Testing Validity
In all cases where assessments are used, and in every step of the recruitment process, it’s essential that employers track and remain aware of differences in performance that are biased toward particular demographic factors. At Vervoe, we constantly monitor assessments to make sure candidates take tests that are fair, and based solely on skills that reflect how they would perform on the job.
Skill tests vs. interviewing
In conclusion, we’ll leave you with few thoughts on skill tests compared to interviews.
First, interviews, in general, need a total overhaul. Recruiters have been asking the same,outdated interview questionsfor decades. Many candidates get overwhelmed by the performance anxiety inherent in the interview and may make(forgivable) mistakes. Nevertheless, many recruiters like the security of meeting someone before making an offer.
Many recruiters seek the same insight from a group interview or case study that they would get from an individual skill test. Unfortunately, using these methods can’t give you the same valuable information as a straightforward aptitude assessment.Case studiescan be too conceptual; rather than seeing how a candidate will approach the work listed in the job description, case studies ask abstract questions. The goal of asking “how many tennis balls can fit on a Boeing 757” is not to see if the candidate can guess the right answer, but to see how they approach the question and reason through their response.
But this knowledge doesn’t always serve a recruiter with the best predictor of on-the-job success.
Group interviews provide more insight – into a candidate’s teamwork, leadership, and communication, for example. Yet, in a group scenario,extroverts tend to dominate. It can be difficult to see how each candidate performs as an individual while trying to consider the group at once.
In summary, skill testing is all about understanding whether a candidate can do something or knows something. It’s about verifying their ability to go the distance with your company. Pre-employment assessments differ slightly in that they focus on predicting how a candidate will behave in certain scenarios, not what they can do. By combining questions from skills testing and pre-employment assessments, recruiters can get a more accurate picture of the candidate’s ability.
Additional Resources
For more reading, check out some of these great resources.
