The HackerRank community is the most significant learning and competition community for programmers. The community currently has over 6 million registered developers who actively use the HackerRank community to practice coding, participate in contests, and prepare for coding interviews.
5 Months : Dec 2020 - Present
HackerRank has a strong brand with various developers’ cohorts resulting in almost 1M unique sign-ins a month.
It is this population that enables us to build and launch highly successful new products. In recent times, the community’s growth rate has been flat, and it needed immediate attention.
HackerRank attracts two primary personas: Learners and Job Seekers. We focussed on both personas equally, and the growth rate had been flat in 2020-21. So we wanted to concentrate on one and de-prioritize the other one.
We surveyed 360 users to understand our community better and found that 63% of our users are here to prepare for jobs and 31% of our users are here to improve coding skills(learners).
From the survey, we learned that a majority of the community developers come to HackerRank to prepare for jobs, and we wanted to focus on this cohort as this was also the most relevant one for other parts of HackerRank. We planned to double down on this persona and sideline anything that doesn’t help job seekers.
Our objective in 2021 was to attract more job seekers and help them prepare for job interviews in the shortest amount of time and effort.
After speaking to several developers who have recently changed their jobs or got their first job, we gained several insights and identified the following pain points faced by them:
There is a lot of content out there and it is difficult to understand where to start.
Following are the quotes from developer interviews:
- “I had to establish the structure for study which gets really hard when deadlines are close”
- “There is a lot of content but nothing is compiled properly. Articulation of the resources could be better”
Do not know how are interviews conducted at different companies and how should I prepare for them.
Both Students and Professionals spend a lot of time on discussion forums to look at past interview questions and the interview experiences shared by others.
Past interview questions and company-wise interview preparation kits are very popular among professional developers because they give them direction to prepare.
Based on the interviews, we built out 2 key personas that are aligned with our primary persona: Job Seeker.
Long projects have their pros and cons. The pros of it are that we get to break down the project into smaller chunks. It gives us a chance to understand and get insights from the previous chunk to plan out the next step/chunk based on those metrics.
Breaking down the project is one task whereas breaking them in such a way that the next one is interdependent on the previous one is another. Making decisions becomes way easier when done that.
Our overall objective in 2021 is to help job seekers ease their interview preparation.
It being a huge project, we broke down the project into 4 smaller parts and worked on each of them step-by-step.
The objectives of the project were:
- Align our current product experience with job seekers and de-prioritise every other experience.
- Update the onboarding experience and understand what the users use HackerRank for.
- Investing in the interview prep experience and content to offer a customised preparation plan based on the job seeker’s need.
- Build a discussion forum to enable job seekers to seek help from other job seekers.
We did not know the motivations of most of the users who sign up with HackerRank Community every month. ~60% of these users do not even mention if they are students or working professionals.
The solution was to update the current onboarding process for new users to identify who they are, what they are looking for and provide them with a tailored experience.
- Why did we focus on onboarding?
We wanted to prioritise new users as we do not know anything about more than 50% of the users who sign up every day. That’s quite a large population we know very little about.
A job seeker who signed up with us 3 months or 6 months ago may not be searching for a job anymore but new users are much more likely to be active job seekers, which is our primary KPI.
2. How will the user benefit by going through this onboarding?
We were going to use the information provided by users during the onboarding to customise the interview prep experience which is the next part of the project.
Before and After
- The drop-off percentage decreased from 55% to 28% which was significant.
- 90% of the users went past the first step and thereby letting us know their intent which we used to customise their preparation.
- The engagement funnel looked like this.
- Onboarding also helped us increase the number of candidates solving at least 1 question after signing up by 25%.
Interview Preparation Kits
Developers still struggle to understand where to start since there is a lot of content out there. We believe by understanding the developers and providing them with a preparation plan that best fits their needs can really help solve this problem.
- Why is an interview preparation Kit?
An interview preparation kit is a collection of questions and mock tests that are curated to help developers prepare for interviews in specified time duration.
2. How did we manage to tailor a kit for a user?
Interview prep kits are based on time and we recommend each job seeker the kit which suits their timeline.
The goal is to understand how the time-based preparation kits work and then launch kits based on roles and companies.
- Bigger projects need to be broken down into smaller parts to ease the design processes, understand the insights pre and post launch and plan the next part based on the feedback on the present one.