Andrew Leng Ly andrewlengly.com/sourcing-channels-casestudy :: where the best hires come from case study # Which hiring channels bring in people who perform well and stay two years, and how a mid-size employer should split its recruiting budget. designed page ......... /sourcing-channels-casestudy # Pages / /projects /designer /developer /analyst /resume /card /campus /portfolio /garden /music /pond /sand /keys /timer /build /opening /split /blog /studio # Case studies /case-studies /grid-watch-casestudy /chain-routes-casestudy /nettracer-casestudy /fish-maps-casestudy /campus-it-casestudy /alwaysup-casestudy /third-places-casestudy /sourcing-channels-casestudy /skills-hiring-casestudy /ramp-time-casestudy /internal-mobility-casestudy /tab-split-casestudy # Data studies /studies /duolingo-streaks /chegg-after-chatgpt /tiktok-stem-feed /handshake-and-linkedin /ai-and-student-learning /third-places /oura-and-whoop /protein-boom /campus-rec-and-gpa ── THE SHORT VERSION ─────────────────────────────────────────────────────────────────────── A data study of which hiring channels bring in people who perform well and stay two years, tracking 311 hires by source. It runs survival models on retention and compares performance ratings by channel. Built with Python, pandas, lifelines and DuckDB, it recommends a two-tier referral bonus and a separate channel mix for production and office roles. the question .......... Referrals, job boards, LinkedIn, job fairs and search ads all bring in hires. Which ones bring in people who stay and do well? what i did ............ Tracked 311 hires by source through retention, survival models and performance ratings, then checked the pattern against BLS quit rates and published hiring data. where it stands ....... Done in November 2026. I recommend a two-tier referral bonus and a separate channel mix for production and office roles. kind .................. Case study · Data study role .................. Analyst year .................. 2026 tools ................. Python, pandas, lifelines, SciPy, DuckDB, Jupyter, BLS API the question .......... Which hiring channels bring in people who stay two years, and how should a recruiting budget split by role? ── THE QUESTION ─────────────────────────────────────────────────────────────────────── [01] # A recruiting budget is a bet on which channel brings in people who stay. Most teams measure channels by cost per hire. That number stops at the offer letter. A cheap hire who leaves in month eight costs the full search again. So I measured each channel by what happens after the hire. Who is still there at two years, and how do their managers rate them? ── HOW I DID IT ─────────────────────────────────────────────────────────────────────── [02] # One table of hires, followed from the offer to the latest review. # From raw HR records to a channel mix 01. Clean 311 hires, 2006 to 2018 Tenure to the last review date 02. Retention Kept at 12 and 24 months Wilson intervals, Fisher test 03. Survival Kaplan-Meier curves Cox model with controls Controls: Role family and hire year, since earlier hires had longer to leave 04. Cost Cost per hire still there at 24 months Editable cost table 05. Benchmark BLS JOLTS quit rates Published referral research kept at 24 months ..... still employed two years after the hire date, counted only for people hired at least two years before the last review cost per retained hire cost per hire / share kept at 24 months Channel costs are assumptions. Referrals assume a $2,500 bonus plus about $1,000 of recruiter time. Every other channel uses SHRM’s published average of $4,700. ── WHAT THE DATA SHOWS ──────────────────────────────────────────────────────────────── [03] # Referral hires stayed longest and were rated below expectations least. # Still employed at 24 months, channels with 20+ hires employee referral (31) 97% linkedin (76) ......... 95% careerbuilder (23) .... 91% diversity job fair (29) 90% indeed (84) ........... 87% google search ads (49) 84% Hire counts in parentheses. Huebner HR Dataset, synthetic. # Hires rated Needs Improvement or put on a PIP employee referral ..... 3% linkedin .............. 8% google search ads ..... 8% indeed ................ 10% company website ....... 15% diversity job fair .... 17% careerbuilder ......... 17% # Cost per hire still there at 24 months, assumed costs employee referral ..... $3,617 linkedin .............. $4,961 careerbuilder ......... $5,148 diversity job fair .... $5,242 indeed ................ $5,408 google search ads ..... $5,617 A referral stays the cheapest until it costs about $4,548 per hire. That leaves room for a bonus of about $3,500. The gaps all point the same way, and the sample is too small for any one of them to pass a significance test. Referral hires kept 97% at two years against 90% for everyone else (Fisher p = 0.33). The Cox model puts their risk of leaving 22% below Indeed hires, with an interval from 0.30 to 1.99. Published data at far larger scale shows the same pattern. On Ashby’s platform referrals were about 1% of applications and about 18% of hires, and hiring managers scored them highest. source ................ Referral statistics, with Ashby and New York Fed figures ── BY ROLE FAMILY ───────────────────────────────────────────────────────────────────── [04] # Referrals held up everywhere. The runner-up changed with the job. Production roles best .............. Referrals and CareerBuilder kept 100% at two years, LinkedIn kept 95% watch ............. Indeed kept 83%, and 8% of its production hires quit in year one Office roles best .............. The careers page kept all 9 of its hires. LinkedIn and referrals each kept 93% watch ............. Google search ads kept 80% from a small base BLS puts manufacturing’s annual quit rate at 23% on average from 2021 to 2025. Every channel here beat that in year one, so this workforce is steadier than the national average. source ................ BLS Job Openings and Labor Turnover Survey ── MY RECOMMENDATION ────────────────────────────────────────────────────────────────── [05] # Pay for referrals that stay, and split the mix by role. pay the bonus in two parts Half at 90 days and half at 12 months, so the bonus rewards hires who stay. two tiers ............. About $1,500 for production roles and up to $3,500 for office and technical roles, under the break-even point. production mix ........ Referrals and LinkedIn first, CareerBuilder as backup, and a smaller share for Indeed. office mix ............ Referrals and LinkedIn first. The careers page earns a test with more volume. search ads last ....... Lowest two-year retention (84%) and the fewest Exceeds ratings (4%). track it quarterly .... Two-year retention and first-year rating by source, with the mix revisited once a year. ── LIMITS ───────────────────────────────────────────────────────────────────────────── [06] # What this data can’t tell you. synthetic data ........ The Huebner dataset was built for teaching HR analytics. Its numbers show the method, and the published research carries the conclusion. one source per hire ... Someone referred by a friend who then applied on Indeed may be logged under Indeed. assumed costs ......... A real employer should swap in invoices and recruiter hours. ── WHAT’S NEXT ──────────────────────────────────────────────────────────────────────── [07] # What I’d run with a real company’s data. a bonus test .......... Roll the two-part bonus out to half the departments for two quarters and compare referral volume and 12-month retention. source of influence ... Ask new hires where they first heard about the job, beside where they applied, to catch referrals logged under job boards. quality of hire score Blend 12-month rating, retention and time to first independent work into one score per channel. referrer retention .... Check whether employees who refer someone also stay longer, a pattern iCIMS reported. a live dashboard ...... Rebuild the cleaned tables in Power BI so recruiting can watch channel quality every month. ── TL;DR ────────────────────────────────────────────────────────────────────────────── [08] studied ............... Which hiring channels bring in people who perform well and stay two years, tracked across 311 hires. found ................. Referral hires stayed longest, with 97% still employed at 24 months against 90% for everyone else. # by the numbers 97% ................. Referral hires still employed at 24 months 3% .................. Referral hires rated Needs Improvement or put on a PIP $3,617 .............. Referral cost per hire still there at 24 months the catch ............. The sample is too small for any gap to pass a significance test. The referral gap has p = 0.33. next .................. Roll the two-part referral bonus out to half the departments for two quarters and compare retention. ── LINKS ─────────────────────────────────────────────────────────────────────────────────── open where the best hires come from /studies/sourcing-channels.pdf the analyst side ...... /machine/analyst # end of /machine/sourcing-channels-casestudy. andrew.leng.ly@gmail.com · leave machine mode