Lead Data Engineer Job at WorkHQ, Los Angeles, CA

MDJUdUlkQjdwSW5RSk5uTjFDNXNSd0JaVmc9PQ==
  • WorkHQ
  • Los Angeles, CA

Job Description

Company Context

Series A, well-funded US startup in HRTech developing WorkHQ.com and an AI Recruiter product.

This is a US-only, Remote role (Mainland).

Role Overview

Lead data infrastructure architect managing billions of data points across 250M+ professional profiles.

Hire data engineers to aid you in that journey.

Core Responsibilities

  • Design scalable data pipelines processing massive record volumes

  • Architect ETL processes using PySpark on Amazon EMR (Open to shifting to other solutions like Data Bricks / Snowflake)

  • Distribute enriched data through medallion architecture across Postgres, Athena, OpenSearch

  • Integrate new data sources into the main pipeline

  • Implement advanced data matching using Splink

Technical Requirements

  • 5-8 years professional data engineering experience

  • Good proficiency in:

    • PySpark and distributed computing

    • AWS data services (EMR, Glue, Athena)

    • Docker

    • Pandas and DataFrame manipulation

    • Complex data format handling (JSONL, Parquet)

  • Strong background in:

    • Big data processing architectures

    • Data warehouse design

    • Performance optimization

  • Advanced Python, SQL skills

Nice to Have

  • Probabilistic record linking expertise

  • OpenSearch/elasticsearch technologies

  • Machine learning data pipeline design

  • Recruitment tech ecosystem knowledge

Technical Stack

  • Big Data: PySpark, EMR

  • Databases: Postgres, OpenSearch

  • Cloud: AWS

  • Containerization: Docker

  • Data Formats: JSONL, Parquet

  • Analytics: Metabase, Athena, Glue

  • Data Processing: Pandas, Splink

Other Considerations

While this role has specific requirements - if you lack a few technical skills, but motivated to learn and lead the platform, please apply for consideration.

If you are coming from Director/Head of/VP levels that is relevant to this job, you can apply as well.

You will need to apply directly on our platform.

Thank you for your time.

Job Tags

Permanent employment, Remote work, Shift work,

Similar Jobs

Pampered Petz LLC

Part Time Pet Sitter & Dog Walker Job at Pampered Petz LLC

 ...Pampered Petz is an established professional pet sitting and dog walking company based out of Gilbertsville, PA. We have been in business...  ...to join our team preferably with animal care/training experience. Currently, we are looking for someone to help in the areas of... 

Baptist Memorial Health Care

Photographer/Videographer Job at Baptist Memorial Health Care

 ...Overview Job Description Under the direction of the public relations manager, the photographer/videographer will plan, shoot, edit and create content and creative photos and videos for public relations, marketing and advertising, web marketing, email, social media... 

Amtrak

Principal Incident Response Analyst - 90397448 - null Job at Amtrak

 ...Your success is a train ride away! As we move Americas workforce toward the future, Amtrak connects businesses and communities across the country. We employ more than 20,000 diverse, energetic professionals in a variety of career fields throughout the United States... 

Ikonicsolution

Technical Project Manager Job at Ikonicsolution

 ...Bakers, I-10/3, Islamabad, Pakistan | Posted on 07/21/2025~ Country Pakistan Job Description Position Title: Technical Project Manager Timings: 4:00pm - 1:00am Department: Software Engineering About Us: IKONIC is a US-based IT company headquartered... 

JOEY Restaurants

Kitchen Expeditor - JOEY Newport Beach Job at JOEY Restaurants

 ...hour and $30.00/hour and will be eligible to participate in our company tip pool. Our tip pool distributions fluctuate, and we cannot guarantee...  ...seek the best and the brightest, drive development, and reward top performers. JOEY is all opportunity, and our people is the way...