Similar Jobs
About TripleLift
We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionable data and smart targeting. Through over 1 trillion monthly ad transactions, we help publishers and platforms monetize their businesses. Our technology is where the world's leading brands find audiences across online video, connected television, display and native ads. Brand and enterprise customers choose us because of our innovative solutions, premium formats, and supportive experts dedicated to maximizing their performance.
As part of the Vista Equity Partners portfolio, we are NMSDC certified, qualify for diverse spending goals and are committed to economic inclusion. Find out how TripleLift raises up the programmatic ecosystem at triplelift.com.
The Role
TripleLift is looking for an experienced lead data engineer to join our team full-time. We are a fast-growing startup in the advertising technology sector, tackling some of the most challenging problems facing the industry. As a lead data engineer, you will lead our data team which builds and improves our data pipeline and reporting infrastructure. This team supports a variety of applications – a Lambda architecture pipeline in Spark, a dependency and scheduling system using Airflow, and the corresponding set of data-driven APIs and front-end components. You will report into the Engineering Manager, Data Platform
The Team
The data platform engineering organization(DPE)’s mission is to ingest, process, store and surface billions of events we generate across our platform and make it available to our internal and external partners. The scale at which we operate peaks over 200 billion events per day, our platform needs to be sustain such scale in a robust way following SOLID principles and SDLC best practices
Responsibilities
- Grow a mission critical codebase that’s at the heart of TripleLift’s value proposition;
- Contribute and monitor our data pipeline that handles billions of daily ad requests and more than a hundred unique daily events;
- Research and implement cutting edge technologies that improve the performance of our data pipeline;
- Design our systems that can handle an order of magnitude growth in data;
- Mentor others on the engineer team around data engineering best practices.
Basic Qualifications
- Advanced experience with distributed processing frameworks like Spark, Kafka etc.
- Advanced experience with a compiled language (Java, Scala, Go, etc.) and a scripting language preferably Python
- Expert working experience with SQL
- Experience with cloud-based data technologies such as Snowflake, Databricks, Trino/Presto, or similar
- Experience with orchestration tools like Airflow, Luigi, etc.
- Experience working with AWS services like S3, EC2, EMR, RDS, etc
- Strong working experience with relational databases as well as NoSQL databases
- Experience building and optimizing ‘big data’ pipelines, architectures and data sets.
- Experience with building robust data models to grow and evolve with the company’s business needs
- Experience supporting and working with cross-functional teams in a dynamic environment.
Preferred qualifications:
- 6+ years of data engineering experience and 2+ years of lead experience
- Bachelor’s degree in Computer Science, computer engineering, electrical engineering OR equivalent work experience.
- Experience with Elasticsearch or OpenSearch
- Experience with IaaC tools like Terraform, etc.
- Experience with CI/CD tools like Github actions, etc.
- Experience with Druid
- Experience with Kafka Streams, Flink, etc
#LI-TP1
Life at TripleLift
At TripleLift, we’re a team of great people who like who they work with and want to make everyone around them better. This means being positive, collaborative, and compassionate. We hustle harder than the competition and are continuously innovating.
Learn more about TripleLift and our culture by visiting our LinkedIn Life page.
Diversity, Equity, Inclusion and Accessibility at TripleLift
At TripleLift, we believe in the power of diversity, equity, inclusion and accessibility. Our culture enables individuals to share their uniqueness and contribute as part of a team. With our DE&I initiatives, TripleLift is a place that works for you, and where you can feel a sense of belonging and support. At TripleLift, we will consider and champion all qualified applicants for employment without regard to race, creed, color, religion, national origin, sex, age, disability, sexual orientation, gender identity, gender expression, genetic predisposition, veteran, marital, or any other status protected by law. TripleLift is proud to be an equal opportunity employer.
Learn more about our DEI efforts at https://triplelift.com/diversity-equity-and-inclusion/
Privacy Policy
Please see our Privacy Policies on our TripleLift and 1plusX websites.
TripleLift does not accept unsolicited resumes from any type of recruitment search firm. Any resume submitted in the absence of a signed agreement will become the property of TripleLift and no fee shall be due.
