Pattern Logo

Pattern

Senior Data Engineer

Posted 9 Days Ago
Be an Early Applicant
Pune, Mahārāshtra
Senior level
Pune, Mahārāshtra
Senior level
Develop and implement scalable data pipelines and data quality processes, collaborating with technology teams to manage large datasets effectively.
The summary above was generated by AI

Job Description:

Pattern is a leading eCommerce data and growth company located in the Silicon Slopes tech hub with global offices in Europe, China, Australia, the Middle East, and Canada. Named one of the fastest-growing companies in the US by Inc. 500, Pattern has made its mark in the industry. Some of the biggest consumer brands like Skullcandy, Nestle, Clorox, Kong, Panasonic, Tumi, and PopSockets trust Pattern with their business. Pattern has recruited talent from brands like Amazon, eBay, Adobe, Pepsico, Apple, Google, and Oracle. 

Pattern values data and the engineering required to take full advantage of it. As a Data Engineer at Pattern, you will be working on business problems that have a huge impact on how the company maintains our competitive edge.

Essential Duties and Responsibilities

  • Develop, deploy, and support automated, scalable real-time and batch data streams from a variety of sources into the lakehouse.
  • Develop and implement data auditing strategies and processes to ensure data quality; identify and resolve problems associated with large scale data processing workflows; implement technical solutions to maintain data pipeline processes and troubleshoot failures
  • Collaborate with technology teams and partners to specify data requirements and provide access to data 
  • Tune application and query performance using profiling tools and SQL or other relevant query language
  • Translate business and analytics requirements for data to a comprehensive data model and pipelines
  • Foster data expertise and own data quality for assigned areas of ownership
  • Work with data infrastructure to triage issues and drive to resolution

Required Qualifications

  • Bachelor’s Degree in Data Science, Data Analytics, Information Management, Computer Science, Information Technology, related field, or equivalent professional experience
  • Overall experience should be more than 7 + years
  • 3+ years of experience working with SQL and Python
  • 3+ years of experience in implementing data pipelines using modern data architectures
  • 2+ years of experience working with data warehouses such as Redshift, BigQuery, Snowflake, or similar
  • Experience with open-source based data architectures: Spark, Hive, Trino / Presto or similar
  • Excellent software engineering and scripting knowledge
  • Strong communication skills (both in presentation and comprehension) along with the aptitude for cross-collaboration across data management and analytics domains
  • Expertise with data systems working with massive data volumes from various data sources
  • Ability to lead a team of Data Engineers

Preferred Qualifications

  • Experience working with time series databases
  • Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and tuning
  • Advanced knowledge of Snowflake, including the ability to write and orchestrate streams and tasks
  • Background in Big Data, non-relational databases, Machine Learning and Data Mining is a plus
  • Experience with cloud-based technologies including SNS, SQS, SES, S3, Lambda, and Glue
  • Experience with modern data platforms like Redshift, Cassandra, DynamoDB, Apache Airflow, Spark, or ElasticSearch
  • Expertise in Data Quality and Data Governance

Our Core Values

  • Data Fanatics: Our edge is always found in the data
  • Partner Obsessed: We are obsessed with partner success
  • Team of Doers: We have a bias for action
  • Game Changers: We encourage innovation

Why Pattern?

  • The company is a rocket ship experiencing phenomenal growth
  • We have tailwinds and a long runway; we’re barely scratching the surface
  • We have big opportunities that will get you energized and excited
  • Great benefits including time off, insurance, competitive pay

Pattern provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability, status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Pattern is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Top Skills

Amazon S3
Amazon Ses
Amazon Sns
Amazon Sqs
Aws Glue
Aws Lambda
BigQuery
Hive
Python
Redshift
Snowflake
Spark
SQL
Trino

Similar Jobs

Senior level
Fintech • Financial Services
Lead data integration and warehousing through complex ETL processes, optimizing T-SQL queries, and ensuring data integrity while collaborating with stakeholders to fulfill enterprise data needs.
Top Skills: Amazon RdsAzure Data FactoryAzure SqlPowershellPythonSQLSQL ServerSql Server Data ToolsSql Server Management StudioSsisT-SqlVisual Studio
16 Days Ago
Pune, Mahārāshtra, IND
Senior level
Senior level
Fintech • Financial Services
The Senior Data Engineer designs and develops data pipelines, implements CI/CD, optimizes data storage, and ensures data quality while collaborating with various teams.
Top Skills: AWSAzureGCPGitHadoopHiveImpalaJavaJenkinsOraclePysparkPythonScalaSpark
18 Days Ago
5 Locations
Senior level
Senior level
Artificial Intelligence • Consulting
The Senior Data Engineer will innovate, build, and maintain technology services, focusing on large-scale data engineering projects using Azure technologies and software engineering principles.
Top Skills: AzureAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure Dev OpsAzure SqlHd InsightsMl ServicePysparkPythonSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account