Pattern Logo

Pattern

Data Engineer

Posted 13 Days Ago
Be an Early Applicant
Pune, Maharashtra
Senior level
Pune, Maharashtra
Senior level
The Data Engineer will develop and support real-time data streams, ensure data quality, and collaborate with teams on data requirements while leading other engineers.
The summary above was generated by AI

Job Description:

Pattern values data and the engineering required to take full advantage of it.  As a Data Engineer at Pattern, you will be working on business problems that have a huge impact on how the company maintains its competitive edge.

Essential Duties and Responsibilities

  • Develop, deploy, and support real-time, automated, scalable data streams from a variety of sources into the data lake or data warehouse.
  • Develop and implement data auditing strategies and processes to ensure data quality; identify and resolve problems associated with large-scale data processing workflows; implement technical solutions to maintain data pipeline processes and troubleshoot failures.
  • Collaborate with technology teams and partners to specify data requirements and provide access to data. 
  • Tune application and query performance using profiling tools and SQL or other relevant query languages.
  • Understand business, operations, and analytics requirements for data
  • Build data expertise and own data quality for assigned areas of ownership
  • Work with data infrastructure to triage issues and drive to resolution

Required Qualifications

  • Bachelor’s Degree in Data Science, Data Analytics, Information Management, Computer Science, Information Technology, related field, or equivalent professional experience
  • Overall experience should be more than 7 + years
  • 3+ years of experience working with SQL
  • 3+ years of experience in implementing modern data architecture-based data warehouses
  • 2+ years of experience working with data warehouses such as Redshift, BigQuery, or Snowflake and understand data architecture design
  • Excellent software engineering and scripting knowledge
  • Strong communication skills (both in presentation and comprehension) along with the aptitude for thought leadership in data management and analytics
  • Expertise with data systems working with massive data sets from various data sources
  • Ability to lead a team of Data Engineers

Preferred Qualifications

  • Experience working with time series databases
  • Advanced knowledge of SQL, including the ability to write stored procedures, triggers, analytic/windowing functions, and tuning
  • Advanced knowledge of Snowflake, including the ability to write and orchestrate streams and tasks
  • Background in Big Data, non-relational databases, Machine Learning and Data Mining
  • Experience with cloud-based technologies including SNS, SQS, SES, S3, Lambda, and Glue
  • Experience with modern data platforms like Redshift, Cassandra, DynamoDB, Apache Airflow, Spark, or ElasticSearch
  • Expertise in Data Quality and Data Governance

Our Core Values

  • Data Fanatics: Our edge is always found in the data
  • Partner Obsessed: We are obsessed with partner success
  • Team of Doers: We have a bias for action
  • Game Changers: We encourage innovation

Pattern is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Top Skills

Apache Airflow
BigQuery
Elasticsearch
Glue
Lambda
Redshift
S3
Ses
Snowflake
Sns
Spark
SQL
Sqs

Similar Jobs

Yesterday
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
The role involves designing and delivering data solutions for credit risk models, collaborating with teams, and optimizing data processes. It requires strong data engineering skills to support complex analytics and ensure data quality for decision-making.
Top Skills: ExcelPythonSQL
3 Days Ago
Pune, Maharashtra, IND
Senior level
Senior level
Healthtech • Logistics • Pharmaceutical
As an Azure Cloud Data Engineer, you will maintain data infrastructure, build pipelines, analyze data, and collaborate with teams, enhancing data quality and modeling.
Top Skills: Azure AiAzure Analysis ServicesAzure Data FactoryAzure Logic AppsAzure SqlAzure Synapse AnalyticsData Blob StorageData Lake StorageETLMachine Learning ServicesMs Sql ServerPower BIPower Bi Premium
3 Days Ago
Hybrid
Mumbai, Maharashtra, IND
Mid level
Mid level
Financial Services
The role involves designing, analyzing, and delivering data for credit stress models, creating data pipelines, writing requirements, and collaborating with various stakeholders.
Top Skills: JIRAExcelPythonSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account