The role involves designing and managing data pipelines, utilizing cloud services, writing SQL/DBT queries, and building reports in Power BI, while ensuring data governance.
Job Title: Data Engineer Location : Hyderabad
Client: Accenture
Experience: 5+ Years
Job Summary:
Data Engineering Job Responsibilities
- An ideal person with the data engineering skills : Snowflake, AWS (API Gateway, Lambda, IAM, S3, SNS, SQS etc.), DBT and Terraform along with Power BI skills.
- ETL/Pipeline management which are implemented in lambda functions ingesting data from different on prem, SaaS applications etc.
- Expert in SQL and primarily working on writing/modifying the complex SQL.
- Manage the tables (creating and updating them) in snowflake, DDL,DML queries of DBT in snowflake.
- Python knowledge to data processing, manipulations, managing large data sets, data transformations, connecting to APIs for data ingestions.
- Building visualizations in Power BI, enhancing the existing built.
- Proactive learner to learn Bain’s tool set and newer industry tools.
- Data governance knowledge is a plus.
Key Skills & Requirements
- 3+ years building/supporting SQL-based data pipelines (Snowflake, MSSQL or similar) including data modeling, complex analysis, support and performance-improvement activities.
- 2+ years of experience with Power BI including DAX, data modeling, report performance optimization.
- 2+ years of programming experience with Python with a focus on data engineering related tools.
- 3+ years of hands-on cloud experience building and maintaining data, compute and pipeline infrastructure (including 1+ years AWS experience)
- Prior experience with CICD tools (e.g. CDK, Terraform, GitHub Actions etc).
- Experience with DBT, Terraform and Octopus is a plus.
- Hands-on experience building and optimizing ‘big data’ pipelines and data sets is a plus.
- QUALIFICATIONS
- Bachelor’s Degree in Computer Science, Information Systems, or related field.
- 5+ years of hands-on technical experience in data engineering or software engineering
- Motivated self-starter capable of working in a fast-paced, dynamic and cross-functional environment, where multiple conflicting objectives need to be prioritized and achieved.
- Proven experience building and executing technical project plans, defining the scope of work, driving code quality, providing meaningful code reviews.
- Takes ownership and pride in end-to-end delivery of projects and initiatives eager to continue learning and excited to tackle complex problems
- Reliable and collaborative team member with experience mentoring and growing team members technically.
- Strong analytical skills, attention to detail, and a problem-solving mindset essential for handling complex data sets.
- Exceptional interpersonal skills with the ability to communicate complex technical concepts to non-technical stakeholders effectively.
- Prior experience in Finance and Asset management domain is a plus but not required.
Top Skills
Api Gateway
AWS
Dbt
Iam
Lambda
Power BI
Python
S3
Snowflake
Sns
SQL
Sqs
Terraform
Similar Jobs
Healthtech • Logistics • Pharmaceutical
The Azure Data Engineer will monitor data pipelines, optimize workflows, collaborate with teams, and implement monitoring tools in Azure for data processing.
Top Skills:
Azure Data FactoryAzure DevopsAzure Log AnalyticsBlob StorageDatabricksDebeziumEvent HubsKusto Query LanguagePower BIPythonSQLStream AnalyticsSynapse
Cloud • eCommerce • Logistics • Software
The Senior DBA / Data Engineer at Cin7 will design and manage data infrastructure, optimize performance, and develop ETL pipelines in Azure environments.
Top Skills:
Azure Data FactoryAzure SqlAzure Synapse AnalyticsCosmos DbDatabricksMicrosoft Fabric DataflowsMicrosoft Sql ServerPowershellPythonTerraform
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Lead projects using cloud technologies, ensure scalable solutions, mentor team members, and facilitate client interactions to drive innovation and project success.
Top Skills:
AWSAzureCloud TechnologiesDatabricksGCPPower BIRedshiftSalesforceSnowflake
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.