Design, develop, and maintain scalable store procedures, manage data workflows, implement CI/CD pipelines, and collaborate with teams to deliver data solutions.
Job Description:
Key Responsibilities:
- Design, develop, and maintain scalable store procedures using SQL, Python, and Snowflake.
- Leverage Flyway for database version control and schema migration across multiple environments.
- Build and manage data orchestration workflows using tools such as Apache Airflow, Prefect, or similar frameworks.
- Implement robust CI/CD pipelines using Bitbucket Pipelines for deployment and automation of data engineering tasks.
- Optimize and monitor data workflows to ensure performance, reliability, and scalability.
- Work with AWS services like S3, Lambda and RDS for cloud-based data engineering tasks.
- Collaborate with Data Analysts, Scientists, and other Engineers to understand requirements and deliver reliable data solutions.
- Maintain documentation of data flows, architecture, and technical standards.
- Ensure data quality, security, and compliance with organizational and regulatory standards.
Required Skills:
- SQL: Advanced skills for data extraction, transformation, and optimization.
- Python: Strong experience in data processing, scripting, and automation.
- Snowflake: Deep knowledge of Snowflake architecture, performance tuning, and best practices.
- Flyway: Proven experience in managing database migrations and versioning.
- AWS: Hands-on experience with cloud data services (S3, Lambda, Glue, etc.).
- Orchestration Frameworks: Experience with Airflow, Prefect, or similar tools.
- CI/CD: Experience in setting up and managing Bitbucket Pipelines or equivalent.
- Strong problem-solving, debugging, and analytical skills.
- Excellent communication and collaboration abilities.
Location:
DGS India - Bengaluru - Manyata H2 blockBrand:
MerkleTime Type:
Full timeContract Type:
PermanentTop Skills
Apache Airflow
AWS
Bitbucket Pipelines
Flyway
Prefect
Python
Snowflake
SQL
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Software Engineer will build a cloud-based SaaS identity analytics product using Java microservices, collaborating on designs, code reviews, and testing while ensuring high code quality.
Top Skills:
AWSJava
Enterprise Web • Fintech • Financial Services
The Senior Software Engineer will develop enterprise and web applications, focusing on scalability, agile practices, and enhancing performance. They will work on Java, cloud solutions, and various databases, while ensuring quality and reliability through testing and continuous integration.
Top Skills:
AWSJ2EeJavaKafkaLinuxMs SqlMySQLNoSQLPostgresRabbitMQSpringSpring BootUnix
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Seeking a Senior UI Engineer to create scalable UIs for the Identity Graph product using React and TypeScript, while mentoring engineers and collaborating with teams.
Top Skills:
CanvasCypressDockerGraphQLKubernetesReactTailwindTypescriptVitest
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
