Design, build, and optimize end-to-end data pipelines and near-real-time integrations. Implement validation, monitor and troubleshoot systems, manage containerized microservices and Kubernetes deployments, collaborate with stakeholders, document designs, mentor team members, and support product upgrades and migrations.
Location: Pune
- Design, implement and optimize end-to-end data pipelines for ingesting, processing and transforming large volumes of structured and unstructured data.
- Develop data pipelines to extract and transform data in near real time using cloud native technologies.
- Implement data validation and quality checks to ensure accuracy and consistency.
- Monitor system performance, troubleshoot issues and implement optimizations to enhance reliability and efficiency.
- Collaborate with business users, analysts and other stakeholders to understand data requirements and deliver tailored solutions.
- Document technical designs, workflows and best practices to facilitate knowledge sharing and maintain system documentation.
- Provide technical guidance and support to team members and stakeholders as needed.
- Identify problems and recommend appropriate solutions for WSI in a wide variety of circumstances.
- Take an active role in developing effective, scalable and maintainable code in a timely fashion and participate in design and code reviews.
- Maintains a manner of leadership and flexibility that diffuses pressure and promotes a positive environment.
- We're a successful, fast-growing company with an entrepreneurial vibe
- A technologically and data-driven business
- Competitive salaries and comprehensive health benefits
- We're at the forefront of tech and retail, redefining technology for the next generation
- We're passionate about our internal and external clients and live/breathe the client experience
- We get to be creative on a daily basis
- A smart, experienced the leadership team that wants to do it right and is open to new ideas
- We believe in autonomy and reward taking the initiative •We have fun!
We're excited about you because you have...
- Experience in development of Web & Enterprise applications in Python language
- Experience in building containerized microservices using Python frameworks, Django, Flask etc.
- Experience in Bash/Shell scripting and Hands-On in Linux Environment
- Experience in integration technologies like Kafka (Distributed Messaging Systems), REST APIs and Webservices.
- Expertise in troubleshooting integration issues involving SSL, firewalls, proxies, load balancers and LDAP
- Experience in managing applications in Kubernetes, Docker and Helm
- Proficiency in working with Oracle/MySQL/graph databases.
- Good to have understanding of Elastic/Open Search applications. Should be comfortable in analysing data, scripting and the desire to learn the rest of our stack.
- Good to have understanding of CI/CD Pipeline functionality.
- Good to have exposure in Redis and monitoring tools such as AppDynamics, Nagios and Grafana.
- Familiarity with Unix/AIX environments and monitoring tools.
- Experience in planning and managing product upgrades and migrations.
- Strong problem-solving, analytical and team collaboration skills.
Desirable Competencies
- Bachelor’s degree or foreign equivalent in Computer Science, Engineering or related field
- 5+ years of progressively responsible experience in software engineering
- 3+ years of data engineering or equivalent experience.
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves managing finance change, regulatory reporting, project management, and software testing, requiring extensive experience in financial services and team leadership.
Top Skills:
Automation Testing ToolsExcelSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Manage projects in the transaction banking sector with an emphasis on compliance and retail payments, using Agile methodologies and strong stakeholder management.
Top Skills:
ConfluenceIso20022JIRA
.png){kind=logo}
Artificial Intelligence • Edtech • Mobile • Natural Language Processing • Productivity • Software
The IT Systems Engineer II will design, automate, and manage scalable IT infrastructure while collaborating across teams to ensure operational excellence in cloud and on-prem environments.
Top Skills:
AnsibleAWSBashCloudFormationGCPGithub ActionsGitlabGrafanaJenkinsPowershellPrometheusPythonTerraform
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
