Design and develop distributed systems and large-scale streaming data pipelines using cloud technologies (AWS, Snowflake, Kafka). Build cloud-native, containerized applications (Kubernetes/OpenShift/EKS) and write maintainable code in Java/Scala/Python/Go. Communicate effectively and adapt to new languages and concepts.
- 6+ years in software engineering, with strong fundamentals in distributed systems design and development
- Experience creating large scale data processing pipelines for streaming and computing with data technologies such as any of the following: AWS, Snowflake (or any Relational Database), Kafka
- Good working knowledge of containers (Kubernetes/OpenShift/EKS or similar) and experience building cloud native applications that run on containers.
- Proficiency in at least one of the following programming languages: Java, Scala, Python, Go.
- Enthusiasm and ability to pick up new languages and concepts as necessary.
- Ability to communicate thoughtfully, demonstrating problem-solving skills and a learning mentality to build long-term relationships.
- Experience writing well structured, quality code that’s easily maintainable by others.
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a data engineering team, managing projects, collaborating with stakeholders, improving data quality, and mentoring engineers. Drive innovation and technical excellence in data products.
Top Skills:
Amazon Web ServicesDatabricksDynamoDBElasticsearchPythonS3SparkSpark-StreamingTableau
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer will lead the data engineering team, architecting solutions and driving complex data projects to enhance operational data quality and support business decisions.
Top Skills:
AirflowAthenaAWSEmrFlinkHiveKafkaRedshiftSparkSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a 50-70 person engineering organization to modernize Atlassian's Commerce Platform into a unified, multi-modal billing and monetization engine. Own architecture, reliability, and financial integrity of billing and finance integrations (including Stripe). Drive AI-native features, enterprise-grade commerce capabilities, and zero-error operational excellence while influencing C-level stakeholders on roadmap and execution.
Top Skills:
AIAutomated TestingMachine LearningStripe
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
