Develop and optimize data pipelines and transformations on AWS, participate in proofs of concept for data patterns, enhance existing feeds, and work with streaming, ETL/ELT tools and databases.
Job description
This individual will be part of the data engineering team working on the development of data pipelines, transformations of data, participation in proof of concept of new data patterns, optimization of existing data feeds and enhancements.
Primary skills:
- RDBMS Concepts
- Strong hands-on experience on AWS Cloud platform and Services (IAM, EC2, Lambda, RDS, Timestream, Glue etc)
- Data streaming tools like Kafka
- Hands on experience of ETL/ELT tools
- Understanding of Snowflake/Postgress or any database
Nice to Have:
- Understanding of data modelling techniques would be preferred.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead a distributed SRE team owning CI/CD platform reliability, automation, observability, and data infrastructure. Provide people management, technical direction, architecture input, operational excellence, and cross-team collaboration while driving automation, monitoring, and AI-assisted workflows.
Top Skills:
AnsibleApache AirflowSparkAWSAzureBashBazelBitbucketChefDatadogGCPGitGithub ActionsGitlabGitlab CiGoGrafanaHumio/LogscaleJenkinsKafkaKubernetesNasNfsObject StorageOpensearchOraclePostgresPowershellPrometheusPulsarPuppetPythonRedisRedpandaSanSli/SloSplunkTerraformValleyVarnish
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
The Sr. Engineer, Knowledge Engineering will design and implement ontologies and knowledge graphs, enabling AI models to reason over enterprise spend data.
Top Skills:
ElasticsearchJson-LdNeo4JNeptuneOwlPythonRdf
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves managing finance change, regulatory reporting, project management, and software testing, requiring extensive experience in financial services and team leadership.
Top Skills:
Automation Testing ToolsExcelSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
