We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer will lead the data engineering team, architecting solutions and driving complex data projects to enhance operational data quality and support business decisions.
Top Skills:
AirflowAthenaAWSEmrFlinkHiveKafkaRedshiftSparkSQL
Artificial Intelligence • Big Data • Cloud • Generative AI
Lead design and delivery of AWS Data Lakehouse solutions using Medallion architecture. Architect and automate cloud infrastructure, optimize Redshift/Glue performance and costs, enforce data governance and quality, implement CDC/ETL pipelines, and liaise with Data Science/BI and business stakeholders. Mentor engineers and drive technical roadmap and migrations.
Top Skills:
Amazon AthenaAmazon RedshiftAmazon S3Apache AirflowAws DmsAws GlueAws Glue Data QualityAws Glue DatabrewAws Lake FormationAws Step FunctionsDbtDockerGithub ActionsIamMicrosoft FabricOpenlineageParquetPower BIPower Bi EmbeddedPysparkPythonRedshift ServerlessSnowflakeSQLTerraform
Agency • Artificial Intelligence • HR Tech • Professional Services
Build and maintain BigQuery data pipelines, map warehouse schemas, and craft SQL to feed LLMs. Develop Claude Skills and Gemini Gems, collaborate on prompts, validate AI outputs, and design AI agents to automate eCommerce analytics and operational workflows.
Top Skills:
Claude (Claude CodeClaude Co-WorkGemini (Gems)Google BigqueryJavaScriptJSONNumpyPandasPythonSkills)SQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
