Design, build, and maintain scalable data pipelines and ETL/ELT solutions using Microsoft Azure Fabric, Databricks, and Azure data services. Translate business requirements into technical solutions, optimize data workflows for performance and cost, troubleshoot production issues, and collaborate with architects, analysts, developers, and global stakeholders. Use AI-assisted development and automation to improve engineering productivity while owning delivery quality, timelines, and outcomes.
This role is for one of Weekday’s clients
Min Experience: 5+ years
Location: India
JobType: full-time
This is a full-time Remote role for an experienced Data Engineer who enjoys solving complex data problems and takes ownership from design through delivery. You can work from home (anywhere in INDIA, job location is in India).
This role is ideal for someone who can build scalable data pipelines on Microsoft Azure Fabric, leverage AI to improve engineering productivity, and work closely with business and technical stakeholders.
Requirements
Qualifications:
- 5+ years of hands-on experience as a Data Engineer.
- Strong experience with Microsoft Azure Fabric, Databricks and Azure data services.
- Solid knowledge of SQL and data modeling concepts.
- Experience building enterprise-grade data pipelines and data integration solutions.
- Proficiency in Python, Spark, or similar technologies is preferred.
- Experience working with cloud-based data platforms in production environments.
Key Skills:
- Design, develop, and maintain scalable data pipelines using Microsoft Azure Fabric.
- Build reliable ETL/ELT processes for structured and unstructured data.
- Work with business teams to understand data requirements and translate them into technical solutions.
- Optimize data processing workflows for performance, scalability, and cost.
- Apply AI-assisted development tools and modern engineering practices to improve delivery speed and solution quality.
- Troubleshoot production issues and proactively identify improvements.
- Collaborate with architects, analysts, and developers throughout the project lifecycle.
- Owns their work. Take responsibility for quality, timelines, and outcomes without constant follow-up.
- Thinks beyond the obvious. Actively use AI and automation to solve problems, improve engineering productivity, and deliver better solutions.
- Communicates proactively. Raise risks early, ask questions when something isn't clear, and keep stakeholders informed.
- Adapts quickly. Requirements evolve, and you're comfortable adjusting priorities while maintaining delivery commitments.
- Works collaboratively. Available to engage with global teams and can overlap with the U.S. East Coast during critical discussions (up to 1:00 PM ET, as needed).
Must-have skills
Databricks, Fabric, Data Engineering
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and optimizes scalable data ingestion pipelines for product telemetry and enterprise business data. Builds automated pipelines using Fivetran, Python, APIs, S3 lakehouse architectures, Kafka, Spark, and Snowflake. Applies advanced SQL, incremental loading, CDC, micro-batching, and rate-limit handling to support reliable, analytics-ready datasets. Implements CI/CD and DevOps practices, monitors pipeline performance, and partners with analysts and platform teams to rapidly deliver data solutions.
Top Skills:
Amazon S3SparkBulk ApisCdcCi/CdDevOpsFivetranKafkaPythonSnowflakeSQLVersion Control
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build, and operate Atlassian’s foundational data platform, including Flink streaming ingestion and MPP query systems such as StarRocks. The role owns architecture, production reliability, performance, cost, data quality, observability, code reviews, complex problem resolution, cross-team initiatives, and mentoring. Candidates need strong distributed-systems and data-engineering expertise, coding skills in Java, Scala, or Python, cloud infrastructure experience, and operational experience with high-scale platforms.
Top Skills:
Apache DorisApache FlinkApache PinotSparkAWSGCPJavaPythonScalaStarrocksTrino
Healthtech • Pharmaceutical
Designs, builds, and operationalizes scalable enterprise data solutions using Azure, Databricks, PySpark, and SQL. Responsibilities include architecting data pipelines, modeling lakehouse layers, automating integrations and testing, optimizing workloads, managing metadata and governance, and enabling BI and advanced analytics. The role leads technical reviews, mentors engineers, gathers stakeholder requirements, supports self-service analytics, and contributes to data platform roadmaps while ensuring compliance with GxP, HIPAA, and GDPR.
Top Skills:
SparkAPIsArmAzure Data CatalogueAzure Data FactoryAzure Data Lake Storage Gen2Azure DevopsAzure FabricAzure SqlBicepCi/CdData LakesData WarehousesDatabricksGitJSONLookerAzurePower BIPysparkRestSQLTableauTerraform
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
