3Pillar Global Logo

3Pillar Global

Senior Data Engineer( Snowflake , Azure)

Reposted 17 Days Ago
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Design, build, and maintain batch and real-time ETL/ELT data pipelines and workflows. Automate ingestion, aggregation and logging; ensure data accuracy, security, and compliance. Implement data warehouse and lake solutions, mentor junior engineers, and collaborate with stakeholders to meet business requirements.
The summary above was generated by AI
3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI
 

Key Responisiobilities

  • Understanding the business requirements

  • Writing code and implementing the proposed solutions

  • Creating data pipelines, versioning and change management

  • Manage the complexity inherent in versioned data pipelines

  • Develop ETL/ELT processes to help extract and manipulate data from multiple sources.

  • Design, build and maintain batch or real-time data pipelines in production.

  • Automate data workflows such as data ingestion, aggregation, and ETL processing.

  • Logging and instrumentation of pipelines and services.

  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

  • Train and mentor junior engineers.

Minimum Qualifications

  • Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role

  • Advanced SQL skills and experience with relational databases and database design.

  • Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).

  • Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries

  • Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc

  • Proficiencient in data pipeline and workflow management tools e.g. Airflow

  • Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc

  • Experience with the AWS/Azure/GCP data engineering services

  • Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM

  • OR

  • Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB

  • Very good exposure of working on Data Lakes & Data Warehouses solutions

  • Excellent problem-solving, communication, and organizational skills.

  • Proven ability to work independently and with a team.

  • Ability to guide other data engineers.

Additional Experience

  • Experience working with data ingestion tools such as Fivetran, stitch, or Matillion.

  • Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.

  • Familiarity with machine learning technologies.

  • Experience in Java or Scala

What It's Like to Work at 3Pillar:
At 3Pillar, we create an environment where people can do their best work while maintaining a healthy work-life balance.
  • Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best, while prioritizing your well-being and personal commitments.
  • Global Community – Collaborate with talented colleagues across the globe in a culture built on connection, support, and shared success.
  • Your Voice Matters – We foster open communication and multiple feedback channels, ensuring every employee has the opportunity to be heard and make an impact.
  • Growth & Development – Gain exposure to diverse clients, industries, and challenges that accelerate learning and career growth.

Our culture is guided by four core values: Collaboration, Outperform, Respect, and Evolve—the principles that shape how we work, grow, and succeed together.

Similar Jobs

19 Minutes Ago
Remote or Hybrid
India
Senior level
Senior level
Digital Media • Information Technology • News + Entertainment
Designs and tests IP network implementations while providing expert technical support, operational guidance, real-time network analysis, and solution testing. Performs manual testing of Cisco routing and switching technologies, particularly Cisco IOS-XR platforms. Uses networking protocols and services including IP/MPLS, OSPF, IS-IS, BGP, Segment Routing, VPNs, and QoS. Automation, traffic-generation tools, troubleshooting, communication, and networking certification are important parts of the role.
Top Skills: AsrBgpCcnpCiscoCisco Ios-XrF5FortinetGitHuaweiIp/MplsIs-IsIxiaJSONL2/L3 VpnsNcsNetconf-YangNokiaOspfPythonQosSegment RoutingSpirentXML
Yesterday
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Design, review, and optimize high-reliability power distribution and substation systems for semiconductor fabs. Produce SLDs, sizing calculations, system studies, grounding/earthing, protection coordination, and commissioning support. Integrate SCADA/BMS, ensure compliance with standards, manage vendors/contractors, and support procurement, FAT/SAT, and energization.
Top Skills: AisArc Flash AssessmentAutocadAutocad ElectricalBimBmsChatgptClaudeCo-PilotEtapFmcsGeneratorsGisHarmonic FiltersLlmsProtection RelaysRevitRmuScadaSkm Power ToolsSwitchgearTransformersUpsVfd
Yesterday
Easy Apply
In-Office or Remote
Easy Apply
Senior level
Senior level
Cloud • Information Technology • Security • Software
Provide Tier 2 technical support for complex Windows and Active Directory integration issues in a SaaS environment. Troubleshoot escalations using logs, network traces, memory dumps, and structured testing; communicate technical causes and resolutions to enterprise customers and executives. Collaborate with engineering, product, account management, and customer success teams, mentor peers, maintain knowledge-base content, improve diagnostic workflows, and participate in an on-call rotation.
Top Skills: Active DirectoryAPIsAWSAzure Active DirectoryCredential ManagerGoogle SuiteLdapOktaPktmonPowershellRadiusScimSlackSsoSysinternalsWindowsWiresharkXpath

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account