3Pillar Global Logo

3Pillar Global

Lead Data Engineer With Snowflake

Reposted 10 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
As a Lead Data Engineer, you will design and manage data pipelines, develop ETL processes, and ensure data quality. Mentorship of junior engineers is also part of the role.
The summary above was generated by AI
3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI.

Key Responsibilities:

  • Understanding the business requirements

  • Writing code and implementing the proposed solutions

  • Creating data pipelines, versioning and change management

  • Manage the complexity inherent in versioned data pipelines

  • Develop ETL/ELT processes to help extract and manipulate data from multiple sources.

  • Design, build and maintain batch or real-time data pipelines in production.

  • Automate data workflows such as data ingestion, aggregation, and ETL processing.

  • Logging and instrumentation of pipelines and services.

  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

  • Train and mentor junior engineers.

Job Description: Data Engineer

  • NoSQL-to-RDBMS Mapping: Flatten and normalize complex, nested JSON data from MongoDB into structured relational tables.
  • Pipeline Development: Build and manage reliable ETL pipelines to ingest data from MongoDB, process it via Snowflake, and load it into MySQL.
  • Database Optimization: Design, index, and tune target MySQL databases to ensure high performance and strict data integrity.
  • Snowflake Utilization: Leverage Snowflake's variant handling capabilities to efficiently stage, parse, and transform semi-structured data.
  • Technical Stack: Proficiency in MongoDB, MySQL, Snowflake SQL, good to have Python (including ETL frameworks like rivery or informatica).

What is it like working for 3Pillar Global?

    At 3Pillar, we offer a world of opportunity:

    • Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach. 

    • You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams. 

    • We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.

    • Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.

    • We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally. 

Benefits:

    At 3Pillar, we create an environment where people can do their best work while maintaining a healthy work-life balance.
     
     
  • Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best, while prioritizing your well-being and personal commitments.
  • Global Community – Collaborate with talented colleagues across the globe in a culture built on connection, support, and shared success.
  • Your Voice Matters – We foster open communication and multiple feedback channels, ensuring every employee has the opportunity to be heard and make an impact.
  • Growth & Development – Gain exposure to diverse clients, industries, and challenges that accelerate learning and career growth.
  • Our culture is guided by four core values: Collaboration, Outperform, Respect, and Evolve—the principles that shape how we work, grow, and succeed together.

Similar Jobs

An Hour Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build, and operate agentic LLM-powered workflows, autonomous agents, and RAG/vector retrieval systems. Own end-to-end delivery including CI/CD, IaC, observability, DevSecOps, and Salesforce integrations to productionize enterprise AI for GTM applications.
Top Skills: AgentcoreAgentforceAutogenAws BedrockCdkCopadoCrewaiDastDockerGithub ActionsGitopsJavaScriptJenkinsKubernetesLangchainLanggraphLightning Web ComponentsModel Context Protocols (Mcp)PgvectorPineconePlatform EventsPythonSalesforce ApexSastSemantic KernelService MeshSlackTerraformTypescriptVertex AiWeaviate
7 Hours Ago
Remote
India
Mid level
Mid level
Cloud • Information Technology • Productivity • Software • Automation
The Marketing Program Manager will build and execute a marketing plan for India, drive demand, manage budgets, and support global marketing initiatives while engaging with partners and stakeholders.
Top Skills: MarketoMS OfficeSfdc (Salesforce)
7 Hours Ago
Remote
India
Senior level
Senior level
Cloud • Information Technology • Productivity • Software • Automation
Technical leader designing and implementing scalable, fault-tolerant backend microservices and Agentic AI systems. Leads architecture, cloud infrastructure, data strategies, incident response, testing, and mentorship to deliver production-grade high-throughput solutions.
Top Skills: Agentic AiAnsibleAWSAzureChaos EngineeringCi/CdCloudFormationContainersDistributed CachingDjangoEksEvent StreamingFastapiFlaskGCPJavaKubernetesLlmsMessage QueuesNoSQLOpensearchPrompt EngineeringPythonRagSlisSlosSpring BootSQLTerraformVector Databases

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account