As a Senior Data Engineer, you'll analyze data integrity, create scalable solutions, mentor peers, and engage in agile development, focusing on backend services using Python and Snowflake.
🌟 Accomplished Tech Visionary:
Elevate your expertise to new heights at 3Pillar, the premier destination for trailblazing senior software engineers like yourself. Picture collaborating with industry leaders, spearheading transformative projects that redefine urban living, establishing new media channels for enterprise companies, or driving innovation in healthcare. Our mission is to revolutionize the tech landscape, and your skills are integral to achieving this ambitious goal.
Your role extends beyond the realm of code composition; you will architect transformative solutions that reshape entire industries. Join us and spearhead the charge toward a tech future that transcends the ordinary. 🔮🌐
Key Responsibilities:
- Primarily responsible for analyzing data integrity challenges including investigating, correcting, and monitoring data to help identify and address key data issues. Must be comfortable remedying data integrity issues and identifying root cause analysis by going through the code.
- Facilitate effective communication with client project stakeholders regarding project status and recommendations.
- Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality.
- Actively participate in accurate planning and estimation efforts, utilizing project methods and tools.
- Proficiently gather requirements and organize/present developed features for clients.
- Execute complex activities within the current methodology and quality standards, showcasing success across diverse engagements.
- Promote client success across the team by collaborating with engineers, designers, and managers to understand user pain points, anticipate potential problems, and iterate on solutions that drive client success.
- Engage in agile software development, including daily stand-ups, sprint planning, team retrospectives, and other governance activities.
- Actively participate in the Engineering Practice community, mentoring others through Communities of Practice (CoPs) or on project teams, and supporting the growth of technical capabilities.
- Independently drive project delivery within defined architecture, demonstrating autonomy and accountability in all stages from conceptualization to deployment.
Minimum Qualifications:
- Should have worked as Data Engineer for atleast 5 years
- Must have atleast 3 years of experience in Snowflake Datawarehouse, SnowPipe, Snowpark and related services
- Experience/expertise in the following areas specified below:
- Design and implement scalable backend services and APIs using Python
- Collaborate with cross-functional teams to define and execute on technical requirements
- Optimize system performance and troubleshoot issues
- Stay updated with the latest Python and SQL to drive continuous improvement Must-Have Skills & Tools:
- Languages: SQL, Python
- Skills/Responsibilities: MS SQL Server, Snowflake (data warehouse), Hevo / dbt
- Tools: Jira, Bitbucket, Slack/Teams Good to Have Skills:
- Languages: Javascript
- Skills/Responsibilities: Dynamo DB, AWS Services, Rockset (analytical engine)
- Experience in Agile software development methodologies.
- Expertise in working with SQL and SQL MS Server
- Experience in creating and implementing well-tested, scalable, and performant enterprise-level systems.
- Practice and initiative mentoring other engineers and decision-makers throughout the organization.
- Proficiency in the English language.
Additional Experience Desired:
- Ability to optimize backend performance and troubleshoot issues.
- Familiarity with modern frontend build tools and CI/CD pipelines.
- Excellent problem-solving skills and a proactive attitude towards challenges.
- Strong verbal and written communication skills.
- Professional software engineering experience, working on multi-discipline teams
- Experience in backend development with expertise in node.js
- Proficiency in designing and implementing RESTful APIs and microservices architecture.
- Good knowledge of AWS services like Lambda, API Gateway, DynamoDB/RDS, and S3.
- Experience with containerization using Docker and orchestration with Kubernetes (optional).
- Excellent problem-solving skills and a proactive attitude towards challenges.
- Object-Relational Mappers (ORMs)
- Architectural (Microservices, Serverless etc) and Design (Factory, Singleton, Observer etc) Patterns
- Unit Testing
What is it like working for 3Pillar Global?
At 3Pillar, we offer a world of opportunity:
Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach.
You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.
Join us and be a part of a global tech community! 🌍💼 Check out our Linkedin site and Careers page to learn more about what it’s like to be part of our #oneteam!
#LI-Remote
Top Skills
Bitbucket
Dbt
Hevo
JIRA
Ms Sql Server
Python
Slack
Snowflake
SQL
Teams
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
As a Backend Engineer, you will design and maintain a Go-based instrumentation service, manage data integrity for usage billing, and support teams in instrumenting features effectively.
Top Skills:
GoGrpcRestRuby On Rails
Cloud • Security • Software • Cybersecurity • Automation
As an Intermediate Backend Engineer, you will design and maintain a Go-based instrumentation service, ensuring data quality and aiding product teams in feature instrumentation.
Top Skills:
GoGrpcRestRuby On Rails
Cloud • Security • Software • Cybersecurity • Automation
The Engineering Manager will lead the AI Governance team, focusing on compliance and security in GitLab's software development lifecycle, overseeing roadmap execution and team growth.
Top Skills:
Ai Agent InfrastructureAudit SystemsCompliance ToolingEvent StreamingLarge Language Model OrchestrationModel Context Protocol ToolingPolicy Enforcement
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
