As a Senior Data Engineer at 3Pillar, you'll leverage advanced data technologies to enhance data analytics projects, supporting analytics that give clients a competitive edge. Your role will include designing data systems and guiding a team of engineers.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
Minimum Qualifications
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
- Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
- Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
- Proficiencient in data pipeline and workflow management tools e.g. Airflow
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
- Experience with the AWS/Azure/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
- OR
- Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
- Very good exposure of working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Ability to guide other data engineers.
Top Skills
Python
SQL
Similar Jobs
Be an Early Applicant
Lead the development and delivery of end-to-end data and analytics solutions for insurance business functions, focusing on claims, customer engagement, and risk management. Collaborate with business and tech teams to create scalable AI solutions, manage the product life cycle, and mentor team members.
The Senior Data Scientist will collaborate with cross-functional teams to apply technical expertise in quantitative analysis and experimentation to develop business strategies. They will create insights to enhance products, measure success through metrics, and influence strategy decisions based on data-driven recommendations.
Be an Early Applicant
The Senior Analyst will collaborate with EMEA Actuarial teams and IT to develop actuarial models, define data requirements, and produce timely actuarial results contributing to MetLife's financials. This role emphasizes stakeholder engagement and data analysis.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
