At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
Minimum Qualifications
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
- Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
- Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
- Proficiencient in data pipeline and workflow management tools e.g. Airflow
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
- Experience with the AWS/Azure/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
- OR
- Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
- Very good exposure of working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Ability to guide other data engineers.
Similar Jobs
Database
The Senior AWS Data Engineer will develop and maintain data pipelines, create data models, and ensure efficient data orchestration using AWS services and tools. Collaborating with teams, the engineer will optimize data processes and communicate solutions effectively.
Top Skills:
AirflowAmazon AthenaAmazon EmrAmazon GlueAmazon RedshiftAWSPrestoPysparkSnowflakeSQL
Database
Develop and maintain data pipelines using AWS services, create data models, and optimize queries. Collaborate with teams to address data needs.
Top Skills:
AirflowAmazon AthenaAmazon EmrAmazon GlueAmazon RedshiftAWSPrestoPysparkSnowflakeSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Tech Business Analyst will define data requirements, manage data migration processes, and ensure stakeholder communication to drive successful project delivery.
Top Skills:
AgileCmdHiveJavaNote++PuttyPysparkPythonScalaSQLTdd
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
