Develop and maintain data pipelines using AWS services, create data models, and optimize queries. Collaborate with teams to address data needs.
Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.
Mactores is seeking an AWS Data Engineer (Senior) to join our team. The ideal candidate will have extensive experience in PySpark and SQL, and have worked with data pipelines using Amazon EMR or Amazon Glue. The candidate must also have experience in data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, Presto, and orchestration experience using Airflow.
What you will do?
- Develop and maintain data pipelines using Amazon EMR or Amazon Glue.
- Create data models and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
- Build and maintain the orchestration of data pipelines using Airflow.
- Collaborate with other teams to understand their data needs and help design solutions.
- Troubleshoot and optimize data pipelines and data models.
- Write and maintain PySpark and SQL scripts to extract, transform, and load data.
- Document and communicate technical solutions to both technical and non-technical audiences.
- Stay up-to-date with new AWS data technologies and evaluate their impact on our existing systems.
What are we looking for?
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience working with PySpark and SQL.
- 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue.
- 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
- 1+ years of experience building and maintaining the orchestration of data pipelines using Airflow.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
- Ability to work independently and within a team environment.
You are preferred if you have
- AWS Data Analytics Specialty Certification
- Experience with Agile development methodology
Life at Mactores
We care about creating a culture that makes a real difference in the lives of every Mactorian. Our 10 Core Leadership Principles that honor Decision-making, Leadership, Collaboration, and Curiosity drive how we work.
1. Be one step ahead
2. Deliver the best
3. Be bold
4. Pay attention to the detail
5. Enjoy the challenge
6. Be curious and take action
7. Take leadership
8. Own it
9. Deliver value
10. Be collaborative
We would like you to read more details about the work culture on https://mactores.com/careers
The Path to Joining the Mactores Team
At Mactores, our recruitment process is structured around three distinct stages:
Pre-Employment Assessment:
You will be invited to participate in a series of pre-employment evaluations to assess your technical proficiency and suitability for the role.
Managerial Interview: The hiring manager will engage with you in multiple discussions, lasting anywhere from 30 minutes to an hour, to assess your technical skills, hands-on experience, leadership potential, and communication abilities.
HR Discussion: During this 30-minute session, you'll have the opportunity to discuss the offer and next steps with a member of the HR team.
At Mactores, we are committed to providing equal opportunities in all of our employment practices, and we do not discriminate based on race, religion, gender, national origin, age, disability, marital status, military status, genetic information, or any other category protected by federal, state, and local laws. This policy extends to all aspects of the employment relationship, including recruitment, compensation, promotions, transfers, disciplinary action, layoff, training, and social and recreational programs. All employment decisions will be made in compliance with these principles.
Note: Please answer as many questions as possible with this application to accelerate the hiring process.
Top Skills
Airflow
Amazon Athena
Amazon Emr
Amazon Glue
Amazon Redshift
AWS
Presto
Pyspark
Snowflake
SQL
Similar Jobs
Cloud • Information Technology • Security • Software
The Principal Software Engineer will tackle complex problems, drive architecture, mentor others, and build new technology initiatives across teams.
Top Skills:
AWSGCPGoIacKubernetesNode.js
Cloud • Security • Software • Cybersecurity • Automation
The Senior Developer Advocate at GitLab will engage developers through content creation, community interactions, technical demonstrations, and strategic initiatives, focusing on enhancing the developer experience with GitLab's platform.
Top Skills:
Ai ToolsDevsecops
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
As a Senior Backend Engineer, you will design and implement scalable backend solutions, mentor team members, and work cross-functionally with various teams to enhance product quality and performance.
Top Skills:
AnsibleDockerElasticsearchKubernetesMongoDBNoSQLRedisRestful ServicesRubyRuby On RailsSQLTerraform
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
