The Senior Data Engineer will design, develop, and implement data solutions, build and optimize data pipelines, and collaborate with teams to enhance data architecture and ensure data quality and integrity.
ProArch is seeking a talented and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and implementing data solutions that tackle complex business problems. You will play a pivotal role in building data pipelines, optimizing data workflows, and collaborating with cross-functional teams to enhance our data architecture. If you are passionate about data engineering and looking for an opportunity to make a significant impact, we would love to hear from you!
Key Responsibilities:
- Design, develop, and maintain robust data pipelines to support data processing and analytics needs.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and build solutions that meet business objectives.
- Optimize and enhance data workflows for performance and scalability.
- Implement data quality checks and validation processes to ensure data accuracy and integrity.
- Work with cloud platforms (AWS, Azure, Google Cloud) to leverage cloud-based data storage and analytics services.
- Assist in the overall data architecture strategy and best practices for the organization.
- 7+ years of experience in data engineering or related fields.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL database systems and NoSQL technologies.
- Hands-on experience with ETL tools and data pipeline orchestration (e.g., Apache Airflow, AWS Glue).
- Familiarity with data warehousing concepts and tools (e.g., Snowflake, Amazon Redshift).
- Experience with cloud infrastructure (e.g., AWS, Microsoft Azure, Google Cloud Platform).
- Ability to work collaboratively in a team environment and communicate effectively with technical and non-technical stakeholders.
- Strong problem-solving skills and attention to detail.
NA
Top Skills
Java
Python
Scala
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
SailPoint seeks a Senior Data Engineer to design and implement robust data ingestion and processing systems. Responsibilities include developing scalable data pipelines, integrating diverse data sources, leveraging AWS services, and using tools like Apache Airflow for orchestration. Candidates should have extensive experience in data engineering and relevant technologies.
Top Skills:
Apache AirflowAWSDockerFlinkKubernetesSpark
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Data Engineer at SailPoint will design and implement ELT processes for data ingestion and processing systems. Responsibilities include developing scalable data pipelines, collaborating with cross-functional teams, and utilizing AWS services to ensure efficient data solutions. The role requires strong adaptability and problem-solving skills in a dynamic environment.
Top Skills:
AWSDockerFlinkKubernetesSpark
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Senior Data Engineer will design, build, and measure complex ELT jobs for processing various data sources. They will work collaboratively on projects involving batch pipelines, data modeling, and data mart solutions to implement efficient data collection and processing pipelines that meet business needs.
Top Skills:
Data Modeling
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
