The Data Engineer will create and maintain data pipeline architectures, build infrastructure for data extraction and transformation, and work with stakeholders to optimize data delivery. They will ensure data reliability, quality, and governance while utilizing big data tools and managing large datasets.
Company Description
Devoteam is a leading consulting firm focused on digital strategy, tech platforms and cybersecurity. By combining creativity, tech and data insights, we empower our customers to transform their business and unlock the future.
With 30 years of experience and more than 11,000 employees across Europe, the Middle East and Africa, Devoteam promotes responsible tech for people and works to create better change.
Creative tech for Better Change.
http://www.devoteam.com
Job Description
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep data separated and secure across national boundaries through multiple data centers and regions.
- Identify ways to improve data reliability, efficiency, and quality
- Ensure data availability and accessibility by the right parties
- Guarantee data pipelines adhere to data governance practices
Qualifications
- 3 years of experience in data warehousing and big data projects.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing ‘big data’ data pipelines
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- A successful history of manipulating, processing, and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Experience in Informatica & Data Quality (Informatica Powercenter and Informatica Data quality Certifications is a plus)
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases
- Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc.
- Fluent in English & Arabic
Additional Information
This role requires flexibility in mobility, allowing individuals to work interchangeably between Tunis and Riyadh (Saudi Arabia).
Top Skills
Java
Python
Scala
SQL
Similar Jobs
Be an Early Applicant
The Data Engineer will design and build data pipelines, manage ETL processes, implement data warehousing, and deploy machine learning models. They will work with cloud technologies like GCP and AWS and ensure compliance and data security. The role requires problem-solving skills and collaboration with stakeholders.
Be an Early Applicant
The Data Visualization & Analytics Engineer will translate business needs into technical specifications, design dashboards and KPIs, utilize data visualization for storytelling, and improve BI systems. The role requires working with data warehousing tools, conducting unit testing, and querying SQL databases to perform analyses.
.png)
Be an Early Applicant
The Compliance Analyst will aid Wasabi's compliance with industry standards in cloud services, mainly supporting ISO 27001 Certification and conducting compliance audits. They will analyze compliance activities, monitor regulatory adherence, and work cross-functionally with teams to mitigate risks and maintain compliance processes.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
