Cloudflare Logo

Cloudflare

Data Engineer

Job Posted 22 Hours Ago Reposted 22 Hours Ago
Be an Early Applicant
Hybrid
Lisbon
Mid level
Hybrid
Lisbon
Mid level
As a Data Engineer, you'll build and improve a petabyte-scale data lake, develop scalable data solutions, and contribute to the architecture for advanced analytics tools.
The summary above was generated by AI
Role Location: Lisbon, Portugal
About the team
The BI team at Cloudflare is responsible for building and managing the cloud data analytics platform. Our focus is on developing a centralized cloud data analytics platform using open source technologies for internal Business Partners and Machine Learning teams. The team aims to make data more accessible, meet Cloudflare's critical business needs, and provide self-service reporting and analytics tools to support current and new business initiatives.
About the role
In the role of Data Engineer, the primary responsibility is to contribute to building and improving a scalable petabyte-scale data lake and Cloud Enterprise Data Warehouse. This involves utilizing a modern tech stack from scratch with open source technologies. Success in this position requires a strong background in data engineering, combined with product and business acumen, to deliver scalable data pipelines and analytics solutions that empower advanced analytics through a user-friendly self-service interface.
What you will do
  • Partner closely with internal stakeholders to gain a strong understanding of business and product data needs
  • Design, build and support scalable and reliable data solutions that can enable self-service reporting and advanced analytics using open source technologies
  • Develop technical tools and programming that leverage machine learning and big-data techniques to cleanse, organize and transform data and to maintain and update data structures and integrity on an automated basis
  • Design application components and evolve architecture: API/Services, data access, integration, application components, etc.
  • Analyze and support platform requirements for Data Science team
  • Implement automation tools and frameworks (CI/CD pipelines)
  • Build tools to automate the monitoring or workload and take proactive measure to scale the platform or to fix the problem
  • Mentor junior data engineers

Examples of desired skills, knowledge, and experience
  • Proven ability to work closely with business and product teams to ensure data solutions are aligned with business initiatives and are of high quality
  • 2-5 years of development experience in Big Data space working with Petabytes of data and building large scale data solutions using any Cloud Platform, Apache Spark, Airflow, Scala, Golang, Python, etc
  • Experience with API design and development of RESTful web services or GraphQL is a plus
  • Working experience in Kubernetes, Docker etc. is a plus
  • Bachelor's or Master's Degree in Computer Science or Engineering or related experience required

Top Skills

Airflow
Spark
Big Data
Cloud Platform
Docker
Go
GraphQL
Kubernetes
Python
Restful Web Services
Scala

Similar Jobs at Cloudflare

9 Days Ago
Hybrid
Lisbon, PRT
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
As a Senior Data Engineer, you will design and scale data platforms, develop robust data architecture, ensure data quality, and collaborate with teams to support business goals.
Top Skills: AirflowSparkDockerGoGoogle Cloud PlatformKafkaKubernetesPythonScala
8 Days Ago
Hybrid
2 Locations
Mid level
Mid level
Cloud • Information Technology • Security • Software • Cybersecurity
As a Systems Engineer for CASB, you will build and maintain API-based integrations and ensure reliable performance while addressing security challenges in SaaS applications.
Top Skills: AWSAzureBigQueryClickhouseElasticsearchGCPGoGrafanaKafkaKibanaPostgresPrometheusReactRedisTypescript
7 Days Ago
Hybrid
Lisbon, PRT
Mid level
Mid level
Cloud • Information Technology • Security • Software • Cybersecurity
The Data Engineer will build scalable data pipelines, support analytics initiatives, and collaborate with teams to enhance data quality and insights.
Top Skills: BigQueryDockerGoGoogle Cloud PlatformKafkaKubernetesPythonSparkSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account