The Role
The Senior Kafka Developer will design and manage Kafka-based solutions, develop data pipelines for real-time processing, integrate data sources, optimize data storage on AWS, monitor Kafka clusters, and collaborate with teams for defining data processing requirements.
Summary Generated by Built In
ProArch is seeking a skilled Senior Kafka Developer with AWS experience to join our innovative team. In this role, you will be responsible for designing, developing, and managing Kafka-based solutions that improve our data streaming capabilities and support our cloud infrastructure on AWS.
Key Responsibilities:
- Design, develop, and implement Kafka streams and data pipelines to facilitate real-time data processing and analytics.
- Integrate Kafka with various data sources and sinks, ensuring data flow across different applications.
- Work alongside data architects and engineers to optimize data flow and storage patterns in AWS.
- Monitor and troubleshoot Kafka clusters, ensuring high availability and reliability of services.
- Implement security measures and manage data governance to protect sensitive information.
- Collaborate with cross-functional teams to define and refine requirements for data processing functionalities.
- Document data pipeline designs, workflows, and operational processes for reference and knowledge sharing.
To be successful in this role, candidates should possess the following qualifications:
- 4+ years of experience in developing applications using Kafka.
- Strong understanding of AWS services such as Kinesis, S3, EC2, Lambda, and CloudFormation.
- Proficient in programming languages like Java, Scala, or Python.
- Experience with data modeling and schema design using Avro or JSON.
- Familiarity with monitoring tools for Kafka, such as Confluent Control Center or Grafana.
- Strong analytical and problem-solving skills.
- Excellent communication skills and ability to work in a team-oriented environment.
- Knowledge of data governance, security, and compliance frameworks is a plus.
Top Skills
Java
Python
Scala
The Company
What We Do
ProArch was founded on the belief that a future where change is ‘business as usual’ is fundamentally more exciting than one where it is not.
We accelerate value and increase resilience for our clients with consulting and technology - enabled by cloud, guided by data, fueled by apps, and secured by design
