Aviatrix Logo

Aviatrix

Principal Engineer - Technical Software Lead - Data Pipeline

Reposted 22 Days Ago
Be an Early Applicant
Remote
4 Locations
Senior level
Remote
4 Locations
Senior level
The Principal Technical Lead will oversee the Aviatrix Data Pipeline team, focusing on designing scalable systems for collecting, processing, and analyzing network data. Responsibilities include leading a team, optimizing data pipelines, ensuring data quality, and integrating analytics tools.
The summary above was generated by AI

 

 

About The Role:
We are searching for a Principal Technical Lead (TL) for the Aviatrix Data Pipeline team in Bengaluru.
The data pipeline team develops and maintains the infrastructure to collect telemetry at scale by
building highly performant real-time data pipelines. Aviatrix unique position in enterprise cloud
environments present a unique set of technical challenges for the collection, transformation, and
transmission of data across a varied architectural landscape. The team's products enable the
development of data driven products in the Aviatrix suite of networking and security features
enabling our end-to-end multi-cloud solution.

As a Principal Technical Lead (TL), you will lead a small team of talented collaborative
software engineers focused on developing and implementing robust and scalable systems to collect, process, and analyze data. In this role, you will shape, design, and build innovative new data pipelines of that scale. This includes a range of complex issues from instrumenting monitoring into systems using eBPF, linux CLI tools, Prometheus and Open Telemetry, transmitting data via pub/sub messaging, ETL, and developing golang microservices to store, process, and analyze data. Our pipelines service a wide range of customers including billing, customer support, operations teams and direct customer insights. You will have an opportunity to make a significant  impact because there is a short time-to-market cycle, and your code will be touched by every Aviatrix enterprise customer

Location: Aviatrix systems India Private limited 5th floor Tablespace Godrej Indiranagar Building, Near Swami Vivekanand Metro station, Bengaluru 560038

Work Model: In-Office Preferred (3 days in office)

What You’ll Do   
Architecture/Design: You will be responsible for designing and architecting the data pipeline infrastructure needed for network analytics including data collection, storage, and processing components to ensure scalability, reliability, and performance of the pipeline.
Collection Data: You will lead and coordinate with other engineers to identify and collect relevant data from network devices, such as routers, switches, and firewalls. 
Data Processing: You will lead and develop algorithms, processes to transform and cleanse the raw network data. This may involve parsing, normalizing, aggregating, and enriching the data to make it suitable for analysis.
Integration with Analytics Tools: You will have expertise in integrating the data pipeline with various analytics tools and platforms such as data visualization tools and ML
Performance Optimization: You will be responsible for optimizing the data pipeline to handle large volumes of network data efficiently, minimizing latency and maximizing throughput. This may involve parallel processing, distributed computing and leveraging cloud
Quality Control: You will be responsible for implementing data quality checks and validation mechanisms to ensure the accuracy, consistency, and completeness of the network data flowing through the pipeline.
Monitoring and Maintenance: you will lead in setting up monitoring tools and techniques to monitor the health and performance of the data pipeline. 
Collaboration and Leadership: as the Technical Software Lead, you will work closely with cross–functional team .

Requirements

  • 10+ years of software development in building large-scale Data Analytics solutions.
  • 3+ years of hands-on engineering leadership 
  • Proficiency in Golang (preferred) or Python
  • Experience building Golang microservices to service ETL use cases.
  • Instrumented data storage strategies for time series and unstructured data.
  • Experience with deploying and managing big data technologies on K8s.
  • Proficiency with common telemetry frameworks (Prometheus, Open Telemetry).
  • Integrated solutions with big data pipeline technologies (g., Logstash, FluentD, Kafka, Spark, Hadoop, Storm, Spark, Flink)
  • Past delivery of large-scale Data Analytics solutions for complex networking problems or
    environments.
  • BS in Computer Science, Software Engineering, Machine Learning, Mathematics,
    Statistics, or equivalent 

Preferred Qualifications:

  • Domain knowledge in networking: (OSI stack, BGP, IP, TCP, UDP, HTTP, DNS; Linux
    network stack, SDN, network automation).
  • Experience with ML libraries (Scikit-learn, Pytorch, Tensorflow or Keras).
  • You have prior experience working on distribution systems.
  • You have experience with production operations and good practices for putting quality code in production and troubleshoot issues when they arise.
  • Take initiative and be responsible for delivering complex software by working effectively with the team and other stakeholders.
  • You feel at home communicating technical ideas verbally and in writing (technical proposals, design specs, architecture diagrams and presentations).

#LI-VM1

BENEFITS

US: We cover 100% of employee premiums and 88% of dependent(s) premiums for medical, dental and vision coverage, 401(k) match, short and long-term disability, life/AD&D insurance, $1,000/year education reimbursement, and a flexible vacation policy. 

Outside the US: We offer a comprehensive benefits package which, (subect to regional variations) could include pension, private medical for you and dependents, generous holiday allowance, life assurance, long-term disability, annual wellbeing stipend

Your total compensation package will be based on job-related knowledge, education, certifications and location, per our aligned ranges.

About Aviatrix
Aviatrix is the cloud networking expert. We’re on a mission to make cloud networking simple so companies stay agile. Trusted by more than 500 of the world’s leading enterprises, our cloud networking platform creates the visibility, security, and control needed to adapt with ease and move ahead at speed. Combined with the Aviatrix Certified Engineer (ACE) Program, the industry's leading multicloud networking and security certification, Aviatrix empowers the cloud networking community to stay at the forefront of digital transformation.

WE WANT TO INCLUDE YOU

We embrace the fact that not everyone’s journey took the same route or started at the same place. If your experience doesn’t quite meet the requirements but the opportunity excites you and you believe you could be great, don’t let that hold you back from applying. Tell us what you CAN bring and what makes you special.

Aviatrix is a community where everyone's career can grow and we want to help you achieve your goals and be “your best YOU,” however that looks. If you're seeking an opportunity where you can be excited to start work every morning with enthusiastic people, make a real difference and be part of something amazing then let’s talk. We want to get to know you and how we could grow together.

Aviatrix, Inc. is an equal opportunity employer and does not make hiring decisions based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

CPRA - California Applicant Privacy Notice


Top Skills

Cloud Platforms
Flink
Fluentd
Go
Hadoop
Kafka
Keras
Logstash
Open Telemetry
Prometheus
Python
PyTorch
Scikit-Learn
Spark
Storm
TensorFlow

Similar Jobs

9 Days Ago
Remote
4 Locations
Senior level
Senior level
Software
The Staff Engineer for the Data Pipeline team will develop observability modules, focusing on real-time data pipelines for cloud environments. Responsibilities include coding in Golang and Python, completing features independently, and conducting design and code reviews. Must have strong software engineering skills and preferably experience in cloud services and data pipeline development.
Top Skills: AWSAzureData PipelineETLGCPGoKubernetesMicroservicesOciPython
6 Days Ago
Easy Apply
Remote
32 Locations
Easy Apply
Senior level
Senior level
Cloud • Security • Software • Cybersecurity • Automation
As a Principal Engineer for Group Tenant Scale at GitLab, you'll lead the design and evolution of a multi-tenant distributed systems platform. You will guide architecture decisions, provide technical leadership, and mentor engineers, ensuring high-quality project delivery while fostering a strong engineering culture.
Top Skills: Ruby,Golang,Cloud Computing
8 Days Ago
Remote
Yokohama, Kanagawa, JPN
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Solutions Sales Executive at Atlassian will lead sales efforts for Jira Service Management in Japan, focusing on developing strategies for revenue growth and building long-term relationships with enterprise customers. Responsibilities include defining territory vision, collaborating with cross-functional teams, and effectively forecasting sales.
Top Skills: Customer SatisfactionItsm MarketJira Service ManagementRevenue GrowthSales ForecastsSales Strategy

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account