Velotio Technologies Logo

Velotio Technologies

Senior Engineer ( Data Platform )

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in Pune, Maharashtra
Senior level
Remote
Hiring Remotely in Pune, Maharashtra
Senior level
The role involves optimizing data platforms by enhancing Spark clusters, improving data extraction methods, and implementing scalable data warehouse solutions.
The summary above was generated by AI

Description

About Velotio:

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We have provided full-stack product development for 110+ startups across the globe, building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements
  • Optimize Spark clusters for cost, efficiency and performance by implementing robust monitoring systems to identify bottlenecks using data and metrics. Provide actionable recommendations for continuous improvement.
  • Optimize the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies .
  • Work with data and analytics experts to strive for greater cost efficiencies in our data systems.

You will enjoy this role if you..

  • Experience with processing large workloads and complex code on Spark clusters.
  • Proven experience in setting up monitoring for Spark clusters and driving optimization based on insights and findings.
  • Experience in designing and implementing scalable Data Warehouse solutions to support analytical and reporting needs.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

Desired Skills & Experience:

  • 4+ years of experience in Data Platform.
  • Expertise with Python and Jupyter notebooks is a must.
  • Experience with big data tools: Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
  • Working knowledge of stream-processing systems: Storm, Spark-Streaming, etc. is a plus
Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly.
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture.
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment.

We want to hire smart, curious, and ambitious folks, so please reach out even if you do not have all of the requisite experience. We are looking for engineers with the potential to grow!

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Top Skills

Airflow
AWS
Azkaban
Cassandra
Ec2
Emr
Jupyter Notebooks
Kafka
Luigi
NoSQL
Postgres
Python
Rds
Redshift
Spark
Spark-Streaming
SQL
Storm

Velotio Technologies Pune, Mahārāshtra, IND Office

3rd Floor, AG Trade Center, Ram Nagar ,Bavdhan , Pune, Maharashtra, India, 411021

Similar Jobs

2 Days Ago
Remote
India
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Senior Data Platform Engineer will develop RESTful APIs, utilize big data technologies, and ensure data quality through automation and cloud solutions.
Top Skills: Amazon Web ServicesDbtFlaskGitJavaKotlinPythonScalaSparkSpring BootSQL
2 Days Ago
Remote
India
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Senior Data Platform Engineer is responsible for designing and implementing data solutions, building APIs, and ensuring data quality through automation, leveraging cloud technologies and big data processing frameworks.
Top Skills: Amazon Web ServicesDbtFlaskGitJavaKotlinMicro ServicesPythonRestful ApisScalaSparkSpring BootSQL
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you will develop data models, build data pipelines, improve data quality, and support business insights by collaborating with analytics teams.
Top Skills: AirflowAWSPythonSparkSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account