As a Data Engineer at InfyStrat, you'll design and maintain data architecture, ensuring data accessibility and reliability while developing data pipelines. You'll collaborate with teams to create scalable data solutions for business intelligence.
At InfyStrat, we are on the lookout for an innovative and skilled Data Engineer to join our dynamic team. In this position, you will be responsible for building and maintaining our data architecture, ensuring that our data is accessible, reliable, and timely. You will leverage your expertise to design robust data pipelines and optimize data flows to support analytical and operational needs across the organization. Collaborating with data analysts, data scientists, and other stakeholders, you will gather requirements to create scalable data solutions that drive business intelligence and insights. If you have a passion for data and enjoy tackling complex challenges, we want to hear from you!
Core Responsibilities- Design, develop, and maintain data pipelines to support ETL processes.
- Ensure data quality and integrity across various data sources and systems.
- Collaborate with cross-functional teams to identify data requirements and create data models.
- Utilize big data technologies for large-scale data processing.
- Monitor and troubleshoot performance issues related to data processes.
- Stay updated on the latest technologies and best practices within the data engineering field.
Requirements
- Degree in Computer Science, Information Technology, or a related field.
- 5 years of experience in data engineering or related roles.
- Expertise in SQL and experience with multiple data storage solutions (NoSQL, relational databases).
- Familiarity with cloud computing platforms (AWS, Azure, Google Cloud).
- Experience with data processing frameworks such as Apache Kafka, Spark, or similar.
- Programming experience in Python, Java, or Scala.
- Strong analytical skills and the ability to work with complex data sets.
- Excellent communication and teamwork skills.
Top Skills
Apache Kafka
AWS
Azure
GCP
Java
NoSQL
Python
Relational Databases
Scala
Spark
SQL
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Design, develop, implement and maintain Big Data solutions for Disability & Absence products. Build batch, speed, and serving layers using Spark, Hive, NoSQL, SOLR and Kafka; optimize Hadoop jobs; automate with Shell/Python; support deployments, CI/CD, runbooks, and cross-team collaboration.
Top Skills:
Spark,Hive,Nosql,Solr,Scala,Pig,Kafka,Hbase,Nifi,Change-Data-Capture,Hadoop,Ci/Cd,Shell,Python,Azure,Google Cloud
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Data Engineer, you will work with GCP technologies, managing big data, utilizing ETL/ELT processes, and collaborating across teams while advancing in your career.
Top Skills:
AirflowBigQueryBigtableCloud RunDatastoreETLGCPGcsJavaPysparkPythonSpannerSparkSQL
Cloud • Software
Lead SRE responsible for designing, building, and optimizing cloud and big-data infrastructure to ensure availability, scalability, and security of ML/AI systems. Provide technical leadership, mentor teams, troubleshoot production issues, drive automation, and define the platform roadmap while collaborating with cross-functional stakeholders.
Top Skills:
Aws,Terraform,Kubernetes,Eks,Hadoop,Spark,Hive,Hdfs,Gobblin,Airflow,Emr,Sagemaker,Python,Go,Prometheus,Alertmanager,Grafana,Thanos,Cloudwatch,Opentelemetry,Elk,Linux
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
