The Big Data Engineer will support existing applications and work on new design and implementation requirements, utilizing big data technologies and tools.
This is a remote position.
Role: Big Data Engineer/Developer
Experience: 3-6 Years in Big Data
Immediate Joiners: Preferred
Location: Remote( for now)
Job Description:
- Data Engineer required with experience working in Hadoop in technologies including Hive, Hdfs, Sqoop etc.
- Must have - Python, Pyspark, Spark, AWS/Azure, SQL.
- Candidate will perform the role of senior developer where he needs to support existing applications as well as work on new requirements from a design and implementation perspectives.
- GitLab Hadoop Hive Jenkins MAVEN Nexus
- Scala Shell Scripting YARN Oracle Scrum/Agile Spring.
- Sound communication skills - both written and verbal
- Good to have - Knowledge of Teradata, Airflow, GCP
Similar Jobs
Artificial Intelligence • Machine Learning • Security • Software • Analytics • Big Data Analytics
Support enterprise big data infrastructure deployments, provide customer site support, manage installations and upgrades, develop automation scripts, and enhance monitoring tools.
Top Skills:
AnsibleApache KafkaSparkApache ZookeeperBashHarborHdfsJenkinsKubernetesLonghornOpen ShiftPythonRedhat LinuxRkeVmware VsphereYarn
Information Technology
The Big Data Engineer will design and develop scalable data solutions, build data pipelines, ensure data quality, and collaborate across teams.
Top Skills:
SparkAWSAzureBigQueryDockerGCPHadoopHdfsJavaKafkaKubernetesPythonS3Scala
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
Responsible for guiding teams in utilizing technology effectively, mentoring colleagues and devising advanced solutions to meet client challenges.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
