Photon

Lead Data Engineer - Data Archival - Bangalore

Reposted 3 Days Ago

Be an Early Applicant

Remote

Hiring Remotely in India

Mid level

Remote

Hiring Remotely in India

Mid level

Design, build and maintain cloud-oriented big data solutions for ingestion, processing, cleaning and exposition. Improve data quality, implement ETL and data-warehouse architectures, and collaborate with DDS/Data Foundation teams to ensure platform reliability.

The summary above was generated by AI

Missions

Job description:

Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

Today we manage SG Data platform service offers and data tools:

·       Data ingestion: to ingest the data from a data source

·       Data processing: to process, transform and distribute the data to the target location

·       Data exposition : to distribute and expose the data hosted in the data platform

·       Data cleaning: to purge the data on the Lake in a secure way

·       Data tools: data formatter, data anonymizer

   As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile

Experience: 3-5 Years
Skills:

-       Computer programming: Spark, Scala, Java, Python

-       Operating system knowledge for Unix, Linux

-       Databases and SQL

-       ETL and data warehousing

-       Hadoop

-       Apach Spark

Tasks:

·       Maintain an excellent service level of the platform and avoid issues.

·       Researching new methods of obtaining valuable data and improving its quality

·       Creating and enhancing data solutions using various programming languages and tools

·       Creating and enhancing data architectures that meet the requirements of the business

·       Communicate inside if the tech league group to find new approaches

Similar Jobs

Atlassian

Account Manager

2 Hours Ago

In-Office or Remote

Senior level

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Manage large enterprise accounts to retain and expand Atlassian product usage. Build and sustain senior/executive relationships, lead high-value renewals and complex sales cycles, forecast owned book of business, identify and mitigate customer risk, collaborate with Sales and channel partners, and use data and product knowledge to discover expansion opportunities.

Top Skills: Atlassian ProductsClariSalesforceTableau

Atlassian

Principal Software Engineer

2 Hours Ago

In-Office or Remote

Expert/Leader

Cloud • Information Technology • Productivity • Security • Software • App development • Automation

Lead design and implementation of search and data systems, define architecture and roadmap, mentor engineers, collaborate cross-functionally to deliver scalable, reliable data and search features, and drive technical strategy.

The Aerospace Corporation

Financial Services Specialist

Yesterday

Remote or Hybrid

India

Senior level

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense

Manage corporate T&E card program including card issuance, activation/deactivation, limit management, and reconciliation with Concur. Provide cardholder support, enforce policy compliance, monitor aging reports, coordinate with payments, produce usage and delinquency reports, assist audits, and drive process improvements and automation.

Top Skills: ConcurExcelSAP

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.