Photon Logo

Photon

Lead Data Engineer - Data Archival - Bangalore

Reposted One Month Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Design, build and maintain cloud-oriented big data solutions for ingestion, processing, cleaning and exposition. Improve data quality, implement ETL and data-warehouse architectures, and collaborate with DDS/Data Foundation teams to ensure platform reliability.
The summary above was generated by AI
Missions
  • Job description:

    Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

    Today we manage SG Data platform service offers and data tools:

    ·       Data ingestion: to ingest the data from a data source

    ·       Data processing: to process, transform and distribute the data to the target location

    ·       Data exposition : to distribute and expose the data hosted in the data platform

    ·       Data cleaning: to purge the data on the Lake in a secure way

    ·       Data tools: data formatter, data anonymizer

       As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile
  • Experience: 3-5 Years
  • Skills:

    -       Computer programming: Spark, Scala, Java, Python

    -       Operating system knowledge for Unix, Linux

    -       Databases and SQL

    -       ETL and data warehousing

    -       Hadoop

    -       Apach Spark

    Tasks:

    ·       Maintain an excellent service level of the platform and avoid issues.

    ·       Researching new methods of obtaining valuable data and improving its quality

    ·       Creating and enhancing data solutions using various programming languages and tools

    ·       Creating and enhancing data architectures that meet the requirements of the business

    ·       Communicate inside if the tech league group to find new approaches

Similar Jobs

8 Minutes Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Sells enterprise cybersecurity software to new and existing customers across assigned accounts. Responsibilities include prospecting, qualification, negotiation, closing, cross-selling, upselling, renewals, forecasting, account planning, CRM documentation, customer onboarding coordination, and collaboration with internal teams and channel partners. The role also requires promoting products, communicating customer feedback, and using AI technologies to improve decision-making and business outcomes.
Top Skills: Ai TechnologiesCRMCybersecurityEnterprise Security SoftwareFalcon FlexMarketing SoftwareSaaS
58 Minutes Ago
Remote or Hybrid
Junior
Junior
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Develops end-to-end product design solutions and high-fidelity designs for ServiceNow products. Collaborates with engineering and product management, presents ideas, gathers feedback, reviews proposals, identifies user needs, validates solutions with end users, and contributes throughout the product development lifecycle.
Top Skills: AIWeb Applications
An Hour Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Oversee private equity fund accounting, NAV calculations, capital accounts, waterfalls, carried interest, fees, expenses, transactions, valuations, and financial reporting. Review statements and investor packages, manage audits, ensure LPA and accounting-standard compliance, coordinate with auditors and tax advisors, and lead a fund accounting team. Drive controls, process standardization, automation, and system enhancements while supporting clients, GPs, and internal stakeholders.
Top Skills: GenevaIfrsInvestranLux GaapExcelUs Gaap

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account