Citi Logo

Citi

Senior Big Data Platform Engineer – C12 – AVP - Pune

Posted 3 Days Ago
Be an Early Applicant
In-Office
Pune, Mahārāshtra
Senior level
In-Office
Pune, Mahārāshtra
Senior level
The Senior Big Data Platform Engineer will install and configure Cloudera clusters, ensure platform performance, and automate processes using Python, Java, and Shell scripts. They will also implement security measures and collaborate with teams for system maintenance and upgrades.
The summary above was generated by AI

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
 

Responsibilities:

  • Install and configure Cloudera cluster
  • Apply proper architecture guidelines to ensure highly available services
  • Plan and execute major platform software and operating system upgrades and maintenance across physical environments
  • Develop and automate processes for maintenance and monitoring of the environment (Python, Java, Shell Script)
  • Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access via Cloudera sentry)
  • Ensure proper resource utilization between the different development teams and processes
  • Review performance stats and query execution/explain plans; recommend changes for tuning Hive/Impala queries
  • Create and maintain detailed, up-to-date technical documentation

Qualifications:

  • 5+ years experience with big data tools: Hadoop, Hive, HBase, Spark, Kafka, Impala, Solr, Phoenix, etc.
  • 3+ years experience with Python, Java, Shell Script
  • 2+ years experience with cloud services platform (prefer AWS.)
  • Ability to troubleshoot problems and quickly resolve issues
  • Cluster maintenance as well as creation and removal of nodes
  • Performance tuning of Hadoop clusters
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • HDFS support and maintenance
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required

Education:

  • Bachelor’s degree/University degree

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

    ------------------------------------------------------

    Job Family Group:

    Technology

    ------------------------------------------------------

    Job Family:

    Applications Development

    ------------------------------------------------------

    Time Type:

    Full time

    ------------------------------------------------------

    Most Relevant Skills

    Please see the requirements listed above.

    ------------------------------------------------------

    Other Relevant Skills

    For complementary skills, please see above and/or contact the recruiter.

    ------------------------------------------------------

    Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

     

    If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
    View Citi’s EEO Policy Statement and the Know Your Rights poster.

    Top Skills

    AWS
    Hadoop
    Hbase
    Hive
    Impala
    Java
    Kafka
    Phoenix
    Python
    Shell Script
    Solr
    Spark

    Similar Jobs

    19 Hours Ago
    In-Office
    Pune, Mahārāshtra, IND
    Senior level
    Senior level
    Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
    Lead multiple software engineering teams, responsible for hiring, mentoring, and delivering high-quality enterprise products. Drive customer engagement and continuous improvement metrics.
    Top Skills: Cloud ApplicationsData ProtectionDistributed SystemsEnterprise ProductsSoftware Engineering
    19 Hours Ago
    Hybrid
    Pune, Mahārāshtra, IND
    Mid level
    Mid level
    Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
    The Analyst - Global Payroll will manage payroll calculations, ensure compliance and quality management, and handle stakeholder communications while contributing to process improvements.
    Top Skills: NetSuiteSAPSQLWorkday
    19 Hours Ago
    Hybrid
    Pune, Mahārāshtra, IND
    Senior level
    Senior level
    Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
    The role involves managing international payroll, ensuring accuracy, conducting quality audits, improving processes, and handling stakeholder communications.
    Top Skills: NetSuiteSAPSQLWorkday

    What you need to know about the Pune Tech Scene

    Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account