Bottomline Technologies Logo

Bottomline Technologies

Senior Data Engineer

Posted 3 Days Ago
Be an Early Applicant
India
Senior level
India
Senior level
The Senior Data Engineer leads the development of data infrastructure, optimizes data pipelines, ensures data integrity, and mentors junior engineers while addressing complex data challenges.
The summary above was generated by AI
Why Choose Bottomline?

Are you ready to transform the way businesses pay and get paid? Bottomline is a global leader in business payments and cash management, with over 35 years of experience and moving more than $16 trillion in payments annually. We're looking for passionate individuals to join our team and help drive impactful results for our customers. If you're dedicated to delighting customers and promoting growth and innovation - we want you on our team!

Senior Data Engineer 

General Information  

Description: The Senior Data Engineer is responsible for leading the design, development, and optimization of data infrastructure and systems to meet complex business needs. They play a strategic role in developing and managing large-scale data pipelines, ensuring scalability, reliability, and performance. As a key technical expert, the Senior Data Engineer collaborates with cross-functional teams to deliver innovative data solutions and ensures adherence to best practices in data management and governance. 

Responsibilities 

  • Leads the design and development of advanced data pipelines, ensuring seamless ETL/ELT of data into enterprise storage systems. 
  • Oversees data integration from diverse sources, maintaining data consistency, integrity, and compliance with enterprise standards. 
  • Transforms raw data into usable formats through cleansing, aggregation, filtering, and enrichment techniques. 
  • Optimizes data pipelines and workflows for scalability, performance, and cost efficiency. 
  • Establishes robust data validation, quality checks, and error-handling mechanisms to ensure enterprise data integrity. 
  • Mentors junior data engineers, promoting technical growth and team development. 
  • Implements and enforces best practices in data governance, including metadata management and lineage tracking. 
  • Drives the adoption of real-time data streaming and processing workflows to enable advanced analytics and decision-making. 
  • Partners with stakeholders to identify and address complex data challenges, delivering scalable and innovative solutions. 
  • Stays updated with emerging data technologies, evaluating their potential to enhance enterprise capabilities. 
  • Develops and enforces data security protocols to protect sensitive information. 

Job Requirements 

Education 

  • A bachelor’s degree in computer science, data science, software engineering, information systems, or related quantitative field; master’s degree preferred 

Experience 

  • 8+ years of data engineering experience, including expertise in data integration, pipeline optimization, and enterprise-scale data solutions. 
  • Proven leadership in implementing big data solutions (e.g., Snowflake, Databricks) and distributed data systems (e.g., Apache Spark, Flink). 

Skills 

  • Advanced proficiency in Apache technologies (Kafka, Airflow, Spark) and programming languages (Python, Java, Scala). 
  • Expertise in data query tools (SQL, Hive) and database technologies (NoSQL, Hadoop, Teradata). 
  • Strong knowledge of cloud platforms (AWS, Azure, GCP) and modern data architectures. 
  • Experience with real-time streaming data workflows and AI/ML analytics initiatives. 
  • Exceptional analytical and problem-solving skills with debugging expertise in complex systems. 
  • Excellent communication skills to effectively collaborate with technical and non-technical stakeholders. 
  • Strong leadership abilities to mentor teams and influence cross-functional initiatives. 

We welcome talent at all career stages and are dedicated to understanding and supporting additional needs. We're proud to be an equal opportunity employer, committed to creating an inclusive and open environment for everyone.

Top Skills

Airflow
Spark
AWS
Azure
Databricks
Flink
GCP
Hadoop
Hive
Java
Kafka
NoSQL
Python
Scala
Snowflake
SQL
Teradata

Similar Jobs

13 Hours Ago
Easy Apply
Bengaluru, Karnataka, IND
Easy Apply
Senior level
Senior level
Artificial Intelligence • Computer Vision • Machine Learning • Payments • Real Estate • PropTech
The Senior Data Engineer will create and manage data products, design data architecture, build data pipelines, and mentor team members while ensuring data quality and compliance.
Top Skills: AirflowAutomicCi/CdDbtEltETLMs Sql ServerMySQLPostgresPysparkPythonSnowflakeSparkSQL
An Hour Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
As a Senior Data Engineer, you'll design cloud-based data solutions, manage data pipelines, ensure data quality, and collaborate with teams to implement analytics strategies.
Top Skills: Ab-InitioAecorsoftAirflowAtaccama DqAzure Data FactoryAzure DatabricksAzure Datalake Gen2Azure Stream AnalyticsAzure Synapse AnalyticsBig QueryCloud FunctionCloudwatchCollibraDatabricksDataflowDataplexDataprocDbtEmrErwinFivetranGcsGlueGoGraph DatabaseInformaticaJavaKafkaKinesisLambdaNeo4JPentahoPl/SqlPubsubPysparkPythonRedshiftS3SnsSQLTalend
9 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
As a Senior Data Engineer, you will develop and maintain a robust data platform, collaborating with peers and producing high-quality code with a focus on data ingestion and architecture evolution.
Top Skills: AirflowAWSDbtJavaPythonSnowflakeSparkSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account