Thales Logo

Thales

Pyspark Data Engineer

Reposted Yesterday
Be an Early Applicant
In-Office
Indra Prastha, Porbandar, Gujarat
Senior level
In-Office
Indra Prastha, Porbandar, Gujarat
Senior level
The role involves coding in Python and PySpark, optimizing Spark jobs, developing ETL processes, and ensuring the scalable performance of data applications.
The summary above was generated by AI
Location: Bangalore - Indraprastha, India

Thales is a global technology leader trusted by governments, institutions, and enterprises to tackle their most demanding challenges. From quantum applications and artificial intelligence to cybersecurity and 6G innovation, our solutions empower critical decisions rooted in human intelligence. Operating at the forefront of aerospace and space, cybersecurity and digital identity, we’re driven by a mission to build a future we can all trust.

Present in India since 1953, Thales is headquartered in Noida and has other operational offices and sites spread across Delhi, Gurugram, Bengaluru and Mumbai, among others. Over 2200 employees are working with Thales and its joint ventures in India. Since the beginning, Thales has been playing an essential role in India’s growth story by sharing its technologies and expertise in Defence, Aerospace and Cyber & Digital sectors. Thales has two engineering competence centres in India - one in Noida focused on Cyber & Digital business, while the one in Bengaluru focuses on hardware, software and systems engineering capabilities for both the civil and defence sectors, serving global needs. The Group has also established an MRO (Maintenance, Repair & Overhaul) facility in Gurugram to provide comprehensive avionics maintenance and repair services to Indian airlines and support the growth of the local aviation industry.

Job Responsibilities:

  • Expert in Python, with knowledge of PySpark
  • Writing distributed data processing code with PySpark
  • Optimizing Spark jobs using DataFrames API and RDDs
  • Working with Spark SQL for querying large datasets (structured sql/mysql database)
  • Implementing UDFs (User Defined Functions) for custom transformations
  • Performance tuning (caching, partitioning, broadcast joins, threading, multiprocessing, Predicate Pushdown)
  • ETL development using Databricks workflows and Delta Live Tables
  • Data pipelines with Databricks Jobs
  • Streaming data processing with Structured Streaming ( event hub or AWS SQS)
  • Non structured file processing like parquet , columnar data format
  • Responsible for writing reusable, testable and efficient code — ensuring the application's performance, security and scalability.

Minimum Skills/Experience:

  • Bachelor’s degree in Engineering, Computer Science or related study
  • Proven experience as a Python language with PySpark
  • Minimum 5 years of experience
  • Understanding of data structures, data modeling and software architecture
  • Ability to write robust code in Python
  • Outstanding analytical and problem-solving skills
  • Experience with Git, JIRA, Confluence
  • Experience in working on Linux OS.

At Thales, we’re committed to fostering a workplace where respect, trust, collaboration, and passion drive everything we do. Here, you’ll feel empowered to bring your best self, thrive in a supportive culture, and love the work you do. Join us, and be part of a team reimagining technology to create solutions that truly make a difference – for a safer, greener, and more inclusive world.

Top Skills

Confluence
Databricks
Dataframes Api
Delta Live Tables
Git
JIRA
Linux
Pyspark
Python
Rdds
Spark Sql

Similar Jobs

4 Hours Ago
Remote or Hybrid
India
Junior
Junior
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Account Executive will sell SailPoint's Identity Security Solution, exceeding revenue quotas while providing superior customer experiences and managing the sales cycle effectively.
Top Skills: Salesforce
4 Hours Ago
Remote or Hybrid
India
Junior
Junior
Security • Cybersecurity
As an Escalation Engineer, you'll troubleshoot complex customer issues, develop solutions, and coordinate effectively with R&D to resolve escalated problems.
Top Skills: C++HibernateJavaLinuxSpringSQL
Yesterday
Easy Apply
Remote or Hybrid
IND
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Security • Software
As a Senior Deal Strategist, you will architect complex deals, manage commercial governance, optimize quote-to-cash processes, and empower sales teams by providing mentorship and training.
Top Skills: Asc 606CpqSaaSSalesforce

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account