The Staff Engineer will design and optimize scalable data pipelines, provide technical leadership, ensure data quality, and oversee architecture decisions across platforms.
Company Description
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (18000 experts across 38 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Job DescriptionREQUIREMENTS:
- Total experience 7+years.
- Hands-on experience with Databricks on any cloud platform (Azure, AWS, or GCP).
- Strong proficiency in Python, Scala, or SQL for data processing and scripting.
- Solid understanding of Big Data concepts, distributed computing, and data lake house architecture.
- Design, develop, and optimize scalable ETL/ELT pipelines using Databricks.
- Experience with data pipeline orchestration tools (e.g., Airflow, Azure Data Factory).
- Ensure data quality, performance tuning, and pipeline monitoring in production environments.
- Provide technical leadership and contribute to architecture decisions for data platforms
- Deep knowledge of and storage (Azure Data Lake, AWS S3, GCP Cloud Storage, etc.). cloud services.
- Strong debugging, performance optimization, and problem-solving skills.
- Should have good communication and customer handling skills.
RESPONSIBILITIES:
- Writing and reviewing great quality code
- Understanding the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements
- Mapping decisions with requirements and be able to translate the same to developers
- Identifying different solutions and being able to narrow down the best option that meets the clients’ requirements
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design documents explaining overall architecture, framework, and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility,scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
- Understanding and relating technology integration scenarios and applying these learnings in projects
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Top Skills
Airflow
Aws S3
Azure Data Factory
Azure Data Lake
Databricks
Gcp Cloud Storage
Python
Scala
SQL
Similar Jobs
Information Technology • Internet of Things • Marketing Tech
The Staff Engineer will lead AI initiatives, oversee multiple teams, mentor staff, and focus on building and scaling AI-driven products.
Top Skills:
AINatural Language ProcessingVoip
16 Days Ago
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The role involves critical tasks such as developing automated testing frameworks, coordinating with cross-functional teams, and managing testing efforts for Oracle applications.
Top Skills:
Data ModelingEtl ProcessesOracle Analytics CloudOracle Autonomous Data WarehouseOracle CloudOracle Fusion Data IntelligencePl/SqlReporting FrameworksSQL
16 Days Ago
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The role involves leading ERP-related projects, managing data intelligence processes, and coordinating with clients for testing. Responsibilities include designing testing frameworks, risk management, and improving testing quality.
Top Skills:
Etl ProcessesOracle Analytics CloudOracle Autonomous Data WarehouseOracle Fusion Data IntelligencePl/SqlSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.