BlackRock Logo

BlackRock

Data Engineer - Python and Scala, Associate

Posted 2 Days Ago
Be an Early Applicant
In-Office
Gurugram, Haryana
Senior level
In-Office
Gurugram, Haryana
Senior level
As a Data Engineer, you'll optimize data pipeline architectures, develop high-quality datasets, and automate processes to enhance data distribution capabilities across platforms, driving insights and supporting decision-making.
The summary above was generated by AI

About this role

Data Engineer – Client Experience Platform

When BlackRock was started in 1988, its founders envisioned a company that combined the best of financial services with cutting edge technology. They imagined a business that would provide financial services to clients as well as technology services to other financial firms. The result of their vision is Aladdin, our industry leading, end-to-end investment management platform. With assets valued over USD $10 trillion managed on Aladdin, our technology empowers millions of investors to save for retirement, pay for college, buy a home and improve their financial wellbeing.

What differentiates us at Aladdin is that data is central to our operations. The capability to consume, store, analyze, and derive insights from data is now a vital aspect of what makes us successful.

The Client Experience Platform team is focused on developing integrated experiences across desktop, web, and mobile channels for clients, regulators, engineers, sales, and service professionals. The mission of this team is to create the best in-class experience across the horizontal client journey.

We are looking for talented Software Engineers that will architect and build the Client Data Platform on the Cloud which will manage and house a 360 degree view of our CRM, Sales and Service echo system. The candidate will focus on building scalable data ingestion pipelines and conforming and transforming the data to support analytical use cases consisting of data of the highest quality for all users of the platform, notably Global Client Business, US Wealth Advisory, Executive Teams and Data Scientists.

Software engineers at BlackRock get to experience working at one of the most recognized financial companies in the world while being part of a software development team responsible for next generation technologies and solutions. Our engineers design and build large scale data storage, computation and distribution systems.

Description:

As Data Engineer, you will…

  • Improve BlackRock’s ability to enhance our retail sales distribution capabilities and services suite by creating, expanding and optimizing our data and data pipeline architecture.

  • You will create and operationalize data pipelines to enable squads to deliver high quality data-driven product.

  • You will be accountable for managing high-quality datasets exposed for internal and external consumption by downstream users and applications.

  • Top technical / programming skills – Python, Java or Scala, Hadoop Suite, Cloud Data Platforms Preferably Snowflake and SQL. Experience working with flat files (e.g., csv, tsv, Excel), Database API sources is a must to both ingest and create transformations.

  • Given the highly execution-focused nature of the work, the ideal candidate will roll up their sleeves to ensure that their projects meet deadlines and will always look for ways to optimize processes in future cycles.

  • The successful candidate will be highly motivated to create, optimize, or redesign data pipelines to support our next generation of products and data initiatives.

  • You will be a builder and an owner of your work product.

Responsibilities:

  • Lead in the creation and maintenance of optimized data pipeline architectures on large and complex data sets.

  • Assemble large, complex data sets that meet business requirements.

  • Act as lead to identify, design, and implement internal process improvements and relay to relevant technology organization.

  • Support customers to assist in data-related technical issues and support their data infrastructure needs.

  • Automate manual ingest processes and optimize data delivery subject to service level agreements; work with infrastructure on re-design for greater scalability.

  • Keep data separated and segregated according to relevant data policies.

  • Work with data scientists to develop data ready tools to support their job.

  • Be up-to-date with the latest tech trends in the big-data space and recommend them as needed.

  • Identify, investigate, and resolve data discrepancies by finding the root cause of issues; collaborate with partners across various multi-functional teams to prevent future occurrences.

Qualifications:

  • Overall 6+ years of hands-on experience in computer/software engineering with majority in big data engineering.

  • 5+ years of strong Python or Scala programming skills (Core Python and PySpark) including hands-on experience creating and supporting UDFs and modules like pytest.

  • 5+ years of experience with building and optimizing ‘big data’ pipelines, architectures, and data sets. Familiarity with data pipeline and workflow management tools (e.g., Airflow, DBT Kafka).

  • 5+ years of hands-on experience on developing on Spark in a production environment. Expertise on parallel execution, deciding resources and different modes of executing jobs is required.

  • 5+ years of experience using Hive (on Spark), Yarn (logs, DAG flow diagrams), Sqoop. Proficiency bucketing, partitioning, tuning and handling different file formats (ORC, PARQUET & AVRO).

  • 5+ years of experience using Transact SQL (e.g., MS SQ Server, MySQL), No-SQL and GraphQL.

  • Strong experience implementing solutions on Snowflake

  • Experience in deployment, maintenance, and administration tasks related to Cloud (Azure Preferred), OpenStack, Docker, Kafka and Kubernetes

  • Experience with working with global teams across different time zones

  • Plus - Experience with Machine Learning and Artificial Intelligence

  • Plus - Experience with Generative Artificial Intelligence

Our benefits
To help you stay energized, engaged and inspired, we offer a wide range of benefits including a strong retirement plan, tuition reimbursement, comprehensive healthcare, support for working parents and Flexible Time Off (FTO) so you can relax, recharge and be there for the people you care about.

Our hybrid work model

BlackRock’s hybrid work model is designed to enable a culture of collaboration and apprenticeship that enriches the experience of our employees, while supporting flexibility for all. Employees are currently required to work at least 4 days in the office per week, with the flexibility to work from home 1 day a week. Some business groups may require more time in the office due to their roles and responsibilities. We remain focused on increasing the impactful moments that arise when we work together in person – aligned with our commitment to performance and innovation. As a new joiner, you can count on this hybrid model to accelerate your learning and onboarding experience here at BlackRock.

About BlackRock

At BlackRock, we are all connected by one mission: to help more and more people experience financial well-being.  Our clients, and the people they serve, are saving for retirement, paying for their children’s educations, buying homes and starting businesses. Their investments also help to strengthen the global economy: support businesses small and large; finance infrastructure projects that connect and power cities; and facilitate innovations that drive progress.

This mission would not be possible without our smartest investment – the one we make in our employees. It’s why we’re dedicated to creating an environment where our colleagues feel welcomed, valued and supported with networks, benefits and development opportunities to help them thrive.

For additional information on BlackRock, please visit @blackrock | Twitter: @blackrock | LinkedIn: www.linkedin.com/company/blackrock

BlackRock is proud to be an Equal Opportunity Employer.  We evaluate qualified applicants without regard to age, disability, family status, gender identity, race, religion, sex, sexual orientation and other protected attributes at law.

Top Skills

Airflow
Cloud Data Platforms
Dbt
Docker
GraphQL
Hadoop
Hive
Kafka
Kubernetes
No-Sql
Python
Scala
Snowflake
Spark
SQL
Sqoop
Transact Sql
Yarn

Similar Jobs at BlackRock

21 Minutes Ago
In-Office
Gurugram, Haryana, IND
Mid level
Mid level
Big Data • Cloud • Fintech • Financial Services • Conversational AI
The role involves engaging stakeholders to assess technology controls, conducting audits on IT systems, and managing risk assessments, with a focus on financial industry standards.
Top Skills: CehCisaCismCobitCriscIsoItilPythonSQL
21 Minutes Ago
In-Office
Gurugram, Haryana, IND
Senior level
Senior level
Big Data • Cloud • Fintech • Financial Services • Conversational AI
Lead the Analytics Stewardship team to improve analytics quality, manage changes, and ensure alignment with data management policies. Drive innovation using advanced analytics and AI/ML, while mentoring junior analysts.
Top Skills: Ai/Ml TechniquesData Science
4 Hours Ago
In-Office
Gurugram, Haryana, IND
Mid level
Mid level
Big Data • Cloud • Fintech • Financial Services • Conversational AI
The Associate, Strategic Sourcing will manage strategic sourcing activities for IT categories, develop sourcing strategies, maintain supplier relationships, perform market analysis, and ensure compliance with procurement policies.
Top Skills: Ai Software ProductsMS Office

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account