The Data Engineer will design and implement data pipelines and architectures using GCP, focusing on data warehousing and analytics platforms while leveraging strong Python and SQL skills.
Data Specialist
Primary Skills
- ETL Fundamentals, SQL, BigQuery, Dataproc, SQL (Basic + Advanced), Python, Data Catalog, Data Warehousing, Composer, Dataflow, Cloud Trace, Cloud Logging, Cloud Storage, Datafusion, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals
Job requirements
- 5 years of experience in software design and development 3 years of experience in the data engineering field is preferred
- 3 years of Hands-on experience in GCP cloud data implementation suite such as Big Query, Pub Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage, Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms.
- Hands on Strong Experience in the below technology
- 1. GBQ Query
- 2. Python
- 3. Apache Airflow
- 4. SQL (BigQuery preferred) Extensive hands-on experience working with data using SQL and Python Cloud Functions.
- Comparable skills in AWS and other cloud Big Data Engineering space is considered.
- Experience with agile development methodologies Excellent verbal and written communications skills with the ability to clearly present ideas, concepts, and solutions
- Bachelor's Degree in Computer Science, Information Technology, or closely related discipline
Top Skills
Apache Airflow
BigQuery
Cloud Logging
Cloud Storage
Cloud Trace
Composer
Data Catalog
Data Warehousing
Dataflow
Datafusion
Dataproc
ETL
Plsql
Python
SQL
Brillio Pune, Mahārāshtra, IND Office
Pune, India
Similar Jobs
Healthtech • Logistics • Pharmaceutical
The Analyst II role involves managing OneTrust Cookie Consent systems, ensuring privacy compliance, and integrating policies with legal teams. It emphasizes project management, configuration for AI Governance, and ongoing testing and validation of consent strategies.
Top Skills:
CookiebotGoogle Tag ManagerGradleJdbcJeeJmsJpaMicrosoft Office SuiteOnetrustOrm SolutionsSpring
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Senior Governance & Risk Analyst will support global ESG initiatives, particularly in data analysis, compliance, environmental reporting, and vendor management related to sustainability efforts.
Top Skills:
Archer GrcEcovadisGriIso 14001Iso 14064ExcelMicrosoft PowerpointMicrosoft WordSasb
Financial Services
The Transformation Lead will drive analytical solutions, innovate technology strategies, manage projects, and collaborate with various teams to enhance Global Research and Sales infrastructure.
Top Skills:
AICloud TechnologyMlPythonQlik SenseTableau
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
