The Azure Data Engineer Lead Consultant will oversee a data engineering team, ensuring best practices, project delivery, and providing technical guidance in data solutions.
3
Tasks:
- Provide leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment. Set clear goals, assign tasks, and manage resources to ensure successful project delivery. Work closely with developers to support them and improve data engineering processes.
- Support team members with troubleshooting and resolving complex technical issues and challenges.
- Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies. Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards.
- Collaborate with stakeholders to understand project requirements, define scope, and create project plans.
- Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards. Monitor progress, identify risks, and implement mitigation strategies.
- Act as a trusted advisor for the customer.
- Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders. Ensure data solutions are scalable, efficient, and aligned with business requirements. Provide guidance in areas such as data modeling, database design, and data integration.
- Align coding standards, conduct code reviews to ensure proper code quality level.
- Identify and introduce quality assurance processes for data pipelines and workflows.
- Optimize data processing and storage for performance, efficiency and cost savings.
- Evaluate and implement new technologies to improve data engineering processes on various aspects (CICD, Quality Assurance, Coding standards).
- Act as main point of contact to other teams/contributors engaged in the project.
- Maintain technical documentation of the project, control validity and perform regular reviews of it.
- Ensure compliance with security standards and regulations.
What we are looking:
- A bachelor's or master's degree in Computer Science, Information Systems, or a related field is typically required. Additional certifications in cloud are advantageous.
- Minimum of 8 years of experience in data engineering or a related field.
- Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, Pyspark.
- Familiarity with Azure cloud platform viz. Azure Databricks, Data Factory, Data Lake etc., and experience in implementing data solutions in a cloud environment.
- Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions.
- In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration.
- Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues.
- Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management.
- Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies.
- Consulting exposure, with external customer focus mindset is preferred.
What we offer:
- Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
- 100% remote.
- Flexibility regarding working hours.
- Full-time position
- Comprehensive online onboarding program with a “Buddy” from day 1.
- Cooperation with top-tier engineers and experts.
- Unlimited access to the Udemy learning platform from day 1.
- Certificate training programs. Lingarians earn 500+ technology certificates yearly.
- Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
- Grow as we grow as a company. 76% of our managers are internal promotions.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
- Create our community together. Refer your friends to receive bonuses.
- Activities to support your well-being and health.
- Plenty of opportunities to donate to charities and support the environment.
Top Skills
Azure Data Factory
Azure Data Lake
Azure Databricks
Etl Frameworks
Pyspark
Python
SQL
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Recruit, develop and manage partner relationships to drive enterprise software and services revenue for the Dynatrace platform. Build joint go-to-market strategies, generate partner-sourced pipeline, run quarterly business reviews, coordinate with regional sales teams, and travel to enable partner initiatives and ensure successful execution.
Top Skills:
AWSCloud ServicesDavis AiDevOpsDynatraceGCPMicrosoftSaaS
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead 24x7 incident management to minimize service disruption, coordinate cross-team response, ensure restoration within SLAs, maintain documentation/repositories, produce post-incident reports, support problem management, and follow business continuity procedures.
Top Skills:
Itil,Etom,Wla,Ericsson Bss,Ericsson Service Layer,Ericsson Core,Ericsson Access,Eridoc,Ericoll,Gsm,Wcdma,Lte,Network Topology,Business Continuity
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Sr. Information Security Engineer leads security strategy execution, manages security alerts, develops security assessments, and mentors junior engineers, ensuring robust information security practices at BlackLine.
Top Skills:
Aws Security HubAzure Security CenterBashDlpEdrPowershellPythonScceTerraformWaf
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
