Skillsoft Logo

Skillsoft

Senior Data Engineer - Enterprise Data Solutions

Posted Yesterday
Be an Early Applicant
In-Office
Hyderabad, Telangana
Senior level
In-Office
Hyderabad, Telangana
Senior level
The Senior Data Engineer will lead data ingestion, processing, and storage using Azure Databricks and SQL, collaborating on data-driven solutions and supporting business analytics.
The summary above was generated by AI

At Skillsoft, we propel organizations and people to grow together through transformative learning experiences. We believe every team member has the potential to be AMAZING. Join us in our quest to transform learning and help individuals unleash their edge.

In this role you will be joining the Enterprise Data Solutions team, within the Digital & Information Technology organization. Driven by a passion for operational excellence and innovation, we partner with all functional groups to provide the expertise and technologies which will enable the company to digitalize, simplify, and scale for the future.

We are seeking an experienced Sr. Data Engineer to join our Enterprise Data Solutions team. The ideal candidate will have a strong background in data engineering, data analysis, business intelligence, and data management. This role will be responsible for the ingestion, processing, and storage of data in our Azure Databricks Data Lake and SQL Server data warehouses.

OVERVIEW:

The Enterprise Data Solutions team provides Skillsoft with the data backbone needed to seamlessly connect systems and enable data-driven business insights through democratized and analytics-ready data sets. Our mission is to:

  • Deliver analytics-ready data sets that enhance business insights, drive decision making, and foster a culture of data-driven innovation.
  • Set a gold standard for process, collaboration, and communication.

OPPORTUNITY HIGHLIGHTS:

  • Lead the identification of business data requirements, create data models and design processes that align to the business logic and regularly communicate with business stakeholders to ensure delivery meets business needs.
  • Design ETL processes, develop source-to-target mappings/integration workflows and manage load processes to support regular and ad hoc activities considering the needs of down-stream systems, functions and visualizations.
  • Work with the latest open-source tools, libraries, platforms and languages to build data products enabling other analysts to explore and interact with large and complex data sets
  • Build robust systems and reusable code modules to solve problems across the team and organization with an eye on the long-term maintenance and support of the application
  • Perform routine testing of own and others’ work to guarantee accurate, complete processes that support business needs. Awareness and compliance with all organizational development standards, industry best practices and business, security, privacy, and retention requirements.
  • Routinely monitor performance, diagnose and implement tuning/optimization strategies to guarantee a highly efficient data structure.
  • Collaborate with other engineers through active participation in code reviews and challenge the team to deliver with precision, consistency and speed.
  • Document data flows and technical designs to ensure compliance with organization, business and security best practices.
  • Regularly monitor timelines and workload. Ensure delivery promises are met or exceeded.
  • Ability and willingness to support the BI mission through learning new technologies and supporting other projects as needed.
  • Provides code reviews and technical guidance to the team.
  • Collaborate closely with the SA and TPO and get the requirements and develop the enterprise solutions

SKILLS & QUALIFICATIONS:

  • Bachelor’s degree in quantitative field – engineering, finance, data science, statistics, economics, or other quantitative.
  • 5+ years of experience in Data Engineering/Data Management space and working with enterprise level production data warehouses.
  • 5+ years of experience in working with Azure Databricks
  • 5+ years experience in SQL and PySpark
  • Ability to work in an Agile methodology environment.
  • Experience and interest in cloud migration/journey to the cloud for data platforms and landscape
  • Strong business acumen, analytical skills, and technical abilities
  • Practical problem-solving skills and ability to move complex projects forward.
MORE ABOUT SKILLSOFT:

Skillsoft delivers online learning, training, and talent solutions to help organizations unleash their edge. Leveraging immersive, engaging content, Skillsoft enables organizations to unlock the potential in their best assets – their people – and build teams with the skills they need for success. Empowering 36 million learners and counting, Skillsoft democratizes learning through an intelligent learning experience and a customized, learner-centric approach to skills development with resources for Leadership Development, Business Skills, Technology & Development, Digital Transformation, and Compliance.

Skillsoft is partner to thousands of leading global organizations, including many Fortune 500 companies. The company features three award-winning systems that support learning, performance and success: Skillsoft learning content, the Percipio intelligent learning experience platform, which offers measurable impact across the entire employee lifecycle. Learn more at www.skillsoft.com.

Thank you for taking the time to learn more about us. 
If this opportunity intrigues you, we would love for you to apply!

NOTE TO EMPLOYMENT AGENCIES: We value the partnerships we have built with our preferred vendors. Skillsoft does not accept unsolicited resumes from employment agencies.  All resumes submitted by employment agencies directly to any Skillsoft employee or hiring manager in any form without a signed Skillsoft Employment Agency Agreement on file and search engagement for that position will be deemed unsolicited in nature.  No fee will be paid in the event the candidate is subsequently hired as a result of the referral or through other means.

Skillsoft is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, age, national origin, disability, veteran status, genetic information, and other legally protected categories.

Top Skills

Azure Databricks
Pyspark
SQL

Similar Jobs at Skillsoft

5 Days Ago
Hyderabad, Telangana, IND
Senior level
Senior level
Artificial Intelligence • Consumer Web • Edtech • HR Tech • Information Technology • Software • Conversational AI
The Data Integration Engineer will manage ETL processes and transition to API-based solutions, ensuring data accuracy and modernizing workflows.
Top Skills: AgileAIAPIsC#Cloud-Based Data IntegrationETLMlScrumSQLSsis
20 Hours Ago
Hyderabad, Telangana, IND
Junior
Junior
Artificial Intelligence • Consumer Web • Edtech • HR Tech • Information Technology • Software • Conversational AI
The Software Engineer II will develop web applications, collaborate with teams to enhance user experience, and maintain APIs. They will drive high-quality software with automated testing.
Top Skills: AngularjsDockerJavaScriptKubernetesMongoDBPostgresReactTypescriptVue
Yesterday
Hyderabad, Telangana, IND
Mid level
Mid level
Artificial Intelligence • Consumer Web • Edtech • HR Tech • Information Technology • Software • Conversational AI
Responsible for supporting integration and automation platforms, troubleshooting incidents, managing support tickets, and driving continuous improvement in operations.
Top Skills: Azure Key VaultFreshservicesJIRAMicrosoft Power AutomateWorkato

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account