The Data Engineer will collaborate with various teams to implement data management and security solutions, improve telemetry services, manage data architecture, perform threat analysis, ensure compliance, conduct risk assessments, and train stakeholders. This role requires strong data engineering skills and expertise in cloud environments.
- Work collaboratively with application development, data protection, information security, and risk management teams to understand and implement data security and management solutions.
- Continuously improve security & observability telemetry services based on input from a diverse network of internal and external stakeholders, and technology teams as well as the IT industry at large.
- Data Management: Define and manage data models, schemas, metadata, and security rules. Design, create, deploy, and manage databases and data structures on premise and in the cloud to fulfill business requirements.
- Threat Analysis: Identify and mitigate potential security risks in the organization's data architecture.
- Compliance: Ensure compliance with data privacy laws and regulations.
- Risk Management: Conduct risk assessments and take appropriate actions to mitigate the risks associated with data security.
- Training and Development: Train and educate stakeholders about our data
- Collaboration: Collaborate with other IT team members, stakeholders, and executives to ensure the security of data architectures.
- Minimum 6+ years of Data Ingestion, Integration, ETL, or security engineering experience with large scale implementations distributed globally
- Extensive knowledge of a globally distributed environment across multiple platforms such as AWS, Azure and GCP
- Data-driven mindset
- Strong understanding of Data Management or Data Engineering
- Strong grounding in data analysis and related processes
- Experienced in Agile methods, experience in Atlassian stack (i.e., JIRA) or related tools
- Ability to Develop roadmaps and the underlying strategies for the data centric products and services
- Experience with standard monitoring frameworks and observability products
- Experience with hybrid environment data sources, data collectors and instrumentation
- Expertise in the use SIEM solutions for basic and advanced detection methods, including cloud-based data sources
- Experience with security monitoring & observability solutions such as Splunk, Sumo, Datadog, New Relic, AppDynamics
- Experience of working with cloud and data security in a DevSecOps/IRE and agile working environments.
- Expertise in at least one scripting language (PowerShell, Python, Bash)
- Experience in container/container orchestration technologies - Docker and Kubernetes
- Experience w/systems configuration orchestration tools - Ansible or Terraform
- Understanding of infrastructure as a code and concepts
- Related security certifications (e.g. CISSP, CCSP, SABSA, ITIL etc.).
- Familiarity and experience with the Splunk SPL query language.
- 3+ years familiarity and experience with Linux / Ubuntu / Mac systems
- Experience in creating dashboards, queries, alerts in Splunk, Data Dog, Sumo
- Experience in troubleshooting issues with Splunk connectivity including, networking, server (windows and Linux), and application tiers.
Top Skills
Bash
Powershell
Python
Similar Jobs
As a Data Engineer at Atlassian, you will build and maintain data lakes, improve data pipelines, and develop micro-services to support business growth. You will collaborate with stakeholders to enhance data ingest processes and ensure effective data management, working with technologies like AWS, Spark, and Airflow.
The Finance Data Engineer will design, develop, and maintain data pipelines for finance use cases, ensuring data accuracy and timeliness. The role requires collaborating with stakeholders to enhance data delivery, manage data integration from various sources, and utilize skills in ETL, SQL, and data visualization.
As a Security Engineer II, you will deliver secure software solutions, execute standard security protocols, write secure code, analyze threats, and contribute to team culture. You will work on system design, application development, and continuity-related training.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
