Black Box Logo

Black Box

Data Engineer

Posted 21 Days Ago
Remote
Hiring Remotely in India
Entry level
Remote
Hiring Remotely in India
Entry level
The description indicates a payroll-focused analyst role within the Payroll team, but provides no specific responsibilities, qualifications, technologies, salary, travel, or clearance requirements.
The summary above was generated by AI

Job Title: Associate Data Engineer

Job Type: Full-time

Experience Level: Fresher (1-4 Years)

About the Role:

We are looking for an enthusiastic and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you!

In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. You will get hands-on experience with modern data infrastructure, transitioning your basic academic or project-level knowledge into production-grade skills. We focus heavily on mentorship, ensuring you have the support you need to grow as a professional.

Key Responsibilities:

  • Pipeline Development: Assist in writing and maintaining ETL (Extract, Transform, Load) scripts to move data across various systems.
  • Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases to support data storage and retrieval.
  • Data Orchestration: Help schedule, monitor, and troubleshoot automated data workflows using Apache Airflow.
  • Stream Processing: Collaborate with the team to build and monitor real-time or near-real-time data streaming applications using Apache Flink.
  • Coding & Debugging: Write clean, readable, and well-documented code in Python.
  • Continuous Learning: Actively participate in code reviews, learn best practices from senior team members, and stay updated on the latest data engineering trends.

Must-Have Qualifications:

  • Education: Bachelor’s or Master’s degree in Computer Science, IT, Data Science, Mathematics, or a related field (Recent graduates from batch [Year] are welcome).
  • Python: Solid foundational knowledge of Python programming (data structures, loops, functions, basic libraries like Pandas).
  • PostgreSQL (SQL): Basic understanding of relational databases, table design, and the ability to write standard SQL queries (SELECT, JOINs, GROUP BY).
  • Apache Airflow: Theoretical understanding or project-level exposure to how Airflow works (DAGs, tasks, scheduling).
  • Apache Flink: Basic conceptual knowledge of distributed data processing or stream processing using Flink.
  • Soft Skills: Strong analytical thinking, problem-solving skills, and a genuine eagerness to learn and adapt to new technologies.

Good-to-Have (Bonus Points):

  • Spatial Data: Knowledge of the PostGIS extension for PostgreSQL and a basic understanding of how to write geo/spatial queries.
  • Version Control: Basic understanding of tools like Git/GitHub.
  • Cloud Basics: Familiarity with cloud platforms (AWS, GCP, or Azure).
  • OS: Comfortable with basic Linux/Unix command-line operations.
  • Portfolio: Any personal or academic projects showcasing data pipelines or data processing.

Similar Jobs

2 Hours Ago
In-Office or Remote
2 Locations
Expert/Leader
Expert/Leader
Information Technology
Designs and manages scalable data platforms, pipelines, ETL/ELT frameworks, data warehouses, data lakes, and lakehouse architectures. Develops batch and real-time processing solutions using cloud-native services and big data technologies. Ensures data quality, governance, security, and compliance while optimizing large-scale data performance. Supports analytics, reporting, and AI/ML initiatives, contributes to architecture reviews, automates deployments through CI/CD, provides technical leadership, and mentors junior engineers.
Top Skills: Amazon EmrAmazon RedshiftAmazon S3Apache KafkaSparkAws GlueAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure Sql DatabaseAzure Synapse AnalyticsCi/CdDelta LakeGitGoogle BigqueryGoogle Cloud StorageGoogle DataflowHadoopJenkinsAzureMicrosoft FabricMySQLOraclePostgresPysparkPythonScalaShell ScriptingSnowflakeSQLSQL Server
Yesterday
In-Office or Remote
India
Entry level
Entry level
Information Technology
Develop and support batch and incremental data pipelines, ETL workflows, SQL transformations, and Airflow orchestration. Investigate data quality issues, perform lineage and reconciliation analysis, support cloud data migrations, validate datasets, resolve production incidents, and build reusable data engineering components. Collaborate with stakeholders and technical teams on data requirements, modernization, monitoring, and process improvements.
Top Skills: Apache AirflowBigQueryCloud ComposerGoogle Cloud PlatformGoogle Cloud StorageKafkaPl/SqlPub/SubPythonSQL
Yesterday
In-Office or Remote
India
Entry level
Entry level
Information Technology
Build and support batch and incremental data pipelines, ETL workflows, Airflow DAGs, and BigQuery transformations. Ensure data quality, lineage, reconciliation, and governance across source and downstream systems. Troubleshoot pipeline failures and data discrepancies, support cloud migration initiatives, collaborate with stakeholders, and provide production support while developing reusable engineering components.
Top Skills: Apache AirflowBigQueryCdpCloud ComposerEltETLGoogle Cloud PlatformGoogle Cloud StorageMartech PlatformsPl/SqlPythonSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account