This role involves collaborating with users to build data solutions, managing AWS data technologies, and automating workflows for efficiency.
This is a remote position.
Responsibilities:
• Partner with our users and other data product teams to understand business needs to build impactful data/analytics solutions
• Build the infrastructure required for optimal extraction, transformation, and loading of data from various data sources using AWS ‘big data’ technologies
• Uses standardized processes for requirements definition, analysis, design, construct, and test activities
• Automate repeatable tasks to create efficiencies in our workflows and enable freedom for innovation
• Modifies existing systems or integrates packaged systems with existing infrastructure to meet business requirements
• Development and support of multiple AWS solutions to support critical business applications
Requirements
Essential Requirements:
- Experience with Data Warehousing, Data Lake, Analytic processes, and methodologies.
- Proficient in writing and optimizing SQL queries and other procedures/scripts
- Strong data model design and implementation experience
- Strong experience with AWS data technologies (such as Aurora Postgres, S3, Lambda, Redshift & other AWS Data Services) covering security, policies, access management
- Experience with AWS ETL/File Movement tools such as GLUE, Athena and other AWS integration products.
- Experience with Agile Development, Jira, CI/CD and GitHub
- Programming experience with SQL and Python
Similar Jobs
Fintech • Financial Services
The Data Engineer will design, develop, and maintain data pipelines and solutions, ensuring data quality and collaborating with cross-functional teams to meet analytics needs.
Top Skills:
Apache AirflowSparkAWSAzureDockerDynamoDBGCPGitHadoopJavaJenkinsKafkaKubernetesLuigiMongoDBMySQLNode.jsPostgresPythonTerraform
.jpg)
Fintech • Analytics
As a Lead AWS Data Engineer, you'll design and develop scalable data pipelines, orchestrate data workflows using AWS tools, and collaborate with business teams to create data-driven solutions. You'll apply modern software engineering practices and continuously learn about the finance domain.
Top Skills:
Apache IcebergSparkAws EmrAws GlueAws LambdaAws S3Python
Fintech • Financial Services
Lead the design and development of scalable data pipelines using Ab-initio and Python, migrating workflows, ensuring data quality, and mentoring team members.
Top Skills:
Ab-InitioAWSAzureDeltaDockerGCPGitPandasParquetPysparkPythonSparkSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
