Similar Jobs

Alternative Path

Data Engineer

3 Days Ago

In-Office or Remote

Mid level

Information Technology • Consulting

Design and maintain web scrapers for alternative datasets, clean and transform large data sets using Python and Pandas, and ingest data into databases or warehouses. Build scheduled workflows with Airflow, create quality-control checks, maintain alerting systems, investigate data incidents, and develop tools for the web-scraping platform. Collaborate with analysts and cross-functional teams to deliver reliable datasets and data products.

Top Skills: Apache AirflowAPIsAws LambdaAws RdsAws S3Aws SnsAws SqsDockerFiddlerGitlab Ci/CdHTMLJavaScriptJenkinsKubernetesPandasPostmanPythonScrapySeleniumSQLXpath

Alternative Path

Senior Data Engineer

3 Days Ago

In-Office or Remote

Senior level

Information Technology • Consulting

Design, maintain, and improve web scrapers for alternative datasets; clean, transform, validate, and load data into databases or warehouses; orchestrate pipelines with Airflow; and build quality checks, alerts, and data tools. Collaborate with analysts and cross-functional teams to define data requirements, investigate time-sensitive incidents, and support investment decision-making through reliable datasets and notifications.

Top Skills: Apache AirflowAPIsAws LambdaAws RdsAws S3Aws SnsAws SqsCi/CdDockerFiddlerGithub ActionsHTMLJavaScriptJenkinsKubernetesPandasPostmanPythonScrapySeleniumSQLXpath

JPMorganChase

Agentic Development - Vice President

An Hour Ago

Remote or Hybrid

India

Expert/Leader

Financial Services

Lead development and delivery of production agentic/autonomous AI components, integrating LLMs and agentic frameworks into business platforms. Build, test, containerize, and deploy cloud-native solutions using IaC and DevOps practices; document designs, ensure code quality and compliance, own workstreams, and manage a team of senior engineers across global locations.

Top Skills: AutogenAWSCi/CdCloudFormationDockerEksGenaiGoogle AdkJIRAKubernetesLanggraphLlmsMlopsPythonRagRdsS3Terraform

Design and implement web scraping solutions using languages like Python or JavaScript and libraries such as Beautiful Soup, Selenium, and Scrapy. Automate data collection, perform cleansing and validation, transform data for reporting and integration, document processes, collaborate with cross-functional teams, and transfer knowledge to stakeholders.

The summary above was generated by AI

Job Title: Web Scraping Engineer

Location: Remote
Experience:5+ Years
JD:
Expert in developing web scrapers and facilitate interactions with web pages

Design and implement web scraping solutions to extract data from various web sources.
Strong programming skills in languages commonly used for web scraping, such as Python, JavaScript, or similar.
Familiarity with web scraping libraries and frameworks (e.g., Beautiful Soup, Selenium, Scrapy).
Automate data collection processes and ensure data quality through cleansing and validation.
Prepare and transform data for reporting, analytics, and integration into other systems.
Collaborate with cross-functional teams to understand data requirements and develop effective solutions.
Document processes and create technical documentation for implemented solutions.
Provide knowledge transfer to team members and stakeholders regarding automated processes and tools.

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.