Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.

Apify API client for Python

Apify actor to run web spiders written in Python in the Scrapy library

An easy-to-use tool for making web service with API from your own Python functions.

Uses Apify to scrape Google Search Engine Results pages for all American Films between 1950-2020 and then parses the knowledge panel structured data.

The official integration for Apify and Haystack 2.0

scrape news articles from investing.com as much as you want

AI Travel Assistant is a powerful AI-powered tool that helps users plan their trips effortlessly. It integrates flight search, hotel booking, and sightseeing recommendations to generate a structured travel itinerary using LangChain, Apify, and OpenAI

Our project leverages data mining techniques, including Apify, Airflow, BERT, PostgreSQL, and Power BI, to conduct in-depth sentiment analysis for bank branches. We successfully identify customer sentiments, highlight positive and negative aspects, and provide valuable insights for enhancing the customer experience and gaining a competitive edge.

Example of Python Scrapy project. It scrapes book data from https://books.toscrape.com/.

Build a tool to query Google Maps API for local restaurants and output the results to TSV

Real-time social media sentiment analysis app built with React and Flask. Fetches tweets from Apify API and analyzes sentiment using a pre-trained model. Visualizes results in a user-friendly pie chart.

Analyse social media sentiment of OpenAI using LinkedIn data with NLP and transfer learning

Python client for Apify API.

Our project's mission is to build a resilient data warehouse solution, facilitating comprehensive analysis of customer feedback for each CIH Bank branch. In the ever-competitive banking landscape, harnessing customer sentiment is paramount for service improvement, elevated satisfaction, and data-informed decisions

thousands of Python scrapers for store locator

All the scripts and data for the “Network Science” group project (A.Y. 2024-25)

Ask questions related to langchain course brought by Activeloop.