StepForge-DataCollection
Fetch user's data across social media
facebook-scraper
instagram-scraper
medium-scraper
pinterest
pinterest-scrapper
python
quora-scraper
reddit-scraper
request
scrapping-python
selenium-python
social-media
tiktok-scraper
twitter-scraper
web-scraper
web-scraping
Updated 2026-06-02 05:19:22 -07:00
A framework for creating semi-automatic web content extractors
beautifulsoup
crawler
css-selector
extractor
lxml
python
scrapers
scraping
scrapy
selector
selector-expression
tutorial
web-scraper
web-scraping
xpath-expression
Updated 2026-01-16 08:11:25 -08:00
A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.
google-scholar
google-scholar-scraper
google-scholar-scrapper
google-search-scraper
python
python-scraper
scraper-api
web-scraper
web-scraping
Updated 2025-12-30 22:50:12 -08:00
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
html2md
html-to-markdown
html-to-markdown-converter
llm
llmops
markdown
markdown-crawler
markdown-parser
markdown-scraper
md-crawler
rag
web-scraper
Updated 2023-10-30 04:46:27 -07:00
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
bloomberg
data-scraper
data-scraping
financial-data
financial-times
futures
futures-historical-data
newsletter
news-scraper
news-websites
options-data
python-web-scraper
reuters
scrapper
sraping
wallstreetbets
wall-street-journal
web-scraper
web-scrapers
web-scraping
Updated 2021-06-28 12:56:23 -07:00