Workflow automation and web extraction
Find integrations, web extraction, conversion and orchestration tools by inputs, triggers and outputs.
New projects join this topic as the archive updates. Browse the latest recorded projects first.
Choose by your task
8 projects
Scrapling
D4Vinci/Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Explore Scrapling →Agent-Reach
Panniantong/Agent-Reach
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Explore Agent-Reach →treg
superdesigndev/treg
OpenRouter for agent tools. Join community here: https://discord.gg/6mQYYfFMAn
Explore treg →n8n
n8n-io/n8n
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
Explore n8n →markitdown
microsoft/markitdown
Python tool for converting files and office documents to Markdown.
Explore markitdown →crawl4ai
unclecode/crawl4ai
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
Explore crawl4ai →MediaCrawler
NanmiCoder/MediaCrawler
See the project overview and official repository for its purpose and setup.
Explore MediaCrawler →Questions before choosing
What makes an automation maintainable?
Start with a small repeatable workflow and define inputs, outputs, retries and duplicate handling. Check third-party permissions, quotas and data storage.
Projects are grouped using their saved purpose descriptions. Topic membership is a discovery aid, not an installation or performance test. Check each project’s overview and official documentation for requirements, sources and versions.
Explore other topics →