Terminal
Terminal/Skill
Turns web pages or topics into organized markdown for RAG chunks, fine-tuning datasets, reference docs or docs mirrors.
By Firecrawl
Works with
npx skills add firecrawl/firecrawl-workflows --skill firecrawl-knowledge-baseUse this to turn URLs or topics into organized LLM-ready content.
Infer the source, goal, depth, and output location from context. If the source and goal are clear, proceed immediately.
Ask at most 1-3 concise questions only if blocked, such as the source URL/topic, whether the output is reference/RAG/training/docs, or training format if training is requested.
Use Firecrawl map for documentation sites, search for topic-based corpora, scrape pages into markdown, and preserve code examples and tables.
For files, follow the Firecrawl download-style convention:
.firecrawl/
<hostname>/
<path>/
index.md
If appropriate, use sub-agents or equivalent parallel task runners:
index.md, and sources.json.manifest.json.training-data.jsonl and training-metadata.json.# Knowledge Base: [Source]
## Summary
[What was collected and why]
## Output Structure
[Files/directories created]
## Coverage
[Sections, source types, counts]
## Usage Notes
[How to use in RAG, docs, training, or agent context]
## Sources
[URLs collected]
## Rerun Inputs
workflow: firecrawl-knowledge-base
source: [url/topic]
goal: [reference/rag/train/docs]
depth: [quick/thorough/exhaustive]
output_dir: [.firecrawl/]