website-crawler

Uzay-G/whorl

Crawl and ingest websites into whorl. Use when scraping a personal site, blog, or extracting web content for the knowledge base.

1 stars

0 forks

Python

72 views

View on GitHub Add to Favorites

Installation

Option 1: Use slash command in Claude Code

/install-skill https://github.com/Uzay-G/whorl/tree/main/skills/website-crawler

Option 2: Clone to skills directory

# Global (all projects)

git clone https://github.com/Uzay-G/whorl/tree/main/skills/website-crawler ~/.claude/skills/whorl

# Project-specific

git clone https://github.com/Uzay-G/whorl/tree/main/skills/website-crawler .claude/skills/whorl

Add MCP server to .cursor/mcp.json:

{
  "mcpServers": {
    "skillz": {
      "command": "npx",
      "args": ["-y", "skillz-mcp", "https://github.com/Uzay-G/whorl/tree/main/skills/website-crawler"]
    }
  }
}

Restart Cursor after adding the configuration.

Option 1: Use Gemini CLI command

gemini extensions install https://github.com/Uzay-G/whorl/tree/main/skills/website-crawler

Option 2: Clone to extensions directory

git clone https://github.com/Uzay-G/whorl/tree/main/skills/website-crawler ~/.gemini/extensions/whorl

Topics

Related Skills

skill-writer

Tensors and Dynamic neural networks in Python with strong GPU acceleration

xlsx

Public repository for Agent Skills

agno

The programming language for agentic software. Build, run, and manage multi-agent systems at scale.

youtube-downloader

A curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows