Questions? hello@viberation.devGet supportBlogDocsChangelog

Colour mode

XGitHub
Get started

Just Scrape

Skills#automation

Scrape, crawl and pull structured data from the web.

ScrapeGraphAI's skill for searching the web, scraping pages, crawling documentation and extracting JSON from sites. Needs the ScrapeGraph AI CLI.

Install this skill

npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape

Runs the open-source skills CLI in your own terminal. It asks which agents to add the skill to. Read what it tells your agent to do before you install it.

Download skill (.zip)

Install for your agent

  • Claude Code

    Run this in your project

    npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape -a claude-code

    Add -g to install it for every project instead.

    Or ask Claude Code to do it

    Install the "just-scrape" skill from https://github.com/scrapegraphai/just-scrape for Claude Code.
Copy the skill folder (the one containing SKILL.md, with any scripts or reference files next to it) into .claude/skills/ in this project.
Before copying, show me the SKILL.md and list any scripts it includes, and wait for me to confirm.

    Or copy the folder yourself

    Unzip the download into .claude/skills/ for this project, or ~/.claude/skills/ for all your projects.

    Picked up in the current session, no restart needed.

    Claude Code skills docs
  • Claude.aiNot supported

    This skill is marked as not working in Claude.ai, usually because it needs a terminal or files that Claude.ai does not have.

    Claude.ai skills docs
  • ChatGPTNot supported

    This skill is marked as not working in ChatGPT, usually because it needs a terminal or files that ChatGPT does not have.

    ChatGPT skills docs
  • Codex

    Run this in your project

    npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape -a codex

    Add -g to install it for every project instead.

    Or ask Codex to do it

    Install the "just-scrape" skill from https://github.com/scrapegraphai/just-scrape for Codex.
Copy the skill folder (the one containing SKILL.md, with any scripts or reference files next to it) into .agents/skills/ in this project.
Before copying, show me the SKILL.md and list any scripts it includes, and wait for me to confirm.

    Or copy the folder yourself

    Unzip the download into .agents/skills/ for this project, or ~/.agents/skills/ for all your projects.

    Restart Codex if the skill does not show up.

    Codex skills docs
  • Cursor

    Run this in your project

    npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape -a cursor

    Add -g to install it for every project instead.

    Or ask Cursor to do it

    Install the "just-scrape" skill from https://github.com/scrapegraphai/just-scrape for Cursor.
Copy the skill folder (the one containing SKILL.md, with any scripts or reference files next to it) into .cursor/skills/ in this project.
Before copying, show me the SKILL.md and list any scripts it includes, and wait for me to confirm.

    Or copy the folder yourself

    Unzip the download into .cursor/skills/ for this project, or ~/.cursor/skills/ for all your projects.

    Run it by typing / and the skill name in chat.

    Cursor skills docs
  • GitHub Copilot

    Run this in your project

    npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape -a github-copilot

    Add -g to install it for every project instead.

    Or ask GitHub Copilot to do it

    Install the "just-scrape" skill from https://github.com/scrapegraphai/just-scrape for GitHub Copilot.
Copy the skill folder (the one containing SKILL.md, with any scripts or reference files next to it) into .github/skills/ in this project.
Before copying, show me the SKILL.md and list any scripts it includes, and wait for me to confirm.

    Or copy the folder yourself

    Unzip the download into .github/skills/ for this project, or ~/.copilot/skills/ for all your projects.

    Works in Copilot CLI, the cloud agent and agent mode in VS Code and JetBrains.

    GitHub Copilot skills docs
  • Antigravity

    Run this in your project

    npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape -a antigravity

    Add -g to install it for every project instead.

    Or ask Antigravity to do it

    Install the "just-scrape" skill from https://github.com/scrapegraphai/just-scrape for Antigravity.
Copy the skill folder (the one containing SKILL.md, with any scripts or reference files next to it) into .agents/skills/ in this project.
Before copying, show me the SKILL.md and list any scripts it includes, and wait for me to confirm.

    Or copy the folder yourself

    Unzip the download into .agents/skills/ for this project, or ~/.gemini/config/skills/ for all your projects.

    Antigravity skills docs
  • Gemini CLI

    Run this in your project

    npx skills add https://github.com/scrapegraphai/just-scrape --skill just-scrape -a gemini-cli

    Add -g to install it for every project instead.

    Or ask Gemini CLI to do it

    Install the "just-scrape" skill from https://github.com/scrapegraphai/just-scrape for Gemini CLI.
Copy the skill folder (the one containing SKILL.md, with any scripts or reference files next to it) into .gemini/skills/ in this project.
Before copying, show me the SKILL.md and list any scripts it includes, and wait for me to confirm.

    Or copy the folder yourself

    Unzip the download into .gemini/skills/ for this project, or ~/.gemini/skills/ for all your projects.

    Run /skills to check it was found.

    Gemini CLI skills docs
Installs
245K via skills.sh
GitHub
58 stars ↗
Last updated
7 Sept 2026
Licence
MIT

Security checks

Run by independent scanners and published on skills.sh. Their results, not a Viberation review.

  • Gen Agent Trust Hub Pass

    The skill provides documentation and usage examples for the 'just-scrape' CLI, an AI-powered web scraping and data extraction tool by ScrapeGraph AI. It facilitates tasks such as website crawling, structured data extraction, and page change monitoring. Analysis of the instructions and commands found no malicious patterns; the skill uses official vendor resources and follows standard practices for CLI tools.

    30 Apr 2026

  • Socket Pass

    No alerts

    30 Apr 2026

  • Snyk Warning

    Risk: MEDIUM · 1 issue

    30 Apr 2026

  • Runlayer Warning

    1/1 file flagged

    21 Feb 2026
What's inside (1 file)
  • SKILL.md12.1K chars

SKILL.md, first part. Shown as plain text.

---
name: just-scrape
description: Search, scrape, crawl, extract structured data, and monitor web pages via the ScrapeGraph AI CLI. Use when the user asks to search the web, scrape a webpage, grab content from a URL, extract JSON from a site, crawl documentation or site sections, monitor a page for changes, inspect request history, check ScrapeGraph credits, or validate API setup.
compatibility: "Requires the just-scrape CLI (`npm install -g just-scrape`). Requires `SGAI_API_KEY` for ScrapeGraph AI requests."
license: MIT
allowed-tools: Bash
metadata:
  openclaw:
    requires:
      bins:
        - just-scrape
    install:
      - kind: node
        package: just-scrape
        bins: [just-scrape]
    homepage: https://github.com/ScrapeGraphAI/just-scrape
---

# just-scrape CLI

Search, scrape, crawl, extract structured JSON, and monitor page changes using the just-scrape CLI.

Run `just-scrape --help` or `just-scrape <command> --help` for full option details.

If the task is to integrate ScrapeGraph AI into application code, add `SGAI_API_KEY` to a project, or choose endpoint usage in product code, inspect the project first and use the ScrapeGraph AI SDK/API docs directly instead of this CLI skill.

## Prerequisites

Must be installed and authenticated. Check with `just-scrape validate` and `just-scrape credits`.

```bash
command -v just-scrape >/dev/null 2>&1 || npm install -g just-scrape@latest
just-scrape validate
just-scrape credits
```

- **API key**: Set `SGAI_API_KEY`, use a `.env` file, use `~/.scrapegraphai/config.json`, or complete the interactive prompt.
- **Credits**: Remaining ScrapeGraph AI credits. Each operation consumes credits.

Before doing real work, verify the setup with one small request:

```bash
mkdir -p .just-scrape
just-scrape scrape "https://example.com" --json > .just-scrape/install-check.json
```

```bash
just-scrape search "query" --num-results 3 --json > .just-scrape/search-check.json
```

## Workflow

Follow this escalation pattern:

1. **Search** - No specific URL yet. Find pages, answer questions, discover sources.
2. **Scrape** - Have a URL. Extract markdown, html, screenshots, links, images, summaries, or branding.
3. **Extract** - Need structured JSON from a known URL with an AI prompt and optional schema.
4. **Crawl** - Need bulk content from an entire site section.
5. **Monitor** - Need scheduled page-change tracking with optional webhook notifications.

| Need                        | Command    | When                                       |
| --------------------------- | ---------- | ------------------------------------------ |
| Find pages on a topic       | `search`   | No specific URL yet                        |
| Get a page's content        | `scrape`   | Have a URL, need one or more page formats  |
| AI-powered data extraction  | `extract`  | Need structured data from a known URL      |
| Bulk extract a site section | `crawl`    | Need many pages or docs sections           |
| Track changes over time     | `monitor`  | Need recurring scraping and webhooks       |
| Inspect prior requests      | `history`  | Need past request IDs, status, or payloads |
| Check credit balance        | `credits`  | Need remaining API credits                 |
| Validate API setup          | `validate` | Need health check and API key validation   |

For detailed command reference, run `just-scrape <command> --help`.

**Scrape vs extract:**

- Use `scrape` for raw page formats: `markdown`, `html`, `screenshot`, `branding`, `links`, `images`, `summary`.
- Use `scrape -f json -p "<prompt>"` or `extract -p "<prompt>"` for AI-structured output.
- Use `extract` when the task is only structured data. Use `scrape` when mixed formats are needed in one call.

**Avoid redundant fetches:**

- `search -p` can extract structured data from search results. Do not re-scrape those URLs unless results are incomplete.
- `crawl` already fetches per-page formats. Do not re-scrape every crawled URL unless a second pass i

Key info

Pricing
Open source
Category
Skills

Related reading

  • Context engineering

    Writing your first skill

    You already have a skill in you: the thing you keep typing into every session. Write it down once.

    Intermediate

More in Skills