🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
title: "Scrapling CLI: Scrape from the Terminal" description: "Install Scrapling terminal tools and choose between extract commands, the interactive shell and the MCP server. Follow the guide for your task."
Command Line Interface
Since v0.3, Scrapling includes a powerful command-line interface that provides three main capabilities:
- Interactive Shell: An interactive Web Scraping shell based on IPython that provides many shortcuts and useful tools
- Extract Commands: Scrape websites from the terminal without any programming
- Utility Commands: Installation and management tools
# Launch interactive shell
scrapling shell
# Convert the content of a page to markdown and save it to a file
scrapling extract get "https://example.com" content.md
# Get help for any command
scrapling --help
scrapling extract --help
Requirements
This section requires you to install the extra shell dependency group, like the following:
pip install "scrapling[shell]"
For browser fetching, also install the browser dependencies:
scrapling install
This downloads Chromium and its system dependencies, and updates the TLD list. HTTP requests do not need this step.