Skip to content

๐Ÿ•ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

1.4 KB
Raw Blame

title: "Scrapling CLI: ํ„ฐ๋ฏธ๋„์—์„œ ์Šคํฌ๋ž˜ํ•‘ํ•˜๊ธฐ" description: "Scrapling ํ„ฐ๋ฏธ๋„ ๋„๊ตฌ๋ฅผ ์„ค์น˜ํ•˜๊ณ  ์ถ”์ถœ ๋ช…๋ น, ๋Œ€ํ™”ํ˜• ์…ธ, MCP ์„œ๋ฒ„ ์ค‘์—์„œ ์„ ํƒํ•˜์„ธ์š”. ์ž‘์—…์— ๋งž๋Š” ์•ˆ๋‚ด๋ฅผ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค."

๋ช…๋ น์ค„ ์ธํ„ฐํŽ˜์ด์Šค {#command-line-interface}

Scrapling v0.3๋ถ€ํ„ฐ ๋‹ค์Œ ์„ธ ๊ฐ€์ง€ ์ฃผ์š” ๊ธฐ๋Šฅ์„ ๊ฐ–์ถ˜ ๋ช…๋ น์ค„ ์ธํ„ฐํŽ˜์ด์Šค๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

  1. ๋Œ€ํ™”ํ˜• ์…ธ: IPython ๊ธฐ๋ฐ˜ ์›น ์Šคํฌ๋ž˜ํ•‘ ์…ธ์ž…๋‹ˆ๋‹ค. ํŽธ๋ฆฌํ•œ ๋‹จ์ถ• ํ•จ์ˆ˜์™€ ๋„๊ตฌ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
  2. ์ถ”์ถœ ๋ช…๋ น: ํ”„๋กœ๊ทธ๋ž˜๋ฐ ์—†์ด ํ„ฐ๋ฏธ๋„์—์„œ ์›น์‚ฌ์ดํŠธ๋ฅผ ์Šคํฌ๋ž˜ํ•‘ํ•ฉ๋‹ˆ๋‹ค.
  3. ์œ ํ‹ธ๋ฆฌํ‹ฐ ๋ช…๋ น: ์„ค์น˜์™€ ๊ด€๋ฆฌ๋ฅผ ์œ„ํ•œ ๋„๊ตฌ์ž…๋‹ˆ๋‹ค.
# Launch interactive shell
scrapling shell

# Convert the content of a page to markdown and save it to a file
scrapling extract get "https://example.com" content.md

# Get help for any command
scrapling --help
scrapling extract --help

์š”๊ตฌ ์‚ฌํ•ญ {#requirements}

์ด ์„น์…˜์˜ ๊ธฐ๋Šฅ์„ ์‚ฌ์šฉํ•˜๋ ค๋ฉด shell ์ถ”๊ฐ€ ์˜์กด์„ฑ ๊ทธ๋ฃน์„ ์„ค์น˜ํ•˜์„ธ์š”.

pip install "scrapling[shell]"

๋ธŒ๋ผ์šฐ์ €๋กœ ํŽ˜์ด์ง€๋ฅผ ๊ฐ€์ ธ์˜ค๋ ค๋ฉด ๋ธŒ๋ผ์šฐ์ € ์˜์กด์„ฑ๋„ ์„ค์น˜ํ•˜์„ธ์š”.

scrapling install

Chromium๊ณผ ์‹œ์Šคํ…œ ์˜์กด์„ฑ์„ ๋‹ค์šด๋กœ๋“œํ•˜๊ณ  TLD ๋ชฉ๋ก์„ ๊ฐฑ์‹ ํ•ฉ๋‹ˆ๋‹ค. HTTP ์š”์ฒญ๋งŒ ์‚ฌ์šฉํ•  ๋•Œ๋Š” ์ด ๋‹จ๊ณ„๊ฐ€ ํ•„์š”ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.