Skip to content

๐Ÿ•ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

1.6 KB
Raw Blame

title: "Python HTML ํŒŒ์„œ ์„ฑ๋Šฅ ๋น„๊ต: Scrapling๊ณผ ๋‹ค๋ฅธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ" description: "HTML ํŒŒ์‹ฑ, ํ…์ŠคํŠธ ์ถ”์ถœ, ๋น„์Šทํ•œ ์š”์†Œ ์ฐพ๊ธฐ์—์„œ Scrapling๊ณผ ๋‹ค๋ฅธ Python ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์˜ ์„ฑ๋Šฅ์„ ๋น„๊ตํ•ฉ๋‹ˆ๋‹ค."

์„ฑ๋Šฅ ํ…Œ์ŠคํŠธ {#performance-benchmarks}

Scrapling์€ ๊ฐ•๋ ฅํ•  ๋ฟ ์•„๋‹ˆ๋ผ ๋งค์šฐ ๋น ๋ฆ…๋‹ˆ๋‹ค. ๋‹ค์Œ ํ…Œ์ŠคํŠธ๋Š” Scrapling ํŒŒ์„œ์™€ ๋„๋ฆฌ ์“ฐ์ด๋Š” ๋‹ค๋ฅธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ๋น„๊ตํ•ฉ๋‹ˆ๋‹ค.

ํ…์ŠคํŠธ ์ถ”์ถœ ์†๋„: ์ค‘์ฒฉ ์š”์†Œ 5,000๊ฐœ {#text-extraction-speed-test-5000-nested-elements}

# ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์‹œ๊ฐ„(ms) Scrapling ๋Œ€๋น„
1 Scrapling 1.99 1.0x
2 Parsel/Scrapy 2.06 1.035
3 Lxml ๋‹จ๋… 2.56 1.286
4 PyQuery 23.98 ~12x
5 Selectolax 197.02 ~99x
6 MechanicalSoup 1545.15 ~776.5x
7 BS4 + Lxml 1562.1 ~785.0x
8 BS4 + html5lib 3412.73 ~1714.9x

๋น„์Šทํ•œ ์š”์†Œ ์ฐพ๊ธฐ์™€ ํ…์ŠคํŠธ ๊ฒ€์ƒ‰ {#element-similarity-text-search-performance}

Scrapling์˜ ์ ์‘ํ˜• ์š”์†Œ ๊ฒ€์ƒ‰์€ ๋‹ค๋ฅธ ๋ฐฉ๋ฒ•๋ณด๋‹ค ํ›จ์”ฌ ๋น ๋ฆ…๋‹ˆ๋‹ค:

๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์‹œ๊ฐ„(ms) Scrapling ๋Œ€๋น„
Scrapling 2.3 1.0x
AutoScraper 12.58 5.47x

๊ฐ ๊ฒฐ๊ณผ๋Š” ์‹œ๊ฐ„์„ ์ธก์ •ํ•œ 100ํšŒ ์‹คํ–‰์˜ ํ‰๊ท ์ž…๋‹ˆ๋‹ค. ์ธก์ • ๋ฐฉ๋ฒ•์€ benchmarks.py๋ฅผ ํ™•์ธํ•˜์„ธ์š”.