Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Fix unrelated broken test
Ondra Urban845539e22e49
diff --git a/test/utils.js b/test/utils.jsindex d3e95426e..c02befcfb 100644--- a/test/utils.js+++ b/test/utils.js@@ -748,33 +748,33 @@ describe('utils.htmlToText()', () => {it('handles larger HTML documents', () => {const html1 = fs.readFileSync(path.join(__dirname, 'data', 'html_to_text_test.html'), 'utf8');- // Careful here - don't change spaces in the text below or the test will break!- /* eslint-disable no-tabs */+ // Careful here - don't change any whitespace in the text below or the test will break, even trailing!+ /* eslint-disable */checkHtmlToText(html1,- `Let's start with a simple text.-The ships hung in the sky, much the way that bricks don't.+ `Let's start with a simple text.+The ships hung in the sky, much the way that bricks don't.These aren't the Droids you're looking forI'm sorry, Dave. I'm afraid I can't do that.I'm sorry, Dave. I'm afraid I can't do that.-A1 A2 A3-B1 B2 B3 B 4-This is some text with inline elements and HTML entities (>bla<)+A1 A2 A3\t+B1 B2 B3 B 4\t+This is some text with inline elements and HTML entities (>bla<)Testafewlinebreaks-Spaces in an inline text should be completely ignored.+Spaces in an inline text should be completely ignored.But,a pre-formattedblock should be keptpre-formatted.-The Greatest Science Fiction Quotes Of All Time+The Greatest Science Fiction Quotes Of All TimeDon't know, I don't know such stuff. I just do eyes, ju-, ju-, just eyes... just genetic design, just eyes. You Nexus, huh? I design your eyes.`,true,);- /* eslint-enable no-tabs */+ /* eslint-enable */});it('works with Cheerio object', () => {