Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
chore: fix TS dockerfiles - do not copy everything
Martin Adámekf60ce2f5d204
diff --git a/packages/templates/templates/cheerio-ts/Dockerfile b/packages/templates/templates/cheerio-ts/Dockerfileindex e92e5deb7..c13b2d3ed 100644--- a/packages/templates/templates/cheerio-ts/Dockerfile+++ b/packages/templates/templates/cheerio-ts/Dockerfile@@ -1,19 +1,25 @@-# using multistage build, as we need dev deps to build the TS source code+# First, specify the base Docker image. You can read more about+# the available images at https://crawlee.dev/docs/guides/docker-images+# You can also use any other image from Docker Hub.FROM apify/actor-node:16 AS builder-# copy all files, install all dependencies (including dev deps) and build the project-COPY . ./-RUN npm install --include=dev \- && npm run build+# Second, copy the TS source files, package.json and package-lock.json since it should be+# the only files that affects the installation and build in the next step+COPY package*.json ./+COPY src ./src-# create final image+# Install all dependencies (including dev deps) and build the project+RUN npm install --include=dev && npm run build++# Create final imageFROM apify/actor-node:16-# copy only necessary files++# Copy only necessary filesCOPY --from=builder /usr/src/app/package.json ./COPY --from=builder /usr/src/app/README.md ./COPY --from=builder /usr/src/app/dist ./dist-# install only prod deps+# Install only prod depsRUN npm --quiet set progress=false \&& npm install --only=prod --no-optional \&& echo "Installed NPM packages:" \@@ -23,5 +29,5 @@ RUN npm --quiet set progress=false \&& echo "NPM version:" \&& npm --version-# run compiled code+# Run compiled codeCMD npm run start:proddiff --git a/packages/templates/templates/playwright-ts/Dockerfile b/packages/templates/templates/playwright-ts/Dockerfileindex b76e89345..fc4850a3d 100644--- a/packages/templates/templates/playwright-ts/Dockerfile+++ b/packages/templates/templates/playwright-ts/Dockerfile@@ -1,19 +1,25 @@-# using multistage build, as we need dev deps to build the TS source code+# First, specify the base Docker image. You can read more about+# the available images at https://crawlee.dev/docs/guides/docker-images+# You can also use any other image from Docker Hub.FROM apify/actor-node:16 AS builder-# copy all files, install all dependencies (including dev deps) and build the project-COPY . ./-RUN npm install --include=dev \- && npm run build+# Second, copy the TS source files, package.json and package-lock.json since it should be+# the only files that affects the installation and build in the next step+COPY package*.json ./+COPY src ./src-# create final image+# Install all dependencies (including dev deps) and build the project+RUN npm install --include=dev && npm run build++# Create final imageFROM apify/actor-node-playwright-chrome:16-# copy only necessary files++# Copy only necessary filesCOPY --from=builder /usr/src/app/package.json ./COPY --from=builder /usr/src/app/README.md ./COPY --from=builder /usr/src/app/dist ./dist-# install only prod deps+# Install only prod depsRUN npm --quiet set progress=false \&& npm install --only=prod --no-optional \&& echo "Installed NPM packages:" \@@ -23,5 +29,5 @@ RUN npm --quiet set progress=false \&& echo "NPM version:" \&& npm --version-# run compiled code-CMD npm run start:prod+# Run compiled code+CMD ./start_xvfb_and_run_cmd.sh && npm run start:proddiff --git a/packages/templates/templates/puppeteer-ts/Dockerfile b/packages/templates/templates/puppeteer-ts/Dockerfileindex 8633e903a..7fe977f7f 100644--- a/packages/templates/templates/puppeteer-ts/Dockerfile+++ b/packages/templates/templates/puppeteer-ts/Dockerfile@@ -1,19 +1,25 @@-# using multistage build, as we need dev deps to build the TS source code+# First, specify the base Docker image. You can read more about+# the available images at https://crawlee.dev/docs/guides/docker-images+# You can also use any other image from Docker Hub.FROM apify/actor-node:16 AS builder-# copy all files, install all dependencies (including dev deps) and build the project-COPY . ./-RUN npm install --include=dev \- && npm run build+# Second, copy the TS source files, package.json and package-lock.json since it should be+# the only files that affects the installation and build in the next step+COPY package*.json ./+COPY src ./src-# create final image+# Install all dependencies (including dev deps) and build the project+RUN npm install --include=dev && npm run build++# Create final imageFROM apify/actor-node-puppeteer-chrome:16-# copy only necessary files++# Copy only necessary filesCOPY --from=builder /usr/src/app/package.json ./COPY --from=builder /usr/src/app/README.md ./COPY --from=builder /usr/src/app/dist ./dist-# install only prod deps+# Install only prod depsRUN npm --quiet set progress=false \&& npm install --only=prod --no-optional \&& echo "Installed NPM packages:" \@@ -23,5 +29,5 @@ RUN npm --quiet set progress=false \&& echo "NPM version:" \&& npm --version-# run compiled code-CMD npm run start:prod+# Run compiled code+CMD ./start_xvfb_and_run_cmd.sh && npm run start:prod