Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Update self-hosted Kubernetes deployments examples for compatibility and consistency (#1177)
Tetsuro Yokoyama5ac6eb7440ab
diff --git a/apps/api/docker-entrypoint.sh b/apps/api/docker-entrypoint.shindex 0e8d72bb0..6b09e7053 100755--- a/apps/api/docker-entrypoint.sh+++ b/apps/api/docker-entrypoint.sh@@ -1,6 +1,6 @@#!/bin/bash -e-if [ $UID -eq 0 ]; then+if [ "$UID" -eq 0 ]; thenset +e # disable failing on errrorulimit -n 65535echo "NEW ULIMIT: $(ulimit -n)"@@ -9,13 +9,13 @@ elseecho ENTRYPOINT DID NOT RUN AS ROOTfi-if [ $FLY_PROCESS_GROUP = "app" ]; then+if [ "$FLY_PROCESS_GROUP" = "app" ]; thenecho "RUNNING app"node --max-old-space-size=8192 dist/src/index.js-elif [ $FLY_PROCESS_GROUP = "worker" ]; then+elif [ "$FLY_PROCESS_GROUP" = "worker" ]; thenecho "RUNNING worker"node --max-old-space-size=8192 dist/src/services/queue-worker.js-elif [ $FLY_PROCESS_GROUP = "index-worker" ]; then+elif [ "$FLY_PROCESS_GROUP" = "index-worker" ]; thenecho "RUNNING index worker"node --max-old-space-size=8192 dist/src/services/indexing/index-worker.jselsediff --git a/examples/kubernetes/cluster-install/README.md b/examples/kubernetes/cluster-install/README.mdindex 6febc616a..126c638d6 100644--- a/examples/kubernetes/cluster-install/README.md+++ b/examples/kubernetes/cluster-install/README.md@@ -12,12 +12,12 @@2. Build Docker images, and host it in your Docker Registry (replace the target registry with your own)1. API (which is also used as a worker image)1. ```bash- docker build --no-cache -t ghcr.io/winkk-dev/firecrawl:latest ../../../apps/api+ docker build --no-cache --platform linux/amd64 -t ghcr.io/winkk-dev/firecrawl:latest ../../../apps/apidocker push ghcr.io/winkk-dev/firecrawl:latest```2. Playwright1. ```bash- docker build --no-cache -t ghcr.io/winkk-dev/firecrawl-playwright:latest ../../../apps/playwright-service+ docker build --no-cache --platform linux/amd64 -t ghcr.io/winkk-dev/firecrawl-playwright:latest ../../../apps/playwright-servicedocker push ghcr.io/winkk-dev/firecrawl-playwright:latest```3. Replace the image in [worker.yaml](worker.yaml), [api.yaml](api.yaml) and [playwright-service.yaml](playwright-service.yaml)diff --git a/examples/kubernetes/cluster-install/api.yaml b/examples/kubernetes/cluster-install/api.yamlindex 54ecfbf6e..c860e4b6c 100644--- a/examples/kubernetes/cluster-install/api.yaml+++ b/examples/kubernetes/cluster-install/api.yaml@@ -21,11 +21,14 @@ spec:args: [ "pnpm", "run", "start:production" ]ports:- containerPort: 3002+ env:+ - name: FLY_PROCESS_GROUP+ value: "app"envFrom:- configMapRef:name: firecrawl-config- #- secretRef:- # name: firecrawl-secret+ - secretRef:+ name: firecrawl-secretlivenessProbe:httpGet:path: /v0/health/livenessdiff --git a/examples/kubernetes/cluster-install/configmap.yaml b/examples/kubernetes/cluster-install/configmap.yamlindex b56cfbcd1..5796fe82a 100644--- a/examples/kubernetes/cluster-install/configmap.yaml+++ b/examples/kubernetes/cluster-install/configmap.yaml@@ -8,6 +8,6 @@ data:HOST: "0.0.0.0"REDIS_URL: "redis://redis:6379"REDIS_RATE_LIMIT_URL: "redis://redis:6379"- PLAYWRIGHT_MICROSERVICE_URL: "http://playwright-service:3000/html"+ PLAYWRIGHT_MICROSERVICE_URL: "http://playwright-service:3000"USE_DB_AUTHENTICATION: "false"HDX_NODE_BETA_MODE: "1"diff --git a/examples/kubernetes/cluster-install/worker.yaml b/examples/kubernetes/cluster-install/worker.yamlindex 8e992cf16..e2d31ebc3 100644--- a/examples/kubernetes/cluster-install/worker.yaml+++ b/examples/kubernetes/cluster-install/worker.yaml@@ -19,8 +19,11 @@ spec:image: ghcr.io/winkk-dev/firecrawl:latestimagePullPolicy: Alwaysargs: [ "pnpm", "run", "workers" ]+ env:+ - name: FLY_PROCESS_GROUP+ value: "worker"envFrom:- configMapRef:name: firecrawl-config- #- secretRef:- # name: firecrawl-secret+ - secretRef:+ name: firecrawl-secret