Skip to content

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Fix werkzeug issue and try caching

Karim shoair72b36d6a26ec
diff --git a/.github/workflows/tests.yml b/.github/workflows/tests.yml
index f39f4fd..5a11dc2 100644
--- a/.github/workflows/tests.yml
+++ b/.github/workflows/tests.yml
@@ -11,6 +11,7 @@ jobs:
runs-on: ${{ matrix.os }}
container:
image: mcr.microsoft.com/playwright/python:v1.48.0-jammy
+ options: --user 1001
strategy:
fail-fast: false
matrix:
@@ -46,13 +47,27 @@ jobs:
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
+ cache: 'pip'
+ cache-dependency-path: |
+ setup.py
+ requirements*.txt
+ tox.ini
- name: Install Camoufox Dependencies
run: |
- python3 -m pip install --upgrade pip
- python3 -m pip install camoufox
python3 -m camoufox fetch --browserforge
+ # Cache tox environments
+ - name: Cache tox environments
+ uses: actions/cache@v3
+ with:
+ path: .tox
+ # Include python version and os in cache key
+ key: tox-${{ runner.os }}-py${{ matrix.python-version }}-${{ hashFiles('tox.ini', 'setup.py', 'requirements*.txt') }}
+ restore-keys: |
+ tox-${{ runner.os }}-py${{ matrix.python-version }}-
+ tox-${{ runner.os }}-
+
- name: Run tests
env: ${{ matrix.env }}
run: |
diff --git a/tests/requirements.txt b/tests/requirements.txt
index 46fd0ec..d5f716f 100644
--- a/tests/requirements.txt
+++ b/tests/requirements.txt
@@ -2,5 +2,6 @@ pytest>=2.8.0,<9
pytest-cov
playwright
camoufox
+werkzeug<3.0.0
pytest-httpbin==2.1.0
httpbin~=0.10.0