Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
refactor!: Dissolve @crawlee/memory-storage into @crawlee/core (#3802)
Jan Buchar5e2c92d88c03
diff --git a/README.md b/README.mdindex 7727f527b..1754819d7 100644--- a/README.md+++ b/README.md@@ -1,23 +1,23 @@<h1 align="center"><a href="https://crawlee.dev"><picture>- <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/apify/crawlee/master/website/static/img/crawlee-dark.svg?sanitize=true">- <img alt="Crawlee" src="https://raw.githubusercontent.com/apify/crawlee/master/website/static/img/crawlee-light.svg?sanitize=true" width="500">+ <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/apify/crawlee/master/website/static/img/crawlee-dark.svg?sanitize=true" />+ <img alt="Crawlee" src="https://raw.githubusercontent.com/apify/crawlee/master/website/static/img/crawlee-light.svg?sanitize=true" width="500" /></picture></a>- <br>+ <br /><small>A web scraping and browser automation library</small></h1>-<p align=center>- <a href="https://trendshift.io/repositories/5179" target="_blank"><img src="https://trendshift.io/api/badge/repositories/5179" alt="apify%2Fcrawlee | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>+<p align="center">+ <a href="https://trendshift.io/repositories/5179" target="_blank"><img src="https://trendshift.io/api/badge/repositories/5179" alt="apify%2Fcrawlee | Trendshift" width="250" height="55"/></a></p>-<p align=center>- <a href="https://www.npmjs.com/package/@crawlee/core" rel="nofollow"><img src="https://img.shields.io/npm/v/@crawlee/core.svg" alt="NPM latest version" data-canonical-src="https://img.shields.io/npm/v/@crawlee/core/next.svg" style="max-width: 100%;"></a>- <a href="https://www.npmjs.com/package/@crawlee/core" rel="nofollow"><img src="https://img.shields.io/npm/dm/@crawlee/core.svg" alt="Downloads" data-canonical-src="https://img.shields.io/npm/dm/@crawlee/core.svg" style="max-width: 100%;"></a>- <a href="https://discord.gg/jyEM2PRvMU" rel="nofollow"><img src="https://img.shields.io/discord/801163717915574323?label=discord" alt="Chat on discord" data-canonical-src="https://img.shields.io/discord/801163717915574323?label=discord" style="max-width: 100%;"></a>- <a href="https://github.com/apify/crawlee/actions/workflows/test-ci.yml"><img src="https://github.com/apify/crawlee/actions/workflows/test-ci.yml/badge.svg?branch=master" alt="Build Status" style="max-width: 100%;"></a>+<p align="center">+ <a href="https://www.npmjs.com/package/@crawlee/core" rel="nofollow"><img src="https://img.shields.io/npm/v/@crawlee/core.svg" alt="NPM latest version" data-canonical-src="https://img.shields.io/npm/v/@crawlee/core/next.svg" /></a>+ <a href="https://www.npmjs.com/package/@crawlee/core" rel="nofollow"><img src="https://img.shields.io/npm/dm/@crawlee/core.svg" alt="Downloads" data-canonical-src="https://img.shields.io/npm/dm/@crawlee/core.svg" /></a>+ <a href="https://discord.gg/jyEM2PRvMU" rel="nofollow"><img src="https://img.shields.io/discord/801163717915574323?label=discord" alt="Chat on discord" data-canonical-src="https://img.shields.io/discord/801163717915574323?label=discord" /></a>+ <a href="https://github.com/apify/crawlee/actions/workflows/test-ci.yml"><img src="https://github.com/apify/crawlee/actions/workflows/test-ci.yml/badge.svg?branch=master" alt="Build Status" /></a></p>Crawlee covers your crawling and scraping end-to-end and **helps you build reliable scrapers. Fast.**diff --git a/REBASE-DEFERRED.md b/REBASE-DEFERRED.mdindex 41ba743b5..c46b0cb26 100644--- a/REBASE-DEFERRED.md+++ b/REBASE-DEFERRED.md@@ -402,3 +402,42 @@ build their file path from internally-generated, non-user-controlled IDs(sequential entity index, hashed request ID), which is exactly what master'soriginal fix (`a04c29766`) called out as already safe, so left them asplain `resolve()`.++**Commit `3365b2d0e` (Dissolve @crawlee/memory-storage into @crawlee/core)+— rewrote two stale master-only security-regression tests that referenced a+long-gone API**: this commit folds `@crawlee/memory-storage` (the pure+in-memory client) into `@crawlee/core`. Git flagged two master-only test+files (`packages/memory-storage/test/key-value-store/record-key-path-traversal.test.ts`+and `packages/memory-storage/test/storage-name-path-traversal.test.ts` — the+regression tests for the `resolveWithinDirectory` path-traversal fix,+`a04c29766`) as "file location" conflicts, suggesting they move to+`packages/core/test/memory-storage/...` alongside the dissolved package's+other tests. That location is wrong: both tests exercise disk-escape+prevention (`persistStorage: true`, checking files on disk), but+`MemoryStorageClient` (the class that lands in `@crawlee/core`) is pure+in-memory post-split and never touches the filesystem — the vulnerability+and its fix now live entirely in `@crawlee/fs-storage`. Moved both to+`packages/fs-storage/test/` instead.++Their content was also fully stale — written against the pre-rebase API+(`new MemoryStorage(...)`, `.keyValueStores().getOrCreate()`,+`client.setRecord()`, `client.update({ name })` for renaming) that no longer+exists anywhere in this branch after ~30 commits of refactors applied earlier+in this rebase (Python-alignment renames, ServiceLocator, the fs-storage+split, KVS value-semantics centralization). Rewrote both against the current+`FileSystemStorageClient` API (`createKeyValueStoreClient({ name })` /+`createDatasetClient({ name })` / `createRequestQueueClient({ name })`,+`client.setValue({ key, value, contentType })`, `client.getMetadata()`).+Dropped the "rename via update rejects escaping names" test in+`storage-name-path-traversal.test.ts` — `update()`/rename support was removed+entirely earlier in this rebase (commit `e00aa9419`), so there is no longer+an operation to test here.++While in there, also found and fixed the same class of staleness in+`packages/core/test/memory-storage/request-queue/handledRequestCount-should-update.test.ts`+(this one auto-merged cleanly, no conflict, so it would have silently landed+broken): its third test called `requestQueue.updateRequest(...)`, an API that+no longer exists. The equivalent already-migrated test in+`packages/fs-storage/test/request-queue/handledRequestCount-should-update.test.ts`+(from an earlier commit in this same rebase) had already dropped this exact+test for the same reason — did the same here for consistency.diff --git a/docs/public-api/crawlee-core.api.md b/docs/public-api/crawlee-core.api.mdindex 228712277..a015d9193 100644--- a/docs/public-api/crawlee-core.api.md+++ b/docs/public-api/crawlee-core.api.md@@ -46,6 +46,7 @@ import type { SendRequestOptions } from '@crawlee/types';import type { SessionFingerprint } from '@crawlee/types';import { SessionState } from '@crawlee/types';import type { SetRequired } from 'type-fest';+import type * as storage from '@crawlee/types';import { StorageClient } from '@crawlee/types';import { StorageIdentifier } from '@crawlee/types';import { tryAbsoluteURL } from '@crawlee/utils';@@ -867,6 +868,37 @@ export const MAX_POOL_SIZE = 1000;// @internalexport const MAX_QUERIES_FOR_CONSISTENCY = 6;+// @public (undocumented)+export class MemoryStorageClient implements storage.StorageClient {+ constructor(options?: MemoryStorageOptions);+ // (undocumented)+ createDatasetClient(options?: storage.CreateDatasetClientOptions): Promise<storage.DatasetClient>;+ // (undocumented)+ createKeyValueStoreClient(options?: storage.CreateKeyValueStoreClientOptions): Promise<storage.KeyValueStoreClient>;+ // (undocumented)+ createRequestQueueClient(options?: storage.CreateRequestQueueClientOptions): Promise<storage.RequestQueueClient>;+ // (undocumented)+ readonly datasetClientCache: DatasetClient_2[];+ getStorageClientCacheKey(): string;+ // (undocumented)+ readonly keyValueStoreCache: KeyValueStoreClient_2[];+ // (undocumented)+ readonly logger?: CrawleeLogger;+ purge(): Promise<void>;+ // (undocumented)+ readonly requestQueueCache: RequestQueueClient_2[];+ // (undocumented)+ setStatusMessage(message: string, options?: storage.SetStatusMessageOptions): Promise<void>;+ // (undocumented)+ storageExists(id: string, type: 'Dataset' | 'KeyValueStore' | 'RequestQueue'): Promise<boolean>;+ teardown(): Promise<void>;+}++// @public (undocumented)+export interface MemoryStorageOptions {+ logger?: CrawleeLogger;+}+// @internalexport function mergeCookies(url: string, sourceCookies: string[]): string;diff --git a/docs/public-api/crawlee.api.md b/docs/public-api/crawlee.api.mdindex f722c9cef..ed64562e3 100644--- a/docs/public-api/crawlee.api.md+++ b/docs/public-api/crawlee.api.md@@ -35,7 +35,6 @@ export * from "@crawlee/fs-storage";export * from "@crawlee/http";export * from "@crawlee/jsdom";export * from "@crawlee/linkedom";-export * from "@crawlee/memory-storage";export * from "@crawlee/playwright";export * from "@crawlee/puppeteer";export * from "@crawlee/utils";diff --git a/docs/upgrading/upgrading_v4.md b/docs/upgrading/upgrading_v4.mdindex 24eda63f8..f38f1a9c8 100644--- a/docs/upgrading/upgrading_v4.md+++ b/docs/upgrading/upgrading_v4.md@@ -430,8 +430,7 @@ const eventManager = serviceLocator.getEventManager();The new `ServiceLocator` supports per-crawler service isolation, allowing you to use different storage clients or event managers for different crawlers by passing them via options:```typescript-import { BasicCrawler, Configuration, LocalEventManager } from 'crawlee';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { BasicCrawler, Configuration, LocalEventManager, MemoryStorageClient } from 'crawlee';const crawler = new BasicCrawler({requestHandler: async ({ request, log }) => {@@ -450,8 +449,7 @@ await crawler.run(['https://example.com']);For most use cases, the global `serviceLocator` singleton works well:```typescript-import { serviceLocator, BasicCrawler } from 'crawlee';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { serviceLocator, BasicCrawler, MemoryStorageClient } from 'crawlee';// Configure global services (optional)serviceLocator.setStorageClient(new MemoryStorageClient());@@ -656,7 +654,7 @@ If you implemented a custom `StorageClient`, you need to:In v3, the single `MemoryStorage` class from `@crawlee/memory-storage` did double duty: it kept everything in memory *and*, by default, mirrored it to disk (toggled via the `persistStorage` option / `CRAWLEE_PERSIST_STORAGE` environment variable). In v4 these two responsibilities are split into two independent classes, and the default storage client now persists to disk.- **`FileSystemStorageClient`** (new, in the new `@crawlee/fs-storage` package) — always persists storage to the local directory (`CRAWLEE_STORAGE_DIR`, default `./storage`). This is what you get implicitly when you don't configure a storage client, and it is the behavior the old `MemoryStorage` had with its default `persistStorage: true`.-- **`MemoryStorageClient`** (the renamed `MemoryStorage`, still in `@crawlee/memory-storage`) — now keeps everything purely in memory and **never touches the disk**. This matches the old `MemoryStorage` with `persistStorage: false`.+- **`MemoryStorageClient`** (the renamed `MemoryStorage`, now part of `@crawlee/core`) — keeps everything purely in memory and **never touches the disk**. This matches the old `MemoryStorage` with `persistStorage: false`. The standalone `@crawlee/memory-storage` package no longer exists; its code was merged into `@crawlee/core`.Both classes are re-exported from the `crawlee` meta-package.@@ -682,7 +680,7 @@ const storageClient = new MemoryStorage();**After:**```typescriptimport { FileSystemStorageClient } from '@crawlee/fs-storage';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';// Persists to disk (the old default behavior):const storageClient = new FileSystemStorageClient();diff --git a/packages/core/package.json b/packages/core/package.jsonindex a7e308bee..e8f2b35ef 100644--- a/packages/core/package.json+++ b/packages/core/package.json@@ -54,14 +54,15 @@"@apify/timeout": "^0.3.2","@apify/utilities": "^2.15.5","@crawlee/fs-storage": "workspace:*",- "@crawlee/memory-storage": "workspace:*","@crawlee/types": "workspace:*","@crawlee/utils": "workspace:*","@sapphire/async-queue": "^1.5.5",+ "@sapphire/shapeshift": "^4.0.0","@vladfrangu/async_event_emitter": "^2.4.6","content-type": "^1.0.5","csv-stringify": "^6.5.2","json5": "^2.2.3",+ "mime-types": "^3.0.1","minimatch": "^10.0.1","ow": "^2.0.0","stream-json": "^1.9.1",diff --git a/packages/core/src/index.ts b/packages/core/src/index.tsindex 9e64ff774..5be7d9575 100644--- a/packages/core/src/index.ts+++ b/packages/core/src/index.ts@@ -12,6 +12,7 @@ export * from './router.js';export * from './serialization.js';export * from './session_pool/index.js';export * from './storages/index.js';+export * from './memory-storage/index.js';export * from './validators.js';export * from './cookie_utils.js';export * from './recoverable_state.js';diff --git a/packages/memory-storage/src/consts.ts b/packages/core/src/memory-storage/consts.tssimilarity index 100%rename from packages/memory-storage/src/consts.tsrename to packages/core/src/memory-storage/consts.tsdiff --git a/packages/memory-storage/src/index.ts b/packages/core/src/memory-storage/index.tssimilarity index 100%rename from packages/memory-storage/src/index.tsrename to packages/core/src/memory-storage/index.tsdiff --git a/packages/memory-storage/src/memory-storage.ts b/packages/core/src/memory-storage/memory-storage.tssimilarity index 100%rename from packages/memory-storage/src/memory-storage.tsrename to packages/core/src/memory-storage/memory-storage.tsdiff --git a/packages/memory-storage/src/resource-clients/common/base-client.ts b/packages/core/src/memory-storage/resource-clients/common/base-client.tssimilarity index 100%rename from packages/memory-storage/src/resource-clients/common/base-client.tsrename to packages/core/src/memory-storage/resource-clients/common/base-client.tsdiff --git a/packages/memory-storage/src/resource-clients/dataset.ts b/packages/core/src/memory-storage/resource-clients/dataset.tssimilarity index 98%rename from packages/memory-storage/src/resource-clients/dataset.tsrename to packages/core/src/memory-storage/resource-clients/dataset.tsindex 55791ced8..89877de59 100644--- a/packages/memory-storage/src/resource-clients/dataset.ts+++ b/packages/core/src/memory-storage/resource-clients/dataset.ts@@ -4,7 +4,7 @@ import type * as storage from '@crawlee/types';import type { Dictionary } from '@crawlee/types';import { s } from '@sapphire/shapeshift';-import type { MemoryStorageClient } from '../index.js';+import type { MemoryStorageClient } from '../memory-storage.js';import { BaseClient } from './common/base-client.js';/**diff --git a/packages/memory-storage/src/resource-clients/key-value-store.ts b/packages/core/src/memory-storage/resource-clients/key-value-store.tssimilarity index 99%rename from packages/memory-storage/src/resource-clients/key-value-store.tsrename to packages/core/src/memory-storage/resource-clients/key-value-store.tsindex a10103ab9..1549ecb0a 100644--- a/packages/memory-storage/src/resource-clients/key-value-store.ts+++ b/packages/core/src/memory-storage/resource-clients/key-value-store.ts@@ -3,7 +3,7 @@ import { randomUUID } from 'node:crypto';import type * as storage from '@crawlee/types';import { s } from '@sapphire/shapeshift';-import type { MemoryStorageClient } from '../index.js';+import type { MemoryStorageClient } from '../memory-storage.js';import { isStream, toBuffer } from '../utils.js';import { BaseClient } from './common/base-client.js';import mime from 'mime-types';diff --git a/packages/memory-storage/src/resource-clients/request-queue.ts b/packages/core/src/memory-storage/resource-clients/request-queue.tssimilarity index 99%rename from packages/memory-storage/src/resource-clients/request-queue.tsrename to packages/core/src/memory-storage/resource-clients/request-queue.tsindex 5167328fa..581f72ac2 100644--- a/packages/memory-storage/src/resource-clients/request-queue.ts+++ b/packages/core/src/memory-storage/resource-clients/request-queue.ts@@ -3,7 +3,7 @@ import { randomUUID } from 'node:crypto';import type * as storage from '@crawlee/types';import { AsyncQueue } from '@sapphire/async-queue';import { s } from '@sapphire/shapeshift';-import type { MemoryStorageClient } from '../index.js';+import type { MemoryStorageClient } from '../memory-storage.js';import { purgeNullsFromObject, uniqueKeyToRequestId } from '../utils.js';import { BaseClient } from './common/base-client.js';diff --git a/packages/memory-storage/src/utils.ts b/packages/core/src/memory-storage/utils.tssimilarity index 100%rename from packages/memory-storage/src/utils.tsrename to packages/core/src/memory-storage/utils.tsdiff --git a/packages/core/src/service_locator.ts b/packages/core/src/service_locator.tsindex 8cecd5f0d..903bce18d 100644--- a/packages/core/src/service_locator.ts+++ b/packages/core/src/service_locator.ts@@ -1,7 +1,6 @@import { AsyncLocalStorage } from 'node:async_hooks';import { FileSystemStorageClient } from '@crawlee/fs-storage';-import { MemoryStorageClient } from '@crawlee/memory-storage';import type { StorageClient } from '@crawlee/types';import log from '@apify/log';@@ -12,6 +11,7 @@ import type { EventManager } from './events/event_manager.js';import { LocalEventManager } from './events/local_event_manager.js';import type { CrawleeLogger } from './log.js';import { ApifyLogAdapter } from './log.js';+import { MemoryStorageClient } from './memory-storage/index.js';import { StorageInstanceManager } from './storages/storage_instance_manager.js';interface ServiceLocatorInterface {@@ -111,8 +111,7 @@ interface ServiceLocatorInterface {** **2. Per-crawler services (recommended for isolation):*** ```typescript- * import { BasicCrawler, Configuration, LocalEventManager } from 'crawlee';- * import { MemoryStorageClient } from '@crawlee/memory-storage';+ * import { BasicCrawler, Configuration, LocalEventManager, MemoryStorageClient } from 'crawlee';** const crawler = new BasicCrawler({* requestHandler: async ({ request }) => { ... },diff --git a/packages/core/test/core/service_locator.test.ts b/packages/core/test/core/service_locator.test.tsindex 8efee82e9..2b3436e79 100644--- a/packages/core/test/core/service_locator.test.ts+++ b/packages/core/test/core/service_locator.test.ts@@ -3,12 +3,12 @@ import {ApifyLogAdapter,Configuration,LocalEventManager,+ MemoryStorageClient,ServiceConflictError,ServiceLocator,serviceLocator,} from '@crawlee/core';import { FileSystemStorageClient } from '@crawlee/fs-storage';-import { MemoryStorageClient } from '@crawlee/memory-storage';function makeMockLogger(overrides: Partial<CrawleeLogger> = {}): CrawleeLogger {const logger: CrawleeLogger = {diff --git a/packages/memory-storage/test/async-iteration.test.ts b/packages/core/test/memory-storage/async-iteration.test.tssimilarity index 98%rename from packages/memory-storage/test/async-iteration.test.tsrename to packages/core/test/memory-storage/async-iteration.test.tsindex b7553e017..fcf6323b5 100644--- a/packages/memory-storage/test/async-iteration.test.ts+++ b/packages/core/test/memory-storage/async-iteration.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { DatasetClient, KeyValueStoreClient } from '@crawlee/types';describe('Async iteration support', () => {diff --git a/packages/memory-storage/test/key-value-store/purge.test.ts b/packages/core/test/memory-storage/key-value-store/purge.test.tssimilarity index 97%rename from packages/memory-storage/test/key-value-store/purge.test.tsrename to packages/core/test/memory-storage/key-value-store/purge.test.tsindex fc4a8452d..23de7850d 100644--- a/packages/memory-storage/test/key-value-store/purge.test.ts+++ b/packages/core/test/memory-storage/key-value-store/purge.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { KeyValueStoreClient } from '@crawlee/types';describe('MemoryStorageClient.purge preserves the default key-value store input', () => {diff --git a/packages/memory-storage/test/key-value-store/stream.test.ts b/packages/core/test/memory-storage/key-value-store/stream.test.tssimilarity index 91%rename from packages/memory-storage/test/key-value-store/stream.test.tsrename to packages/core/test/memory-storage/key-value-store/stream.test.tsindex 327d6cbd9..cd9f9bb41 100644--- a/packages/memory-storage/test/key-value-store/stream.test.ts+++ b/packages/core/test/memory-storage/key-value-store/stream.test.ts@@ -1,6 +1,6 @@import { Readable } from 'node:stream';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';describe('KeyValueStore should drain streams when setting records', () => {const storage = new MemoryStorageClient();diff --git a/packages/memory-storage/test/no-crash-on-big-buffers.test.ts b/packages/core/test/memory-storage/no-crash-on-big-buffers.test.tssimilarity index 93%rename from packages/memory-storage/test/no-crash-on-big-buffers.test.tsrename to packages/core/test/memory-storage/no-crash-on-big-buffers.test.tsindex d7ee48435..df7b9790c 100644--- a/packages/memory-storage/test/no-crash-on-big-buffers.test.ts+++ b/packages/core/test/memory-storage/no-crash-on-big-buffers.test.ts@@ -1,7 +1,7 @@// https://github.com/apify/crawlee/issues/1732// https://github.com/apify/crawlee/issues/1710-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { KeyValueStoreClient } from '@crawlee/types';describe('MemoryStorageClient should not crash when saving a big buffer', () => {diff --git a/packages/memory-storage/test/request-queue/forefront.test.ts b/packages/core/test/memory-storage/request-queue/forefront.test.tssimilarity index 99%rename from packages/memory-storage/test/request-queue/forefront.test.tsrename to packages/core/test/memory-storage/request-queue/forefront.test.tsindex bdb9b16d5..c17ef0c1f 100644--- a/packages/memory-storage/test/request-queue/forefront.test.ts+++ b/packages/core/test/memory-storage/request-queue/forefront.test.ts@@ -2,7 +2,7 @@ import { rm } from 'node:fs/promises';import { resolve } from 'node:path';import { setTimeout as sleep } from 'node:timers/promises';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { RequestQueueClient } from '@crawlee/types';/**diff --git a/packages/memory-storage/test/request-queue/handledRequestCount-should-update.test.ts b/packages/core/test/memory-storage/request-queue/handledRequestCount-should-update.test.tssimilarity index 63%rename from packages/memory-storage/test/request-queue/handledRequestCount-should-update.test.tsrename to packages/core/test/memory-storage/request-queue/handledRequestCount-should-update.test.tsindex 2b8e56366..5992ae895 100644--- a/packages/memory-storage/test/request-queue/handledRequestCount-should-update.test.ts+++ b/packages/core/test/memory-storage/request-queue/handledRequestCount-should-update.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { RequestQueueClient } from '@crawlee/types';describe('RequestQueue handledRequestCount should update', () => {@@ -38,24 +38,4 @@ describe('RequestQueue handledRequestCount should update', () => {const updatedStatistics = await requestQueue.getMetadata();expect(updatedStatistics.handledRequestCount).toEqual(2);});-- test('updating an already handled request should not increment the handledRequestCount again', async () => {- const { requestId } = await requestQueue.addRequest({- url: 'http://example.com/4',- uniqueKey: '4',- handledAt: new Date().toISOString(),- });-- const { handledRequestCount } = await requestQueue.getMetadata();-- await requestQueue.updateRequest({- url: 'http://example.com/4',- uniqueKey: '4',- id: requestId,- handledAt: new Date().toISOString(),- });-- const updatedStatistics = await requestQueue.getMetadata();- expect(updatedStatistics.handledRequestCount).toEqual(handledRequestCount);- });});diff --git a/packages/memory-storage/test/request-queue/in-progress.test.ts b/packages/core/test/memory-storage/request-queue/in-progress.test.tssimilarity index 98%rename from packages/memory-storage/test/request-queue/in-progress.test.tsrename to packages/core/test/memory-storage/request-queue/in-progress.test.tsindex f9ce49c93..498a3cd9c 100644--- a/packages/memory-storage/test/request-queue/in-progress.test.ts+++ b/packages/core/test/memory-storage/request-queue/in-progress.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { RequestQueueClient } from '@crawlee/types';describe('RequestQueue in-progress requests', () => {diff --git a/packages/memory-storage/test/reverse-datataset-list.test.ts b/packages/core/test/memory-storage/reverse-datataset-list.test.tssimilarity index 95%rename from packages/memory-storage/test/reverse-datataset-list.test.tsrename to packages/core/test/memory-storage/reverse-datataset-list.test.tsindex 8f42cb6df..ed51e4bba 100644--- a/packages/memory-storage/test/reverse-datataset-list.test.ts+++ b/packages/core/test/memory-storage/reverse-datataset-list.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { DatasetClient } from '@crawlee/types';const elements = Array.from({ length: 10 }, (_, i) => ({ number: i }));diff --git a/packages/core/test/request-queue/adding-the-same-request-should-not-call-the-api.test.ts b/packages/core/test/request-queue/adding-the-same-request-should-not-call-the-api.test.tsindex c7c07bb12..6e5ba6ad8 100644--- a/packages/core/test/request-queue/adding-the-same-request-should-not-call-the-api.test.ts+++ b/packages/core/test/request-queue/adding-the-same-request-should-not-call-the-api.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import type { RequestQueueClient } from '@crawlee/types';import { RequestQueue, serviceLocator } from 'crawlee';diff --git a/packages/core/test/request-queue/request-queue.test.ts b/packages/core/test/request-queue/request-queue.test.tsindex 8d31608fb..92db62db6 100644--- a/packages/core/test/request-queue/request-queue.test.ts+++ b/packages/core/test/request-queue/request-queue.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import { RequestQueue } from 'crawlee';import type { MockInstance } from 'vitest';diff --git a/packages/core/test/storages/open-storage-with-different-client-should-be-respected.test.ts b/packages/core/test/storages/open-storage-with-different-client-should-be-respected.test.tsindex 5d331bb04..24aab26a6 100644--- a/packages/core/test/storages/open-storage-with-different-client-should-be-respected.test.ts+++ b/packages/core/test/storages/open-storage-with-different-client-should-be-respected.test.ts@@ -1,4 +1,4 @@-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import { RequestQueue, serviceLocator } from 'crawlee';let newClient: MemoryStorageClient;diff --git a/packages/crawlee/package.json b/packages/crawlee/package.jsonindex d70bfb914..11ad028cf 100644--- a/packages/crawlee/package.json+++ b/packages/crawlee/package.json@@ -59,7 +59,6 @@"@crawlee/http": "workspace:*","@crawlee/jsdom": "workspace:*","@crawlee/linkedom": "workspace:*",- "@crawlee/memory-storage": "workspace:*","@crawlee/playwright": "workspace:*","@crawlee/puppeteer": "workspace:*","@crawlee/utils": "workspace:*",diff --git a/packages/crawlee/src/index.ts b/packages/crawlee/src/index.tsindex ef2827e0f..0457cdef9 100644--- a/packages/crawlee/src/index.ts+++ b/packages/crawlee/src/index.ts@@ -14,7 +14,6 @@ export * from '@crawlee/cheerio';export * from '@crawlee/puppeteer';export * from '@crawlee/playwright';export * from '@crawlee/browser-pool';-export * from '@crawlee/memory-storage';export * from '@crawlee/fs-storage';export const utils = {diff --git a/packages/fs-storage/test/key-value-store/record-key-path-traversal.test.ts b/packages/fs-storage/test/key-value-store/record-key-path-traversal.test.tsnew file mode 100644index 000000000..46385689e--- /dev/null+++ b/packages/fs-storage/test/key-value-store/record-key-path-traversal.test.ts@@ -0,0 +1,46 @@+import { rm } from 'node:fs/promises';+import { resolve } from 'node:path';++import { FileSystemStorageClient } from '@crawlee/fs-storage';+import { pathExists } from 'fs-extra/esm';++import { waitTillWrittenToDisk } from '../__shared__.js';++describe('record key path traversal', () => {+ const tmpLocation = resolve(import.meta.dirname, './tmp/record-key-path-traversal');++ afterAll(async () => {+ await rm(tmpLocation, { force: true, recursive: true });+ });++ const storage = new FileSystemStorageClient({+ localDataDirectory: tmpLocation,+ writeMetadata: true,+ });++ test('setValue rejects a key that escapes the store directory', async () => {+ const client = await storage.createKeyValueStoreClient({ name: 'record-key-store' });++ await expect(+ client.setValue({ key: '../escaped-record', value: 'pwned', contentType: 'text/plain' }),+ ).rejects.toThrow();++ // The escaped file must not have been created outside the store directory.+ await expect(pathExists(resolve(storage.keyValueStoresDirectory, 'escaped-record.txt'))).resolves.toBe(+ false,+ );+ });++ test('setValue still works for a regular key', async () => {+ const client = await storage.createKeyValueStoreClient({ name: 'record-key-store-ok' });++ await expect(+ client.setValue({ key: 'SAFEKEY', value: 'value', contentType: 'text/plain' }),+ ).resolves.not.toThrow();++ // The store was opened by name, so it lives under its name directory.+ const storePath = resolve(storage.keyValueStoresDirectory, (await client.getMetadata()).name!);+ await waitTillWrittenToDisk(resolve(storePath, 'SAFEKEY.txt'));+ await expect(pathExists(resolve(storePath, 'SAFEKEY.txt'))).resolves.toBe(true);+ });+});diff --git a/packages/fs-storage/test/storage-name-path-traversal.test.ts b/packages/fs-storage/test/storage-name-path-traversal.test.tsnew file mode 100644index 000000000..00f5aa14d--- /dev/null+++ b/packages/fs-storage/test/storage-name-path-traversal.test.ts@@ -0,0 +1,41 @@+import { rm } from 'node:fs/promises';+import { resolve, sep } from 'node:path';++import { FileSystemStorageClient } from '@crawlee/fs-storage';++describe('storage name path traversal', () => {+ const tmpLocation = resolve(import.meta.dirname, './tmp/storage-name-path-traversal');++ afterAll(async () => {+ await rm(tmpLocation, { force: true, recursive: true });+ });++ const storage = new FileSystemStorageClient({+ localDataDirectory: tmpLocation,+ writeMetadata: true,+ });++ const traversalNames = ['../escaped', `..${sep}escaped`, resolve(tmpLocation, '..', 'escaped-absolute')];++ describe('createXClient rejects names that escape the storage directory', () => {+ test.each(traversalNames)('key-value store name %s', async (name) => {+ await expect(storage.createKeyValueStoreClient({ name })).rejects.toThrow();+ });++ test.each(traversalNames)('dataset name %s', async (name) => {+ await expect(storage.createDatasetClient({ name })).rejects.toThrow();+ });++ test.each(traversalNames)('request queue name %s', async (name) => {+ await expect(storage.createRequestQueueClient({ name })).rejects.toThrow();+ });+ });++ test('legitimate names still work', async () => {+ const client = await storage.createKeyValueStoreClient({ name: 'normal-name' });++ await expect(+ client.setValue({ key: 'SAFEKEY', value: 'value', contentType: 'text/plain' }),+ ).resolves.not.toThrow();+ });+});diff --git a/packages/memory-storage/.npmignore b/packages/memory-storage/.npmignoredeleted file mode 100644index d18b05a66..000000000--- a/packages/memory-storage/.npmignore+++ /dev/null@@ -1,5 +0,0 @@-node_modules-src-test-coverage-tsconfig.*diff --git a/packages/memory-storage/CHANGELOG.md b/packages/memory-storage/CHANGELOG.mddeleted file mode 100644index 527449ce2..000000000--- a/packages/memory-storage/CHANGELOG.md+++ /dev/null@@ -1,670 +0,0 @@-# Change Log--All notable changes to this project will be documented in this file.-See [Conventional Commits](https://conventionalcommits.org) for commit guidelines.--## [3.18.1](https://github.com/apify/crawlee/compare/v3.18.0...v3.18.1) (2026-08-12)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.18.0](https://github.com/apify/crawlee/compare/v3.17.0...v3.18.0) (2026-08-04)--### Bug Fixes--* **memory-storage:** don't increment `handledRequestCount` when updating a handled request ([#3827](https://github.com/apify/crawlee/issues/3827)) ([4739d48](https://github.com/apify/crawlee/commit/4739d4886e3c52f90814b9e5342c4ec2cbaa7587))-* **memory-storage:** prevent storage names from escaping the storage directory ([#3715](https://github.com/apify/crawlee/issues/3715)) ([a04c297](https://github.com/apify/crawlee/commit/a04c29766e3165534a5789d59a3a7bef5a8f5b5a))-* **memory-storage:** use platform basename in key-value store warning ([#3864](https://github.com/apify/crawlee/issues/3864)) ([dcefe01](https://github.com/apify/crawlee/commit/dcefe0196d0ba9bd89770e0a9ff5503295dc274b))---# [3.17.0](https://github.com/apify/crawlee/compare/v3.16.0...v3.17.0) (2026-06-04)---### Bug Fixes--* change sequential approach to parallel for Iterator first page ([#3402](https://github.com/apify/crawlee/issues/3402)) ([adf3dae](https://github.com/apify/crawlee/commit/adf3daeb0b3000124817b1b2011b2196342e8715)), closes [#3395](https://github.com/apify/crawlee/issues/3395)---### Performance Improvements--* add lazyIterablePromise to kvs iterators ([#3413](https://github.com/apify/crawlee/issues/3413)) ([2658610](https://github.com/apify/crawlee/commit/2658610a62ae8dca2702f5af222d64f88d91f4a8))------# [3.16.0](https://github.com/apify/crawlee/compare/v3.15.3...v3.16.0) (2026-02-06)---### Features--* implements async iterators ([#3352](https://github.com/apify/crawlee/issues/3352)) ([7f7a4ab](https://github.com/apify/crawlee/commit/7f7a4ab3e21b801983c7d3be2aff84f4a0e83f6e)), closes [#3338](https://github.com/apify/crawlee/issues/3338)---### Performance Improvements--* drop `tsbuildinfo` from published packages ([#3243](https://github.com/apify/crawlee/issues/3243)) ([3450f27](https://github.com/apify/crawlee/commit/3450f27880afb9e9d857a54d9212b54c397aed91)), closes [#3239](https://github.com/apify/crawlee/issues/3239)------## [3.15.3](https://github.com/apify/crawlee/compare/v3.15.2...v3.15.3) (2025-11-10)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.15.2](https://github.com/apify/crawlee/compare/v3.15.1...v3.15.2) (2025-10-23)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.15.1](https://github.com/apify/crawlee/compare/v3.15.0...v3.15.1) (2025-09-26)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.15.0](https://github.com/apify/crawlee/compare/v3.14.1...v3.15.0) (2025-09-17)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.14.1](https://github.com/apify/crawlee/compare/v3.14.0...v3.14.1) (2025-08-05)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.14.0](https://github.com/apify/crawlee/compare/v3.13.10...v3.14.0) (2025-07-25)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.10](https://github.com/apify/crawlee/compare/v3.13.9...v3.13.10) (2025-07-09)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.9](https://github.com/apify/crawlee/compare/v3.13.8...v3.13.9) (2025-06-27)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.8](https://github.com/apify/crawlee/compare/v3.13.7...v3.13.8) (2025-06-16)---### Features--* support `KVS.listKeys()` `prefix` and `collection` parameters ([#3001](https://github.com/apify/crawlee/issues/3001)) ([5c4726d](https://github.com/apify/crawlee/commit/5c4726df96e358a9bbf44a0cd2760e4e269f0fae)), closes [#2974](https://github.com/apify/crawlee/issues/2974)------## [3.13.7](https://github.com/apify/crawlee/compare/v3.13.6...v3.13.7) (2025-06-06)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.6](https://github.com/apify/crawlee/compare/v3.13.5...v3.13.6) (2025-06-05)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.5](https://github.com/apify/crawlee/compare/v3.13.4...v3.13.5) (2025-05-20)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.4](https://github.com/apify/crawlee/compare/v3.13.3...v3.13.4) (2025-05-14)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.3](https://github.com/apify/crawlee/compare/v3.13.2...v3.13.3) (2025-05-05)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.2](https://github.com/apify/crawlee/compare/v3.13.1...v3.13.2) (2025-04-08)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.13.1](https://github.com/apify/crawlee/compare/v3.13.0...v3.13.1) (2025-04-07)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.13.0](https://github.com/apify/crawlee/compare/v3.12.2...v3.13.0) (2025-03-04)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.12.2](https://github.com/apify/crawlee/compare/v3.12.1...v3.12.2) (2025-01-27)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.12.1](https://github.com/apify/crawlee/compare/v3.12.0...v3.12.1) (2024-12-04)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.12.0](https://github.com/apify/crawlee/compare/v3.11.5...v3.12.0) (2024-11-04)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.11.5](https://github.com/apify/crawlee/compare/v3.11.4...v3.11.5) (2024-10-04)---### Bug Fixes--* `prolong-` and `deleteRequestLock` `forefront` option ([#2690](https://github.com/apify/crawlee/issues/2690)) ([cba8da3](https://github.com/apify/crawlee/commit/cba8da31312bcc4228662c79c4472e35278627c1)), closes [#2681](https://github.com/apify/crawlee/issues/2681) [#2689](https://github.com/apify/crawlee/issues/2689) [#2669](https://github.com/apify/crawlee/issues/2669)-* respect `forefront` option in `MemoryStorage`'s `RequestQueue` ([#2681](https://github.com/apify/crawlee/issues/2681)) ([b0527f9](https://github.com/apify/crawlee/commit/b0527f948b73e3b74ac77e58f9184b34c1adab3a)), closes [#2669](https://github.com/apify/crawlee/issues/2669)------## [3.11.4](https://github.com/apify/crawlee/compare/v3.11.3...v3.11.4) (2024-09-23)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.11.3](https://github.com/apify/crawlee/compare/v3.11.2...v3.11.3) (2024-09-03)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.11.2](https://github.com/apify/crawlee/compare/v3.11.1...v3.11.2) (2024-08-28)---### Bug Fixes--* **RequestQueueV2:** remove `inProgress` cache, rely solely on locked states ([#2601](https://github.com/apify/crawlee/issues/2601)) ([57fcb08](https://github.com/apify/crawlee/commit/57fcb0804a9f1268039d1e2b246c515ceca7e405))-* Use the correct mutex in memory storage RequestQueueClient ([#2623](https://github.com/apify/crawlee/issues/2623)) ([2fa8a29](https://github.com/apify/crawlee/commit/2fa8a29b815689f041f3d06cc0563e77e02e05f4))------## [3.11.1](https://github.com/apify/crawlee/compare/v3.11.0...v3.11.1) (2024-07-24)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.11.0](https://github.com/apify/crawlee/compare/v3.10.5...v3.11.0) (2024-07-09)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.10.5](https://github.com/apify/crawlee/compare/v3.10.4...v3.10.5) (2024-06-12)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.10.4](https://github.com/apify/crawlee/compare/v3.10.3...v3.10.4) (2024-06-11)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.10.3](https://github.com/apify/crawlee/compare/v3.10.2...v3.10.3) (2024-06-07)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.10.2](https://github.com/apify/crawlee/compare/v3.10.1...v3.10.2) (2024-06-03)---### Bug Fixes--* improve fix for double extension in KVS with HTML files ([#2505](https://github.com/apify/crawlee/issues/2505)) ([157927d](https://github.com/apify/crawlee/commit/157927d67f42342c20fdf01ef81bdafd7095f0b8)), closes [#2419](https://github.com/apify/crawlee/issues/2419)------## [3.10.1](https://github.com/apify/crawlee/compare/v3.10.0...v3.10.1) (2024-05-23)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.10.0](https://github.com/apify/crawlee/compare/v3.9.2...v3.10.0) (2024-05-16)---### Bug Fixes--* Fixed double extension for screenshots ([#2419](https://github.com/apify/crawlee/issues/2419)) ([e8b39c4](https://github.com/apify/crawlee/commit/e8b39c41764726280c995e52fa7d79a9240d993e)), closes [#1980](https://github.com/apify/crawlee/issues/1980)------## [3.9.2](https://github.com/apify/crawlee/compare/v3.9.1...v3.9.2) (2024-04-17)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.9.1](https://github.com/apify/crawlee/compare/v3.9.0...v3.9.1) (2024-04-11)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.9.0](https://github.com/apify/crawlee/compare/v3.8.2...v3.9.0) (2024-04-10)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.8.2](https://github.com/apify/crawlee/compare/v3.8.1...v3.8.2) (2024-03-21)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.8.1](https://github.com/apify/crawlee/compare/v3.8.0...v3.8.1) (2024-02-22)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.8.0](https://github.com/apify/crawlee/compare/v3.7.3...v3.8.0) (2024-02-21)---### Features--* `KeyValueStore.recordExists()` ([#2339](https://github.com/apify/crawlee/issues/2339)) ([8507a65](https://github.com/apify/crawlee/commit/8507a65d1ad079f64c752a6ddb1d8fac9b494228))------## [3.7.3](https://github.com/apify/crawlee/compare/v3.7.2...v3.7.3) (2024-01-30)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.7.2](https://github.com/apify/crawlee/compare/v3.7.1...v3.7.2) (2024-01-09)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.7.1](https://github.com/apify/crawlee/compare/v3.7.0...v3.7.1) (2024-01-02)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.7.0](https://github.com/apify/crawlee/compare/v3.6.2...v3.7.0) (2023-12-21)---### Bug Fixes--* **MemoryStorage:** lock request JSON file when reading to support multiple process crawling ([#2215](https://github.com/apify/crawlee/issues/2215)) ([eb84ce9](https://github.com/apify/crawlee/commit/eb84ce9ce5540b72d5799b1f66c80938d57bc1cc))------## [3.6.2](https://github.com/apify/crawlee/compare/v3.6.1...v3.6.2) (2023-11-26)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.6.1](https://github.com/apify/crawlee/compare/v3.6.0...v3.6.1) (2023-11-15)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.6.0](https://github.com/apify/crawlee/compare/v3.5.8...v3.6.0) (2023-11-15)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.5.8](https://github.com/apify/crawlee/compare/v3.5.7...v3.5.8) (2023-10-17)---### Bug Fixes--* **MemoryStorage:** ignore invalid files for request queues ([#2132](https://github.com/apify/crawlee/issues/2132)) ([fa58581](https://github.com/apify/crawlee/commit/fa58581b530ef3ad89bdd71403df2d2e4f06c59f)), closes [#1985](https://github.com/apify/crawlee/issues/1985)------## [3.5.7](https://github.com/apify/crawlee/compare/v3.5.6...v3.5.7) (2023-10-05)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.5.6](https://github.com/apify/crawlee/compare/v3.5.5...v3.5.6) (2023-10-04)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.5.5](https://github.com/apify/crawlee/compare/v3.5.4...v3.5.5) (2023-10-02)---### Features--* Request Queue v2 ([#1975](https://github.com/apify/crawlee/issues/1975)) ([70a77ee](https://github.com/apify/crawlee/commit/70a77ee15f984e9ae67cd584fc58ace7e55346db)), closes [#1365](https://github.com/apify/crawlee/issues/1365)------## [3.5.4](https://github.com/apify/crawlee/compare/v3.5.3...v3.5.4) (2023-09-11)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.5.3](https://github.com/apify/crawlee/compare/v3.5.2...v3.5.3) (2023-08-31)---### Bug Fixes--* pin all internal dependencies ([#2041](https://github.com/apify/crawlee/issues/2041)) ([d6f2b17](https://github.com/apify/crawlee/commit/d6f2b172d4a6776137c7893ca798d5b4a9408e79)), closes [#2040](https://github.com/apify/crawlee/issues/2040)------## [3.5.2](https://github.com/apify/crawlee/compare/v3.5.1...v3.5.2) (2023-08-21)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.5.1](https://github.com/apify/crawlee/compare/v3.5.0...v3.5.1) (2023-08-16)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.5.0](https://github.com/apify/crawlee/compare/v3.4.2...v3.5.0) (2023-07-31)---### Bug Fixes--* cleanup worker stuff from memory storage to fix `vitest` ([#2004](https://github.com/apify/crawlee/issues/2004)) ([d2e098c](https://github.com/apify/crawlee/commit/d2e098cab62c700a5c58fcf43a5bcf9f492d71ec)), closes [#1999](https://github.com/apify/crawlee/issues/1999)------## [3.4.2](https://github.com/apify/crawlee/compare/v3.4.1...v3.4.2) (2023-07-19)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.4.1](https://github.com/apify/crawlee/compare/v3.4.0...v3.4.1) (2023-07-13)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.4.0](https://github.com/apify/crawlee/compare/v3.3.3...v3.4.0) (2023-06-12)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.3.3](https://github.com/apify/crawlee/compare/v3.3.2...v3.3.3) (2023-05-31)---### Bug Fixes--* **MemoryStorage:** handle EXDEV errors when purging storages ([#1932](https://github.com/apify/crawlee/issues/1932)) ([e656050](https://github.com/apify/crawlee/commit/e6560507243f5e2d0b126160616573f13e5998e1))------## [3.3.2](https://github.com/apify/crawlee/compare/v3.3.1...v3.3.2) (2023-05-11)---### Bug Fixes--* **MemoryStorage:** cache requests in `RequestQueue` ([#1899](https://github.com/apify/crawlee/issues/1899)) ([063dcd1](https://github.com/apify/crawlee/commit/063dcd1c9e6652cd316cc0e8c4f4e4bbb70c246e))---### Features--* RQv2 memory storage support ([#1874](https://github.com/apify/crawlee/issues/1874)) ([049486b](https://github.com/apify/crawlee/commit/049486b772cc2accd2d2d226d8c8726e5ab933a9))------## [3.3.1](https://github.com/apify/crawlee/compare/v3.3.0...v3.3.1) (2023-04-11)---### Bug Fixes--* **MemoryStorage:** handling of readable streams for key-value stores when setting records ([#1852](https://github.com/apify/crawlee/issues/1852)) ([a5ee37d](https://github.com/apify/crawlee/commit/a5ee37d7e245f004785fc03220e37aeafdfa0e81)), closes [#1843](https://github.com/apify/crawlee/issues/1843)------# [3.3.0](https://github.com/apify/crawlee/compare/v3.2.2...v3.3.0) (2023-03-09)---### Bug Fixes--* **MemoryStorage:** request queues race conditions causing crashes ([#1806](https://github.com/apify/crawlee/issues/1806)) ([083a9db](https://github.com/apify/crawlee/commit/083a9db9ebcddd3fa886631234c790d4c5bcdf86)), closes [#1792](https://github.com/apify/crawlee/issues/1792)-* **MemoryStorage:** RequestQueue should respect `forefront` ([#1816](https://github.com/apify/crawlee/issues/1816)) ([b68e86a](https://github.com/apify/crawlee/commit/b68e86a97954bcbe30fde802fed5f263016fffe2)), closes [#1787](https://github.com/apify/crawlee/issues/1787)-* **MemoryStorage:** RequestQueue#handledRequestCount should update ([#1817](https://github.com/apify/crawlee/issues/1817)) ([a775e4a](https://github.com/apify/crawlee/commit/a775e4afea20d0b31492f44b90f61b6a903491b6)), closes [#1764](https://github.com/apify/crawlee/issues/1764)---### Features--* add basic support for `setStatusMessage` ([#1790](https://github.com/apify/crawlee/issues/1790)) ([c318980](https://github.com/apify/crawlee/commit/c318980ec11d211b1a5c9e6bdbe76198c5d895be))-* move the status message implementation to Crawlee, noop in storage ([#1808](https://github.com/apify/crawlee/issues/1808)) ([99c3fdc](https://github.com/apify/crawlee/commit/99c3fdc18030b7898e6b6d149d6d94fab7881f09))------## [3.2.2](https://github.com/apify/crawlee/compare/v3.2.1...v3.2.2) (2023-02-08)---### Bug Fixes--* **MemoryStorage:** request queues saved in the wrong place ([#1779](https://github.com/apify/crawlee/issues/1779)) ([19409db](https://github.com/apify/crawlee/commit/19409dbd614560a73c97ef6e00997e482573d2ff))------## [3.2.1](https://github.com/apify/crawlee/compare/v3.2.0...v3.2.1) (2023-02-07)--**Note:** Version bump only for package @crawlee/memory-storage------# [3.2.0](https://github.com/apify/crawlee/compare/v3.1.4...v3.2.0) (2023-02-07)---### Bug Fixes--* Correctly compute `pendingRequestCount` in request queue ([#1765](https://github.com/apify/crawlee/issues/1765)) ([946535f](https://github.com/apify/crawlee/commit/946535f2338086e13c71ff70129e7a1f6bfd275d)), closes [/github.com/apify/crawlee/blob/master/packages/memory-storage/src/resource-clients/request-queue.ts#L291-L298](https://github.com//github.com/apify/crawlee/blob/master/packages/memory-storage/src/resource-clients/request-queue.ts/issues/L291-L298)-* **KeyValueStore:** big buffers should not crash ([#1734](https://github.com/apify/crawlee/issues/1734)) ([2f682f7](https://github.com/apify/crawlee/commit/2f682f7ddd189cad11a3f5e7655ac6243444ff74)), closes [#1732](https://github.com/apify/crawlee/issues/1732) [#1710](https://github.com/apify/crawlee/issues/1710)-* **memory-storage:** dont fail when storage already purged ([#1737](https://github.com/apify/crawlee/issues/1737)) ([8694027](https://github.com/apify/crawlee/commit/86940273dbac2d13294140962f816f66582684ff)), closes [#1736](https://github.com/apify/crawlee/issues/1736)-* **utils:** add missing dependency on `ow` ([bf0e03c](https://github.com/apify/crawlee/commit/bf0e03cc6ddc103c9337de5cd8dce9bc86c369a3)), closes [#1716](https://github.com/apify/crawlee/issues/1716)---### Features--* **MemoryStorage:** read from fs if persistStorage is enabled, ram only otherwise ([#1761](https://github.com/apify/crawlee/issues/1761)) ([e903980](https://github.com/apify/crawlee/commit/e9039809a0c0af0bc086be1f1400d18aa45ae490))------## 3.1.2 (2022-11-15)--**Note:** Version bump only for package @crawlee/memory-storage------## 3.1.1 (2022-11-07)--**Note:** Version bump only for package @crawlee/memory-storage------# 3.1.0 (2022-10-13)--**Note:** Version bump only for package @crawlee/memory-storage------## [3.0.4](https://github.com/apify/crawlee/compare/v3.0.3...v3.0.4) (2022-08-22)---### Bug Fixes--* key value stores emitting an error when multiple write promises ran in parallel ([#1460](https://github.com/apify/crawlee/issues/1460)) ([f201cca](https://github.com/apify/crawlee/commit/f201cca4a99d1c8b3e87be0289d5b3b363048f09))diff --git a/packages/memory-storage/package.json b/packages/memory-storage/package.jsondeleted file mode 100644index 086b89172..000000000--- a/packages/memory-storage/package.json+++ /dev/null@@ -1,54 +0,0 @@-{- "name": "@crawlee/memory-storage",- "version": "4.0.0",- "description": "A simple in-memory storage implementation of the Apify API",- "engines": {- "node": ">=22.0.0"- },- "type": "module",- "exports": {- ".": "./dist/index.js",- "./package.json": "./package.json"- },- "keywords": [- "apify",- "api",- "memory"- ],- "author": {- "name": "Apify",- "email": "[email protected]",- "url": "https://apify.com"- },- "contributors": [- "Vlad Frangu <[email protected]>"- ],- "license": "Apache-2.0",- "repository": {- "type": "git",- "url": "git+https://github.com/apify/crawlee"- },- "bugs": {- "url": "https://github.com/apify/crawlee/issues"- },- "homepage": "https://crawlee.dev",- "scripts": {- "build": "pnpm clean && pnpm compile && pnpm copy",- "clean": "rimraf ./dist",- "compile": "tsc -p tsconfig.build.json",- "copy": "tsx ../../scripts/copy.ts"- },- "publishConfig": {- "access": "public"- },- "dependencies": {- "@crawlee/types": "workspace:*",- "@crawlee/utils": "workspace:*",- "@sapphire/async-queue": "^1.5.5",- "@sapphire/shapeshift": "^4.0.0",- "content-type": "^1.0.5",- "json5": "^2.2.3",- "mime-types": "^3.0.1",- "tslib": "^2.8.1"- }-}diff --git a/packages/memory-storage/test/key-value-store/record-key-path-traversal.test.ts b/packages/memory-storage/test/key-value-store/record-key-path-traversal.test.tsdeleted file mode 100644index e52e9fba0..000000000--- a/packages/memory-storage/test/key-value-store/record-key-path-traversal.test.ts+++ /dev/null@@ -1,47 +0,0 @@-import { rm } from 'node:fs/promises';-import { resolve } from 'node:path';--import { MemoryStorage } from '@crawlee/memory-storage';-import { pathExists } from 'fs-extra';--import { waitTillWrittenToDisk } from '../__shared__';--describe('record key path traversal', () => {- const tmpLocation = resolve(__dirname, './tmp/record-key-path-traversal');-- afterAll(async () => {- await rm(tmpLocation, { force: true, recursive: true });- });-- const storage = new MemoryStorage({- localDataDirectory: tmpLocation,- persistStorage: true,- writeMetadata: true,- });-- test('setRecord rejects a key that escapes the store directory', async () => {- const info = await storage.keyValueStores().getOrCreate('record-key-store');- const client = storage.keyValueStore(info.id);-- await expect(- client.setRecord({ key: '../escaped-record', value: 'pwned', contentType: 'text/plain' }),- ).rejects.toThrow();-- // The escaped file must not have been created outside the store directory.- await expect(pathExists(resolve(storage.keyValueStoresDirectory, 'escaped-record.txt'))).resolves.toBe(false);- });-- test('setRecord still works for a regular key', async () => {- const info = await storage.keyValueStores().getOrCreate('record-key-store-ok');- const client = storage.keyValueStore(info.id);-- await expect(- client.setRecord({ key: 'SAFEKEY', value: 'value', contentType: 'text/plain' }),- ).resolves.not.toThrow();-- // The store was opened by name, so it lives under its name directory.- const storePath = resolve(storage.keyValueStoresDirectory, info.name!);- await waitTillWrittenToDisk(resolve(storePath, 'SAFEKEY.txt'));- await expect(pathExists(resolve(storePath, 'SAFEKEY.txt'))).resolves.toBe(true);- });-});diff --git a/packages/memory-storage/test/storage-name-path-traversal.test.ts b/packages/memory-storage/test/storage-name-path-traversal.test.tsdeleted file mode 100644index 9afd81675..000000000--- a/packages/memory-storage/test/storage-name-path-traversal.test.ts+++ /dev/null@@ -1,50 +0,0 @@-import { rm } from 'node:fs/promises';-import { resolve, sep } from 'node:path';--import { MemoryStorage } from '@crawlee/memory-storage';--describe('storage name path traversal', () => {- const tmpLocation = resolve(__dirname, './tmp/storage-name-path-traversal');-- afterAll(async () => {- await rm(tmpLocation, { force: true, recursive: true });- });-- const storage = new MemoryStorage({- localDataDirectory: tmpLocation,- persistStorage: true,- writeMetadata: true,- });-- const traversalNames = ['../escaped', `..${sep}escaped`, resolve(tmpLocation, '..', 'escaped-absolute')];-- describe('getOrCreate rejects names that escape the storage directory', () => {- test.each(traversalNames)('key-value store name %s', async (name) => {- await expect(storage.keyValueStores().getOrCreate(name)).rejects.toThrow();- });-- test.each(traversalNames)('dataset name %s', async (name) => {- await expect(storage.datasets().getOrCreate(name)).rejects.toThrow();- });-- test.each(traversalNames)('request queue name %s', async (name) => {- await expect(storage.requestQueues().getOrCreate(name)).rejects.toThrow();- });- });-- test('rename via update rejects names that escape the storage directory', async () => {- const info = await storage.keyValueStores().getOrCreate('legit-store');- const client = storage.keyValueStore(info.id);-- await expect(client.update({ name: '../escaped-rename' })).rejects.toThrow();- });-- test('legitimate names still work', async () => {- const info = await storage.keyValueStores().getOrCreate('normal-name');- const client = storage.keyValueStore(info.id);-- await expect(- client.setRecord({ key: 'SAFEKEY', value: 'value', contentType: 'text/plain' }),- ).resolves.not.toThrow();- });-});diff --git a/packages/memory-storage/test/tsconfig.json b/packages/memory-storage/test/tsconfig.jsondeleted file mode 100644index eb8cbab58..000000000--- a/packages/memory-storage/test/tsconfig.json+++ /dev/null@@ -1,7 +0,0 @@-{- "extends": "../../../tsconfig.json",- "include": ["**/*", "../../**/*"],- "compilerOptions": {- "types": ["vitest/globals"]- }-}diff --git a/packages/memory-storage/tsconfig.build.json b/packages/memory-storage/tsconfig.build.jsondeleted file mode 100644index 5f63b6d3d..000000000--- a/packages/memory-storage/tsconfig.build.json+++ /dev/null@@ -1,8 +0,0 @@-{- "extends": "../../tsconfig.build.json",- "compilerOptions": {- "outDir": "./dist",- "rootDir": "./src"- },- "include": ["src/**/*"]-}diff --git a/packages/memory-storage/tsconfig.json b/packages/memory-storage/tsconfig.jsondeleted file mode 100644index 66bb87a91..000000000--- a/packages/memory-storage/tsconfig.json+++ /dev/null@@ -1,4 +0,0 @@-{- "extends": "../../tsconfig.json",- "include": ["src/**/*"]-}diff --git a/pnpm-lock.yaml b/pnpm-lock.yamlindex dcc960ac9..29e5541ea 100644--- a/pnpm-lock.yaml+++ b/pnpm-lock.yaml@@ -437,9 +437,6 @@ importers:'@crawlee/fs-storage':specifier: workspace:*version: link:../fs-storage- '@crawlee/memory-storage':- specifier: workspace:*- version: link:../memory-storage'@crawlee/types':specifier: workspace:*version: link:../types@@ -449,6 +446,9 @@ importers:'@sapphire/async-queue':specifier: ^1.5.5version: 1.5.5+ '@sapphire/shapeshift':+ specifier: ^4.0.0+ version: 4.0.0'@vladfrangu/async_event_emitter':specifier: ^2.4.6version: 2.4.7@@ -461,6 +461,9 @@ importers:json5:specifier: ^2.2.3version: 2.2.3+ mime-types:+ specifier: ^3.0.1+ version: 3.0.2minimatch:specifier: ^9.0.0version: 9.0.9@@ -521,9 +524,6 @@ importers:'@crawlee/linkedom':specifier: workspace:*version: link:../linkedom-crawler- '@crawlee/memory-storage':- specifier: workspace:*- version: link:../memory-storage'@crawlee/playwright':specifier: workspace:*version: link:../playwright-crawler@@ -729,33 +729,6 @@ importers:specifier: ^2.8.1version: 2.8.1- packages/memory-storage:- dependencies:- '@crawlee/types':- specifier: workspace:*- version: link:../types- '@crawlee/utils':- specifier: workspace:*- version: link:../utils- '@sapphire/async-queue':- specifier: ^1.5.5- version: 1.5.5- '@sapphire/shapeshift':- specifier: ^4.0.0- version: 4.0.0- content-type:- specifier: ^1.0.5- version: 1.0.5- json5:- specifier: ^2.2.3- version: 2.2.3- mime-types:- specifier: ^3.0.1- version: 3.0.2- tslib:- specifier: ^2.8.1- version: 2.8.1-packages/playwright-crawler:dependencies:'@apify/datastructures':diff --git a/test/core/crawlers/basic_crawler.test.ts b/test/core/crawlers/basic_crawler.test.tsindex a55a7cfee..1a8198b0a 100644--- a/test/core/crawlers/basic_crawler.test.ts+++ b/test/core/crawlers/basic_crawler.test.ts@@ -22,8 +22,7 @@ import {serviceLocator,SessionPool,} from '@crawlee/basic';-import { Dataset, RequestState, SessionPool, Statistics } from '@crawlee/core';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { Dataset, MemoryStorageClient, RequestState, SessionPool, Statistics } from '@crawlee/core';import type { ISession, ProxyInfo } from '@crawlee/types';import type { Dictionary } from '@crawlee/utils';import { RobotsTxtFile, sleep } from '@crawlee/utils';diff --git a/test/e2e/adaptive-playwright-default/actor/package.json b/test/e2e/adaptive-playwright-default/actor/package.jsonindex 10fdd0b2f..53a9cc52e 100644--- a/test/e2e/adaptive-playwright-default/actor/package.json+++ b/test/e2e/adaptive-playwright-default/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/adaptive-playwright-robots-file/actor/package.json b/test/e2e/adaptive-playwright-robots-file/actor/package.jsonindex a64d929ea..bf5d2df6b 100644--- a/test/e2e/adaptive-playwright-robots-file/actor/package.json+++ b/test/e2e/adaptive-playwright-robots-file/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/automatic-persist-value/actor/package.json b/test/e2e/automatic-persist-value/actor/package.jsonindex a48a5d9a2..45b1fd30f 100644--- a/test/e2e/automatic-persist-value/actor/package.json+++ b/test/e2e/automatic-persist-value/actor/package.json@@ -7,7 +7,6 @@"@apify/storage-local": "^3.0.0","@crawlee/basic": "file:./packages/basic-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/autoscaling-max-tasks-per-minute/actor/package.json b/test/e2e/autoscaling-max-tasks-per-minute/actor/package.jsonindex cc50062a7..0dde3644f 100644--- a/test/e2e/autoscaling-max-tasks-per-minute/actor/package.json+++ b/test/e2e/autoscaling-max-tasks-per-minute/actor/package.json@@ -7,7 +7,6 @@"@apify/storage-local": "^3.0.0","@crawlee/basic": "file:./packages/basic-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/camoufox-cloudflare/actor/package.json b/test/e2e/camoufox-cloudflare/actor/package.jsonindex a306d30ff..288b238f5 100644--- a/test/e2e/camoufox-cloudflare/actor/package.json+++ b/test/e2e/camoufox-cloudflare/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/cheerio-curl-impersonate-ts/actor/package.json b/test/e2e/cheerio-curl-impersonate-ts/actor/package.jsonindex c11ca6920..95c795e54 100644--- a/test/e2e/cheerio-curl-impersonate-ts/actor/package.json+++ b/test/e2e/cheerio-curl-impersonate-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core","@crawlee/http": "file:./packages/http-crawler",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils","apify": "next",diff --git a/test/e2e/cheerio-default-ts/actor/package.json b/test/e2e/cheerio-default-ts/actor/package.jsonindex 5284678c1..64b409b36 100644--- a/test/e2e/cheerio-default-ts/actor/package.json+++ b/test/e2e/cheerio-default-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-default/actor/package.json b/test/e2e/cheerio-default/actor/package.jsonindex 094ae318c..ab97ed664 100644--- a/test/e2e/cheerio-default/actor/package.json+++ b/test/e2e/cheerio-default/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-enqueue-links-base/actor/package.json b/test/e2e/cheerio-enqueue-links-base/actor/package.jsonindex 6a21d041f..d96b73cd6 100644--- a/test/e2e/cheerio-enqueue-links-base/actor/package.json+++ b/test/e2e/cheerio-enqueue-links-base/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils","deep-equal": "^2.0.5"diff --git a/test/e2e/cheerio-enqueue-links/actor/package.json b/test/e2e/cheerio-enqueue-links/actor/package.jsonindex 46347245d..f6f61bf7f 100644--- a/test/e2e/cheerio-enqueue-links/actor/package.json+++ b/test/e2e/cheerio-enqueue-links/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils","deep-equal": "^2.0.5"diff --git a/test/e2e/cheerio-error-snapshot/actor/package.json b/test/e2e/cheerio-error-snapshot/actor/package.jsonindex a7ce8575f..694f175de 100644--- a/test/e2e/cheerio-error-snapshot/actor/package.json+++ b/test/e2e/cheerio-error-snapshot/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-ignore-ssl-errors/actor/package.json b/test/e2e/cheerio-ignore-ssl-errors/actor/package.jsonindex b56335126..56f233063 100644--- a/test/e2e/cheerio-ignore-ssl-errors/actor/package.json+++ b/test/e2e/cheerio-ignore-ssl-errors/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-impit-ts/actor/package.json b/test/e2e/cheerio-impit-ts/actor/package.jsonindex 3a9e9ff73..2189731c5 100644--- a/test/e2e/cheerio-impit-ts/actor/package.json+++ b/test/e2e/cheerio-impit-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils","@crawlee/impit-client": "file:./packages/impit-client"diff --git a/test/e2e/cheerio-initial-cookies/actor/package.json b/test/e2e/cheerio-initial-cookies/actor/package.jsonindex 778702f01..edaf317ca 100644--- a/test/e2e/cheerio-initial-cookies/actor/package.json+++ b/test/e2e/cheerio-initial-cookies/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-max-requests/actor/package.json b/test/e2e/cheerio-max-requests/actor/package.jsonindex e8dbdd192..5035a42be 100644--- a/test/e2e/cheerio-max-requests/actor/package.json+++ b/test/e2e/cheerio-max-requests/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-page-info/actor/package.json b/test/e2e/cheerio-page-info/actor/package.jsonindex 6fbef4479..52bd7124a 100644--- a/test/e2e/cheerio-page-info/actor/package.json+++ b/test/e2e/cheerio-page-info/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-request-queue-v2/actor/package.json b/test/e2e/cheerio-request-queue-v2/actor/package.jsonindex 4c155a2a2..753330ddd 100644--- a/test/e2e/cheerio-request-queue-v2/actor/package.json+++ b/test/e2e/cheerio-request-queue-v2/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-robots-file/actor/package.json b/test/e2e/cheerio-robots-file/actor/package.jsonindex 62766e073..0960f88af 100644--- a/test/e2e/cheerio-robots-file/actor/package.json+++ b/test/e2e/cheerio-robots-file/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"diff --git a/test/e2e/cheerio-stop-resume-ts/actor/package.json b/test/e2e/cheerio-stop-resume-ts/actor/package.jsonindex a7fca5872..ec315f699 100644--- a/test/e2e/cheerio-stop-resume-ts/actor/package.json+++ b/test/e2e/cheerio-stop-resume-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/cheerio-throw-on-ssl-errors/actor/package.json b/test/e2e/cheerio-throw-on-ssl-errors/actor/package.jsonindex afd957463..3a61661e1 100644--- a/test/e2e/cheerio-throw-on-ssl-errors/actor/package.json+++ b/test/e2e/cheerio-throw-on-ssl-errors/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/jsdom-default-ts/actor/package.json b/test/e2e/jsdom-default-ts/actor/package.jsonindex 31a0996e5..27a29fcd8 100644--- a/test/e2e/jsdom-default-ts/actor/package.json+++ b/test/e2e/jsdom-default-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/jsdom": "file:./packages/jsdom-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/jsdom-react-ts/actor/package.json b/test/e2e/jsdom-react-ts/actor/package.jsonindex e0a1ba367..aa320eada 100644--- a/test/e2e/jsdom-react-ts/actor/package.json+++ b/test/e2e/jsdom-react-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/jsdom": "file:./packages/jsdom-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/linkedom-default-ts/actor/package.json b/test/e2e/linkedom-default-ts/actor/package.jsonindex 8abc156f9..35da40069 100644--- a/test/e2e/linkedom-default-ts/actor/package.json+++ b/test/e2e/linkedom-default-ts/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/linkedom": "file:./packages/linkedom-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/migration/actor/package.json b/test/e2e/migration/actor/package.jsonindex b5215db2e..812b8602f 100644--- a/test/e2e/migration/actor/package.json+++ b/test/e2e/migration/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/playwright-default/actor/package.json b/test/e2e/playwright-default/actor/package.jsonindex 8abeb337b..8a264f7e2 100644--- a/test/e2e/playwright-default/actor/package.json+++ b/test/e2e/playwright-default/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/playwright-enqueue-links-base/actor/package.json b/test/e2e/playwright-enqueue-links-base/actor/package.jsonindex 445798a50..1e854f7c7 100644--- a/test/e2e/playwright-enqueue-links-base/actor/package.json+++ b/test/e2e/playwright-enqueue-links-base/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/playwright-enqueue-links/actor/package.json b/test/e2e/playwright-enqueue-links/actor/package.jsonindex 1edf81e2f..b2eb51307 100644--- a/test/e2e/playwright-enqueue-links/actor/package.json+++ b/test/e2e/playwright-enqueue-links/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/playwright-initial-cookies/actor/package.json b/test/e2e/playwright-initial-cookies/actor/package.jsonindex 18a721fb8..be48b4c63 100644--- a/test/e2e/playwright-initial-cookies/actor/package.json+++ b/test/e2e/playwright-initial-cookies/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/playwright-introduction-guide/actor/package.json b/test/e2e/playwright-introduction-guide/actor/package.jsonindex dcceb64cd..55838e4d5 100644--- a/test/e2e/playwright-introduction-guide/actor/package.json+++ b/test/e2e/playwright-introduction-guide/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/playwright-multi-run/actor/package.json b/test/e2e/playwright-multi-run/actor/package.jsonindex c246725a5..0d5e038fb 100644--- a/test/e2e/playwright-multi-run/actor/package.json+++ b/test/e2e/playwright-multi-run/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/playwright-robots-file/actor/package.json b/test/e2e/playwright-robots-file/actor/package.jsonindex 91e24336d..14c34c72d 100644--- a/test/e2e/playwright-robots-file/actor/package.json+++ b/test/e2e/playwright-robots-file/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/proxy-rotation/actor/package.json b/test/e2e/proxy-rotation/actor/package.jsonindex dfbc28ef1..2ee8ff4a7 100644--- a/test/e2e/proxy-rotation/actor/package.json+++ b/test/e2e/proxy-rotation/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-default/actor/package.json b/test/e2e/puppeteer-default/actor/package.jsonindex 098bbda2b..515f342b0 100644--- a/test/e2e/puppeteer-default/actor/package.json+++ b/test/e2e/puppeteer-default/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-enqueue-links/actor/package.json b/test/e2e/puppeteer-enqueue-links/actor/package.jsonindex 68f9feab0..8858a0714 100644--- a/test/e2e/puppeteer-enqueue-links/actor/package.json+++ b/test/e2e/puppeteer-enqueue-links/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-error-snapshot/actor/package.json b/test/e2e/puppeteer-error-snapshot/actor/package.jsonindex 2efb6861a..fd7147de9 100644--- a/test/e2e/puppeteer-error-snapshot/actor/package.json+++ b/test/e2e/puppeteer-error-snapshot/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-ignore-ssl-errors/actor/package.json b/test/e2e/puppeteer-ignore-ssl-errors/actor/package.jsonindex 9cb8357a3..69ab34568 100644--- a/test/e2e/puppeteer-ignore-ssl-errors/actor/package.json+++ b/test/e2e/puppeteer-ignore-ssl-errors/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-initial-cookies/actor/package.json b/test/e2e/puppeteer-initial-cookies/actor/package.jsonindex 16c974a3b..1a6b60c06 100644--- a/test/e2e/puppeteer-initial-cookies/actor/package.json+++ b/test/e2e/puppeteer-initial-cookies/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-page-info/actor/package.json b/test/e2e/puppeteer-page-info/actor/package.jsonindex ccceac7fc..9f33f3b29 100644--- a/test/e2e/puppeteer-page-info/actor/package.json+++ b/test/e2e/puppeteer-page-info/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-store-pagination-jquery/actor/package.json b/test/e2e/puppeteer-store-pagination-jquery/actor/package.jsonindex 3709b1666..092261da3 100644--- a/test/e2e/puppeteer-store-pagination-jquery/actor/package.json+++ b/test/e2e/puppeteer-store-pagination-jquery/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-store-pagination/actor/package.json b/test/e2e/puppeteer-store-pagination/actor/package.jsonindex 6fdca3f14..a460901bb 100644--- a/test/e2e/puppeteer-store-pagination/actor/package.json+++ b/test/e2e/puppeteer-store-pagination/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/puppeteer-throw-on-ssl-errors/actor/package.json b/test/e2e/puppeteer-throw-on-ssl-errors/actor/package.jsonindex d363ad728..fde71b195 100644--- a/test/e2e/puppeteer-throw-on-ssl-errors/actor/package.json+++ b/test/e2e/puppeteer-throw-on-ssl-errors/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/puppeteer": "file:./packages/puppeteer-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/request-queue-with-concurrency/actor/package.json b/test/e2e/request-queue-with-concurrency/actor/package.jsonindex 4c95b1aac..567227326 100644--- a/test/e2e/request-queue-with-concurrency/actor/package.json+++ b/test/e2e/request-queue-with-concurrency/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/request-queue-zero-concurrency/actor/package.json b/test/e2e/request-queue-zero-concurrency/actor/package.jsonindex 78084f237..f23dbf622 100644--- a/test/e2e/request-queue-zero-concurrency/actor/package.json+++ b/test/e2e/request-queue-zero-concurrency/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/request-skip-navigation/actor/package.json b/test/e2e/request-skip-navigation/actor/package.jsonindex 77e76e767..c93e3df95 100644--- a/test/e2e/request-skip-navigation/actor/package.json+++ b/test/e2e/request-skip-navigation/actor/package.json@@ -10,7 +10,6 @@"@crawlee/http": "file:./packages/http-crawler","@crawlee/cheerio": "file:./packages/cheerio-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/e2e/session-rotation/actor/package.json b/test/e2e/session-rotation/actor/package.jsonindex c9085592c..1ed984080 100644--- a/test/e2e/session-rotation/actor/package.json+++ b/test/e2e/session-rotation/actor/package.json@@ -9,7 +9,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/playwright": "file:./packages/playwright-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/stagehand-claude/actor/package.json b/test/e2e/stagehand-claude/actor/package.jsonindex 376c70aff..b53a77d6c 100644--- a/test/e2e/stagehand-claude/actor/package.json+++ b/test/e2e/stagehand-claude/actor/package.json@@ -10,7 +10,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/stagehand": "file:./packages/stagehand-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/stagehand-concurrent/actor/package.json b/test/e2e/stagehand-concurrent/actor/package.jsonindex 52b420caf..e3daef8e3 100644--- a/test/e2e/stagehand-concurrent/actor/package.json+++ b/test/e2e/stagehand-concurrent/actor/package.json@@ -10,7 +10,6 @@"@crawlee/browser": "file:./packages/browser-crawler","@crawlee/browser-pool": "file:./packages/browser-pool","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/stagehand": "file:./packages/stagehand-crawler","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils",diff --git a/test/e2e/storage-open-return-storage-object/actor/package.json b/test/e2e/storage-open-return-storage-object/actor/package.jsonindex eba7f94d2..09f3f4157 100644--- a/test/e2e/storage-open-return-storage-object/actor/package.json+++ b/test/e2e/storage-open-return-storage-object/actor/package.json@@ -7,7 +7,6 @@"@apify/storage-local": "^3.0.0","@crawlee/basic": "file:./packages/basic-crawler","@crawlee/core": "file:./packages/core",- "@crawlee/memory-storage": "file:./packages/memory-storage","@crawlee/types": "file:./packages/types","@crawlee/utils": "file:./packages/utils"},diff --git a/test/shared/MemoryStorageEmulator.ts b/test/shared/MemoryStorageEmulator.tsindex 2d46beac7..24d07c7fc 100644--- a/test/shared/MemoryStorageEmulator.ts+++ b/test/shared/MemoryStorageEmulator.ts@@ -1,6 +1,6 @@import { resolve } from 'node:path';-import { MemoryStorageClient } from '@crawlee/memory-storage';+import { MemoryStorageClient } from '@crawlee/core';import { Configuration, KeyValueStore, serviceLocator } from 'crawlee';import { ensureDir } from 'fs-extra';@@ -31,7 +31,7 @@ export class MemoryStorageEmulator extends StorageEmulator {}static override toString() {- return '@crawlee/memory-storage';+ return 'MemoryStorageClient';}getDataset(id?: string) {diff --git a/website/docusaurus.config.js b/website/docusaurus.config.jsindex 46b6e0192..28462ef8e 100644--- a/website/docusaurus.config.js+++ b/website/docusaurus.config.js@@ -15,7 +15,6 @@ const packages = ['jsdom-crawler','linkedom-crawler','stagehand-crawler',- 'memory-storage','fs-storage','utils','types',@@ -34,7 +33,6 @@ const packagesOrder = ['@crawlee/http','@crawlee/http-client','@crawlee/browser',- '@crawlee/memory-storage','@crawlee/fs-storage','@crawlee/browser-pool','@crawlee/utils',