Build AI methods with your coding agent, then run them anywhere: as an MCP for chatbots, as a webapp for people, or via API for your software.
feature/Gateway-leftovers · L-261006-f20535 — dead gateway_test config (#1406)
Louis Choquel4cd240d847e2
diff --git a/.drift/acks/config-docs.toml b/.drift/acks/config-docs.tomlindex a18ea83e2..c9a2aed1e 100644--- a/.drift/acks/config-docs.toml+++ b/.drift/acks/config-docs.toml@@ -1,16 +1,16 @@contract = "config-docs"-digest = "sha256:e3d7f15c7d521e6963df9e168da7eb62cb2b4c244f491d6f463f111091a42042"-reviewed_by = "Claude (Opus 5.5)"-reviewed_at = "2026-10-10T11:26:01Z"-rationale = "real-catch: the triggers add is_show_path to RichLogConfig and pipelex.toml (default false, a prose comment above the table), reword the stale-configuration warning to one message with its remedy in user_action, and reword two DEBUG lines of aws_config. logging-config.md, the only configuration page listing the rich_log keys, documents is_show_path in Display Options and in the full example. The stale-warning example in inference-backend-config.md was rendered through ConsoleLogSink to check it: the message, the quoted migration_steps JSON and the advice line under it match, but the path was written with a leading ellipsis the console never prints for a path that short, since it cuts only past 80 characters, so the example now gives the full path the console prints. The other mentions of the stale warning (telemetry-config.md, the DEV and is_markup_enabled paragraphs of logging-config.md) quote no message and still hold. configs.py, config_cogt.py and the ledgers need nothing: check-migration-schemas passes with the additive key, and no validator moved."+digest = "sha256:7121dcd7b9d44de22c6d0e86c2d2bf206d32a8129c2032465da6f49dd1e13054"+reviewed_by = "Louis Choquel"+reviewed_at = "2026-10-10T13:32:12Z"+rationale = "clean-pass: the triggers remove the unread [inference.gateway_test] table from pipelex.toml with its GatewayTestConfig model and the InferenceConfig.gateway_test field in config_cogt.py. The removal is answered in the same change by ledger entry pipelex-config@8, a safe delete_table, with check-ledger and check-migration-schemas green. No page under docs/configuration documented the table (inference-config.md lists llm, img_gen and extract only), configs.py needs nothing, and no validator moved."[trigger_files]-"pipelex/cogt/config_cogt.py" = "blob:02f71cb4a6b01aebda59c2e31f262ef9c865e17b"+"pipelex/cogt/config_cogt.py" = "blob:8e6514bfcc38e63c9b159a91cd4352e588a24fc5""pipelex/cogt/img_gen/img_gen_job_components.py" = "blob:084985080413fd8d6c3b1b9b0747020cb0161858""pipelex/graph/graph_config.py" = "blob:dc0939a6d2730c0a10b88aa1a6e0b2dd583462a6""pipelex/language/mthds_config.py" = "blob:353009ad8c59dc5266bdd9dfa42b1ad18b67dca7""pipelex/methods/methods_config.py" = "blob:76ca9a0e64f8c10ef6a355aafd0d79d36b09f06a"-"pipelex/pipelex.toml" = "blob:dbc550b61a1c9f5473f0ed9d88ebfd3cc420e119"+"pipelex/pipelex.toml" = "blob:cd7090d669438aef7364babbee6c11a34f1e1227""pipelex/system/configuration/__init__.py" = "blob:8b137891791fe96927ad78e64b0aad7bded08bdc""pipelex/system/configuration/config_check.py" = "blob:2d5de29aba3d2ce205d3d82b4623f37b53108332""pipelex/system/configuration/config_loader.py" = "blob:2850f6b39df6ad2afafefc4d431672cb6ee91ced"diff --git a/CHANGELOG.md b/CHANGELOG.mdindex abd2e4e6c..c900b46c6 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -20,6 +20,10 @@- **A condition whose outcome may be skipped declares it**: a PipeCondition routing to an outcome pipe that takes plainly an input the condition declares optional must declare its own output optional, and is refused with `optional_not_handled` otherwise, since a run without that input skips the outcome and resolves the condition's output absent; an outcome the condition's expression chooses only with that input present declares it forced (`!`) instead, since validation does not read the expression. Every name such an outcome always stores in its caller's memory counts as maybe-absent too, so a sequence binding one into a plain output is refused where it used to validate and then resolve absent; the outcome is listed in `liftable_pipes` under its condition, and a `!` input on an outcome counts in the `optional_force_redundant` lint.- **A sequence step that may be skipped keeps what its run may store**: a step an absent input may lift, whose pipe stores a name on some runs only, now leaves that name maybe-absent when a run may store an absence there, so a sequence binding it into a plain output is refused with `optional_not_handled` rather than validating and then resolving absent.+### Removed++- **`[inference.gateway_test]` (Breaking)**: the maintainer-only section whose `config_id_substitutions` map swapped the Pipelex Gateway's model configurations is gone, with its `GatewayTestConfig` model and the `gateway_test` field of `InferenceConfig`, as nothing has read it since the Gateway backend left in 0.73.0. **Migration:** run `pipelex migrate`, which deletes the section from the file on disk (ledger entry `pipelex-config@8`).+### Security- **The API server refuses to start on an unknown `AUTH_MODE` (Breaking)**: a value that is not exactly `none`, `jwt` or `api_key`, such as `jwtt` or `JWT`, now stops the server at startup with `InvalidAuthModeError`, whose message names the valid modes, where the server used to log a warning and serve every `/v1` route without authentication. An unset or empty `AUTH_MODE` still means `none`. A deployment that booted on a mistyped mode sets it to the mode it meant.diff --git a/pipelex/cogt/config_cogt.py b/pipelex/cogt/config_cogt.pyindex 02f71cb4a..8e6514bfc 100644--- a/pipelex/cogt/config_cogt.py+++ b/pipelex/cogt/config_cogt.py@@ -161,10 +161,6 @@ class LLMConfig(ConfigModel):return value-class GatewayTestConfig(ConfigModel):- config_id_substitutions: dict[str, str]--class InferenceConfig(ConfigModel):# Tier 1 transport retry: the number of times an inference SDK client retries a transient# transport failure (connection error, 408/409/429/5xx, honoring Retry-After) on top of the@@ -176,6 +172,5 @@ class InferenceConfig(ConfigModel):llm: LLMConfigimg_gen: ImgGenConfigextract: ExtractConfig- gateway_test: GatewayTestConfigtemplating: TemplatingConfigdry_run: DryRunConfigdiff --git a/pipelex/cogt/img_gen/img_gen_args_factory.py b/pipelex/cogt/img_gen/img_gen_args_factory.pyindex df531f76a..5399c9591 100644--- a/pipelex/cogt/img_gen/img_gen_args_factory.py+++ b/pipelex/cogt/img_gen/img_gen_args_factory.py@@ -430,8 +430,8 @@ class ImgGenArgsFactory:| AspectRatioTaxonomy.GEMINI_3_FLASH| AspectRatioTaxonomy.GEMINI_3_FLASH_LITE):- # The Google native worker and the gateway build their own `image_config`- # from the job params; this path validates the (aspect_ratio, size) pair+ # The Google native worker builds its own `image_config` from the job+ # params; this path validates the (aspect_ratio, size) pair# against the taxonomy's published grids and exposes the ratio literal.resolved = ImgGenGeminiMapping.resolve_image_config(aspect_ratio_taxonomy,diff --git a/pipelex/cogt/img_gen/img_gen_gemini_mapping.py b/pipelex/cogt/img_gen/img_gen_gemini_mapping.pyindex fdd2678c8..836f7921d 100644--- a/pipelex/cogt/img_gen/img_gen_gemini_mapping.py+++ b/pipelex/cogt/img_gen/img_gen_gemini_mapping.py@@ -2,9 +2,9 @@Keyed by the `AspectRatioTaxonomy` members `GEMINI_2_5` / `GEMINI_3_PRO` / `GEMINI_3_FLASH` /`GEMINI_3_FLASH_LITE` — a `cogt`-owned enum — so this lives beside the args factory that-consumes it rather than in the Google adapter. The native Google worker and the Pipelex-gateway (one Portkey SDK spanning several vendors' taxonomies) both resolve geometry through-it, which is why the mapping cannot belong to either adapter.+consumes it rather than in the Google adapter. The mapping is keyed by taxonomy rather than+by provider, so a worker serving any model whose rules name one of these taxonomies resolves+geometry through it, and it belongs to no single adapter.Reference: https://ai.google.dev/gemini-api/docs/image-generation"""@@ -153,9 +153,9 @@ class ImgGenGeminiMapping:def optional_img_gen_taxonomy(cls, inference_model: InferenceModelSpec) -> AspectRatioTaxonomy | None:"""The model's geometry taxonomy, or None when rules are missing or carry an unknown value.- The None arm mirrors the support-layer abstain policy for remotely-fetched specs (the- Pipelex gateway catalog) whose taxonomy strings may predate this factory: with nothing- to validate against, callers keep their pre-taxonomy behavior instead of hard-failing.+ The None arm mirrors the support-layer abstain policy for specs whose taxonomy strings+ may predate this factory, such as those of an older backend file: with nothing to+ validate against, callers keep their pre-taxonomy behavior instead of hard-failing."""rules = inference_model.rules or {}taxonomy_value = rules.get(ImgGenArgTopic.ASPECT_RATIO)diff --git a/pipelex/cogt/img_gen/img_gen_gpt_mapping.py b/pipelex/cogt/img_gen/img_gen_gpt_mapping.pyindex 4b3b7125d..dc4b1cae2 100644--- a/pipelex/cogt/img_gen/img_gen_gpt_mapping.py+++ b/pipelex/cogt/img_gen/img_gen_gpt_mapping.py@@ -4,8 +4,7 @@ Keyed by `AspectRatioTaxonomy.GPT_IMAGE_LEGACY` / `GPT_IMAGE_2` and the siblingand input-fidelity taxonomies — all `cogt`-owned enums — so this lives beside the argsfactory that consumes it rather than in the OpenAI adapter. More than one adapter servesthese models: the `openai` and `azure_openai` decks both ship models carrying these-taxonomies, and the gateway worker routes any model whose rules name one through the same-args factory. No single adapter owns the mapping.+taxonomies, and both go through the same args factory. No single adapter owns the mapping.Reference: https://platform.openai.com/docs/guides/image-generation"""diff --git a/pipelex/cogt/img_gen/img_gen_param_support.py b/pipelex/cogt/img_gen/img_gen_param_support.pyindex 15a3e7fe6..b8f1ccbfe 100644--- a/pipelex/cogt/img_gen/img_gen_param_support.py+++ b/pipelex/cogt/img_gen/img_gen_param_support.py@@ -10,10 +10,9 @@ Used by:- `PipeImgGen` blueprint validation, to surface config errors at load time.Unknown-taxonomy policy: if a rule value cannot be parsed into the expected-taxonomy enum, the check abstains (returns supported=True). Some backends-(e.g. the Pipelex gateway) carry rules whose taxonomy strings predate this-factory, and those rules are consumed by a different worker — abstaining-prevents false negatives in those cases.+taxonomy enum, the check abstains (returns supported=True). A backend file+written before this factory may carry rules whose taxonomy strings it cannot+parse, and abstaining prevents false negatives in that case."""from typing import NamedTuplediff --git a/pipelex/kit/deck_variants/README.md b/pipelex/kit/deck_variants/README.mdindex a37825664..a7d71b365 100644--- a/pipelex/kit/deck_variants/README.md+++ b/pipelex/kit/deck_variants/README.md@@ -2,9 +2,9 @@A deck variant is a complete set of the numbered model deck files (`1_llm_deck.toml`, `2_img_gen_deck.toml`, `3_extract_deck.toml`, `4_search_deck.toml`, `5_doc_gen_deck.toml`, `6_judgment_deck.toml`) kept as an alternative edition of the deck that the kit ships in `pipelex/kit/configs/inference/deck/`. Nothing loads a variant: `pipelex init` does not copy it, `pipelex update` and `pipelex doctor` do not diff against it, and the deck manifest does not know it exists. It is source code that is kept correct, not configuration that is applied.-`multi_provider/` is the deck Pipelex shipped before the default moved to the models the Pipelex Gateway serves from Azure. It resolves the default aliases and presets to Anthropic, Google and OpenAI models, and it still defines the three provider-named aliases (`best-claude`, `best-gemini`, `best-mistral`) that the shipped deck no longer carries.+`multi_provider/` is the deck Pipelex shipped before the default deck moved to OpenAI's GPT models alone. It resolves the default aliases and presets to Anthropic, Google and OpenAI models, and it still defines the three provider-named aliases (`best-claude`, `best-gemini`, `best-mistral`) that the shipped deck no longer carries.-The files keep their header comment about being managed by `pipelex update`, because they are byte-identical copies of what was shipped. That sentence is true of an installed deck, not of this parked copy.+The files keep their header comment about being managed by `pipelex update`, because they are copies of what was shipped. That sentence is true of an installed deck, not of this parked copy.## What keeps a variant from rotting@@ -12,7 +12,7 @@ The files keep their header comment about being managed by `pipelex update`, becThe first is the vocabulary: the variant must define exactly the same alias, preset and waterfall names, per model family, as the shipped deck. The only differences it tolerates are the names the shipped deck deliberately dropped, which the test lists explicitly, so a stale entry in that list fails too. Adding a preset to the shipped deck and not to a variant turns the test red.-The second is the handles: every model handle a variant names and the shipped deck does not must still be declared by one of the kit's backend files. This is how a parked deck actually goes stale — pipelex v0.61.0 retired the GPT-4.1, o-series and GPT-5 to 5.2 generations, and a variant naming one of those would otherwise pass the vocabulary check forever. The check is scoped to the handles only the variant names, because a handle the shipped deck names too is already exercised at boot, and some of those are gateway-served with no backend section of their own.+The second is the handles: every model handle a variant names and the shipped deck does not must still be declared by one of the kit's backend files. This is how a parked deck actually goes stale — pipelex v0.61.0 retired the GPT-4.1, o-series and GPT-5 to 5.2 generations, and a variant naming one of those would otherwise pass the vocabulary check forever. The check is scoped to the handles only the variant names, because a handle the shipped deck names too is already exercised at boot.## Re-enabling a variantdiff --git a/pipelex/kit/deck_variants/multi_provider/6_judgment_deck.toml b/pipelex/kit/deck_variants/multi_provider/6_judgment_deck.tomlindex 01e45b3c5..5fec6dd59 100644--- a/pipelex/kit/deck_variants/multi_provider/6_judgment_deck.toml+++ b/pipelex/kit/deck_variants/multi_provider/6_judgment_deck.toml@@ -26,7 +26,7 @@## There is deliberately no `choice_default` here, and that is what tells you no judgment model is# served out of the box: a judgment backend is one you bring, so a pipe names the model it judges-# with until the Pipelex Gateway serves the family. Set one here once you have a backend configured.+# with. Set one here once you have a backend configured.[judgment]diff --git a/pipelex/migration/goldens/pipelex-config/[email protected] b/pipelex/migration/goldens/pipelex-config/[email protected]new file mode 100644index 000000000..cd7090d66--- /dev/null+++ b/pipelex/migration/goldens/pipelex-config/[email protected]@@ -0,0 +1,497 @@+####################################################################################################+# Runtime — kernel-layer, process-scoped infrastructure (what runtime_hub brokers)+####################################################################################################++[runtime]++[runtime.storage]+is_fetch_remote_content_enabled = true+is_upload_local_content_enabled = true+method = "local" # local, in_memory, s3, gcp++[runtime.storage.local]+uri_format = "{hash}.{extension}"+local_storage_path = ".pipelex/storage"++[runtime.storage.in_memory]+uri_format = "{hash}.{extension}"++[runtime.storage.s3]+uri_format = "{hash}.{extension}"+bucket_name = ""+region = ""+signed_urls_lifespan_seconds = 3600++[runtime.storage.gcp]+uri_format = "{hash}.{extension}"+bucket_name = ""+project_id = ""+signed_urls_lifespan_seconds = 3600++[runtime.network]+is_fetch_ssrf_guard_enabled = true++[runtime.secrets]+method = "env" # env (built-in); an external plugin may add e.g. vault++####################################################################################################+# Log config+####################################################################################################++[runtime.log]+default_log_level = "INFO"+# sink names the registered log sink boot installs on the root logger, the way runtime.storage.method+# names a storage backend: "console" (the Rich handler, for a terminal), "json" (one JSON object per+# line, for a server behind a log agent), "otlp" (the OpenTelemetry logs signal, for a collector),+# "gcp" (Google Cloud Logging through the client library), or a token an installed plugin registers.+# "console" is the default so the CLI keeps its rendering; a server selects "json". An unregistered+# token stops the boot naming the registered ones.+sink = "console"+# console_log_target controls the stream the console and json sinks write to (log.debug/info/...).+# Logs are diagnostics → stderr.+console_log_target = "stderr"+# console_print_target controls the Console returned by get_console(), used for banners,+# deck notices, and the main `pipelex` CLI's data tables (`show backends`, `show models`,+# `which`, `doctor`). Tables are data the user pipes to a file → stdout.+# Note: the agent CLI (`pipelex-agent`) emits its actual JSON/markdown results via bare+# builtin `print(...)` to sys.stdout, bypassing Rich entirely — so this knob does NOT+# affect the agent CLI data channel. The agent CLI factory additionally forces both+# targets to stderr internally to keep its stdout strictly reserved for the success+# envelope (see `_AGENT_CLI_STDERR_CONSOLE_OVERRIDES` in `agent_cli_factory.py`).+console_print_target = "stdout"++json_logs_indent = 4+presentation_line_width = 120+silenced_problem_ids = ["azure_openai_no_stream_options"]+caller_info_template = "file_line"+is_caller_info_enabled = false++# pretty_print_mode controls the panels `pretty_print(...)` renders, the "Output of pipe" panel after+# every operator pipe among them: "rich" renders Rich tables, "poor" prints plain text, "silent" prints+# nothing and builds no renderable at all. A host with no console, or one that runs pipes on a thread+# that must not stall, sets "silent"; the agent CLI forces it.+pretty_print_mode = "rich"++[runtime.log.package_log_levels]+# for logger names, the dots "." have been replaced by "-" to avoid toml parsing issues+# TODO: use quotes to re-enable names with dots+anthropic = "INFO"+asyncio = "INFO"+botocore = "INFO"+botocore-credentials = "WARNING"+google = "INFO"+httpx = "WARNING"+httpcore = "INFO"+# openai 3.x sends its requests through the httpx2 and httpcore2 forks, which log under their own+# names, so they get the levels of the packages they fork: otherwise every inference call prints an+# INFO line carrying the provider's endpoint URL and the HTTP status.+httpx2 = "WARNING"+httpcore2 = "INFO"+openai = "INFO"+instructor = "INFO"+urllib3-connectionpool = "INFO"+urllib3-util-retry = "INFO"++pipelex = "INFO"+++# The settings of the "console" sink. is_show_path adds a column at the right of every line naming the+# source file and line that logged it, which makes a long line wrap; is_link_path_enabled makes that+# path clickable where the terminal supports links.+[runtime.log.rich_log]+is_show_time = false+is_show_level = true+is_show_path = false+is_link_path_enabled = true+highlighter_name = "json"+is_rich_tracebacks = true+is_tracebacks_word_wrap = true+is_tracebacks_show_locals = false+tracebacks_suppress = []+keywords_to_hilight = []++# The settings of the "otlp" sink. An endpoint key, when set, names the collector's logs URL+# (for instance "http://localhost:4318/v1/logs"); left unset, the exporter follows the OpenTelemetry+# environment conventions: OTEL_EXPORTER_OTLP_LOGS_ENDPOINT, then OTEL_EXPORTER_OTLP_ENDPOINT, then+# the collector default on localhost. Empty headers likewise leave OTEL_EXPORTER_OTLP_HEADERS in charge.+# A header value may name a secret rather than carry it, a collector's bearer token written+# "Bearer ${OTLP_AUTH_TOKEN}" for one: it is resolved through the secrets provider [runtime.secrets]+# selects, which boot builds before the sink, and a variable that does not resolve stops the boot.+[runtime.log.otlp]+headers = {}++# The settings of the "gcp" sink, which writes to Google Cloud Logging through the client library.+# Most processes want "json" instead: a platform that runs a logging agent over the container's+# stdout, Cloud Run and GKE among them, ingests the JSON objects that sink writes and needs no client+# at all. Select "gcp" for a process that must write to Cloud Logging directly. log_name is the+# Cloud Logging log the entries land under. A project_id key names the project when it is not the+# ambient one the credentials or the metadata server declare, and a credentials_file_path key names a+# service-account JSON file when Application Default Credentials are not what the process should use.+# The path may be a secret too, "${GCP_CREDENTIALS_FILE_PATH}" being the one the gcp storage provider+# reads, resolved through the secrets provider the way the otlp headers are.+[runtime.log.gcp]+log_name = "pipelex"++# [runtime.log.redaction] governs the one processor every sink is behind: it scrubs the secret shapes+# the workspace already knows (an Authorization bearer token, an api-key or signature header, an OAuth+# code parameter, a cookie, a JSON secret entry, and the sk_ / plx_sk_ / pk_ / bl_ key prefixes) out of+# the message and out of every string a field carries, and neutralises the control characters in a+# field value so a caller-supplied string cannot forge a line or a field separator. is_enabled = false+# turns it off for a process that redacts downstream. extra_patterns are regular expressions added to+# the shipped families for the secret shapes only this deployment knows; every match is replaced by+# "[REDACTED]", and a pattern the re module refuses is a configuration error named at load.+[runtime.log.redaction]+is_enabled = true+extra_patterns = []++[runtime.aws]+api_key_method = "env"+bedrock_access_variant = "aws_access"++[runtime.reporting]+is_log_costs_to_console = true+is_generate_cost_report_file_enabled = false+cost_report_dir_path = "reports"+cost_report_base_name = "cost_report"+cost_report_extension = "csv"+cost_report_unit_scale = 1.0++####################################################################################################+# Tracing config (event log for distributed tracing across workers)+####################################################################################################++[runtime.tracing]+is_enabled = true+backend = "ndjson"++[runtime.tracing.ndjson]+traces_dir = ".pipelex/traces"++[runtime.tracing.dynamodb]+table_name = ""+region = ""++[runtime.observer]+observer_dir = "results/observer"++[runtime.plugins]+# Names of discovered plugins to skip at startup (a denylist). Discovery is the+# source of truth for which plugins are present; this only turns one off.+disabled = []++####################################################################################################+# Inference — the model-calling seam (was [cogt])+####################################################################################################++[inference]+transport_max_retries = 2++[inference.model_deck]+is_model_fallback_enabled = true+missing_presets_reaction = "log"++[inference.llm]+default_max_images = 100+is_structure_prompt_enabled = true+is_dump_text_prompts_enabled = false+is_dump_response_text_enabled = false+schema_reask_max_attempts = 3++[inference.llm.instructor]+is_dump_kwargs_enabled = false+is_dump_response_enabled = false+is_dump_error_enabled = false++[inference.llm.openai.effort_to_level_map]+none = "none"+minimal = "minimal"+low = "low"+medium = "medium"+high = "high"+xhigh = "xhigh"+max = "xhigh"++[inference.llm.anthropic]+structured_output_timeout_seconds = 1200++[inference.llm.anthropic.effort_to_level_map]+none = "disabled"+minimal = "low"+low = "low"+medium = "medium"+high = "high"+xhigh = "xhigh"+max = "max"++[inference.llm.google.effort_to_level_map]+none = "disabled"+minimal = "minimal"+low = "low"+medium = "medium"+high = "high"+xhigh = "high"+max = "high"++[inference.llm.mistral.effort_to_level_map]+none = "disabled"+minimal = "reasoning"+low = "reasoning"+medium = "reasoning"+high = "reasoning"+xhigh = "reasoning"+max = "reasoning"++[inference.llm.effort_to_budget_maps.anthropic]+none = 0 # Required by validator; unreachable at runtime (level map gates NONE as disabled before budget lookup)+minimal = 512+low = 1024+medium = 5000+high = 16384+xhigh = 32768+max = 65536++[inference.llm.effort_to_budget_maps.gemini]+none = 0 # Required by validator; unreachable at runtime (level map gates NONE as disabled before budget lookup)+minimal = 512+low = 1024+medium = 5000+high = 16384+xhigh = 32768+max = 65536++[inference.llm.generic_templates]+output_structure_prompt = """+++---+The instance we want to generate will be for the following class:+{{ class_structure_str }}++DO NOT create information.+If some information is not present for an attribute, output the default value or None according to the attribute definition.+"""++structuring_prompt = """+Read the following text carefully and produce the requested structured output from it.++---+{{ text }}+"""++####################################################################################################+# Image generation config+####################################################################################################++[inference.img_gen.img_gen_job]+is_sync_mode = false++[inference.img_gen.img_gen_param_defaults]+nb_steps = 28 # 28 is a good default for Flux, possible values are [1,2,4,8] for SDXL Lightning+quality = "low"+aspect_ratio = "square" # "square", "landscape_4_3", "landscape_3_2", "landscape_16_9", "landscape_21_9", "landscape_4_1", "landscape_8_1", "portrait_3_4", "portrait_2_3", "portrait_9_16", "portrait_9_21", "portrait_1_4", "portrait_1_8"+guidance_scale = 2.5+background = "auto"+is_moderated = true+safety_tolerance = 5+is_raw = false+seed = "auto"++[inference.img_gen.quality_to_steps_maps]+flux = { "low" = 14, "medium" = 28, "high" = 56 }+sdxl_lightning = { "low" = 2, "medium" = 4, "high" = 8 }+qwen_image = { "low" = 10, "medium" = 20, "high" = 28 }++####################################################################################################+# Extract config+####################################################################################################++[inference.extract]+default_page_views_dpi = 72++####################################################################################################+# Templating config+####################################################################################################++[inference.templating]+default_templating_style = { tag_style = "xml" }++####################################################################################################+# Dry run config+####################################################################################################++[inference.dry_run]+text_gen_truncate_length = 256+nb_list_items = 3+nb_extract_pages = 4+allowed_to_fail_pipes = [+ "failing_pipelines.infinite_loop_1", # Loop but only for testing purposes — matched on the namespaced pipe_ref+]+image_urls = [+ "https://storage.googleapis.com/public_test_files_7fa6_4277_9ab/fashion/fashion_photo_1.jpg",+ "https://storage.googleapis.com/public_test_files_7fa6_4277_9ab/fashion/fashion_photo_2.png",+]++####################################################################################################+# Interpreter — library-scoped method machinery (what interpreter_hub brokers)+####################################################################################################++[interpreter]++####################################################################################################+# MTHDS config+####################################################################################################++[interpreter.mthds.inline_tables]+spaces_inside_curly_braces = true++[interpreter.mthds.strings]+prefer_literal = false+force_multiline = false+length_limit_to_multiline = 100+ensure_trailing_newline = true+ensure_leading_blank_line = true++[interpreter.mthds.concepts]+structure_field_ordering = [+ "type",+ "concept_ref",+ "item_type",+ "item_concept_ref",+ "description",+ "choices",+ "required",+]++[interpreter.mthds.pipes]+field_ordering = ["type", "description", "inputs", "output"]++####################################################################################################+# Methods config+####################################################################################################++[interpreter.methods]+# When a bundle references another method by address (github.com/...->domain.pipe) and no installed+# method matches, fetch the package by address and install it into ~/.mthds/methods/ so the load can+# proceed. Set to false to forbid network fetches at load time — a miss then raises a diagnostic+# telling you the address and how to install it manually. The PIPELEX_METHODS_FETCH_ON_MISS+# environment variable (1/0, true/false) overrides this setting when set.+fetch_on_miss = true++####################################################################################################+# Pipe run config+####################################################################################################++[interpreter.pipe_run]+pipe_stack_limit = 20++####################################################################################################+# PipeFunc config+####################################################################################################++[interpreter.pipe_func]+# PipeFunc execution mode, selected from the PipeFuncExecutorRegistry the plugins populate. "direct"+# (core) imports and runs customer functions in this process; "daytona" (our Daytona sandbox plugin)+# runs them in a remote box. Any non-"direct" mode carries customer PipeFunc code as source text and+# executes it only inside an isolated sandbox, never imported here.+execution_mode = "direct"++####################################################################################################+# Pipeline execution config+####################################################################################################++[interpreter.pipeline_execution]+is_normalize_data_urls_to_storage = true+is_mock_inputs = false+is_generate_graph = true+is_generate_usage = true++# Bounded fan-out concurrency for PipeBatch: at most this many branches run at once.+# A modest default keeps a large workload (one pipe over many items) from overwhelming+# asyncio, memory, and provider rate limits. Set to "unbounded" to disable the bound.+max_concurrency = 8++[interpreter.pipeline_execution.graph]++[interpreter.pipeline_execution.graph.data_inclusion]+stuff_json_content = true+error_stack_traces = true+pipe_and_concept_registry = true++[interpreter.pipeline_execution.graph.graphs_inclusion]+graphspec_json = true+mermaidflow_mmd = true+mermaidflow_html = true+reactflow_html = true++[interpreter.pipeline_execution.graph.mermaid]+direction = "left_to_right"+is_include_data_edges = true+is_include_contains_edges = false+is_include_selected_outcome_edges = true+is_show_stuff_codes = false++[interpreter.pipeline_execution.graph.mermaid.style]+theme = "dark"++[interpreter.pipeline_execution.graph.reactflow]+is_use_cdn = true+layout_direction = "left_to_right"+nodesep = 50+ranksep = 30+edge_type = "bezier"+initial_zoom = 1.0+pan_to_top = true+default_title = "Pipelex Graph"+# Forwarded to mthds-ui as `showControllers`: when true, controller pipes (PipeSequence,+# PipeParallel, PipeCondition, PipeBatch) render as grouping containers around their children;+# when false, they collapse out of the graph and edges connect stuff nodes directly.+show_batch_controller = true++[interpreter.pipeline_execution.graph.reactflow.style]+theme = "dark"+palette = "dracula"++[interpreter.scan]+excluded_dirs = [+ ".venv",+ "venv",+ "env",+ ".env",+ "virtualenv",+ ".virtualenv",+ ".git",+ "__pycache__",+ ".pytest_cache",+ ".mypy_cache",+ ".ruff_cache",+ "node_modules",+ "results",+]++[interpreter.builder]+fix_loop_max_attempts = 10+default_output_dir = "."+default_bundle_file_name = "bundle"+default_directory_base_name = "pipeline"++####################################################################################################+# Run — where `pipelex run` and `pipelex-agent run` execute a method+####################################################################################################++[run]+# Where a run executes when the command passes neither --hosted nor --local:+# - "local" runs on this machine, on the backends configured in .pipelex/inference/ (your own provider keys)+# - "hosted" runs on the hosted Pipelex API, with the key in PIPELEX_API_KEY (the environment or ~/.pipelex/.env),+# at the origin in PIPELEX_BASE_URL (https://api.pipelex.com when unset)+execution = "local"++####################################################################################################+# Kit Config+####################################################################################################++[kit]+# Agent rule files to install (used by `pipelex-dev kit rules`)+# Each entry is one of: "cursor", "agents", "claude"+# - "cursor" installs .cursor/rules/*.mdc files (cannot be combined with others)+# - "agents" / "claude" install AGENTS.md / CLAUDE.md respectively — both can be listed together+preferred_agent_targets = ["claude", "agents"]diff --git a/pipelex/migration/goldens/pipelex-config/[email protected] b/pipelex/migration/goldens/pipelex-config/[email protected]new file mode 100644index 000000000..0765458c6--- /dev/null+++ b/pipelex/migration/goldens/pipelex-config/[email protected]@@ -0,0 +1,1504 @@+{+ "surface_id": "pipelex-config",+ "schema_version": 8,+ "document_root_is_open": false,+ "paths": {+ "inference": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.dry_run": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.dry_run.allowed_to_fail_pipes": {+ "value_type": "list[str]",+ "required": false,+ "default": [+ "failing_pipelines.infinite_loop_1"+ ],+ "open_node": false+ },+ "inference.dry_run.image_urls": {+ "value_type": "list[str]",+ "required": true,+ "default": [+ "https://storage.googleapis.com/public_test_files_7fa6_4277_9ab/fashion/fashion_photo_1.jpg",+ "https://storage.googleapis.com/public_test_files_7fa6_4277_9ab/fashion/fashion_photo_2.png"+ ],+ "open_node": false+ },+ "inference.dry_run.nb_extract_pages": {+ "value_type": "int",+ "required": true,+ "default": 4,+ "open_node": false+ },+ "inference.dry_run.nb_list_items": {+ "value_type": "int",+ "required": true,+ "default": 3,+ "open_node": false+ },+ "inference.dry_run.text_gen_truncate_length": {+ "value_type": "int",+ "required": true,+ "default": 256,+ "open_node": false+ },+ "inference.extract": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.extract.default_page_views_dpi": {+ "value_type": "int",+ "required": true,+ "default": 72,+ "open_node": false+ },+ "inference.img_gen": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.img_gen.img_gen_job": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.img_gen.img_gen_job.is_sync_mode": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.aspect_ratio": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "landscape_16_9",+ "landscape_21_9",+ "landscape_3_2",+ "landscape_4_1",+ "landscape_4_3",+ "landscape_8_1",+ "portrait_1_4",+ "portrait_1_8",+ "portrait_2_3",+ "portrait_3_4",+ "portrait_9_16",+ "portrait_9_21",+ "square"+ ],+ "default": "square",+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.background": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "auto",+ "opaque",+ "transparent"+ ],+ "default": "auto",+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.guidance_scale": {+ "value_type": "float",+ "required": true,+ "default": 2.5,+ "open_node": false,+ "constraints": {+ "gt": 0+ }+ },+ "inference.img_gen.img_gen_param_defaults.is_moderated": {+ "value_type": "bool",+ "required": false,+ "default": true,+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.is_raw": {+ "value_type": "bool",+ "required": false,+ "default": false,+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.nb_steps": {+ "value_type": "int",+ "required": false,+ "default": 28,+ "open_node": false,+ "constraints": {+ "gt": 0+ }+ },+ "inference.img_gen.img_gen_param_defaults.quality": {+ "value_type": "enum",+ "required": false,+ "enum_members": [+ "high",+ "low",+ "medium"+ ],+ "default": "low",+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.safety_tolerance": {+ "value_type": "int",+ "required": true,+ "default": 5,+ "open_node": false,+ "constraints": {+ "ge": 1,+ "le": 6+ }+ },+ "inference.img_gen.img_gen_param_defaults.seed": {+ "value_type": "int | literal",+ "required": true,+ "enum_members": [+ "auto"+ ],+ "default": "auto",+ "open_node": false+ },+ "inference.img_gen.img_gen_param_defaults.size": {+ "value_type": "enum | table",+ "required": false,+ "enum_members": [+ "0.5k",+ "1k",+ "2k",+ "4k"+ ],+ "open_node": false+ },+ "inference.img_gen.quality_to_steps_maps": {+ "value_type": "dict[str, dict[str, int]]",+ "required": true,+ "default": {+ "flux": {+ "low": 14,+ "medium": 28,+ "high": 56+ },+ "sdxl_lightning": {+ "low": 2,+ "medium": 4,+ "high": 8+ },+ "qwen_image": {+ "low": 10,+ "medium": 20,+ "high": 28+ }+ },+ "open_node": true+ },+ "inference.img_gen.quality_to_steps_maps.*": {+ "value_type": "dict[str, int]",+ "required": true,+ "open_node": true+ },+ "inference.img_gen.quality_to_steps_maps.*.*": {+ "value_type": "int",+ "required": true,+ "open_node": false+ },+ "inference.llm": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.llm.anthropic": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.llm.anthropic.effort_to_level_map": {+ "value_type": "dict[str, str]",+ "required": true,+ "default": {+ "none": "disabled",+ "minimal": "low",+ "low": "low",+ "medium": "medium",+ "high": "high",+ "xhigh": "xhigh",+ "max": "max"+ },+ "open_node": true+ },+ "inference.llm.anthropic.effort_to_level_map.*": {+ "value_type": "str",+ "required": true,+ "open_node": false+ },+ "inference.llm.anthropic.structured_output_timeout_seconds": {+ "value_type": "int",+ "required": true,+ "default": 1200,+ "open_node": false+ },+ "inference.llm.default_max_images": {+ "value_type": "int",+ "required": true,+ "default": 100,+ "open_node": false+ },+ "inference.llm.effort_to_budget_maps": {+ "value_type": "dict[str, dict[str, int]]",+ "required": true,+ "default": {+ "anthropic": {+ "none": 0,+ "minimal": 512,+ "low": 1024,+ "medium": 5000,+ "high": 16384,+ "xhigh": 32768,+ "max": 65536+ },+ "gemini": {+ "none": 0,+ "minimal": 512,+ "low": 1024,+ "medium": 5000,+ "high": 16384,+ "xhigh": 32768,+ "max": 65536+ }+ },+ "open_node": true+ },+ "inference.llm.effort_to_budget_maps.*": {+ "value_type": "dict[str, int]",+ "required": true,+ "open_node": true+ },+ "inference.llm.effort_to_budget_maps.*.*": {+ "value_type": "int",+ "required": true,+ "open_node": false+ },+ "inference.llm.generic_templates": {+ "value_type": "dict[str, str]",+ "required": true,+ "default": {+ "output_structure_prompt": "\n\n---\nThe instance we want to generate will be for the following class:\n{{ class_structure_str }}\n\nDO NOT create information.\nIf some information is not present for an attribute, output the default value or None according to the attribute definition.\n",+ "structuring_prompt": "Read the following text carefully and produce the requested structured output from it.\n\n---\n{{ text }}\n"+ },+ "open_node": true+ },+ "inference.llm.generic_templates.*": {+ "value_type": "str",+ "required": true,+ "open_node": false+ },+ "inference.llm.google": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.llm.google.effort_to_level_map": {+ "value_type": "dict[str, str]",+ "required": true,+ "default": {+ "none": "disabled",+ "minimal": "minimal",+ "low": "low",+ "medium": "medium",+ "high": "high",+ "xhigh": "high",+ "max": "high"+ },+ "open_node": true+ },+ "inference.llm.google.effort_to_level_map.*": {+ "value_type": "str",+ "required": true,+ "open_node": false+ },+ "inference.llm.instructor": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.llm.instructor.is_dump_error_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "inference.llm.instructor.is_dump_kwargs_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "inference.llm.instructor.is_dump_response_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "inference.llm.is_dump_response_text_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "inference.llm.is_dump_text_prompts_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "inference.llm.is_structure_prompt_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "inference.llm.mistral": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.llm.mistral.effort_to_level_map": {+ "value_type": "dict[str, str]",+ "required": true,+ "default": {+ "none": "disabled",+ "minimal": "reasoning",+ "low": "reasoning",+ "medium": "reasoning",+ "high": "reasoning",+ "xhigh": "reasoning",+ "max": "reasoning"+ },+ "open_node": true+ },+ "inference.llm.mistral.effort_to_level_map.*": {+ "value_type": "str",+ "required": true,+ "open_node": false+ },+ "inference.llm.openai": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.llm.openai.effort_to_level_map": {+ "value_type": "dict[str, str]",+ "required": true,+ "default": {+ "none": "none",+ "minimal": "minimal",+ "low": "low",+ "medium": "medium",+ "high": "high",+ "xhigh": "xhigh",+ "max": "xhigh"+ },+ "open_node": true+ },+ "inference.llm.openai.effort_to_level_map.*": {+ "value_type": "str",+ "required": true,+ "open_node": false+ },+ "inference.llm.schema_reask_max_attempts": {+ "value_type": "int",+ "required": true,+ "default": 3,+ "open_node": false,+ "constraints": {+ "ge": 1,+ "le": 10+ }+ },+ "inference.model_deck": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.model_deck.is_model_fallback_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "inference.model_deck.missing_presets_reaction": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "log",+ "none",+ "raise"+ ],+ "default": "log",+ "open_node": false+ },+ "inference.templating": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.templating.default_templating_style": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "inference.templating.default_templating_style.tag_style": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "no_tag",+ "square_brackets",+ "ticks",+ "xml"+ ],+ "default": "xml",+ "open_node": false+ },+ "inference.templating.default_templating_style.text_format": {+ "value_type": "enum",+ "required": false,+ "enum_members": [+ "html",+ "json",+ "markdown",+ "plain"+ ],+ "open_node": false+ },+ "inference.transport_max_retries": {+ "value_type": "int",+ "required": true,+ "default": 2,+ "open_node": false,+ "constraints": {+ "ge": 0,+ "le": 10+ }+ },+ "interpreter": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.builder": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.builder.default_bundle_file_name": {+ "value_type": "str",+ "required": true,+ "default": "bundle",+ "open_node": false+ },+ "interpreter.builder.default_directory_base_name": {+ "value_type": "str",+ "required": true,+ "default": "pipeline",+ "open_node": false+ },+ "interpreter.builder.default_output_dir": {+ "value_type": "str",+ "required": true,+ "default": ".",+ "open_node": false+ },+ "interpreter.builder.fix_loop_max_attempts": {+ "value_type": "int",+ "required": true,+ "default": 10,+ "open_node": false+ },+ "interpreter.methods": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.methods.fetch_on_miss": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.mthds": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.mthds.concepts": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.mthds.concepts.structure_field_ordering": {+ "value_type": "list[str]",+ "required": true,+ "default": [+ "type",+ "concept_ref",+ "item_type",+ "item_concept_ref",+ "description",+ "choices",+ "required"+ ],+ "open_node": false+ },+ "interpreter.mthds.inline_tables": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.mthds.inline_tables.spaces_inside_curly_braces": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.mthds.pipes": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.mthds.pipes.field_ordering": {+ "value_type": "list[str]",+ "required": true,+ "default": [+ "type",+ "description",+ "inputs",+ "output"+ ],+ "open_node": false+ },+ "interpreter.mthds.strings": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.mthds.strings.ensure_leading_blank_line": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.mthds.strings.ensure_trailing_newline": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.mthds.strings.force_multiline": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "interpreter.mthds.strings.length_limit_to_multiline": {+ "value_type": "int",+ "required": true,+ "default": 100,+ "open_node": false+ },+ "interpreter.mthds.strings.prefer_literal": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "interpreter.pipe_func": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipe_func.execution_mode": {+ "value_type": "str",+ "required": true,+ "default": "direct",+ "open_node": false+ },+ "interpreter.pipe_run": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipe_run.pipe_stack_limit": {+ "value_type": "int",+ "required": true,+ "default": 20,+ "open_node": false+ },+ "interpreter.pipeline_execution": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.data_inclusion": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.data_inclusion.error_stack_traces": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.data_inclusion.pipe_and_concept_registry": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.data_inclusion.stuff_json_content": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.graphs_inclusion": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.graphs_inclusion.graphspec_json": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.graphs_inclusion.mermaidflow_html": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.graphs_inclusion.mermaidflow_mmd": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.graphs_inclusion.reactflow_html": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.direction": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "left_to_right",+ "top_down"+ ],+ "default": "left_to_right",+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.is_include_contains_edges": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.is_include_data_edges": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.is_include_selected_outcome_edges": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.is_show_stuff_codes": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.style": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.mermaid.style.theme": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "base",+ "dark",+ "default",+ "forest",+ "neutral"+ ],+ "default": "dark",+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.default_title": {+ "value_type": "str",+ "required": true,+ "default": "Pipelex Graph",+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.edge_type": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "bezier",+ "smoothstep",+ "step",+ "straight"+ ],+ "default": "bezier",+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.initial_zoom": {+ "value_type": "float",+ "required": true,+ "default": 1.0,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.is_use_cdn": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.layout_direction": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "left_to_right",+ "top_down"+ ],+ "default": "left_to_right",+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.nodesep": {+ "value_type": "int",+ "required": true,+ "default": 50,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.pan_to_top": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.ranksep": {+ "value_type": "int",+ "required": true,+ "default": 30,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.show_batch_controller": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.style": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.style.palette": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "dracula",+ "yellow_blue"+ ],+ "default": "dracula",+ "open_node": false+ },+ "interpreter.pipeline_execution.graph.reactflow.style.theme": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "dark",+ "light",+ "system"+ ],+ "default": "dark",+ "open_node": false+ },+ "interpreter.pipeline_execution.is_generate_graph": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.is_generate_usage": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.is_mock_inputs": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "interpreter.pipeline_execution.is_normalize_data_urls_to_storage": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "interpreter.pipeline_execution.max_concurrency": {+ "value_type": "int | literal",+ "required": true,+ "enum_members": [+ "unbounded"+ ],+ "default": 8,+ "open_node": false,+ "constraints": {+ "ge": 1+ }+ },+ "interpreter.scan": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "interpreter.scan.excluded_dirs": {+ "value_type": "frozenset[str]",+ "required": true,+ "default": [+ ".venv",+ "venv",+ "env",+ ".env",+ "virtualenv",+ ".virtualenv",+ ".git",+ "__pycache__",+ ".pytest_cache",+ ".mypy_cache",+ ".ruff_cache",+ "node_modules",+ "results"+ ],+ "open_node": false+ },+ "kit": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "kit.preferred_agent_targets": {+ "value_type": "list[enum]",+ "required": true,+ "enum_members": [+ "agents",+ "claude",+ "cursor"+ ],+ "default": [+ "claude",+ "agents"+ ],+ "open_node": false+ },+ "run": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "run.execution": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "hosted",+ "local"+ ],+ "default": "local",+ "open_node": false+ },+ "runtime": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.aws": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.aws.api_key_method": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "env",+ "secret_provider"+ ],+ "default": "env",+ "open_node": false+ },+ "runtime.aws.bedrock_access_variant": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "aws_access",+ "bedrock_token"+ ],+ "default": "aws_access",+ "open_node": false+ },+ "runtime.log": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.log.caller_info_template": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "file_func",+ "file_line",+ "file_line_func",+ "func",+ "func_line",+ "func_module",+ "func_module_line"+ ],+ "default": "file_line",+ "open_node": false+ },+ "runtime.log.console_log_target": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "file",+ "stderr",+ "stdout"+ ],+ "default": "stderr",+ "open_node": false+ },+ "runtime.log.console_print_target": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "file",+ "stderr",+ "stdout"+ ],+ "default": "stdout",+ "open_node": false+ },+ "runtime.log.default_log_level": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "CRITICAL",+ "DEBUG",+ "ERROR",+ "INFO",+ "OFF",+ "VERBOSE",+ "WARNING"+ ],+ "default": "INFO",+ "open_node": false+ },+ "runtime.log.gcp": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.log.gcp.credentials_file_path": {+ "value_type": "str",+ "required": false,+ "open_node": false+ },+ "runtime.log.gcp.log_name": {+ "value_type": "str",+ "required": true,+ "default": "pipelex",+ "open_node": false+ },+ "runtime.log.gcp.project_id": {+ "value_type": "str",+ "required": false,+ "open_node": false+ },+ "runtime.log.is_caller_info_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "runtime.log.json_logs_indent": {+ "value_type": "int",+ "required": true,+ "default": 4,+ "open_node": false+ },+ "runtime.log.otlp": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.log.otlp.endpoint": {+ "value_type": "str",+ "required": false,+ "open_node": false+ },+ "runtime.log.otlp.headers": {+ "value_type": "dict[str, str]",+ "required": true,+ "default": {},+ "open_node": true+ },+ "runtime.log.otlp.headers.*": {+ "value_type": "str",+ "required": true,+ "open_node": false+ },+ "runtime.log.package_log_levels": {+ "value_type": "dict[str, enum]",+ "required": true,+ "default": {+ "anthropic": "INFO",+ "asyncio": "INFO",+ "botocore": "INFO",+ "botocore-credentials": "WARNING",+ "google": "INFO",+ "httpx": "WARNING",+ "httpcore": "INFO",+ "httpx2": "WARNING",+ "httpcore2": "INFO",+ "openai": "INFO",+ "instructor": "INFO",+ "urllib3-connectionpool": "INFO",+ "urllib3-util-retry": "INFO",+ "pipelex": "INFO"+ },+ "open_node": true+ },+ "runtime.log.package_log_levels.*": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "CRITICAL",+ "DEBUG",+ "ERROR",+ "INFO",+ "OFF",+ "VERBOSE",+ "WARNING"+ ],+ "open_node": false+ },+ "runtime.log.presentation_line_width": {+ "value_type": "int",+ "required": true,+ "default": 120,+ "open_node": false+ },+ "runtime.log.pretty_print_mode": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "poor",+ "rich",+ "silent"+ ],+ "default": "rich",+ "open_node": false+ },+ "runtime.log.redaction": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.log.redaction.extra_patterns": {+ "value_type": "list[str]",+ "required": true,+ "default": [],+ "open_node": false+ },+ "runtime.log.redaction.is_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.log.rich_log": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.log.rich_log.highlighter_name": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "json",+ "repr"+ ],+ "default": "json",+ "open_node": false+ },+ "runtime.log.rich_log.is_link_path_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.log.rich_log.is_rich_tracebacks": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.log.rich_log.is_show_level": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.log.rich_log.is_show_path": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "runtime.log.rich_log.is_show_time": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "runtime.log.rich_log.is_tracebacks_show_locals": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "runtime.log.rich_log.is_tracebacks_word_wrap": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.log.rich_log.keywords_to_hilight": {+ "value_type": "list[str]",+ "required": true,+ "default": [],+ "open_node": false+ },+ "runtime.log.rich_log.tracebacks_suppress": {+ "value_type": "list[str]",+ "required": true,+ "default": [],+ "open_node": false+ },+ "runtime.log.silenced_problem_ids": {+ "value_type": "list[str]",+ "required": true,+ "default": [+ "azure_openai_no_stream_options"+ ],+ "open_node": false+ },+ "runtime.log.sink": {+ "value_type": "str",+ "required": true,+ "default": "console",+ "open_node": false+ },+ "runtime.network": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.network.is_fetch_ssrf_guard_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.observer": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.observer.observer_dir": {+ "value_type": "str",+ "required": true,+ "default": "results/observer",+ "open_node": false+ },+ "runtime.plugins": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.plugins.disabled": {+ "value_type": "list[str]",+ "required": true,+ "default": [],+ "open_node": false+ },+ "runtime.reporting": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.reporting.cost_report_base_name": {+ "value_type": "str",+ "required": true,+ "default": "cost_report",+ "open_node": false+ },+ "runtime.reporting.cost_report_dir_path": {+ "value_type": "str",+ "required": true,+ "default": "reports",+ "open_node": false+ },+ "runtime.reporting.cost_report_extension": {+ "value_type": "str",+ "required": true,+ "default": "csv",+ "open_node": false+ },+ "runtime.reporting.cost_report_unit_scale": {+ "value_type": "float",+ "required": true,+ "default": 1.0,+ "open_node": false,+ "constraints": {+ "gt": 0+ }+ },+ "runtime.reporting.is_generate_cost_report_file_enabled": {+ "value_type": "bool",+ "required": true,+ "default": false,+ "open_node": false+ },+ "runtime.reporting.is_log_costs_to_console": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.secrets": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.secrets.method": {+ "value_type": "str",+ "required": true,+ "default": "env",+ "open_node": false+ },+ "runtime.storage": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.storage.gcp": {+ "value_type": "table",+ "required": false,+ "open_node": false+ },+ "runtime.storage.gcp.bucket_name": {+ "value_type": "str",+ "required": true,+ "default": "",+ "open_node": false+ },+ "runtime.storage.gcp.project_id": {+ "value_type": "str",+ "required": true,+ "default": "",+ "open_node": false+ },+ "runtime.storage.gcp.signed_urls_lifespan_seconds": {+ "value_type": "int | literal",+ "required": true,+ "enum_members": [+ "disabled"+ ],+ "default": 3600,+ "open_node": false+ },+ "runtime.storage.gcp.uri_format": {+ "value_type": "str",+ "required": true,+ "default": "{hash}.{extension}",+ "open_node": false+ },+ "runtime.storage.in_memory": {+ "value_type": "table",+ "required": false,+ "open_node": false+ },+ "runtime.storage.in_memory.uri_format": {+ "value_type": "str",+ "required": true,+ "default": "{hash}.{extension}",+ "open_node": false+ },+ "runtime.storage.is_fetch_remote_content_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.storage.is_upload_local_content_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.storage.local": {+ "value_type": "table",+ "required": false,+ "open_node": false+ },+ "runtime.storage.local.local_storage_path": {+ "value_type": "str",+ "required": true,+ "default": ".pipelex/storage",+ "open_node": false+ },+ "runtime.storage.local.uri_format": {+ "value_type": "str",+ "required": true,+ "default": "{hash}.{extension}",+ "open_node": false+ },+ "runtime.storage.method": {+ "value_type": "str",+ "required": true,+ "default": "local",+ "open_node": false+ },+ "runtime.storage.s3": {+ "value_type": "table",+ "required": false,+ "open_node": false+ },+ "runtime.storage.s3.bucket_name": {+ "value_type": "str",+ "required": true,+ "default": "",+ "open_node": false+ },+ "runtime.storage.s3.region": {+ "value_type": "str",+ "required": true,+ "default": "",+ "open_node": false+ },+ "runtime.storage.s3.signed_urls_lifespan_seconds": {+ "value_type": "int | literal",+ "required": true,+ "enum_members": [+ "disabled"+ ],+ "default": 3600,+ "open_node": false+ },+ "runtime.storage.s3.uri_format": {+ "value_type": "str",+ "required": true,+ "default": "{hash}.{extension}",+ "open_node": false+ },+ "runtime.tracing": {+ "value_type": "table",+ "required": true,+ "open_node": false+ },+ "runtime.tracing.backend": {+ "value_type": "enum",+ "required": true,+ "enum_members": [+ "dynamodb",+ "ndjson"+ ],+ "default": "ndjson",+ "open_node": false+ },+ "runtime.tracing.dynamodb": {+ "value_type": "table",+ "required": false,+ "open_node": false+ },+ "runtime.tracing.dynamodb.region": {+ "value_type": "str",+ "required": true,+ "default": "",+ "open_node": false+ },+ "runtime.tracing.dynamodb.table_name": {+ "value_type": "str",+ "required": true,+ "default": "",+ "open_node": false+ },+ "runtime.tracing.is_enabled": {+ "value_type": "bool",+ "required": true,+ "default": true,+ "open_node": false+ },+ "runtime.tracing.ndjson": {+ "value_type": "table",+ "required": false,+ "open_node": false+ },+ "runtime.tracing.ndjson.traces_dir": {+ "value_type": "str",+ "required": true,+ "default": ".pipelex/traces",+ "open_node": false+ }+ }+}diff --git a/pipelex/migration/ledgers/pipelex-config.toml b/pipelex/migration/ledgers/pipelex-config.tomlindex 4497c090c..49a675e82 100644--- a/pipelex/migration/ledgers/pipelex-config.toml+++ b/pipelex/migration/ledgers/pipelex-config.toml@@ -12,7 +12,7 @@ id = "pipelex-config"title = "The main Pipelex configuration"base_file = "pipelex.toml"tier_glob = "pipelex_*.toml"-current_schema_version = 7+current_schema_version = 8min_supported_schema_version = 0# This entry is inserted *below* the reshape rather than appended above it, and the order is what@@ -506,3 +506,24 @@ its tags: put the values in `fields`, which the console colours by name.kind = "delete_key"table_path = ["runtime", "log", "rich_log"]key = "is_markup_enabled"++[[migration]]+id = "pipelex-config@8"+to_schema_version = 8+introduced_in = "0.82.0"+breaking = true+safety = "safe"+title = "Drop the maintainer-only [inference.gateway_test] section"+description = """+`[inference.gateway_test]` held the `config_id_substitutions` map that let Pipelex staff swap the \+Pipelex Gateway's model configurations while testing, and it went unread when the Gateway backend left \+the runtime in 0.73.0. The section is gone from the configuration, and a file still carrying it loses it.+"""+guidance = """+Nothing to decide: the map was empty unless a maintainer filled it, and nothing has read it since \+0.73.0, so dropping it changes no behaviour.+"""++[[migration.ops]]+kind = "delete_table"+table_path = ["inference", "gateway_test"]diff --git a/pipelex/pipelex.toml b/pipelex/pipelex.tomlindex dbc550b61..cd7090d66 100644--- a/pipelex/pipelex.toml+++ b/pipelex/pipelex.toml@@ -308,14 +308,6 @@ qwen_image = { "low" = 10, "medium" = 20, "high" = 28 }[inference.extract]default_page_views_dpi = 72-####################################################################################################-# Gateway test config-####################################################################################################--[inference.gateway_test.config_id_substitutions]-# this is an empty dict, it's only used by Pipelex staff to override the ¨Pipelex Gateway¨ config-# in order to test new model integrations or debug issues with the Gateway-##################################################################################################### Templating config####################################################################################################diff --git a/tests/unit/pipelex/kit/test_deck_variants.py b/tests/unit/pipelex/kit/test_deck_variants.pyindex 0ffdf223a..a11eba44c 100644--- a/tests/unit/pipelex/kit/test_deck_variants.py+++ b/tests/unit/pipelex/kit/test_deck_variants.py@@ -11,8 +11,8 @@ every variant through the same loader the runtime uses and holds it to the shippdeclared only as another type does not count.The second check is scoped to the models only the variant names. A handle the shipped deck names-too is not held to them here: some are served only through Pipelex, with no backend section-of their own, and the shipped deck's default aliases have their own guard in `test_shipped_deck_defaults.py`.+too is not held to them here: it is already exercised at boot, and the shipped deck's default+aliases have their own guard in `test_shipped_deck_defaults.py`."""from collections.abc import Mapping