Build AI methods with your coding agent, then run them anywhere: as an MCP for chatbots, as a webapp for people, or via API for your software.
Release v0.84.0
Louis Choquel1a8e69a4c222
diff --git a/.badges/tests.json b/.badges/tests.jsonindex 5f95578fa..a0d011ac1 100644--- a/.badges/tests.json+++ b/.badges/tests.json@@ -1,7 +1,7 @@{"schemaVersion": 1,"label": "tests",- "message": "18033",+ "message": "18279","color": "blue","cacheSeconds": 300}diff --git a/.test_durations b/.test_durationsindex ef073cbb2..bbb7ded24 100644--- a/.test_durations+++ b/.test_durations@@ -1,4 +1,7 @@{+ "tests/e2e/agent_cli/test_usage_stats_canary.py::TestUsageStatsCanary::test_canary_never_leaves_the_machine": 25.4434,+ "tests/e2e/agent_cli/test_usage_stats_init.py::TestUsageStatsInit::test_agent_init_reports_what_it_set[config0-local-enabled0]": 1.4113,+ "tests/e2e/agent_cli/test_usage_stats_init.py::TestUsageStatsInit::test_agent_init_reports_what_it_set[config1-hosted-None]": 1.8653,"tests/e2e/pipelex/cli/test_csv_run.py::TestCsvRun::test_bundle_cmd_forwards_save_csv": 0.0726,"tests/e2e/pipelex/cli/test_csv_run.py::TestCsvRun::test_run_command_declares_save_csv[run_bundle_cmd]": 0.0004,"tests/e2e/pipelex/cli/test_csv_run.py::TestCsvRun::test_run_command_declares_save_csv[run_method_cmd]": 0.001,@@ -4234,6 +4237,56 @@"tests/unit/pipelex/cli/test_update_cmd.py::TestUpdateCmd::test_other_backend_files_are_left_alone": 0.0858,"tests/unit/pipelex/cli/test_update_cmd.py::TestUpdateCmd::test_x_custom_files_are_left_alone": 0.006,"tests/unit/pipelex/cli/test_update_cmd.py::TestUpdateCmd::test_yes_flag_skips_confirm": 0.0042,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_a_command_runs_without_statistics_when_they_cannot_be_read": 0.0025,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_a_command_stopped_at_a_prompt_is_cancelled[ask-prompt_answer0-cancelled]": 0.1469,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_a_command_stopped_at_a_prompt_is_cancelled[ask-prompt_answer2-failed]": 0.0054,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_a_command_stopped_at_a_prompt_is_cancelled[confirm-n-cancelled]": 0.007,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_carries_the_notice_once[args0-False-None]": 0.0094,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_carries_the_notice_once[args1-True-None]": 0.0098,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_carries_the_notice_once[args2-True-None]": 0.0064,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_carries_the_notice_once[args3-False-_off_by_do_not_track]": 0.0034,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_carries_the_notice_once[args4-True-_off_by_tool_switch]": 0.0043,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_carries_the_notice_once[args5-True-_off_by_disable]": 0.004,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_reports_what_it_set[pipelex-agent-args1-_hosted_init-expected1]": 0.0062,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_reports_what_it_set[pipelex-args0-_local_init-expected0]": 0.0055,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_reports_what_it_set[pipelex-args2-_succeed-expected2]": 0.0043,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_init_reports_what_it_set[pipelex-args3-_local_init-expected3]": 0.0047,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args13-validate bundle-False]": 0.0006,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args14-validate bundle-True]": 0.0005,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args15-validate bundle-True]": 0.0039,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args16-validate bundle-True]": 0.0004,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args17-validate bundle-False]": 0.0005,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args18-inputs pipe-True]": 0.0009,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-agent-args19-models-False]": 0.0053,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args0-validate bundle-False]": 0.2018,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args1-validate pipe-False]": 0.0834,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args10-None-False]": 0.0004,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args11-None-False]": 0.0008,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args12-None-False]": 0.1207,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args2-validate pipe-False]": 0.0005,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args3-codegen types-False]": 0.0009,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args4-other-False]": 0.0006,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args5-other-False]": 0.0954,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args6-None-False]": 0.0005,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args7-None-False]": 0.0011,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args8-None-False]": 0.0005,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_invocation_is_resolved_without_reading_arguments[pipelex-args9-None-False]": 0.0011,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_machine_read_stderr_gets_no_notice": 0.0051,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_notice_once_then_command_completed": 0.0079,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_outcome_of_the_command[_cancelled_exit-expected3]": 0.0047,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_outcome_of_the_command[_fail_with_input_error-expected1]": 0.0135,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_outcome_of_the_command[_hosted_run-expected4]": 0.0069,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_outcome_of_the_command[_interrupted-expected2]": 0.0038,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_outcome_of_the_command[_succeed-expected0]": 0.0059,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_statistics_never_replace_the_commands_exit": 0.0071,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_statistics_off_print_and_write_nothing": 0.0027,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_the_notice_init_shows_records_nothing": 0.0044,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_uncounted_invocations_touch_nothing[args0]": 0.002,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_uncounted_invocations_touch_nothing[args1]": 0.1385,+ "tests/unit/pipelex/cli/test_usage_stats_cli.py::TestUsageStatsCli::test_uncounted_invocations_touch_nothing[args2]": 0.0012,+ "tests/unit/pipelex/cli/test_usage_stats_cmd.py::TestUsageStatsCmd::test_disable_enable_and_reset_id": 0.0098,+ "tests/unit/pipelex/cli/test_usage_stats_cmd.py::TestUsageStatsCmd::test_disable_reports_a_state_it_cannot_write": 0.0056,+ "tests/unit/pipelex/cli/test_usage_stats_cmd.py::TestUsageStatsCmd::test_status_is_read_only_and_prints_the_status_object": 0.1137,"tests/unit/pipelex/cli/test_validate_exit_codes.py::TestValidateExitCodes::test_agent_bundle_directory_with_multiple_mthds_exits_2": 0.0027,"tests/unit/pipelex/cli/test_validate_exit_codes.py::TestValidateExitCodes::test_agent_bundle_directory_without_mthds_exits_2": 0.0029,"tests/unit/pipelex/cli/test_validate_exit_codes.py::TestValidateExitCodes::test_agent_bundle_path_that_is_neither_file_nor_dir_exits_2": 0.0033,@@ -4795,6 +4848,19 @@"tests/unit/pipelex/cogt/doc_gen/test_render_job.py::TestRenderJob::test_a_job_with_another_source_s_payload_too_is_refused": 0.0008,"tests/unit/pipelex/cogt/doc_gen/test_render_job.py::TestRenderJob::test_a_job_without_its_payload_is_refused": 0.0013,"tests/unit/pipelex/cogt/doc_gen/test_render_job.py::TestRenderJob::test_a_stray_field_is_refused": 0.0003,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_filter_after_markdown_in_a_block_prints_what_it_returns": 0.0016,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[False-in_a_loop]": 0.003,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[False-in_a_macro]": 0.1456,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[False-in_a_set_block]": 0.0022,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[False-in_another_filter_block]": 0.0022,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[True-in_a_loop]": 0.0035,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[True-in_a_macro]": 0.0846,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[True-in_a_set_block]": 0.0048,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_as_the_printed_form_does[True-in_another_filter_block]": 0.003,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_its_plain_text_without_a_finalize": 0.002,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_prints_through_the_engine_s_finalize": 0.0881,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_reads_none_printed_in_its_body_as_text": 0.0017,+ "tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_markdown_filter_block_under_autoescape_prints_as_the_printed_form_does": 0.0021,"tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_missing_value_fails_the_render": 0.0034,"tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_render_spends_from_a_budget": 0.2597,"tests/unit/pipelex/cogt/doc_gen/test_template_environment.py::TestPlainDataTemplateEnvironment::test_a_template_renders_synchronously": 0.1669,@@ -9584,6 +9650,7 @@"tests/unit/pipelex/kit/test_paths.py::TestKitPaths::test_get_kit_root": 1.1306,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_a_judgment_default_naming_a_handle_the_kit_declares_only_as_an_llm_is_refused": 0.1292,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_a_waterfall_is_read_through_every_entry": 0.0023,+ "tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_an_alias_awaiting_a_kit_backend_is_a_shipped_default[judgment-default-judgment-vision]": 0.0018,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[doc_gen-default-pdf]": 0.01,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[extract-default-extract-document]": 0.0097,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[extract-default-extract-image]": 0.0098,@@ -9594,6 +9661,7 @@"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[img_gen-default-general]": 0.0105,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[img_gen-default-premium]": 0.0115,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[img_gen-default-small]": 0.0101,+ "tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[judgment-default-judgment-vision]": 0.1101,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[judgment-default-judgment]": 0.0096,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[llm-default-general]": 0.1125,"tests/unit/pipelex/kit/test_shipped_deck_defaults.py::TestShippedDeckDefaults::test_default_alias_reaches_a_declared_model[llm-default-large-context-code]": 0.0115,@@ -12612,6 +12680,13 @@"tests/unit/pipelex/pipe_run/test_pipe_run_params.py::TestOutputMultiplicityToApply::test_override_true_enables_multiple_outputs": 0.0003,"tests/unit/pipelex/pipe_run/test_pipe_run_params.py::TestOutputMultiplicityToApply::test_return_basemodel_structure": 0.0003,"tests/unit/pipelex/pipe_run/test_pipe_run_params_isolation.py::TestPipeRunParamsIsolation::test_make_deep_copy_isolates_pipe_stack": 0.9471,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_a_statistic_never_changes_the_runs_result[_call_then_fail-PipelexError]": 0.0066,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_a_statistic_never_changes_the_runs_result[_call_then_succeed-None]": 0.0052,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_every_run_end_reports_with_its_tokens[_call_then_fail-failed-PipelexError]": 0.1033,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_every_run_end_reports_with_its_tokens[_call_then_succeed-succeeded-None]": 0.01,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_every_run_end_reports_with_its_tokens[_cancelled-cancelled-CancelledError]": 0.008,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_untraced_run_reports_usage_unknown": 0.0082,+ "tests/unit/pipelex/pipe_run/test_pipe_run_usage_stats.py::TestPipeRunUsageStats::test_validation_sweeps_and_statistics_off_report_nothing": 0.0879,"tests/unit/pipelex/pipe_run/test_run_batch_branch_hook.py::TestRunBatchBranchHook::test_default_delegates_to_run": 0.7221,"tests/unit/pipelex/pipe_run/test_run_batch_branch_hook.py::TestRunBatchBranchHook::test_default_runs_the_observer_hooks_like_run": 0.1006,"tests/unit/pipelex/pipe_run/test_scoped_pipe_router.py::TestScopedPipeRouter::test_nested_scope_restores_outer_override_on_inner_exit": 0.0008,@@ -12954,6 +13029,26 @@"tests/unit/pipelex/pipeline/test_select_primary_blueprint.py::TestSelectPrimaryBlueprint::test_first_declaring_wins_over_earlier_non_declaring": 0.001,"tests/unit/pipelex/pipeline/test_select_primary_blueprint.py::TestSelectPrimaryBlueprint::test_multiple_declaring_first_wins": 0.0034,"tests/unit/pipelex/pipeline/test_select_primary_blueprint.py::TestSelectPrimaryBlueprint::test_none_declaring_selects_first_with_no_ref": 0.8941,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_a_call_that_fell_back_is_attributed_to_the_backend_that_made_it": 0.0009,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_a_validation_statistic_never_changes_the_validation": 0.0031,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_code_generated": 0.0019,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_failed_and_cancelled_runs[cancelled-None]": 0.0008,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_failed_and_cancelled_runs[failed-error0]": 0.001,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_failed_and_cancelled_runs[failed-error1]": 0.0013,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_invalid_verdict_handled_on_the_way_out_is_read": 0.0009,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_method_validated": 0.1212,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_nothing_is_built_while_statistics_are_off": 0.0011,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[None-claude-4-sonnet-custom-other]": 0.0033,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[anthropic-claude-4-sonnet-anthropic-claude-4-sonnet]": 0.0026,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[anthropic-has spaces in it-anthropic-other]": 0.0011,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[anthropic-my-fine-tune-secret-anthropic-other]": 0.0005,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[my_company_gateway-claude-4-sonnet-custom-other]": 0.0004,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[openai-claude-4-sonnet-openai-other]": 0.0004,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[pipelex_manifold-claude-4-sonnet-pipelex_manifold-claude-4-sonnet]": 0.0004,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_provider_and_model_are_from_closed_lists[pipelex_manifold-my-fine-tune-secret-pipelex_manifold-other]": 0.0004,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_run_with_usage_reports_one_model_used_per_model": 0.1498,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_unrated_model_leaves_the_run_cost_out": 0.001,+ "tests/unit/pipelex/pipeline/test_usage_stats_reporting.py::TestUsageStatsReporting::test_usage_unknown_sends_no_counts_and_no_model_used": 0.0005,"tests/unit/pipelex/pipeline/test_vacuous_presence_warnings.py::TestVacuousPresenceWarnings::test_a_concept_less_object_node_is_silent": 0.0037,"tests/unit/pipelex/pipeline/test_vacuous_presence_warnings.py::TestVacuousPresenceWarnings::test_a_hierarchical_domain_keeps_its_full_path_in_the_locator": 0.0004,"tests/unit/pipelex/pipeline/test_vacuous_presence_warnings.py::TestVacuousPresenceWarnings::test_a_non_entry_pipe_with_the_warning_shape_is_silent": 0.0003,@@ -14876,6 +14971,145 @@"tests/unit/pipelex/system/test_storage_scope.py::TestScopeIsRequired::test_omitting_it_is_an_error_rather_than_a_default": 0.0005,"tests/unit/pipelex/system/test_storage_scope.py::TestTheTelemetryPlaceholderStaysOutOfIdentity::test_no_module_uses_it_as_an_identity_or_a_scope": 0.2869,"tests/unit/pipelex/system/test_storage_scope.py::TestTheTelemetryPlaceholderStaysOutOfIdentity::test_the_dry_run_identity_is_not_the_telemetry_placeholder": 0.0172,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_a_command_that_could_not_configure_statistics_keeps_them_off": 0.0013,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_ci_posts_in_process_before_the_command_ends": 0.5162,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_ci_spools_what_it_could_not_send": 0.0107,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_command_posts_in_process_when_the_sender_cannot_start": 0.5221,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_command_spools_and_starts_the_detached_sender": 0.0046,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_configuration_never_fails_for_a_state_that_cannot_be_looked_into": 0.1182,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_configuration_never_fails_for_want_of_a_home": 0.0039,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_debug_prints_the_envelope_instead_of_sending": 0.0046,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_envelope_carries_the_common_properties": 0.0038,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_fork_reset_drops_what_the_parent_held": 0.0846,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_in_process_posts_also_send_what_earlier_commands_queued": 0.6449,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_process_local_identifier_is_never_persisted": 0.0761,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_python_program_posts_from_its_thread": 0.5284,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_statistics_off_create_nothing": 0.1152,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[None-False-cli_command]": 0.5799,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[None-False-long_running]": 0.5072,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[accepted-True-cli_command]": 0.5144,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[accepted-True-long_running]": 0.6047,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[refused-False-cli_command]": 0.5044,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[refused-False-long_running]": 0.5124,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[retry-False-cli_command]": 0.5041,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_the_spool_goes_only_after_an_accepted_post[retry-False-long_running]": 0.6628,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_thread_after_an_error_in_a_post[error0-False]": 2.6445,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_thread_after_an_error_in_a_post[error1-True]": 2.6404,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_thread_also_sends_what_earlier_processes_queued": 0.6232,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_client.py::TestUsageStatsClient::test_thread_drops_events_once_disabled": 0.5112,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_a_provider_without_its_field_never_breaks_init_s_event": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_ci_and_container_markers_are_the_schemas": 0.0816,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_command_lists_are_the_schemas": 0.0005,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_destination_is_the_schemas": 0.1164,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_enums_are_the_schemas_values": 0.0006,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_environment_variables_are_the_schemas": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_init_backend_fields_are_the_providers_and_the_schemas": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_manifold_is_reported_as_its_shipped_backend_name": 0.0007,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_notice_is_the_schemas_text_for_pipelex": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_off_by_tokens_are_pipelexs_switches_in_order": 0.0006,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_packaged_configuration_ships_statistics_on": 0.1249,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_patterns_are_the_schemas": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_spool_limits_and_budgets_are_the_schemas": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_state_names_are_the_schemas": 0.0008,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_contract.py::TestUsageStatsContract::test_switch_values_are_the_schemas": 0.0002,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_answer_decides_what_happens_to_the_file[200-accepted-False]": 0.5166,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_answer_decides_what_happens_to_the_file[400-refused-False]": 0.5987,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_answer_decides_what_happens_to_the_file[413-refused-False]": 0.5386,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_answer_decides_what_happens_to_the_file[429-retry-True]": 0.6145,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_answer_decides_what_happens_to_the_file[503-retry-True]": 0.5144,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_batch_is_posted_with_the_project_token": 0.6432,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_detached_sender_delivers_where_pipelex_is_not_importable": 0.6268,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_detached_sender_file_posts_the_queue": 0.7419,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_drain_returns_within_its_budget_and_keeps_the_file": 0.5438,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_events_of_a_replaced_identifier_are_dropped": 0.601,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_events_that_cannot_be_encoded_are_refused_for_good": 0.5088,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_nothing_is_sent_once_disabled_or_migrated": 0.5053,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_nothing_is_sent_while_a_legacy_opt_out_cannot_be_migrated": 0.5844,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_post_returns_within_its_budget_whatever_the_network_does": 0.5269,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_sender_drains_only_its_own_tool": 0.6154,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_sender_imports_the_standard_library_alone": 0.0783,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_sender_posts_a_file_only_to_the_endpoint_it_was_queued_for": 0.5314,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_sender_refuses_any_other_origin[http://10.0.0.1:8123]": 0.0025,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_sender_refuses_any_other_origin[http://127.0.0.1:8123/batch/]": 0.1437,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_sender_refuses_any_other_origin[https://example.com]": 0.0023,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_delivery.py::TestUsageStatsDelivery::test_unreachable_endpoint_keeps_the_file": 0.0442,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_claim_and_release": 0.1467,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_file_of_another_shape_is_not_read[[]]": 0.0011,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_file_of_another_shape_is_not_read[not json]": 0.0015,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_file_of_another_shape_is_not_read[{\"spool_version\": 1, \"endpoint\": 8123, \"events\": []}]": 0.0018,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_file_of_another_shape_is_not_read[{\"spool_version\": 1, \"events\": [1]}]": 0.0009,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_file_of_another_shape_is_not_read[{\"spool_version\": 1, \"events\": {}}]": 0.0012,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_file_of_another_shape_is_not_read[{\"spool_version\": 2, \"events\": []}]": 0.082,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_prune": 0.0021,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_spool_keeps_at_most_its_limit_deleting_the_oldest": 0.018,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_written_file_holds_its_events": 0.0773,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_spool.py::TestUsageStatsSpool::test_written_file_records_the_endpoint_it_was_queued_for": 0.0809,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_disable_and_enable": 0.0048,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_first_identifier_is_created_once": 0.1244,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_identifier_with_whitespace_is_read": 0.0014,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_config_dialect": 0.0006,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_opt_out_is_migrated_once": 0.0039,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_value_that_does_not_mean_off_migrates_nothing[# DISABLE_TELEMETRY=1\\n]": 0.0012,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_value_that_does_not_mean_off_migrates_nothing[DISABLE_TELEMETRY=0\\n]": 0.0025,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_value_that_does_not_mean_off_migrates_nothing[DISABLE_TELEMETRY=false\\n]": 0.0011,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_value_that_does_not_mean_off_migrates_nothing[OTHER=1\\n]": 0.1222,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_legacy_value_that_does_not_mean_off_migrates_nothing[]": 0.0013,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_malformed_identifier_is_never_rewritten[0F8FAD5B-D9CB-469F-A165-70867728950E]": 0.0022,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_malformed_identifier_is_never_rewritten[0f8fad5b-d9cb-169f-a165-70867728950e]": 0.0021,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_malformed_identifier_is_never_rewritten[]": 0.0036,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_malformed_identifier_is_never_rewritten[not-a-uuid]": 0.0031,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_no_hard_links_means_nothing_persisted": 0.0757,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_no_reader_raises_for_a_state_that_cannot_be_looked_into": 0.0019,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_notice_markers_and_internal": 0.0009,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_racing_first_runs_converge_on_one_identifier": 0.0076,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_reset_id_empties_every_spool": 0.0053,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_state.py::TestUsageStatsState::test_stale_temporary_identifiers_are_deleted": 0.0022,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_declared_host_and_release_version": 0.0005,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[-False]": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://10.0.0.1:8123-False]": 0.1269,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://127.0.0.1-False]": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://127.0.0.1:0-False]": 0.0005,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://127.0.0.1:65536-False]": 0.0008,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://127.0.0.1:8123-True]": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://127.0.0.1:8123/batch/-False]": 0.0006,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://[::1]:65535-True]": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://localhost.example.com:80-False]": 0.0024,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[http://localhost:9-True]": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[https://127.0.0.1:8123-False]": 0.0008,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_endpoint_override_is_loopback_only[https://eu.i.posthog.com-False]": 0.0021,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_every_switch_is_listed_in_the_contracts_order": 0.0047,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[ FALSE -False]": 0.0012,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[-False]": 0.0012,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[0-False]": 0.0011,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[1-True]": 0.0013,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[anything-True]": 0.0011,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[no-True]": 0.0011,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_flag_reading[true-True]": 0.0024,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_home_configuration_is_not_a_switch": 0.0035,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_packaged_default": 0.0014,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[-False]": 0.0014,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[runtime]\\nfoo = 1\\n-False]": 0.0022,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[usage_stats\\nenabled = false\\n-True]": 0.0028,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[usage_stats]\\n-False]": 0.0053,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[usage_stats]\\nenabled = \"false\"\\n-True]": 0.0037,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[usage_stats]\\nenabled = 0\\n-True]": 0.0025,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[usage_stats]\\nenabled = false\\n-True]": 0.0022,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[[usage_stats]\\nenabled = true\\n-False]": 0.0015,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[\\xff\\xfe[usage_stats]-True]": 0.002,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_fails_closed[usage_stats = false\\n-True]": 0.0019,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_setting_needs_a_project": 0.0019,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_project_that_cannot_be_looked_into_fails_closed": 0.1337,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[ No -True]": 0.0039,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[ Yes-False]": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[-False]": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[0-True]": 0.1022,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[1-False]": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[2-True]": 0.1451,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[OFF-True]": 0.0004,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[disabled-True]": 0.0005,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[false-True]": 0.0005,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[on-False]": 0.0003,+ "tests/unit/pipelex/system/usage_stats/test_usage_stats_switches.py::TestUsageStatsSwitches::test_tool_switch_reading[true-False]": 0.0009,"tests/unit/pipelex/test_base_exceptions.py::TestErrorReportColdImport::test_error_report_constructable_without_cogt_exceptions_loaded": 1.1613,"tests/unit/pipelex/test_class_registry_scoping.py::TestHubClassRegistry::test_an_opened_library_gets_its_own_registry_seeded_from_the_global_one": 0.4581,"tests/unit/pipelex/test_class_registry_scoping.py::TestHubClassRegistry::test_get_class_registry_library_without_registry_falls_back_to_global": 0.0007,@@ -16750,6 +16984,14 @@"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_dict_view_is_estimated_before_it_is_printed[{{ big.items() }}]": 0.0086,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_dict_view_is_estimated_before_it_is_printed[{{ big.values() | string }}]": 0.0034,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_dict_view_is_estimated_before_it_is_printed[{{ big.values() }}]": 0.0033,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_prints_a_result_that_is_no_text_as_a_tag_prints_it[False]": 0.0039,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_prints_a_result_that_is_no_text_as_a_tag_prints_it[True]": 0.0076,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_s_result_goes_through_the_caller_s_finalize": 0.0011,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_s_result_is_charged_as_a_print[False-no_text]": 0.0057,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_s_result_is_charged_as_a_print[False-text]": 0.0019,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_s_result_is_charged_as_a_print[True-no_text]": 0.0138,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_s_result_is_charged_as_a_print[True-text]": 0.0036,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_filter_block_s_result_that_is_no_text_is_escaped_as_a_printed_value": 0.0907,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_long_word_under_its_width_is_read_in_one_pass": 0.0518,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_a_percent_key_left_open_is_read_in_one_pass": 0.0243,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_async_render_raises_the_budget_error": 0.0021,@@ -16857,6 +17099,7 @@"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-static_text_and_escaping]": 0.0015,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-str_format]": 0.0024,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-tests]": 0.0021,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-text_filter_blocks]": 0.1126,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-text_filters]": 0.0022,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-undefined_macro_argument]": 0.0019,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-False-undefined_values]": 0.0029,@@ -16891,6 +17134,7 @@"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-static_text_and_escaping]": 0.0013,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-str_format]": 0.0016,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-tests]": 0.0025,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-text_filter_blocks]": 0.0025,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-text_filters]": 0.0034,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-undefined_macro_argument]": 0.0017,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[False-True-undefined_values]": 0.0024,@@ -16925,6 +17169,7 @@"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-static_text_and_escaping]": 0.0024,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-str_format]": 0.0032,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-tests]": 0.0132,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-text_filter_blocks]": 0.0064,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-text_filters]": 0.0025,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-undefined_macro_argument]": 0.0033,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-False-undefined_values]": 0.0042,@@ -16959,6 +17204,7 @@"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-static_text_and_escaping]": 0.0041,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-str_format]": 0.0029,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-tests]": 0.0068,+ "tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-text_filter_blocks]": 0.0043,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-text_filters]": 0.0026,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-undefined_macro_argument]": 0.0054,"tests/unit/pipelex/tools/test_jinja2_render_budget.py::TestRenderBudget::test_renders_as_the_stock_sandbox[True-True-undefined_values]": 0.0065,diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 7830f514f..fd6e5939d 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -1,11 +1,15 @@# Changelog-## [Unreleased]+## [v0.84.0] - 2026-10-12++### Highlights++**pipelex now reports anonymous usage statistics, on by default.** Commands, runs, validations and code generations are counted with closed-list properties only, never a method, a prompt, an input or an output, and `DO_NOT_TRACK`, `PIPELEX_USAGE_STATS=0`, `pipelex usage-stats disable` or `[usage_stats] enabled = false` in a project turn them off.### Added- **Anonymous usage statistics**: pipelex now reports anonymous counts of its use to Pipelex, on by default: a `command_completed` per command of the `pipelex` and `pipelex-agent` CLIs, a `run_completed` per run however it ended, with a `model_used` per model when the run's usage events were read, a `method_validated` per validation and a `code_generated` per code generation, whatever started them. Every property is a count, a boolean or a value from a closed list: no method, pipe code, concept name, prompt, input, output, file name, error message or argument is ever sent, and a model outside the backend tables pipelex ships is sent as `other`. The first command with statistics on prints a notice on stderr, once per machine, except where stderr is a machine contract (`pipelex-agent` with JSON errors), and `pipelex init` shows the same text on stderr whenever statistics are on, once per run. Statistics stay off under `DO_NOT_TRACK`, `PIPELEX_USAGE_STATS=0`, `pipelex usage-stats disable`, the `mthds` CLI's former `DISABLE_TELEMETRY` opt-out, `[usage_stats] enabled = false` in a project's `.pipelex/pipelex.toml` or in the packaged configuration, a `~/.mthds/usage-stats/` pipelex cannot look into, and the `pytest` integration mode; the [usage statistics page](https://docs.pipelex.com/latest/setup/usage-statistics/) lists what is collected. A dedicated client sends them to PostHog's EU region, from a detached sender after a CLI command and from a daemon thread in a Python program or the API server; `telemetry.toml` and the telemetry you configure are untouched.-- **`pipelex usage-stats`**: `status` (with `--format json`), `disable`, `enable` and `reset-id` show and change the statistics of every Pipelex tool on the machine, through the state they share in `~/.mthds/usage-stats/`. `PIPELEX_USAGE_STATS_DEBUG` prints each event to stderr as a JSON line instead of sending it, and `PIPELEX_USAGE_STATS_ENDPOINT` sends to a loopback origin for tests. Each queued file names the endpoint its events were queued for, and a sender posts the files naming its own origin and those naming none, which earlier builds wrote, so events queued under the variable never reach PostHog.+- **`pipelex usage-stats`**: `status` (with `--format json`), `disable`, `enable` and `reset-id` show and change the statistics of every Pipelex tool on the machine, through the state they share in `~/.mthds/usage-stats/`. `PIPELEX_USAGE_STATS_DEBUG` prints each event to stderr as a JSON line instead of sending it, and `PIPELEX_USAGE_STATS_ENDPOINT` sends to a loopback origin for tests. Each queued file names the endpoint its events were queued for, and a sender posts the files naming its own origin and those naming none, so events queued under the variable never reach PostHog.- **`[usage_stats] enabled`**: a new `pipelex.toml` section, `true` in the packaged configuration. Set to `false` in a project's `.pipelex/pipelex.toml` it turns statistics off for everyone working in the project; it is read from the project's own file, never from `~/.pipelex/`, and a file that cannot be read turns them off too.- **Token usage names the backend that served the call**: `LLMTokensUsage`, `ImgGenTokensUsage`, `ExtractTokensUsage`, `SearchTokensUsage` and `JudgmentTokensUsage` gain `backend_name`, set by the job from the backend whose worker ran it, so a run's usage events credit each call to its own backend even when two backends call the model by the same id, as after a fallback. A synthetic report no backend made, a dry run's, leaves it `None`.- **`@default-judgment-vision`**: the judgment deck names a second alias, for a judgment model that reads images, beside `@default-judgment`, which stays TypeSafe's text-only `jev-1.13.0`. It points at OpenAI's `gpt-6-luna`, which judges through OpenAI's Decisions API; no inference backend of Pipelex calls that API yet, so on your own keys a `PipeJudge` naming the alias finds no model when it runs. Run `pipelex update` to bring the alias into an installed deck.diff --git a/docs/api-server/openapi/pipelex-api.openapi.yaml b/docs/api-server/openapi/pipelex-api.openapi.yamlindex 547545521..9d1dfdb82 100644--- a/docs/api-server/openapi/pipelex-api.openapi.yaml+++ b/docs/api-server/openapi/pipelex-api.openapi.yaml@@ -12,7 +12,7 @@ info:license:name: Elastic License 2.0identifier: Elastic-2.0- version: 0.83.0+ version: 0.84.0paths:/health:get:diff --git a/pyproject.toml b/pyproject.tomlindex 65550db0b..ee069e79a 100644--- a/pyproject.toml+++ b/pyproject.toml@@ -1,6 +1,6 @@[project]name = "pipelex"-version = "0.83.0"+version = "0.84.0"description = "Execute composable AI methods declared in the MTHDS open standard"authors = [{ name = "Evotis S.A.S.", email = "[email protected]" }]maintainers = [{ name = "Pipelex staff", email = "[email protected]" }]diff --git a/uv.lock b/uv.lockindex 383503d81..aa8ab3fc8 100644--- a/uv.lock+++ b/uv.lock@@ -3557,7 +3557,7 @@ wheels = [[[package]]name = "pipelex"-version = "0.83.0"+version = "0.84.0"source = { editable = "." }dependencies = [{ name = "aiofiles" },