Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Python calibrationclassificationdecision-modelhuggingfacejevmodernbertmultilingualnlppythonpytorchroutingtyped-decisionszero-shot
feat(dotnet): port predict_batch and router batch APIs
kevin-gatimu24b8a5aa1962
diff --git a/laya-dotnet/CHANGELOG.md b/laya-dotnet/CHANGELOG.mdindex f16d18cd..19be9c00 100644--- a/laya-dotnet/CHANGELOG.md+++ b/laya-dotnet/CHANGELOG.md@@ -11,6 +11,18 @@ goldens: 0.4.12).### Added+- `LayaEngine.PredictBatch` (`ILayaBatchPredictor`), `LayaBatchOptions` (`BatchSize`, `SortByLength`),+ `LayaRouter.PredictBatch` and `LayaRouter.RouteBatch` over `LayaBatchRequest`, ported from Python+ `ONNXAgent.predict_batch` and `Router.predict_batch` / `route_batch`: shared forward passes, `batch_size`+ chunking, `sort_by_length` inside windows of eight batches (effective only for `1 < batch_size < len(states)`),+ routing grouped by checkpoint then question schema with input order restored, and per-request `lang_guess`.+ Hooks, `min_confidence`, per-call `lang` / `max_len` / `head_max_len` and the router `diagnostics`+ dictionary are not ported yet. Existing signatures are unchanged.+- Behaviour change, to match Python (`system_one` is `predict_batch([state])`): `LayaEngine.Predict` and+ `LayaRouter.Predict` / `PredictLong` refuse a null state with `ArgumentNullException` carrying Python's+ text (`state must not be None; pass a string, dict, or list`) instead of answering the text `"null"`,+ and `LayaEngine.Predict` with an empty `QuestionSet` returns an empty answer set with zero usage instead+ of throwing. `LayaEngine.Predict` now reports the usage diagnostics too, as `PredictBatch([state])[0]` does. An unknown model name now carries Python's exact message.- `LangGuess` (a language code or a callback of the state), Python's `lang_guess`: per call through new`LayaRouter.Route`, `Predict` and `PredictLong` overloads, and for every request through`LayaRouterOptions.LangGuess`. Precedence is explicit `lang`, then `lang_guess`, then detection;@@ -108,6 +120,5 @@ goldens: 0.4.12).### Known gaps- Python-only opt-in features are not yet ported: abstention (`min_confidence`),- `lang_temperatures`, hooks, batching APIs, question option ordering and digest controls.-- New Python usage diagnostics (`state_tokens`, `truncated`, `state_tokens_dropped` and- `truncated_questions`) are populated for `PredictLong`, but not ordinary `Predict`.+ `lang_temperatures`, hooks, question option ordering and digest controls. Batching is ported without+ hooks, `min_confidence` and per-call `lang` / `max_len` / `head_max_len`.diff --git a/laya-dotnet/README.md b/laya-dotnet/README.mdindex d0b91312..befb406b 100644--- a/laya-dotnet/README.md+++ b/laya-dotnet/README.md@@ -32,6 +32,7 @@ hallucinate.- [Writing questions](#writing-questions)- [Supplying state](#supplying-state)- [Long prediction](#long-prediction)+- [Batch prediction](#batch-prediction)- [Reading results](#reading-results)- [Confidence gating](#confidence-gating)- [Built-in presets](#built-in-presets)@@ -327,7 +328,7 @@ LayaResult routed = router.PredictLong(document, questions, model: "english", ba- Scan usage sums `InputTokens`, `StateTokens`, `StateTokensDropped` and `Truncated`(a window count, including 0/1 for a single window). `TruncatedQuestions` is the lastwindow's list; `Options` merges collapsed-option records by question id. These additional- diagnostics are currently populated only by `PredictLong`, not ordinary `Predict`.+ diagnostics are populated by `Predict`, `PredictBatch` and `PredictLong`.- `aggregate` accepts only `"auto"`. Null state, unsupported aggregation, no state room, or agap-causing stride throws `ArgumentException` (`ArgumentNullException` for null state).A stride valid for a requested window that gets clamped is reduced to half its new size.@@ -342,6 +343,44 @@ identifier is kept, rather than Python ONNXAgent's `"laya-rl-agent-onnx"` suffix---+## Batch prediction++`PredictBatch` answers the same questions about many states, sharing forward passes. It ports Python+**`ONNXAgent.predict_batch`** (`batch_size`, `sort_by_length`):++```csharp+IReadOnlyList<LayaResult> results = engine.PredictBatch(+ [ticket1, ticket2, ticket3], questions,+ new LayaBatchOptions { BatchSize = 2, SortByLength = true }); // one result per state, input order+```++- One session run holds every state's question rows. `BatchSize` caps states per run; `null`, `0` or a+ negative value sends them all in one run, exactly as Python (which raises nothing for such values).+- `SortByLength` groups similarly sized encoded states inside windows of eight batches to reduce padding.+ It has an effect only with `1 < BatchSize < states.Count`; otherwise it is ignored, as in Python. Results+ keep input order. A different batch shape can move a prediction by a rounding step near a threshold.+- An empty `states` list returns an empty list and never looks at the questions. An empty+ `QuestionSet` gives each state an empty answer set with zero usage. A null state throws+ `ArgumentNullException` (`state must not be None; pass a string, dict, or list`, the text Python's `TypeError`+ carries, as `Predict` and `PredictLong` now do too); a question whose options+ cannot fit the head budget throws `ArgumentException`, as `Predict` does. States are encoded and run a+ window at a time, so an unanswerable state fails after the earlier windows have run, as in Python.+- Each result carries the usage diagnostics Python's ONNX path reports (`StateTokens`,+ `StateTokensDropped`, `Truncated`, `TruncatedQuestions`, `Options`), the same as `Predict` reports for a single state.+- `LayaBatchOptions` is a class of init-only properties, so later per-call options extend it without+ changing a signature. `ILayaBatchPredictor` is a separate interface; `ILayaPredictor` is unchanged.++**Router.** `LayaRouter.PredictBatch(requests, options)` takes `LayaBatchRequest`s (`State`, `Questions`,+and the optional routing overrides `Model`, `Task`, `Lang`, `LangGuess`), routes all of them first, groups them+by routed checkpoint (first-seen order, so each checkpoint loads at most once), splits each group by question+schema (order-sensitive) so same-schema states share a pass, and returns results in request order, each with+`Routing`. `LayaRouter.RouteBatch(requests)` returns just the `RouteDecision`s and loads nothing. A null+state or questions, or an unknown model, fails the whole call before anything loads. Attached predictors must+implement `ILayaBatchPredictor`, else `NotSupportedException`. Hooks, `min_confidence`, per-call+`lang` / `max_len` / `head_max_len` and the `diagnostics` dictionary are not ported yet.++---+## Reading results`LayaResult` is indexed by question id. `Ids` returns the ids in the order they were asked.@@ -540,7 +579,8 @@ var deDe = router.Predict(Console.WriteLine(result.Routing!.Reason); // "English Latin text"```-`router.Route(state, questions)` decides without loading or running anything — useful for logging+`router.PredictBatch(requests, options)` and `router.RouteBatch(requests)` do the same for a mixed request list; see+[Batch prediction](#batch-prediction). `router.Route(state, questions)` decides without loading or running anything — useful for loggingor testing the routing logic in isolation. `Preload()` builds every checkpoint up front for aserver or demo, so no request pays a cold load.@@ -590,6 +630,7 @@ Python's `laya.Agent`.| `static LayaEngine FromDirectory(string directory)` | Shorthand for `Create(new LayaOptions { ModelDirectory = directory })`. || `LayaResult Predict(object? state, QuestionSet questions)` | Answers every question about `state` in a single batched inference call. See [Supplying state](#supplying-state). || `LayaResult PredictLong(object state, QuestionSet questions, int? window = null, int? stride = null, string aggregate = "auto", int? batchSize = null)` | Scans overlapping token windows. See [Long prediction](#long-prediction). |+| `IReadOnlyList<LayaResult> PredictBatch(IReadOnlyList<object?> states, QuestionSet questions, LayaBatchOptions? options = null)` | Answers the same questions over many states in shared passes. See [Batch prediction](#batch-prediction). || `LayaConfig Config { get; }` | The loaded checkpoint's `rl_agent_config.json`. || `ModelArtifacts Artifacts { get; }` | The paths the artifacts were loaded from. || `void Dispose()` | Releases the session and tokenizer. Safe to call more than once. |@@ -946,11 +987,12 @@ disclaimer, signature and reply-header rules, including Portuguese, Spanish and- **Opt-in features added in Python 0.3.21 are not ported yet:** abstention (`min_confidence`),and per-language temperatures (`lang_temperatures`). They are off by default inPython, so default predictions are unaffected. They are planned as follow-ups.-- **Other Python-only APIs are not ported:** hooks, batching APIs, question option ordering and- digest controls.-- **Usage diagnostics:** Python's `state_tokens`, `truncated`, `state_tokens_dropped` and- `truncated_questions` are exposed for `PredictLong` only; ordinary `Predict` still reports- just input/output tokens.+- **Other Python-only APIs are not ported:** hooks, question option ordering and digest controls.+ Batching is ported (`PredictBatch`, `LayaRouter.PredictBatch` / `RouteBatch`) without hooks,+ `min_confidence`, per-call `lang` / `max_len` / `head_max_len` and the router `diagnostics` dictionary.+- **Usage diagnostics:** Python's `state_tokens`, `truncated`, `state_tokens_dropped`, `truncated_questions`+ and `options` are reported by `Predict`, `PredictBatch` and `PredictLong`, as Python's `system_one` is+ `predict_batch([state])`.## Differences from Pythondiff --git a/laya-dotnet/src/Laya/LayaBatch.cs b/laya-dotnet/src/Laya/LayaBatch.csnew file mode 100644index 00000000..d2a5ffcd--- /dev/null+++ b/laya-dotnet/src/Laya/LayaBatch.cs@@ -0,0 +1,142 @@+namespace Laya;++/// <summary>+/// Per-call knobs for <see cref="ILayaBatchPredictor.PredictBatch"/> and+/// <see cref="LayaRouter.PredictBatch"/>. Ports the batching arguments of Python's+/// <c>ONNXAgent.predict_batch</c> (<c>batch_size</c>, <c>sort_by_length</c>). It is a class with+/// init-only properties so later per-call options (<c>min_confidence</c>, <c>lang</c>,+/// <c>max_len</c>, <c>head_max_len</c>) can be added without changing any signature.+/// </summary>+public sealed class LayaBatchOptions+{+ /// <summary>+ /// Cap on states per session run. <see langword="null"/>, zero or a negative value sends them all+ /// in one run, exactly as Python's <c>batch_size</c> (<c>batch_size if batch_size and batch_size > 0+ /// else len(states)</c>); Python raises nothing for such values.+ /// </summary>+ public int? BatchSize { get; init; }++ /// <summary>+ /// Group similarly sized encoded states within windows of eight batches to cut padding. Takes+ /// effect only with an explicit <see cref="BatchSize"/> greater than one and smaller than the+ /// number of states (per question group on a router); otherwise it is ignored. Results keep+ /// input order. Changing batch shapes can slightly change floating-point predictions near+ /// decision thresholds.+ /// </summary>+ public bool SortByLength { get; init; }+}++/// <summary>+/// Anything that can answer one <see cref="QuestionSet"/> over many states in shared forward passes:+/// a <see cref="LayaEngine"/>. <see cref="LayaRouter.PredictBatch"/> needs its checkpoints to+/// implement this. A separate interface, so <see cref="ILayaPredictor"/> keeps its shape.+/// </summary>+public interface ILayaBatchPredictor : ILayaPredictor+{+ /// <summary>+ /// Evaluate the same <paramref name="questions"/> over every state, one result per state in input order.+ /// </summary>+ IReadOnlyList<LayaResult> PredictBatch(+ IReadOnlyList<object?> states, QuestionSet questions, LayaBatchOptions? options = null);+}++/// <summary>+/// One request of a heterogeneous <see cref="LayaRouter.PredictBatch"/> / <see cref="LayaRouter.RouteBatch"/>+/// call. Python passes these as dicts with <c>state</c> and <c>questions</c> plus the optional routing+/// overrides <c>model</c>, <c>task</c>, <c>lang</c> and <c>lang_guess</c>.+/// </summary>+public sealed class LayaBatchRequest+{+ /// <summary>The state to judge; null is refused, as Python refuses a <c>None</c> state.</summary>+ public required object? State { get; init; }++ /// <summary>The questions to answer.</summary>+ public required QuestionSet Questions { get; init; }++ /// <summary>Explicit checkpoint name or alias (Python <c>model</c>).</summary>+ public string? Model { get; init; }++ /// <summary>Explicit task name (Python <c>task</c>).</summary>+ public string? Task { get; init; }++ /// <summary>Explicit language code used for routing (Python <c>lang</c>).</summary>+ public string? Lang { get; init; }++ /// <summary>Per-request language hint (Python <c>lang_guess</c>).</summary>+ public LangGuess? LangGuess { get; init; }+}++/// <summary>Python's refusal of a missing state, shared by every prediction entry point.</summary>+internal static class StateGuard+{+ /// <summary>The text of Python's <c>TypeError</c> (onnx_agent.py:413, router.py:1335).</summary>+ internal const string NullStateText = "state must not be None; pass a string, dict, or list";++ /// <summary>Refuse a null state: Python raises instead of answering a decision about the text <c>"null"</c>.</summary>+ internal static void NotNull(object? state)+ {+ if (state is null) throw new ArgumentNullException(null, NullStateText);+ }+}++/// <summary>Chunking and ordering rules of Python's <c>ONNXAgent._infer_batch</c>, free of any model.</summary>+internal static class BatchPlanning+{+ /// <summary>Number of windows of batches the sort looks ahead over (onnx_agent.py:815).</summary>+ internal const int LookaheadBatches = 8;++ /// <summary>+ /// <c>chunk</c>, <c>reorder</c> and <c>window</c> of onnx_agent.py:809-815. <paramref name="count"/> must be positive.+ /// </summary>+ internal static (int Chunk, bool Reorder, int Window) Plan(int count, int? batchSize, bool sortByLength)+ {+ var chunk = batchSize is > 0 ? batchSize.Value : count;+ var reorder = sortByLength && 1 < chunk && chunk < count;+ var window = reorder ? (int)Math.Min((long)chunk * LookaheadBatches, count) : chunk;+ return (chunk, reorder, window);+ }++ /// <summary>+ /// Stable ascending order of indices by width (Python's <c>list.sort</c> is stable, so ties keep input order).+ /// </summary>+ internal static int[] SortedOrder(IReadOnlyList<int> widths) =>+ [.. Enumerable.Range(0, widths.Count).OrderBy(i => widths[i])];++ /// <summary>+ /// Encode window by window, optionally sort each window by width, run chunk by chunk, and return+ /// the results in input order (onnx_agent.py:816-865).+ /// </summary>+ internal static IReadOnlyList<TResult> Execute<TEncoded, TResult>(+ IReadOnlyList<object?> states, int? batchSize, bool sortByLength,+ Func<IReadOnlyList<object?>, IReadOnlyList<TEncoded>> encode,+ Func<TEncoded, int> width,+ Func<IReadOnlyList<TEncoded>, IReadOnlyList<TResult>> infer)+ {+ if (states.Count == 0) return [];+ var (chunk, reorder, window) = Plan(states.Count, batchSize, sortByLength);+ var results = new List<TResult>(states.Count);+ // Sizes come from the input, never from the cap: Python accepts any positive batch_size.+ for (long start = 0; start < states.Count; start += window)+ {+ var end = (int)Math.Min(start + window, states.Count);+ var part = new List<object?>(end - (int)start);+ for (var i = (int)start; i < end; i++) part.Add(states[i]);+ var encoded = encode(part);+ var order = reorder+ ? SortedOrder([.. encoded.Select(width)])+ : Enumerable.Range(0, encoded.Count).ToArray();+ var windowResults = new TResult[encoded.Count];+ for (long offset = 0; offset < order.Length; offset += chunk)+ {+ var indices = order.Skip((int)offset).Take(chunk).ToArray();+ var chunkResults = infer([.. indices.Select(i => encoded[i])]);+ if (chunkResults.Count != indices.Length)+ throw new InvalidOperationException(+ $"internal error: a batch of {indices.Length} states produced {chunkResults.Count} results");+ for (var k = 0; k < indices.Length; k++) windowResults[indices[k]] = chunkResults[k];+ }+ results.AddRange(windowResults);+ }+ return results;+ }+}diff --git a/laya-dotnet/src/Laya/LayaEngine.cs b/laya-dotnet/src/Laya/LayaEngine.csindex 1d973011..607787cb 100644--- a/laya-dotnet/src/Laya/LayaEngine.cs+++ b/laya-dotnet/src/Laya/LayaEngine.cs@@ -28,7 +28,7 @@ namespace Laya;/// layout is loaded./// </para>/// </remarks>-public sealed class LayaEngine : IDisposable, ILayaLongPredictor+public sealed class LayaEngine : IDisposable, ILayaLongPredictor, ILayaBatchPredictor{private const string ModelName = "laya-rl-agent";@@ -189,16 +189,19 @@ public sealed class LayaEngine : IDisposable, ILayaLongPredictor/// <c>serialize_state</c> does, so an object or a list of conversation turns both work./// </param>/// <param name="questions">The questions to answer, in the order they should be returned.</param>+ /// <exception cref="ArgumentNullException">If <paramref name="state"/> is null, as Python's <c>TypeError</c>.</exception>/// <exception cref="ArgumentException">/// If a question's options cannot fit the head budget, rather than answering a silently/// truncated question./// </exception>public LayaResult Predict(object? state, QuestionSet questions){+ StateGuard.NotNull(state);ArgumentNullException.ThrowIfNull(questions);ObjectDisposedException.ThrowIf(Volatile.Read(ref _disposed) == 1, this);- if (questions.Count == 0) throw new ArgumentException("no questions to answer", nameof(questions));- return PredictStates([state], questions, diagnostics: false)[0];+ // Python's system_one is predict_batch([state]): no questions is an empty answer set, not an error,+ // and the usage carries the same truncation diagnostics.+ return PredictStates([state], questions, diagnostics: true)[0];}/// <summary>@@ -221,7 +224,7 @@ public sealed class LayaEngine : IDisposable, ILayaLongPredictorpublic LayaResult PredictLong(object state, QuestionSet questions, int? window = null, int? stride = null,string aggregate = "auto", int? batchSize = null){- ArgumentNullException.ThrowIfNull(state);+ StateGuard.NotNull(state);ArgumentNullException.ThrowIfNull(questions);ObjectDisposedException.ThrowIf(Volatile.Read(ref _disposed) == 1, this);if (aggregate != "auto")@@ -258,14 +261,52 @@ public sealed class LayaEngine : IDisposable, ILayaLongPredictorreturn LongPrediction.Aggregate(questions, results, spans);}+ /// <summary>+ /// Evaluate the same <paramref name="questions"/> over many states, sharing forward passes. Ports+ /// Python <c>ONNXAgent.predict_batch</c> (onnx_agent.py:342): one result per state in input order,+ /// each identical in shape to what a single-state pass over the same states would produce, with+ /// the diagnostic usage fields (state tokens, truncation, collapsed options) that Python's ONNX+ /// path reports.+ /// </summary>+ /// <param name="states">The states; a null element is refused, an empty list returns an empty list.</param>+ /// <param name="questions">The questions answered about every state. With no questions each state+ /// gets an empty answer set and zero usage, as in Python.</param>+ /// <param name="options">Batch size and ordering; see <see cref="LayaBatchOptions"/>.</param>+ /// <exception cref="ArgumentException">A null state, or a question whose options cannot fit the head budget.</exception>+ public IReadOnlyList<LayaResult> PredictBatch(+ IReadOnlyList<object?> states, QuestionSet questions, LayaBatchOptions? options = null)+ {+ ArgumentNullException.ThrowIfNull(states);+ ArgumentNullException.ThrowIfNull(questions);+ ObjectDisposedException.ThrowIf(Volatile.Read(ref _disposed) == 1, this);+ // onnx_agent.py:398-414: the surviving states are validated before anything runs, and a+ // missing state would otherwise be answered as the literal text "null".+ var list = states.ToArray();+ foreach (var state in list) StateGuard.NotNull(state);+ // onnx_agent.py:415: an empty list answers [] without looking at the questions.+ if (list.Length == 0) return [];+ if (questions.Count == 0) return PredictStates(list, questions, diagnostics: true);+ return BatchPlanning.Execute<EncodedState, LayaResult>(+ list, options?.BatchSize, options?.SortByLength ?? false,+ part => EncodeStates(part, questions),+ encoded => encoded.Items.Max(item => item.Ids.Length),+ chunk => InferStates(chunk, questions, diagnostics: true));+ }++ private sealed record EncodedState(SequenceItem[] Items, SequenceBuilder.SequenceDetails[] Details);+private IReadOnlyList<LayaResult> PredictStates(IReadOnlyList<object?> states, QuestionSet questions, bool diagnostics){if (questions.Count == 0)return states.Select(_ => new LayaResult(ModelName, [], new(StringComparer.Ordinal), new Usage(0, 0))).ToArray();+ return InferStates(EncodeStates(states, questions), questions, diagnostics);+ }++ private IReadOnlyList<EncodedState> EncodeStates(IReadOnlyList<object?> states, QuestionSet questions)+ {var ids = questions.Ids;- var items = new List<SequenceItem>(questions.Count * states.Count);- var details = new List<SequenceBuilder.SequenceDetails>(questions.Count * states.Count);+ var encoded = new List<EncodedState>(states.Count);// A chronological conversation list is serialized newest-last, so right-truncation// (the default) would silently drop the newest turn. Matches Agent._encode_state's@@ -279,6 +320,8 @@ public sealed class LayaEngine : IDisposable, ILayaLongPredictor{foreach (var state in states){+ var items = new List<SequenceItem>(ids.Count);+ var details = new List<SequenceBuilder.SequenceDetails>(ids.Count);var truncateLeft = PythonJson.IsListState(state);var stateIds = _tokenizer.Encode(PythonJson.State(state).Replace(_tokenizer.MaskToken, " ", StringComparison.Ordinal));@@ -299,8 +342,19 @@ public sealed class LayaEngine : IDisposable, ILayaLongPredictoritems.Add(new SequenceItem(seq, markers, question.Type));details.Add(built);}+ encoded.Add(new EncodedState([.. items], [.. details]));}}+ return encoded;+ }++ private IReadOnlyList<LayaResult> InferStates(+ IReadOnlyList<EncodedState> encoded, QuestionSet questions, bool diagnostics)+ {+ var ids = questions.Ids;+ var states = encoded;+ var items = encoded.SelectMany(e => e.Items).ToList();+ var details = encoded.SelectMany(e => e.Details).ToList();var batch = Collator.Collate(items, _tokenizer.PadId);var (logits, actLogits) = Run(batch);diff --git a/laya-dotnet/src/Laya/LayaRouter.cs b/laya-dotnet/src/Laya/LayaRouter.csindex 452724ff..b5cd6ba3 100644--- a/laya-dotnet/src/Laya/LayaRouter.cs+++ b/laya-dotnet/src/Laya/LayaRouter.cs@@ -212,13 +212,16 @@ public sealed class LayaRouter : ILayaLongPredictor, IDisposable"english" => LayaCheckpoint.English,"multilingual" => LayaCheckpoint.Multilingual,"typed-decisions" => LayaCheckpoint.TypedDecisions,+ // Python's text, list reprs included (router.py:187): sorted(DEFAULT_MODELS), sorted(_ALIASES)._ => throw new ArgumentException(- $"unknown model '{name}'; choose one of english, multilingual, typed-decisions "- + $"(or an alias: {string.Join(", ", Aliases.Keys.OrderBy(k => k, StringComparer.Ordinal))})",- nameof(name)),+ $"unknown model {PythonStr.Repr(name)}; choose one of {PyList(["english", "multilingual", "typed-decisions"])} "+ + $"(or an alias: {PyList(Aliases.Keys)})"),};}+ private static string PyList(IEnumerable<string> items) =>+ "[" + string.Join(", ", items.OrderBy(k => k, StringComparer.Ordinal).Select(PythonStr.Repr)) + "]";+/// <summary>/// Name of the typed-decisions workflow whose question ids these are, else/// <see langword="null"/>. Requires an exact id-set match, so an unrelated schema that@@ -522,7 +525,7 @@ public sealed class LayaRouter : ILayaLongPredictor, IDisposablestring aggregate, int? batchSize,string? model, string? task, string? lang, LangGuess? langGuess){- ArgumentNullException.ThrowIfNull(state);+ StateGuard.NotNull(state);return PredictRouted(state, questions, model, task, lang, langGuess, predictor =>predictor is ILayaLongPredictor scanner? scanner.PredictLong(state, questions, window, stride, aggregate, batchSize)@@ -534,24 +537,30 @@ public sealed class LayaRouter : ILayaLongPredictor, IDisposableobject? state, QuestionSet questions, string? model, string? task, string? lang, LangGuess? langGuess,Func<ILayaPredictor, LayaResult> predict){+ StateGuard.NotNull(state);ArgumentNullException.ThrowIfNull(questions);var decision = Route(state, questions, model, task, lang, langGuess);+ // Inference runs outside the lock, exactly as Python's predict() calls+ // agent.system_one after load() has already returned and released the lock — so+ // concurrent predictions on a shared checkpoint are not serialised by the router.+ return WithLease(decision.Model, predict).WithRouting(decision);+ }+ // Loads (or finds) the checkpoint, holds a lease so eviction cannot dispose it mid-call, and+ // runs `run` on it outside the lock.+ private T WithLease<T>(LayaCheckpoint checkpoint, Func<ILayaPredictor, T> run)+ {Slot slot;lock (_lock){ThrowIfDisposed();- slot = FindOrBuild(decision.Model);+ slot = FindOrBuild(checkpoint);slot.Leases++;Evict();}try{- // Inference runs outside the lock, exactly as Python's predict() calls- // agent.system_one after load() has already returned and released the lock — so- // concurrent predictions on a shared checkpoint are not serialised by the router.- var result = predict(slot.Predictor);- return result.WithRouting(decision);+ return run(slot.Predictor);}finally{@@ -564,6 +573,155 @@ public sealed class LayaRouter : ILayaLongPredictor, IDisposable}}+ // ── batching ──────────────────────────────────────────────────────────────++ /// <summary>+ /// Route a heterogeneous request batch without loading any checkpoint. Ports Python+ /// <c>Router.route_batch</c> (router.py:1538): each request is validated and routed exactly as+ /// <see cref="Route(object?, QuestionSet?, string?, string?, string?, LangGuess?)"/> does with its own+ /// <c>Model</c>, <c>Task</c>, <c>Lang</c> and <c>LangGuess</c>, and the decisions keep input order.+ /// </summary>+ /// <exception cref="ArgumentException">A request is null, has a null state or null questions, or names an unknown model or task.</exception>+ public IReadOnlyList<RouteDecision> RouteBatch(IReadOnlyList<LayaBatchRequest> requests)+ {+ ArgumentNullException.ThrowIfNull(requests);+ var decisions = new List<RouteDecision>(requests.Count);+ for (var i = 0; i < requests.Count; i++)+ {+ var request = requests[i]+ ?? throw new ArgumentException($"request {i} must be a dict, got NoneType");+ if (request.State is null)+ throw new ArgumentNullException(null, $"request {i} 'state' must not be None; pass a string, dict, or list");+ if (request.Questions is null)+ throw new ArgumentException($"request {i} 'questions' must be a dict, got NoneType");+ decisions.Add(Route(request.State, request.Questions, request.Model, request.Task,+ request.Lang, request.LangGuess));+ }+ return decisions;+ }++ /// <summary>+ /// Route and answer a heterogeneous request batch with minimal checkpoint churn. Ports Python+ /// <c>Router.predict_batch</c> (router.py:1603): requests are routed first+ /// (<see cref="RouteBatch"/>), grouped by routed checkpoint in first-seen order, and within a+ /// checkpoint split again by question schema (order-sensitive, router.py:221) so states sharing+ /// a schema share forward passes via <see cref="ILayaBatchPredictor.PredictBatch"/>. Results are+ /// returned in input order, each carrying its <see cref="LayaResult.Routing"/>.+ /// </summary>+ /// <param name="requests">The requests; an empty list returns an empty list and loads nothing.</param>+ /// <param name="options">Passed to every checkpoint batch; <see cref="LayaBatchOptions.SortByLength"/>+ /// acts per question group, as in Python.</param>+ /// <exception cref="NotSupportedException">A routed checkpoint (an attached predictor) has no batch support.</exception>+ public IReadOnlyList<LayaResult> PredictBatch(+ IReadOnlyList<LayaBatchRequest> requests, LayaBatchOptions? options = null)+ {+ var decisions = RouteBatch(requests);+ if (decisions.Count == 0) return [];++ // First-seen order, so cache effects stay deterministic and an interleaved workload costs at+ // most one load per routed checkpoint (router.py:1674).+ var checkpoints = new List<LayaCheckpoint>();+ var byCheckpoint = new Dictionary<LayaCheckpoint, List<int>>();+ for (var i = 0; i < decisions.Count; i++)+ {+ if (!byCheckpoint.TryGetValue(decisions[i].Model, out var indices))+ {+ byCheckpoint[decisions[i].Model] = indices = [];+ checkpoints.Add(decisions[i].Model);+ }+ indices.Add(i);+ }++ var results = new LayaResult[requests.Count];+ foreach (var checkpoint in checkpoints)+ {+ var indices = byCheckpoint[checkpoint];+ WithLease(checkpoint, predictor =>+ {+ if (predictor is not ILayaBatchPredictor batcher)+ throw new NotSupportedException(+ $"{predictor.GetType().Name} has no PredictBatch, so requests cannot share forward passes");+ foreach (var (questions, group) in GroupBySchema(requests, indices))+ {+ var batch = batcher.PredictBatch([.. group.Select(i => requests[i].State)], questions, options);+ if (batch.Count != group.Count)+ throw new InvalidOperationException(+ $"internal error: Agent.predict_batch returned {batch.Count} results for {group.Count} states");+ for (var k = 0; k < batch.Count; k++)+ results[group[k]] = batch[k].WithRouting(decisions[group[k]]);+ }+ return 0;+ });+ }+ return results;+ }++ // Splits one checkpoint's requests by question schema, first-seen order (router.py:1726-1776). A+ // later per-request token budget or lang joins the grouping key here.+ private static List<(QuestionSet Questions, List<int> Indices)> GroupBySchema(+ IReadOnlyList<LayaBatchRequest> requests, List<int> indices)+ {+ var groups = new List<(string Schema, QuestionSet Questions, List<int> Indices)>();+ QuestionSet? lastQuestions = null;+ string? lastSchema = null;+ foreach (var i in indices)+ {+ var questions = requests[i].Questions;+ string schema;+ if (ReferenceEquals(questions, lastQuestions)) schema = lastSchema!;+ else+ {+ schema = QuestionSchema(questions);+ lastQuestions = questions;+ lastSchema = schema;+ }+ var at = groups.FindIndex(g => g.Schema == schema);+ if (at < 0) groups.Add((schema, questions, [i]));+ else groups[at].Indices.Add(i);+ }+ return [.. groups.Select(g => (g.Questions, g.Indices))];+ }++ /// <summary>+ /// Order-sensitive signature of a question set, for sharing forward passes (router.py:221): ids, types,+ /// instructions, labels and rendered options all count, in declaration order.+ /// </summary>+ internal static string QuestionSchema(QuestionSet questions)+ {+ // json.dumps(questions, sort_keys=False, ensure_ascii=False, default=str): insertion order at+ // every level, ", " / ": " separators, Python float repr (so 1 and 1.0 differ). A question+ // carries no memory of how its dict was spelled, so each is written in canonical key order+ // (type, instructions, criteria) and a noul only lists the wordings it was given.+ var all = new List<KeyValuePair<string, object?>>();+ foreach (var (id, question) in questions)+ {+ var entry = new List<KeyValuePair<string, object?>>+ {+ new("type", SequenceBuilder.TypeName(question.Type)),+ new("instructions", question.Instructions),+ };+ switch (question)+ {+ case ChoiceQuestion choice:+ entry.Add(new("criteria", choice.Options.ToList()));+ break;+ case ScoreQuestion score:+ entry.Add(new("criteria", score.Levels));+ break;+ case NoulQuestion { IfFalse: null, IfTrue: null }:+ break;+ case NoulQuestion noul:+ var wording = new List<KeyValuePair<string, object?>>();+ if (noul.IfFalse is not null) wording.Add(new("false", noul.IfFalse));+ if (noul.IfTrue is not null) wording.Add(new("true", noul.IfTrue));+ entry.Add(new("criteria", wording));+ break;+ }+ all.Add(new(id, entry));+ }+ return PythonJson.Dumps(all, escapeNonAscii: false, fallbackToStr: true);+ }+private void ThrowIfDisposed() => ObjectDisposedException.ThrowIf(_disposed, this);/// <inheritdoc/>diff --git a/laya-dotnet/tests/Laya.Tests/BatchPredictionTests.cs b/laya-dotnet/tests/Laya.Tests/BatchPredictionTests.csnew file mode 100644index 00000000..64e548bf--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/BatchPredictionTests.cs@@ -0,0 +1,577 @@+using System.Text.Json;++namespace Laya.Tests;++/// <summary>+/// Model-free tests of batched prediction: the chunk/window/sort rules of Python's+/// <c>ONNXAgent._infer_batch</c> (<see cref="BatchPlanning"/>), and+/// <see cref="LayaRouter.PredictBatch"/> / <see cref="LayaRouter.RouteBatch"/> over fake predictors.+/// The model-backed parity of the same rules is in <see cref="PredictParityTests"/>.+/// </summary>+public sealed class BatchPredictionTests+{+ // ── planning: onnx_agent.py:809-815 ───────────────────────────────────────++ [Theory]+ [InlineData(5, null, false, 5, false, 5)]+ [InlineData(5, 0, false, 5, false, 5)]+ [InlineData(5, -3, false, 5, false, 5)]+ [InlineData(5, 2, false, 2, false, 2)]+ [InlineData(5, 100, false, 100, false, 100)]+ // sort_by_length needs an explicit batch_size with 1 < batch_size < len(states).+ [InlineData(20, 2, true, 2, true, 16)]+ [InlineData(20, 3, true, 3, true, 20)]+ [InlineData(20, null, true, 20, false, 20)]+ [InlineData(20, 0, true, 20, false, 20)]+ [InlineData(20, -1, true, 20, false, 20)]+ [InlineData(20, 1, true, 1, false, 1)]+ [InlineData(20, 20, true, 20, false, 20)]+ [InlineData(20, 25, true, 25, false, 25)]+ [InlineData(1, 1, true, 1, false, 1)]+ public void PlanFollowsPythonsChunkAndWindowRules(+ int count, int? batchSize, bool sort, int chunk, bool reorder, int window)+ {+ Assert.Equal((chunk, reorder, window), BatchPlanning.Plan(count, batchSize, sort));+ }++ [Fact]+ public void LookaheadWindowDoesNotOverflowForHugeBatchSizes()+ {+ var (chunk, reorder, window) = BatchPlanning.Plan(int.MaxValue, int.MaxValue - 1, sortByLength: true);+ Assert.Equal(int.MaxValue - 1, chunk);+ Assert.True(reorder);+ Assert.Equal(int.MaxValue, window);+ }++ [Fact]+ public void SortedOrderIsStableAscendingByWidth()+ {+ Assert.Equal([1, 3, 0, 4, 2], BatchPlanning.SortedOrder([5, 1, 7, 1, 5]));+ }++ // States are their own widths; the fake "model" returns each state's width times ten, so a+ // result proves which state it answered.+ private static (IReadOnlyList<int> Results, List<int[]> Runs, List<int> Encoded) Execute(+ int[] widths, int? batchSize, bool sort)+ {+ var runs = new List<int[]>();+ var encoded = new List<int>();+ var results = BatchPlanning.Execute<int, int>(+ [.. widths.Cast<object?>()], batchSize, sort,+ part => { encoded.Add(part.Count); return [.. part.Select(p => (int)p!)]; },+ width => width,+ chunk => { runs.Add([.. chunk]); return [.. chunk.Select(w => w * 10)]; });+ return (results, runs, encoded);+ }++ [Fact]+ public void NoBatchSizeRunsEverythingOnceInInputOrder()+ {+ var (results, runs, encoded) = Execute([5, 1, 3], null, sort: true);+ Assert.Equal([50, 10, 30], results);+ Assert.Equal([[5, 1, 3]], runs);+ Assert.Equal([3], encoded);+ }++ [Fact]+ public void CapSplitsIntoChunksAndEncodesOneChunkAtATimeWithoutSort()+ {+ var (results, runs, encoded) = Execute([5, 1, 3, 2, 4], 2, sort: false);+ Assert.Equal([50, 10, 30, 20, 40], results);+ Assert.Equal([[5, 1], [3, 2], [4]], runs);+ Assert.Equal([2, 2, 1], encoded);+ }++ [Fact]+ public void SortGroupsByWidthInsideTheLookaheadWindowAndRestoresInputOrder()+ {+ var (results, runs, encoded) = Execute([5, 1, 3, 2, 4], 2, sort: true);+ Assert.Equal([50, 10, 30, 20, 40], results);+ Assert.Equal([[1, 2], [3, 4], [5]], runs);+ Assert.Equal([5], encoded);+ }++ [Fact]+ public void SortNeverReachesAcrossWindowsOfEightBatches()+ {+ // 20 states, batch 2: windows of 16 and 4. The smallest width in the second window runs+ // after the largest of the first even though it is smaller than all of them.+ int[] widths = [.. Enumerable.Range(0, 16).Select(i => 100 - i), 1, 2, 3, 4];+ var (results, runs, encoded) = Execute(widths, 2, sort: true);+ Assert.Equal(widths.Select(w => w * 10), results);+ Assert.Equal([16, 4], encoded);+ Assert.Equal([99, 100], runs[7]);+ Assert.Equal([1, 2], runs[8]);+ Assert.Equal(10, runs.Count);+ }++ [Theory]+ [InlineData(int.MaxValue, false)]+ [InlineData(int.MaxValue, true)]+ [InlineData(1_000_000_000, false)]+ [InlineData(1_000_000_000, true)]+ public void HugeBatchSizesNeverSizeBuffersByTheCap(int batchSize, bool sort)+ {+ var (results, runs, encoded) = Execute([5, 1, 3], batchSize, sort);+ Assert.Equal([50, 10, 30], results);+ Assert.Equal([[5, 1, 3]], runs);+ Assert.Equal([3], encoded);+ }++ [Fact]+ public void EqualWidthsKeepInputOrder()+ {+ var (_, runs, _) = Execute([3, 3, 3, 3], 2, sort: true);+ Assert.Equal([[3, 3], [3, 3]], runs);+ var (results, _, _) = Execute([4, 2, 4, 2, 4], 2, sort: true);+ Assert.Equal([40, 20, 40, 20, 40], results);+ }++ [Theory]+ [InlineData(1)]+ [InlineData(0)]+ [InlineData(-5)]+ public void EmptyStatesNeverEncodeOrRun(int batchSize)+ {+ var (results, runs, encoded) = Execute([], batchSize, sort: true);+ Assert.Empty(results);+ Assert.Empty(runs);+ Assert.Empty(encoded);+ }++ [Fact]+ public void ChunkResultCountMismatchIsAnInternalError()+ {+ var error = Assert.Throws<InvalidOperationException>(() => BatchPlanning.Execute<int, int>(+ [1, 2, 3], null, false, part => [.. part.Select(p => (int)p!)], w => w, _ => [1]));+ Assert.Contains("internal error", error.Message, StringComparison.Ordinal);+ }++ [Fact]+ public void OptionsDefaultToNoCapAndNoSort()+ {+ var options = new LayaBatchOptions();+ Assert.Null(options.BatchSize);+ Assert.False(options.SortByLength);+ }++ // ── router over fake predictors ───────────────────────────────────────────++ private sealed class FakeBatchPredictor(string name) : ILayaBatchPredictor+ {+ public string Name { get; } = name;+ public List<(IReadOnlyList<object?> States, QuestionSet Questions, LayaBatchOptions? Options)> Calls { get; } = [];++ public LayaResult Predict(object? state, QuestionSet questions) => Answer(state);++ public IReadOnlyList<LayaResult> PredictBatch(+ IReadOnlyList<object?> states, QuestionSet questions, LayaBatchOptions? options = null)+ {+ Calls.Add(([.. states], questions, options));+ return [.. states.Select(Answer)];+ }++ // The state is the result's model, so each result says which request it answered.+ private LayaResult Answer(object? state) =>+ new($"{Name}:{state}", [], new Dictionary<string, Answer>(StringComparer.Ordinal), new Usage(0, 0));+ }++ private sealed class PlainPredictor : ILayaPredictor+ {+ public LayaResult Predict(object? state, QuestionSet questions) =>+ new("plain", [], new Dictionary<string, Answer>(StringComparer.Ordinal), new Usage(0, 0));+ }++ private sealed class ShortChangePredictor : ILayaBatchPredictor+ {+ public LayaResult Predict(object? state, QuestionSet questions) => throw new NotSupportedException();++ public IReadOnlyList<LayaResult> PredictBatch(+ IReadOnlyList<object?> states, QuestionSet questions, LayaBatchOptions? options = null) => [];+ }++ private sealed class Rig : IDisposable+ {+ public Dictionary<LayaCheckpoint, FakeBatchPredictor> Predictors { get; } = [];+ public List<LayaCheckpoint> Built { get; } = [];+ public LayaRouter Router { get; }++ public Rig(LayaRouterOptions? options = null) =>+ Router = new LayaRouter(options, checkpoint =>+ {+ Built.Add(checkpoint);+ return Predictors[checkpoint] = new FakeBatchPredictor(LayaOptions.CheckpointSubfolder(checkpoint));+ });++ public void Dispose() => Router.Dispose();+ }++ private static QuestionSet Choice(string instructions, params string[] labels) =>+ new() { ["dept"] = Question.Choice(instructions, labels) };++ private static LayaBatchRequest Request(+ object state, QuestionSet questions, string? model = null, string? task = null,+ string? lang = null, LangGuess? guess = null) =>+ new() { State = state, Questions = questions, Model = model, Task = task, Lang = lang, LangGuess = guess };++ private static readonly QuestionSet Q = Choice("Which team?", "billing", "tech");++ [Fact]+ public void RouteBatchLoadsNothingAndKeepsInputOrder()+ {+ using var rig = new Rig();+ var decisions = rig.Router.RouteBatch(+ [+ Request("I was charged twice, please refund.", Q),+ Request("Der Kunde wurde zweimal belastet und moechte eine Rueckerstattung fuer die Rechnung die nicht korrekt ist", Q),+ Request("hello", Q, model: "ml"),+ Request("hello", Q, task: "typed_decisions"),+ Request("hello", Q, lang: "de"),+ Request("Care este ora in Tokyo?", Q, guess: "ro"),+ ]);++ Assert.Equal(+ [LayaCheckpoint.English, LayaCheckpoint.Multilingual, LayaCheckpoint.Multilingual,+ LayaCheckpoint.TypedDecisions, LayaCheckpoint.Multilingual, LayaCheckpoint.Multilingual],+ decisions.Select(d => d.Model));+ Assert.Empty(rig.Built);+ Assert.Empty(rig.Router.Loaded);+ }++ [Fact]+ public void RouteBatchOfNothingIsEmpty()+ {+ using var rig = new Rig();+ Assert.Empty(rig.Router.RouteBatch([]));+ Assert.Empty(rig.Router.PredictBatch([]));+ Assert.Empty(rig.Built);+ }++ [Fact]+ public void RouteBatchValidatesEveryRequestLikePython()+ {+ using var rig = new Rig();+ var none = Assert.Throws<ArgumentNullException>(() =>+ rig.Router.RouteBatch([Request("ok", Q), new LayaBatchRequest { State = null, Questions = Q }]));+ Assert.Equal("request 1 'state' must not be None; pass a string, dict, or list", none.Message);++ var noQuestions = Assert.Throws<ArgumentException>(() =>+ rig.Router.RouteBatch([new LayaBatchRequest { State = "ok", Questions = null! }]));+ Assert.Equal("request 0 'questions' must be a dict, got NoneType", noQuestions.Message);++ Assert.Throws<ArgumentException>(() => rig.Router.RouteBatch([Request("ok", Q, model: "gpt")]));+ Assert.Throws<ArgumentNullException>(() => rig.Router.RouteBatch(null!));+ Assert.Empty(rig.Built);+ }++ [Fact]+ public void PredictBatchGroupsByCheckpointThenSchemaAndRestoresOrder()+ {+ using var rig = new Rig();+ var other = Choice("Which queue?", "a", "b");+ var results = rig.Router.PredictBatch(+ [+ Request("r0", Q, model: "english"),+ Request("r1", Q, model: "multilingual"),+ Request("r2", other, model: "english"),+ Request("r3", Q, model: "english"),+ Request("r4", Choice("Which team?", "billing", "tech"), model: "multilingual"),+ Request("r5", other, model: "english"),+ ]);++ Assert.Equal(+ ["english:r0", "multilingual:r1", "english:r2", "english:r3", "multilingual:r4", "english:r5"],+ results.Select(r => r.Model));+ // One load per routed checkpoint, in first-seen order.+ Assert.Equal([LayaCheckpoint.English, LayaCheckpoint.Multilingual], rig.Built);++ var english = rig.Predictors[LayaCheckpoint.English].Calls;+ Assert.Equal(2, english.Count);+ Assert.Equal(["r0", "r3"], english[0].States);+ Assert.Equal(["r2", "r5"], english[1].States);+ // Equal-looking but distinct QuestionSets share a forward pass; r1 and r4 are one group.+ var multilingual = rig.Predictors[LayaCheckpoint.Multilingual].Calls;+ Assert.Single(multilingual);+ Assert.Equal(["r1", "r4"], multilingual[0].States);+ }++ [Fact]+ public void SchemaGroupingIsOrderSensitive()+ {+ using var rig = new Rig();+ var results = rig.Router.PredictBatch(+ [+ Request("a", Choice("Which team?", "billing", "tech"), model: "english"),+ Request("b", Choice("Which team?", "tech", "billing"), model: "english"),+ Request("c", new QuestionSet { ["x"] = Question.Noul("n"), ["y"] = Question.Noul("n") }, model: "english"),+ Request("d", new QuestionSet { ["y"] = Question.Noul("n"), ["x"] = Question.Noul("n") }, model: "english"),+ ]);+ Assert.Equal(4, rig.Predictors[LayaCheckpoint.English].Calls.Count);+ Assert.Equal(["english:a", "english:b", "english:c", "english:d"], results.Select(r => r.Model));+ }++ [Fact]+ public void SchemaDistinguishesTypeInstructionsAndOptions()+ {+ var baseline = LayaRouter.QuestionSchema(Choice("Which team?", "billing", "tech"));+ Assert.Equal(baseline, LayaRouter.QuestionSchema(Choice("Which team?", "billing", "tech")));+ Assert.NotEqual(baseline, LayaRouter.QuestionSchema(Choice("Which squad?", "billing", "tech")));+ Assert.NotEqual(baseline, LayaRouter.QuestionSchema(Choice("Which team?", "billing", "tech", "other")));+ Assert.NotEqual(+ LayaRouter.QuestionSchema(new QuestionSet { ["dept"] = Question.Choice("q", ("a", "described")) }),+ LayaRouter.QuestionSchema(new QuestionSet { ["dept"] = Question.Choice("q", ("a", (object?)null)) }));+ Assert.NotEqual(+ LayaRouter.QuestionSchema(new QuestionSet { ["dept"] = Question.Noul("q") }),+ LayaRouter.QuestionSchema(new QuestionSet { ["dept"] = Question.Score("q", "a", "b") }));+ }++ [Fact]+ public void PredictBatchRecordsEachRequestsOwnRoutingDecision()+ {+ using var rig = new Rig();+ var results = rig.Router.PredictBatch(+ [+ Request("hello", Q, model: "english"),+ Request("hello", Q, lang: "de"),+ Request("hello", Q, guess: "ro"),+ Request("x", Q, task: "typed-decisions"),+ ]);+ Assert.Equal("explicit model='english'", results[0].Routing!.Reason);+ Assert.Equal("explicit lang='de'", results[1].Routing!.Reason);+ Assert.Equal(LayaCheckpoint.Multilingual, results[2].Routing!.Model);+ Assert.StartsWith("lang_guess:", results[2].Routing!.Reason, StringComparison.Ordinal);+ Assert.Equal(LayaCheckpoint.TypedDecisions, results[3].Routing!.Model);+ }++ [Fact]+ public void PerRequestLangGuessBeatsTheInstalledOne()+ {+ using var rig = new Rig(new LayaRouterOptions { LangGuess = "ro" });+ var results = rig.Router.PredictBatch(+ [+ Request("Care este ora in Tokyo?", Q),+ Request("Care este ora in Tokyo?", Q, guess: "en"),+ Request("Care este ora in Tokyo?", Q, guess: "C"),+ ]);+ Assert.Equal(+ [LayaCheckpoint.Multilingual, LayaCheckpoint.English, LayaCheckpoint.Multilingual],+ results.Select(r => r.Routing!.Model));+ Assert.StartsWith("Router(lang_guess=...)", results[0].Routing!.Reason, StringComparison.Ordinal);+ Assert.StartsWith("lang_guess:", results[1].Routing!.Reason, StringComparison.Ordinal);+ Assert.StartsWith("Router(lang_guess=...)", results[2].Routing!.Reason, StringComparison.Ordinal);+ }++ [Fact]+ public void PredictBatchPassesTheOptionsToEveryGroup()+ {+ using var rig = new Rig();+ var options = new LayaBatchOptions { BatchSize = 4, SortByLength = true };+ rig.Router.PredictBatch(+ [Request("a", Q, model: "english"), Request("b", Choice("other", "x", "y"), model: "english"),+ Request("c", Q, model: "multilingual")], options);+ foreach (var predictor in rig.Predictors.Values)+ foreach (var call in predictor.Calls)+ Assert.Same(options, call.Options);+ }++ [Fact]+ public void PredictBatchNeedsBatchCapablePredictors()+ {+ using var rig = new Rig();+ rig.Router.Attach("english", new PlainPredictor());+ var error = Assert.Throws<NotSupportedException>(() =>+ rig.Router.PredictBatch([Request("a", Q, model: "english")]));+ Assert.Contains("PlainPredictor", error.Message, StringComparison.Ordinal);+ }++ [Fact]+ public void PredictBatchRefusesAPredictorThatReturnsTheWrongCount()+ {+ using var rig = new Rig();+ rig.Router.Attach("english", new ShortChangePredictor());+ var error = Assert.Throws<InvalidOperationException>(() =>+ rig.Router.PredictBatch([Request("a", Q, model: "english")]));+ Assert.Equal("internal error: Agent.predict_batch returned 0 results for 1 states", error.Message);+ }++ [Fact]+ public void PredictBatchRoutesAllRequestsBeforeLoadingAnything()+ {+ using var rig = new Rig();+ Assert.Throws<ArgumentException>(() => rig.Router.PredictBatch(+ [Request("a", Q, model: "english"), Request("b", Q, model: "gpt")]));+ Assert.Empty(rig.Built);+ }++ [Fact]+ public void AnAttachedBatchPredictorIsUsedWithoutLoading()+ {+ var attached = new FakeBatchPredictor("mine");+ using var rig = new Rig();+ rig.Router.Attach("english", attached);+ var results = rig.Router.PredictBatch([Request("a", Q, model: "english"), Request("b", Q, model: "english")]);+ Assert.Equal(["mine:a", "mine:b"], results.Select(r => r.Model));+ Assert.Single(attached.Calls);+ Assert.Empty(rig.Built);+ }+++ // ── Python's refusals and texts ───────────────────────────────────────────++ private const string NullStateText = "state must not be None; pass a string, dict, or list";++ [Fact]+ public void RouterPredictRefusesANullStateBeforeAnythingElse()+ {+ using var rig = new Rig();+ var plain = Assert.Throws<ArgumentNullException>(() => rig.Router.Predict(null, null!));+ Assert.Equal(NullStateText, plain.Message);+ var scan = Assert.Throws<ArgumentNullException>(() => rig.Router.PredictLong(null!, Q));+ Assert.Equal(NullStateText, scan.Message);+ Assert.Empty(rig.Built);+ }++ [Fact]+ public void UnknownModelMessageIsPythons()+ {+ var error = Assert.Throws<ArgumentException>(() => LayaRouter.NormaliseName("gpt"));+ Assert.Equal(+ "unknown model 'gpt'; choose one of ['english', 'multilingual', 'typed-decisions'] "+ + "(or an alias: ['decisions', 'default', 'en', 'laya', 'laya-multilingual', "+ + "'laya-typed-decisions', 'ml', 'multi', 'typed', 'typed_decisions'])",+ error.Message);+ }++ [Fact]+ public void QuestionSchemaIsPythonsJsonDumpsOfTheQuestions()+ {+ var questions = new QuestionSet+ {+ ["dept"] = Question.Choice("Wh\u00e4t team?", ("billing", 1), ("tech", 1.0), ("other", (object?)null)),+ ["urgency"] = Question.Score("How urgent?", "low", 2.5, true),+ ["churn"] = Question.Noul("Cancel?"),+ ["flag"] = Question.Noul("Hold?", ifTrue: "yes"),+ };+ Assert.Equal(+ "{\"dept\": {\"type\": \"choice\", \"instructions\": \"Wh\u00e4t team?\", "+ + "\"criteria\": {\"billing\": 1, \"tech\": 1.0, \"other\": null}}, "+ + "\"urgency\": {\"type\": \"score\", \"instructions\": \"How urgent?\", "+ + "\"criteria\": [\"low\", 2.5, true]}, "+ + "\"churn\": {\"type\": \"noul\", \"instructions\": \"Cancel?\"}, "+ + "\"flag\": {\"type\": \"noul\", \"instructions\": \"Hold?\", \"criteria\": {\"true\": \"yes\"}}}",+ LayaRouter.QuestionSchema(questions));+ }++ [Fact]+ public void IntegerAndFloatCriteriaAreDifferentSchemas()+ {+ using var rig = new Rig();+ rig.Router.PredictBatch(+ [+ Request("a", new QuestionSet { ["q"] = Question.Choice("x", ("a", 1)) }, model: "english"),+ Request("b", new QuestionSet { ["q"] = Question.Choice("x", ("a", 1.0)) }, model: "english"),+ Request("c", new QuestionSet { ["q"] = Question.Choice("x", ("a", 1)) }, model: "english"),+ ]);+ var calls = rig.Predictors[LayaCheckpoint.English].Calls;+ Assert.Equal(2, calls.Count);+ Assert.Equal(["a", "c"], calls[0].States);+ Assert.Equal(["b"], calls[1].States);+ }++ // ── route_batch against the Python recording ──────────────────────────────++ public static IEnumerable<object[]> RouteBatchCases()+ {+ using var doc = RoutingGoldenData.Load("route_batch_probe.json");+ return [.. doc.RootElement.GetProperty("cases").EnumerateArray()+ .Select(e => new object[] { e.GetProperty("label").GetString()! })];+ }++ public static IEnumerable<object[]> RouteBatchErrorCases()+ {+ using var doc = RoutingGoldenData.Load("route_batch_probe.json");+ return [.. doc.RootElement.GetProperty("errors").EnumerateArray()+ .Select(e => new object[] { e.GetProperty("label").GetString()! })];+ }++ private static JsonElement ProbeEntry(string section, string label)+ {+ using var doc = RoutingGoldenData.Load("route_batch_probe.json");+ foreach (var e in doc.RootElement.GetProperty(section).EnumerateArray())+ if (e.GetProperty("label").GetString() == label)+ return JsonDocument.Parse(e.GetRawText()).RootElement;+ throw new InvalidOperationException($"no route_batch_probe.json {section} entry labelled '{label}'");+ }++ private static string? OptString(JsonElement obj, string prop) =>+ obj.TryGetProperty(prop, out var v) && v.ValueKind != JsonValueKind.Null ? v.GetString() : null;++ private static LayaRouterOptions RouterOptions(JsonElement kwargs)+ {+ var installed = OptString(kwargs, "lang_guess");+ var options = new LayaRouterOptions { LangGuess = installed is null ? null : LangGuess.FromCode(installed) };+ if (kwargs.TryGetProperty("auto_task_detection", out var atd)) options.AutoTaskDetection = atd.GetBoolean();+ if (kwargs.TryGetProperty("default", out var def)) options.Default = LayaRouter.NormaliseName(def.GetString()!);+ return options;+ }++ [Theory]+ [MemberData(nameof(RouteBatchCases))]+ public void RouteBatchReproducesPythonDecisions(string label)+ {+ var e = ProbeEntry("cases", label);+ var requests = e.GetProperty("requests").EnumerateArray().Select(r =>+ {+ var guess = OptString(r, "lang_guess");+ return new LayaBatchRequest+ {+ State = RoutingGoldenData.ToClr(r.GetProperty("state")),+ Questions = GoldenData.BuildQuestions(r.GetProperty("questions")),+ Model = OptString(r, "model"),+ Task = OptString(r, "task"),+ Lang = OptString(r, "lang"),+ LangGuess = guess is null ? null : LangGuess.FromCode(guess),+ };+ }).ToArray();++ using var rig = new Rig(RouterOptions(e.GetProperty("router_kwargs")));+ var got = rig.Router.RouteBatch(requests);++ var want = e.GetProperty("decisions").EnumerateArray().ToArray();+ Assert.Equal(want.Length, got.Count);+ for (var i = 0; i < want.Length; i++)+ {+ Assert.Equal(want[i].GetProperty("model").GetString(), LayaOptions.CheckpointSubfolder(got[i].Model));+ Assert.Equal(want[i].GetProperty("reason").GetString(), got[i].Reason);+ Assert.Equal(OptString(want[i], "workflow"), got[i].Workflow);+ Assert.Equal(want[i].GetProperty("detection").ValueKind == JsonValueKind.Null, got[i].Detection is null);+ }+ Assert.Empty(rig.Built);+ }++ [Theory]+ [MemberData(nameof(RouteBatchErrorCases))]+ public void RouteBatchRefusesWhatPythonRefuses(string label)+ {+ var e = ProbeEntry("errors", label);+ var requests = e.GetProperty("requests").EnumerateArray().ToArray();+ // A typed request cannot omit a required member, be a non-dict, or be absent; those Python+ // errors have no spelling here, so only the representable ones are replayed.+ if (requests.Any(r => r.ValueKind != JsonValueKind.Object+ || !r.TryGetProperty("state", out _) || !r.TryGetProperty("questions", out _)))+ return;+ var typed = requests.Select(r => new LayaBatchRequest+ {+ State = RoutingGoldenData.ToClr(r.GetProperty("state")),+ Questions = r.GetProperty("questions").ValueKind == JsonValueKind.Null+ ? null!+ : GoldenData.BuildQuestions(r.GetProperty("questions")),+ Model = OptString(r, "model"),+ }).ToArray();++ using var rig = new Rig(RouterOptions(e.GetProperty("router_kwargs")));+ var error = Assert.ThrowsAny<ArgumentException>(() => rig.Router.RouteBatch(typed));+ Assert.Equal(e.GetProperty("error_message").GetString(), error.Message);+ Assert.Empty(rig.Built);+ }+}diff --git a/laya-dotnet/tests/Laya.Tests/PredictParityTests.Batch.cs b/laya-dotnet/tests/Laya.Tests/PredictParityTests.Batch.csnew file mode 100644index 00000000..f977a1fd--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/PredictParityTests.Batch.cs@@ -0,0 +1,173 @@+using Laya.Tokenization;+using System.Text.Json;++namespace Laya.Tests;++public sealed partial class PredictParityTests+{+ public static IEnumerable<object[]> BatchSuccessCases() =>+ from checkpoint in TestArtifacts.ParityCheckpoints+ where GoldenData.For(checkpoint).Available+ from info in GoldenData.For(checkpoint).Index.Where(i => i.Kind == "batch" && !i.ExpectsError)+ from split in new[] { false, true }+ select new object[] { checkpoint, info, split };++ public static IEnumerable<object[]> BatchErrorCases() =>+ from checkpoint in TestArtifacts.ParityCheckpoints+ where GoldenData.For(checkpoint).Available+ from info in GoldenData.For(checkpoint).Index.Where(i => i.Kind == "batch" && i.ExpectsError)+ select new object[] { checkpoint, info };++ private static LayaBatchOptions BatchOptions(JsonElement options) => new()+ {+ BatchSize = options.TryGetProperty("batch_size", out var size) ? size.GetInt32() : null,+ SortByLength = options.TryGetProperty("sort_by_length", out var sort) && sort.GetBoolean(),+ };++ private static List<object?> BatchStates(JsonElement root) =>+ [.. root.GetProperty("states").EnumerateArray().Select(GoldenData.ToClr)];++ [Theory]+ [MemberData(nameof(BatchSuccessCases))]+ public void ReproducesBatchPredictions(LayaCheckpoint checkpoint, GoldenCaseInfo info, bool split)+ {+ var engine = split ? fixture.RequireSplit(checkpoint) : fixture.Require(checkpoint);+ using var doc = GoldenData.For(checkpoint).Load(info);+ var root = doc.RootElement;+ var states = BatchStates(root);+ var questions = GoldenData.BuildQuestions(root.GetProperty("questions"));++ var got = engine.PredictBatch(states, questions, BatchOptions(root.GetProperty("options")));++ var expected = root.GetProperty("results").EnumerateArray().ToArray();+ Assert.Equal(expected.Length, got.Count);+ for (var s = 0; s < expected.Length; s++)+ {+ var where = $"{checkpoint}/{split}/{info.Name}[{s}]";+ Assert.Equal("laya-rl-agent-onnx", expected[s].GetProperty("model").GetString());+ Assert.Equal("laya-rl-agent", got[s].Model);+ AssertBatchUsage(expected[s].GetProperty("usage"), got[s].Usage);+ var answers = expected[s].GetProperty("answers");+ Assert.Equal(answers.EnumerateObject().Select(p => p.Name), got[s].Ids);+ foreach (var entry in answers.EnumerateObject())+ {+ var want = entry.Value;+ var answer = got[s][entry.Name];+ var at = $"{where}/{entry.Name}";+ Assert.Equal(want.GetProperty("type").GetString(), SequenceBuilder.TypeName(answer.Type));+ AssertClose(want.GetProperty("confidence").GetDouble(), answer.Confidence, ProbTolerance, at + ".confidence");+ AssertClose(want.GetProperty("answer_confidence").GetDouble(), answer.AnswerConfidence,+ ProbTolerance, at + ".answer_confidence");+ AssertClose(want.GetProperty("action").GetProperty("act_probability").GetDouble(),+ answer.Action.ActProbability, ProbTolerance, at + ".action");+ switch (answer.Type)+ {+ case QuestionType.Choice: AssertChoice(want, answer.AsChoice(), at); break;+ case QuestionType.Score: AssertScore(want, answer.AsScore(), at); break;+ case QuestionType.Noul:+ AssertClose(want.GetProperty("noul").GetDouble(), answer.AsNoul().Probability, ProbTolerance, at);+ break;+ }+ }+ }+ }++ // Python's own session-run shapes against this port's chunk planning, over this port's own+ // token counts: each state's width (its longest question row) must equal Python's, and the+ // planned runs must be the ones Python made.+ [Theory]+ [MemberData(nameof(BatchSuccessCases))]+ public void PlansTheRecordedSessionRuns(LayaCheckpoint checkpoint, GoldenCaseInfo info, bool split)+ {+ if (split) return; // planning is layout-independent+ var engine = fixture.Require(checkpoint);+ using var doc = GoldenData.For(checkpoint).Load(info);+ var root = doc.RootElement;+ var states = BatchStates(root);+ var questions = GoldenData.BuildQuestions(root.GetProperty("questions"));+ if (questions.Count == 0 || states.Count == 0) return;++ using var tokenizer = new HfTokenizer(engine.Artifacts.TokenizerPath);+ var widths = states.Select(state => questions.Max(q =>+ SequenceBuilder.Build(tokenizer, state, q.Value, engine.Config.MaxLen, engine.Config.HeadMaxLen,+ PythonJson.IsListState(state)).Ids.Length)).ToArray();+ Assert.Equal(root.GetProperty("state_widths").EnumerateArray().Select(w => w.GetInt32()), widths);++ var options = BatchOptions(root.GetProperty("options"));+ var runs = new List<int[]>();+ BatchPlanning.Execute<int, int>(+ [.. Enumerable.Range(0, states.Count).Cast<object?>()], options.BatchSize, options.SortByLength,+ part => [.. part.Select(index => widths[(int)index!])],+ width => width,+ chunk =>+ {+ runs.Add([chunk.Count * questions.Count, chunk.Max()]);+ return [.. chunk];+ });+ Assert.Equal(+ root.GetProperty("runs").EnumerateArray().Select(r => r.EnumerateArray().Select(d => d.GetInt32()).ToArray()),+ runs);+ }++ // system_one is predict_batch([state]): the single-state path agrees with the batch on the+ // two edges that used to differ.+ [Theory]+ [InlineData(LayaCheckpoint.English)]+ [InlineData(LayaCheckpoint.Multilingual)]+ [InlineData(LayaCheckpoint.TypedDecisions)]+ public void PlainPredictIsAOneStateBatch(LayaCheckpoint checkpoint)+ {+ var engine = fixture.Require(checkpoint);+ var empty = engine.Predict("anything", new QuestionSet());+ Assert.Equal(0, empty.Count);+ Assert.Equal(new Usage(0, 0), empty.Usage);+ var none = Assert.Throws<ArgumentNullException>(() => engine.Predict(null, new QuestionSet()));+ Assert.Equal("state must not be None; pass a string, dict, or list", none.Message);+ }++ [Theory]+ [MemberData(nameof(BatchErrorCases))]+ public void ReproducesBatchErrors(LayaCheckpoint checkpoint, GoldenCaseInfo info)+ {+ var engine = fixture.Require(checkpoint);+ using var doc = GoldenData.For(checkpoint).Load(info);+ var root = doc.RootElement;+ var states = BatchStates(root);+ var questions = GoldenData.BuildQuestions(root.GetProperty("questions"));+ var error = Assert.ThrowsAny<ArgumentException>(+ () => engine.PredictBatch(states, questions, BatchOptions(root.GetProperty("options"))));+ Assert.StartsWith(root.GetProperty("error_message").GetString()!, error.Message, StringComparison.Ordinal);+ }++ private static void AssertBatchUsage(JsonElement want, Usage got)+ {+ Assert.Equal(want.GetProperty("input_tokens").GetInt32(), got.InputTokens);+ Assert.Equal(want.GetProperty("output_tokens").GetInt32(), got.OutputTokens);+ Assert.Null(got.Windows);+ Assert.Equal(OptInt(want, "state_tokens"), got.StateTokens);+ Assert.Equal(OptInt(want, "state_tokens_dropped"), got.StateTokensDropped);+ int? truncated = want.TryGetProperty("truncated", out var t) ? t.GetBoolean() ? 1 : 0 : null;+ Assert.Equal(truncated, got.Truncated);+ if (want.TryGetProperty("truncated_questions", out var ids))+ Assert.Equal(ids.EnumerateArray().Select(id => id.GetString()!), got.TruncatedQuestions);+ else+ Assert.Null(got.TruncatedQuestions);+ if (want.TryGetProperty("options", out var options))+ {+ Assert.NotNull(got.Options);+ Assert.Equal(options.EnumerateObject().Select(p => p.Name), got.Options.Keys);+ foreach (var entry in options.EnumerateObject())+ {+ var tokens = entry.Value.GetProperty("tokens_per_option");+ Assert.Equal(new OptionUsage(entry.Value.GetProperty("total").GetInt32(),+ entry.Value.GetProperty("distinct").GetInt32(),+ tokens.ValueKind == JsonValueKind.Null ? null : tokens.GetInt32()), got.Options[entry.Name]);+ }+ }+ else+ Assert.Null(got.Options);+ }++ private static int? OptInt(JsonElement obj, string name) =>+ obj.TryGetProperty(name, out var value) ? value.GetInt32() : null;+}diff --git a/laya-dotnet/tests/Laya.Tests/PredictParityTests.cs b/laya-dotnet/tests/Laya.Tests/PredictParityTests.csindex 2d086b45..8a588a5c 100644--- a/laya-dotnet/tests/Laya.Tests/PredictParityTests.cs+++ b/laya-dotnet/tests/Laya.Tests/PredictParityTests.cs@@ -86,6 +86,7 @@ public sealed partial class PredictParityTests(AllEnginesFixture fixture)result.Usage.InputTokens);Assert.Equal(expected.GetProperty("usage").GetProperty("output_tokens").GetInt32(),result.Usage.OutputTokens);+ AssertBatchUsage(expected.GetProperty("usage"), result.Usage);var answers = expected.GetProperty("answers");// Ids in order: a result that answered the right questions in the wrong order would attach@@ -144,6 +145,7 @@ public sealed partial class PredictParityTests(AllEnginesFixture fixture)Assert.Equal(expected.GetProperty("model").GetString(), result.Model);Assert.Equal(expected.GetProperty("usage").GetProperty("input_tokens").GetInt32(),result.Usage.InputTokens);+ AssertBatchUsage(expected.GetProperty("usage"), result.Usage);var answers = expected.GetProperty("answers");Assert.Equal([.. answers.EnumerateObject().Select(p => p.Name)], result.Ids);diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_chunked.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_chunked.jsonnew file mode 100644index 00000000..224ad91e--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_chunked.json@@ -0,0 +1,466 @@+{+ "name": "batch_chunked",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ],+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint. Turn 140: the agent restated the refund policy and the customer repeated the complaint. Turn 141: the agent restated the refund policy and the customer repeated the complaint. Turn 142: the agent restated the refund policy and the customer repeated the complaint. Turn 143: the agent restated the refund policy and the customer repeated the complaint. Turn 144: the agent restated the refund policy and the customer repeated the complaint. Turn 145: the agent restated the refund policy and the customer repeated the complaint. Turn 146: the agent restated the refund policy and the customer repeated the complaint. Turn 147: the agent restated the refund policy and the customer repeated the complaint. Turn 148: the agent restated the refund policy and the customer repeated the complaint. Turn 149: the agent restated the refund policy and the customer repeated the complaint. Turn 150: the agent restated the refund policy and the customer repeated the complaint. Turn 151: the agent restated the refund policy and the customer repeated the complaint. Turn 152: the agent restated the refund policy and the customer repeated the complaint. Turn 153: the agent restated the refund policy and the customer repeated the complaint. Turn 154: the agent restated the refund policy and the customer repeated the complaint. Turn 155: the agent restated the refund policy and the customer repeated the complaint. Turn 156: the agent restated the refund policy and the customer repeated the complaint. Turn 157: the agent restated the refund policy and the customer repeated the complaint. Turn 158: the agent restated the refund policy and the customer repeated the complaint. Turn 159: the agent restated the refund policy and the customer repeated the complaint. Turn 160: the agent restated the refund policy and the customer repeated the complaint. Turn 161: the agent restated the refund policy and the customer repeated the complaint. Turn 162: the agent restated the refund policy and the customer repeated the complaint. Turn 163: the agent restated the refund policy and the customer repeated the complaint. Turn 164: the agent restated the refund policy and the customer repeated the complaint. Turn 165: the agent restated the refund policy and the customer repeated the complaint. Turn 166: the agent restated the refund policy and the customer repeated the complaint. Turn 167: the agent restated the refund policy and the customer repeated the complaint. Turn 168: the agent restated the refund policy and the customer repeated the complaint. Turn 169: the agent restated the refund policy and the customer repeated the complaint. Turn 170: the agent restated the refund policy and the customer repeated the complaint. Turn 171: the agent restated the refund policy and the customer repeated the complaint. Turn 172: the agent restated the refund policy and the customer repeated the complaint. Turn 173: the agent restated the refund policy and the customer repeated the complaint. Turn 174: the agent restated the refund policy and the customer repeated the complaint. Turn 175: the agent restated the refund policy and the customer repeated the complaint. Turn 176: the agent restated the refund policy and the customer repeated the complaint. Turn 177: the agent restated the refund policy and the customer repeated the complaint. Turn 178: the agent restated the refund policy and the customer repeated the complaint. Turn 179: the agent restated the refund policy and the customer repeated the complaint. Turn 180: the agent restated the refund policy and the customer repeated the complaint. Turn 181: the agent restated the refund policy and the customer repeated the complaint. Turn 182: the agent restated the refund policy and the customer repeated the complaint. Turn 183: the agent restated the refund policy and the customer repeated the complaint. Turn 184: the agent restated the refund policy and the customer repeated the complaint. Turn 185: the agent restated the refund policy and the customer repeated the complaint. Turn 186: the agent restated the refund policy and the customer repeated the complaint. Turn 187: the agent restated the refund policy and the customer repeated the complaint. Turn 188: the agent restated the refund policy and the customer repeated the complaint. Turn 189: the agent restated the refund policy and the customer repeated the complaint. Turn 190: the agent restated the refund policy and the customer repeated the complaint. Turn 191: the agent restated the refund policy and the customer repeated the complaint. Turn 192: the agent restated the refund policy and the customer repeated the complaint. Turn 193: the agent restated the refund policy and the customer repeated the complaint. Turn 194: the agent restated the refund policy and the customer repeated the complaint. Turn 195: the agent restated the refund policy and the customer repeated the complaint. Turn 196: the agent restated the refund policy and the customer repeated the complaint. Turn 197: the agent restated the refund policy and the customer repeated the complaint. Turn 198: the agent restated the refund policy and the customer repeated the complaint. Turn 199: the agent restated the refund policy and the customer repeated the complaint. Turn 200: the agent restated the refund policy and the customer repeated the complaint. Turn 201: the agent restated the refund policy and the customer repeated the complaint. Turn 202: the agent restated the refund policy and the customer repeated the complaint. Turn 203: the agent restated the refund policy and the customer repeated the complaint. Turn 204: the agent restated the refund policy and the customer repeated the complaint. Turn 205: the agent restated the refund policy and the customer repeated the complaint. Turn 206: the agent restated the refund policy and the customer repeated the complaint. Turn 207: the agent restated the refund policy and the customer repeated the complaint. Turn 208: the agent restated the refund policy and the customer repeated the complaint. Turn 209: the agent restated the refund policy and the customer repeated the complaint. Turn 210: the agent restated the refund policy and the customer repeated the complaint. Turn 211: the agent restated the refund policy and the customer repeated the complaint. Turn 212: the agent restated the refund policy and the customer repeated the complaint. Turn 213: the agent restated the refund policy and the customer repeated the complaint. Turn 214: the agent restated the refund policy and the customer repeated the complaint. Turn 215: the agent restated the refund policy and the customer repeated the complaint. Turn 216: the agent restated the refund policy and the customer repeated the complaint. Turn 217: the agent restated the refund policy and the customer repeated the complaint. Turn 218: the agent restated the refund policy and the customer repeated the complaint. Turn 219: the agent restated the refund policy and the customer repeated the complaint. Turn 220: the agent restated the refund policy and the customer repeated the complaint. Turn 221: the agent restated the refund policy and the customer repeated the complaint. Turn 222: the agent restated the refund policy and the customer repeated the complaint. Turn 223: the agent restated the refund policy and the customer repeated the complaint. Turn 224: the agent restated the refund policy and the customer repeated the complaint. Turn 225: the agent restated the refund policy and the customer repeated the complaint. Turn 226: the agent restated the refund policy and the customer repeated the complaint. Turn 227: the agent restated the refund policy and the customer repeated the complaint. Turn 228: the agent restated the refund policy and the customer repeated the complaint. Turn 229: the agent restated the refund policy and the customer repeated the complaint. Turn 230: the agent restated the refund policy and the customer repeated the complaint. Turn 231: the agent restated the refund policy and the customer repeated the complaint. Turn 232: the agent restated the refund policy and the customer repeated the complaint. Turn 233: the agent restated the refund policy and the customer repeated the complaint. Turn 234: the agent restated the refund policy and the customer repeated the complaint. Turn 235: the agent restated the refund policy and the customer repeated the complaint. Turn 236: the agent restated the refund policy and the customer repeated the complaint. Turn 237: the agent restated the refund policy and the customer repeated the complaint. Turn 238: the agent restated the refund policy and the customer repeated the complaint. Turn 239: the agent restated the refund policy and the customer repeated the complaint. Turn 240: the agent restated the refund policy and the customer repeated the complaint. Turn 241: the agent restated the refund policy and the customer repeated the complaint. Turn 242: the agent restated the refund policy and the customer repeated the complaint. Turn 243: the agent restated the refund policy and the customer repeated the complaint. Turn 244: the agent restated the refund policy and the customer repeated the complaint. Turn 245: the agent restated the refund policy and the customer repeated the complaint. Turn 246: the agent restated the refund policy and the customer repeated the complaint. Turn 247: the agent restated the refund policy and the customer repeated the complaint. Turn 248: the agent restated the refund policy and the customer repeated the complaint. Turn 249: the agent restated the refund policy and the customer repeated the complaint. Turn 250: the agent restated the refund policy and the customer repeated the complaint. Turn 251: the agent restated the refund policy and the customer repeated the complaint. Turn 252: the agent restated the refund policy and the customer repeated the complaint. Turn 253: the agent restated the refund policy and the customer repeated the complaint. Turn 254: the agent restated the refund policy and the customer repeated the complaint. Turn 255: the agent restated the refund policy and the customer repeated the complaint. Turn 256: the agent restated the refund policy and the customer repeated the complaint. Turn 257: the agent restated the refund policy and the customer repeated the complaint. Turn 258: the agent restated the refund policy and the customer repeated the complaint. Turn 259: the agent restated the refund policy and the customer repeated the complaint. Turn 260: the agent restated the refund policy and the customer repeated the complaint. Turn 261: the agent restated the refund policy and the customer repeated the complaint. Turn 262: the agent restated the refund policy and the customer repeated the complaint. Turn 263: the agent restated the refund policy and the customer repeated the complaint. Turn 264: the agent restated the refund policy and the customer repeated the complaint. Turn 265: the agent restated the refund policy and the customer repeated the complaint. Turn 266: the agent restated the refund policy and the customer repeated the complaint. Turn 267: the agent restated the refund policy and the customer repeated the complaint. Turn 268: the agent restated the refund policy and the customer repeated the complaint. Turn 269: the agent restated the refund policy and the customer repeated the complaint. Turn 270: the agent restated the refund policy and the customer repeated the complaint. Turn 271: the agent restated the refund policy and the customer repeated the complaint. Turn 272: the agent restated the refund policy and the customer repeated the complaint. Turn 273: the agent restated the refund policy and the customer repeated the complaint. Turn 274: the agent restated the refund policy and the customer repeated the complaint. Turn 275: the agent restated the refund policy and the customer repeated the complaint. Turn 276: the agent restated the refund policy and the customer repeated the complaint. Turn 277: the agent restated the refund policy and the customer repeated the complaint. Turn 278: the agent restated the refund policy and the customer repeated the complaint. Turn 279: the agent restated the refund policy and the customer repeated the complaint. Turn 280: the agent restated the refund policy and the customer repeated the complaint. Turn 281: the agent restated the refund policy and the customer repeated the complaint. Turn 282: the agent restated the refund policy and the customer repeated the complaint. Turn 283: the agent restated the refund policy and the customer repeated the complaint. Turn 284: the agent restated the refund policy and the customer repeated the complaint. Turn 285: the agent restated the refund policy and the customer repeated the complaint. Turn 286: the agent restated the refund policy and the customer repeated the complaint. Turn 287: the agent restated the refund policy and the customer repeated the complaint. Turn 288: the agent restated the refund policy and the customer repeated the complaint. Turn 289: the agent restated the refund policy and the customer repeated the complaint. Turn 290: the agent restated the refund policy and the customer repeated the complaint. Turn 291: the agent restated the refund policy and the customer repeated the complaint. Turn 292: the agent restated the refund policy and the customer repeated the complaint. Turn 293: the agent restated the refund policy and the customer repeated the complaint. Turn 294: the agent restated the refund policy and the customer repeated the complaint. Turn 295: the agent restated the refund policy and the customer repeated the complaint. Turn 296: the agent restated the refund policy and the customer repeated the complaint. Turn 297: the agent restated the refund policy and the customer repeated the complaint. Turn 298: the agent restated the refund policy and the customer repeated the complaint. Turn 299: the agent restated the refund policy and the customer repeated the complaint. Turn 300: the agent restated the refund policy and the customer repeated the complaint. Turn 301: the agent restated the refund policy and the customer repeated the complaint. Turn 302: the agent restated the refund policy and the customer repeated the complaint. Turn 303: the agent restated the refund policy and the customer repeated the complaint. Turn 304: the agent restated the refund policy and the customer repeated the complaint. Turn 305: the agent restated the refund policy and the customer repeated the complaint. Turn 306: the agent restated the refund policy and the customer repeated the complaint. Turn 307: the agent restated the refund policy and the customer repeated the complaint. Turn 308: the agent restated the refund policy and the customer repeated the complaint. Turn 309: the agent restated the refund policy and the customer repeated the complaint. Turn 310: the agent restated the refund policy and the customer repeated the complaint. Turn 311: the agent restated the refund policy and the customer repeated the complaint. Turn 312: the agent restated the refund policy and the customer repeated the complaint. Turn 313: the agent restated the refund policy and the customer repeated the complaint. Turn 314: the agent restated the refund policy and the customer repeated the complaint. Turn 315: the agent restated the refund policy and the customer repeated the complaint. Turn 316: the agent restated the refund policy and the customer repeated the complaint. Turn 317: the agent restated the refund policy and the customer repeated the complaint. Turn 318: the agent restated the refund policy and the customer repeated the complaint. Turn 319: the agent restated the refund policy and the customer repeated the complaint. Turn 320: the agent restated the refund policy and the customer repeated the complaint. Turn 321: the agent restated the refund policy and the customer repeated the complaint. Turn 322: the agent restated the refund policy and the customer repeated the complaint. Turn 323: the agent restated the refund policy and the customer repeated the complaint. Turn 324: the agent restated the refund policy and the customer repeated the complaint. Turn 325: the agent restated the refund policy and the customer repeated the complaint. Turn 326: the agent restated the refund policy and the customer repeated the complaint. Turn 327: the agent restated the refund policy and the customer repeated the complaint. Turn 328: the agent restated the refund policy and the customer repeated the complaint. Turn 329: the agent restated the refund policy and the customer repeated the complaint. Turn 330: the agent restated the refund policy and the customer repeated the complaint. Turn 331: the agent restated the refund policy and the customer repeated the complaint. Turn 332: the agent restated the refund policy and the customer repeated the complaint. Turn 333: the agent restated the refund policy and the customer repeated the complaint. Turn 334: the agent restated the refund policy and the customer repeated the complaint. Turn 335: the agent restated the refund policy and the customer repeated the complaint. Turn 336: the agent restated the refund policy and the customer repeated the complaint. Turn 337: the agent restated the refund policy and the customer repeated the complaint. Turn 338: the agent restated the refund policy and the customer repeated the complaint. Turn 339: the agent restated the refund policy and the customer repeated the complaint. Turn 340: the agent restated the refund policy and the customer repeated the complaint. Turn 341: the agent restated the refund policy and the customer repeated the complaint. Turn 342: the agent restated the refund policy and the customer repeated the complaint. Turn 343: the agent restated the refund policy and the customer repeated the complaint. Turn 344: the agent restated the refund policy and the customer repeated the complaint. Turn 345: the agent restated the refund policy and the customer repeated the complaint. Turn 346: the agent restated the refund policy and the customer repeated the complaint. Turn 347: the agent restated the refund policy and the customer repeated the complaint. Turn 348: the agent restated the refund policy and the customer repeated the complaint. Turn 349: the agent restated the refund policy and the customer repeated the complaint. Turn 350: the agent restated the refund policy and the customer repeated the complaint. Turn 351: the agent restated the refund policy and the customer repeated the complaint. Turn 352: the agent restated the refund policy and the customer repeated the complaint. Turn 353: the agent restated the refund policy and the customer repeated the complaint. Turn 354: the agent restated the refund policy and the customer repeated the complaint. Turn 355: the agent restated the refund policy and the customer repeated the complaint. Turn 356: the agent restated the refund policy and the customer repeated the complaint. Turn 357: the agent restated the refund policy and the customer repeated the complaint. Turn 358: the agent restated the refund policy and the customer repeated the complaint. Turn 359: the agent restated the refund policy and the customer repeated the complaint. Turn 360: the agent restated the refund policy and the customer repeated the complaint. Turn 361: the agent restated the refund policy and the customer repeated the complaint. Turn 362: the agent restated the refund policy and the customer repeated the complaint. Turn 363: the agent restated the refund policy and the customer repeated the complaint. Turn 364: the agent restated the refund policy and the customer repeated the complaint. Turn 365: the agent restated the refund policy and the customer repeated the complaint. Turn 366: the agent restated the refund policy and the customer repeated the complaint. Turn 367: the agent restated the refund policy and the customer repeated the complaint. Turn 368: the agent restated the refund policy and the customer repeated the complaint. Turn 369: the agent restated the refund policy and the customer repeated the complaint. Turn 370: the agent restated the refund policy and the customer repeated the complaint. Turn 371: the agent restated the refund policy and the customer repeated the complaint. Turn 372: the agent restated the refund policy and the customer repeated the complaint. Turn 373: the agent restated the refund policy and the customer repeated the complaint. Turn 374: the agent restated the refund policy and the customer repeated the complaint. Turn 375: the agent restated the refund policy and the customer repeated the complaint. Turn 376: the agent restated the refund policy and the customer repeated the complaint. Turn 377: the agent restated the refund policy and the customer repeated the complaint. Turn 378: the agent restated the refund policy and the customer repeated the complaint. Turn 379: the agent restated the refund policy and the customer repeated the complaint. Turn 380: the agent restated the refund policy and the customer repeated the complaint. Turn 381: the agent restated the refund policy and the customer repeated the complaint. Turn 382: the agent restated the refund policy and the customer repeated the complaint. Turn 383: the agent restated the refund policy and the customer repeated the complaint. Turn 384: the agent restated the refund policy and the customer repeated the complaint. Turn 385: the agent restated the refund policy and the customer repeated the complaint. Turn 386: the agent restated the refund policy and the customer repeated the complaint. Turn 387: the agent restated the refund policy and the customer repeated the complaint. Turn 388: the agent restated the refund policy and the customer repeated the complaint. Turn 389: the agent restated the refund policy and the customer repeated the complaint. Turn 390: the agent restated the refund policy and the customer repeated the complaint. Turn 391: the agent restated the refund policy and the customer repeated the complaint. Turn 392: the agent restated the refund policy and the customer repeated the complaint. Turn 393: the agent restated the refund policy and the customer repeated the complaint. Turn 394: the agent restated the refund policy and the customer repeated the complaint. Turn 395: the agent restated the refund policy and the customer repeated the complaint. Turn 396: the agent restated the refund policy and the customer repeated the complaint. Turn 397: the agent restated the refund policy and the customer repeated the complaint. Turn 398: the agent restated the refund policy and the customer repeated the complaint. Turn 399: the agent restated the refund policy and the customer repeated the complaint.",+ "The app crashes on login since yesterday's update.",+ "ok"+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3+ },+ "state_widths": [+ 91,+ 44,+ 157,+ 74,+ 512,+ 44,+ 35+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8178,+ "technical": 0.1682,+ "other": 0.014+ },+ "confidence": 0.5229,+ "answer_confidence": 0.8178,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7428,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5839,+ "1": 0.0894,+ "2": 0.3267+ },+ "confidence": 0.1849,+ "answer_confidence": 0.5839,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0144,+ "confidence": 0.9856,+ "answer_confidence": 0.9856,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7468,+ "technical": 0.1514,+ "other": 0.1017+ },+ "confidence": 0.3297,+ "answer_confidence": 0.7468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6364,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1029,+ "1": 0.1578,+ "2": 0.7393+ },+ "confidence": 0.3185,+ "answer_confidence": 0.7393,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9238,+ "confidence": 0.9238,+ "answer_confidence": 0.9238,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9067,+ "technical": 0.0472,+ "other": 0.0461+ },+ "confidence": 0.6589,+ "answer_confidence": 0.9067,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8012,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3497,+ "1": 0.4994,+ "2": 0.1509+ },+ "confidence": 0.0902,+ "answer_confidence": 0.4994,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1497,+ "confidence": 0.8503,+ "answer_confidence": 0.8503,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 214,+ "output_tokens": 0,+ "state_tokens": 40,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8204,+ "technical": 0.0752,+ "other": 0.1045+ },+ "confidence": 0.4603,+ "answer_confidence": 0.8204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6454,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5702,+ "1": 0.2141,+ "2": 0.2156+ },+ "confidence": 0.1069,+ "answer_confidence": 0.5702,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3196,+ "confidence": 0.6804,+ "answer_confidence": 0.6804,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 6804,+ "state_tokens_dropped": 6326,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.0483,+ "technical": 0.9057,+ "other": 0.046+ },+ "confidence": 0.6563,+ "answer_confidence": 0.9057,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4741,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.17,+ "1": 0.186,+ "2": 0.6441+ },+ "confidence": 0.1831,+ "answer_confidence": 0.6441,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.122,+ "confidence": 0.878,+ "answer_confidence": 0.878,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5728,+ "technical": 0.2419,+ "other": 0.1853+ },+ "confidence": 0.1126,+ "answer_confidence": 0.5728,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.606,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5308,+ "1": 0.3323,+ "2": 0.1368+ },+ "confidence": 0.113,+ "answer_confidence": 0.5308,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4482,+ "confidence": 0.5518,+ "answer_confidence": 0.5518,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 97,+ "output_tokens": 0,+ "state_tokens": 1,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 157+ ],+ [+ 9,+ 512+ ],+ [+ 3,+ 35+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_duplicate_states.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_duplicate_states.jsonnew file mode 100644index 00000000..acc0038e--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_duplicate_states.json@@ -0,0 +1,211 @@+{+ "name": "batch_duplicate_states",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 91,+ 91,+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 91+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_both.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_both.jsonnew file mode 100644index 00000000..8a31ab3d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_both.json@@ -0,0 +1,9 @@+{+ "name": "batch_empty_both",+ "states": [],+ "questions": {},+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_questions.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_questions.jsonnew file mode 100644index 00000000..ea34701f--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_questions.json@@ -0,0 +1,29 @@+{+ "name": "batch_empty_questions",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ ""+ ],+ "questions": {},+ "options": {},+ "state_widths": [],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ }+ ],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_questions_with_options.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_questions_with_options.jsonnew file mode 100644index 00000000..d646aae6--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_questions_with_options.json@@ -0,0 +1,45 @@+{+ "name": "batch_empty_questions_with_options",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ }+ ],+ "questions": {},+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ }+ ],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_states.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_states.jsonnew file mode 100644index 00000000..eabd6424--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_states.json@@ -0,0 +1,32 @@+{+ "name": "batch_empty_states",+ "states": [],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_states_invalid_questions.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_states_invalid_questions.jsonnew file mode 100644index 00000000..d8c82752--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_empty_states_invalid_questions.json@@ -0,0 +1,316 @@+{+ "name": "batch_empty_states_invalid_questions",+ "states": [],+ "questions": {+ "too_wide": {+ "type": "choice",+ "instructions": "Too many options to fit the sequence.",+ "criteria": {+ "opt_000": "description 0",+ "opt_001": "description 1",+ "opt_002": "description 2",+ "opt_003": "description 3",+ "opt_004": "description 4",+ "opt_005": "description 5",+ "opt_006": "description 6",+ "opt_007": "description 7",+ "opt_008": "description 8",+ "opt_009": "description 9",+ "opt_010": "description 10",+ "opt_011": "description 11",+ "opt_012": "description 12",+ "opt_013": "description 13",+ "opt_014": "description 14",+ "opt_015": "description 15",+ "opt_016": "description 16",+ "opt_017": "description 17",+ "opt_018": "description 18",+ "opt_019": "description 19",+ "opt_020": "description 20",+ "opt_021": "description 21",+ "opt_022": "description 22",+ "opt_023": "description 23",+ "opt_024": "description 24",+ "opt_025": "description 25",+ "opt_026": "description 26",+ "opt_027": "description 27",+ "opt_028": "description 28",+ "opt_029": "description 29",+ "opt_030": "description 30",+ "opt_031": "description 31",+ "opt_032": "description 32",+ "opt_033": "description 33",+ "opt_034": "description 34",+ "opt_035": "description 35",+ "opt_036": "description 36",+ "opt_037": "description 37",+ "opt_038": "description 38",+ "opt_039": "description 39",+ "opt_040": "description 40",+ "opt_041": "description 41",+ "opt_042": "description 42",+ "opt_043": "description 43",+ "opt_044": "description 44",+ "opt_045": "description 45",+ "opt_046": "description 46",+ "opt_047": "description 47",+ "opt_048": "description 48",+ "opt_049": "description 49",+ "opt_050": "description 50",+ "opt_051": "description 51",+ "opt_052": "description 52",+ "opt_053": "description 53",+ "opt_054": "description 54",+ "opt_055": "description 55",+ "opt_056": "description 56",+ "opt_057": "description 57",+ "opt_058": "description 58",+ "opt_059": "description 59",+ "opt_060": "description 60",+ "opt_061": "description 61",+ "opt_062": "description 62",+ "opt_063": "description 63",+ "opt_064": "description 64",+ "opt_065": "description 65",+ "opt_066": "description 66",+ "opt_067": "description 67",+ "opt_068": "description 68",+ "opt_069": "description 69",+ "opt_070": "description 70",+ "opt_071": "description 71",+ "opt_072": "description 72",+ "opt_073": "description 73",+ "opt_074": "description 74",+ "opt_075": "description 75",+ "opt_076": "description 76",+ "opt_077": "description 77",+ "opt_078": "description 78",+ "opt_079": "description 79",+ "opt_080": "description 80",+ "opt_081": "description 81",+ "opt_082": "description 82",+ "opt_083": "description 83",+ "opt_084": "description 84",+ "opt_085": "description 85",+ "opt_086": "description 86",+ "opt_087": "description 87",+ "opt_088": "description 88",+ "opt_089": "description 89",+ "opt_090": "description 90",+ "opt_091": "description 91",+ "opt_092": "description 92",+ "opt_093": "description 93",+ "opt_094": "description 94",+ "opt_095": "description 95",+ "opt_096": "description 96",+ "opt_097": "description 97",+ "opt_098": "description 98",+ "opt_099": "description 99",+ "opt_100": "description 100",+ "opt_101": "description 101",+ "opt_102": "description 102",+ "opt_103": "description 103",+ "opt_104": "description 104",+ "opt_105": "description 105",+ "opt_106": "description 106",+ "opt_107": "description 107",+ "opt_108": "description 108",+ "opt_109": "description 109",+ "opt_110": "description 110",+ "opt_111": "description 111",+ "opt_112": "description 112",+ "opt_113": "description 113",+ "opt_114": "description 114",+ "opt_115": "description 115",+ "opt_116": "description 116",+ "opt_117": "description 117",+ "opt_118": "description 118",+ "opt_119": "description 119",+ "opt_120": "description 120",+ "opt_121": "description 121",+ "opt_122": "description 122",+ "opt_123": "description 123",+ "opt_124": "description 124",+ "opt_125": "description 125",+ "opt_126": "description 126",+ "opt_127": "description 127",+ "opt_128": "description 128",+ "opt_129": "description 129",+ "opt_130": "description 130",+ "opt_131": "description 131",+ "opt_132": "description 132",+ "opt_133": "description 133",+ "opt_134": "description 134",+ "opt_135": "description 135",+ "opt_136": "description 136",+ "opt_137": "description 137",+ "opt_138": "description 138",+ "opt_139": "description 139",+ "opt_140": "description 140",+ "opt_141": "description 141",+ "opt_142": "description 142",+ "opt_143": "description 143",+ "opt_144": "description 144",+ "opt_145": "description 145",+ "opt_146": "description 146",+ "opt_147": "description 147",+ "opt_148": "description 148",+ "opt_149": "description 149",+ "opt_150": "description 150",+ "opt_151": "description 151",+ "opt_152": "description 152",+ "opt_153": "description 153",+ "opt_154": "description 154",+ "opt_155": "description 155",+ "opt_156": "description 156",+ "opt_157": "description 157",+ "opt_158": "description 158",+ "opt_159": "description 159",+ "opt_160": "description 160",+ "opt_161": "description 161",+ "opt_162": "description 162",+ "opt_163": "description 163",+ "opt_164": "description 164",+ "opt_165": "description 165",+ "opt_166": "description 166",+ "opt_167": "description 167",+ "opt_168": "description 168",+ "opt_169": "description 169",+ "opt_170": "description 170",+ "opt_171": "description 171",+ "opt_172": "description 172",+ "opt_173": "description 173",+ "opt_174": "description 174",+ "opt_175": "description 175",+ "opt_176": "description 176",+ "opt_177": "description 177",+ "opt_178": "description 178",+ "opt_179": "description 179",+ "opt_180": "description 180",+ "opt_181": "description 181",+ "opt_182": "description 182",+ "opt_183": "description 183",+ "opt_184": "description 184",+ "opt_185": "description 185",+ "opt_186": "description 186",+ "opt_187": "description 187",+ "opt_188": "description 188",+ "opt_189": "description 189",+ "opt_190": "description 190",+ "opt_191": "description 191",+ "opt_192": "description 192",+ "opt_193": "description 193",+ "opt_194": "description 194",+ "opt_195": "description 195",+ "opt_196": "description 196",+ "opt_197": "description 197",+ "opt_198": "description 198",+ "opt_199": "description 199",+ "opt_200": "description 200",+ "opt_201": "description 201",+ "opt_202": "description 202",+ "opt_203": "description 203",+ "opt_204": "description 204",+ "opt_205": "description 205",+ "opt_206": "description 206",+ "opt_207": "description 207",+ "opt_208": "description 208",+ "opt_209": "description 209",+ "opt_210": "description 210",+ "opt_211": "description 211",+ "opt_212": "description 212",+ "opt_213": "description 213",+ "opt_214": "description 214",+ "opt_215": "description 215",+ "opt_216": "description 216",+ "opt_217": "description 217",+ "opt_218": "description 218",+ "opt_219": "description 219",+ "opt_220": "description 220",+ "opt_221": "description 221",+ "opt_222": "description 222",+ "opt_223": "description 223",+ "opt_224": "description 224",+ "opt_225": "description 225",+ "opt_226": "description 226",+ "opt_227": "description 227",+ "opt_228": "description 228",+ "opt_229": "description 229",+ "opt_230": "description 230",+ "opt_231": "description 231",+ "opt_232": "description 232",+ "opt_233": "description 233",+ "opt_234": "description 234",+ "opt_235": "description 235",+ "opt_236": "description 236",+ "opt_237": "description 237",+ "opt_238": "description 238",+ "opt_239": "description 239",+ "opt_240": "description 240",+ "opt_241": "description 241",+ "opt_242": "description 242",+ "opt_243": "description 243",+ "opt_244": "description 244",+ "opt_245": "description 245",+ "opt_246": "description 246",+ "opt_247": "description 247",+ "opt_248": "description 248",+ "opt_249": "description 249",+ "opt_250": "description 250",+ "opt_251": "description 251",+ "opt_252": "description 252",+ "opt_253": "description 253",+ "opt_254": "description 254",+ "opt_255": "description 255",+ "opt_256": "description 256",+ "opt_257": "description 257",+ "opt_258": "description 258",+ "opt_259": "description 259",+ "opt_260": "description 260",+ "opt_261": "description 261",+ "opt_262": "description 262",+ "opt_263": "description 263",+ "opt_264": "description 264",+ "opt_265": "description 265",+ "opt_266": "description 266",+ "opt_267": "description 267",+ "opt_268": "description 268",+ "opt_269": "description 269",+ "opt_270": "description 270",+ "opt_271": "description 271",+ "opt_272": "description 272",+ "opt_273": "description 273",+ "opt_274": "description 274",+ "opt_275": "description 275",+ "opt_276": "description 276",+ "opt_277": "description 277",+ "opt_278": "description 278",+ "opt_279": "description 279",+ "opt_280": "description 280",+ "opt_281": "description 281",+ "opt_282": "description 282",+ "opt_283": "description 283",+ "opt_284": "description 284",+ "opt_285": "description 285",+ "opt_286": "description 286",+ "opt_287": "description 287",+ "opt_288": "description 288",+ "opt_289": "description 289",+ "opt_290": "description 290",+ "opt_291": "description 291",+ "opt_292": "description 292",+ "opt_293": "description 293",+ "opt_294": "description 294",+ "opt_295": "description 295",+ "opt_296": "description 296",+ "opt_297": "description 297",+ "opt_298": "description 298",+ "opt_299": "description 299"+ }+ }+ },+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_mixed.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_mixed.jsonnew file mode 100644index 00000000..426098fc--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_mixed.json@@ -0,0 +1,515 @@+{+ "name": "batch_mixed",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7826,+ "technical": 0.1583,+ "other": 0.0591+ },+ "confidence": 0.4076,+ "answer_confidence": 0.7826,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7512,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.1611,+ "2": 0.795+ },+ "confidence": 0.4415,+ "answer_confidence": 0.795,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9312,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7843,+ "technical": 0.1543,+ "other": 0.0614+ },+ "confidence": 0.4082,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0568,+ "1": 0.179,+ "2": 0.7642+ },+ "confidence": 0.3843,+ "answer_confidence": 0.7642,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8762,+ "confidence": 0.8762,+ "answer_confidence": 0.8762,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5445,+ "technical": 0.2427,+ "other": 0.2129+ },+ "confidence": 0.0861,+ "answer_confidence": 0.5445,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6874,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4819,+ "1": 0.3488,+ "2": 0.1693+ },+ "confidence": 0.0717,+ "answer_confidence": 0.4819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3894,+ "confidence": 0.6106,+ "answer_confidence": 0.6106,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2918,+ "technical": 0.398,+ "other": 0.3102+ },+ "confidence": 0.0086,+ "answer_confidence": 0.398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5403,+ "1": 0.1276,+ "2": 0.3321+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5403,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0548,+ "confidence": 0.9452,+ "answer_confidence": 0.9452,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.573,+ "technical": 0.1873,+ "other": 0.2397+ },+ "confidence": 0.1124,+ "answer_confidence": 0.573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8166,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0486,+ "1": 0.0862,+ "2": 0.8652+ },+ "confidence": 0.5599,+ "answer_confidence": 0.8652,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8598,+ "confidence": 0.8598,+ "answer_confidence": 0.8598,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5426,+ "technical": 0.3484,+ "other": 0.109+ },+ "confidence": 0.1438,+ "answer_confidence": 0.5426,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.516,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6281,+ "1": 0.2278,+ "2": 0.1441+ },+ "confidence": 0.1733,+ "answer_confidence": 0.6281,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3136,+ "confidence": 0.6864,+ "answer_confidence": 0.6864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_none_state.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_none_state.jsonnew file mode 100644index 00000000..560be81a--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_none_state.json@@ -0,0 +1,34 @@+{+ "name": "batch_none_state",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ null+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "error_type": "TypeError",+ "error_message": "state must not be None; pass a string, dict, or list"+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_one_state.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_one_state.jsonnew file mode 100644index 00000000..41d01db1--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_one_state.json@@ -0,0 +1,97 @@+{+ "name": "batch_one_state",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 91+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_options_exceed_head.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_options_exceed_head.jsonnew file mode 100644index 00000000..367b9f55--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_options_exceed_head.json@@ -0,0 +1,318 @@+{+ "name": "batch_options_exceed_head",+ "states": [+ "short",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "too_wide": {+ "type": "choice",+ "instructions": "Too many options to fit the sequence.",+ "criteria": {+ "opt_000": "description 0",+ "opt_001": "description 1",+ "opt_002": "description 2",+ "opt_003": "description 3",+ "opt_004": "description 4",+ "opt_005": "description 5",+ "opt_006": "description 6",+ "opt_007": "description 7",+ "opt_008": "description 8",+ "opt_009": "description 9",+ "opt_010": "description 10",+ "opt_011": "description 11",+ "opt_012": "description 12",+ "opt_013": "description 13",+ "opt_014": "description 14",+ "opt_015": "description 15",+ "opt_016": "description 16",+ "opt_017": "description 17",+ "opt_018": "description 18",+ "opt_019": "description 19",+ "opt_020": "description 20",+ "opt_021": "description 21",+ "opt_022": "description 22",+ "opt_023": "description 23",+ "opt_024": "description 24",+ "opt_025": "description 25",+ "opt_026": "description 26",+ "opt_027": "description 27",+ "opt_028": "description 28",+ "opt_029": "description 29",+ "opt_030": "description 30",+ "opt_031": "description 31",+ "opt_032": "description 32",+ "opt_033": "description 33",+ "opt_034": "description 34",+ "opt_035": "description 35",+ "opt_036": "description 36",+ "opt_037": "description 37",+ "opt_038": "description 38",+ "opt_039": "description 39",+ "opt_040": "description 40",+ "opt_041": "description 41",+ "opt_042": "description 42",+ "opt_043": "description 43",+ "opt_044": "description 44",+ "opt_045": "description 45",+ "opt_046": "description 46",+ "opt_047": "description 47",+ "opt_048": "description 48",+ "opt_049": "description 49",+ "opt_050": "description 50",+ "opt_051": "description 51",+ "opt_052": "description 52",+ "opt_053": "description 53",+ "opt_054": "description 54",+ "opt_055": "description 55",+ "opt_056": "description 56",+ "opt_057": "description 57",+ "opt_058": "description 58",+ "opt_059": "description 59",+ "opt_060": "description 60",+ "opt_061": "description 61",+ "opt_062": "description 62",+ "opt_063": "description 63",+ "opt_064": "description 64",+ "opt_065": "description 65",+ "opt_066": "description 66",+ "opt_067": "description 67",+ "opt_068": "description 68",+ "opt_069": "description 69",+ "opt_070": "description 70",+ "opt_071": "description 71",+ "opt_072": "description 72",+ "opt_073": "description 73",+ "opt_074": "description 74",+ "opt_075": "description 75",+ "opt_076": "description 76",+ "opt_077": "description 77",+ "opt_078": "description 78",+ "opt_079": "description 79",+ "opt_080": "description 80",+ "opt_081": "description 81",+ "opt_082": "description 82",+ "opt_083": "description 83",+ "opt_084": "description 84",+ "opt_085": "description 85",+ "opt_086": "description 86",+ "opt_087": "description 87",+ "opt_088": "description 88",+ "opt_089": "description 89",+ "opt_090": "description 90",+ "opt_091": "description 91",+ "opt_092": "description 92",+ "opt_093": "description 93",+ "opt_094": "description 94",+ "opt_095": "description 95",+ "opt_096": "description 96",+ "opt_097": "description 97",+ "opt_098": "description 98",+ "opt_099": "description 99",+ "opt_100": "description 100",+ "opt_101": "description 101",+ "opt_102": "description 102",+ "opt_103": "description 103",+ "opt_104": "description 104",+ "opt_105": "description 105",+ "opt_106": "description 106",+ "opt_107": "description 107",+ "opt_108": "description 108",+ "opt_109": "description 109",+ "opt_110": "description 110",+ "opt_111": "description 111",+ "opt_112": "description 112",+ "opt_113": "description 113",+ "opt_114": "description 114",+ "opt_115": "description 115",+ "opt_116": "description 116",+ "opt_117": "description 117",+ "opt_118": "description 118",+ "opt_119": "description 119",+ "opt_120": "description 120",+ "opt_121": "description 121",+ "opt_122": "description 122",+ "opt_123": "description 123",+ "opt_124": "description 124",+ "opt_125": "description 125",+ "opt_126": "description 126",+ "opt_127": "description 127",+ "opt_128": "description 128",+ "opt_129": "description 129",+ "opt_130": "description 130",+ "opt_131": "description 131",+ "opt_132": "description 132",+ "opt_133": "description 133",+ "opt_134": "description 134",+ "opt_135": "description 135",+ "opt_136": "description 136",+ "opt_137": "description 137",+ "opt_138": "description 138",+ "opt_139": "description 139",+ "opt_140": "description 140",+ "opt_141": "description 141",+ "opt_142": "description 142",+ "opt_143": "description 143",+ "opt_144": "description 144",+ "opt_145": "description 145",+ "opt_146": "description 146",+ "opt_147": "description 147",+ "opt_148": "description 148",+ "opt_149": "description 149",+ "opt_150": "description 150",+ "opt_151": "description 151",+ "opt_152": "description 152",+ "opt_153": "description 153",+ "opt_154": "description 154",+ "opt_155": "description 155",+ "opt_156": "description 156",+ "opt_157": "description 157",+ "opt_158": "description 158",+ "opt_159": "description 159",+ "opt_160": "description 160",+ "opt_161": "description 161",+ "opt_162": "description 162",+ "opt_163": "description 163",+ "opt_164": "description 164",+ "opt_165": "description 165",+ "opt_166": "description 166",+ "opt_167": "description 167",+ "opt_168": "description 168",+ "opt_169": "description 169",+ "opt_170": "description 170",+ "opt_171": "description 171",+ "opt_172": "description 172",+ "opt_173": "description 173",+ "opt_174": "description 174",+ "opt_175": "description 175",+ "opt_176": "description 176",+ "opt_177": "description 177",+ "opt_178": "description 178",+ "opt_179": "description 179",+ "opt_180": "description 180",+ "opt_181": "description 181",+ "opt_182": "description 182",+ "opt_183": "description 183",+ "opt_184": "description 184",+ "opt_185": "description 185",+ "opt_186": "description 186",+ "opt_187": "description 187",+ "opt_188": "description 188",+ "opt_189": "description 189",+ "opt_190": "description 190",+ "opt_191": "description 191",+ "opt_192": "description 192",+ "opt_193": "description 193",+ "opt_194": "description 194",+ "opt_195": "description 195",+ "opt_196": "description 196",+ "opt_197": "description 197",+ "opt_198": "description 198",+ "opt_199": "description 199",+ "opt_200": "description 200",+ "opt_201": "description 201",+ "opt_202": "description 202",+ "opt_203": "description 203",+ "opt_204": "description 204",+ "opt_205": "description 205",+ "opt_206": "description 206",+ "opt_207": "description 207",+ "opt_208": "description 208",+ "opt_209": "description 209",+ "opt_210": "description 210",+ "opt_211": "description 211",+ "opt_212": "description 212",+ "opt_213": "description 213",+ "opt_214": "description 214",+ "opt_215": "description 215",+ "opt_216": "description 216",+ "opt_217": "description 217",+ "opt_218": "description 218",+ "opt_219": "description 219",+ "opt_220": "description 220",+ "opt_221": "description 221",+ "opt_222": "description 222",+ "opt_223": "description 223",+ "opt_224": "description 224",+ "opt_225": "description 225",+ "opt_226": "description 226",+ "opt_227": "description 227",+ "opt_228": "description 228",+ "opt_229": "description 229",+ "opt_230": "description 230",+ "opt_231": "description 231",+ "opt_232": "description 232",+ "opt_233": "description 233",+ "opt_234": "description 234",+ "opt_235": "description 235",+ "opt_236": "description 236",+ "opt_237": "description 237",+ "opt_238": "description 238",+ "opt_239": "description 239",+ "opt_240": "description 240",+ "opt_241": "description 241",+ "opt_242": "description 242",+ "opt_243": "description 243",+ "opt_244": "description 244",+ "opt_245": "description 245",+ "opt_246": "description 246",+ "opt_247": "description 247",+ "opt_248": "description 248",+ "opt_249": "description 249",+ "opt_250": "description 250",+ "opt_251": "description 251",+ "opt_252": "description 252",+ "opt_253": "description 253",+ "opt_254": "description 254",+ "opt_255": "description 255",+ "opt_256": "description 256",+ "opt_257": "description 257",+ "opt_258": "description 258",+ "opt_259": "description 259",+ "opt_260": "description 260",+ "opt_261": "description 261",+ "opt_262": "description 262",+ "opt_263": "description 263",+ "opt_264": "description 264",+ "opt_265": "description 265",+ "opt_266": "description 266",+ "opt_267": "description 267",+ "opt_268": "description 268",+ "opt_269": "description 269",+ "opt_270": "description 270",+ "opt_271": "description 271",+ "opt_272": "description 272",+ "opt_273": "description 273",+ "opt_274": "description 274",+ "opt_275": "description 275",+ "opt_276": "description 276",+ "opt_277": "description 277",+ "opt_278": "description 278",+ "opt_279": "description 279",+ "opt_280": "description 280",+ "opt_281": "description 281",+ "opt_282": "description 282",+ "opt_283": "description 283",+ "opt_284": "description 284",+ "opt_285": "description 285",+ "opt_286": "description 286",+ "opt_287": "description 287",+ "opt_288": "description 288",+ "opt_289": "description 289",+ "opt_290": "description 290",+ "opt_291": "description 291",+ "opt_292": "description 292",+ "opt_293": "description 293",+ "opt_294": "description 294",+ "opt_295": "description 295",+ "opt_296": "description 296",+ "opt_297": "description 297",+ "opt_298": "description 298",+ "opt_299": "description 299"+ }+ }+ },+ "options": {},+ "error_type": "ValueError",+ "error_message": "question 'too_wide': only 126 of its 300 option markers fit in max_len=512 with head_max_len=192 spent on the question; lower head_max_len, raise max_len, or use fewer options"+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_single_question.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_single_question.jsonnew file mode 100644index 00000000..d935f4ee--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_single_question.json@@ -0,0 +1,137 @@+{+ "name": "batch_single_question",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ]+ ],+ "questions": {+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 91,+ 44,+ 157,+ 74+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 91,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.0144,+ "confidence": 0.9856,+ "answer_confidence": 0.9856,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 44,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.9238,+ "confidence": 0.9238,+ "answer_confidence": 0.9238,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 157,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.1497,+ "confidence": 0.8503,+ "answer_confidence": 0.8503,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 74,+ "output_tokens": 0,+ "state_tokens": 40,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 2,+ 91+ ],+ [+ 2,+ 157+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_1.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_1.jsonnew file mode 100644index 00000000..cfe47670--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_1.json@@ -0,0 +1,545 @@+{+ "name": "batch_size_1",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 1+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7826,+ "technical": 0.1583,+ "other": 0.0591+ },+ "confidence": 0.4076,+ "answer_confidence": 0.7826,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7512,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.1611,+ "2": 0.795+ },+ "confidence": 0.4415,+ "answer_confidence": 0.795,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9312,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7843,+ "technical": 0.1543,+ "other": 0.0614+ },+ "confidence": 0.4082,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0568,+ "1": 0.179,+ "2": 0.7642+ },+ "confidence": 0.3843,+ "answer_confidence": 0.7642,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8762,+ "confidence": 0.8762,+ "answer_confidence": 0.8762,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5445,+ "technical": 0.2427,+ "other": 0.2129+ },+ "confidence": 0.0861,+ "answer_confidence": 0.5445,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6874,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4819,+ "1": 0.3488,+ "2": 0.1693+ },+ "confidence": 0.0717,+ "answer_confidence": 0.4819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3894,+ "confidence": 0.6106,+ "answer_confidence": 0.6106,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2918,+ "technical": 0.398,+ "other": 0.3102+ },+ "confidence": 0.0086,+ "answer_confidence": 0.398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5403,+ "1": 0.1276,+ "2": 0.3321+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5403,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0548,+ "confidence": 0.9452,+ "answer_confidence": 0.9452,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.573,+ "technical": 0.1873,+ "other": 0.2397+ },+ "confidence": 0.1124,+ "answer_confidence": 0.573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8166,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0486,+ "1": 0.0862,+ "2": 0.8652+ },+ "confidence": 0.5599,+ "answer_confidence": 0.8652,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8598,+ "confidence": 0.8598,+ "answer_confidence": 0.8598,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5426,+ "technical": 0.3484,+ "other": 0.109+ },+ "confidence": 0.1438,+ "answer_confidence": 0.5426,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.516,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6281,+ "1": 0.2278,+ "2": 0.1441+ },+ "confidence": 0.1733,+ "answer_confidence": 0.6281,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3136,+ "confidence": 0.6864,+ "answer_confidence": 0.6864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 91+ ],+ [+ 3,+ 110+ ],+ [+ 3,+ 144+ ],+ [+ 3,+ 34+ ],+ [+ 3,+ 163+ ],+ [+ 3,+ 42+ ],+ [+ 3,+ 98+ ],+ [+ 3,+ 56+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_3.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_3.jsonnew file mode 100644index 00000000..91881f04--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_3.json@@ -0,0 +1,525 @@+{+ "name": "batch_size_3",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7826,+ "technical": 0.1583,+ "other": 0.0591+ },+ "confidence": 0.4076,+ "answer_confidence": 0.7826,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7512,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.1611,+ "2": 0.795+ },+ "confidence": 0.4415,+ "answer_confidence": 0.795,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9312,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7843,+ "technical": 0.1543,+ "other": 0.0614+ },+ "confidence": 0.4082,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0568,+ "1": 0.179,+ "2": 0.7642+ },+ "confidence": 0.3843,+ "answer_confidence": 0.7642,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8762,+ "confidence": 0.8762,+ "answer_confidence": 0.8762,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5445,+ "technical": 0.2427,+ "other": 0.2129+ },+ "confidence": 0.0861,+ "answer_confidence": 0.5445,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6874,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4819,+ "1": 0.3488,+ "2": 0.1693+ },+ "confidence": 0.0717,+ "answer_confidence": 0.4819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3894,+ "confidence": 0.6106,+ "answer_confidence": 0.6106,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2918,+ "technical": 0.398,+ "other": 0.3102+ },+ "confidence": 0.0086,+ "answer_confidence": 0.398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5403,+ "1": 0.1276,+ "2": 0.3321+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5403,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0548,+ "confidence": 0.9452,+ "answer_confidence": 0.9452,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.573,+ "technical": 0.1873,+ "other": 0.2397+ },+ "confidence": 0.1124,+ "answer_confidence": 0.573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8166,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0486,+ "1": 0.0862,+ "2": 0.8652+ },+ "confidence": 0.5599,+ "answer_confidence": 0.8652,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8598,+ "confidence": 0.8598,+ "answer_confidence": 0.8598,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5426,+ "technical": 0.3484,+ "other": 0.109+ },+ "confidence": 0.1438,+ "answer_confidence": 0.5426,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.516,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6281,+ "1": 0.2278,+ "2": 0.1441+ },+ "confidence": 0.1733,+ "answer_confidence": 0.6281,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3136,+ "confidence": 0.6864,+ "answer_confidence": 0.6864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 144+ ],+ [+ 9,+ 163+ ],+ [+ 6,+ 98+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_negative.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_negative.jsonnew file mode 100644index 00000000..0a19f61d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_negative.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_negative",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": -2+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7826,+ "technical": 0.1583,+ "other": 0.0591+ },+ "confidence": 0.4076,+ "answer_confidence": 0.7826,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7512,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.1611,+ "2": 0.795+ },+ "confidence": 0.4415,+ "answer_confidence": 0.795,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9312,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7843,+ "technical": 0.1543,+ "other": 0.0614+ },+ "confidence": 0.4082,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0568,+ "1": 0.179,+ "2": 0.7642+ },+ "confidence": 0.3843,+ "answer_confidence": 0.7642,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8762,+ "confidence": 0.8762,+ "answer_confidence": 0.8762,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5445,+ "technical": 0.2427,+ "other": 0.2129+ },+ "confidence": 0.0861,+ "answer_confidence": 0.5445,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6874,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4819,+ "1": 0.3488,+ "2": 0.1693+ },+ "confidence": 0.0717,+ "answer_confidence": 0.4819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3894,+ "confidence": 0.6106,+ "answer_confidence": 0.6106,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2918,+ "technical": 0.398,+ "other": 0.3102+ },+ "confidence": 0.0086,+ "answer_confidence": 0.398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5403,+ "1": 0.1276,+ "2": 0.3321+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5403,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0548,+ "confidence": 0.9452,+ "answer_confidence": 0.9452,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.573,+ "technical": 0.1873,+ "other": 0.2397+ },+ "confidence": 0.1124,+ "answer_confidence": 0.573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8166,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0486,+ "1": 0.0862,+ "2": 0.8652+ },+ "confidence": 0.5599,+ "answer_confidence": 0.8652,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8598,+ "confidence": 0.8598,+ "answer_confidence": 0.8598,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5426,+ "technical": 0.3484,+ "other": 0.109+ },+ "confidence": 0.1438,+ "answer_confidence": 0.5426,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.516,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6281,+ "1": 0.2278,+ "2": 0.1441+ },+ "confidence": 0.1733,+ "answer_confidence": 0.6281,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3136,+ "confidence": 0.6864,+ "answer_confidence": 0.6864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_over_len.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_over_len.jsonnew file mode 100644index 00000000..a65fbefb--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_over_len.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_over_len",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 100+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7826,+ "technical": 0.1583,+ "other": 0.0591+ },+ "confidence": 0.4076,+ "answer_confidence": 0.7826,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7512,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.1611,+ "2": 0.795+ },+ "confidence": 0.4415,+ "answer_confidence": 0.795,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9312,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7843,+ "technical": 0.1543,+ "other": 0.0614+ },+ "confidence": 0.4082,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0568,+ "1": 0.179,+ "2": 0.7642+ },+ "confidence": 0.3843,+ "answer_confidence": 0.7642,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8762,+ "confidence": 0.8762,+ "answer_confidence": 0.8762,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5445,+ "technical": 0.2427,+ "other": 0.2129+ },+ "confidence": 0.0861,+ "answer_confidence": 0.5445,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6874,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4819,+ "1": 0.3488,+ "2": 0.1693+ },+ "confidence": 0.0717,+ "answer_confidence": 0.4819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3894,+ "confidence": 0.6106,+ "answer_confidence": 0.6106,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2918,+ "technical": 0.398,+ "other": 0.3102+ },+ "confidence": 0.0086,+ "answer_confidence": 0.398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5403,+ "1": 0.1276,+ "2": 0.3321+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5403,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0548,+ "confidence": 0.9452,+ "answer_confidence": 0.9452,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.573,+ "technical": 0.1873,+ "other": 0.2397+ },+ "confidence": 0.1124,+ "answer_confidence": 0.573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8166,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0486,+ "1": 0.0862,+ "2": 0.8652+ },+ "confidence": 0.5599,+ "answer_confidence": 0.8652,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8598,+ "confidence": 0.8598,+ "answer_confidence": 0.8598,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5426,+ "technical": 0.3484,+ "other": 0.109+ },+ "confidence": 0.1438,+ "answer_confidence": 0.5426,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.516,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6281,+ "1": 0.2278,+ "2": 0.1441+ },+ "confidence": 0.1733,+ "answer_confidence": 0.6281,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3136,+ "confidence": 0.6864,+ "answer_confidence": 0.6864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_zero.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_zero.jsonnew file mode 100644index 00000000..f50beb52--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_size_zero.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_zero",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 0+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7826,+ "technical": 0.1583,+ "other": 0.0591+ },+ "confidence": 0.4076,+ "answer_confidence": 0.7826,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7512,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.1611,+ "2": 0.795+ },+ "confidence": 0.4415,+ "answer_confidence": 0.795,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9312,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7843,+ "technical": 0.1543,+ "other": 0.0614+ },+ "confidence": 0.4082,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0568,+ "1": 0.179,+ "2": 0.7642+ },+ "confidence": 0.3843,+ "answer_confidence": 0.7642,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8762,+ "confidence": 0.8762,+ "answer_confidence": 0.8762,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5445,+ "technical": 0.2427,+ "other": 0.2129+ },+ "confidence": 0.0861,+ "answer_confidence": 0.5445,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6874,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4819,+ "1": 0.3488,+ "2": 0.1693+ },+ "confidence": 0.0717,+ "answer_confidence": 0.4819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3894,+ "confidence": 0.6106,+ "answer_confidence": 0.6106,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2918,+ "technical": 0.398,+ "other": 0.3102+ },+ "confidence": 0.0086,+ "answer_confidence": 0.398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5403,+ "1": 0.1276,+ "2": 0.3321+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5403,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0548,+ "confidence": 0.9452,+ "answer_confidence": 0.9452,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.573,+ "technical": 0.1873,+ "other": 0.2397+ },+ "confidence": 0.1124,+ "answer_confidence": 0.573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8166,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0486,+ "1": 0.0862,+ "2": 0.8652+ },+ "confidence": 0.5599,+ "answer_confidence": 0.8652,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8598,+ "confidence": 0.8598,+ "answer_confidence": 0.8598,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5426,+ "technical": 0.3484,+ "other": 0.109+ },+ "confidence": 0.1438,+ "answer_confidence": 0.5426,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.516,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6281,+ "1": 0.2278,+ "2": 0.1441+ },+ "confidence": 0.1733,+ "answer_confidence": 0.6281,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3136,+ "confidence": 0.6864,+ "answer_confidence": 0.6864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_no_batch_size.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_no_batch_size.jsonnew file mode 100644index 00000000..1ec59464--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_no_batch_size.json@@ -0,0 +1,1182 @@+{+ "name": "batch_sort_no_batch_size",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_off.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_off.jsonnew file mode 100644index 00000000..ff680065--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_off.json@@ -0,0 +1,1218 @@+{+ "name": "batch_sort_off",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 199+ ],+ [+ 6,+ 145+ ],+ [+ 6,+ 175+ ],+ [+ 6,+ 157+ ],+ [+ 6,+ 187+ ],+ [+ 6,+ 163+ ],+ [+ 6,+ 205+ ],+ [+ 6,+ 169+ ],+ [+ 6,+ 193+ ],+ [+ 6,+ 181+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_on.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_on.jsonnew file mode 100644index 00000000..a9d75231--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_on.json@@ -0,0 +1,1219 @@+{+ "name": "batch_sort_on",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 97+ ],+ [+ 6,+ 109+ ],+ [+ 6,+ 121+ ],+ [+ 6,+ 139+ ],+ [+ 6,+ 157+ ],+ [+ 6,+ 169+ ],+ [+ 6,+ 187+ ],+ [+ 6,+ 205+ ],+ [+ 6,+ 151+ ],+ [+ 6,+ 193+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_partial_window.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_partial_window.jsonnew file mode 100644index 00000000..ff70b938--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_partial_window.json@@ -0,0 +1,218 @@+{+ "name": "batch_sort_partial_window",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 145+ ],+ [+ 3,+ 199+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_1.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_1.jsonnew file mode 100644index 00000000..93454a9c--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_1.json@@ -0,0 +1,1259 @@+{+ "name": "batch_sort_size_1",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 1,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 199+ ],+ [+ 3,+ 103+ ],+ [+ 3,+ 145+ ],+ [+ 3,+ 91+ ],+ [+ 3,+ 175+ ],+ [+ 3,+ 121+ ],+ [+ 3,+ 157+ ],+ [+ 3,+ 97+ ],+ [+ 3,+ 187+ ],+ [+ 3,+ 133+ ],+ [+ 3,+ 109+ ],+ [+ 3,+ 163+ ],+ [+ 3,+ 205+ ],+ [+ 3,+ 115+ ],+ [+ 3,+ 139+ ],+ [+ 3,+ 169+ ],+ [+ 3,+ 127+ ],+ [+ 3,+ 193+ ],+ [+ 3,+ 151+ ],+ [+ 3,+ 181+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_3.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_3.jsonnew file mode 100644index 00000000..91bc90ee--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_3.json@@ -0,0 +1,1207 @@+{+ "name": "batch_sort_size_3",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 103+ ],+ [+ 9,+ 121+ ],+ [+ 9,+ 139+ ],+ [+ 9,+ 157+ ],+ [+ 9,+ 175+ ],+ [+ 9,+ 193+ ],+ [+ 6,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_eq_len.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_eq_len.jsonnew file mode 100644index 00000000..c77c742c--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_eq_len.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_eq_len",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 20,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_over_len.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_over_len.jsonnew file mode 100644index 00000000..6e2ebbc6--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_over_len.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_over_len",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 25,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_zero.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_zero.jsonnew file mode 100644index 00000000..33182c8d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sort_size_zero.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_zero",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 0,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.896,+ "technical": 0.0688,+ "other": 0.0352+ },+ "confidence": 0.6355,+ "answer_confidence": 0.896,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7317,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0621,+ "1": 0.1442,+ "2": 0.7937+ },+ "confidence": 0.4219,+ "answer_confidence": 0.7937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8605,+ "technical": 0.0968,+ "other": 0.0428+ },+ "confidence": 0.5539,+ "answer_confidence": 0.8605,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7395,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0594,+ "1": 0.1416,+ "2": 0.7989+ },+ "confidence": 0.432,+ "answer_confidence": 0.7989,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9368,+ "confidence": 0.9368,+ "answer_confidence": 0.9368,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9048,+ "technical": 0.064,+ "other": 0.0312+ },+ "confidence": 0.6591,+ "answer_confidence": 0.9048,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7761,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0368,+ "1": 0.1503,+ "2": 0.8129+ },+ "confidence": 0.4768,+ "answer_confidence": 0.8129,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9441,+ "confidence": 0.9441,+ "answer_confidence": 0.9441,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8943,+ "technical": 0.071,+ "other": 0.0347+ },+ "confidence": 0.632,+ "answer_confidence": 0.8943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7077,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0712,+ "1": 0.1499,+ "2": 0.7789+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7789,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.973,+ "confidence": 0.973,+ "answer_confidence": 0.973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8917,+ "technical": 0.0738,+ "other": 0.0345+ },+ "confidence": 0.6261,+ "answer_confidence": 0.8917,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0487,+ "1": 0.1333,+ "2": 0.818+ },+ "confidence": 0.4719,+ "answer_confidence": 0.818,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9284,+ "confidence": 0.9284,+ "answer_confidence": 0.9284,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8991,+ "technical": 0.0687,+ "other": 0.0322+ },+ "confidence": 0.6449,+ "answer_confidence": 0.8991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7492,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0463,+ "1": 0.1583,+ "2": 0.7955+ },+ "confidence": 0.4393,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9494,+ "confidence": 0.9494,+ "answer_confidence": 0.9494,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8759,+ "technical": 0.0843,+ "other": 0.0398+ },+ "confidence": 0.5877,+ "answer_confidence": 0.8759,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6595,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0763,+ "1": 0.1879,+ "2": 0.7358+ },+ "confidence": 0.3298,+ "answer_confidence": 0.7358,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9291,+ "confidence": 0.9291,+ "answer_confidence": 0.9291,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9152,+ "technical": 0.0558,+ "other": 0.0289+ },+ "confidence": 0.6862,+ "answer_confidence": 0.9152,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7942,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0439,+ "1": 0.118,+ "2": 0.8381+ },+ "confidence": 0.5108,+ "answer_confidence": 0.8381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9885,+ "confidence": 0.9885,+ "answer_confidence": 0.9885,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9167,+ "technical": 0.0549,+ "other": 0.0284+ },+ "confidence": 0.6903,+ "answer_confidence": 0.9167,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.815,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0345,+ "1": 0.116,+ "2": 0.8495+ },+ "confidence": 0.5407,+ "answer_confidence": 0.8495,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9104,+ "confidence": 0.9104,+ "answer_confidence": 0.9104,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8502,+ "technical": 0.0984,+ "other": 0.0514+ },+ "confidence": 0.5279,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7984,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0383,+ "1": 0.1251,+ "2": 0.8366+ },+ "confidence": 0.5138,+ "answer_confidence": 0.8366,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9522,+ "confidence": 0.9522,+ "answer_confidence": 0.9522,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9119,+ "technical": 0.0619,+ "other": 0.0263+ },+ "confidence": 0.6797,+ "answer_confidence": 0.9119,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8174,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0327,+ "1": 0.1173,+ "2": 0.85+ },+ "confidence": 0.5437,+ "answer_confidence": 0.85,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9744,+ "confidence": 0.9744,+ "answer_confidence": 0.9744,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9076,+ "technical": 0.0614,+ "other": 0.031+ },+ "confidence": 0.6659,+ "answer_confidence": 0.9076,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6686,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0787,+ "1": 0.174,+ "2": 0.7473+ },+ "confidence": 0.3428,+ "answer_confidence": 0.7473,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9973,+ "confidence": 0.9973,+ "answer_confidence": 0.9973,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8711,+ "technical": 0.084,+ "other": 0.0449+ },+ "confidence": 0.5744,+ "answer_confidence": 0.8711,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8099,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0405,+ "1": 0.1091,+ "2": 0.8504+ },+ "confidence": 0.5363,+ "answer_confidence": 0.8504,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9386,+ "confidence": 0.9386,+ "answer_confidence": 0.9386,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8908,+ "technical": 0.074,+ "other": 0.0352+ },+ "confidence": 0.6236,+ "answer_confidence": 0.8908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8126,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0335,+ "1": 0.1203,+ "2": 0.8462+ },+ "confidence": 0.5358,+ "answer_confidence": 0.8462,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9351,+ "confidence": 0.9351,+ "answer_confidence": 0.9351,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8958,+ "technical": 0.071,+ "other": 0.0333+ },+ "confidence": 0.6363,+ "answer_confidence": 0.8958,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7433,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0599,+ "1": 0.1369,+ "2": 0.8032+ },+ "confidence": 0.4384,+ "answer_confidence": 0.8032,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9824,+ "confidence": 0.9824,+ "answer_confidence": 0.9824,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.915,+ "technical": 0.0552,+ "other": 0.0298+ },+ "confidence": 0.6852,+ "answer_confidence": 0.915,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8398,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0301,+ "1": 0.1,+ "2": 0.8699+ },+ "confidence": 0.584,+ "answer_confidence": 0.8699,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9285,+ "confidence": 0.9285,+ "answer_confidence": 0.9285,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.906,+ "technical": 0.0606,+ "other": 0.0334+ },+ "confidence": 0.6606,+ "answer_confidence": 0.906,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7995,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0435,+ "1": 0.1136,+ "2": 0.8429+ },+ "confidence": 0.5199,+ "answer_confidence": 0.8429,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9698,+ "confidence": 0.9698,+ "answer_confidence": 0.9698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8836,+ "technical": 0.0799,+ "other": 0.0365+ },+ "confidence": 0.6066,+ "answer_confidence": 0.8836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7561,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0459,+ "1": 0.1522,+ "2": 0.8019+ },+ "confidence": 0.4494,+ "answer_confidence": 0.8019,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9458,+ "confidence": 0.9458,+ "answer_confidence": 0.9458,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9298,+ "technical": 0.0462,+ "other": 0.024+ },+ "confidence": 0.7276,+ "answer_confidence": 0.9298,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.752,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0625,+ "1": 0.123,+ "2": 0.8145+ },+ "confidence": 0.4555,+ "answer_confidence": 0.8145,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9912,+ "confidence": 0.9912,+ "answer_confidence": 0.9912,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sorted.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sorted.jsonnew file mode 100644index 00000000..2dc3ddcb--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sorted.json@@ -0,0 +1,471 @@+{+ "name": "batch_sorted",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ],+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint. Turn 140: the agent restated the refund policy and the customer repeated the complaint. Turn 141: the agent restated the refund policy and the customer repeated the complaint. Turn 142: the agent restated the refund policy and the customer repeated the complaint. Turn 143: the agent restated the refund policy and the customer repeated the complaint. Turn 144: the agent restated the refund policy and the customer repeated the complaint. Turn 145: the agent restated the refund policy and the customer repeated the complaint. Turn 146: the agent restated the refund policy and the customer repeated the complaint. Turn 147: the agent restated the refund policy and the customer repeated the complaint. Turn 148: the agent restated the refund policy and the customer repeated the complaint. Turn 149: the agent restated the refund policy and the customer repeated the complaint. Turn 150: the agent restated the refund policy and the customer repeated the complaint. Turn 151: the agent restated the refund policy and the customer repeated the complaint. Turn 152: the agent restated the refund policy and the customer repeated the complaint. Turn 153: the agent restated the refund policy and the customer repeated the complaint. Turn 154: the agent restated the refund policy and the customer repeated the complaint. Turn 155: the agent restated the refund policy and the customer repeated the complaint. Turn 156: the agent restated the refund policy and the customer repeated the complaint. Turn 157: the agent restated the refund policy and the customer repeated the complaint. Turn 158: the agent restated the refund policy and the customer repeated the complaint. Turn 159: the agent restated the refund policy and the customer repeated the complaint. Turn 160: the agent restated the refund policy and the customer repeated the complaint. Turn 161: the agent restated the refund policy and the customer repeated the complaint. Turn 162: the agent restated the refund policy and the customer repeated the complaint. Turn 163: the agent restated the refund policy and the customer repeated the complaint. Turn 164: the agent restated the refund policy and the customer repeated the complaint. Turn 165: the agent restated the refund policy and the customer repeated the complaint. Turn 166: the agent restated the refund policy and the customer repeated the complaint. Turn 167: the agent restated the refund policy and the customer repeated the complaint. Turn 168: the agent restated the refund policy and the customer repeated the complaint. Turn 169: the agent restated the refund policy and the customer repeated the complaint. Turn 170: the agent restated the refund policy and the customer repeated the complaint. Turn 171: the agent restated the refund policy and the customer repeated the complaint. Turn 172: the agent restated the refund policy and the customer repeated the complaint. Turn 173: the agent restated the refund policy and the customer repeated the complaint. Turn 174: the agent restated the refund policy and the customer repeated the complaint. Turn 175: the agent restated the refund policy and the customer repeated the complaint. Turn 176: the agent restated the refund policy and the customer repeated the complaint. Turn 177: the agent restated the refund policy and the customer repeated the complaint. Turn 178: the agent restated the refund policy and the customer repeated the complaint. Turn 179: the agent restated the refund policy and the customer repeated the complaint. Turn 180: the agent restated the refund policy and the customer repeated the complaint. Turn 181: the agent restated the refund policy and the customer repeated the complaint. Turn 182: the agent restated the refund policy and the customer repeated the complaint. Turn 183: the agent restated the refund policy and the customer repeated the complaint. Turn 184: the agent restated the refund policy and the customer repeated the complaint. Turn 185: the agent restated the refund policy and the customer repeated the complaint. Turn 186: the agent restated the refund policy and the customer repeated the complaint. Turn 187: the agent restated the refund policy and the customer repeated the complaint. Turn 188: the agent restated the refund policy and the customer repeated the complaint. Turn 189: the agent restated the refund policy and the customer repeated the complaint. Turn 190: the agent restated the refund policy and the customer repeated the complaint. Turn 191: the agent restated the refund policy and the customer repeated the complaint. Turn 192: the agent restated the refund policy and the customer repeated the complaint. Turn 193: the agent restated the refund policy and the customer repeated the complaint. Turn 194: the agent restated the refund policy and the customer repeated the complaint. Turn 195: the agent restated the refund policy and the customer repeated the complaint. Turn 196: the agent restated the refund policy and the customer repeated the complaint. Turn 197: the agent restated the refund policy and the customer repeated the complaint. Turn 198: the agent restated the refund policy and the customer repeated the complaint. Turn 199: the agent restated the refund policy and the customer repeated the complaint. Turn 200: the agent restated the refund policy and the customer repeated the complaint. Turn 201: the agent restated the refund policy and the customer repeated the complaint. Turn 202: the agent restated the refund policy and the customer repeated the complaint. Turn 203: the agent restated the refund policy and the customer repeated the complaint. Turn 204: the agent restated the refund policy and the customer repeated the complaint. Turn 205: the agent restated the refund policy and the customer repeated the complaint. Turn 206: the agent restated the refund policy and the customer repeated the complaint. Turn 207: the agent restated the refund policy and the customer repeated the complaint. Turn 208: the agent restated the refund policy and the customer repeated the complaint. Turn 209: the agent restated the refund policy and the customer repeated the complaint. Turn 210: the agent restated the refund policy and the customer repeated the complaint. Turn 211: the agent restated the refund policy and the customer repeated the complaint. Turn 212: the agent restated the refund policy and the customer repeated the complaint. Turn 213: the agent restated the refund policy and the customer repeated the complaint. Turn 214: the agent restated the refund policy and the customer repeated the complaint. Turn 215: the agent restated the refund policy and the customer repeated the complaint. Turn 216: the agent restated the refund policy and the customer repeated the complaint. Turn 217: the agent restated the refund policy and the customer repeated the complaint. Turn 218: the agent restated the refund policy and the customer repeated the complaint. Turn 219: the agent restated the refund policy and the customer repeated the complaint. Turn 220: the agent restated the refund policy and the customer repeated the complaint. Turn 221: the agent restated the refund policy and the customer repeated the complaint. Turn 222: the agent restated the refund policy and the customer repeated the complaint. Turn 223: the agent restated the refund policy and the customer repeated the complaint. Turn 224: the agent restated the refund policy and the customer repeated the complaint. Turn 225: the agent restated the refund policy and the customer repeated the complaint. Turn 226: the agent restated the refund policy and the customer repeated the complaint. Turn 227: the agent restated the refund policy and the customer repeated the complaint. Turn 228: the agent restated the refund policy and the customer repeated the complaint. Turn 229: the agent restated the refund policy and the customer repeated the complaint. Turn 230: the agent restated the refund policy and the customer repeated the complaint. Turn 231: the agent restated the refund policy and the customer repeated the complaint. Turn 232: the agent restated the refund policy and the customer repeated the complaint. Turn 233: the agent restated the refund policy and the customer repeated the complaint. Turn 234: the agent restated the refund policy and the customer repeated the complaint. Turn 235: the agent restated the refund policy and the customer repeated the complaint. Turn 236: the agent restated the refund policy and the customer repeated the complaint. Turn 237: the agent restated the refund policy and the customer repeated the complaint. Turn 238: the agent restated the refund policy and the customer repeated the complaint. Turn 239: the agent restated the refund policy and the customer repeated the complaint. Turn 240: the agent restated the refund policy and the customer repeated the complaint. Turn 241: the agent restated the refund policy and the customer repeated the complaint. Turn 242: the agent restated the refund policy and the customer repeated the complaint. Turn 243: the agent restated the refund policy and the customer repeated the complaint. Turn 244: the agent restated the refund policy and the customer repeated the complaint. Turn 245: the agent restated the refund policy and the customer repeated the complaint. Turn 246: the agent restated the refund policy and the customer repeated the complaint. Turn 247: the agent restated the refund policy and the customer repeated the complaint. Turn 248: the agent restated the refund policy and the customer repeated the complaint. Turn 249: the agent restated the refund policy and the customer repeated the complaint. Turn 250: the agent restated the refund policy and the customer repeated the complaint. Turn 251: the agent restated the refund policy and the customer repeated the complaint. Turn 252: the agent restated the refund policy and the customer repeated the complaint. Turn 253: the agent restated the refund policy and the customer repeated the complaint. Turn 254: the agent restated the refund policy and the customer repeated the complaint. Turn 255: the agent restated the refund policy and the customer repeated the complaint. Turn 256: the agent restated the refund policy and the customer repeated the complaint. Turn 257: the agent restated the refund policy and the customer repeated the complaint. Turn 258: the agent restated the refund policy and the customer repeated the complaint. Turn 259: the agent restated the refund policy and the customer repeated the complaint. Turn 260: the agent restated the refund policy and the customer repeated the complaint. Turn 261: the agent restated the refund policy and the customer repeated the complaint. Turn 262: the agent restated the refund policy and the customer repeated the complaint. Turn 263: the agent restated the refund policy and the customer repeated the complaint. Turn 264: the agent restated the refund policy and the customer repeated the complaint. Turn 265: the agent restated the refund policy and the customer repeated the complaint. Turn 266: the agent restated the refund policy and the customer repeated the complaint. Turn 267: the agent restated the refund policy and the customer repeated the complaint. Turn 268: the agent restated the refund policy and the customer repeated the complaint. Turn 269: the agent restated the refund policy and the customer repeated the complaint. Turn 270: the agent restated the refund policy and the customer repeated the complaint. Turn 271: the agent restated the refund policy and the customer repeated the complaint. Turn 272: the agent restated the refund policy and the customer repeated the complaint. Turn 273: the agent restated the refund policy and the customer repeated the complaint. Turn 274: the agent restated the refund policy and the customer repeated the complaint. Turn 275: the agent restated the refund policy and the customer repeated the complaint. Turn 276: the agent restated the refund policy and the customer repeated the complaint. Turn 277: the agent restated the refund policy and the customer repeated the complaint. Turn 278: the agent restated the refund policy and the customer repeated the complaint. Turn 279: the agent restated the refund policy and the customer repeated the complaint. Turn 280: the agent restated the refund policy and the customer repeated the complaint. Turn 281: the agent restated the refund policy and the customer repeated the complaint. Turn 282: the agent restated the refund policy and the customer repeated the complaint. Turn 283: the agent restated the refund policy and the customer repeated the complaint. Turn 284: the agent restated the refund policy and the customer repeated the complaint. Turn 285: the agent restated the refund policy and the customer repeated the complaint. Turn 286: the agent restated the refund policy and the customer repeated the complaint. Turn 287: the agent restated the refund policy and the customer repeated the complaint. Turn 288: the agent restated the refund policy and the customer repeated the complaint. Turn 289: the agent restated the refund policy and the customer repeated the complaint. Turn 290: the agent restated the refund policy and the customer repeated the complaint. Turn 291: the agent restated the refund policy and the customer repeated the complaint. Turn 292: the agent restated the refund policy and the customer repeated the complaint. Turn 293: the agent restated the refund policy and the customer repeated the complaint. Turn 294: the agent restated the refund policy and the customer repeated the complaint. Turn 295: the agent restated the refund policy and the customer repeated the complaint. Turn 296: the agent restated the refund policy and the customer repeated the complaint. Turn 297: the agent restated the refund policy and the customer repeated the complaint. Turn 298: the agent restated the refund policy and the customer repeated the complaint. Turn 299: the agent restated the refund policy and the customer repeated the complaint. Turn 300: the agent restated the refund policy and the customer repeated the complaint. Turn 301: the agent restated the refund policy and the customer repeated the complaint. Turn 302: the agent restated the refund policy and the customer repeated the complaint. Turn 303: the agent restated the refund policy and the customer repeated the complaint. Turn 304: the agent restated the refund policy and the customer repeated the complaint. Turn 305: the agent restated the refund policy and the customer repeated the complaint. Turn 306: the agent restated the refund policy and the customer repeated the complaint. Turn 307: the agent restated the refund policy and the customer repeated the complaint. Turn 308: the agent restated the refund policy and the customer repeated the complaint. Turn 309: the agent restated the refund policy and the customer repeated the complaint. Turn 310: the agent restated the refund policy and the customer repeated the complaint. Turn 311: the agent restated the refund policy and the customer repeated the complaint. Turn 312: the agent restated the refund policy and the customer repeated the complaint. Turn 313: the agent restated the refund policy and the customer repeated the complaint. Turn 314: the agent restated the refund policy and the customer repeated the complaint. Turn 315: the agent restated the refund policy and the customer repeated the complaint. Turn 316: the agent restated the refund policy and the customer repeated the complaint. Turn 317: the agent restated the refund policy and the customer repeated the complaint. Turn 318: the agent restated the refund policy and the customer repeated the complaint. Turn 319: the agent restated the refund policy and the customer repeated the complaint. Turn 320: the agent restated the refund policy and the customer repeated the complaint. Turn 321: the agent restated the refund policy and the customer repeated the complaint. Turn 322: the agent restated the refund policy and the customer repeated the complaint. Turn 323: the agent restated the refund policy and the customer repeated the complaint. Turn 324: the agent restated the refund policy and the customer repeated the complaint. Turn 325: the agent restated the refund policy and the customer repeated the complaint. Turn 326: the agent restated the refund policy and the customer repeated the complaint. Turn 327: the agent restated the refund policy and the customer repeated the complaint. Turn 328: the agent restated the refund policy and the customer repeated the complaint. Turn 329: the agent restated the refund policy and the customer repeated the complaint. Turn 330: the agent restated the refund policy and the customer repeated the complaint. Turn 331: the agent restated the refund policy and the customer repeated the complaint. Turn 332: the agent restated the refund policy and the customer repeated the complaint. Turn 333: the agent restated the refund policy and the customer repeated the complaint. Turn 334: the agent restated the refund policy and the customer repeated the complaint. Turn 335: the agent restated the refund policy and the customer repeated the complaint. Turn 336: the agent restated the refund policy and the customer repeated the complaint. Turn 337: the agent restated the refund policy and the customer repeated the complaint. Turn 338: the agent restated the refund policy and the customer repeated the complaint. Turn 339: the agent restated the refund policy and the customer repeated the complaint. Turn 340: the agent restated the refund policy and the customer repeated the complaint. Turn 341: the agent restated the refund policy and the customer repeated the complaint. Turn 342: the agent restated the refund policy and the customer repeated the complaint. Turn 343: the agent restated the refund policy and the customer repeated the complaint. Turn 344: the agent restated the refund policy and the customer repeated the complaint. Turn 345: the agent restated the refund policy and the customer repeated the complaint. Turn 346: the agent restated the refund policy and the customer repeated the complaint. Turn 347: the agent restated the refund policy and the customer repeated the complaint. Turn 348: the agent restated the refund policy and the customer repeated the complaint. Turn 349: the agent restated the refund policy and the customer repeated the complaint. Turn 350: the agent restated the refund policy and the customer repeated the complaint. Turn 351: the agent restated the refund policy and the customer repeated the complaint. Turn 352: the agent restated the refund policy and the customer repeated the complaint. Turn 353: the agent restated the refund policy and the customer repeated the complaint. Turn 354: the agent restated the refund policy and the customer repeated the complaint. Turn 355: the agent restated the refund policy and the customer repeated the complaint. Turn 356: the agent restated the refund policy and the customer repeated the complaint. Turn 357: the agent restated the refund policy and the customer repeated the complaint. Turn 358: the agent restated the refund policy and the customer repeated the complaint. Turn 359: the agent restated the refund policy and the customer repeated the complaint. Turn 360: the agent restated the refund policy and the customer repeated the complaint. Turn 361: the agent restated the refund policy and the customer repeated the complaint. Turn 362: the agent restated the refund policy and the customer repeated the complaint. Turn 363: the agent restated the refund policy and the customer repeated the complaint. Turn 364: the agent restated the refund policy and the customer repeated the complaint. Turn 365: the agent restated the refund policy and the customer repeated the complaint. Turn 366: the agent restated the refund policy and the customer repeated the complaint. Turn 367: the agent restated the refund policy and the customer repeated the complaint. Turn 368: the agent restated the refund policy and the customer repeated the complaint. Turn 369: the agent restated the refund policy and the customer repeated the complaint. Turn 370: the agent restated the refund policy and the customer repeated the complaint. Turn 371: the agent restated the refund policy and the customer repeated the complaint. Turn 372: the agent restated the refund policy and the customer repeated the complaint. Turn 373: the agent restated the refund policy and the customer repeated the complaint. Turn 374: the agent restated the refund policy and the customer repeated the complaint. Turn 375: the agent restated the refund policy and the customer repeated the complaint. Turn 376: the agent restated the refund policy and the customer repeated the complaint. Turn 377: the agent restated the refund policy and the customer repeated the complaint. Turn 378: the agent restated the refund policy and the customer repeated the complaint. Turn 379: the agent restated the refund policy and the customer repeated the complaint. Turn 380: the agent restated the refund policy and the customer repeated the complaint. Turn 381: the agent restated the refund policy and the customer repeated the complaint. Turn 382: the agent restated the refund policy and the customer repeated the complaint. Turn 383: the agent restated the refund policy and the customer repeated the complaint. Turn 384: the agent restated the refund policy and the customer repeated the complaint. Turn 385: the agent restated the refund policy and the customer repeated the complaint. Turn 386: the agent restated the refund policy and the customer repeated the complaint. Turn 387: the agent restated the refund policy and the customer repeated the complaint. Turn 388: the agent restated the refund policy and the customer repeated the complaint. Turn 389: the agent restated the refund policy and the customer repeated the complaint. Turn 390: the agent restated the refund policy and the customer repeated the complaint. Turn 391: the agent restated the refund policy and the customer repeated the complaint. Turn 392: the agent restated the refund policy and the customer repeated the complaint. Turn 393: the agent restated the refund policy and the customer repeated the complaint. Turn 394: the agent restated the refund policy and the customer repeated the complaint. Turn 395: the agent restated the refund policy and the customer repeated the complaint. Turn 396: the agent restated the refund policy and the customer repeated the complaint. Turn 397: the agent restated the refund policy and the customer repeated the complaint. Turn 398: the agent restated the refund policy and the customer repeated the complaint. Turn 399: the agent restated the refund policy and the customer repeated the complaint.",+ "The app crashes on login since yesterday's update.",+ "ok"+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 91,+ 44,+ 157,+ 74,+ 512,+ 44,+ 35+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8178,+ "technical": 0.1682,+ "other": 0.014+ },+ "confidence": 0.5229,+ "answer_confidence": 0.8178,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7428,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5839,+ "1": 0.0894,+ "2": 0.3267+ },+ "confidence": 0.1849,+ "answer_confidence": 0.5839,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0144,+ "confidence": 0.9856,+ "answer_confidence": 0.9856,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7468,+ "technical": 0.1514,+ "other": 0.1017+ },+ "confidence": 0.3297,+ "answer_confidence": 0.7468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6364,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1029,+ "1": 0.1578,+ "2": 0.7393+ },+ "confidence": 0.3185,+ "answer_confidence": 0.7393,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9238,+ "confidence": 0.9238,+ "answer_confidence": 0.9238,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9067,+ "technical": 0.0472,+ "other": 0.0461+ },+ "confidence": 0.6589,+ "answer_confidence": 0.9067,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8012,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3497,+ "1": 0.4994,+ "2": 0.1509+ },+ "confidence": 0.0902,+ "answer_confidence": 0.4994,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1497,+ "confidence": 0.8503,+ "answer_confidence": 0.8503,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 214,+ "output_tokens": 0,+ "state_tokens": 40,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8204,+ "technical": 0.0752,+ "other": 0.1045+ },+ "confidence": 0.4603,+ "answer_confidence": 0.8204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6454,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5702,+ "1": 0.2141,+ "2": 0.2156+ },+ "confidence": 0.1069,+ "answer_confidence": 0.5702,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3196,+ "confidence": 0.6804,+ "answer_confidence": 0.6804,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 6804,+ "state_tokens_dropped": 6326,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.0483,+ "technical": 0.9057,+ "other": 0.046+ },+ "confidence": 0.6563,+ "answer_confidence": 0.9057,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4741,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.17,+ "1": 0.186,+ "2": 0.6441+ },+ "confidence": 0.1831,+ "answer_confidence": 0.6441,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.122,+ "confidence": 0.878,+ "answer_confidence": 0.878,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5728,+ "technical": 0.2419,+ "other": 0.1853+ },+ "confidence": 0.1126,+ "answer_confidence": 0.5728,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.606,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5308,+ "1": 0.3323,+ "2": 0.1368+ },+ "confidence": 0.113,+ "answer_confidence": 0.5308,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4482,+ "confidence": 0.5518,+ "answer_confidence": 0.5518,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 97,+ "output_tokens": 0,+ "state_tokens": 1,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 44+ ],+ [+ 6,+ 74+ ],+ [+ 6,+ 157+ ],+ [+ 3,+ 512+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sorted_windows.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sorted_windows.jsonnew file mode 100644index 00000000..6a5ed8e5--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_sorted_windows.json@@ -0,0 +1,1101 @@+{+ "name": "batch_sorted_windows",+ "states": [+ "Routine status note 0. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 1. Routine status note 1. ",+ "Routine status note 2. Routine status note 2. Routine status note 2. ",+ "Routine status note 3. Routine status note 3. Routine status note 3. Routine status note 3. ",+ "Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. ",+ "Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. ",+ "Routine status note 7. ",+ "Routine status note 8. Routine status note 8. ",+ "Routine status note 9. Routine status note 9. Routine status note 9. ",+ "Routine status note 10. Routine status note 10. Routine status note 10. Routine status note 10. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. ",+ "Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. ",+ "Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. ",+ "Routine status note 14. ",+ "Routine status note 15. Routine status note 15. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 16. Routine status note 16. Routine status note 16. ",+ "Routine status note 17. Routine status note 17. Routine status note 17. Routine status note 17. "+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 97,+ 47,+ 53,+ 59,+ 65,+ 127,+ 77,+ 41,+ 47,+ 53,+ 115,+ 65,+ 71,+ 77,+ 41,+ 103,+ 53,+ 59+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8655,+ "technical": 0.0902,+ "other": 0.0442+ },+ "confidence": 0.5631,+ "answer_confidence": 0.8655,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5635,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1496,+ "1": 0.1374,+ "2": 0.7131+ },+ "confidence": 0.2736,+ "answer_confidence": 0.7131,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9215,+ "confidence": 0.9215,+ "answer_confidence": 0.9215,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2397,+ "technical": 0.4202,+ "other": 0.3402+ },+ "confidence": 0.0228,+ "answer_confidence": 0.4202,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8313,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5109,+ "1": 0.1468,+ "2": 0.3423+ },+ "confidence": 0.0973,+ "answer_confidence": 0.5109,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0808,+ "confidence": 0.9192,+ "answer_confidence": 0.9192,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1535,+ "technical": 0.4669,+ "other": 0.3797+ },+ "confidence": 0.0798,+ "answer_confidence": 0.4669,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9775,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4256,+ "1": 0.1713,+ "2": 0.4031+ },+ "confidence": 0.0606,+ "answer_confidence": 0.4256,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.05,+ "confidence": 0.95,+ "answer_confidence": 0.95,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1547,+ "technical": 0.468,+ "other": 0.3773+ },+ "confidence": 0.079,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9046,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4522,+ "1": 0.191,+ "2": 0.3568+ },+ "confidence": 0.0508,+ "answer_confidence": 0.4522,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.059,+ "confidence": 0.941,+ "answer_confidence": 0.941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1587,+ "technical": 0.454,+ "other": 0.3873+ },+ "confidence": 0.0734,+ "answer_confidence": 0.454,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8131,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.493,+ "1": 0.2008,+ "2": 0.3062+ },+ "confidence": 0.0594,+ "answer_confidence": 0.493,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0713,+ "confidence": 0.9287,+ "answer_confidence": 0.9287,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8316,+ "technical": 0.1188,+ "other": 0.0496+ },+ "confidence": 0.4944,+ "answer_confidence": 0.8316,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7514,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.161,+ "2": 0.7952+ },+ "confidence": 0.4418,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9343,+ "confidence": 0.9343,+ "answer_confidence": 0.9343,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1728,+ "technical": 0.4389,+ "other": 0.3884+ },+ "confidence": 0.0606,+ "answer_confidence": 0.4389,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7076,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5471,+ "1": 0.1982,+ "2": 0.2547+ },+ "confidence": 0.0906,+ "answer_confidence": 0.5471,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1004,+ "confidence": 0.8996,+ "answer_confidence": 0.8996,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2969,+ "technical": 0.3791,+ "other": 0.324+ },+ "confidence": 0.0047,+ "answer_confidence": 0.3791,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.5766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6179,+ "1": 0.1875,+ "2": 0.1945+ },+ "confidence": 0.1536,+ "answer_confidence": 0.6179,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0524,+ "confidence": 0.9476,+ "answer_confidence": 0.9476,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2135,+ "technical": 0.4829,+ "other": 0.3036+ },+ "confidence": 0.0505,+ "answer_confidence": 0.4829,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8657,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4937,+ "1": 0.1469,+ "2": 0.3594+ },+ "confidence": 0.0916,+ "answer_confidence": 0.4937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1542,+ "technical": 0.4931,+ "other": 0.3526+ },+ "confidence": 0.0857,+ "answer_confidence": 0.4931,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7263,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5523,+ "1": 0.1692,+ "2": 0.2786+ },+ "confidence": 0.1038,+ "answer_confidence": 0.5523,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0396,+ "confidence": 0.9604,+ "answer_confidence": 0.9604,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.811,+ "technical": 0.1311,+ "other": 0.0579+ },+ "confidence": 0.4528,+ "answer_confidence": 0.811,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7229,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0615,+ "1": 0.1542,+ "2": 0.7843+ },+ "confidence": 0.4081,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9289,+ "confidence": 0.9289,+ "answer_confidence": 0.9289,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1664,+ "technical": 0.4641,+ "other": 0.3695+ },+ "confidence": 0.0692,+ "answer_confidence": 0.4641,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7084,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5451,+ "1": 0.2013,+ "2": 0.2536+ },+ "confidence": 0.0885,+ "answer_confidence": 0.5451,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0688,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1743,+ "technical": 0.4648,+ "other": 0.361+ },+ "confidence": 0.0639,+ "answer_confidence": 0.4648,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7638,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5147,+ "1": 0.2067,+ "2": 0.2785+ },+ "confidence": 0.0681,+ "answer_confidence": 0.5147,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0847,+ "confidence": 0.9153,+ "answer_confidence": 0.9153,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 205,+ "output_tokens": 0,+ "state_tokens": 37,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1576,+ "technical": 0.4595,+ "other": 0.3829+ },+ "confidence": 0.0751,+ "answer_confidence": 0.4595,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7753,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5131,+ "1": 0.1986,+ "2": 0.2884+ },+ "confidence": 0.0697,+ "answer_confidence": 0.5131,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0911,+ "confidence": 0.9089,+ "answer_confidence": 0.9089,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2859,+ "technical": 0.3743,+ "other": 0.3399+ },+ "confidence": 0.0055,+ "answer_confidence": 0.3743,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6247,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5914,+ "1": 0.1926,+ "2": 0.216+ },+ "confidence": 0.1272,+ "answer_confidence": 0.5914,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0601,+ "confidence": 0.9399,+ "answer_confidence": 0.9399,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8501,+ "technical": 0.1039,+ "other": 0.046+ },+ "confidence": 0.5314,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7509,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0536,+ "1": 0.142,+ "2": 0.8044+ },+ "confidence": 0.4457,+ "answer_confidence": 0.8044,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.94,+ "confidence": 0.94,+ "answer_confidence": 0.94,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1586,+ "technical": 0.4977,+ "other": 0.3437+ },+ "confidence": 0.084,+ "answer_confidence": 0.4977,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7191,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.557,+ "1": 0.1668,+ "2": 0.2761+ },+ "confidence": 0.1079,+ "answer_confidence": 0.557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0613,+ "confidence": 0.9387,+ "answer_confidence": 0.9387,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1858,+ "technical": 0.4573,+ "other": 0.3568+ },+ "confidence": 0.055,+ "answer_confidence": 0.4573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7483,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.534,+ "1": 0.1837,+ "2": 0.2823+ },+ "confidence": 0.0867,+ "answer_confidence": 0.534,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0678,+ "confidence": 0.9322,+ "answer_confidence": 0.9322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 41+ ],+ [+ 6,+ 47+ ],+ [+ 6,+ 53+ ],+ [+ 6,+ 65+ ],+ [+ 6,+ 71+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 103+ ],+ [+ 6,+ 127+ ],+ [+ 6,+ 59+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_truncated.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_truncated.jsonnew file mode 100644index 00000000..e463bdce--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_truncated.json@@ -0,0 +1,854 @@+{+ "name": "batch_truncated",+ "states": [+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ [+ {+ "role": "user",+ "content": "Turn 0: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 1: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 2: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 3: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 4: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 5: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 6: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 7: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 8: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 9: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 10: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 11: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 12: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 13: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 14: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 15: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 16: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 17: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 18: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 19: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 20: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 21: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 22: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 23: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 24: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 25: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 26: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 27: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 28: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 29: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 30: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 31: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 32: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 33: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 34: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 35: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 36: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 37: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 38: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 39: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 40: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 41: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 42: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 43: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 44: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 45: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 46: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 47: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 48: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 49: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 50: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 51: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 52: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 53: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 54: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 55: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 56: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 57: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 58: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 59: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 60: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 61: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 62: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 63: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 64: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 65: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 66: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 67: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 68: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 69: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 70: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 71: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 72: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 73: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 74: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 75: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 76: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 77: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 78: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 79: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 80: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 81: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 82: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 83: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 84: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 85: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 86: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 87: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 88: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 89: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 90: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 91: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 92: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 93: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 94: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 95: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 96: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 97: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 98: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 99: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 100: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 101: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 102: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 103: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 104: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 105: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 106: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 107: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 108: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 109: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 110: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 111: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 112: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 113: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 114: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 115: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 116: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 117: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 118: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 119: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 120: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 121: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 122: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 123: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 124: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 125: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 126: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 127: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 128: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 129: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 130: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 131: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 132: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 133: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 134: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 135: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 136: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 137: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 138: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 139: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "I want a refund or I will cancel today."+ }+ ],+ {+ "notes": "Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 512,+ 512,+ 512,+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8204,+ "technical": 0.0752,+ "other": 0.1045+ },+ "confidence": 0.4603,+ "answer_confidence": 0.8204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6454,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5702,+ "1": 0.2141,+ "2": 0.2156+ },+ "confidence": 0.1069,+ "answer_confidence": 0.5702,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3196,+ "confidence": 0.6804,+ "answer_confidence": 0.6804,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 2384,+ "state_tokens_dropped": 1906,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7269,+ "technical": 0.0916,+ "other": 0.1815+ },+ "confidence": 0.3077,+ "answer_confidence": 0.7269,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1608,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2363,+ "1": 0.3666,+ "2": 0.3971+ },+ "confidence": 0.021,+ "answer_confidence": 0.3971,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.698,+ "confidence": 0.698,+ "answer_confidence": 0.698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 4012,+ "state_tokens_dropped": 3534,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8348,+ "technical": 0.0629,+ "other": 0.1023+ },+ "confidence": 0.4922,+ "answer_confidence": 0.8348,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.5638,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6079,+ "1": 0.2203,+ "2": 0.1718+ },+ "confidence": 0.1458,+ "answer_confidence": 0.6079,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.5013,+ "confidence": 0.5013,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 2448,+ "state_tokens_dropped": 1970,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 512+ ],+ [+ 6,+ 512+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_truncated_sorted.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_truncated_sorted.jsonnew file mode 100644index 00000000..f21a6c48--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_truncated_sorted.json@@ -0,0 +1,855 @@+{+ "name": "batch_truncated_sorted",+ "states": [+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ [+ {+ "role": "user",+ "content": "Turn 0: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 1: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 2: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 3: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 4: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 5: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 6: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 7: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 8: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 9: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 10: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 11: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 12: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 13: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 14: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 15: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 16: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 17: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 18: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 19: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 20: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 21: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 22: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 23: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 24: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 25: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 26: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 27: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 28: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 29: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 30: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 31: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 32: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 33: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 34: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 35: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 36: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 37: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 38: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 39: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 40: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 41: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 42: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 43: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 44: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 45: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 46: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 47: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 48: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 49: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 50: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 51: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 52: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 53: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 54: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 55: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 56: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 57: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 58: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 59: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 60: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 61: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 62: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 63: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 64: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 65: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 66: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 67: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 68: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 69: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 70: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 71: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 72: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 73: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 74: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 75: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 76: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 77: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 78: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 79: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 80: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 81: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 82: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 83: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 84: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 85: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 86: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 87: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 88: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 89: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 90: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 91: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 92: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 93: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 94: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 95: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 96: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 97: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 98: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 99: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 100: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 101: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 102: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 103: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 104: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 105: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 106: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 107: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 108: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 109: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 110: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 111: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 112: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 113: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 114: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 115: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 116: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 117: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 118: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 119: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 120: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 121: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 122: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 123: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 124: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 125: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 126: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 127: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 128: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 129: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 130: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 131: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 132: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 133: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 134: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 135: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 136: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 137: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 138: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 139: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "I want a refund or I will cancel today."+ }+ ],+ {+ "notes": "Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3,+ "sort_by_length": true+ },+ "state_widths": [+ 512,+ 512,+ 512,+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8204,+ "technical": 0.0752,+ "other": 0.1045+ },+ "confidence": 0.4603,+ "answer_confidence": 0.8204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6454,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5702,+ "1": 0.2141,+ "2": 0.2156+ },+ "confidence": 0.1069,+ "answer_confidence": 0.5702,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3196,+ "confidence": 0.6804,+ "answer_confidence": 0.6804,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 2384,+ "state_tokens_dropped": 1906,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7269,+ "technical": 0.0916,+ "other": 0.1815+ },+ "confidence": 0.3077,+ "answer_confidence": 0.7269,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1608,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2363,+ "1": 0.3666,+ "2": 0.3971+ },+ "confidence": 0.021,+ "answer_confidence": 0.3971,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.698,+ "confidence": 0.698,+ "answer_confidence": 0.698,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 4012,+ "state_tokens_dropped": 3534,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8348,+ "technical": 0.0629,+ "other": 0.1023+ },+ "confidence": 0.4922,+ "answer_confidence": 0.8348,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.5638,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6079,+ "1": 0.2203,+ "2": 0.1718+ },+ "confidence": 0.1458,+ "answer_confidence": 0.6079,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.5013,+ "confidence": 0.5013,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 1536,+ "output_tokens": 0,+ "state_tokens": 2448,+ "state_tokens_dropped": 1970,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8355,+ "technical": 0.1139,+ "other": 0.0506+ },+ "confidence": 0.5008,+ "answer_confidence": 0.8355,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8578,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0339,+ "1": 0.0745,+ "2": 0.8916+ },+ "confidence": 0.6264,+ "answer_confidence": 0.8916,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.968,+ "confidence": 0.968,+ "answer_confidence": 0.968,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 512+ ],+ [+ 3,+ 512+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_unsorted_windows.json b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_unsorted_windows.jsonnew file mode 100644index 00000000..32240e81--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/english/case_batch_unsorted_windows.json@@ -0,0 +1,1100 @@+{+ "name": "batch_unsorted_windows",+ "states": [+ "Routine status note 0. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 1. Routine status note 1. ",+ "Routine status note 2. Routine status note 2. Routine status note 2. ",+ "Routine status note 3. Routine status note 3. Routine status note 3. Routine status note 3. ",+ "Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. ",+ "Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. ",+ "Routine status note 7. ",+ "Routine status note 8. Routine status note 8. ",+ "Routine status note 9. Routine status note 9. Routine status note 9. ",+ "Routine status note 10. Routine status note 10. Routine status note 10. Routine status note 10. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. ",+ "Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. ",+ "Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. ",+ "Routine status note 14. ",+ "Routine status note 15. Routine status note 15. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 16. Routine status note 16. Routine status note 16. ",+ "Routine status note 17. Routine status note 17. Routine status note 17. Routine status note 17. "+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 97,+ 47,+ 53,+ 59,+ 65,+ 127,+ 77,+ 41,+ 47,+ 53,+ 115,+ 65,+ 71,+ 77,+ 41,+ 103,+ 53,+ 59+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8655,+ "technical": 0.0902,+ "other": 0.0442+ },+ "confidence": 0.5631,+ "answer_confidence": 0.8655,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5635,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1496,+ "1": 0.1374,+ "2": 0.7131+ },+ "confidence": 0.2736,+ "answer_confidence": 0.7131,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9215,+ "confidence": 0.9215,+ "answer_confidence": 0.9215,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2397,+ "technical": 0.4202,+ "other": 0.3402+ },+ "confidence": 0.0228,+ "answer_confidence": 0.4202,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8313,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5109,+ "1": 0.1468,+ "2": 0.3423+ },+ "confidence": 0.0973,+ "answer_confidence": 0.5109,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0808,+ "confidence": 0.9192,+ "answer_confidence": 0.9192,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1535,+ "technical": 0.4669,+ "other": 0.3797+ },+ "confidence": 0.0798,+ "answer_confidence": 0.4669,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9775,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4256,+ "1": 0.1713,+ "2": 0.4031+ },+ "confidence": 0.0606,+ "answer_confidence": 0.4256,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.05,+ "confidence": 0.95,+ "answer_confidence": 0.95,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1547,+ "technical": 0.468,+ "other": 0.3773+ },+ "confidence": 0.079,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9046,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4522,+ "1": 0.191,+ "2": 0.3568+ },+ "confidence": 0.0508,+ "answer_confidence": 0.4522,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.059,+ "confidence": 0.941,+ "answer_confidence": 0.941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1587,+ "technical": 0.454,+ "other": 0.3873+ },+ "confidence": 0.0734,+ "answer_confidence": 0.454,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8131,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.493,+ "1": 0.2008,+ "2": 0.3062+ },+ "confidence": 0.0594,+ "answer_confidence": 0.493,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0713,+ "confidence": 0.9287,+ "answer_confidence": 0.9287,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8316,+ "technical": 0.1188,+ "other": 0.0496+ },+ "confidence": 0.4944,+ "answer_confidence": 0.8316,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7514,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0438,+ "1": 0.161,+ "2": 0.7952+ },+ "confidence": 0.4418,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9343,+ "confidence": 0.9343,+ "answer_confidence": 0.9343,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1728,+ "technical": 0.4389,+ "other": 0.3884+ },+ "confidence": 0.0606,+ "answer_confidence": 0.4389,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7076,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5471,+ "1": 0.1982,+ "2": 0.2547+ },+ "confidence": 0.0906,+ "answer_confidence": 0.5471,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1004,+ "confidence": 0.8996,+ "answer_confidence": 0.8996,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2969,+ "technical": 0.3791,+ "other": 0.324+ },+ "confidence": 0.0047,+ "answer_confidence": 0.3791,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.5766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.6179,+ "1": 0.1875,+ "2": 0.1945+ },+ "confidence": 0.1536,+ "answer_confidence": 0.6179,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0524,+ "confidence": 0.9476,+ "answer_confidence": 0.9476,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2135,+ "technical": 0.4829,+ "other": 0.3036+ },+ "confidence": 0.0505,+ "answer_confidence": 0.4829,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8657,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4937,+ "1": 0.1469,+ "2": 0.3594+ },+ "confidence": 0.0916,+ "answer_confidence": 0.4937,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1542,+ "technical": 0.4931,+ "other": 0.3526+ },+ "confidence": 0.0857,+ "answer_confidence": 0.4931,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7263,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5523,+ "1": 0.1692,+ "2": 0.2786+ },+ "confidence": 0.1038,+ "answer_confidence": 0.5523,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0396,+ "confidence": 0.9604,+ "answer_confidence": 0.9604,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.811,+ "technical": 0.1311,+ "other": 0.0579+ },+ "confidence": 0.4528,+ "answer_confidence": 0.811,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7229,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0615,+ "1": 0.1542,+ "2": 0.7843+ },+ "confidence": 0.4081,+ "answer_confidence": 0.7843,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.9289,+ "confidence": 0.9289,+ "answer_confidence": 0.9289,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1664,+ "technical": 0.4641,+ "other": 0.3695+ },+ "confidence": 0.0692,+ "answer_confidence": 0.4641,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7084,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5451,+ "1": 0.2013,+ "2": 0.2536+ },+ "confidence": 0.0885,+ "answer_confidence": 0.5451,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0688,+ "confidence": 0.9312,+ "answer_confidence": 0.9312,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1743,+ "technical": 0.4648,+ "other": 0.361+ },+ "confidence": 0.0639,+ "answer_confidence": 0.4648,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7638,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5147,+ "1": 0.2067,+ "2": 0.2785+ },+ "confidence": 0.0681,+ "answer_confidence": 0.5147,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0847,+ "confidence": 0.9153,+ "answer_confidence": 0.9153,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 205,+ "output_tokens": 0,+ "state_tokens": 37,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1576,+ "technical": 0.4595,+ "other": 0.3829+ },+ "confidence": 0.0751,+ "answer_confidence": 0.4595,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7753,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5131,+ "1": 0.1986,+ "2": 0.2884+ },+ "confidence": 0.0697,+ "answer_confidence": 0.5131,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0911,+ "confidence": 0.9089,+ "answer_confidence": 0.9089,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.2859,+ "technical": 0.3743,+ "other": 0.3399+ },+ "confidence": 0.0055,+ "answer_confidence": 0.3743,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.6247,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.5914,+ "1": 0.1926,+ "2": 0.216+ },+ "confidence": 0.1272,+ "answer_confidence": 0.5914,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0601,+ "confidence": 0.9399,+ "answer_confidence": 0.9399,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8501,+ "technical": 0.1039,+ "other": 0.046+ },+ "confidence": 0.5314,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7509,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0536,+ "1": 0.142,+ "2": 0.8044+ },+ "confidence": 0.4457,+ "answer_confidence": 0.8044,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.94,+ "confidence": 0.94,+ "answer_confidence": 0.94,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1586,+ "technical": 0.4977,+ "other": 0.3437+ },+ "confidence": 0.084,+ "answer_confidence": 0.4977,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7191,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.557,+ "1": 0.1668,+ "2": 0.2761+ },+ "confidence": 0.1079,+ "answer_confidence": 0.557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0613,+ "confidence": 0.9387,+ "answer_confidence": 0.9387,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1858,+ "technical": 0.4573,+ "other": 0.3568+ },+ "confidence": 0.055,+ "answer_confidence": 0.4573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7483,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.534,+ "1": 0.1837,+ "2": 0.2823+ },+ "confidence": 0.0867,+ "answer_confidence": 0.534,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0678,+ "confidence": 0.9322,+ "answer_confidence": 0.9322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 97+ ],+ [+ 6,+ 59+ ],+ [+ 6,+ 127+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 53+ ],+ [+ 6,+ 115+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 103+ ],+ [+ 6,+ 59+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/index.json b/laya-dotnet/tests/Laya.Tests/golden/english/index.jsonindex 5c2bf1ce..eb70e281 100644--- a/laya-dotnet/tests/Laya.Tests/golden/english/index.json+++ b/laya-dotnet/tests/Laya.Tests/golden/english/index.json@@ -162,5 +162,191 @@"file": "case_long_no_state_room.json","expects_error": true,"kind": "long"+ },+ {+ "name": "batch_one_state",+ "file": "case_batch_one_state.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_mixed",+ "file": "case_batch_mixed.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_1",+ "file": "case_batch_size_1.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_3",+ "file": "case_batch_size_3.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_over_len",+ "file": "case_batch_size_over_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_zero",+ "file": "case_batch_size_zero.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_negative",+ "file": "case_batch_size_negative.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_on",+ "file": "case_batch_sort_on.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_off",+ "file": "case_batch_sort_off.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_3",+ "file": "case_batch_sort_size_3.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_partial_window",+ "file": "case_batch_sort_partial_window.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_no_batch_size",+ "file": "case_batch_sort_no_batch_size.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_1",+ "file": "case_batch_sort_size_1.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_eq_len",+ "file": "case_batch_sort_size_eq_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_over_len",+ "file": "case_batch_sort_size_over_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_zero",+ "file": "case_batch_sort_size_zero.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_truncated",+ "file": "case_batch_truncated.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_truncated_sorted",+ "file": "case_batch_truncated_sorted.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_duplicate_states",+ "file": "case_batch_duplicate_states.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_states",+ "file": "case_batch_empty_states.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_states_invalid_questions",+ "file": "case_batch_empty_states_invalid_questions.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_questions",+ "file": "case_batch_empty_questions.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_both",+ "file": "case_batch_empty_both.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sorted",+ "file": "case_batch_sorted.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sorted_windows",+ "file": "case_batch_sorted_windows.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_unsorted_windows",+ "file": "case_batch_unsorted_windows.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_chunked",+ "file": "case_batch_chunked.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_single_question",+ "file": "case_batch_single_question.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_questions_with_options",+ "file": "case_batch_empty_questions_with_options.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_none_state",+ "file": "case_batch_none_state.json",+ "expects_error": true,+ "kind": "batch"+ },+ {+ "name": "batch_options_exceed_head",+ "file": "case_batch_options_exceed_head.json",+ "expects_error": true,+ "kind": "batch"}]diff --git a/laya-dotnet/tests/Laya.Tests/golden/english/meta.json b/laya-dotnet/tests/Laya.Tests/golden/english/meta.jsonindex e781e7ad..a57acde6 100644--- a/laya-dotnet/tests/Laya.Tests/golden/english/meta.json+++ b/laya-dotnet/tests/Laya.Tests/golden/english/meta.json@@ -1,7 +1,7 @@{"generator": "tools/dump_golden.py","onnx_dir": "english",- "laya_version": "0.4.11",+ "laya_version": "0.4.14","onnxruntime_version": "1.30.0","transformers_version": "5.17.0","config": {diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_chunked.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_chunked.jsonnew file mode 100644index 00000000..7289736f--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_chunked.json@@ -0,0 +1,466 @@+{+ "name": "batch_chunked",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ],+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint. Turn 140: the agent restated the refund policy and the customer repeated the complaint. Turn 141: the agent restated the refund policy and the customer repeated the complaint. Turn 142: the agent restated the refund policy and the customer repeated the complaint. Turn 143: the agent restated the refund policy and the customer repeated the complaint. Turn 144: the agent restated the refund policy and the customer repeated the complaint. Turn 145: the agent restated the refund policy and the customer repeated the complaint. Turn 146: the agent restated the refund policy and the customer repeated the complaint. Turn 147: the agent restated the refund policy and the customer repeated the complaint. Turn 148: the agent restated the refund policy and the customer repeated the complaint. Turn 149: the agent restated the refund policy and the customer repeated the complaint. Turn 150: the agent restated the refund policy and the customer repeated the complaint. Turn 151: the agent restated the refund policy and the customer repeated the complaint. Turn 152: the agent restated the refund policy and the customer repeated the complaint. Turn 153: the agent restated the refund policy and the customer repeated the complaint. Turn 154: the agent restated the refund policy and the customer repeated the complaint. Turn 155: the agent restated the refund policy and the customer repeated the complaint. Turn 156: the agent restated the refund policy and the customer repeated the complaint. Turn 157: the agent restated the refund policy and the customer repeated the complaint. Turn 158: the agent restated the refund policy and the customer repeated the complaint. Turn 159: the agent restated the refund policy and the customer repeated the complaint. Turn 160: the agent restated the refund policy and the customer repeated the complaint. Turn 161: the agent restated the refund policy and the customer repeated the complaint. Turn 162: the agent restated the refund policy and the customer repeated the complaint. Turn 163: the agent restated the refund policy and the customer repeated the complaint. Turn 164: the agent restated the refund policy and the customer repeated the complaint. Turn 165: the agent restated the refund policy and the customer repeated the complaint. Turn 166: the agent restated the refund policy and the customer repeated the complaint. Turn 167: the agent restated the refund policy and the customer repeated the complaint. Turn 168: the agent restated the refund policy and the customer repeated the complaint. Turn 169: the agent restated the refund policy and the customer repeated the complaint. Turn 170: the agent restated the refund policy and the customer repeated the complaint. Turn 171: the agent restated the refund policy and the customer repeated the complaint. Turn 172: the agent restated the refund policy and the customer repeated the complaint. Turn 173: the agent restated the refund policy and the customer repeated the complaint. Turn 174: the agent restated the refund policy and the customer repeated the complaint. Turn 175: the agent restated the refund policy and the customer repeated the complaint. Turn 176: the agent restated the refund policy and the customer repeated the complaint. Turn 177: the agent restated the refund policy and the customer repeated the complaint. Turn 178: the agent restated the refund policy and the customer repeated the complaint. Turn 179: the agent restated the refund policy and the customer repeated the complaint. Turn 180: the agent restated the refund policy and the customer repeated the complaint. Turn 181: the agent restated the refund policy and the customer repeated the complaint. Turn 182: the agent restated the refund policy and the customer repeated the complaint. Turn 183: the agent restated the refund policy and the customer repeated the complaint. Turn 184: the agent restated the refund policy and the customer repeated the complaint. Turn 185: the agent restated the refund policy and the customer repeated the complaint. Turn 186: the agent restated the refund policy and the customer repeated the complaint. Turn 187: the agent restated the refund policy and the customer repeated the complaint. Turn 188: the agent restated the refund policy and the customer repeated the complaint. Turn 189: the agent restated the refund policy and the customer repeated the complaint. Turn 190: the agent restated the refund policy and the customer repeated the complaint. Turn 191: the agent restated the refund policy and the customer repeated the complaint. Turn 192: the agent restated the refund policy and the customer repeated the complaint. Turn 193: the agent restated the refund policy and the customer repeated the complaint. Turn 194: the agent restated the refund policy and the customer repeated the complaint. Turn 195: the agent restated the refund policy and the customer repeated the complaint. Turn 196: the agent restated the refund policy and the customer repeated the complaint. Turn 197: the agent restated the refund policy and the customer repeated the complaint. Turn 198: the agent restated the refund policy and the customer repeated the complaint. Turn 199: the agent restated the refund policy and the customer repeated the complaint. Turn 200: the agent restated the refund policy and the customer repeated the complaint. Turn 201: the agent restated the refund policy and the customer repeated the complaint. Turn 202: the agent restated the refund policy and the customer repeated the complaint. Turn 203: the agent restated the refund policy and the customer repeated the complaint. Turn 204: the agent restated the refund policy and the customer repeated the complaint. Turn 205: the agent restated the refund policy and the customer repeated the complaint. Turn 206: the agent restated the refund policy and the customer repeated the complaint. Turn 207: the agent restated the refund policy and the customer repeated the complaint. Turn 208: the agent restated the refund policy and the customer repeated the complaint. Turn 209: the agent restated the refund policy and the customer repeated the complaint. Turn 210: the agent restated the refund policy and the customer repeated the complaint. Turn 211: the agent restated the refund policy and the customer repeated the complaint. Turn 212: the agent restated the refund policy and the customer repeated the complaint. Turn 213: the agent restated the refund policy and the customer repeated the complaint. Turn 214: the agent restated the refund policy and the customer repeated the complaint. Turn 215: the agent restated the refund policy and the customer repeated the complaint. Turn 216: the agent restated the refund policy and the customer repeated the complaint. Turn 217: the agent restated the refund policy and the customer repeated the complaint. Turn 218: the agent restated the refund policy and the customer repeated the complaint. Turn 219: the agent restated the refund policy and the customer repeated the complaint. Turn 220: the agent restated the refund policy and the customer repeated the complaint. Turn 221: the agent restated the refund policy and the customer repeated the complaint. Turn 222: the agent restated the refund policy and the customer repeated the complaint. Turn 223: the agent restated the refund policy and the customer repeated the complaint. Turn 224: the agent restated the refund policy and the customer repeated the complaint. Turn 225: the agent restated the refund policy and the customer repeated the complaint. Turn 226: the agent restated the refund policy and the customer repeated the complaint. Turn 227: the agent restated the refund policy and the customer repeated the complaint. Turn 228: the agent restated the refund policy and the customer repeated the complaint. Turn 229: the agent restated the refund policy and the customer repeated the complaint. Turn 230: the agent restated the refund policy and the customer repeated the complaint. Turn 231: the agent restated the refund policy and the customer repeated the complaint. Turn 232: the agent restated the refund policy and the customer repeated the complaint. Turn 233: the agent restated the refund policy and the customer repeated the complaint. Turn 234: the agent restated the refund policy and the customer repeated the complaint. Turn 235: the agent restated the refund policy and the customer repeated the complaint. Turn 236: the agent restated the refund policy and the customer repeated the complaint. Turn 237: the agent restated the refund policy and the customer repeated the complaint. Turn 238: the agent restated the refund policy and the customer repeated the complaint. Turn 239: the agent restated the refund policy and the customer repeated the complaint. Turn 240: the agent restated the refund policy and the customer repeated the complaint. Turn 241: the agent restated the refund policy and the customer repeated the complaint. Turn 242: the agent restated the refund policy and the customer repeated the complaint. Turn 243: the agent restated the refund policy and the customer repeated the complaint. Turn 244: the agent restated the refund policy and the customer repeated the complaint. Turn 245: the agent restated the refund policy and the customer repeated the complaint. Turn 246: the agent restated the refund policy and the customer repeated the complaint. Turn 247: the agent restated the refund policy and the customer repeated the complaint. Turn 248: the agent restated the refund policy and the customer repeated the complaint. Turn 249: the agent restated the refund policy and the customer repeated the complaint. Turn 250: the agent restated the refund policy and the customer repeated the complaint. Turn 251: the agent restated the refund policy and the customer repeated the complaint. Turn 252: the agent restated the refund policy and the customer repeated the complaint. Turn 253: the agent restated the refund policy and the customer repeated the complaint. Turn 254: the agent restated the refund policy and the customer repeated the complaint. Turn 255: the agent restated the refund policy and the customer repeated the complaint. Turn 256: the agent restated the refund policy and the customer repeated the complaint. Turn 257: the agent restated the refund policy and the customer repeated the complaint. Turn 258: the agent restated the refund policy and the customer repeated the complaint. Turn 259: the agent restated the refund policy and the customer repeated the complaint. Turn 260: the agent restated the refund policy and the customer repeated the complaint. Turn 261: the agent restated the refund policy and the customer repeated the complaint. Turn 262: the agent restated the refund policy and the customer repeated the complaint. Turn 263: the agent restated the refund policy and the customer repeated the complaint. Turn 264: the agent restated the refund policy and the customer repeated the complaint. Turn 265: the agent restated the refund policy and the customer repeated the complaint. Turn 266: the agent restated the refund policy and the customer repeated the complaint. Turn 267: the agent restated the refund policy and the customer repeated the complaint. Turn 268: the agent restated the refund policy and the customer repeated the complaint. Turn 269: the agent restated the refund policy and the customer repeated the complaint. Turn 270: the agent restated the refund policy and the customer repeated the complaint. Turn 271: the agent restated the refund policy and the customer repeated the complaint. Turn 272: the agent restated the refund policy and the customer repeated the complaint. Turn 273: the agent restated the refund policy and the customer repeated the complaint. Turn 274: the agent restated the refund policy and the customer repeated the complaint. Turn 275: the agent restated the refund policy and the customer repeated the complaint. Turn 276: the agent restated the refund policy and the customer repeated the complaint. Turn 277: the agent restated the refund policy and the customer repeated the complaint. Turn 278: the agent restated the refund policy and the customer repeated the complaint. Turn 279: the agent restated the refund policy and the customer repeated the complaint. Turn 280: the agent restated the refund policy and the customer repeated the complaint. Turn 281: the agent restated the refund policy and the customer repeated the complaint. Turn 282: the agent restated the refund policy and the customer repeated the complaint. Turn 283: the agent restated the refund policy and the customer repeated the complaint. Turn 284: the agent restated the refund policy and the customer repeated the complaint. Turn 285: the agent restated the refund policy and the customer repeated the complaint. Turn 286: the agent restated the refund policy and the customer repeated the complaint. Turn 287: the agent restated the refund policy and the customer repeated the complaint. Turn 288: the agent restated the refund policy and the customer repeated the complaint. Turn 289: the agent restated the refund policy and the customer repeated the complaint. Turn 290: the agent restated the refund policy and the customer repeated the complaint. Turn 291: the agent restated the refund policy and the customer repeated the complaint. Turn 292: the agent restated the refund policy and the customer repeated the complaint. Turn 293: the agent restated the refund policy and the customer repeated the complaint. Turn 294: the agent restated the refund policy and the customer repeated the complaint. Turn 295: the agent restated the refund policy and the customer repeated the complaint. Turn 296: the agent restated the refund policy and the customer repeated the complaint. Turn 297: the agent restated the refund policy and the customer repeated the complaint. Turn 298: the agent restated the refund policy and the customer repeated the complaint. Turn 299: the agent restated the refund policy and the customer repeated the complaint. Turn 300: the agent restated the refund policy and the customer repeated the complaint. Turn 301: the agent restated the refund policy and the customer repeated the complaint. Turn 302: the agent restated the refund policy and the customer repeated the complaint. Turn 303: the agent restated the refund policy and the customer repeated the complaint. Turn 304: the agent restated the refund policy and the customer repeated the complaint. Turn 305: the agent restated the refund policy and the customer repeated the complaint. Turn 306: the agent restated the refund policy and the customer repeated the complaint. Turn 307: the agent restated the refund policy and the customer repeated the complaint. Turn 308: the agent restated the refund policy and the customer repeated the complaint. Turn 309: the agent restated the refund policy and the customer repeated the complaint. Turn 310: the agent restated the refund policy and the customer repeated the complaint. Turn 311: the agent restated the refund policy and the customer repeated the complaint. Turn 312: the agent restated the refund policy and the customer repeated the complaint. Turn 313: the agent restated the refund policy and the customer repeated the complaint. Turn 314: the agent restated the refund policy and the customer repeated the complaint. Turn 315: the agent restated the refund policy and the customer repeated the complaint. Turn 316: the agent restated the refund policy and the customer repeated the complaint. Turn 317: the agent restated the refund policy and the customer repeated the complaint. Turn 318: the agent restated the refund policy and the customer repeated the complaint. Turn 319: the agent restated the refund policy and the customer repeated the complaint. Turn 320: the agent restated the refund policy and the customer repeated the complaint. Turn 321: the agent restated the refund policy and the customer repeated the complaint. Turn 322: the agent restated the refund policy and the customer repeated the complaint. Turn 323: the agent restated the refund policy and the customer repeated the complaint. Turn 324: the agent restated the refund policy and the customer repeated the complaint. Turn 325: the agent restated the refund policy and the customer repeated the complaint. Turn 326: the agent restated the refund policy and the customer repeated the complaint. Turn 327: the agent restated the refund policy and the customer repeated the complaint. Turn 328: the agent restated the refund policy and the customer repeated the complaint. Turn 329: the agent restated the refund policy and the customer repeated the complaint. Turn 330: the agent restated the refund policy and the customer repeated the complaint. Turn 331: the agent restated the refund policy and the customer repeated the complaint. Turn 332: the agent restated the refund policy and the customer repeated the complaint. Turn 333: the agent restated the refund policy and the customer repeated the complaint. Turn 334: the agent restated the refund policy and the customer repeated the complaint. Turn 335: the agent restated the refund policy and the customer repeated the complaint. Turn 336: the agent restated the refund policy and the customer repeated the complaint. Turn 337: the agent restated the refund policy and the customer repeated the complaint. Turn 338: the agent restated the refund policy and the customer repeated the complaint. Turn 339: the agent restated the refund policy and the customer repeated the complaint. Turn 340: the agent restated the refund policy and the customer repeated the complaint. Turn 341: the agent restated the refund policy and the customer repeated the complaint. Turn 342: the agent restated the refund policy and the customer repeated the complaint. Turn 343: the agent restated the refund policy and the customer repeated the complaint. Turn 344: the agent restated the refund policy and the customer repeated the complaint. Turn 345: the agent restated the refund policy and the customer repeated the complaint. Turn 346: the agent restated the refund policy and the customer repeated the complaint. Turn 347: the agent restated the refund policy and the customer repeated the complaint. Turn 348: the agent restated the refund policy and the customer repeated the complaint. Turn 349: the agent restated the refund policy and the customer repeated the complaint. Turn 350: the agent restated the refund policy and the customer repeated the complaint. Turn 351: the agent restated the refund policy and the customer repeated the complaint. Turn 352: the agent restated the refund policy and the customer repeated the complaint. Turn 353: the agent restated the refund policy and the customer repeated the complaint. Turn 354: the agent restated the refund policy and the customer repeated the complaint. Turn 355: the agent restated the refund policy and the customer repeated the complaint. Turn 356: the agent restated the refund policy and the customer repeated the complaint. Turn 357: the agent restated the refund policy and the customer repeated the complaint. Turn 358: the agent restated the refund policy and the customer repeated the complaint. Turn 359: the agent restated the refund policy and the customer repeated the complaint. Turn 360: the agent restated the refund policy and the customer repeated the complaint. Turn 361: the agent restated the refund policy and the customer repeated the complaint. Turn 362: the agent restated the refund policy and the customer repeated the complaint. Turn 363: the agent restated the refund policy and the customer repeated the complaint. Turn 364: the agent restated the refund policy and the customer repeated the complaint. Turn 365: the agent restated the refund policy and the customer repeated the complaint. Turn 366: the agent restated the refund policy and the customer repeated the complaint. Turn 367: the agent restated the refund policy and the customer repeated the complaint. Turn 368: the agent restated the refund policy and the customer repeated the complaint. Turn 369: the agent restated the refund policy and the customer repeated the complaint. Turn 370: the agent restated the refund policy and the customer repeated the complaint. Turn 371: the agent restated the refund policy and the customer repeated the complaint. Turn 372: the agent restated the refund policy and the customer repeated the complaint. Turn 373: the agent restated the refund policy and the customer repeated the complaint. Turn 374: the agent restated the refund policy and the customer repeated the complaint. Turn 375: the agent restated the refund policy and the customer repeated the complaint. Turn 376: the agent restated the refund policy and the customer repeated the complaint. Turn 377: the agent restated the refund policy and the customer repeated the complaint. Turn 378: the agent restated the refund policy and the customer repeated the complaint. Turn 379: the agent restated the refund policy and the customer repeated the complaint. Turn 380: the agent restated the refund policy and the customer repeated the complaint. Turn 381: the agent restated the refund policy and the customer repeated the complaint. Turn 382: the agent restated the refund policy and the customer repeated the complaint. Turn 383: the agent restated the refund policy and the customer repeated the complaint. Turn 384: the agent restated the refund policy and the customer repeated the complaint. Turn 385: the agent restated the refund policy and the customer repeated the complaint. Turn 386: the agent restated the refund policy and the customer repeated the complaint. Turn 387: the agent restated the refund policy and the customer repeated the complaint. Turn 388: the agent restated the refund policy and the customer repeated the complaint. Turn 389: the agent restated the refund policy and the customer repeated the complaint. Turn 390: the agent restated the refund policy and the customer repeated the complaint. Turn 391: the agent restated the refund policy and the customer repeated the complaint. Turn 392: the agent restated the refund policy and the customer repeated the complaint. Turn 393: the agent restated the refund policy and the customer repeated the complaint. Turn 394: the agent restated the refund policy and the customer repeated the complaint. Turn 395: the agent restated the refund policy and the customer repeated the complaint. Turn 396: the agent restated the refund policy and the customer repeated the complaint. Turn 397: the agent restated the refund policy and the customer repeated the complaint. Turn 398: the agent restated the refund policy and the customer repeated the complaint. Turn 399: the agent restated the refund policy and the customer repeated the complaint.",+ "The app crashes on login since yesterday's update.",+ "ok"+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3+ },+ "state_widths": [+ 90,+ 44,+ 147,+ 73,+ 1024,+ 45,+ 35+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9999,+ "technical": 0.0,+ "other": 0.0+ },+ "confidence": 0.9993,+ "answer_confidence": 0.9999,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6231,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0528,+ "1": 0.2714,+ "2": 0.6759+ },+ "confidence": 0.2956,+ "answer_confidence": 0.6759,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0067,+ "confidence": 0.9933,+ "answer_confidence": 0.9933,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 126,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2098,+ "technical": 0.0637,+ "other": 0.7266+ },+ "confidence": 0.331,+ "answer_confidence": 0.7266,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3977,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0308,+ "1": 0.5407,+ "2": 0.4285+ },+ "confidence": 0.2692,+ "answer_confidence": 0.5407,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1873,+ "confidence": 0.8127,+ "answer_confidence": 0.8127,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 435,+ "output_tokens": 0,+ "state_tokens": 113,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6466,+ "technical": 0.0903,+ "other": 0.2631+ },+ "confidence": 0.2259,+ "answer_confidence": 0.6466,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0493,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1356,+ "1": 0.6796,+ "2": 0.1849+ },+ "confidence": 0.2304,+ "answer_confidence": 0.6796,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0166,+ "confidence": 0.9834,+ "answer_confidence": 0.9834,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 213,+ "output_tokens": 0,+ "state_tokens": 39,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2111,+ "technical": 0.0685,+ "other": 0.7204+ },+ "confidence": 0.319,+ "answer_confidence": 0.7204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1106,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2027,+ "1": 0.484,+ "2": 0.3133+ },+ "confidence": 0.0549,+ "answer_confidence": 0.484,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8812,+ "confidence": 0.8812,+ "answer_confidence": 0.8812,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 7894,+ "state_tokens_dropped": 6904,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.0015,+ "technical": 0.962,+ "other": 0.0365+ },+ "confidence": 0.8474,+ "answer_confidence": 0.962,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1251,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0863,+ "1": 0.7023,+ "2": 0.2114+ },+ "confidence": 0.2826,+ "answer_confidence": 0.7023,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0344,+ "confidence": 0.9656,+ "answer_confidence": 0.9656,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 129,+ "output_tokens": 0,+ "state_tokens": 11,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7941,+ "technical": 0.0972,+ "other": 0.1087+ },+ "confidence": 0.4075,+ "answer_confidence": 0.7941,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.006,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2485,+ "1": 0.4971,+ "2": 0.2545+ },+ "confidence": 0.0518,+ "answer_confidence": 0.4971,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0083,+ "confidence": 0.9917,+ "answer_confidence": 0.9917,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 99,+ "output_tokens": 0,+ "state_tokens": 1,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 147+ ],+ [+ 9,+ 1024+ ],+ [+ 3,+ 35+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_duplicate_states.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_duplicate_states.jsonnew file mode 100644index 00000000..0211716d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_duplicate_states.json@@ -0,0 +1,211 @@+{+ "name": "batch_duplicate_states",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 90,+ 90,+ 90+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 90+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_both.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_both.jsonnew file mode 100644index 00000000..8a31ab3d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_both.json@@ -0,0 +1,9 @@+{+ "name": "batch_empty_both",+ "states": [],+ "questions": {},+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_questions.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_questions.jsonnew file mode 100644index 00000000..ea34701f--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_questions.json@@ -0,0 +1,29 @@+{+ "name": "batch_empty_questions",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ ""+ ],+ "questions": {},+ "options": {},+ "state_widths": [],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ }+ ],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_questions_with_options.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_questions_with_options.jsonnew file mode 100644index 00000000..d646aae6--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_questions_with_options.json@@ -0,0 +1,45 @@+{+ "name": "batch_empty_questions_with_options",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ }+ ],+ "questions": {},+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ }+ ],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_states.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_states.jsonnew file mode 100644index 00000000..eabd6424--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_states.json@@ -0,0 +1,32 @@+{+ "name": "batch_empty_states",+ "states": [],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_states_invalid_questions.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_states_invalid_questions.jsonnew file mode 100644index 00000000..d8c82752--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_empty_states_invalid_questions.json@@ -0,0 +1,316 @@+{+ "name": "batch_empty_states_invalid_questions",+ "states": [],+ "questions": {+ "too_wide": {+ "type": "choice",+ "instructions": "Too many options to fit the sequence.",+ "criteria": {+ "opt_000": "description 0",+ "opt_001": "description 1",+ "opt_002": "description 2",+ "opt_003": "description 3",+ "opt_004": "description 4",+ "opt_005": "description 5",+ "opt_006": "description 6",+ "opt_007": "description 7",+ "opt_008": "description 8",+ "opt_009": "description 9",+ "opt_010": "description 10",+ "opt_011": "description 11",+ "opt_012": "description 12",+ "opt_013": "description 13",+ "opt_014": "description 14",+ "opt_015": "description 15",+ "opt_016": "description 16",+ "opt_017": "description 17",+ "opt_018": "description 18",+ "opt_019": "description 19",+ "opt_020": "description 20",+ "opt_021": "description 21",+ "opt_022": "description 22",+ "opt_023": "description 23",+ "opt_024": "description 24",+ "opt_025": "description 25",+ "opt_026": "description 26",+ "opt_027": "description 27",+ "opt_028": "description 28",+ "opt_029": "description 29",+ "opt_030": "description 30",+ "opt_031": "description 31",+ "opt_032": "description 32",+ "opt_033": "description 33",+ "opt_034": "description 34",+ "opt_035": "description 35",+ "opt_036": "description 36",+ "opt_037": "description 37",+ "opt_038": "description 38",+ "opt_039": "description 39",+ "opt_040": "description 40",+ "opt_041": "description 41",+ "opt_042": "description 42",+ "opt_043": "description 43",+ "opt_044": "description 44",+ "opt_045": "description 45",+ "opt_046": "description 46",+ "opt_047": "description 47",+ "opt_048": "description 48",+ "opt_049": "description 49",+ "opt_050": "description 50",+ "opt_051": "description 51",+ "opt_052": "description 52",+ "opt_053": "description 53",+ "opt_054": "description 54",+ "opt_055": "description 55",+ "opt_056": "description 56",+ "opt_057": "description 57",+ "opt_058": "description 58",+ "opt_059": "description 59",+ "opt_060": "description 60",+ "opt_061": "description 61",+ "opt_062": "description 62",+ "opt_063": "description 63",+ "opt_064": "description 64",+ "opt_065": "description 65",+ "opt_066": "description 66",+ "opt_067": "description 67",+ "opt_068": "description 68",+ "opt_069": "description 69",+ "opt_070": "description 70",+ "opt_071": "description 71",+ "opt_072": "description 72",+ "opt_073": "description 73",+ "opt_074": "description 74",+ "opt_075": "description 75",+ "opt_076": "description 76",+ "opt_077": "description 77",+ "opt_078": "description 78",+ "opt_079": "description 79",+ "opt_080": "description 80",+ "opt_081": "description 81",+ "opt_082": "description 82",+ "opt_083": "description 83",+ "opt_084": "description 84",+ "opt_085": "description 85",+ "opt_086": "description 86",+ "opt_087": "description 87",+ "opt_088": "description 88",+ "opt_089": "description 89",+ "opt_090": "description 90",+ "opt_091": "description 91",+ "opt_092": "description 92",+ "opt_093": "description 93",+ "opt_094": "description 94",+ "opt_095": "description 95",+ "opt_096": "description 96",+ "opt_097": "description 97",+ "opt_098": "description 98",+ "opt_099": "description 99",+ "opt_100": "description 100",+ "opt_101": "description 101",+ "opt_102": "description 102",+ "opt_103": "description 103",+ "opt_104": "description 104",+ "opt_105": "description 105",+ "opt_106": "description 106",+ "opt_107": "description 107",+ "opt_108": "description 108",+ "opt_109": "description 109",+ "opt_110": "description 110",+ "opt_111": "description 111",+ "opt_112": "description 112",+ "opt_113": "description 113",+ "opt_114": "description 114",+ "opt_115": "description 115",+ "opt_116": "description 116",+ "opt_117": "description 117",+ "opt_118": "description 118",+ "opt_119": "description 119",+ "opt_120": "description 120",+ "opt_121": "description 121",+ "opt_122": "description 122",+ "opt_123": "description 123",+ "opt_124": "description 124",+ "opt_125": "description 125",+ "opt_126": "description 126",+ "opt_127": "description 127",+ "opt_128": "description 128",+ "opt_129": "description 129",+ "opt_130": "description 130",+ "opt_131": "description 131",+ "opt_132": "description 132",+ "opt_133": "description 133",+ "opt_134": "description 134",+ "opt_135": "description 135",+ "opt_136": "description 136",+ "opt_137": "description 137",+ "opt_138": "description 138",+ "opt_139": "description 139",+ "opt_140": "description 140",+ "opt_141": "description 141",+ "opt_142": "description 142",+ "opt_143": "description 143",+ "opt_144": "description 144",+ "opt_145": "description 145",+ "opt_146": "description 146",+ "opt_147": "description 147",+ "opt_148": "description 148",+ "opt_149": "description 149",+ "opt_150": "description 150",+ "opt_151": "description 151",+ "opt_152": "description 152",+ "opt_153": "description 153",+ "opt_154": "description 154",+ "opt_155": "description 155",+ "opt_156": "description 156",+ "opt_157": "description 157",+ "opt_158": "description 158",+ "opt_159": "description 159",+ "opt_160": "description 160",+ "opt_161": "description 161",+ "opt_162": "description 162",+ "opt_163": "description 163",+ "opt_164": "description 164",+ "opt_165": "description 165",+ "opt_166": "description 166",+ "opt_167": "description 167",+ "opt_168": "description 168",+ "opt_169": "description 169",+ "opt_170": "description 170",+ "opt_171": "description 171",+ "opt_172": "description 172",+ "opt_173": "description 173",+ "opt_174": "description 174",+ "opt_175": "description 175",+ "opt_176": "description 176",+ "opt_177": "description 177",+ "opt_178": "description 178",+ "opt_179": "description 179",+ "opt_180": "description 180",+ "opt_181": "description 181",+ "opt_182": "description 182",+ "opt_183": "description 183",+ "opt_184": "description 184",+ "opt_185": "description 185",+ "opt_186": "description 186",+ "opt_187": "description 187",+ "opt_188": "description 188",+ "opt_189": "description 189",+ "opt_190": "description 190",+ "opt_191": "description 191",+ "opt_192": "description 192",+ "opt_193": "description 193",+ "opt_194": "description 194",+ "opt_195": "description 195",+ "opt_196": "description 196",+ "opt_197": "description 197",+ "opt_198": "description 198",+ "opt_199": "description 199",+ "opt_200": "description 200",+ "opt_201": "description 201",+ "opt_202": "description 202",+ "opt_203": "description 203",+ "opt_204": "description 204",+ "opt_205": "description 205",+ "opt_206": "description 206",+ "opt_207": "description 207",+ "opt_208": "description 208",+ "opt_209": "description 209",+ "opt_210": "description 210",+ "opt_211": "description 211",+ "opt_212": "description 212",+ "opt_213": "description 213",+ "opt_214": "description 214",+ "opt_215": "description 215",+ "opt_216": "description 216",+ "opt_217": "description 217",+ "opt_218": "description 218",+ "opt_219": "description 219",+ "opt_220": "description 220",+ "opt_221": "description 221",+ "opt_222": "description 222",+ "opt_223": "description 223",+ "opt_224": "description 224",+ "opt_225": "description 225",+ "opt_226": "description 226",+ "opt_227": "description 227",+ "opt_228": "description 228",+ "opt_229": "description 229",+ "opt_230": "description 230",+ "opt_231": "description 231",+ "opt_232": "description 232",+ "opt_233": "description 233",+ "opt_234": "description 234",+ "opt_235": "description 235",+ "opt_236": "description 236",+ "opt_237": "description 237",+ "opt_238": "description 238",+ "opt_239": "description 239",+ "opt_240": "description 240",+ "opt_241": "description 241",+ "opt_242": "description 242",+ "opt_243": "description 243",+ "opt_244": "description 244",+ "opt_245": "description 245",+ "opt_246": "description 246",+ "opt_247": "description 247",+ "opt_248": "description 248",+ "opt_249": "description 249",+ "opt_250": "description 250",+ "opt_251": "description 251",+ "opt_252": "description 252",+ "opt_253": "description 253",+ "opt_254": "description 254",+ "opt_255": "description 255",+ "opt_256": "description 256",+ "opt_257": "description 257",+ "opt_258": "description 258",+ "opt_259": "description 259",+ "opt_260": "description 260",+ "opt_261": "description 261",+ "opt_262": "description 262",+ "opt_263": "description 263",+ "opt_264": "description 264",+ "opt_265": "description 265",+ "opt_266": "description 266",+ "opt_267": "description 267",+ "opt_268": "description 268",+ "opt_269": "description 269",+ "opt_270": "description 270",+ "opt_271": "description 271",+ "opt_272": "description 272",+ "opt_273": "description 273",+ "opt_274": "description 274",+ "opt_275": "description 275",+ "opt_276": "description 276",+ "opt_277": "description 277",+ "opt_278": "description 278",+ "opt_279": "description 279",+ "opt_280": "description 280",+ "opt_281": "description 281",+ "opt_282": "description 282",+ "opt_283": "description 283",+ "opt_284": "description 284",+ "opt_285": "description 285",+ "opt_286": "description 286",+ "opt_287": "description 287",+ "opt_288": "description 288",+ "opt_289": "description 289",+ "opt_290": "description 290",+ "opt_291": "description 291",+ "opt_292": "description 292",+ "opt_293": "description 293",+ "opt_294": "description 294",+ "opt_295": "description 295",+ "opt_296": "description 296",+ "opt_297": "description 297",+ "opt_298": "description 298",+ "opt_299": "description 299"+ }+ }+ },+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_mixed.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_mixed.jsonnew file mode 100644index 00000000..bfe56925--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_mixed.json@@ -0,0 +1,515 @@+{+ "name": "batch_mixed",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 90,+ 113,+ 143,+ 34,+ 150,+ 42,+ 90,+ 48+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6527,+ "technical": 0.0268,+ "other": 0.3205+ },+ "confidence": 0.3264,+ "answer_confidence": 0.6527,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4526,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0142,+ "1": 0.519,+ "2": 0.4668+ },+ "confidence": 0.3115,+ "answer_confidence": 0.519,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3678,+ "confidence": 0.6322,+ "answer_confidence": 0.6322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 333,+ "output_tokens": 0,+ "state_tokens": 79,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2035,+ "technical": 0.1274,+ "other": 0.6691+ },+ "confidence": 0.2215,+ "answer_confidence": 0.6691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3642,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0252,+ "1": 0.5854,+ "2": 0.3894+ },+ "confidence": 0.2959,+ "answer_confidence": 0.5854,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0571,+ "confidence": 0.9429,+ "answer_confidence": 0.9429,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 423,+ "output_tokens": 0,+ "state_tokens": 109,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.806,+ "technical": 0.1113,+ "other": 0.0827+ },+ "confidence": 0.4317,+ "answer_confidence": 0.806,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1501,+ "1": 0.5664,+ "2": 0.2835+ },+ "confidence": 0.1225,+ "answer_confidence": 0.5664,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0063,+ "confidence": 0.9937,+ "answer_confidence": 0.9937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 96,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.0595,+ "technical": 0.0895,+ "other": 0.851+ },+ "confidence": 0.5256,+ "answer_confidence": 0.851,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3418,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1574,+ "1": 0.3433,+ "2": 0.4993+ },+ "confidence": 0.0853,+ "answer_confidence": 0.4993,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0056,+ "confidence": 0.9944,+ "answer_confidence": 0.9944,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.468,+ "technical": 0.301,+ "other": 0.231+ },+ "confidence": 0.0395,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8737,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0305,+ "1": 0.0652,+ "2": 0.9042+ },+ "confidence": 0.6581,+ "answer_confidence": 0.9042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4844,+ "confidence": 0.5156,+ "answer_confidence": 0.5156,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9822,+ "technical": 0.0057,+ "other": 0.012+ },+ "confidence": 0.9086,+ "answer_confidence": 0.9822,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7021,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0303,+ "1": 0.2373,+ "2": 0.7324+ },+ "confidence": 0.3852,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1059,+ "confidence": 0.8941,+ "answer_confidence": 0.8941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 138,+ "output_tokens": 0,+ "state_tokens": 14,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 150+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_none_state.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_none_state.jsonnew file mode 100644index 00000000..560be81a--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_none_state.json@@ -0,0 +1,34 @@+{+ "name": "batch_none_state",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ null+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "error_type": "TypeError",+ "error_message": "state must not be None; pass a string, dict, or list"+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_one_state.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_one_state.jsonnew file mode 100644index 00000000..c000e321--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_one_state.json@@ -0,0 +1,97 @@+{+ "name": "batch_one_state",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 90+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 90+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_options_exceed_head.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_options_exceed_head.jsonnew file mode 100644index 00000000..1c4ae386--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_options_exceed_head.json@@ -0,0 +1,318 @@+{+ "name": "batch_options_exceed_head",+ "states": [+ "short",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "too_wide": {+ "type": "choice",+ "instructions": "Too many options to fit the sequence.",+ "criteria": {+ "opt_000": "description 0",+ "opt_001": "description 1",+ "opt_002": "description 2",+ "opt_003": "description 3",+ "opt_004": "description 4",+ "opt_005": "description 5",+ "opt_006": "description 6",+ "opt_007": "description 7",+ "opt_008": "description 8",+ "opt_009": "description 9",+ "opt_010": "description 10",+ "opt_011": "description 11",+ "opt_012": "description 12",+ "opt_013": "description 13",+ "opt_014": "description 14",+ "opt_015": "description 15",+ "opt_016": "description 16",+ "opt_017": "description 17",+ "opt_018": "description 18",+ "opt_019": "description 19",+ "opt_020": "description 20",+ "opt_021": "description 21",+ "opt_022": "description 22",+ "opt_023": "description 23",+ "opt_024": "description 24",+ "opt_025": "description 25",+ "opt_026": "description 26",+ "opt_027": "description 27",+ "opt_028": "description 28",+ "opt_029": "description 29",+ "opt_030": "description 30",+ "opt_031": "description 31",+ "opt_032": "description 32",+ "opt_033": "description 33",+ "opt_034": "description 34",+ "opt_035": "description 35",+ "opt_036": "description 36",+ "opt_037": "description 37",+ "opt_038": "description 38",+ "opt_039": "description 39",+ "opt_040": "description 40",+ "opt_041": "description 41",+ "opt_042": "description 42",+ "opt_043": "description 43",+ "opt_044": "description 44",+ "opt_045": "description 45",+ "opt_046": "description 46",+ "opt_047": "description 47",+ "opt_048": "description 48",+ "opt_049": "description 49",+ "opt_050": "description 50",+ "opt_051": "description 51",+ "opt_052": "description 52",+ "opt_053": "description 53",+ "opt_054": "description 54",+ "opt_055": "description 55",+ "opt_056": "description 56",+ "opt_057": "description 57",+ "opt_058": "description 58",+ "opt_059": "description 59",+ "opt_060": "description 60",+ "opt_061": "description 61",+ "opt_062": "description 62",+ "opt_063": "description 63",+ "opt_064": "description 64",+ "opt_065": "description 65",+ "opt_066": "description 66",+ "opt_067": "description 67",+ "opt_068": "description 68",+ "opt_069": "description 69",+ "opt_070": "description 70",+ "opt_071": "description 71",+ "opt_072": "description 72",+ "opt_073": "description 73",+ "opt_074": "description 74",+ "opt_075": "description 75",+ "opt_076": "description 76",+ "opt_077": "description 77",+ "opt_078": "description 78",+ "opt_079": "description 79",+ "opt_080": "description 80",+ "opt_081": "description 81",+ "opt_082": "description 82",+ "opt_083": "description 83",+ "opt_084": "description 84",+ "opt_085": "description 85",+ "opt_086": "description 86",+ "opt_087": "description 87",+ "opt_088": "description 88",+ "opt_089": "description 89",+ "opt_090": "description 90",+ "opt_091": "description 91",+ "opt_092": "description 92",+ "opt_093": "description 93",+ "opt_094": "description 94",+ "opt_095": "description 95",+ "opt_096": "description 96",+ "opt_097": "description 97",+ "opt_098": "description 98",+ "opt_099": "description 99",+ "opt_100": "description 100",+ "opt_101": "description 101",+ "opt_102": "description 102",+ "opt_103": "description 103",+ "opt_104": "description 104",+ "opt_105": "description 105",+ "opt_106": "description 106",+ "opt_107": "description 107",+ "opt_108": "description 108",+ "opt_109": "description 109",+ "opt_110": "description 110",+ "opt_111": "description 111",+ "opt_112": "description 112",+ "opt_113": "description 113",+ "opt_114": "description 114",+ "opt_115": "description 115",+ "opt_116": "description 116",+ "opt_117": "description 117",+ "opt_118": "description 118",+ "opt_119": "description 119",+ "opt_120": "description 120",+ "opt_121": "description 121",+ "opt_122": "description 122",+ "opt_123": "description 123",+ "opt_124": "description 124",+ "opt_125": "description 125",+ "opt_126": "description 126",+ "opt_127": "description 127",+ "opt_128": "description 128",+ "opt_129": "description 129",+ "opt_130": "description 130",+ "opt_131": "description 131",+ "opt_132": "description 132",+ "opt_133": "description 133",+ "opt_134": "description 134",+ "opt_135": "description 135",+ "opt_136": "description 136",+ "opt_137": "description 137",+ "opt_138": "description 138",+ "opt_139": "description 139",+ "opt_140": "description 140",+ "opt_141": "description 141",+ "opt_142": "description 142",+ "opt_143": "description 143",+ "opt_144": "description 144",+ "opt_145": "description 145",+ "opt_146": "description 146",+ "opt_147": "description 147",+ "opt_148": "description 148",+ "opt_149": "description 149",+ "opt_150": "description 150",+ "opt_151": "description 151",+ "opt_152": "description 152",+ "opt_153": "description 153",+ "opt_154": "description 154",+ "opt_155": "description 155",+ "opt_156": "description 156",+ "opt_157": "description 157",+ "opt_158": "description 158",+ "opt_159": "description 159",+ "opt_160": "description 160",+ "opt_161": "description 161",+ "opt_162": "description 162",+ "opt_163": "description 163",+ "opt_164": "description 164",+ "opt_165": "description 165",+ "opt_166": "description 166",+ "opt_167": "description 167",+ "opt_168": "description 168",+ "opt_169": "description 169",+ "opt_170": "description 170",+ "opt_171": "description 171",+ "opt_172": "description 172",+ "opt_173": "description 173",+ "opt_174": "description 174",+ "opt_175": "description 175",+ "opt_176": "description 176",+ "opt_177": "description 177",+ "opt_178": "description 178",+ "opt_179": "description 179",+ "opt_180": "description 180",+ "opt_181": "description 181",+ "opt_182": "description 182",+ "opt_183": "description 183",+ "opt_184": "description 184",+ "opt_185": "description 185",+ "opt_186": "description 186",+ "opt_187": "description 187",+ "opt_188": "description 188",+ "opt_189": "description 189",+ "opt_190": "description 190",+ "opt_191": "description 191",+ "opt_192": "description 192",+ "opt_193": "description 193",+ "opt_194": "description 194",+ "opt_195": "description 195",+ "opt_196": "description 196",+ "opt_197": "description 197",+ "opt_198": "description 198",+ "opt_199": "description 199",+ "opt_200": "description 200",+ "opt_201": "description 201",+ "opt_202": "description 202",+ "opt_203": "description 203",+ "opt_204": "description 204",+ "opt_205": "description 205",+ "opt_206": "description 206",+ "opt_207": "description 207",+ "opt_208": "description 208",+ "opt_209": "description 209",+ "opt_210": "description 210",+ "opt_211": "description 211",+ "opt_212": "description 212",+ "opt_213": "description 213",+ "opt_214": "description 214",+ "opt_215": "description 215",+ "opt_216": "description 216",+ "opt_217": "description 217",+ "opt_218": "description 218",+ "opt_219": "description 219",+ "opt_220": "description 220",+ "opt_221": "description 221",+ "opt_222": "description 222",+ "opt_223": "description 223",+ "opt_224": "description 224",+ "opt_225": "description 225",+ "opt_226": "description 226",+ "opt_227": "description 227",+ "opt_228": "description 228",+ "opt_229": "description 229",+ "opt_230": "description 230",+ "opt_231": "description 231",+ "opt_232": "description 232",+ "opt_233": "description 233",+ "opt_234": "description 234",+ "opt_235": "description 235",+ "opt_236": "description 236",+ "opt_237": "description 237",+ "opt_238": "description 238",+ "opt_239": "description 239",+ "opt_240": "description 240",+ "opt_241": "description 241",+ "opt_242": "description 242",+ "opt_243": "description 243",+ "opt_244": "description 244",+ "opt_245": "description 245",+ "opt_246": "description 246",+ "opt_247": "description 247",+ "opt_248": "description 248",+ "opt_249": "description 249",+ "opt_250": "description 250",+ "opt_251": "description 251",+ "opt_252": "description 252",+ "opt_253": "description 253",+ "opt_254": "description 254",+ "opt_255": "description 255",+ "opt_256": "description 256",+ "opt_257": "description 257",+ "opt_258": "description 258",+ "opt_259": "description 259",+ "opt_260": "description 260",+ "opt_261": "description 261",+ "opt_262": "description 262",+ "opt_263": "description 263",+ "opt_264": "description 264",+ "opt_265": "description 265",+ "opt_266": "description 266",+ "opt_267": "description 267",+ "opt_268": "description 268",+ "opt_269": "description 269",+ "opt_270": "description 270",+ "opt_271": "description 271",+ "opt_272": "description 272",+ "opt_273": "description 273",+ "opt_274": "description 274",+ "opt_275": "description 275",+ "opt_276": "description 276",+ "opt_277": "description 277",+ "opt_278": "description 278",+ "opt_279": "description 279",+ "opt_280": "description 280",+ "opt_281": "description 281",+ "opt_282": "description 282",+ "opt_283": "description 283",+ "opt_284": "description 284",+ "opt_285": "description 285",+ "opt_286": "description 286",+ "opt_287": "description 287",+ "opt_288": "description 288",+ "opt_289": "description 289",+ "opt_290": "description 290",+ "opt_291": "description 291",+ "opt_292": "description 292",+ "opt_293": "description 293",+ "opt_294": "description 294",+ "opt_295": "description 295",+ "opt_296": "description 296",+ "opt_297": "description 297",+ "opt_298": "description 298",+ "opt_299": "description 299"+ }+ }+ },+ "options": {},+ "error_type": "ValueError",+ "error_message": "question 'too_wide': only 254 of its 300 option markers fit in max_len=1024 with head_max_len=256 spent on the question; lower head_max_len, raise max_len, or use fewer options"+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_single_question.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_single_question.jsonnew file mode 100644index 00000000..f5a311b6--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_single_question.json@@ -0,0 +1,137 @@+{+ "name": "batch_single_question",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ]+ ],+ "questions": {+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 90,+ 44,+ 147,+ 73+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 90,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.0067,+ "confidence": 0.9933,+ "answer_confidence": 0.9933,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 44,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.1873,+ "confidence": 0.8127,+ "answer_confidence": 0.8127,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 147,+ "output_tokens": 0,+ "state_tokens": 113,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.0166,+ "confidence": 0.9834,+ "answer_confidence": 0.9834,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 73,+ "output_tokens": 0,+ "state_tokens": 39,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 2,+ 90+ ],+ [+ 2,+ 147+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_1.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_1.jsonnew file mode 100644index 00000000..be4424ea--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_1.json@@ -0,0 +1,545 @@+{+ "name": "batch_size_1",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 1+ },+ "state_widths": [+ 90,+ 113,+ 143,+ 34,+ 150,+ 42,+ 90,+ 48+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6527,+ "technical": 0.0268,+ "other": 0.3205+ },+ "confidence": 0.3264,+ "answer_confidence": 0.6527,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4526,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0142,+ "1": 0.519,+ "2": 0.4668+ },+ "confidence": 0.3115,+ "answer_confidence": 0.519,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3678,+ "confidence": 0.6322,+ "answer_confidence": 0.6322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 333,+ "output_tokens": 0,+ "state_tokens": 79,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2035,+ "technical": 0.1274,+ "other": 0.6691+ },+ "confidence": 0.2215,+ "answer_confidence": 0.6691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3642,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0252,+ "1": 0.5854,+ "2": 0.3894+ },+ "confidence": 0.2959,+ "answer_confidence": 0.5854,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0571,+ "confidence": 0.9429,+ "answer_confidence": 0.9429,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 423,+ "output_tokens": 0,+ "state_tokens": 109,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.806,+ "technical": 0.1113,+ "other": 0.0827+ },+ "confidence": 0.4317,+ "answer_confidence": 0.806,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1501,+ "1": 0.5664,+ "2": 0.2835+ },+ "confidence": 0.1225,+ "answer_confidence": 0.5664,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0063,+ "confidence": 0.9937,+ "answer_confidence": 0.9937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 96,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.0595,+ "technical": 0.0895,+ "other": 0.851+ },+ "confidence": 0.5256,+ "answer_confidence": 0.851,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3418,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1574,+ "1": 0.3433,+ "2": 0.4993+ },+ "confidence": 0.0853,+ "answer_confidence": 0.4993,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0056,+ "confidence": 0.9944,+ "answer_confidence": 0.9944,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.468,+ "technical": 0.301,+ "other": 0.231+ },+ "confidence": 0.0395,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8737,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0305,+ "1": 0.0652,+ "2": 0.9042+ },+ "confidence": 0.6581,+ "answer_confidence": 0.9042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4844,+ "confidence": 0.5156,+ "answer_confidence": 0.5156,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9822,+ "technical": 0.0057,+ "other": 0.012+ },+ "confidence": 0.9086,+ "answer_confidence": 0.9822,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7021,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0303,+ "1": 0.2373,+ "2": 0.7324+ },+ "confidence": 0.3852,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1059,+ "confidence": 0.8941,+ "answer_confidence": 0.8941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 138,+ "output_tokens": 0,+ "state_tokens": 14,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 90+ ],+ [+ 3,+ 113+ ],+ [+ 3,+ 143+ ],+ [+ 3,+ 34+ ],+ [+ 3,+ 150+ ],+ [+ 3,+ 42+ ],+ [+ 3,+ 90+ ],+ [+ 3,+ 48+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_3.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_3.jsonnew file mode 100644index 00000000..c80284fa--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_3.json@@ -0,0 +1,525 @@+{+ "name": "batch_size_3",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3+ },+ "state_widths": [+ 90,+ 113,+ 143,+ 34,+ 150,+ 42,+ 90,+ 48+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6527,+ "technical": 0.0268,+ "other": 0.3205+ },+ "confidence": 0.3264,+ "answer_confidence": 0.6527,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4526,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0142,+ "1": 0.519,+ "2": 0.4668+ },+ "confidence": 0.3115,+ "answer_confidence": 0.519,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3678,+ "confidence": 0.6322,+ "answer_confidence": 0.6322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 333,+ "output_tokens": 0,+ "state_tokens": 79,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2035,+ "technical": 0.1274,+ "other": 0.6691+ },+ "confidence": 0.2215,+ "answer_confidence": 0.6691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3642,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0252,+ "1": 0.5854,+ "2": 0.3894+ },+ "confidence": 0.2959,+ "answer_confidence": 0.5854,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0571,+ "confidence": 0.9429,+ "answer_confidence": 0.9429,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 423,+ "output_tokens": 0,+ "state_tokens": 109,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.806,+ "technical": 0.1113,+ "other": 0.0827+ },+ "confidence": 0.4317,+ "answer_confidence": 0.806,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1501,+ "1": 0.5664,+ "2": 0.2835+ },+ "confidence": 0.1225,+ "answer_confidence": 0.5664,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0063,+ "confidence": 0.9937,+ "answer_confidence": 0.9937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 96,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.0595,+ "technical": 0.0895,+ "other": 0.851+ },+ "confidence": 0.5256,+ "answer_confidence": 0.851,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3418,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1574,+ "1": 0.3433,+ "2": 0.4993+ },+ "confidence": 0.0853,+ "answer_confidence": 0.4993,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0056,+ "confidence": 0.9944,+ "answer_confidence": 0.9944,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.468,+ "technical": 0.301,+ "other": 0.231+ },+ "confidence": 0.0395,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8737,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0305,+ "1": 0.0652,+ "2": 0.9042+ },+ "confidence": 0.6581,+ "answer_confidence": 0.9042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4844,+ "confidence": 0.5156,+ "answer_confidence": 0.5156,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9822,+ "technical": 0.0057,+ "other": 0.012+ },+ "confidence": 0.9086,+ "answer_confidence": 0.9822,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7021,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0303,+ "1": 0.2373,+ "2": 0.7324+ },+ "confidence": 0.3852,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1059,+ "confidence": 0.8941,+ "answer_confidence": 0.8941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 138,+ "output_tokens": 0,+ "state_tokens": 14,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 143+ ],+ [+ 9,+ 150+ ],+ [+ 6,+ 90+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_negative.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_negative.jsonnew file mode 100644index 00000000..8e676dd2--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_negative.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_negative",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": -2+ },+ "state_widths": [+ 90,+ 113,+ 143,+ 34,+ 150,+ 42,+ 90,+ 48+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6527,+ "technical": 0.0268,+ "other": 0.3205+ },+ "confidence": 0.3264,+ "answer_confidence": 0.6527,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4526,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0142,+ "1": 0.519,+ "2": 0.4668+ },+ "confidence": 0.3115,+ "answer_confidence": 0.519,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3678,+ "confidence": 0.6322,+ "answer_confidence": 0.6322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 333,+ "output_tokens": 0,+ "state_tokens": 79,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2035,+ "technical": 0.1274,+ "other": 0.6691+ },+ "confidence": 0.2215,+ "answer_confidence": 0.6691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3642,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0252,+ "1": 0.5854,+ "2": 0.3894+ },+ "confidence": 0.2959,+ "answer_confidence": 0.5854,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0571,+ "confidence": 0.9429,+ "answer_confidence": 0.9429,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 423,+ "output_tokens": 0,+ "state_tokens": 109,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.806,+ "technical": 0.1113,+ "other": 0.0827+ },+ "confidence": 0.4317,+ "answer_confidence": 0.806,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1501,+ "1": 0.5664,+ "2": 0.2835+ },+ "confidence": 0.1225,+ "answer_confidence": 0.5664,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0063,+ "confidence": 0.9937,+ "answer_confidence": 0.9937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 96,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.0595,+ "technical": 0.0895,+ "other": 0.851+ },+ "confidence": 0.5256,+ "answer_confidence": 0.851,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3418,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1574,+ "1": 0.3433,+ "2": 0.4993+ },+ "confidence": 0.0853,+ "answer_confidence": 0.4993,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0056,+ "confidence": 0.9944,+ "answer_confidence": 0.9944,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.468,+ "technical": 0.301,+ "other": 0.231+ },+ "confidence": 0.0395,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8737,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0305,+ "1": 0.0652,+ "2": 0.9042+ },+ "confidence": 0.6581,+ "answer_confidence": 0.9042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4844,+ "confidence": 0.5156,+ "answer_confidence": 0.5156,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9822,+ "technical": 0.0057,+ "other": 0.012+ },+ "confidence": 0.9086,+ "answer_confidence": 0.9822,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7021,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0303,+ "1": 0.2373,+ "2": 0.7324+ },+ "confidence": 0.3852,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1059,+ "confidence": 0.8941,+ "answer_confidence": 0.8941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 138,+ "output_tokens": 0,+ "state_tokens": 14,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 150+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_over_len.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_over_len.jsonnew file mode 100644index 00000000..fbcc6dec--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_over_len.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_over_len",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 100+ },+ "state_widths": [+ 90,+ 113,+ 143,+ 34,+ 150,+ 42,+ 90,+ 48+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6527,+ "technical": 0.0268,+ "other": 0.3205+ },+ "confidence": 0.3264,+ "answer_confidence": 0.6527,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4526,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0142,+ "1": 0.519,+ "2": 0.4668+ },+ "confidence": 0.3115,+ "answer_confidence": 0.519,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3678,+ "confidence": 0.6322,+ "answer_confidence": 0.6322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 333,+ "output_tokens": 0,+ "state_tokens": 79,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2035,+ "technical": 0.1274,+ "other": 0.6691+ },+ "confidence": 0.2215,+ "answer_confidence": 0.6691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3642,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0252,+ "1": 0.5854,+ "2": 0.3894+ },+ "confidence": 0.2959,+ "answer_confidence": 0.5854,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0571,+ "confidence": 0.9429,+ "answer_confidence": 0.9429,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 423,+ "output_tokens": 0,+ "state_tokens": 109,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.806,+ "technical": 0.1113,+ "other": 0.0827+ },+ "confidence": 0.4317,+ "answer_confidence": 0.806,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1501,+ "1": 0.5664,+ "2": 0.2835+ },+ "confidence": 0.1225,+ "answer_confidence": 0.5664,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0063,+ "confidence": 0.9937,+ "answer_confidence": 0.9937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 96,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.0595,+ "technical": 0.0895,+ "other": 0.851+ },+ "confidence": 0.5256,+ "answer_confidence": 0.851,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3418,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1574,+ "1": 0.3433,+ "2": 0.4993+ },+ "confidence": 0.0853,+ "answer_confidence": 0.4993,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0056,+ "confidence": 0.9944,+ "answer_confidence": 0.9944,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.468,+ "technical": 0.301,+ "other": 0.231+ },+ "confidence": 0.0395,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8737,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0305,+ "1": 0.0652,+ "2": 0.9042+ },+ "confidence": 0.6581,+ "answer_confidence": 0.9042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4844,+ "confidence": 0.5156,+ "answer_confidence": 0.5156,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9822,+ "technical": 0.0057,+ "other": 0.012+ },+ "confidence": 0.9086,+ "answer_confidence": 0.9822,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7021,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0303,+ "1": 0.2373,+ "2": 0.7324+ },+ "confidence": 0.3852,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1059,+ "confidence": 0.8941,+ "answer_confidence": 0.8941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 138,+ "output_tokens": 0,+ "state_tokens": 14,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 150+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_zero.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_zero.jsonnew file mode 100644index 00000000..40fcd782--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_size_zero.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_zero",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 0+ },+ "state_widths": [+ 90,+ 113,+ 143,+ 34,+ 150,+ 42,+ 90,+ 48+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6527,+ "technical": 0.0268,+ "other": 0.3205+ },+ "confidence": 0.3264,+ "answer_confidence": 0.6527,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4526,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0142,+ "1": 0.519,+ "2": 0.4668+ },+ "confidence": 0.3115,+ "answer_confidence": 0.519,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3678,+ "confidence": 0.6322,+ "answer_confidence": 0.6322,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 333,+ "output_tokens": 0,+ "state_tokens": 79,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2035,+ "technical": 0.1274,+ "other": 0.6691+ },+ "confidence": 0.2215,+ "answer_confidence": 0.6691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3642,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0252,+ "1": 0.5854,+ "2": 0.3894+ },+ "confidence": 0.2959,+ "answer_confidence": 0.5854,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0571,+ "confidence": 0.9429,+ "answer_confidence": 0.9429,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 423,+ "output_tokens": 0,+ "state_tokens": 109,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.806,+ "technical": 0.1113,+ "other": 0.0827+ },+ "confidence": 0.4317,+ "answer_confidence": 0.806,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1501,+ "1": 0.5664,+ "2": 0.2835+ },+ "confidence": 0.1225,+ "answer_confidence": 0.5664,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0063,+ "confidence": 0.9937,+ "answer_confidence": 0.9937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 96,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.0595,+ "technical": 0.0895,+ "other": 0.851+ },+ "confidence": 0.5256,+ "answer_confidence": 0.851,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3418,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1574,+ "1": 0.3433,+ "2": 0.4993+ },+ "confidence": 0.0853,+ "answer_confidence": 0.4993,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0056,+ "confidence": 0.9944,+ "answer_confidence": 0.9944,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.468,+ "technical": 0.301,+ "other": 0.231+ },+ "confidence": 0.0395,+ "answer_confidence": 0.468,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8737,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0305,+ "1": 0.0652,+ "2": 0.9042+ },+ "confidence": 0.6581,+ "answer_confidence": 0.9042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.4844,+ "confidence": 0.5156,+ "answer_confidence": 0.5156,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9822,+ "technical": 0.0057,+ "other": 0.012+ },+ "confidence": 0.9086,+ "answer_confidence": 0.9822,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7021,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0303,+ "1": 0.2373,+ "2": 0.7324+ },+ "confidence": 0.3852,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1059,+ "confidence": 0.8941,+ "answer_confidence": 0.8941,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 138,+ "output_tokens": 0,+ "state_tokens": 14,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 150+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_no_batch_size.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_no_batch_size.jsonnew file mode 100644index 00000000..e684e273--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_no_batch_size.json@@ -0,0 +1,1182 @@+{+ "name": "batch_sort_no_batch_size",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 185+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_off.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_off.jsonnew file mode 100644index 00000000..75e26b91--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_off.json@@ -0,0 +1,1218 @@+{+ "name": "batch_sort_off",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 180+ ],+ [+ 6,+ 135+ ],+ [+ 6,+ 160+ ],+ [+ 6,+ 145+ ],+ [+ 6,+ 170+ ],+ [+ 6,+ 150+ ],+ [+ 6,+ 185+ ],+ [+ 6,+ 155+ ],+ [+ 6,+ 175+ ],+ [+ 6,+ 165+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_on.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_on.jsonnew file mode 100644index 00000000..bfac7e57--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_on.json@@ -0,0 +1,1219 @@+{+ "name": "batch_sort_on",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 95+ ],+ [+ 6,+ 105+ ],+ [+ 6,+ 115+ ],+ [+ 6,+ 130+ ],+ [+ 6,+ 145+ ],+ [+ 6,+ 155+ ],+ [+ 6,+ 170+ ],+ [+ 6,+ 185+ ],+ [+ 6,+ 140+ ],+ [+ 6,+ 175+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_partial_window.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_partial_window.jsonnew file mode 100644index 00000000..de1cbb8f--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_partial_window.json@@ -0,0 +1,218 @@+{+ "name": "batch_sort_partial_window",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 135+ ],+ [+ 3,+ 180+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_1.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_1.jsonnew file mode 100644index 00000000..6e5b15b5--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_1.json@@ -0,0 +1,1259 @@+{+ "name": "batch_sort_size_1",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 1,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 180+ ],+ [+ 3,+ 100+ ],+ [+ 3,+ 135+ ],+ [+ 3,+ 90+ ],+ [+ 3,+ 160+ ],+ [+ 3,+ 115+ ],+ [+ 3,+ 145+ ],+ [+ 3,+ 95+ ],+ [+ 3,+ 170+ ],+ [+ 3,+ 125+ ],+ [+ 3,+ 105+ ],+ [+ 3,+ 150+ ],+ [+ 3,+ 185+ ],+ [+ 3,+ 110+ ],+ [+ 3,+ 130+ ],+ [+ 3,+ 155+ ],+ [+ 3,+ 120+ ],+ [+ 3,+ 175+ ],+ [+ 3,+ 140+ ],+ [+ 3,+ 165+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_3.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_3.jsonnew file mode 100644index 00000000..dd48171b--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_3.json@@ -0,0 +1,1207 @@+{+ "name": "batch_sort_size_3",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 100+ ],+ [+ 9,+ 115+ ],+ [+ 9,+ 130+ ],+ [+ 9,+ 145+ ],+ [+ 9,+ 160+ ],+ [+ 9,+ 175+ ],+ [+ 6,+ 185+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_eq_len.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_eq_len.jsonnew file mode 100644index 00000000..fd2b3384--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_eq_len.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_eq_len",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 20,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 185+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_over_len.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_over_len.jsonnew file mode 100644index 00000000..ad88c803--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_over_len.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_over_len",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 25,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 185+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_zero.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_zero.jsonnew file mode 100644index 00000000..72b95a87--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sort_size_zero.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_zero",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 0,+ "sort_by_length": true+ },+ "state_widths": [+ 180,+ 100,+ 135,+ 90,+ 160,+ 115,+ 145,+ 95,+ 170,+ 125,+ 105,+ 150,+ 185,+ 110,+ 130,+ 155,+ 120,+ 175,+ 140,+ 165+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9823,+ "technical": 0.0007,+ "other": 0.017+ },+ "confidence": 0.916,+ "answer_confidence": 0.9823,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3568,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0709,+ "1": 0.5013,+ "2": 0.4278+ },+ "confidence": 0.1834,+ "answer_confidence": 0.5013,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0867,+ "confidence": 0.9133,+ "answer_confidence": 0.9133,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 534,+ "output_tokens": 0,+ "state_tokens": 146,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9664,+ "technical": 0.0022,+ "other": 0.0314+ },+ "confidence": 0.8589,+ "answer_confidence": 0.9664,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0367,+ "1": 0.7004,+ "2": 0.2629+ },+ "confidence": 0.3429,+ "answer_confidence": 0.7004,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0634,+ "confidence": 0.9366,+ "answer_confidence": 0.9366,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 294,+ "output_tokens": 0,+ "state_tokens": 66,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9708,+ "technical": 0.0008,+ "other": 0.0284+ },+ "confidence": 0.8764,+ "answer_confidence": 0.9708,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6446,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0315,+ "1": 0.2924,+ "2": 0.6761+ },+ "confidence": 0.3327,+ "answer_confidence": 0.6761,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0554,+ "confidence": 0.9446,+ "answer_confidence": 0.9446,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 399,+ "output_tokens": 0,+ "state_tokens": 101,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.972,+ "technical": 0.0011,+ "other": 0.0269+ },+ "confidence": 0.8798,+ "answer_confidence": 0.972,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5259,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0331,+ "1": 0.4079,+ "2": 0.559+ },+ "confidence": 0.2684,+ "answer_confidence": 0.559,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0972,+ "confidence": 0.9028,+ "answer_confidence": 0.9028,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 474,+ "output_tokens": 0,+ "state_tokens": 126,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9345,+ "technical": 0.0011,+ "other": 0.0644+ },+ "confidence": 0.7748,+ "answer_confidence": 0.9345,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3357,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0468,+ "1": 0.5707,+ "2": 0.3825+ },+ "confidence": 0.2436,+ "answer_confidence": 0.5707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1013,+ "confidence": 0.8987,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 339,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9765,+ "technical": 0.0006,+ "other": 0.0229+ },+ "confidence": 0.896,+ "answer_confidence": 0.9765,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0311,+ "1": 0.325,+ "2": 0.6439+ },+ "confidence": 0.3113,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 429,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.8729,+ "technical": 0.0066,+ "other": 0.1206+ },+ "confidence": 0.6299,+ "answer_confidence": 0.8729,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1993,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0317,+ "1": 0.7373,+ "2": 0.231+ },+ "confidence": 0.3878,+ "answer_confidence": 0.7373,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0431,+ "confidence": 0.9569,+ "answer_confidence": 0.9569,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 279,+ "output_tokens": 0,+ "state_tokens": 61,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9385,+ "technical": 0.0016,+ "other": 0.0599+ },+ "confidence": 0.7827,+ "answer_confidence": 0.9385,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3682,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0805,+ "1": 0.4707,+ "2": 0.4488+ },+ "confidence": 0.1652,+ "answer_confidence": 0.4707,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2113,+ "confidence": 0.7887,+ "answer_confidence": 0.7887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 504,+ "output_tokens": 0,+ "state_tokens": 136,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9699,+ "technical": 0.001,+ "other": 0.0291+ },+ "confidence": 0.8732,+ "answer_confidence": 0.9699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4181,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0389,+ "1": 0.5042,+ "2": 0.457+ },+ "confidence": 0.245,+ "answer_confidence": 0.5042,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1113,+ "confidence": 0.8887,+ "answer_confidence": 0.8887,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 369,+ "output_tokens": 0,+ "state_tokens": 91,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.955,+ "technical": 0.0021,+ "other": 0.0428+ },+ "confidence": 0.8253,+ "answer_confidence": 0.955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3941,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.5512,+ "2": 0.4215+ },+ "confidence": 0.2801,+ "answer_confidence": 0.5512,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.063,+ "confidence": 0.937,+ "answer_confidence": 0.937,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 309,+ "output_tokens": 0,+ "state_tokens": 71,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9867,+ "technical": 0.0005,+ "other": 0.0129+ },+ "confidence": 0.9336,+ "answer_confidence": 0.9867,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5707,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0398,+ "1": 0.3498,+ "2": 0.6105+ },+ "confidence": 0.2746,+ "answer_confidence": 0.6105,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0882,+ "confidence": 0.9118,+ "answer_confidence": 0.9118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 444,+ "output_tokens": 0,+ "state_tokens": 116,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9575,+ "technical": 0.0014,+ "other": 0.0411+ },+ "confidence": 0.8343,+ "answer_confidence": 0.9575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.067,+ "1": 0.4609,+ "2": 0.472+ },+ "confidence": 0.1876,+ "answer_confidence": 0.472,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0889,+ "confidence": 0.9111,+ "answer_confidence": 0.9111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 549,+ "output_tokens": 0,+ "state_tokens": 151,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9668,+ "technical": 0.0012,+ "other": 0.0319+ },+ "confidence": 0.8628,+ "answer_confidence": 0.9668,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4042,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0443,+ "1": 0.5073,+ "2": 0.4484+ },+ "confidence": 0.2337,+ "answer_confidence": 0.5073,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0683,+ "confidence": 0.9317,+ "answer_confidence": 0.9317,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 324,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9758,+ "technical": 0.0008,+ "other": 0.0234+ },+ "confidence": 0.8931,+ "answer_confidence": 0.9758,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0272,+ "1": 0.3085,+ "2": 0.6643+ },+ "confidence": 0.3332,+ "answer_confidence": 0.6643,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0753,+ "confidence": 0.9247,+ "answer_confidence": 0.9247,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 384,+ "output_tokens": 0,+ "state_tokens": 96,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9913,+ "technical": 0.0005,+ "other": 0.0083+ },+ "confidence": 0.9527,+ "answer_confidence": 0.9913,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5763,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0328,+ "1": 0.3582,+ "2": 0.6091+ },+ "confidence": 0.2884,+ "answer_confidence": 0.6091,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.07,+ "confidence": 0.93,+ "answer_confidence": 0.93,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 459,+ "output_tokens": 0,+ "state_tokens": 121,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9702,+ "technical": 0.0009,+ "other": 0.0289+ },+ "confidence": 0.874,+ "answer_confidence": 0.9702,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3405,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0412,+ "1": 0.577,+ "2": 0.3817+ },+ "confidence": 0.2569,+ "answer_confidence": 0.577,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0905,+ "confidence": 0.9095,+ "answer_confidence": 0.9095,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 354,+ "output_tokens": 0,+ "state_tokens": 86,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9658,+ "technical": 0.0016,+ "other": 0.0326+ },+ "confidence": 0.8583,+ "answer_confidence": 0.9658,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2456,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1208,+ "1": 0.5128,+ "2": 0.3664+ },+ "confidence": 0.121,+ "answer_confidence": 0.5128,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1006,+ "confidence": 0.8994,+ "answer_confidence": 0.8994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 519,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9802,+ "technical": 0.0008,+ "other": 0.019+ },+ "confidence": 0.9085,+ "answer_confidence": 0.9802,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4647,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0502,+ "1": 0.435,+ "2": 0.5148+ },+ "confidence": 0.2227,+ "answer_confidence": 0.5148,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0599,+ "confidence": 0.9401,+ "answer_confidence": 0.9401,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 414,+ "output_tokens": 0,+ "state_tokens": 106,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9703,+ "technical": 0.0013,+ "other": 0.0285+ },+ "confidence": 0.8733,+ "answer_confidence": 0.9703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5325,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0449,+ "1": 0.3777,+ "2": 0.5774+ },+ "confidence": 0.2498,+ "answer_confidence": 0.5774,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1136,+ "confidence": 0.8864,+ "answer_confidence": 0.8864,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 489,+ "output_tokens": 0,+ "state_tokens": 131,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 185+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sorted.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sorted.jsonnew file mode 100644index 00000000..939629e5--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sorted.json@@ -0,0 +1,471 @@+{+ "name": "batch_sorted",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ],+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint. Turn 140: the agent restated the refund policy and the customer repeated the complaint. Turn 141: the agent restated the refund policy and the customer repeated the complaint. Turn 142: the agent restated the refund policy and the customer repeated the complaint. Turn 143: the agent restated the refund policy and the customer repeated the complaint. Turn 144: the agent restated the refund policy and the customer repeated the complaint. Turn 145: the agent restated the refund policy and the customer repeated the complaint. Turn 146: the agent restated the refund policy and the customer repeated the complaint. Turn 147: the agent restated the refund policy and the customer repeated the complaint. Turn 148: the agent restated the refund policy and the customer repeated the complaint. Turn 149: the agent restated the refund policy and the customer repeated the complaint. Turn 150: the agent restated the refund policy and the customer repeated the complaint. Turn 151: the agent restated the refund policy and the customer repeated the complaint. Turn 152: the agent restated the refund policy and the customer repeated the complaint. Turn 153: the agent restated the refund policy and the customer repeated the complaint. Turn 154: the agent restated the refund policy and the customer repeated the complaint. Turn 155: the agent restated the refund policy and the customer repeated the complaint. Turn 156: the agent restated the refund policy and the customer repeated the complaint. Turn 157: the agent restated the refund policy and the customer repeated the complaint. Turn 158: the agent restated the refund policy and the customer repeated the complaint. Turn 159: the agent restated the refund policy and the customer repeated the complaint. Turn 160: the agent restated the refund policy and the customer repeated the complaint. Turn 161: the agent restated the refund policy and the customer repeated the complaint. Turn 162: the agent restated the refund policy and the customer repeated the complaint. Turn 163: the agent restated the refund policy and the customer repeated the complaint. Turn 164: the agent restated the refund policy and the customer repeated the complaint. Turn 165: the agent restated the refund policy and the customer repeated the complaint. Turn 166: the agent restated the refund policy and the customer repeated the complaint. Turn 167: the agent restated the refund policy and the customer repeated the complaint. Turn 168: the agent restated the refund policy and the customer repeated the complaint. Turn 169: the agent restated the refund policy and the customer repeated the complaint. Turn 170: the agent restated the refund policy and the customer repeated the complaint. Turn 171: the agent restated the refund policy and the customer repeated the complaint. Turn 172: the agent restated the refund policy and the customer repeated the complaint. Turn 173: the agent restated the refund policy and the customer repeated the complaint. Turn 174: the agent restated the refund policy and the customer repeated the complaint. Turn 175: the agent restated the refund policy and the customer repeated the complaint. Turn 176: the agent restated the refund policy and the customer repeated the complaint. Turn 177: the agent restated the refund policy and the customer repeated the complaint. Turn 178: the agent restated the refund policy and the customer repeated the complaint. Turn 179: the agent restated the refund policy and the customer repeated the complaint. Turn 180: the agent restated the refund policy and the customer repeated the complaint. Turn 181: the agent restated the refund policy and the customer repeated the complaint. Turn 182: the agent restated the refund policy and the customer repeated the complaint. Turn 183: the agent restated the refund policy and the customer repeated the complaint. Turn 184: the agent restated the refund policy and the customer repeated the complaint. Turn 185: the agent restated the refund policy and the customer repeated the complaint. Turn 186: the agent restated the refund policy and the customer repeated the complaint. Turn 187: the agent restated the refund policy and the customer repeated the complaint. Turn 188: the agent restated the refund policy and the customer repeated the complaint. Turn 189: the agent restated the refund policy and the customer repeated the complaint. Turn 190: the agent restated the refund policy and the customer repeated the complaint. Turn 191: the agent restated the refund policy and the customer repeated the complaint. Turn 192: the agent restated the refund policy and the customer repeated the complaint. Turn 193: the agent restated the refund policy and the customer repeated the complaint. Turn 194: the agent restated the refund policy and the customer repeated the complaint. Turn 195: the agent restated the refund policy and the customer repeated the complaint. Turn 196: the agent restated the refund policy and the customer repeated the complaint. Turn 197: the agent restated the refund policy and the customer repeated the complaint. Turn 198: the agent restated the refund policy and the customer repeated the complaint. Turn 199: the agent restated the refund policy and the customer repeated the complaint. Turn 200: the agent restated the refund policy and the customer repeated the complaint. Turn 201: the agent restated the refund policy and the customer repeated the complaint. Turn 202: the agent restated the refund policy and the customer repeated the complaint. Turn 203: the agent restated the refund policy and the customer repeated the complaint. Turn 204: the agent restated the refund policy and the customer repeated the complaint. Turn 205: the agent restated the refund policy and the customer repeated the complaint. Turn 206: the agent restated the refund policy and the customer repeated the complaint. Turn 207: the agent restated the refund policy and the customer repeated the complaint. Turn 208: the agent restated the refund policy and the customer repeated the complaint. Turn 209: the agent restated the refund policy and the customer repeated the complaint. Turn 210: the agent restated the refund policy and the customer repeated the complaint. Turn 211: the agent restated the refund policy and the customer repeated the complaint. Turn 212: the agent restated the refund policy and the customer repeated the complaint. Turn 213: the agent restated the refund policy and the customer repeated the complaint. Turn 214: the agent restated the refund policy and the customer repeated the complaint. Turn 215: the agent restated the refund policy and the customer repeated the complaint. Turn 216: the agent restated the refund policy and the customer repeated the complaint. Turn 217: the agent restated the refund policy and the customer repeated the complaint. Turn 218: the agent restated the refund policy and the customer repeated the complaint. Turn 219: the agent restated the refund policy and the customer repeated the complaint. Turn 220: the agent restated the refund policy and the customer repeated the complaint. Turn 221: the agent restated the refund policy and the customer repeated the complaint. Turn 222: the agent restated the refund policy and the customer repeated the complaint. Turn 223: the agent restated the refund policy and the customer repeated the complaint. Turn 224: the agent restated the refund policy and the customer repeated the complaint. Turn 225: the agent restated the refund policy and the customer repeated the complaint. Turn 226: the agent restated the refund policy and the customer repeated the complaint. Turn 227: the agent restated the refund policy and the customer repeated the complaint. Turn 228: the agent restated the refund policy and the customer repeated the complaint. Turn 229: the agent restated the refund policy and the customer repeated the complaint. Turn 230: the agent restated the refund policy and the customer repeated the complaint. Turn 231: the agent restated the refund policy and the customer repeated the complaint. Turn 232: the agent restated the refund policy and the customer repeated the complaint. Turn 233: the agent restated the refund policy and the customer repeated the complaint. Turn 234: the agent restated the refund policy and the customer repeated the complaint. Turn 235: the agent restated the refund policy and the customer repeated the complaint. Turn 236: the agent restated the refund policy and the customer repeated the complaint. Turn 237: the agent restated the refund policy and the customer repeated the complaint. Turn 238: the agent restated the refund policy and the customer repeated the complaint. Turn 239: the agent restated the refund policy and the customer repeated the complaint. Turn 240: the agent restated the refund policy and the customer repeated the complaint. Turn 241: the agent restated the refund policy and the customer repeated the complaint. Turn 242: the agent restated the refund policy and the customer repeated the complaint. Turn 243: the agent restated the refund policy and the customer repeated the complaint. Turn 244: the agent restated the refund policy and the customer repeated the complaint. Turn 245: the agent restated the refund policy and the customer repeated the complaint. Turn 246: the agent restated the refund policy and the customer repeated the complaint. Turn 247: the agent restated the refund policy and the customer repeated the complaint. Turn 248: the agent restated the refund policy and the customer repeated the complaint. Turn 249: the agent restated the refund policy and the customer repeated the complaint. Turn 250: the agent restated the refund policy and the customer repeated the complaint. Turn 251: the agent restated the refund policy and the customer repeated the complaint. Turn 252: the agent restated the refund policy and the customer repeated the complaint. Turn 253: the agent restated the refund policy and the customer repeated the complaint. Turn 254: the agent restated the refund policy and the customer repeated the complaint. Turn 255: the agent restated the refund policy and the customer repeated the complaint. Turn 256: the agent restated the refund policy and the customer repeated the complaint. Turn 257: the agent restated the refund policy and the customer repeated the complaint. Turn 258: the agent restated the refund policy and the customer repeated the complaint. Turn 259: the agent restated the refund policy and the customer repeated the complaint. Turn 260: the agent restated the refund policy and the customer repeated the complaint. Turn 261: the agent restated the refund policy and the customer repeated the complaint. Turn 262: the agent restated the refund policy and the customer repeated the complaint. Turn 263: the agent restated the refund policy and the customer repeated the complaint. Turn 264: the agent restated the refund policy and the customer repeated the complaint. Turn 265: the agent restated the refund policy and the customer repeated the complaint. Turn 266: the agent restated the refund policy and the customer repeated the complaint. Turn 267: the agent restated the refund policy and the customer repeated the complaint. Turn 268: the agent restated the refund policy and the customer repeated the complaint. Turn 269: the agent restated the refund policy and the customer repeated the complaint. Turn 270: the agent restated the refund policy and the customer repeated the complaint. Turn 271: the agent restated the refund policy and the customer repeated the complaint. Turn 272: the agent restated the refund policy and the customer repeated the complaint. Turn 273: the agent restated the refund policy and the customer repeated the complaint. Turn 274: the agent restated the refund policy and the customer repeated the complaint. Turn 275: the agent restated the refund policy and the customer repeated the complaint. Turn 276: the agent restated the refund policy and the customer repeated the complaint. Turn 277: the agent restated the refund policy and the customer repeated the complaint. Turn 278: the agent restated the refund policy and the customer repeated the complaint. Turn 279: the agent restated the refund policy and the customer repeated the complaint. Turn 280: the agent restated the refund policy and the customer repeated the complaint. Turn 281: the agent restated the refund policy and the customer repeated the complaint. Turn 282: the agent restated the refund policy and the customer repeated the complaint. Turn 283: the agent restated the refund policy and the customer repeated the complaint. Turn 284: the agent restated the refund policy and the customer repeated the complaint. Turn 285: the agent restated the refund policy and the customer repeated the complaint. Turn 286: the agent restated the refund policy and the customer repeated the complaint. Turn 287: the agent restated the refund policy and the customer repeated the complaint. Turn 288: the agent restated the refund policy and the customer repeated the complaint. Turn 289: the agent restated the refund policy and the customer repeated the complaint. Turn 290: the agent restated the refund policy and the customer repeated the complaint. Turn 291: the agent restated the refund policy and the customer repeated the complaint. Turn 292: the agent restated the refund policy and the customer repeated the complaint. Turn 293: the agent restated the refund policy and the customer repeated the complaint. Turn 294: the agent restated the refund policy and the customer repeated the complaint. Turn 295: the agent restated the refund policy and the customer repeated the complaint. Turn 296: the agent restated the refund policy and the customer repeated the complaint. Turn 297: the agent restated the refund policy and the customer repeated the complaint. Turn 298: the agent restated the refund policy and the customer repeated the complaint. Turn 299: the agent restated the refund policy and the customer repeated the complaint. Turn 300: the agent restated the refund policy and the customer repeated the complaint. Turn 301: the agent restated the refund policy and the customer repeated the complaint. Turn 302: the agent restated the refund policy and the customer repeated the complaint. Turn 303: the agent restated the refund policy and the customer repeated the complaint. Turn 304: the agent restated the refund policy and the customer repeated the complaint. Turn 305: the agent restated the refund policy and the customer repeated the complaint. Turn 306: the agent restated the refund policy and the customer repeated the complaint. Turn 307: the agent restated the refund policy and the customer repeated the complaint. Turn 308: the agent restated the refund policy and the customer repeated the complaint. Turn 309: the agent restated the refund policy and the customer repeated the complaint. Turn 310: the agent restated the refund policy and the customer repeated the complaint. Turn 311: the agent restated the refund policy and the customer repeated the complaint. Turn 312: the agent restated the refund policy and the customer repeated the complaint. Turn 313: the agent restated the refund policy and the customer repeated the complaint. Turn 314: the agent restated the refund policy and the customer repeated the complaint. Turn 315: the agent restated the refund policy and the customer repeated the complaint. Turn 316: the agent restated the refund policy and the customer repeated the complaint. Turn 317: the agent restated the refund policy and the customer repeated the complaint. Turn 318: the agent restated the refund policy and the customer repeated the complaint. Turn 319: the agent restated the refund policy and the customer repeated the complaint. Turn 320: the agent restated the refund policy and the customer repeated the complaint. Turn 321: the agent restated the refund policy and the customer repeated the complaint. Turn 322: the agent restated the refund policy and the customer repeated the complaint. Turn 323: the agent restated the refund policy and the customer repeated the complaint. Turn 324: the agent restated the refund policy and the customer repeated the complaint. Turn 325: the agent restated the refund policy and the customer repeated the complaint. Turn 326: the agent restated the refund policy and the customer repeated the complaint. Turn 327: the agent restated the refund policy and the customer repeated the complaint. Turn 328: the agent restated the refund policy and the customer repeated the complaint. Turn 329: the agent restated the refund policy and the customer repeated the complaint. Turn 330: the agent restated the refund policy and the customer repeated the complaint. Turn 331: the agent restated the refund policy and the customer repeated the complaint. Turn 332: the agent restated the refund policy and the customer repeated the complaint. Turn 333: the agent restated the refund policy and the customer repeated the complaint. Turn 334: the agent restated the refund policy and the customer repeated the complaint. Turn 335: the agent restated the refund policy and the customer repeated the complaint. Turn 336: the agent restated the refund policy and the customer repeated the complaint. Turn 337: the agent restated the refund policy and the customer repeated the complaint. Turn 338: the agent restated the refund policy and the customer repeated the complaint. Turn 339: the agent restated the refund policy and the customer repeated the complaint. Turn 340: the agent restated the refund policy and the customer repeated the complaint. Turn 341: the agent restated the refund policy and the customer repeated the complaint. Turn 342: the agent restated the refund policy and the customer repeated the complaint. Turn 343: the agent restated the refund policy and the customer repeated the complaint. Turn 344: the agent restated the refund policy and the customer repeated the complaint. Turn 345: the agent restated the refund policy and the customer repeated the complaint. Turn 346: the agent restated the refund policy and the customer repeated the complaint. Turn 347: the agent restated the refund policy and the customer repeated the complaint. Turn 348: the agent restated the refund policy and the customer repeated the complaint. Turn 349: the agent restated the refund policy and the customer repeated the complaint. Turn 350: the agent restated the refund policy and the customer repeated the complaint. Turn 351: the agent restated the refund policy and the customer repeated the complaint. Turn 352: the agent restated the refund policy and the customer repeated the complaint. Turn 353: the agent restated the refund policy and the customer repeated the complaint. Turn 354: the agent restated the refund policy and the customer repeated the complaint. Turn 355: the agent restated the refund policy and the customer repeated the complaint. Turn 356: the agent restated the refund policy and the customer repeated the complaint. Turn 357: the agent restated the refund policy and the customer repeated the complaint. Turn 358: the agent restated the refund policy and the customer repeated the complaint. Turn 359: the agent restated the refund policy and the customer repeated the complaint. Turn 360: the agent restated the refund policy and the customer repeated the complaint. Turn 361: the agent restated the refund policy and the customer repeated the complaint. Turn 362: the agent restated the refund policy and the customer repeated the complaint. Turn 363: the agent restated the refund policy and the customer repeated the complaint. Turn 364: the agent restated the refund policy and the customer repeated the complaint. Turn 365: the agent restated the refund policy and the customer repeated the complaint. Turn 366: the agent restated the refund policy and the customer repeated the complaint. Turn 367: the agent restated the refund policy and the customer repeated the complaint. Turn 368: the agent restated the refund policy and the customer repeated the complaint. Turn 369: the agent restated the refund policy and the customer repeated the complaint. Turn 370: the agent restated the refund policy and the customer repeated the complaint. Turn 371: the agent restated the refund policy and the customer repeated the complaint. Turn 372: the agent restated the refund policy and the customer repeated the complaint. Turn 373: the agent restated the refund policy and the customer repeated the complaint. Turn 374: the agent restated the refund policy and the customer repeated the complaint. Turn 375: the agent restated the refund policy and the customer repeated the complaint. Turn 376: the agent restated the refund policy and the customer repeated the complaint. Turn 377: the agent restated the refund policy and the customer repeated the complaint. Turn 378: the agent restated the refund policy and the customer repeated the complaint. Turn 379: the agent restated the refund policy and the customer repeated the complaint. Turn 380: the agent restated the refund policy and the customer repeated the complaint. Turn 381: the agent restated the refund policy and the customer repeated the complaint. Turn 382: the agent restated the refund policy and the customer repeated the complaint. Turn 383: the agent restated the refund policy and the customer repeated the complaint. Turn 384: the agent restated the refund policy and the customer repeated the complaint. Turn 385: the agent restated the refund policy and the customer repeated the complaint. Turn 386: the agent restated the refund policy and the customer repeated the complaint. Turn 387: the agent restated the refund policy and the customer repeated the complaint. Turn 388: the agent restated the refund policy and the customer repeated the complaint. Turn 389: the agent restated the refund policy and the customer repeated the complaint. Turn 390: the agent restated the refund policy and the customer repeated the complaint. Turn 391: the agent restated the refund policy and the customer repeated the complaint. Turn 392: the agent restated the refund policy and the customer repeated the complaint. Turn 393: the agent restated the refund policy and the customer repeated the complaint. Turn 394: the agent restated the refund policy and the customer repeated the complaint. Turn 395: the agent restated the refund policy and the customer repeated the complaint. Turn 396: the agent restated the refund policy and the customer repeated the complaint. Turn 397: the agent restated the refund policy and the customer repeated the complaint. Turn 398: the agent restated the refund policy and the customer repeated the complaint. Turn 399: the agent restated the refund policy and the customer repeated the complaint.",+ "The app crashes on login since yesterday's update.",+ "ok"+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 90,+ 44,+ 147,+ 73,+ 1024,+ 45,+ 35+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9999,+ "technical": 0.0,+ "other": 0.0+ },+ "confidence": 0.9993,+ "answer_confidence": 0.9999,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6231,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0528,+ "1": 0.2714,+ "2": 0.6759+ },+ "confidence": 0.2956,+ "answer_confidence": 0.6759,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0067,+ "confidence": 0.9933,+ "answer_confidence": 0.9933,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 126,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2098,+ "technical": 0.0637,+ "other": 0.7266+ },+ "confidence": 0.331,+ "answer_confidence": 0.7266,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3977,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0308,+ "1": 0.5407,+ "2": 0.4285+ },+ "confidence": 0.2692,+ "answer_confidence": 0.5407,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1873,+ "confidence": 0.8127,+ "answer_confidence": 0.8127,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 435,+ "output_tokens": 0,+ "state_tokens": 113,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6466,+ "technical": 0.0903,+ "other": 0.2631+ },+ "confidence": 0.2259,+ "answer_confidence": 0.6466,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0493,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1356,+ "1": 0.6796,+ "2": 0.1849+ },+ "confidence": 0.2304,+ "answer_confidence": 0.6796,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0166,+ "confidence": 0.9834,+ "answer_confidence": 0.9834,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 213,+ "output_tokens": 0,+ "state_tokens": 39,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2111,+ "technical": 0.0685,+ "other": 0.7204+ },+ "confidence": 0.319,+ "answer_confidence": 0.7204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1106,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2027,+ "1": 0.484,+ "2": 0.3133+ },+ "confidence": 0.0549,+ "answer_confidence": 0.484,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8812,+ "confidence": 0.8812,+ "answer_confidence": 0.8812,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 7894,+ "state_tokens_dropped": 6904,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.0015,+ "technical": 0.962,+ "other": 0.0365+ },+ "confidence": 0.8474,+ "answer_confidence": 0.962,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1251,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0863,+ "1": 0.7023,+ "2": 0.2114+ },+ "confidence": 0.2826,+ "answer_confidence": 0.7023,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0344,+ "confidence": 0.9656,+ "answer_confidence": 0.9656,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 129,+ "output_tokens": 0,+ "state_tokens": 11,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7941,+ "technical": 0.0972,+ "other": 0.1087+ },+ "confidence": 0.4075,+ "answer_confidence": 0.7941,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.006,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2485,+ "1": 0.4971,+ "2": 0.2545+ },+ "confidence": 0.0518,+ "answer_confidence": 0.4971,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0083,+ "confidence": 0.9917,+ "answer_confidence": 0.9917,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 99,+ "output_tokens": 0,+ "state_tokens": 1,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 44+ ],+ [+ 6,+ 73+ ],+ [+ 6,+ 147+ ],+ [+ 3,+ 1024+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sorted_windows.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sorted_windows.jsonnew file mode 100644index 00000000..0a2d02e5--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_sorted_windows.json@@ -0,0 +1,1101 @@+{+ "name": "batch_sorted_windows",+ "states": [+ "Routine status note 0. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 1. Routine status note 1. ",+ "Routine status note 2. Routine status note 2. Routine status note 2. ",+ "Routine status note 3. Routine status note 3. Routine status note 3. Routine status note 3. ",+ "Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. ",+ "Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. ",+ "Routine status note 7. ",+ "Routine status note 8. Routine status note 8. ",+ "Routine status note 9. Routine status note 9. Routine status note 9. ",+ "Routine status note 10. Routine status note 10. Routine status note 10. Routine status note 10. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. ",+ "Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. ",+ "Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. ",+ "Routine status note 14. ",+ "Routine status note 15. Routine status note 15. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 16. Routine status note 16. Routine status note 16. ",+ "Routine status note 17. Routine status note 17. Routine status note 17. Routine status note 17. "+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 96,+ 47,+ 53,+ 59,+ 65,+ 126,+ 77,+ 41,+ 47,+ 53,+ 118,+ 70,+ 77,+ 84,+ 42,+ 104,+ 56,+ 63+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9014,+ "technical": 0.0068,+ "other": 0.0918+ },+ "confidence": 0.6844,+ "answer_confidence": 0.9014,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3022,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.027,+ "1": 0.6439,+ "2": 0.3292+ },+ "confidence": 0.3204,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0285,+ "confidence": 0.9715,+ "answer_confidence": 0.9715,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 282,+ "output_tokens": 0,+ "state_tokens": 62,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3729,+ "technical": 0.159,+ "other": 0.4682+ },+ "confidence": 0.0756,+ "answer_confidence": 0.4682,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9772,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1331,+ "1": 0.7566,+ "2": 0.1103+ },+ "confidence": 0.3422,+ "answer_confidence": 0.7566,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0016,+ "confidence": 0.9984,+ "answer_confidence": 0.9984,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 135,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5872,+ "technical": 0.1169,+ "other": 0.2959+ },+ "confidence": 0.159,+ "answer_confidence": 0.5872,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0725,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1339,+ "1": 0.6598,+ "2": 0.2064+ },+ "confidence": 0.2088,+ "answer_confidence": 0.6598,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0011,+ "confidence": 0.9989,+ "answer_confidence": 0.9989,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 153,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5939,+ "technical": 0.1168,+ "other": 0.2893+ },+ "confidence": 0.1634,+ "answer_confidence": 0.5939,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0196,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1745,+ "1": 0.6313,+ "2": 0.1941+ },+ "confidence": 0.1687,+ "answer_confidence": 0.6313,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0011,+ "confidence": 0.9989,+ "answer_confidence": 0.9989,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 171,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5894,+ "technical": 0.1066,+ "other": 0.3041+ },+ "confidence": 0.1697,+ "answer_confidence": 0.5894,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.006,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1794,+ "1": 0.6351,+ "2": 0.1854+ },+ "confidence": 0.1726,+ "answer_confidence": 0.6351,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0011,+ "confidence": 0.9989,+ "answer_confidence": 0.9989,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 189,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9691,+ "technical": 0.002,+ "other": 0.0289+ },+ "confidence": 0.8678,+ "answer_confidence": 0.9691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.45,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0141,+ "1": 0.5219,+ "2": 0.464+ },+ "confidence": 0.3122,+ "answer_confidence": 0.5219,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0538,+ "confidence": 0.9462,+ "answer_confidence": 0.9462,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 372,+ "output_tokens": 0,+ "state_tokens": 92,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5699,+ "technical": 0.1313,+ "other": 0.2988+ },+ "confidence": 0.1371,+ "answer_confidence": 0.5699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1242,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1557,+ "1": 0.5644,+ "2": 0.2799+ },+ "confidence": 0.1181,+ "answer_confidence": 0.5644,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.001,+ "confidence": 0.999,+ "answer_confidence": 0.999,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 225,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2209,+ "technical": 0.1229,+ "other": 0.6562+ },+ "confidence": 0.2102,+ "answer_confidence": 0.6562,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9522,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2022,+ "1": 0.6435,+ "2": 0.1543+ },+ "confidence": 0.1851,+ "answer_confidence": 0.6435,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0019,+ "confidence": 0.9981,+ "answer_confidence": 0.9981,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 117,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3429,+ "technical": 0.1539,+ "other": 0.5033+ },+ "confidence": 0.0892,+ "answer_confidence": 0.5033,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9555,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1784,+ "1": 0.6876,+ "2": 0.1339+ },+ "confidence": 0.2406,+ "answer_confidence": 0.6876,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.001,+ "confidence": 0.999,+ "answer_confidence": 0.999,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 135,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5255,+ "technical": 0.1426,+ "other": 0.3319+ },+ "confidence": 0.1062,+ "answer_confidence": 0.5255,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0067,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.165,+ "1": 0.6633,+ "2": 0.1717+ },+ "confidence": 0.2062,+ "answer_confidence": 0.6633,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0008,+ "confidence": 0.9992,+ "answer_confidence": 0.9992,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 153,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9448,+ "technical": 0.0019,+ "other": 0.0533+ },+ "confidence": 0.7979,+ "answer_confidence": 0.9448,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2482,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0276,+ "1": 0.6967,+ "2": 0.2758+ },+ "confidence": 0.3573,+ "answer_confidence": 0.6967,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0793,+ "confidence": 0.9207,+ "answer_confidence": 0.9207,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 348,+ "output_tokens": 0,+ "state_tokens": 84,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4408,+ "technical": 0.1294,+ "other": 0.4297+ },+ "confidence": 0.1001,+ "answer_confidence": 0.4408,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1102,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1325,+ "1": 0.6248,+ "2": 0.2427+ },+ "confidence": 0.1759,+ "answer_confidence": 0.6248,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0006,+ "confidence": 0.9994,+ "answer_confidence": 0.9994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 204,+ "output_tokens": 0,+ "state_tokens": 36,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4908,+ "technical": 0.146,+ "other": 0.3633+ },+ "confidence": 0.0915,+ "answer_confidence": 0.4908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1341,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1639,+ "1": 0.5381,+ "2": 0.298+ },+ "confidence": 0.0983,+ "answer_confidence": 0.5381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0005,+ "confidence": 0.9995,+ "answer_confidence": 0.9995,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 225,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4493,+ "technical": 0.1573,+ "other": 0.3934+ },+ "confidence": 0.0739,+ "answer_confidence": 0.4493,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1835,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1551,+ "1": 0.5063,+ "2": 0.3386+ },+ "confidence": 0.0895,+ "answer_confidence": 0.5063,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0004,+ "confidence": 0.9996,+ "answer_confidence": 0.9996,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 246,+ "output_tokens": 0,+ "state_tokens": 50,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.21,+ "technical": 0.1104,+ "other": 0.6796+ },+ "confidence": 0.2412,+ "answer_confidence": 0.6796,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9855,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1809,+ "1": 0.6526,+ "2": 0.1664+ },+ "confidence": 0.1933,+ "answer_confidence": 0.6526,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0013,+ "confidence": 0.9987,+ "answer_confidence": 0.9987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9237,+ "technical": 0.0024,+ "other": 0.0739+ },+ "confidence": 0.745,+ "answer_confidence": 0.9237,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.292,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0184,+ "1": 0.6711,+ "2": 0.3104+ },+ "confidence": 0.3589,+ "answer_confidence": 0.6711,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0624,+ "confidence": 0.9376,+ "answer_confidence": 0.9376,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 306,+ "output_tokens": 0,+ "state_tokens": 70,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4746,+ "technical": 0.1093,+ "other": 0.4161+ },+ "confidence": 0.1257,+ "answer_confidence": 0.4746,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0366,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1616,+ "1": 0.6402,+ "2": 0.1982+ },+ "confidence": 0.18,+ "answer_confidence": 0.6402,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0007,+ "confidence": 0.9993,+ "answer_confidence": 0.9993,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 162,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.4059,+ "technical": 0.0931,+ "other": 0.501+ },+ "confidence": 0.1505,+ "answer_confidence": 0.501,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0468,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1712,+ "1": 0.6109,+ "2": 0.218+ },+ "confidence": 0.1487,+ "answer_confidence": 0.6109,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0006,+ "confidence": 0.9994,+ "answer_confidence": 0.9994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 183,+ "output_tokens": 0,+ "state_tokens": 29,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 42+ ],+ [+ 6,+ 47+ ],+ [+ 6,+ 53+ ],+ [+ 6,+ 65+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 84+ ],+ [+ 6,+ 104+ ],+ [+ 6,+ 126+ ],+ [+ 6,+ 63+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_truncated.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_truncated.jsonnew file mode 100644index 00000000..5181ba6d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_truncated.json@@ -0,0 +1,854 @@+{+ "name": "batch_truncated",+ "states": [+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ [+ {+ "role": "user",+ "content": "Turn 0: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 1: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 2: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 3: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 4: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 5: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 6: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 7: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 8: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 9: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 10: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 11: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 12: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 13: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 14: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 15: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 16: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 17: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 18: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 19: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 20: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 21: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 22: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 23: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 24: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 25: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 26: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 27: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 28: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 29: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 30: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 31: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 32: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 33: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 34: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 35: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 36: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 37: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 38: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 39: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 40: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 41: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 42: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 43: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 44: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 45: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 46: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 47: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 48: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 49: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 50: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 51: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 52: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 53: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 54: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 55: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 56: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 57: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 58: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 59: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 60: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 61: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 62: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 63: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 64: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 65: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 66: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 67: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 68: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 69: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 70: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 71: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 72: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 73: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 74: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 75: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 76: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 77: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 78: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 79: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 80: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 81: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 82: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 83: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 84: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 85: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 86: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 87: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 88: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 89: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 90: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 91: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 92: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 93: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 94: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 95: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 96: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 97: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 98: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 99: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 100: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 101: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 102: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 103: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 104: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 105: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 106: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 107: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 108: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 109: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 110: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 111: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 112: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 113: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 114: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 115: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 116: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 117: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 118: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 119: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 120: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 121: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 122: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 123: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 124: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 125: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 126: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 127: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 128: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 129: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 130: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 131: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 132: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 133: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 134: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 135: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 136: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 137: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 138: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 139: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "I want a refund or I will cancel today."+ }+ ],+ {+ "notes": "Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 1024,+ 1024,+ 1024,+ 90+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2111,+ "technical": 0.0685,+ "other": 0.7204+ },+ "confidence": 0.319,+ "answer_confidence": 0.7204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1106,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2027,+ "1": 0.484,+ "2": 0.3133+ },+ "confidence": 0.0549,+ "answer_confidence": 0.484,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8812,+ "confidence": 0.8812,+ "answer_confidence": 0.8812,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2694,+ "state_tokens_dropped": 1704,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.978,+ "technical": 0.0026,+ "other": 0.0194+ },+ "confidence": 0.8967,+ "answer_confidence": 0.978,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8829,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0158,+ "1": 0.0855,+ "2": 0.8987+ },+ "confidence": 0.6616,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.5785,+ "confidence": 0.5785,+ "answer_confidence": 0.5785,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 4252,+ "state_tokens_dropped": 3262,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2488,+ "technical": 0.0481,+ "other": 0.703+ },+ "confidence": 0.3265,+ "answer_confidence": 0.703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1362,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1841,+ "1": 0.4956,+ "2": 0.3203+ },+ "confidence": 0.0678,+ "answer_confidence": 0.4956,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0491,+ "confidence": 0.9509,+ "answer_confidence": 0.9509,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2758,+ "state_tokens_dropped": 1768,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 1024+ ],+ [+ 6,+ 1024+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_truncated_sorted.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_truncated_sorted.jsonnew file mode 100644index 00000000..0edcb6b6--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_truncated_sorted.json@@ -0,0 +1,855 @@+{+ "name": "batch_truncated_sorted",+ "states": [+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ [+ {+ "role": "user",+ "content": "Turn 0: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 1: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 2: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 3: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 4: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 5: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 6: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 7: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 8: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 9: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 10: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 11: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 12: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 13: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 14: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 15: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 16: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 17: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 18: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 19: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 20: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 21: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 22: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 23: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 24: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 25: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 26: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 27: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 28: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 29: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 30: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 31: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 32: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 33: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 34: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 35: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 36: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 37: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 38: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 39: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 40: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 41: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 42: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 43: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 44: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 45: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 46: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 47: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 48: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 49: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 50: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 51: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 52: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 53: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 54: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 55: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 56: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 57: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 58: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 59: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 60: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 61: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 62: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 63: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 64: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 65: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 66: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 67: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 68: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 69: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 70: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 71: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 72: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 73: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 74: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 75: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 76: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 77: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 78: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 79: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 80: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 81: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 82: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 83: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 84: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 85: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 86: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 87: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 88: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 89: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 90: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 91: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 92: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 93: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 94: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 95: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 96: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 97: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 98: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 99: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 100: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 101: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 102: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 103: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 104: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 105: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 106: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 107: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 108: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 109: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 110: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 111: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 112: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 113: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 114: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 115: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 116: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 117: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 118: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 119: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 120: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 121: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 122: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 123: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 124: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 125: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 126: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 127: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 128: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 129: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 130: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 131: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 132: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 133: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 134: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 135: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 136: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 137: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 138: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 139: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "I want a refund or I will cancel today."+ }+ ],+ {+ "notes": "Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3,+ "sort_by_length": true+ },+ "state_widths": [+ 1024,+ 1024,+ 1024,+ 90+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2111,+ "technical": 0.0685,+ "other": 0.7204+ },+ "confidence": 0.319,+ "answer_confidence": 0.7204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1106,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2027,+ "1": 0.484,+ "2": 0.3133+ },+ "confidence": 0.0549,+ "answer_confidence": 0.484,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8812,+ "confidence": 0.8812,+ "answer_confidence": 0.8812,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2694,+ "state_tokens_dropped": 1704,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.978,+ "technical": 0.0026,+ "other": 0.0194+ },+ "confidence": 0.8967,+ "answer_confidence": 0.978,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8829,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0158,+ "1": 0.0855,+ "2": 0.8987+ },+ "confidence": 0.6616,+ "answer_confidence": 0.8987,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.5785,+ "confidence": 0.5785,+ "answer_confidence": 0.5785,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 4252,+ "state_tokens_dropped": 3262,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2488,+ "technical": 0.0481,+ "other": 0.703+ },+ "confidence": 0.3265,+ "answer_confidence": 0.703,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1362,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1841,+ "1": 0.4956,+ "2": 0.3203+ },+ "confidence": 0.0678,+ "answer_confidence": 0.4956,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0491,+ "confidence": 0.9509,+ "answer_confidence": 0.9509,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2758,+ "state_tokens_dropped": 1768,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.836,+ "technical": 0.0114,+ "other": 0.1526+ },+ "confidence": 0.5562,+ "answer_confidence": 0.836,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3713,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0231,+ "1": 0.5824,+ "2": 0.3945+ },+ "confidence": 0.3001,+ "answer_confidence": 0.5824,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0414,+ "confidence": 0.9586,+ "answer_confidence": 0.9586,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 264,+ "output_tokens": 0,+ "state_tokens": 56,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 1024+ ],+ [+ 3,+ 1024+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_unsorted_windows.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_unsorted_windows.jsonnew file mode 100644index 00000000..4b6ceddb--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/case_batch_unsorted_windows.json@@ -0,0 +1,1100 @@+{+ "name": "batch_unsorted_windows",+ "states": [+ "Routine status note 0. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 1. Routine status note 1. ",+ "Routine status note 2. Routine status note 2. Routine status note 2. ",+ "Routine status note 3. Routine status note 3. Routine status note 3. Routine status note 3. ",+ "Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. ",+ "Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. ",+ "Routine status note 7. ",+ "Routine status note 8. Routine status note 8. ",+ "Routine status note 9. Routine status note 9. Routine status note 9. ",+ "Routine status note 10. Routine status note 10. Routine status note 10. Routine status note 10. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. ",+ "Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. ",+ "Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. ",+ "Routine status note 14. ",+ "Routine status note 15. Routine status note 15. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 16. Routine status note 16. Routine status note 16. ",+ "Routine status note 17. Routine status note 17. Routine status note 17. Routine status note 17. "+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 96,+ 47,+ 53,+ 59,+ 65,+ 126,+ 77,+ 41,+ 47,+ 53,+ 118,+ 70,+ 77,+ 84,+ 42,+ 104,+ 56,+ 63+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9014,+ "technical": 0.0068,+ "other": 0.0918+ },+ "confidence": 0.6844,+ "answer_confidence": 0.9014,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.3022,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.027,+ "1": 0.6439,+ "2": 0.3292+ },+ "confidence": 0.3204,+ "answer_confidence": 0.6439,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0285,+ "confidence": 0.9715,+ "answer_confidence": 0.9715,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 282,+ "output_tokens": 0,+ "state_tokens": 62,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3729,+ "technical": 0.159,+ "other": 0.4682+ },+ "confidence": 0.0756,+ "answer_confidence": 0.4682,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9772,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1331,+ "1": 0.7566,+ "2": 0.1103+ },+ "confidence": 0.3422,+ "answer_confidence": 0.7566,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0016,+ "confidence": 0.9984,+ "answer_confidence": 0.9984,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 135,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5872,+ "technical": 0.1169,+ "other": 0.2959+ },+ "confidence": 0.159,+ "answer_confidence": 0.5872,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0725,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1339,+ "1": 0.6598,+ "2": 0.2064+ },+ "confidence": 0.2088,+ "answer_confidence": 0.6598,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0011,+ "confidence": 0.9989,+ "answer_confidence": 0.9989,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 153,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5939,+ "technical": 0.1168,+ "other": 0.2893+ },+ "confidence": 0.1634,+ "answer_confidence": 0.5939,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0196,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1745,+ "1": 0.6313,+ "2": 0.1941+ },+ "confidence": 0.1687,+ "answer_confidence": 0.6313,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0011,+ "confidence": 0.9989,+ "answer_confidence": 0.9989,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 171,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5894,+ "technical": 0.1066,+ "other": 0.3041+ },+ "confidence": 0.1697,+ "answer_confidence": 0.5894,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.006,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1794,+ "1": 0.6351,+ "2": 0.1854+ },+ "confidence": 0.1726,+ "answer_confidence": 0.6351,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0011,+ "confidence": 0.9989,+ "answer_confidence": 0.9989,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 189,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9691,+ "technical": 0.002,+ "other": 0.0289+ },+ "confidence": 0.8678,+ "answer_confidence": 0.9691,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.45,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0141,+ "1": 0.5219,+ "2": 0.464+ },+ "confidence": 0.3122,+ "answer_confidence": 0.5219,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0538,+ "confidence": 0.9462,+ "answer_confidence": 0.9462,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 372,+ "output_tokens": 0,+ "state_tokens": 92,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5699,+ "technical": 0.1313,+ "other": 0.2988+ },+ "confidence": 0.1371,+ "answer_confidence": 0.5699,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1242,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1557,+ "1": 0.5644,+ "2": 0.2799+ },+ "confidence": 0.1181,+ "answer_confidence": 0.5644,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.001,+ "confidence": 0.999,+ "answer_confidence": 0.999,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 225,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2209,+ "technical": 0.1229,+ "other": 0.6562+ },+ "confidence": 0.2102,+ "answer_confidence": 0.6562,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9522,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2022,+ "1": 0.6435,+ "2": 0.1543+ },+ "confidence": 0.1851,+ "answer_confidence": 0.6435,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0019,+ "confidence": 0.9981,+ "answer_confidence": 0.9981,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 117,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3429,+ "technical": 0.1539,+ "other": 0.5033+ },+ "confidence": 0.0892,+ "answer_confidence": 0.5033,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9555,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1784,+ "1": 0.6876,+ "2": 0.1339+ },+ "confidence": 0.2406,+ "answer_confidence": 0.6876,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.001,+ "confidence": 0.999,+ "answer_confidence": 0.999,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 135,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5255,+ "technical": 0.1426,+ "other": 0.3319+ },+ "confidence": 0.1062,+ "answer_confidence": 0.5255,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0067,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.165,+ "1": 0.6633,+ "2": 0.1717+ },+ "confidence": 0.2062,+ "answer_confidence": 0.6633,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0008,+ "confidence": 0.9992,+ "answer_confidence": 0.9992,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 153,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9448,+ "technical": 0.0019,+ "other": 0.0533+ },+ "confidence": 0.7979,+ "answer_confidence": 0.9448,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2482,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0276,+ "1": 0.6967,+ "2": 0.2758+ },+ "confidence": 0.3573,+ "answer_confidence": 0.6967,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0793,+ "confidence": 0.9207,+ "answer_confidence": 0.9207,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 348,+ "output_tokens": 0,+ "state_tokens": 84,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4408,+ "technical": 0.1294,+ "other": 0.4297+ },+ "confidence": 0.1001,+ "answer_confidence": 0.4408,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1102,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1325,+ "1": 0.6248,+ "2": 0.2427+ },+ "confidence": 0.1759,+ "answer_confidence": 0.6248,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0006,+ "confidence": 0.9994,+ "answer_confidence": 0.9994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 204,+ "output_tokens": 0,+ "state_tokens": 36,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4908,+ "technical": 0.146,+ "other": 0.3633+ },+ "confidence": 0.0915,+ "answer_confidence": 0.4908,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1341,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1639,+ "1": 0.5381,+ "2": 0.298+ },+ "confidence": 0.0983,+ "answer_confidence": 0.5381,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0005,+ "confidence": 0.9995,+ "answer_confidence": 0.9995,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 225,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4493,+ "technical": 0.1573,+ "other": 0.3934+ },+ "confidence": 0.0739,+ "answer_confidence": 0.4493,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.1835,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1551,+ "1": 0.5063,+ "2": 0.3386+ },+ "confidence": 0.0895,+ "answer_confidence": 0.5063,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0004,+ "confidence": 0.9996,+ "answer_confidence": 0.9996,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 246,+ "output_tokens": 0,+ "state_tokens": 50,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.21,+ "technical": 0.1104,+ "other": 0.6796+ },+ "confidence": 0.2412,+ "answer_confidence": 0.6796,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9855,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1809,+ "1": 0.6526,+ "2": 0.1664+ },+ "confidence": 0.1933,+ "answer_confidence": 0.6526,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0013,+ "confidence": 0.9987,+ "answer_confidence": 0.9987,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 120,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.9237,+ "technical": 0.0024,+ "other": 0.0739+ },+ "confidence": 0.745,+ "answer_confidence": 0.9237,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.292,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0184,+ "1": 0.6711,+ "2": 0.3104+ },+ "confidence": 0.3589,+ "answer_confidence": 0.6711,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0624,+ "confidence": 0.9376,+ "answer_confidence": 0.9376,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 306,+ "output_tokens": 0,+ "state_tokens": 70,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4746,+ "technical": 0.1093,+ "other": 0.4161+ },+ "confidence": 0.1257,+ "answer_confidence": 0.4746,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0366,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1616,+ "1": 0.6402,+ "2": 0.1982+ },+ "confidence": 0.18,+ "answer_confidence": 0.6402,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0007,+ "confidence": 0.9993,+ "answer_confidence": 0.9993,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 162,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.4059,+ "technical": 0.0931,+ "other": 0.501+ },+ "confidence": 0.1505,+ "answer_confidence": 0.501,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0468,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1712,+ "1": 0.6109,+ "2": 0.218+ },+ "confidence": 0.1487,+ "answer_confidence": 0.6109,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0006,+ "confidence": 0.9994,+ "answer_confidence": 0.9994,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 183,+ "output_tokens": 0,+ "state_tokens": 29,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 96+ ],+ [+ 6,+ 59+ ],+ [+ 6,+ 126+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 53+ ],+ [+ 6,+ 118+ ],+ [+ 6,+ 84+ ],+ [+ 6,+ 104+ ],+ [+ 6,+ 63+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/index.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/index.jsonindex 5c2bf1ce..eb70e281 100644--- a/laya-dotnet/tests/Laya.Tests/golden/multilingual/index.json+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/index.json@@ -162,5 +162,191 @@"file": "case_long_no_state_room.json","expects_error": true,"kind": "long"+ },+ {+ "name": "batch_one_state",+ "file": "case_batch_one_state.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_mixed",+ "file": "case_batch_mixed.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_1",+ "file": "case_batch_size_1.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_3",+ "file": "case_batch_size_3.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_over_len",+ "file": "case_batch_size_over_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_zero",+ "file": "case_batch_size_zero.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_negative",+ "file": "case_batch_size_negative.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_on",+ "file": "case_batch_sort_on.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_off",+ "file": "case_batch_sort_off.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_3",+ "file": "case_batch_sort_size_3.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_partial_window",+ "file": "case_batch_sort_partial_window.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_no_batch_size",+ "file": "case_batch_sort_no_batch_size.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_1",+ "file": "case_batch_sort_size_1.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_eq_len",+ "file": "case_batch_sort_size_eq_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_over_len",+ "file": "case_batch_sort_size_over_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_zero",+ "file": "case_batch_sort_size_zero.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_truncated",+ "file": "case_batch_truncated.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_truncated_sorted",+ "file": "case_batch_truncated_sorted.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_duplicate_states",+ "file": "case_batch_duplicate_states.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_states",+ "file": "case_batch_empty_states.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_states_invalid_questions",+ "file": "case_batch_empty_states_invalid_questions.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_questions",+ "file": "case_batch_empty_questions.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_both",+ "file": "case_batch_empty_both.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sorted",+ "file": "case_batch_sorted.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sorted_windows",+ "file": "case_batch_sorted_windows.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_unsorted_windows",+ "file": "case_batch_unsorted_windows.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_chunked",+ "file": "case_batch_chunked.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_single_question",+ "file": "case_batch_single_question.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_questions_with_options",+ "file": "case_batch_empty_questions_with_options.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_none_state",+ "file": "case_batch_none_state.json",+ "expects_error": true,+ "kind": "batch"+ },+ {+ "name": "batch_options_exceed_head",+ "file": "case_batch_options_exceed_head.json",+ "expects_error": true,+ "kind": "batch"}]diff --git a/laya-dotnet/tests/Laya.Tests/golden/multilingual/meta.json b/laya-dotnet/tests/Laya.Tests/golden/multilingual/meta.jsonindex b52f1a0b..b1c4ab8c 100644--- a/laya-dotnet/tests/Laya.Tests/golden/multilingual/meta.json+++ b/laya-dotnet/tests/Laya.Tests/golden/multilingual/meta.json@@ -1,7 +1,7 @@{"generator": "tools/dump_golden.py","onnx_dir": "multilingual",- "laya_version": "0.4.11",+ "laya_version": "0.4.14","onnxruntime_version": "1.30.0","transformers_version": "5.17.0","config": {diff --git a/laya-dotnet/tests/Laya.Tests/golden/routing/meta.json b/laya-dotnet/tests/Laya.Tests/golden/routing/meta.jsonindex 7582cc30..444edfcb 100644--- a/laya-dotnet/tests/Laya.Tests/golden/routing/meta.json+++ b/laya-dotnet/tests/Laya.Tests/golden/routing/meta.json@@ -1,6 +1,6 @@{"generator": "tools/dump_routing_golden.py",- "laya_version": "0.4.13",+ "laya_version": "0.4.14","default_shortlist_k": 20,"notes": {"route_probe": "RouteDecision is serialized as {model, reason, detection, workflow}; 'repo' is intentionally omitted (not part of the ported RouteDecision).",@@ -9,6 +9,8 @@"counts": {"lang_probe": 246,"route_probe": 142,+ "route_batch_probe": 10,+ "route_batch_probe_errors": 6,"email_probe_clean": 253,"email_probe_state": 22,"shortlist_probe": 22,diff --git a/laya-dotnet/tests/Laya.Tests/golden/routing/route_batch_probe.json b/laya-dotnet/tests/Laya.Tests/golden/routing/route_batch_probe.jsonnew file mode 100644index 00000000..f3470247--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/routing/route_batch_probe.json@@ -0,0 +1,1061 @@+{+ "cases": [+ {+ "label": "empty",+ "router_kwargs": {},+ "requests": [],+ "decisions": []+ },+ {+ "label": "single_english",+ "router_kwargs": {},+ "requests": [+ {+ "state": "I was charged twice, please refund.",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ }+ ],+ "decisions": [+ {+ "model": "english",+ "reason": "English Latin text",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "en",+ "is_english": true,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ }+ ]+ },+ {+ "label": "mixed_order",+ "router_kwargs": {},+ "requests": [+ {+ "state": "I was charged twice, please refund.",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": "Der Kunde wurde zweimal belastet und moechte eine Rueckerstattung fuer die Rechnung die nicht korrekt ist",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": {+ "body": "मुझसे दो बार शुल्क लिया गया"+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": "I was charged twice, please refund.",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ }+ ],+ "decisions": [+ {+ "model": "english",+ "reason": "English Latin text",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "en",+ "is_english": true,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "Latin script but language looks like 'de', not English",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "de",+ "is_english": false,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "non-Latin script (devanagari, 100% of letters); the English checkpoint cannot read it",+ "detection": {+ "script": "devanagari",+ "script_profile": {+ "devanagari": 1.0+ },+ "language": null,+ "is_english": false,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 1.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "english",+ "reason": "English Latin text",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "en",+ "is_english": true,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ }+ ]+ },+ {+ "label": "per_request_overrides",+ "router_kwargs": {},+ "requests": [+ {+ "state": "hello",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "model": "ml"+ },+ {+ "state": "hello",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "task": "typed_decisions"+ },+ {+ "state": "मुझसे दो बार",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "en"+ },+ {+ "state": "hello",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "de"+ },+ {+ "state": "hello",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "C",+ "lang_guess": "ro"+ },+ {+ "state": "Care este ora in Tokyo?",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang_guess": "ro"+ },+ {+ "state": "Care este ora in Tokyo?",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang_guess": "en"+ },+ {+ "state": "Care este ora in Tokyo?",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang_guess": "und"+ },+ {+ "state": "x",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "model": "english",+ "lang_guess": "ro"+ }+ ],+ "decisions": [+ {+ "model": "multilingual",+ "reason": "explicit model='ml'",+ "detection": null,+ "workflow": null+ },+ {+ "model": "typed-decisions",+ "reason": "explicit task='typed_decisions'",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "explicit lang='en'",+ "detection": null,+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "explicit lang='de'",+ "detection": null,+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "lang_guess: the caller identified this as non-English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "lang_guess: the caller identified this as non-English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "lang_guess: the caller identified this as English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "English Latin text",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "en",+ "is_english": true,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "english",+ "reason": "explicit model='english'",+ "detection": null,+ "workflow": null+ }+ ]+ },+ {+ "label": "installed_lang_guess",+ "router_kwargs": {+ "lang_guess": "ro"+ },+ "requests": [+ {+ "state": "Care este ora in Tokyo?",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": "Care este ora in Tokyo?",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang_guess": "en"+ },+ {+ "state": "Care este ora in Tokyo?",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang_guess": "C"+ }+ ],+ "decisions": [+ {+ "model": "multilingual",+ "reason": "Router(lang_guess=...): the caller identified this as non-English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "lang_guess: the caller identified this as English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "Router(lang_guess=...): the caller identified this as non-English text",+ "detection": null,+ "workflow": null+ }+ ]+ },+ {+ "label": "auto_task_workflow",+ "router_kwargs": {+ "auto_task_detection": true+ },+ "requests": [+ {+ "state": {+ "body": "I was charged twice"+ },+ "questions": {+ "action": {+ "type": "noul",+ "instructions": "x"+ },+ "category": {+ "type": "noul",+ "instructions": "x"+ },+ "churn_risk": {+ "type": "noul",+ "instructions": "x"+ },+ "needs_human": {+ "type": "noul",+ "instructions": "x"+ },+ "urgency": {+ "type": "noul",+ "instructions": "x"+ }+ }+ },+ {+ "state": {+ "body": "I was charged twice"+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": "x",+ "questions": {+ "action": {+ "type": "noul",+ "instructions": "x"+ },+ "category": {+ "type": "noul",+ "instructions": "x"+ },+ "churn_risk": {+ "type": "noul",+ "instructions": "x"+ },+ "needs_human": {+ "type": "noul",+ "instructions": "x"+ },+ "urgency": {+ "type": "noul",+ "instructions": "x"+ }+ },+ "lang_guess": "ro"+ }+ ],+ "decisions": [+ {+ "model": "typed-decisions",+ "reason": "question ids match the 'customer_service' typed-decisions workflow",+ "detection": null,+ "workflow": "customer_service"+ },+ {+ "model": "english",+ "reason": "English Latin text",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "en",+ "is_english": true,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "typed-decisions",+ "reason": "question ids match the 'customer_service' typed-decisions workflow",+ "detection": null,+ "workflow": "customer_service"+ }+ ]+ },+ {+ "label": "custom_default",+ "router_kwargs": {+ "default": "english"+ },+ "requests": [+ {+ "state": "12345",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": "Hello",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ }+ ],+ "decisions": [+ {+ "model": "english",+ "reason": "no letters detected in state; using default (english)",+ "detection": {+ "script": "unknown",+ "script_profile": {},+ "language": null,+ "is_english": true,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "english",+ "reason": "Latin script, language not identified and no non-English letters; using default (english)",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": null,+ "is_english": true,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ }+ ]+ },+ {+ "label": "falsy_states",+ "router_kwargs": {},+ "requests": [+ {+ "state": "",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": {},+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": [],+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": 0,+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ }+ ],+ "decisions": [+ {+ "model": "multilingual",+ "reason": "no letters detected in state; using default (multilingual)",+ "detection": {+ "script": "unknown",+ "script_profile": {},+ "language": null,+ "is_english": true,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "no letters detected in state; using default (multilingual)",+ "detection": {+ "script": "unknown",+ "script_profile": {},+ "language": null,+ "is_english": true,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "no letters detected in state; using default (multilingual)",+ "detection": {+ "script": "unknown",+ "script_profile": {},+ "language": null,+ "is_english": true,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "multilingual",+ "reason": "no letters detected in state; using default (multilingual)",+ "detection": {+ "script": "unknown",+ "script_profile": {},+ "language": null,+ "is_english": true,+ "language_undecided": true,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ }+ ]+ },+ {+ "label": "lang_variants",+ "router_kwargs": {},+ "requests": [+ {+ "state": {+ "body": "I was charged twice, please refund this order."+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "fr"+ },+ {+ "state": {+ "body": "मुझसे दो बार शुल्क लिया गया"+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "en-US"+ },+ {+ "state": {+ "body": "I was charged twice, please refund this order."+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "C"+ },+ {+ "state": {+ "body": "मुझसे दो बार शुल्क लिया गया"+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "model": "english"+ }+ ],+ "decisions": [+ {+ "model": "multilingual",+ "reason": "explicit lang='fr'",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "explicit lang='en-US'",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "English Latin text",+ "detection": {+ "script": "latin",+ "script_profile": {+ "latin": 1.0+ },+ "language": "en",+ "is_english": true,+ "language_undecided": false,+ "diacritic_rate": 0.0,+ "non_latin_fraction": 0.0,+ "mixed_segment": null+ },+ "workflow": null+ },+ {+ "model": "english",+ "reason": "explicit model='english'",+ "detection": null,+ "workflow": null+ }+ ]+ },+ {+ "label": "installed_lang_guess_lang_wins",+ "router_kwargs": {+ "lang_guess": "de"+ },+ "requests": [+ {+ "state": {+ "body": "I was charged twice, please refund this order."+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": {+ "body": "I was charged twice, please refund this order."+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang_guess": "en"+ },+ {+ "state": {+ "body": "I was charged twice, please refund this order."+ },+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "lang": "en"+ }+ ],+ "decisions": [+ {+ "model": "multilingual",+ "reason": "Router(lang_guess=...): the caller identified this as non-English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "lang_guess: the caller identified this as English text",+ "detection": null,+ "workflow": null+ },+ {+ "model": "english",+ "reason": "explicit lang='en'",+ "detection": null,+ "workflow": null+ }+ ]+ }+ ],+ "errors": [+ {+ "label": "state_none",+ "router_kwargs": {},+ "requests": [+ {+ "state": "ok",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": null,+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ }+ ],+ "error_type": "TypeError",+ "error_message": "request 1 'state' must not be None; pass a string, dict, or list"+ },+ {+ "label": "state_missing",+ "router_kwargs": {},+ "requests": [+ {+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ }+ ],+ "error_type": "ValueError",+ "error_message": "request 0 is missing required key 'state'"+ },+ {+ "label": "questions_missing",+ "router_kwargs": {},+ "requests": [+ {+ "state": "ok"+ }+ ],+ "error_type": "ValueError",+ "error_message": "request 0 is missing required key 'questions'"+ },+ {+ "label": "questions_none",+ "router_kwargs": {},+ "requests": [+ {+ "state": "ok",+ "questions": null+ }+ ],+ "error_type": "TypeError",+ "error_message": "request 0 'questions' must be a dict, got NoneType"+ },+ {+ "label": "unknown_model",+ "router_kwargs": {},+ "requests": [+ {+ "state": "ok",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ {+ "state": "ok",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ },+ "model": "gpt"+ }+ ],+ "error_type": "ValueError",+ "error_message": "unknown model 'gpt'; choose one of ['english', 'multilingual', 'typed-decisions'] (or an alias: ['decisions', 'default', 'en', 'laya', 'laya-multilingual', 'laya-typed-decisions', 'ml', 'multi', 'typed', 'typed_decisions'])"+ },+ {+ "label": "request_not_dict",+ "router_kwargs": {},+ "requests": [+ {+ "state": "ok",+ "questions": {+ "dept": {+ "type": "choice",+ "instructions": "Which team?",+ "criteria": {+ "billing": null,+ "tech": null+ }+ }+ }+ },+ "ok"+ ],+ "error_type": "TypeError",+ "error_message": "request 1 must be a dict, got str"+ }+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_chunked.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_chunked.jsonnew file mode 100644index 00000000..73a35af8--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_chunked.json@@ -0,0 +1,466 @@+{+ "name": "batch_chunked",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ],+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint. Turn 140: the agent restated the refund policy and the customer repeated the complaint. Turn 141: the agent restated the refund policy and the customer repeated the complaint. Turn 142: the agent restated the refund policy and the customer repeated the complaint. Turn 143: the agent restated the refund policy and the customer repeated the complaint. Turn 144: the agent restated the refund policy and the customer repeated the complaint. Turn 145: the agent restated the refund policy and the customer repeated the complaint. Turn 146: the agent restated the refund policy and the customer repeated the complaint. Turn 147: the agent restated the refund policy and the customer repeated the complaint. Turn 148: the agent restated the refund policy and the customer repeated the complaint. Turn 149: the agent restated the refund policy and the customer repeated the complaint. Turn 150: the agent restated the refund policy and the customer repeated the complaint. Turn 151: the agent restated the refund policy and the customer repeated the complaint. Turn 152: the agent restated the refund policy and the customer repeated the complaint. Turn 153: the agent restated the refund policy and the customer repeated the complaint. Turn 154: the agent restated the refund policy and the customer repeated the complaint. Turn 155: the agent restated the refund policy and the customer repeated the complaint. Turn 156: the agent restated the refund policy and the customer repeated the complaint. Turn 157: the agent restated the refund policy and the customer repeated the complaint. Turn 158: the agent restated the refund policy and the customer repeated the complaint. Turn 159: the agent restated the refund policy and the customer repeated the complaint. Turn 160: the agent restated the refund policy and the customer repeated the complaint. Turn 161: the agent restated the refund policy and the customer repeated the complaint. Turn 162: the agent restated the refund policy and the customer repeated the complaint. Turn 163: the agent restated the refund policy and the customer repeated the complaint. Turn 164: the agent restated the refund policy and the customer repeated the complaint. Turn 165: the agent restated the refund policy and the customer repeated the complaint. Turn 166: the agent restated the refund policy and the customer repeated the complaint. Turn 167: the agent restated the refund policy and the customer repeated the complaint. Turn 168: the agent restated the refund policy and the customer repeated the complaint. Turn 169: the agent restated the refund policy and the customer repeated the complaint. Turn 170: the agent restated the refund policy and the customer repeated the complaint. Turn 171: the agent restated the refund policy and the customer repeated the complaint. Turn 172: the agent restated the refund policy and the customer repeated the complaint. Turn 173: the agent restated the refund policy and the customer repeated the complaint. Turn 174: the agent restated the refund policy and the customer repeated the complaint. Turn 175: the agent restated the refund policy and the customer repeated the complaint. Turn 176: the agent restated the refund policy and the customer repeated the complaint. Turn 177: the agent restated the refund policy and the customer repeated the complaint. Turn 178: the agent restated the refund policy and the customer repeated the complaint. Turn 179: the agent restated the refund policy and the customer repeated the complaint. Turn 180: the agent restated the refund policy and the customer repeated the complaint. Turn 181: the agent restated the refund policy and the customer repeated the complaint. Turn 182: the agent restated the refund policy and the customer repeated the complaint. Turn 183: the agent restated the refund policy and the customer repeated the complaint. Turn 184: the agent restated the refund policy and the customer repeated the complaint. Turn 185: the agent restated the refund policy and the customer repeated the complaint. Turn 186: the agent restated the refund policy and the customer repeated the complaint. Turn 187: the agent restated the refund policy and the customer repeated the complaint. Turn 188: the agent restated the refund policy and the customer repeated the complaint. Turn 189: the agent restated the refund policy and the customer repeated the complaint. Turn 190: the agent restated the refund policy and the customer repeated the complaint. Turn 191: the agent restated the refund policy and the customer repeated the complaint. Turn 192: the agent restated the refund policy and the customer repeated the complaint. Turn 193: the agent restated the refund policy and the customer repeated the complaint. Turn 194: the agent restated the refund policy and the customer repeated the complaint. Turn 195: the agent restated the refund policy and the customer repeated the complaint. Turn 196: the agent restated the refund policy and the customer repeated the complaint. Turn 197: the agent restated the refund policy and the customer repeated the complaint. Turn 198: the agent restated the refund policy and the customer repeated the complaint. Turn 199: the agent restated the refund policy and the customer repeated the complaint. Turn 200: the agent restated the refund policy and the customer repeated the complaint. Turn 201: the agent restated the refund policy and the customer repeated the complaint. Turn 202: the agent restated the refund policy and the customer repeated the complaint. Turn 203: the agent restated the refund policy and the customer repeated the complaint. Turn 204: the agent restated the refund policy and the customer repeated the complaint. Turn 205: the agent restated the refund policy and the customer repeated the complaint. Turn 206: the agent restated the refund policy and the customer repeated the complaint. Turn 207: the agent restated the refund policy and the customer repeated the complaint. Turn 208: the agent restated the refund policy and the customer repeated the complaint. Turn 209: the agent restated the refund policy and the customer repeated the complaint. Turn 210: the agent restated the refund policy and the customer repeated the complaint. Turn 211: the agent restated the refund policy and the customer repeated the complaint. Turn 212: the agent restated the refund policy and the customer repeated the complaint. Turn 213: the agent restated the refund policy and the customer repeated the complaint. Turn 214: the agent restated the refund policy and the customer repeated the complaint. Turn 215: the agent restated the refund policy and the customer repeated the complaint. Turn 216: the agent restated the refund policy and the customer repeated the complaint. Turn 217: the agent restated the refund policy and the customer repeated the complaint. Turn 218: the agent restated the refund policy and the customer repeated the complaint. Turn 219: the agent restated the refund policy and the customer repeated the complaint. Turn 220: the agent restated the refund policy and the customer repeated the complaint. Turn 221: the agent restated the refund policy and the customer repeated the complaint. Turn 222: the agent restated the refund policy and the customer repeated the complaint. Turn 223: the agent restated the refund policy and the customer repeated the complaint. Turn 224: the agent restated the refund policy and the customer repeated the complaint. Turn 225: the agent restated the refund policy and the customer repeated the complaint. Turn 226: the agent restated the refund policy and the customer repeated the complaint. Turn 227: the agent restated the refund policy and the customer repeated the complaint. Turn 228: the agent restated the refund policy and the customer repeated the complaint. Turn 229: the agent restated the refund policy and the customer repeated the complaint. Turn 230: the agent restated the refund policy and the customer repeated the complaint. Turn 231: the agent restated the refund policy and the customer repeated the complaint. Turn 232: the agent restated the refund policy and the customer repeated the complaint. Turn 233: the agent restated the refund policy and the customer repeated the complaint. Turn 234: the agent restated the refund policy and the customer repeated the complaint. Turn 235: the agent restated the refund policy and the customer repeated the complaint. Turn 236: the agent restated the refund policy and the customer repeated the complaint. Turn 237: the agent restated the refund policy and the customer repeated the complaint. Turn 238: the agent restated the refund policy and the customer repeated the complaint. Turn 239: the agent restated the refund policy and the customer repeated the complaint. Turn 240: the agent restated the refund policy and the customer repeated the complaint. Turn 241: the agent restated the refund policy and the customer repeated the complaint. Turn 242: the agent restated the refund policy and the customer repeated the complaint. Turn 243: the agent restated the refund policy and the customer repeated the complaint. Turn 244: the agent restated the refund policy and the customer repeated the complaint. Turn 245: the agent restated the refund policy and the customer repeated the complaint. Turn 246: the agent restated the refund policy and the customer repeated the complaint. Turn 247: the agent restated the refund policy and the customer repeated the complaint. Turn 248: the agent restated the refund policy and the customer repeated the complaint. Turn 249: the agent restated the refund policy and the customer repeated the complaint. Turn 250: the agent restated the refund policy and the customer repeated the complaint. Turn 251: the agent restated the refund policy and the customer repeated the complaint. Turn 252: the agent restated the refund policy and the customer repeated the complaint. Turn 253: the agent restated the refund policy and the customer repeated the complaint. Turn 254: the agent restated the refund policy and the customer repeated the complaint. Turn 255: the agent restated the refund policy and the customer repeated the complaint. Turn 256: the agent restated the refund policy and the customer repeated the complaint. Turn 257: the agent restated the refund policy and the customer repeated the complaint. Turn 258: the agent restated the refund policy and the customer repeated the complaint. Turn 259: the agent restated the refund policy and the customer repeated the complaint. Turn 260: the agent restated the refund policy and the customer repeated the complaint. Turn 261: the agent restated the refund policy and the customer repeated the complaint. Turn 262: the agent restated the refund policy and the customer repeated the complaint. Turn 263: the agent restated the refund policy and the customer repeated the complaint. Turn 264: the agent restated the refund policy and the customer repeated the complaint. Turn 265: the agent restated the refund policy and the customer repeated the complaint. Turn 266: the agent restated the refund policy and the customer repeated the complaint. Turn 267: the agent restated the refund policy and the customer repeated the complaint. Turn 268: the agent restated the refund policy and the customer repeated the complaint. Turn 269: the agent restated the refund policy and the customer repeated the complaint. Turn 270: the agent restated the refund policy and the customer repeated the complaint. Turn 271: the agent restated the refund policy and the customer repeated the complaint. Turn 272: the agent restated the refund policy and the customer repeated the complaint. Turn 273: the agent restated the refund policy and the customer repeated the complaint. Turn 274: the agent restated the refund policy and the customer repeated the complaint. Turn 275: the agent restated the refund policy and the customer repeated the complaint. Turn 276: the agent restated the refund policy and the customer repeated the complaint. Turn 277: the agent restated the refund policy and the customer repeated the complaint. Turn 278: the agent restated the refund policy and the customer repeated the complaint. Turn 279: the agent restated the refund policy and the customer repeated the complaint. Turn 280: the agent restated the refund policy and the customer repeated the complaint. Turn 281: the agent restated the refund policy and the customer repeated the complaint. Turn 282: the agent restated the refund policy and the customer repeated the complaint. Turn 283: the agent restated the refund policy and the customer repeated the complaint. Turn 284: the agent restated the refund policy and the customer repeated the complaint. Turn 285: the agent restated the refund policy and the customer repeated the complaint. Turn 286: the agent restated the refund policy and the customer repeated the complaint. Turn 287: the agent restated the refund policy and the customer repeated the complaint. Turn 288: the agent restated the refund policy and the customer repeated the complaint. Turn 289: the agent restated the refund policy and the customer repeated the complaint. Turn 290: the agent restated the refund policy and the customer repeated the complaint. Turn 291: the agent restated the refund policy and the customer repeated the complaint. Turn 292: the agent restated the refund policy and the customer repeated the complaint. Turn 293: the agent restated the refund policy and the customer repeated the complaint. Turn 294: the agent restated the refund policy and the customer repeated the complaint. Turn 295: the agent restated the refund policy and the customer repeated the complaint. Turn 296: the agent restated the refund policy and the customer repeated the complaint. Turn 297: the agent restated the refund policy and the customer repeated the complaint. Turn 298: the agent restated the refund policy and the customer repeated the complaint. Turn 299: the agent restated the refund policy and the customer repeated the complaint. Turn 300: the agent restated the refund policy and the customer repeated the complaint. Turn 301: the agent restated the refund policy and the customer repeated the complaint. Turn 302: the agent restated the refund policy and the customer repeated the complaint. Turn 303: the agent restated the refund policy and the customer repeated the complaint. Turn 304: the agent restated the refund policy and the customer repeated the complaint. Turn 305: the agent restated the refund policy and the customer repeated the complaint. Turn 306: the agent restated the refund policy and the customer repeated the complaint. Turn 307: the agent restated the refund policy and the customer repeated the complaint. Turn 308: the agent restated the refund policy and the customer repeated the complaint. Turn 309: the agent restated the refund policy and the customer repeated the complaint. Turn 310: the agent restated the refund policy and the customer repeated the complaint. Turn 311: the agent restated the refund policy and the customer repeated the complaint. Turn 312: the agent restated the refund policy and the customer repeated the complaint. Turn 313: the agent restated the refund policy and the customer repeated the complaint. Turn 314: the agent restated the refund policy and the customer repeated the complaint. Turn 315: the agent restated the refund policy and the customer repeated the complaint. Turn 316: the agent restated the refund policy and the customer repeated the complaint. Turn 317: the agent restated the refund policy and the customer repeated the complaint. Turn 318: the agent restated the refund policy and the customer repeated the complaint. Turn 319: the agent restated the refund policy and the customer repeated the complaint. Turn 320: the agent restated the refund policy and the customer repeated the complaint. Turn 321: the agent restated the refund policy and the customer repeated the complaint. Turn 322: the agent restated the refund policy and the customer repeated the complaint. Turn 323: the agent restated the refund policy and the customer repeated the complaint. Turn 324: the agent restated the refund policy and the customer repeated the complaint. Turn 325: the agent restated the refund policy and the customer repeated the complaint. Turn 326: the agent restated the refund policy and the customer repeated the complaint. Turn 327: the agent restated the refund policy and the customer repeated the complaint. Turn 328: the agent restated the refund policy and the customer repeated the complaint. Turn 329: the agent restated the refund policy and the customer repeated the complaint. Turn 330: the agent restated the refund policy and the customer repeated the complaint. Turn 331: the agent restated the refund policy and the customer repeated the complaint. Turn 332: the agent restated the refund policy and the customer repeated the complaint. Turn 333: the agent restated the refund policy and the customer repeated the complaint. Turn 334: the agent restated the refund policy and the customer repeated the complaint. Turn 335: the agent restated the refund policy and the customer repeated the complaint. Turn 336: the agent restated the refund policy and the customer repeated the complaint. Turn 337: the agent restated the refund policy and the customer repeated the complaint. Turn 338: the agent restated the refund policy and the customer repeated the complaint. Turn 339: the agent restated the refund policy and the customer repeated the complaint. Turn 340: the agent restated the refund policy and the customer repeated the complaint. Turn 341: the agent restated the refund policy and the customer repeated the complaint. Turn 342: the agent restated the refund policy and the customer repeated the complaint. Turn 343: the agent restated the refund policy and the customer repeated the complaint. Turn 344: the agent restated the refund policy and the customer repeated the complaint. Turn 345: the agent restated the refund policy and the customer repeated the complaint. Turn 346: the agent restated the refund policy and the customer repeated the complaint. Turn 347: the agent restated the refund policy and the customer repeated the complaint. Turn 348: the agent restated the refund policy and the customer repeated the complaint. Turn 349: the agent restated the refund policy and the customer repeated the complaint. Turn 350: the agent restated the refund policy and the customer repeated the complaint. Turn 351: the agent restated the refund policy and the customer repeated the complaint. Turn 352: the agent restated the refund policy and the customer repeated the complaint. Turn 353: the agent restated the refund policy and the customer repeated the complaint. Turn 354: the agent restated the refund policy and the customer repeated the complaint. Turn 355: the agent restated the refund policy and the customer repeated the complaint. Turn 356: the agent restated the refund policy and the customer repeated the complaint. Turn 357: the agent restated the refund policy and the customer repeated the complaint. Turn 358: the agent restated the refund policy and the customer repeated the complaint. Turn 359: the agent restated the refund policy and the customer repeated the complaint. Turn 360: the agent restated the refund policy and the customer repeated the complaint. Turn 361: the agent restated the refund policy and the customer repeated the complaint. Turn 362: the agent restated the refund policy and the customer repeated the complaint. Turn 363: the agent restated the refund policy and the customer repeated the complaint. Turn 364: the agent restated the refund policy and the customer repeated the complaint. Turn 365: the agent restated the refund policy and the customer repeated the complaint. Turn 366: the agent restated the refund policy and the customer repeated the complaint. Turn 367: the agent restated the refund policy and the customer repeated the complaint. Turn 368: the agent restated the refund policy and the customer repeated the complaint. Turn 369: the agent restated the refund policy and the customer repeated the complaint. Turn 370: the agent restated the refund policy and the customer repeated the complaint. Turn 371: the agent restated the refund policy and the customer repeated the complaint. Turn 372: the agent restated the refund policy and the customer repeated the complaint. Turn 373: the agent restated the refund policy and the customer repeated the complaint. Turn 374: the agent restated the refund policy and the customer repeated the complaint. Turn 375: the agent restated the refund policy and the customer repeated the complaint. Turn 376: the agent restated the refund policy and the customer repeated the complaint. Turn 377: the agent restated the refund policy and the customer repeated the complaint. Turn 378: the agent restated the refund policy and the customer repeated the complaint. Turn 379: the agent restated the refund policy and the customer repeated the complaint. Turn 380: the agent restated the refund policy and the customer repeated the complaint. Turn 381: the agent restated the refund policy and the customer repeated the complaint. Turn 382: the agent restated the refund policy and the customer repeated the complaint. Turn 383: the agent restated the refund policy and the customer repeated the complaint. Turn 384: the agent restated the refund policy and the customer repeated the complaint. Turn 385: the agent restated the refund policy and the customer repeated the complaint. Turn 386: the agent restated the refund policy and the customer repeated the complaint. Turn 387: the agent restated the refund policy and the customer repeated the complaint. Turn 388: the agent restated the refund policy and the customer repeated the complaint. Turn 389: the agent restated the refund policy and the customer repeated the complaint. Turn 390: the agent restated the refund policy and the customer repeated the complaint. Turn 391: the agent restated the refund policy and the customer repeated the complaint. Turn 392: the agent restated the refund policy and the customer repeated the complaint. Turn 393: the agent restated the refund policy and the customer repeated the complaint. Turn 394: the agent restated the refund policy and the customer repeated the complaint. Turn 395: the agent restated the refund policy and the customer repeated the complaint. Turn 396: the agent restated the refund policy and the customer repeated the complaint. Turn 397: the agent restated the refund policy and the customer repeated the complaint. Turn 398: the agent restated the refund policy and the customer repeated the complaint. Turn 399: the agent restated the refund policy and the customer repeated the complaint.",+ "The app crashes on login since yesterday's update.",+ "ok"+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3+ },+ "state_widths": [+ 91,+ 44,+ 157,+ 74,+ 1024,+ 44,+ 35+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4925,+ "technical": 0.3304,+ "other": 0.1771+ },+ "confidence": 0.0704,+ "answer_confidence": 0.4925,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2205,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2895,+ "1": 0.2006,+ "2": 0.51+ },+ "confidence": 0.0675,+ "answer_confidence": 0.51,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0363,+ "confidence": 0.9637,+ "answer_confidence": 0.9637,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5409,+ "technical": 0.2757,+ "other": 0.1834+ },+ "confidence": 0.0909,+ "answer_confidence": 0.5409,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.138,+ "2": 0.8347+ },+ "confidence": 0.5244,+ "answer_confidence": 0.8347,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7748,+ "confidence": 0.7748,+ "answer_confidence": 0.7748,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5116,+ "technical": 0.1679,+ "other": 0.3205+ },+ "confidence": 0.0832,+ "answer_confidence": 0.5116,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2127,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1436,+ "1": 0.5002,+ "2": 0.3562+ },+ "confidence": 0.0963,+ "answer_confidence": 0.5002,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2121,+ "confidence": 0.7879,+ "answer_confidence": 0.7879,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 214,+ "output_tokens": 0,+ "state_tokens": 40,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4553,+ "technical": 0.1506,+ "other": 0.3941+ },+ "confidence": 0.0804,+ "answer_confidence": 0.4553,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9401,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3838,+ "1": 0.2923,+ "2": 0.3239+ },+ "confidence": 0.0058,+ "answer_confidence": 0.3838,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1726,+ "confidence": 0.8274,+ "answer_confidence": 0.8274,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 6804,+ "state_tokens_dropped": 5814,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.0616,+ "technical": 0.7487,+ "other": 0.1897+ },+ "confidence": 0.3594,+ "answer_confidence": 0.7487,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4629,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1179,+ "1": 0.3013,+ "2": 0.5808+ },+ "confidence": 0.1543,+ "answer_confidence": 0.5808,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.5343,+ "confidence": 0.5343,+ "answer_confidence": 0.5343,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.3803,+ "technical": 0.2662,+ "other": 0.3535+ },+ "confidence": 0.01,+ "answer_confidence": 0.3803,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8546,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3938,+ "1": 0.3579,+ "2": 0.2483+ },+ "confidence": 0.0164,+ "answer_confidence": 0.3938,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3012,+ "confidence": 0.6988,+ "answer_confidence": 0.6988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 97,+ "output_tokens": 0,+ "state_tokens": 1,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 157+ ],+ [+ 9,+ 1024+ ],+ [+ 3,+ 35+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_duplicate_states.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_duplicate_states.jsonnew file mode 100644index 00000000..849422ab--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_duplicate_states.json@@ -0,0 +1,211 @@+{+ "name": "batch_duplicate_states",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 91,+ 91,+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 91+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_both.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_both.jsonnew file mode 100644index 00000000..8a31ab3d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_both.json@@ -0,0 +1,9 @@+{+ "name": "batch_empty_both",+ "states": [],+ "questions": {},+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_questions.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_questions.jsonnew file mode 100644index 00000000..ea34701f--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_questions.json@@ -0,0 +1,29 @@+{+ "name": "batch_empty_questions",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ ""+ ],+ "questions": {},+ "options": {},+ "state_widths": [],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ }+ ],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_questions_with_options.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_questions_with_options.jsonnew file mode 100644index 00000000..d646aae6--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_questions_with_options.json@@ -0,0 +1,45 @@+{+ "name": "batch_empty_questions_with_options",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ }+ ],+ "questions": {},+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {},+ "usage": {+ "input_tokens": 0,+ "output_tokens": 0+ }+ }+ ],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_states.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_states.jsonnew file mode 100644index 00000000..eabd6424--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_states.json@@ -0,0 +1,32 @@+{+ "name": "batch_empty_states",+ "states": [],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_states_invalid_questions.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_states_invalid_questions.jsonnew file mode 100644index 00000000..d8c82752--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_empty_states_invalid_questions.json@@ -0,0 +1,316 @@+{+ "name": "batch_empty_states_invalid_questions",+ "states": [],+ "questions": {+ "too_wide": {+ "type": "choice",+ "instructions": "Too many options to fit the sequence.",+ "criteria": {+ "opt_000": "description 0",+ "opt_001": "description 1",+ "opt_002": "description 2",+ "opt_003": "description 3",+ "opt_004": "description 4",+ "opt_005": "description 5",+ "opt_006": "description 6",+ "opt_007": "description 7",+ "opt_008": "description 8",+ "opt_009": "description 9",+ "opt_010": "description 10",+ "opt_011": "description 11",+ "opt_012": "description 12",+ "opt_013": "description 13",+ "opt_014": "description 14",+ "opt_015": "description 15",+ "opt_016": "description 16",+ "opt_017": "description 17",+ "opt_018": "description 18",+ "opt_019": "description 19",+ "opt_020": "description 20",+ "opt_021": "description 21",+ "opt_022": "description 22",+ "opt_023": "description 23",+ "opt_024": "description 24",+ "opt_025": "description 25",+ "opt_026": "description 26",+ "opt_027": "description 27",+ "opt_028": "description 28",+ "opt_029": "description 29",+ "opt_030": "description 30",+ "opt_031": "description 31",+ "opt_032": "description 32",+ "opt_033": "description 33",+ "opt_034": "description 34",+ "opt_035": "description 35",+ "opt_036": "description 36",+ "opt_037": "description 37",+ "opt_038": "description 38",+ "opt_039": "description 39",+ "opt_040": "description 40",+ "opt_041": "description 41",+ "opt_042": "description 42",+ "opt_043": "description 43",+ "opt_044": "description 44",+ "opt_045": "description 45",+ "opt_046": "description 46",+ "opt_047": "description 47",+ "opt_048": "description 48",+ "opt_049": "description 49",+ "opt_050": "description 50",+ "opt_051": "description 51",+ "opt_052": "description 52",+ "opt_053": "description 53",+ "opt_054": "description 54",+ "opt_055": "description 55",+ "opt_056": "description 56",+ "opt_057": "description 57",+ "opt_058": "description 58",+ "opt_059": "description 59",+ "opt_060": "description 60",+ "opt_061": "description 61",+ "opt_062": "description 62",+ "opt_063": "description 63",+ "opt_064": "description 64",+ "opt_065": "description 65",+ "opt_066": "description 66",+ "opt_067": "description 67",+ "opt_068": "description 68",+ "opt_069": "description 69",+ "opt_070": "description 70",+ "opt_071": "description 71",+ "opt_072": "description 72",+ "opt_073": "description 73",+ "opt_074": "description 74",+ "opt_075": "description 75",+ "opt_076": "description 76",+ "opt_077": "description 77",+ "opt_078": "description 78",+ "opt_079": "description 79",+ "opt_080": "description 80",+ "opt_081": "description 81",+ "opt_082": "description 82",+ "opt_083": "description 83",+ "opt_084": "description 84",+ "opt_085": "description 85",+ "opt_086": "description 86",+ "opt_087": "description 87",+ "opt_088": "description 88",+ "opt_089": "description 89",+ "opt_090": "description 90",+ "opt_091": "description 91",+ "opt_092": "description 92",+ "opt_093": "description 93",+ "opt_094": "description 94",+ "opt_095": "description 95",+ "opt_096": "description 96",+ "opt_097": "description 97",+ "opt_098": "description 98",+ "opt_099": "description 99",+ "opt_100": "description 100",+ "opt_101": "description 101",+ "opt_102": "description 102",+ "opt_103": "description 103",+ "opt_104": "description 104",+ "opt_105": "description 105",+ "opt_106": "description 106",+ "opt_107": "description 107",+ "opt_108": "description 108",+ "opt_109": "description 109",+ "opt_110": "description 110",+ "opt_111": "description 111",+ "opt_112": "description 112",+ "opt_113": "description 113",+ "opt_114": "description 114",+ "opt_115": "description 115",+ "opt_116": "description 116",+ "opt_117": "description 117",+ "opt_118": "description 118",+ "opt_119": "description 119",+ "opt_120": "description 120",+ "opt_121": "description 121",+ "opt_122": "description 122",+ "opt_123": "description 123",+ "opt_124": "description 124",+ "opt_125": "description 125",+ "opt_126": "description 126",+ "opt_127": "description 127",+ "opt_128": "description 128",+ "opt_129": "description 129",+ "opt_130": "description 130",+ "opt_131": "description 131",+ "opt_132": "description 132",+ "opt_133": "description 133",+ "opt_134": "description 134",+ "opt_135": "description 135",+ "opt_136": "description 136",+ "opt_137": "description 137",+ "opt_138": "description 138",+ "opt_139": "description 139",+ "opt_140": "description 140",+ "opt_141": "description 141",+ "opt_142": "description 142",+ "opt_143": "description 143",+ "opt_144": "description 144",+ "opt_145": "description 145",+ "opt_146": "description 146",+ "opt_147": "description 147",+ "opt_148": "description 148",+ "opt_149": "description 149",+ "opt_150": "description 150",+ "opt_151": "description 151",+ "opt_152": "description 152",+ "opt_153": "description 153",+ "opt_154": "description 154",+ "opt_155": "description 155",+ "opt_156": "description 156",+ "opt_157": "description 157",+ "opt_158": "description 158",+ "opt_159": "description 159",+ "opt_160": "description 160",+ "opt_161": "description 161",+ "opt_162": "description 162",+ "opt_163": "description 163",+ "opt_164": "description 164",+ "opt_165": "description 165",+ "opt_166": "description 166",+ "opt_167": "description 167",+ "opt_168": "description 168",+ "opt_169": "description 169",+ "opt_170": "description 170",+ "opt_171": "description 171",+ "opt_172": "description 172",+ "opt_173": "description 173",+ "opt_174": "description 174",+ "opt_175": "description 175",+ "opt_176": "description 176",+ "opt_177": "description 177",+ "opt_178": "description 178",+ "opt_179": "description 179",+ "opt_180": "description 180",+ "opt_181": "description 181",+ "opt_182": "description 182",+ "opt_183": "description 183",+ "opt_184": "description 184",+ "opt_185": "description 185",+ "opt_186": "description 186",+ "opt_187": "description 187",+ "opt_188": "description 188",+ "opt_189": "description 189",+ "opt_190": "description 190",+ "opt_191": "description 191",+ "opt_192": "description 192",+ "opt_193": "description 193",+ "opt_194": "description 194",+ "opt_195": "description 195",+ "opt_196": "description 196",+ "opt_197": "description 197",+ "opt_198": "description 198",+ "opt_199": "description 199",+ "opt_200": "description 200",+ "opt_201": "description 201",+ "opt_202": "description 202",+ "opt_203": "description 203",+ "opt_204": "description 204",+ "opt_205": "description 205",+ "opt_206": "description 206",+ "opt_207": "description 207",+ "opt_208": "description 208",+ "opt_209": "description 209",+ "opt_210": "description 210",+ "opt_211": "description 211",+ "opt_212": "description 212",+ "opt_213": "description 213",+ "opt_214": "description 214",+ "opt_215": "description 215",+ "opt_216": "description 216",+ "opt_217": "description 217",+ "opt_218": "description 218",+ "opt_219": "description 219",+ "opt_220": "description 220",+ "opt_221": "description 221",+ "opt_222": "description 222",+ "opt_223": "description 223",+ "opt_224": "description 224",+ "opt_225": "description 225",+ "opt_226": "description 226",+ "opt_227": "description 227",+ "opt_228": "description 228",+ "opt_229": "description 229",+ "opt_230": "description 230",+ "opt_231": "description 231",+ "opt_232": "description 232",+ "opt_233": "description 233",+ "opt_234": "description 234",+ "opt_235": "description 235",+ "opt_236": "description 236",+ "opt_237": "description 237",+ "opt_238": "description 238",+ "opt_239": "description 239",+ "opt_240": "description 240",+ "opt_241": "description 241",+ "opt_242": "description 242",+ "opt_243": "description 243",+ "opt_244": "description 244",+ "opt_245": "description 245",+ "opt_246": "description 246",+ "opt_247": "description 247",+ "opt_248": "description 248",+ "opt_249": "description 249",+ "opt_250": "description 250",+ "opt_251": "description 251",+ "opt_252": "description 252",+ "opt_253": "description 253",+ "opt_254": "description 254",+ "opt_255": "description 255",+ "opt_256": "description 256",+ "opt_257": "description 257",+ "opt_258": "description 258",+ "opt_259": "description 259",+ "opt_260": "description 260",+ "opt_261": "description 261",+ "opt_262": "description 262",+ "opt_263": "description 263",+ "opt_264": "description 264",+ "opt_265": "description 265",+ "opt_266": "description 266",+ "opt_267": "description 267",+ "opt_268": "description 268",+ "opt_269": "description 269",+ "opt_270": "description 270",+ "opt_271": "description 271",+ "opt_272": "description 272",+ "opt_273": "description 273",+ "opt_274": "description 274",+ "opt_275": "description 275",+ "opt_276": "description 276",+ "opt_277": "description 277",+ "opt_278": "description 278",+ "opt_279": "description 279",+ "opt_280": "description 280",+ "opt_281": "description 281",+ "opt_282": "description 282",+ "opt_283": "description 283",+ "opt_284": "description 284",+ "opt_285": "description 285",+ "opt_286": "description 286",+ "opt_287": "description 287",+ "opt_288": "description 288",+ "opt_289": "description 289",+ "opt_290": "description 290",+ "opt_291": "description 291",+ "opt_292": "description 292",+ "opt_293": "description 293",+ "opt_294": "description 294",+ "opt_295": "description 295",+ "opt_296": "description 296",+ "opt_297": "description 297",+ "opt_298": "description 298",+ "opt_299": "description 299"+ }+ }+ },+ "options": {},+ "state_widths": [],+ "results": [],+ "runs": []+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_mixed.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_mixed.jsonnew file mode 100644index 00000000..58532154--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_mixed.json@@ -0,0 +1,515 @@+{+ "name": "batch_mixed",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6869,+ "technical": 0.2079,+ "other": 0.1052+ },+ "confidence": 0.2523,+ "answer_confidence": 0.6869,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0204,+ "1": 0.1675,+ "2": 0.8121+ },+ "confidence": 0.5015,+ "answer_confidence": 0.8121,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7602,+ "confidence": 0.7602,+ "answer_confidence": 0.7602,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6718,+ "technical": 0.2244,+ "other": 0.1038+ },+ "confidence": 0.2375,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7672,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0194,+ "1": 0.194,+ "2": 0.7866+ },+ "confidence": 0.4689,+ "answer_confidence": 0.7866,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7234,+ "confidence": 0.7234,+ "answer_confidence": 0.7234,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3741,+ "technical": 0.2268,+ "other": 0.3991+ },+ "confidence": 0.0252,+ "answer_confidence": 0.3991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9031,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.368,+ "1": 0.361,+ "2": 0.2711+ },+ "confidence": 0.0083,+ "answer_confidence": 0.368,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2943,+ "confidence": 0.7057,+ "answer_confidence": 0.7057,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.142,+ "technical": 0.3006,+ "other": 0.5573+ },+ "confidence": 0.1222,+ "answer_confidence": 0.5573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2804,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2652,+ "1": 0.1891,+ "2": 0.5456+ },+ "confidence": 0.092,+ "answer_confidence": 0.5456,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0403,+ "confidence": 0.9597,+ "answer_confidence": 0.9597,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2504,+ "technical": 0.3345,+ "other": 0.4151+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4151,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0394,+ "1": 0.1552,+ "2": 0.8054+ },+ "confidence": 0.4622,+ "answer_confidence": 0.8054,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.776,+ "confidence": 0.776,+ "answer_confidence": 0.776,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1839,+ "technical": 0.4141,+ "other": 0.4019+ },+ "confidence": 0.0507,+ "answer_confidence": 0.4141,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9808,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3293,+ "1": 0.3606,+ "2": 0.3101+ },+ "confidence": 0.0018,+ "answer_confidence": 0.3606,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2948,+ "confidence": 0.7052,+ "answer_confidence": 0.7052,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_none_state.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_none_state.jsonnew file mode 100644index 00000000..560be81a--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_none_state.json@@ -0,0 +1,34 @@+{+ "name": "batch_none_state",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ null+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "error_type": "TypeError",+ "error_message": "state must not be None; pass a string, dict, or list"+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_one_state.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_one_state.jsonnew file mode 100644index 00000000..e04a3370--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_one_state.json@@ -0,0 +1,97 @@+{+ "name": "batch_one_state",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {},+ "state_widths": [+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 91+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_options_exceed_head.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_options_exceed_head.jsonnew file mode 100644index 00000000..1c4ae386--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_options_exceed_head.json@@ -0,0 +1,318 @@+{+ "name": "batch_options_exceed_head",+ "states": [+ "short",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "too_wide": {+ "type": "choice",+ "instructions": "Too many options to fit the sequence.",+ "criteria": {+ "opt_000": "description 0",+ "opt_001": "description 1",+ "opt_002": "description 2",+ "opt_003": "description 3",+ "opt_004": "description 4",+ "opt_005": "description 5",+ "opt_006": "description 6",+ "opt_007": "description 7",+ "opt_008": "description 8",+ "opt_009": "description 9",+ "opt_010": "description 10",+ "opt_011": "description 11",+ "opt_012": "description 12",+ "opt_013": "description 13",+ "opt_014": "description 14",+ "opt_015": "description 15",+ "opt_016": "description 16",+ "opt_017": "description 17",+ "opt_018": "description 18",+ "opt_019": "description 19",+ "opt_020": "description 20",+ "opt_021": "description 21",+ "opt_022": "description 22",+ "opt_023": "description 23",+ "opt_024": "description 24",+ "opt_025": "description 25",+ "opt_026": "description 26",+ "opt_027": "description 27",+ "opt_028": "description 28",+ "opt_029": "description 29",+ "opt_030": "description 30",+ "opt_031": "description 31",+ "opt_032": "description 32",+ "opt_033": "description 33",+ "opt_034": "description 34",+ "opt_035": "description 35",+ "opt_036": "description 36",+ "opt_037": "description 37",+ "opt_038": "description 38",+ "opt_039": "description 39",+ "opt_040": "description 40",+ "opt_041": "description 41",+ "opt_042": "description 42",+ "opt_043": "description 43",+ "opt_044": "description 44",+ "opt_045": "description 45",+ "opt_046": "description 46",+ "opt_047": "description 47",+ "opt_048": "description 48",+ "opt_049": "description 49",+ "opt_050": "description 50",+ "opt_051": "description 51",+ "opt_052": "description 52",+ "opt_053": "description 53",+ "opt_054": "description 54",+ "opt_055": "description 55",+ "opt_056": "description 56",+ "opt_057": "description 57",+ "opt_058": "description 58",+ "opt_059": "description 59",+ "opt_060": "description 60",+ "opt_061": "description 61",+ "opt_062": "description 62",+ "opt_063": "description 63",+ "opt_064": "description 64",+ "opt_065": "description 65",+ "opt_066": "description 66",+ "opt_067": "description 67",+ "opt_068": "description 68",+ "opt_069": "description 69",+ "opt_070": "description 70",+ "opt_071": "description 71",+ "opt_072": "description 72",+ "opt_073": "description 73",+ "opt_074": "description 74",+ "opt_075": "description 75",+ "opt_076": "description 76",+ "opt_077": "description 77",+ "opt_078": "description 78",+ "opt_079": "description 79",+ "opt_080": "description 80",+ "opt_081": "description 81",+ "opt_082": "description 82",+ "opt_083": "description 83",+ "opt_084": "description 84",+ "opt_085": "description 85",+ "opt_086": "description 86",+ "opt_087": "description 87",+ "opt_088": "description 88",+ "opt_089": "description 89",+ "opt_090": "description 90",+ "opt_091": "description 91",+ "opt_092": "description 92",+ "opt_093": "description 93",+ "opt_094": "description 94",+ "opt_095": "description 95",+ "opt_096": "description 96",+ "opt_097": "description 97",+ "opt_098": "description 98",+ "opt_099": "description 99",+ "opt_100": "description 100",+ "opt_101": "description 101",+ "opt_102": "description 102",+ "opt_103": "description 103",+ "opt_104": "description 104",+ "opt_105": "description 105",+ "opt_106": "description 106",+ "opt_107": "description 107",+ "opt_108": "description 108",+ "opt_109": "description 109",+ "opt_110": "description 110",+ "opt_111": "description 111",+ "opt_112": "description 112",+ "opt_113": "description 113",+ "opt_114": "description 114",+ "opt_115": "description 115",+ "opt_116": "description 116",+ "opt_117": "description 117",+ "opt_118": "description 118",+ "opt_119": "description 119",+ "opt_120": "description 120",+ "opt_121": "description 121",+ "opt_122": "description 122",+ "opt_123": "description 123",+ "opt_124": "description 124",+ "opt_125": "description 125",+ "opt_126": "description 126",+ "opt_127": "description 127",+ "opt_128": "description 128",+ "opt_129": "description 129",+ "opt_130": "description 130",+ "opt_131": "description 131",+ "opt_132": "description 132",+ "opt_133": "description 133",+ "opt_134": "description 134",+ "opt_135": "description 135",+ "opt_136": "description 136",+ "opt_137": "description 137",+ "opt_138": "description 138",+ "opt_139": "description 139",+ "opt_140": "description 140",+ "opt_141": "description 141",+ "opt_142": "description 142",+ "opt_143": "description 143",+ "opt_144": "description 144",+ "opt_145": "description 145",+ "opt_146": "description 146",+ "opt_147": "description 147",+ "opt_148": "description 148",+ "opt_149": "description 149",+ "opt_150": "description 150",+ "opt_151": "description 151",+ "opt_152": "description 152",+ "opt_153": "description 153",+ "opt_154": "description 154",+ "opt_155": "description 155",+ "opt_156": "description 156",+ "opt_157": "description 157",+ "opt_158": "description 158",+ "opt_159": "description 159",+ "opt_160": "description 160",+ "opt_161": "description 161",+ "opt_162": "description 162",+ "opt_163": "description 163",+ "opt_164": "description 164",+ "opt_165": "description 165",+ "opt_166": "description 166",+ "opt_167": "description 167",+ "opt_168": "description 168",+ "opt_169": "description 169",+ "opt_170": "description 170",+ "opt_171": "description 171",+ "opt_172": "description 172",+ "opt_173": "description 173",+ "opt_174": "description 174",+ "opt_175": "description 175",+ "opt_176": "description 176",+ "opt_177": "description 177",+ "opt_178": "description 178",+ "opt_179": "description 179",+ "opt_180": "description 180",+ "opt_181": "description 181",+ "opt_182": "description 182",+ "opt_183": "description 183",+ "opt_184": "description 184",+ "opt_185": "description 185",+ "opt_186": "description 186",+ "opt_187": "description 187",+ "opt_188": "description 188",+ "opt_189": "description 189",+ "opt_190": "description 190",+ "opt_191": "description 191",+ "opt_192": "description 192",+ "opt_193": "description 193",+ "opt_194": "description 194",+ "opt_195": "description 195",+ "opt_196": "description 196",+ "opt_197": "description 197",+ "opt_198": "description 198",+ "opt_199": "description 199",+ "opt_200": "description 200",+ "opt_201": "description 201",+ "opt_202": "description 202",+ "opt_203": "description 203",+ "opt_204": "description 204",+ "opt_205": "description 205",+ "opt_206": "description 206",+ "opt_207": "description 207",+ "opt_208": "description 208",+ "opt_209": "description 209",+ "opt_210": "description 210",+ "opt_211": "description 211",+ "opt_212": "description 212",+ "opt_213": "description 213",+ "opt_214": "description 214",+ "opt_215": "description 215",+ "opt_216": "description 216",+ "opt_217": "description 217",+ "opt_218": "description 218",+ "opt_219": "description 219",+ "opt_220": "description 220",+ "opt_221": "description 221",+ "opt_222": "description 222",+ "opt_223": "description 223",+ "opt_224": "description 224",+ "opt_225": "description 225",+ "opt_226": "description 226",+ "opt_227": "description 227",+ "opt_228": "description 228",+ "opt_229": "description 229",+ "opt_230": "description 230",+ "opt_231": "description 231",+ "opt_232": "description 232",+ "opt_233": "description 233",+ "opt_234": "description 234",+ "opt_235": "description 235",+ "opt_236": "description 236",+ "opt_237": "description 237",+ "opt_238": "description 238",+ "opt_239": "description 239",+ "opt_240": "description 240",+ "opt_241": "description 241",+ "opt_242": "description 242",+ "opt_243": "description 243",+ "opt_244": "description 244",+ "opt_245": "description 245",+ "opt_246": "description 246",+ "opt_247": "description 247",+ "opt_248": "description 248",+ "opt_249": "description 249",+ "opt_250": "description 250",+ "opt_251": "description 251",+ "opt_252": "description 252",+ "opt_253": "description 253",+ "opt_254": "description 254",+ "opt_255": "description 255",+ "opt_256": "description 256",+ "opt_257": "description 257",+ "opt_258": "description 258",+ "opt_259": "description 259",+ "opt_260": "description 260",+ "opt_261": "description 261",+ "opt_262": "description 262",+ "opt_263": "description 263",+ "opt_264": "description 264",+ "opt_265": "description 265",+ "opt_266": "description 266",+ "opt_267": "description 267",+ "opt_268": "description 268",+ "opt_269": "description 269",+ "opt_270": "description 270",+ "opt_271": "description 271",+ "opt_272": "description 272",+ "opt_273": "description 273",+ "opt_274": "description 274",+ "opt_275": "description 275",+ "opt_276": "description 276",+ "opt_277": "description 277",+ "opt_278": "description 278",+ "opt_279": "description 279",+ "opt_280": "description 280",+ "opt_281": "description 281",+ "opt_282": "description 282",+ "opt_283": "description 283",+ "opt_284": "description 284",+ "opt_285": "description 285",+ "opt_286": "description 286",+ "opt_287": "description 287",+ "opt_288": "description 288",+ "opt_289": "description 289",+ "opt_290": "description 290",+ "opt_291": "description 291",+ "opt_292": "description 292",+ "opt_293": "description 293",+ "opt_294": "description 294",+ "opt_295": "description 295",+ "opt_296": "description 296",+ "opt_297": "description 297",+ "opt_298": "description 298",+ "opt_299": "description 299"+ }+ }+ },+ "options": {},+ "error_type": "ValueError",+ "error_message": "question 'too_wide': only 254 of its 300 option markers fit in max_len=1024 with head_max_len=256 spent on the question; lower head_max_len, raise max_len, or use fewer options"+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_single_question.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_single_question.jsonnew file mode 100644index 00000000..924a90ca--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_single_question.json@@ -0,0 +1,137 @@+{+ "name": "batch_single_question",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ]+ ],+ "questions": {+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 91,+ 44,+ 157,+ 74+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 91,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.0363,+ "confidence": 0.9637,+ "answer_confidence": 0.9637,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 44,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.7748,+ "confidence": 0.7748,+ "answer_confidence": 0.7748,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 157,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "cancel": {+ "type": "noul",+ "noul": 0.2121,+ "confidence": 0.7879,+ "answer_confidence": 0.7879,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 74,+ "output_tokens": 0,+ "state_tokens": 40,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 2,+ 91+ ],+ [+ 2,+ 157+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_1.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_1.jsonnew file mode 100644index 00000000..497223c9--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_1.json@@ -0,0 +1,545 @@+{+ "name": "batch_size_1",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 1+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6869,+ "technical": 0.2079,+ "other": 0.1052+ },+ "confidence": 0.2523,+ "answer_confidence": 0.6869,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0204,+ "1": 0.1675,+ "2": 0.8121+ },+ "confidence": 0.5015,+ "answer_confidence": 0.8121,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7602,+ "confidence": 0.7602,+ "answer_confidence": 0.7602,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6718,+ "technical": 0.2244,+ "other": 0.1038+ },+ "confidence": 0.2375,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7672,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0194,+ "1": 0.194,+ "2": 0.7866+ },+ "confidence": 0.4689,+ "answer_confidence": 0.7866,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7234,+ "confidence": 0.7234,+ "answer_confidence": 0.7234,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3741,+ "technical": 0.2268,+ "other": 0.3991+ },+ "confidence": 0.0252,+ "answer_confidence": 0.3991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9031,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.368,+ "1": 0.361,+ "2": 0.2711+ },+ "confidence": 0.0083,+ "answer_confidence": 0.368,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2943,+ "confidence": 0.7057,+ "answer_confidence": 0.7057,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.142,+ "technical": 0.3006,+ "other": 0.5573+ },+ "confidence": 0.1222,+ "answer_confidence": 0.5573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2804,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2652,+ "1": 0.1891,+ "2": 0.5456+ },+ "confidence": 0.092,+ "answer_confidence": 0.5456,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0403,+ "confidence": 0.9597,+ "answer_confidence": 0.9597,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2504,+ "technical": 0.3345,+ "other": 0.4151+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4151,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0394,+ "1": 0.1552,+ "2": 0.8054+ },+ "confidence": 0.4622,+ "answer_confidence": 0.8054,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.776,+ "confidence": 0.776,+ "answer_confidence": 0.776,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1839,+ "technical": 0.4141,+ "other": 0.4019+ },+ "confidence": 0.0507,+ "answer_confidence": 0.4141,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9808,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3293,+ "1": 0.3606,+ "2": 0.3101+ },+ "confidence": 0.0018,+ "answer_confidence": 0.3606,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2948,+ "confidence": 0.7052,+ "answer_confidence": 0.7052,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 91+ ],+ [+ 3,+ 110+ ],+ [+ 3,+ 144+ ],+ [+ 3,+ 34+ ],+ [+ 3,+ 163+ ],+ [+ 3,+ 42+ ],+ [+ 3,+ 98+ ],+ [+ 3,+ 56+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_3.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_3.jsonnew file mode 100644index 00000000..2a673d53--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_3.json@@ -0,0 +1,525 @@+{+ "name": "batch_size_3",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6869,+ "technical": 0.2079,+ "other": 0.1052+ },+ "confidence": 0.2523,+ "answer_confidence": 0.6869,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0204,+ "1": 0.1675,+ "2": 0.8121+ },+ "confidence": 0.5015,+ "answer_confidence": 0.8121,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7602,+ "confidence": 0.7602,+ "answer_confidence": 0.7602,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6718,+ "technical": 0.2244,+ "other": 0.1038+ },+ "confidence": 0.2375,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7672,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0194,+ "1": 0.194,+ "2": 0.7866+ },+ "confidence": 0.4689,+ "answer_confidence": 0.7866,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7234,+ "confidence": 0.7234,+ "answer_confidence": 0.7234,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3741,+ "technical": 0.2268,+ "other": 0.3991+ },+ "confidence": 0.0252,+ "answer_confidence": 0.3991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9031,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.368,+ "1": 0.361,+ "2": 0.2711+ },+ "confidence": 0.0083,+ "answer_confidence": 0.368,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2943,+ "confidence": 0.7057,+ "answer_confidence": 0.7057,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.142,+ "technical": 0.3006,+ "other": 0.5573+ },+ "confidence": 0.1222,+ "answer_confidence": 0.5573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2804,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2652,+ "1": 0.1891,+ "2": 0.5456+ },+ "confidence": 0.092,+ "answer_confidence": 0.5456,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0403,+ "confidence": 0.9597,+ "answer_confidence": 0.9597,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2504,+ "technical": 0.3345,+ "other": 0.4151+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4151,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0394,+ "1": 0.1552,+ "2": 0.8054+ },+ "confidence": 0.4622,+ "answer_confidence": 0.8054,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.776,+ "confidence": 0.776,+ "answer_confidence": 0.776,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1839,+ "technical": 0.4141,+ "other": 0.4019+ },+ "confidence": 0.0507,+ "answer_confidence": 0.4141,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9808,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3293,+ "1": 0.3606,+ "2": 0.3101+ },+ "confidence": 0.0018,+ "answer_confidence": 0.3606,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2948,+ "confidence": 0.7052,+ "answer_confidence": 0.7052,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 144+ ],+ [+ 9,+ 163+ ],+ [+ 6,+ 98+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_negative.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_negative.jsonnew file mode 100644index 00000000..7617fbb1--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_negative.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_negative",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": -2+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6869,+ "technical": 0.2079,+ "other": 0.1052+ },+ "confidence": 0.2523,+ "answer_confidence": 0.6869,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0204,+ "1": 0.1675,+ "2": 0.8121+ },+ "confidence": 0.5015,+ "answer_confidence": 0.8121,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7602,+ "confidence": 0.7602,+ "answer_confidence": 0.7602,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6718,+ "technical": 0.2244,+ "other": 0.1038+ },+ "confidence": 0.2375,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7672,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0194,+ "1": 0.194,+ "2": 0.7866+ },+ "confidence": 0.4689,+ "answer_confidence": 0.7866,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7234,+ "confidence": 0.7234,+ "answer_confidence": 0.7234,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3741,+ "technical": 0.2268,+ "other": 0.3991+ },+ "confidence": 0.0252,+ "answer_confidence": 0.3991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9031,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.368,+ "1": 0.361,+ "2": 0.2711+ },+ "confidence": 0.0083,+ "answer_confidence": 0.368,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2943,+ "confidence": 0.7057,+ "answer_confidence": 0.7057,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.142,+ "technical": 0.3006,+ "other": 0.5573+ },+ "confidence": 0.1222,+ "answer_confidence": 0.5573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2804,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2652,+ "1": 0.1891,+ "2": 0.5456+ },+ "confidence": 0.092,+ "answer_confidence": 0.5456,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0403,+ "confidence": 0.9597,+ "answer_confidence": 0.9597,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2504,+ "technical": 0.3345,+ "other": 0.4151+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4151,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0394,+ "1": 0.1552,+ "2": 0.8054+ },+ "confidence": 0.4622,+ "answer_confidence": 0.8054,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.776,+ "confidence": 0.776,+ "answer_confidence": 0.776,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1839,+ "technical": 0.4141,+ "other": 0.4019+ },+ "confidence": 0.0507,+ "answer_confidence": 0.4141,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9808,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3293,+ "1": 0.3606,+ "2": 0.3101+ },+ "confidence": 0.0018,+ "answer_confidence": 0.3606,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2948,+ "confidence": 0.7052,+ "answer_confidence": 0.7052,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_over_len.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_over_len.jsonnew file mode 100644index 00000000..cdcab5f0--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_over_len.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_over_len",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 100+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6869,+ "technical": 0.2079,+ "other": 0.1052+ },+ "confidence": 0.2523,+ "answer_confidence": 0.6869,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0204,+ "1": 0.1675,+ "2": 0.8121+ },+ "confidence": 0.5015,+ "answer_confidence": 0.8121,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7602,+ "confidence": 0.7602,+ "answer_confidence": 0.7602,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6718,+ "technical": 0.2244,+ "other": 0.1038+ },+ "confidence": 0.2375,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7672,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0194,+ "1": 0.194,+ "2": 0.7866+ },+ "confidence": 0.4689,+ "answer_confidence": 0.7866,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7234,+ "confidence": 0.7234,+ "answer_confidence": 0.7234,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3741,+ "technical": 0.2268,+ "other": 0.3991+ },+ "confidence": 0.0252,+ "answer_confidence": 0.3991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9031,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.368,+ "1": 0.361,+ "2": 0.2711+ },+ "confidence": 0.0083,+ "answer_confidence": 0.368,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2943,+ "confidence": 0.7057,+ "answer_confidence": 0.7057,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.142,+ "technical": 0.3006,+ "other": 0.5573+ },+ "confidence": 0.1222,+ "answer_confidence": 0.5573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2804,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2652,+ "1": 0.1891,+ "2": 0.5456+ },+ "confidence": 0.092,+ "answer_confidence": 0.5456,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0403,+ "confidence": 0.9597,+ "answer_confidence": 0.9597,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2504,+ "technical": 0.3345,+ "other": 0.4151+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4151,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0394,+ "1": 0.1552,+ "2": 0.8054+ },+ "confidence": 0.4622,+ "answer_confidence": 0.8054,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.776,+ "confidence": 0.776,+ "answer_confidence": 0.776,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1839,+ "technical": 0.4141,+ "other": 0.4019+ },+ "confidence": 0.0507,+ "answer_confidence": 0.4141,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9808,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3293,+ "1": 0.3606,+ "2": 0.3101+ },+ "confidence": 0.0018,+ "answer_confidence": 0.3606,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2948,+ "confidence": 0.7052,+ "answer_confidence": 0.7052,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_zero.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_zero.jsonnew file mode 100644index 00000000..17c4dc7d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_size_zero.json@@ -0,0 +1,517 @@+{+ "name": "batch_size_zero",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ {+ "subject": "Double charged on invoice 88213",+ "body": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ [+ {+ "role": "user",+ "content": "Hi, I need help with my invoice."+ },+ {+ "role": "assistant",+ "content": "Of course, what is wrong?"+ },+ {+ "role": "user",+ "content": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ }+ ],+ "",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, that is all sorted now.",+ {+ "notes": "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. ",+ "message": "Please cancel my account today."+ },+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 0+ },+ "state_widths": [+ 91,+ 110,+ 144,+ 34,+ 163,+ 42,+ 98,+ 56+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6869,+ "technical": 0.2079,+ "other": 0.1052+ },+ "confidence": 0.2523,+ "answer_confidence": 0.6869,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7918,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0204,+ "1": 0.1675,+ "2": 0.8121+ },+ "confidence": 0.5015,+ "answer_confidence": 0.8121,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7602,+ "confidence": 0.7602,+ "answer_confidence": 0.7602,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 322,+ "output_tokens": 0,+ "state_tokens": 76,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6718,+ "technical": 0.2244,+ "other": 0.1038+ },+ "confidence": 0.2375,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7672,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0194,+ "1": 0.194,+ "2": 0.7866+ },+ "confidence": 0.4689,+ "answer_confidence": 0.7866,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7234,+ "confidence": 0.7234,+ "answer_confidence": 0.7234,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 424,+ "output_tokens": 0,+ "state_tokens": 110,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.3741,+ "technical": 0.2268,+ "other": 0.3991+ },+ "confidence": 0.0252,+ "answer_confidence": 0.3991,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9031,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.368,+ "1": 0.361,+ "2": 0.2711+ },+ "confidence": 0.0083,+ "answer_confidence": 0.368,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2943,+ "confidence": 0.7057,+ "answer_confidence": 0.7057,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 94,+ "output_tokens": 0,+ "state_tokens": 0,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.142,+ "technical": 0.3006,+ "other": 0.5573+ },+ "confidence": 0.1222,+ "answer_confidence": 0.5573,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2804,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2652,+ "1": 0.1891,+ "2": 0.5456+ },+ "confidence": 0.092,+ "answer_confidence": 0.5456,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0403,+ "confidence": 0.9597,+ "answer_confidence": 0.9597,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 118,+ "output_tokens": 0,+ "state_tokens": 8,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.2504,+ "technical": 0.3345,+ "other": 0.4151+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4151,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.766,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0394,+ "1": 0.1552,+ "2": 0.8054+ },+ "confidence": 0.4622,+ "answer_confidence": 0.8054,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.776,+ "confidence": 0.776,+ "answer_confidence": 0.776,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 286,+ "output_tokens": 0,+ "state_tokens": 64,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.1839,+ "technical": 0.4141,+ "other": 0.4019+ },+ "confidence": 0.0507,+ "answer_confidence": 0.4141,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9808,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3293,+ "1": 0.3606,+ "2": 0.3101+ },+ "confidence": 0.0018,+ "answer_confidence": 0.3606,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2948,+ "confidence": 0.7052,+ "answer_confidence": 0.7052,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 160,+ "output_tokens": 0,+ "state_tokens": 22,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 24,+ 163+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_no_batch_size.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_no_batch_size.jsonnew file mode 100644index 00000000..bcecc977--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_no_batch_size.json@@ -0,0 +1,1182 @@+{+ "name": "batch_sort_no_batch_size",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_off.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_off.jsonnew file mode 100644index 00000000..dc8ed69f--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_off.json@@ -0,0 +1,1218 @@+{+ "name": "batch_sort_off",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 199+ ],+ [+ 6,+ 145+ ],+ [+ 6,+ 175+ ],+ [+ 6,+ 157+ ],+ [+ 6,+ 187+ ],+ [+ 6,+ 163+ ],+ [+ 6,+ 205+ ],+ [+ 6,+ 169+ ],+ [+ 6,+ 193+ ],+ [+ 6,+ 181+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_on.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_on.jsonnew file mode 100644index 00000000..f4522ea4--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_on.json@@ -0,0 +1,1219 @@+{+ "name": "batch_sort_on",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 97+ ],+ [+ 6,+ 109+ ],+ [+ 6,+ 121+ ],+ [+ 6,+ 139+ ],+ [+ 6,+ 157+ ],+ [+ 6,+ 169+ ],+ [+ 6,+ 187+ ],+ [+ 6,+ 205+ ],+ [+ 6,+ 151+ ],+ [+ 6,+ 193+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_partial_window.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_partial_window.jsonnew file mode 100644index 00000000..ee17f1a9--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_partial_window.json@@ -0,0 +1,218 @@+{+ "name": "batch_sort_partial_window",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 145+ ],+ [+ 3,+ 199+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_1.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_1.jsonnew file mode 100644index 00000000..5a02652a--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_1.json@@ -0,0 +1,1259 @@+{+ "name": "batch_sort_size_1",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 1,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 3,+ 199+ ],+ [+ 3,+ 103+ ],+ [+ 3,+ 145+ ],+ [+ 3,+ 91+ ],+ [+ 3,+ 175+ ],+ [+ 3,+ 121+ ],+ [+ 3,+ 157+ ],+ [+ 3,+ 97+ ],+ [+ 3,+ 187+ ],+ [+ 3,+ 133+ ],+ [+ 3,+ 109+ ],+ [+ 3,+ 163+ ],+ [+ 3,+ 205+ ],+ [+ 3,+ 115+ ],+ [+ 3,+ 139+ ],+ [+ 3,+ 169+ ],+ [+ 3,+ 127+ ],+ [+ 3,+ 193+ ],+ [+ 3,+ 151+ ],+ [+ 3,+ 181+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_3.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_3.jsonnew file mode 100644index 00000000..ac140ff1--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_3.json@@ -0,0 +1,1207 @@+{+ "name": "batch_sort_size_3",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 103+ ],+ [+ 9,+ 121+ ],+ [+ 9,+ 139+ ],+ [+ 9,+ 157+ ],+ [+ 9,+ 175+ ],+ [+ 9,+ 193+ ],+ [+ 6,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_eq_len.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_eq_len.jsonnew file mode 100644index 00000000..0be562ab--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_eq_len.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_eq_len",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 20,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_over_len.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_over_len.jsonnew file mode 100644index 00000000..7b179cd7--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_over_len.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_over_len",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 25,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_zero.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_zero.jsonnew file mode 100644index 00000000..59422370--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sort_size_zero.json@@ -0,0 +1,1183 @@+{+ "name": "batch_sort_size_zero",+ "states": [+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Routine account check completed. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 0,+ "sort_by_length": true+ },+ "state_widths": [+ 199,+ 103,+ 145,+ 91,+ 175,+ 121,+ 157,+ 97,+ 187,+ 133,+ 109,+ 163,+ 205,+ 115,+ 139,+ 169,+ 127,+ 193,+ 151,+ 181+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7688,+ "technical": 0.1498,+ "other": 0.0814+ },+ "confidence": 0.3712,+ "answer_confidence": 0.7688,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.839,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1276,+ "2": 0.8557+ },+ "confidence": 0.5773,+ "answer_confidence": 0.8557,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8118,+ "confidence": 0.8118,+ "answer_confidence": 0.8118,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 589,+ "output_tokens": 0,+ "state_tokens": 165,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7324,+ "technical": 0.1799,+ "other": 0.0877+ },+ "confidence": 0.3172,+ "answer_confidence": 0.7324,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.6583,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0379,+ "1": 0.2659,+ "2": 0.6962+ },+ "confidence": 0.337,+ "answer_confidence": 0.6962,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7988,+ "confidence": 0.7988,+ "answer_confidence": 0.7988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7732,+ "technical": 0.1468,+ "other": 0.08+ },+ "confidence": 0.3786,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8334,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0162,+ "1": 0.1342,+ "2": 0.8496+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8132,+ "confidence": 0.8132,+ "answer_confidence": 0.8132,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 427,+ "output_tokens": 0,+ "state_tokens": 111,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7458,+ "technical": 0.1647,+ "other": 0.0895+ },+ "confidence": 0.3338,+ "answer_confidence": 0.7458,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8335,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1332,+ "2": 0.8501+ },+ "confidence": 0.5678,+ "answer_confidence": 0.8501,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.827,+ "confidence": 0.827,+ "answer_confidence": 0.827,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 517,+ "output_tokens": 0,+ "state_tokens": 141,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7837,+ "technical": 0.1379,+ "other": 0.0784+ },+ "confidence": 0.3958,+ "answer_confidence": 0.7837,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8327,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0171,+ "1": 0.1331,+ "2": 0.8498+ },+ "confidence": 0.5665,+ "answer_confidence": 0.8498,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7977,+ "confidence": 0.7977,+ "answer_confidence": 0.7977,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 355,+ "output_tokens": 0,+ "state_tokens": 87,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7287,+ "technical": 0.1816,+ "other": 0.0897+ },+ "confidence": 0.3111,+ "answer_confidence": 0.7287,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8351,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0151,+ "1": 0.1346,+ "2": 0.8502+ },+ "confidence": 0.571,+ "answer_confidence": 0.8502,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8224,+ "confidence": 0.8224,+ "answer_confidence": 0.8224,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7582,+ "technical": 0.1488,+ "other": 0.093+ },+ "confidence": 0.3499,+ "answer_confidence": 0.7582,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.5545,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0538,+ "1": 0.3378,+ "2": 0.6083+ },+ "confidence": 0.2479,+ "answer_confidence": 0.6083,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7899,+ "confidence": 0.7899,+ "answer_confidence": 0.7899,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7819,+ "technical": 0.1394,+ "other": 0.0787+ },+ "confidence": 0.3927,+ "answer_confidence": 0.7819,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8342,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0169,+ "1": 0.1321,+ "2": 0.8511+ },+ "confidence": 0.569,+ "answer_confidence": 0.8511,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8239,+ "confidence": 0.8239,+ "answer_confidence": 0.8239,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 553,+ "output_tokens": 0,+ "state_tokens": 153,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7943,+ "technical": 0.1323,+ "other": 0.0734+ },+ "confidence": 0.4154,+ "answer_confidence": 0.7943,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8503,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0167,+ "1": 0.1164,+ "2": 0.8669+ },+ "confidence": 0.5973,+ "answer_confidence": 0.8669,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8072,+ "confidence": 0.8072,+ "answer_confidence": 0.8072,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 391,+ "output_tokens": 0,+ "state_tokens": 99,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7677,+ "technical": 0.1443,+ "other": 0.088+ },+ "confidence": 0.3663,+ "answer_confidence": 0.7677,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7692,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0234,+ "1": 0.184,+ "2": 0.7926+ },+ "confidence": 0.4687,+ "answer_confidence": 0.7926,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7909,+ "confidence": 0.7909,+ "answer_confidence": 0.7909,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 319,+ "output_tokens": 0,+ "state_tokens": 75,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7312,+ "technical": 0.1851,+ "other": 0.0838+ },+ "confidence": 0.3184,+ "answer_confidence": 0.7312,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8478,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0137,+ "1": 0.1248,+ "2": 0.8615+ },+ "confidence": 0.5931,+ "answer_confidence": 0.8615,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8255,+ "confidence": 0.8255,+ "answer_confidence": 0.8255,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 481,+ "output_tokens": 0,+ "state_tokens": 129,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7575,+ "technical": 0.1576,+ "other": 0.0849+ },+ "confidence": 0.3529,+ "answer_confidence": 0.7575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8307,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0179,+ "1": 0.1335,+ "2": 0.8486+ },+ "confidence": 0.5629,+ "answer_confidence": 0.8486,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8174,+ "confidence": 0.8174,+ "answer_confidence": 0.8174,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 607,+ "output_tokens": 0,+ "state_tokens": 171,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7807,+ "technical": 0.135,+ "other": 0.0843+ },+ "confidence": 0.3883,+ "answer_confidence": 0.7807,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8128,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0189,+ "1": 0.1494,+ "2": 0.8317+ },+ "confidence": 0.5337,+ "answer_confidence": 0.8317,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7952,+ "confidence": 0.7952,+ "answer_confidence": 0.7952,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7583,+ "technical": 0.1605,+ "other": 0.0812+ },+ "confidence": 0.3561,+ "answer_confidence": 0.7583,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8375,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0183,+ "1": 0.1259,+ "2": 0.8558+ },+ "confidence": 0.5746,+ "answer_confidence": 0.8558,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8111,+ "confidence": 0.8111,+ "answer_confidence": 0.8111,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 409,+ "output_tokens": 0,+ "state_tokens": 105,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7181,+ "technical": 0.192,+ "other": 0.0898+ },+ "confidence": 0.2981,+ "answer_confidence": 0.7181,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8396,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0154,+ "1": 0.1295,+ "2": 0.855+ },+ "confidence": 0.5785,+ "answer_confidence": 0.855,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8286,+ "confidence": 0.8286,+ "answer_confidence": 0.8286,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 499,+ "output_tokens": 0,+ "state_tokens": 135,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7955,+ "technical": 0.133,+ "other": 0.0715+ },+ "confidence": 0.4184,+ "answer_confidence": 0.7955,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8318,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0165,+ "1": 0.1351,+ "2": 0.8483+ },+ "confidence": 0.5651,+ "answer_confidence": 0.8483,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.809,+ "confidence": 0.809,+ "answer_confidence": 0.809,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7676,+ "technical": 0.1494,+ "other": 0.083+ },+ "confidence": 0.3686,+ "answer_confidence": 0.7676,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.832,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0176,+ "1": 0.1328,+ "2": 0.8496+ },+ "confidence": 0.5652,+ "answer_confidence": 0.8496,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8189,+ "confidence": 0.8189,+ "answer_confidence": 0.8189,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 571,+ "output_tokens": 0,+ "state_tokens": 159,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7387,+ "technical": 0.1748,+ "other": 0.0865+ },+ "confidence": 0.3261,+ "answer_confidence": 0.7387,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8236,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0164,+ "1": 0.1436,+ "2": 0.84+ },+ "confidence": 0.5517,+ "answer_confidence": 0.84,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8144,+ "confidence": 0.8144,+ "answer_confidence": 0.8144,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 445,+ "output_tokens": 0,+ "state_tokens": 117,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7814,+ "technical": 0.1415,+ "other": 0.0771+ },+ "confidence": 0.3928,+ "answer_confidence": 0.7814,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8262,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0175,+ "1": 0.1389,+ "2": 0.8436+ },+ "confidence": 0.5555,+ "answer_confidence": 0.8436,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.8303,+ "confidence": 0.8303,+ "answer_confidence": 0.8303,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 535,+ "output_tokens": 0,+ "state_tokens": 147,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 60,+ 205+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sorted.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sorted.jsonnew file mode 100644index 00000000..7179adbb--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sorted.json@@ -0,0 +1,471 @@+{+ "name": "batch_sorted",+ "states": [+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Thanks, the refund arrived and everything works now.",+ {+ "ticket": 4821,+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "notes": "Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. Routine checks. "+ },+ [+ {+ "role": "assistant",+ "content": "How can I help?"+ },+ {+ "role": "user",+ "content": "I was billed twice this month and nobody has answered."+ }+ ],+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint. Turn 140: the agent restated the refund policy and the customer repeated the complaint. Turn 141: the agent restated the refund policy and the customer repeated the complaint. Turn 142: the agent restated the refund policy and the customer repeated the complaint. Turn 143: the agent restated the refund policy and the customer repeated the complaint. Turn 144: the agent restated the refund policy and the customer repeated the complaint. Turn 145: the agent restated the refund policy and the customer repeated the complaint. Turn 146: the agent restated the refund policy and the customer repeated the complaint. Turn 147: the agent restated the refund policy and the customer repeated the complaint. Turn 148: the agent restated the refund policy and the customer repeated the complaint. Turn 149: the agent restated the refund policy and the customer repeated the complaint. Turn 150: the agent restated the refund policy and the customer repeated the complaint. Turn 151: the agent restated the refund policy and the customer repeated the complaint. Turn 152: the agent restated the refund policy and the customer repeated the complaint. Turn 153: the agent restated the refund policy and the customer repeated the complaint. Turn 154: the agent restated the refund policy and the customer repeated the complaint. Turn 155: the agent restated the refund policy and the customer repeated the complaint. Turn 156: the agent restated the refund policy and the customer repeated the complaint. Turn 157: the agent restated the refund policy and the customer repeated the complaint. Turn 158: the agent restated the refund policy and the customer repeated the complaint. Turn 159: the agent restated the refund policy and the customer repeated the complaint. Turn 160: the agent restated the refund policy and the customer repeated the complaint. Turn 161: the agent restated the refund policy and the customer repeated the complaint. Turn 162: the agent restated the refund policy and the customer repeated the complaint. Turn 163: the agent restated the refund policy and the customer repeated the complaint. Turn 164: the agent restated the refund policy and the customer repeated the complaint. Turn 165: the agent restated the refund policy and the customer repeated the complaint. Turn 166: the agent restated the refund policy and the customer repeated the complaint. Turn 167: the agent restated the refund policy and the customer repeated the complaint. Turn 168: the agent restated the refund policy and the customer repeated the complaint. Turn 169: the agent restated the refund policy and the customer repeated the complaint. Turn 170: the agent restated the refund policy and the customer repeated the complaint. Turn 171: the agent restated the refund policy and the customer repeated the complaint. Turn 172: the agent restated the refund policy and the customer repeated the complaint. Turn 173: the agent restated the refund policy and the customer repeated the complaint. Turn 174: the agent restated the refund policy and the customer repeated the complaint. Turn 175: the agent restated the refund policy and the customer repeated the complaint. Turn 176: the agent restated the refund policy and the customer repeated the complaint. Turn 177: the agent restated the refund policy and the customer repeated the complaint. Turn 178: the agent restated the refund policy and the customer repeated the complaint. Turn 179: the agent restated the refund policy and the customer repeated the complaint. Turn 180: the agent restated the refund policy and the customer repeated the complaint. Turn 181: the agent restated the refund policy and the customer repeated the complaint. Turn 182: the agent restated the refund policy and the customer repeated the complaint. Turn 183: the agent restated the refund policy and the customer repeated the complaint. Turn 184: the agent restated the refund policy and the customer repeated the complaint. Turn 185: the agent restated the refund policy and the customer repeated the complaint. Turn 186: the agent restated the refund policy and the customer repeated the complaint. Turn 187: the agent restated the refund policy and the customer repeated the complaint. Turn 188: the agent restated the refund policy and the customer repeated the complaint. Turn 189: the agent restated the refund policy and the customer repeated the complaint. Turn 190: the agent restated the refund policy and the customer repeated the complaint. Turn 191: the agent restated the refund policy and the customer repeated the complaint. Turn 192: the agent restated the refund policy and the customer repeated the complaint. Turn 193: the agent restated the refund policy and the customer repeated the complaint. Turn 194: the agent restated the refund policy and the customer repeated the complaint. Turn 195: the agent restated the refund policy and the customer repeated the complaint. Turn 196: the agent restated the refund policy and the customer repeated the complaint. Turn 197: the agent restated the refund policy and the customer repeated the complaint. Turn 198: the agent restated the refund policy and the customer repeated the complaint. Turn 199: the agent restated the refund policy and the customer repeated the complaint. Turn 200: the agent restated the refund policy and the customer repeated the complaint. Turn 201: the agent restated the refund policy and the customer repeated the complaint. Turn 202: the agent restated the refund policy and the customer repeated the complaint. Turn 203: the agent restated the refund policy and the customer repeated the complaint. Turn 204: the agent restated the refund policy and the customer repeated the complaint. Turn 205: the agent restated the refund policy and the customer repeated the complaint. Turn 206: the agent restated the refund policy and the customer repeated the complaint. Turn 207: the agent restated the refund policy and the customer repeated the complaint. Turn 208: the agent restated the refund policy and the customer repeated the complaint. Turn 209: the agent restated the refund policy and the customer repeated the complaint. Turn 210: the agent restated the refund policy and the customer repeated the complaint. Turn 211: the agent restated the refund policy and the customer repeated the complaint. Turn 212: the agent restated the refund policy and the customer repeated the complaint. Turn 213: the agent restated the refund policy and the customer repeated the complaint. Turn 214: the agent restated the refund policy and the customer repeated the complaint. Turn 215: the agent restated the refund policy and the customer repeated the complaint. Turn 216: the agent restated the refund policy and the customer repeated the complaint. Turn 217: the agent restated the refund policy and the customer repeated the complaint. Turn 218: the agent restated the refund policy and the customer repeated the complaint. Turn 219: the agent restated the refund policy and the customer repeated the complaint. Turn 220: the agent restated the refund policy and the customer repeated the complaint. Turn 221: the agent restated the refund policy and the customer repeated the complaint. Turn 222: the agent restated the refund policy and the customer repeated the complaint. Turn 223: the agent restated the refund policy and the customer repeated the complaint. Turn 224: the agent restated the refund policy and the customer repeated the complaint. Turn 225: the agent restated the refund policy and the customer repeated the complaint. Turn 226: the agent restated the refund policy and the customer repeated the complaint. Turn 227: the agent restated the refund policy and the customer repeated the complaint. Turn 228: the agent restated the refund policy and the customer repeated the complaint. Turn 229: the agent restated the refund policy and the customer repeated the complaint. Turn 230: the agent restated the refund policy and the customer repeated the complaint. Turn 231: the agent restated the refund policy and the customer repeated the complaint. Turn 232: the agent restated the refund policy and the customer repeated the complaint. Turn 233: the agent restated the refund policy and the customer repeated the complaint. Turn 234: the agent restated the refund policy and the customer repeated the complaint. Turn 235: the agent restated the refund policy and the customer repeated the complaint. Turn 236: the agent restated the refund policy and the customer repeated the complaint. Turn 237: the agent restated the refund policy and the customer repeated the complaint. Turn 238: the agent restated the refund policy and the customer repeated the complaint. Turn 239: the agent restated the refund policy and the customer repeated the complaint. Turn 240: the agent restated the refund policy and the customer repeated the complaint. Turn 241: the agent restated the refund policy and the customer repeated the complaint. Turn 242: the agent restated the refund policy and the customer repeated the complaint. Turn 243: the agent restated the refund policy and the customer repeated the complaint. Turn 244: the agent restated the refund policy and the customer repeated the complaint. Turn 245: the agent restated the refund policy and the customer repeated the complaint. Turn 246: the agent restated the refund policy and the customer repeated the complaint. Turn 247: the agent restated the refund policy and the customer repeated the complaint. Turn 248: the agent restated the refund policy and the customer repeated the complaint. Turn 249: the agent restated the refund policy and the customer repeated the complaint. Turn 250: the agent restated the refund policy and the customer repeated the complaint. Turn 251: the agent restated the refund policy and the customer repeated the complaint. Turn 252: the agent restated the refund policy and the customer repeated the complaint. Turn 253: the agent restated the refund policy and the customer repeated the complaint. Turn 254: the agent restated the refund policy and the customer repeated the complaint. Turn 255: the agent restated the refund policy and the customer repeated the complaint. Turn 256: the agent restated the refund policy and the customer repeated the complaint. Turn 257: the agent restated the refund policy and the customer repeated the complaint. Turn 258: the agent restated the refund policy and the customer repeated the complaint. Turn 259: the agent restated the refund policy and the customer repeated the complaint. Turn 260: the agent restated the refund policy and the customer repeated the complaint. Turn 261: the agent restated the refund policy and the customer repeated the complaint. Turn 262: the agent restated the refund policy and the customer repeated the complaint. Turn 263: the agent restated the refund policy and the customer repeated the complaint. Turn 264: the agent restated the refund policy and the customer repeated the complaint. Turn 265: the agent restated the refund policy and the customer repeated the complaint. Turn 266: the agent restated the refund policy and the customer repeated the complaint. Turn 267: the agent restated the refund policy and the customer repeated the complaint. Turn 268: the agent restated the refund policy and the customer repeated the complaint. Turn 269: the agent restated the refund policy and the customer repeated the complaint. Turn 270: the agent restated the refund policy and the customer repeated the complaint. Turn 271: the agent restated the refund policy and the customer repeated the complaint. Turn 272: the agent restated the refund policy and the customer repeated the complaint. Turn 273: the agent restated the refund policy and the customer repeated the complaint. Turn 274: the agent restated the refund policy and the customer repeated the complaint. Turn 275: the agent restated the refund policy and the customer repeated the complaint. Turn 276: the agent restated the refund policy and the customer repeated the complaint. Turn 277: the agent restated the refund policy and the customer repeated the complaint. Turn 278: the agent restated the refund policy and the customer repeated the complaint. Turn 279: the agent restated the refund policy and the customer repeated the complaint. Turn 280: the agent restated the refund policy and the customer repeated the complaint. Turn 281: the agent restated the refund policy and the customer repeated the complaint. Turn 282: the agent restated the refund policy and the customer repeated the complaint. Turn 283: the agent restated the refund policy and the customer repeated the complaint. Turn 284: the agent restated the refund policy and the customer repeated the complaint. Turn 285: the agent restated the refund policy and the customer repeated the complaint. Turn 286: the agent restated the refund policy and the customer repeated the complaint. Turn 287: the agent restated the refund policy and the customer repeated the complaint. Turn 288: the agent restated the refund policy and the customer repeated the complaint. Turn 289: the agent restated the refund policy and the customer repeated the complaint. Turn 290: the agent restated the refund policy and the customer repeated the complaint. Turn 291: the agent restated the refund policy and the customer repeated the complaint. Turn 292: the agent restated the refund policy and the customer repeated the complaint. Turn 293: the agent restated the refund policy and the customer repeated the complaint. Turn 294: the agent restated the refund policy and the customer repeated the complaint. Turn 295: the agent restated the refund policy and the customer repeated the complaint. Turn 296: the agent restated the refund policy and the customer repeated the complaint. Turn 297: the agent restated the refund policy and the customer repeated the complaint. Turn 298: the agent restated the refund policy and the customer repeated the complaint. Turn 299: the agent restated the refund policy and the customer repeated the complaint. Turn 300: the agent restated the refund policy and the customer repeated the complaint. Turn 301: the agent restated the refund policy and the customer repeated the complaint. Turn 302: the agent restated the refund policy and the customer repeated the complaint. Turn 303: the agent restated the refund policy and the customer repeated the complaint. Turn 304: the agent restated the refund policy and the customer repeated the complaint. Turn 305: the agent restated the refund policy and the customer repeated the complaint. Turn 306: the agent restated the refund policy and the customer repeated the complaint. Turn 307: the agent restated the refund policy and the customer repeated the complaint. Turn 308: the agent restated the refund policy and the customer repeated the complaint. Turn 309: the agent restated the refund policy and the customer repeated the complaint. Turn 310: the agent restated the refund policy and the customer repeated the complaint. Turn 311: the agent restated the refund policy and the customer repeated the complaint. Turn 312: the agent restated the refund policy and the customer repeated the complaint. Turn 313: the agent restated the refund policy and the customer repeated the complaint. Turn 314: the agent restated the refund policy and the customer repeated the complaint. Turn 315: the agent restated the refund policy and the customer repeated the complaint. Turn 316: the agent restated the refund policy and the customer repeated the complaint. Turn 317: the agent restated the refund policy and the customer repeated the complaint. Turn 318: the agent restated the refund policy and the customer repeated the complaint. Turn 319: the agent restated the refund policy and the customer repeated the complaint. Turn 320: the agent restated the refund policy and the customer repeated the complaint. Turn 321: the agent restated the refund policy and the customer repeated the complaint. Turn 322: the agent restated the refund policy and the customer repeated the complaint. Turn 323: the agent restated the refund policy and the customer repeated the complaint. Turn 324: the agent restated the refund policy and the customer repeated the complaint. Turn 325: the agent restated the refund policy and the customer repeated the complaint. Turn 326: the agent restated the refund policy and the customer repeated the complaint. Turn 327: the agent restated the refund policy and the customer repeated the complaint. Turn 328: the agent restated the refund policy and the customer repeated the complaint. Turn 329: the agent restated the refund policy and the customer repeated the complaint. Turn 330: the agent restated the refund policy and the customer repeated the complaint. Turn 331: the agent restated the refund policy and the customer repeated the complaint. Turn 332: the agent restated the refund policy and the customer repeated the complaint. Turn 333: the agent restated the refund policy and the customer repeated the complaint. Turn 334: the agent restated the refund policy and the customer repeated the complaint. Turn 335: the agent restated the refund policy and the customer repeated the complaint. Turn 336: the agent restated the refund policy and the customer repeated the complaint. Turn 337: the agent restated the refund policy and the customer repeated the complaint. Turn 338: the agent restated the refund policy and the customer repeated the complaint. Turn 339: the agent restated the refund policy and the customer repeated the complaint. Turn 340: the agent restated the refund policy and the customer repeated the complaint. Turn 341: the agent restated the refund policy and the customer repeated the complaint. Turn 342: the agent restated the refund policy and the customer repeated the complaint. Turn 343: the agent restated the refund policy and the customer repeated the complaint. Turn 344: the agent restated the refund policy and the customer repeated the complaint. Turn 345: the agent restated the refund policy and the customer repeated the complaint. Turn 346: the agent restated the refund policy and the customer repeated the complaint. Turn 347: the agent restated the refund policy and the customer repeated the complaint. Turn 348: the agent restated the refund policy and the customer repeated the complaint. Turn 349: the agent restated the refund policy and the customer repeated the complaint. Turn 350: the agent restated the refund policy and the customer repeated the complaint. Turn 351: the agent restated the refund policy and the customer repeated the complaint. Turn 352: the agent restated the refund policy and the customer repeated the complaint. Turn 353: the agent restated the refund policy and the customer repeated the complaint. Turn 354: the agent restated the refund policy and the customer repeated the complaint. Turn 355: the agent restated the refund policy and the customer repeated the complaint. Turn 356: the agent restated the refund policy and the customer repeated the complaint. Turn 357: the agent restated the refund policy and the customer repeated the complaint. Turn 358: the agent restated the refund policy and the customer repeated the complaint. Turn 359: the agent restated the refund policy and the customer repeated the complaint. Turn 360: the agent restated the refund policy and the customer repeated the complaint. Turn 361: the agent restated the refund policy and the customer repeated the complaint. Turn 362: the agent restated the refund policy and the customer repeated the complaint. Turn 363: the agent restated the refund policy and the customer repeated the complaint. Turn 364: the agent restated the refund policy and the customer repeated the complaint. Turn 365: the agent restated the refund policy and the customer repeated the complaint. Turn 366: the agent restated the refund policy and the customer repeated the complaint. Turn 367: the agent restated the refund policy and the customer repeated the complaint. Turn 368: the agent restated the refund policy and the customer repeated the complaint. Turn 369: the agent restated the refund policy and the customer repeated the complaint. Turn 370: the agent restated the refund policy and the customer repeated the complaint. Turn 371: the agent restated the refund policy and the customer repeated the complaint. Turn 372: the agent restated the refund policy and the customer repeated the complaint. Turn 373: the agent restated the refund policy and the customer repeated the complaint. Turn 374: the agent restated the refund policy and the customer repeated the complaint. Turn 375: the agent restated the refund policy and the customer repeated the complaint. Turn 376: the agent restated the refund policy and the customer repeated the complaint. Turn 377: the agent restated the refund policy and the customer repeated the complaint. Turn 378: the agent restated the refund policy and the customer repeated the complaint. Turn 379: the agent restated the refund policy and the customer repeated the complaint. Turn 380: the agent restated the refund policy and the customer repeated the complaint. Turn 381: the agent restated the refund policy and the customer repeated the complaint. Turn 382: the agent restated the refund policy and the customer repeated the complaint. Turn 383: the agent restated the refund policy and the customer repeated the complaint. Turn 384: the agent restated the refund policy and the customer repeated the complaint. Turn 385: the agent restated the refund policy and the customer repeated the complaint. Turn 386: the agent restated the refund policy and the customer repeated the complaint. Turn 387: the agent restated the refund policy and the customer repeated the complaint. Turn 388: the agent restated the refund policy and the customer repeated the complaint. Turn 389: the agent restated the refund policy and the customer repeated the complaint. Turn 390: the agent restated the refund policy and the customer repeated the complaint. Turn 391: the agent restated the refund policy and the customer repeated the complaint. Turn 392: the agent restated the refund policy and the customer repeated the complaint. Turn 393: the agent restated the refund policy and the customer repeated the complaint. Turn 394: the agent restated the refund policy and the customer repeated the complaint. Turn 395: the agent restated the refund policy and the customer repeated the complaint. Turn 396: the agent restated the refund policy and the customer repeated the complaint. Turn 397: the agent restated the refund policy and the customer repeated the complaint. Turn 398: the agent restated the refund policy and the customer repeated the complaint. Turn 399: the agent restated the refund policy and the customer repeated the complaint.",+ "The app crashes on login since yesterday's update.",+ "ok"+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 91,+ 44,+ 157,+ 74,+ 1024,+ 44,+ 35+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4925,+ "technical": 0.3304,+ "other": 0.1771+ },+ "confidence": 0.0704,+ "answer_confidence": 0.4925,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2205,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.2895,+ "1": 0.2006,+ "2": 0.51+ },+ "confidence": 0.0675,+ "answer_confidence": 0.51,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0363,+ "confidence": 0.9637,+ "answer_confidence": 0.9637,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5409,+ "technical": 0.2757,+ "other": 0.1834+ },+ "confidence": 0.0909,+ "answer_confidence": 0.5409,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8074,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0273,+ "1": 0.138,+ "2": 0.8347+ },+ "confidence": 0.5244,+ "answer_confidence": 0.8347,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7748,+ "confidence": 0.7748,+ "answer_confidence": 0.7748,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 463,+ "output_tokens": 0,+ "state_tokens": 123,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.5116,+ "technical": 0.1679,+ "other": 0.3205+ },+ "confidence": 0.0832,+ "answer_confidence": 0.5116,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.2127,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1436,+ "1": 0.5002,+ "2": 0.3562+ },+ "confidence": 0.0963,+ "answer_confidence": 0.5002,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2121,+ "confidence": 0.7879,+ "answer_confidence": 0.7879,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 214,+ "output_tokens": 0,+ "state_tokens": 40,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4553,+ "technical": 0.1506,+ "other": 0.3941+ },+ "confidence": 0.0804,+ "answer_confidence": 0.4553,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9401,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3838,+ "1": 0.2923,+ "2": 0.3239+ },+ "confidence": 0.0058,+ "answer_confidence": 0.3838,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1726,+ "confidence": 0.8274,+ "answer_confidence": 0.8274,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 6804,+ "state_tokens_dropped": 5814,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "technical",+ "probabilities": {+ "refund": 0.0616,+ "technical": 0.7487,+ "other": 0.1897+ },+ "confidence": 0.3594,+ "answer_confidence": 0.7487,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.4629,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1179,+ "1": 0.3013,+ "2": 0.5808+ },+ "confidence": 0.1543,+ "answer_confidence": 0.5808,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.5343,+ "confidence": 0.5343,+ "answer_confidence": 0.5343,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 124,+ "output_tokens": 0,+ "state_tokens": 10,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.3803,+ "technical": 0.2662,+ "other": 0.3535+ },+ "confidence": 0.01,+ "answer_confidence": 0.3803,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8546,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3938,+ "1": 0.3579,+ "2": 0.2483+ },+ "confidence": 0.0164,+ "answer_confidence": 0.3938,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.3012,+ "confidence": 0.6988,+ "answer_confidence": 0.6988,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 97,+ "output_tokens": 0,+ "state_tokens": 1,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 44+ ],+ [+ 6,+ 74+ ],+ [+ 6,+ 157+ ],+ [+ 3,+ 1024+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sorted_windows.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sorted_windows.jsonnew file mode 100644index 00000000..494c8f20--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_sorted_windows.json@@ -0,0 +1,1101 @@+{+ "name": "batch_sorted_windows",+ "states": [+ "Routine status note 0. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 1. Routine status note 1. ",+ "Routine status note 2. Routine status note 2. Routine status note 2. ",+ "Routine status note 3. Routine status note 3. Routine status note 3. Routine status note 3. ",+ "Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. ",+ "Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. ",+ "Routine status note 7. ",+ "Routine status note 8. Routine status note 8. ",+ "Routine status note 9. Routine status note 9. Routine status note 9. ",+ "Routine status note 10. Routine status note 10. Routine status note 10. Routine status note 10. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. ",+ "Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. ",+ "Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. ",+ "Routine status note 14. ",+ "Routine status note 15. Routine status note 15. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 16. Routine status note 16. Routine status note 16. ",+ "Routine status note 17. Routine status note 17. Routine status note 17. Routine status note 17. "+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2,+ "sort_by_length": true+ },+ "state_widths": [+ 97,+ 47,+ 53,+ 59,+ 65,+ 127,+ 77,+ 41,+ 47,+ 53,+ 115,+ 65,+ 71,+ 77,+ 41,+ 103,+ 53,+ 59+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7222,+ "technical": 0.1761,+ "other": 0.1017+ },+ "confidence": 0.2961,+ "answer_confidence": 0.7222,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7209,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0356,+ "1": 0.2079,+ "2": 0.7565+ },+ "confidence": 0.4025,+ "answer_confidence": 0.7565,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7675,+ "confidence": 0.7675,+ "answer_confidence": 0.7675,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.173,+ "technical": 0.2872,+ "other": 0.5397+ },+ "confidence": 0.0946,+ "answer_confidence": 0.5397,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8082,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4468,+ "1": 0.2981,+ "2": 0.2551+ },+ "confidence": 0.0267,+ "answer_confidence": 0.4468,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1223,+ "confidence": 0.8777,+ "answer_confidence": 0.8777,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1405,+ "technical": 0.2954,+ "other": 0.5642+ },+ "confidence": 0.1272,+ "answer_confidence": 0.5642,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0013,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.345,+ "1": 0.3087,+ "2": 0.3463+ },+ "confidence": 0.0013,+ "answer_confidence": 0.3463,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1068,+ "confidence": 0.8932,+ "answer_confidence": 0.8932,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1397,+ "technical": 0.3011,+ "other": 0.5591+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5591,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9601,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3593,+ "1": 0.3212,+ "2": 0.3195+ },+ "confidence": 0.0014,+ "answer_confidence": 0.3593,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1071,+ "confidence": 0.8929,+ "answer_confidence": 0.8929,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1414,+ "technical": 0.3011,+ "other": 0.5575+ },+ "confidence": 0.1228,+ "answer_confidence": 0.5575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8981,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3945,+ "1": 0.313,+ "2": 0.2926+ },+ "confidence": 0.0078,+ "answer_confidence": 0.3945,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0955,+ "confidence": 0.9045,+ "answer_confidence": 0.9045,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7204,+ "technical": 0.197,+ "other": 0.0826+ },+ "confidence": 0.3061,+ "answer_confidence": 0.7204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7992,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0198,+ "1": 0.1612,+ "2": 0.819+ },+ "confidence": 0.5126,+ "answer_confidence": 0.819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7907,+ "confidence": 0.7907,+ "answer_confidence": 0.7907,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1401,+ "technical": 0.319,+ "other": 0.541+ },+ "confidence": 0.1151,+ "answer_confidence": 0.541,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7457,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4863,+ "1": 0.2818,+ "2": 0.2319+ },+ "confidence": 0.0475,+ "answer_confidence": 0.4863,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0991,+ "confidence": 0.9009,+ "answer_confidence": 0.9009,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1908,+ "technical": 0.2627,+ "other": 0.5465+ },+ "confidence": 0.0921,+ "answer_confidence": 0.5465,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8267,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.431,+ "1": 0.3113,+ "2": 0.2577+ },+ "confidence": 0.0211,+ "answer_confidence": 0.431,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1412,+ "confidence": 0.8588,+ "answer_confidence": 0.8588,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1548,+ "technical": 0.2982,+ "other": 0.547+ },+ "confidence": 0.1083,+ "answer_confidence": 0.547,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8704,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4209,+ "1": 0.2879,+ "2": 0.2913+ },+ "confidence": 0.0151,+ "answer_confidence": 0.4209,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1222,+ "confidence": 0.8778,+ "answer_confidence": 0.8778,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1351,+ "technical": 0.3056,+ "other": 0.5592+ },+ "confidence": 0.1282,+ "answer_confidence": 0.5592,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8124,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.446,+ "1": 0.2956,+ "2": 0.2584+ },+ "confidence": 0.026,+ "answer_confidence": 0.446,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1097,+ "confidence": 0.8903,+ "answer_confidence": 0.8903,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7135,+ "technical": 0.1905,+ "other": 0.096+ },+ "confidence": 0.2884,+ "answer_confidence": 0.7135,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8225,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0182,+ "1": 0.1412,+ "2": 0.8406+ },+ "confidence": 0.5493,+ "answer_confidence": 0.8406,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7732,+ "confidence": 0.7732,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1358,+ "technical": 0.3244,+ "other": 0.5398+ },+ "confidence": 0.1178,+ "answer_confidence": 0.5398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.827,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4369,+ "1": 0.2992,+ "2": 0.2639+ },+ "confidence": 0.0221,+ "answer_confidence": 0.4369,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1021,+ "confidence": 0.8979,+ "answer_confidence": 0.8979,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1337,+ "technical": 0.3239,+ "other": 0.5424+ },+ "confidence": 0.1208,+ "answer_confidence": 0.5424,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8311,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4345,+ "1": 0.2998,+ "2": 0.2656+ },+ "confidence": 0.0211,+ "answer_confidence": 0.4345,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1031,+ "confidence": 0.8969,+ "answer_confidence": 0.8969,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 205,+ "output_tokens": 0,+ "state_tokens": 37,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1339,+ "technical": 0.3298,+ "other": 0.5363+ },+ "confidence": 0.1178,+ "answer_confidence": 0.5363,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.74,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4864,+ "1": 0.2872,+ "2": 0.2264+ },+ "confidence": 0.0486,+ "answer_confidence": 0.4864,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1028,+ "confidence": 0.8972,+ "answer_confidence": 0.8972,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1964,+ "technical": 0.2657,+ "other": 0.5379+ },+ "confidence": 0.0849,+ "answer_confidence": 0.5379,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.836,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4238,+ "1": 0.3164,+ "2": 0.2598+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4238,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1404,+ "confidence": 0.8596,+ "answer_confidence": 0.8596,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6932,+ "technical": 0.2125,+ "other": 0.0943+ },+ "confidence": 0.2665,+ "answer_confidence": 0.6932,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7768,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0217,+ "1": 0.1798,+ "2": 0.7985+ },+ "confidence": 0.48,+ "answer_confidence": 0.7985,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7737,+ "confidence": 0.7737,+ "answer_confidence": 0.7737,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.134,+ "technical": 0.3007,+ "other": 0.5653+ },+ "confidence": 0.1325,+ "answer_confidence": 0.5653,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8129,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4444,+ "1": 0.2983,+ "2": 0.2573+ },+ "confidence": 0.0256,+ "answer_confidence": 0.4444,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1135,+ "confidence": 0.8865,+ "answer_confidence": 0.8865,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1429,+ "technical": 0.3085,+ "other": 0.5486+ },+ "confidence": 0.1168,+ "answer_confidence": 0.5486,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8114,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4437,+ "1": 0.3012,+ "2": 0.2551+ },+ "confidence": 0.0256,+ "answer_confidence": 0.4437,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1153,+ "confidence": 0.8847,+ "answer_confidence": 0.8847,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 41+ ],+ [+ 6,+ 47+ ],+ [+ 6,+ 53+ ],+ [+ 6,+ 65+ ],+ [+ 6,+ 71+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 103+ ],+ [+ 6,+ 127+ ],+ [+ 6,+ 59+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_truncated.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_truncated.jsonnew file mode 100644index 00000000..8e225e6d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_truncated.json@@ -0,0 +1,854 @@+{+ "name": "batch_truncated",+ "states": [+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ [+ {+ "role": "user",+ "content": "Turn 0: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 1: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 2: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 3: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 4: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 5: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 6: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 7: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 8: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 9: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 10: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 11: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 12: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 13: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 14: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 15: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 16: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 17: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 18: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 19: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 20: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 21: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 22: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 23: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 24: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 25: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 26: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 27: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 28: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 29: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 30: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 31: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 32: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 33: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 34: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 35: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 36: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 37: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 38: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 39: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 40: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 41: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 42: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 43: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 44: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 45: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 46: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 47: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 48: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 49: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 50: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 51: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 52: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 53: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 54: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 55: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 56: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 57: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 58: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 59: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 60: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 61: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 62: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 63: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 64: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 65: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 66: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 67: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 68: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 69: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 70: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 71: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 72: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 73: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 74: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 75: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 76: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 77: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 78: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 79: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 80: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 81: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 82: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 83: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 84: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 85: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 86: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 87: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 88: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 89: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 90: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 91: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 92: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 93: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 94: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 95: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 96: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 97: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 98: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 99: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 100: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 101: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 102: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 103: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 104: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 105: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 106: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 107: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 108: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 109: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 110: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 111: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 112: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 113: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 114: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 115: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 116: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 117: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 118: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 119: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 120: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 121: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 122: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 123: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 124: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 125: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 126: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 127: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 128: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 129: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 130: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 131: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 132: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 133: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 134: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 135: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 136: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 137: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 138: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 139: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "I want a refund or I will cancel today."+ }+ ],+ {+ "notes": "Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 1024,+ 1024,+ 1024,+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4553,+ "technical": 0.1506,+ "other": 0.3941+ },+ "confidence": 0.0804,+ "answer_confidence": 0.4553,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9401,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3838,+ "1": 0.2923,+ "2": 0.3239+ },+ "confidence": 0.0058,+ "answer_confidence": 0.3838,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1726,+ "confidence": 0.8274,+ "answer_confidence": 0.8274,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2384,+ "state_tokens_dropped": 1394,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7622,+ "technical": 0.0639,+ "other": 0.1739+ },+ "confidence": 0.3748,+ "answer_confidence": 0.7622,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.562,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1098,+ "1": 0.2184,+ "2": 0.6718+ },+ "confidence": 0.2335,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.6263,+ "confidence": 0.6263,+ "answer_confidence": 0.6263,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 4012,+ "state_tokens_dropped": 3022,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.444,+ "technical": 0.1555,+ "other": 0.4005+ },+ "confidence": 0.0749,+ "answer_confidence": 0.444,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8498,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4282,+ "1": 0.2938,+ "2": 0.278+ },+ "confidence": 0.0179,+ "answer_confidence": 0.4282,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2183,+ "confidence": 0.7817,+ "answer_confidence": 0.7817,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2448,+ "state_tokens_dropped": 1458,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 1024+ ],+ [+ 6,+ 1024+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_truncated_sorted.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_truncated_sorted.jsonnew file mode 100644index 00000000..96581bb1--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_truncated_sorted.json@@ -0,0 +1,855 @@+{+ "name": "batch_truncated_sorted",+ "states": [+ "Customer support transcript. Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ [+ {+ "role": "user",+ "content": "Turn 0: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 1: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 2: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 3: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 4: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 5: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 6: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 7: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 8: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 9: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 10: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 11: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 12: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 13: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 14: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 15: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 16: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 17: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 18: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 19: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 20: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 21: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 22: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 23: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 24: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 25: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 26: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 27: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 28: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 29: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 30: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 31: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 32: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 33: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 34: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 35: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 36: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 37: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 38: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 39: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 40: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 41: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 42: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 43: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 44: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 45: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 46: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 47: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 48: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 49: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 50: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 51: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 52: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 53: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 54: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 55: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 56: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 57: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 58: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 59: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 60: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 61: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 62: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 63: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 64: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 65: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 66: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 67: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 68: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 69: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 70: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 71: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 72: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 73: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 74: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 75: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 76: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 77: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 78: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 79: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 80: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 81: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 82: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 83: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 84: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 85: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 86: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 87: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 88: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 89: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 90: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 91: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 92: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 93: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 94: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 95: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 96: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 97: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 98: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 99: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 100: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 101: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 102: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 103: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 104: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 105: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 106: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 107: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 108: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 109: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 110: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 111: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 112: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 113: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 114: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 115: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 116: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 117: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 118: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 119: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 120: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 121: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 122: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 123: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 124: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 125: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 126: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 127: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 128: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 129: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 130: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 131: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 132: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 133: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 134: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 135: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 136: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 137: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "Turn 138: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "assistant",+ "content": "Turn 139: the agent restated the refund policy and the customer repeated the complaint."+ },+ {+ "role": "user",+ "content": "I want a refund or I will cancel today."+ }+ ],+ {+ "notes": "Turn 0: the agent restated the refund policy and the customer repeated the complaint. Turn 1: the agent restated the refund policy and the customer repeated the complaint. Turn 2: the agent restated the refund policy and the customer repeated the complaint. Turn 3: the agent restated the refund policy and the customer repeated the complaint. Turn 4: the agent restated the refund policy and the customer repeated the complaint. Turn 5: the agent restated the refund policy and the customer repeated the complaint. Turn 6: the agent restated the refund policy and the customer repeated the complaint. Turn 7: the agent restated the refund policy and the customer repeated the complaint. Turn 8: the agent restated the refund policy and the customer repeated the complaint. Turn 9: the agent restated the refund policy and the customer repeated the complaint. Turn 10: the agent restated the refund policy and the customer repeated the complaint. Turn 11: the agent restated the refund policy and the customer repeated the complaint. Turn 12: the agent restated the refund policy and the customer repeated the complaint. Turn 13: the agent restated the refund policy and the customer repeated the complaint. Turn 14: the agent restated the refund policy and the customer repeated the complaint. Turn 15: the agent restated the refund policy and the customer repeated the complaint. Turn 16: the agent restated the refund policy and the customer repeated the complaint. Turn 17: the agent restated the refund policy and the customer repeated the complaint. Turn 18: the agent restated the refund policy and the customer repeated the complaint. Turn 19: the agent restated the refund policy and the customer repeated the complaint. Turn 20: the agent restated the refund policy and the customer repeated the complaint. Turn 21: the agent restated the refund policy and the customer repeated the complaint. Turn 22: the agent restated the refund policy and the customer repeated the complaint. Turn 23: the agent restated the refund policy and the customer repeated the complaint. Turn 24: the agent restated the refund policy and the customer repeated the complaint. Turn 25: the agent restated the refund policy and the customer repeated the complaint. Turn 26: the agent restated the refund policy and the customer repeated the complaint. Turn 27: the agent restated the refund policy and the customer repeated the complaint. Turn 28: the agent restated the refund policy and the customer repeated the complaint. Turn 29: the agent restated the refund policy and the customer repeated the complaint. Turn 30: the agent restated the refund policy and the customer repeated the complaint. Turn 31: the agent restated the refund policy and the customer repeated the complaint. Turn 32: the agent restated the refund policy and the customer repeated the complaint. Turn 33: the agent restated the refund policy and the customer repeated the complaint. Turn 34: the agent restated the refund policy and the customer repeated the complaint. Turn 35: the agent restated the refund policy and the customer repeated the complaint. Turn 36: the agent restated the refund policy and the customer repeated the complaint. Turn 37: the agent restated the refund policy and the customer repeated the complaint. Turn 38: the agent restated the refund policy and the customer repeated the complaint. Turn 39: the agent restated the refund policy and the customer repeated the complaint. Turn 40: the agent restated the refund policy and the customer repeated the complaint. Turn 41: the agent restated the refund policy and the customer repeated the complaint. Turn 42: the agent restated the refund policy and the customer repeated the complaint. Turn 43: the agent restated the refund policy and the customer repeated the complaint. Turn 44: the agent restated the refund policy and the customer repeated the complaint. Turn 45: the agent restated the refund policy and the customer repeated the complaint. Turn 46: the agent restated the refund policy and the customer repeated the complaint. Turn 47: the agent restated the refund policy and the customer repeated the complaint. Turn 48: the agent restated the refund policy and the customer repeated the complaint. Turn 49: the agent restated the refund policy and the customer repeated the complaint. Turn 50: the agent restated the refund policy and the customer repeated the complaint. Turn 51: the agent restated the refund policy and the customer repeated the complaint. Turn 52: the agent restated the refund policy and the customer repeated the complaint. Turn 53: the agent restated the refund policy and the customer repeated the complaint. Turn 54: the agent restated the refund policy and the customer repeated the complaint. Turn 55: the agent restated the refund policy and the customer repeated the complaint. Turn 56: the agent restated the refund policy and the customer repeated the complaint. Turn 57: the agent restated the refund policy and the customer repeated the complaint. Turn 58: the agent restated the refund policy and the customer repeated the complaint. Turn 59: the agent restated the refund policy and the customer repeated the complaint. Turn 60: the agent restated the refund policy and the customer repeated the complaint. Turn 61: the agent restated the refund policy and the customer repeated the complaint. Turn 62: the agent restated the refund policy and the customer repeated the complaint. Turn 63: the agent restated the refund policy and the customer repeated the complaint. Turn 64: the agent restated the refund policy and the customer repeated the complaint. Turn 65: the agent restated the refund policy and the customer repeated the complaint. Turn 66: the agent restated the refund policy and the customer repeated the complaint. Turn 67: the agent restated the refund policy and the customer repeated the complaint. Turn 68: the agent restated the refund policy and the customer repeated the complaint. Turn 69: the agent restated the refund policy and the customer repeated the complaint. Turn 70: the agent restated the refund policy and the customer repeated the complaint. Turn 71: the agent restated the refund policy and the customer repeated the complaint. Turn 72: the agent restated the refund policy and the customer repeated the complaint. Turn 73: the agent restated the refund policy and the customer repeated the complaint. Turn 74: the agent restated the refund policy and the customer repeated the complaint. Turn 75: the agent restated the refund policy and the customer repeated the complaint. Turn 76: the agent restated the refund policy and the customer repeated the complaint. Turn 77: the agent restated the refund policy and the customer repeated the complaint. Turn 78: the agent restated the refund policy and the customer repeated the complaint. Turn 79: the agent restated the refund policy and the customer repeated the complaint. Turn 80: the agent restated the refund policy and the customer repeated the complaint. Turn 81: the agent restated the refund policy and the customer repeated the complaint. Turn 82: the agent restated the refund policy and the customer repeated the complaint. Turn 83: the agent restated the refund policy and the customer repeated the complaint. Turn 84: the agent restated the refund policy and the customer repeated the complaint. Turn 85: the agent restated the refund policy and the customer repeated the complaint. Turn 86: the agent restated the refund policy and the customer repeated the complaint. Turn 87: the agent restated the refund policy and the customer repeated the complaint. Turn 88: the agent restated the refund policy and the customer repeated the complaint. Turn 89: the agent restated the refund policy and the customer repeated the complaint. Turn 90: the agent restated the refund policy and the customer repeated the complaint. Turn 91: the agent restated the refund policy and the customer repeated the complaint. Turn 92: the agent restated the refund policy and the customer repeated the complaint. Turn 93: the agent restated the refund policy and the customer repeated the complaint. Turn 94: the agent restated the refund policy and the customer repeated the complaint. Turn 95: the agent restated the refund policy and the customer repeated the complaint. Turn 96: the agent restated the refund policy and the customer repeated the complaint. Turn 97: the agent restated the refund policy and the customer repeated the complaint. Turn 98: the agent restated the refund policy and the customer repeated the complaint. Turn 99: the agent restated the refund policy and the customer repeated the complaint. Turn 100: the agent restated the refund policy and the customer repeated the complaint. Turn 101: the agent restated the refund policy and the customer repeated the complaint. Turn 102: the agent restated the refund policy and the customer repeated the complaint. Turn 103: the agent restated the refund policy and the customer repeated the complaint. Turn 104: the agent restated the refund policy and the customer repeated the complaint. Turn 105: the agent restated the refund policy and the customer repeated the complaint. Turn 106: the agent restated the refund policy and the customer repeated the complaint. Turn 107: the agent restated the refund policy and the customer repeated the complaint. Turn 108: the agent restated the refund policy and the customer repeated the complaint. Turn 109: the agent restated the refund policy and the customer repeated the complaint. Turn 110: the agent restated the refund policy and the customer repeated the complaint. Turn 111: the agent restated the refund policy and the customer repeated the complaint. Turn 112: the agent restated the refund policy and the customer repeated the complaint. Turn 113: the agent restated the refund policy and the customer repeated the complaint. Turn 114: the agent restated the refund policy and the customer repeated the complaint. Turn 115: the agent restated the refund policy and the customer repeated the complaint. Turn 116: the agent restated the refund policy and the customer repeated the complaint. Turn 117: the agent restated the refund policy and the customer repeated the complaint. Turn 118: the agent restated the refund policy and the customer repeated the complaint. Turn 119: the agent restated the refund policy and the customer repeated the complaint. Turn 120: the agent restated the refund policy and the customer repeated the complaint. Turn 121: the agent restated the refund policy and the customer repeated the complaint. Turn 122: the agent restated the refund policy and the customer repeated the complaint. Turn 123: the agent restated the refund policy and the customer repeated the complaint. Turn 124: the agent restated the refund policy and the customer repeated the complaint. Turn 125: the agent restated the refund policy and the customer repeated the complaint. Turn 126: the agent restated the refund policy and the customer repeated the complaint. Turn 127: the agent restated the refund policy and the customer repeated the complaint. Turn 128: the agent restated the refund policy and the customer repeated the complaint. Turn 129: the agent restated the refund policy and the customer repeated the complaint. Turn 130: the agent restated the refund policy and the customer repeated the complaint. Turn 131: the agent restated the refund policy and the customer repeated the complaint. Turn 132: the agent restated the refund policy and the customer repeated the complaint. Turn 133: the agent restated the refund policy and the customer repeated the complaint. Turn 134: the agent restated the refund policy and the customer repeated the complaint. Turn 135: the agent restated the refund policy and the customer repeated the complaint. Turn 136: the agent restated the refund policy and the customer repeated the complaint. Turn 137: the agent restated the refund policy and the customer repeated the complaint. Turn 138: the agent restated the refund policy and the customer repeated the complaint. Turn 139: the agent restated the refund policy and the customer repeated the complaint.",+ "message": "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ },+ "Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account."+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 3,+ "sort_by_length": true+ },+ "state_widths": [+ 1024,+ 1024,+ 1024,+ 91+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.4553,+ "technical": 0.1506,+ "other": 0.3941+ },+ "confidence": 0.0804,+ "answer_confidence": 0.4553,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9401,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3838,+ "1": 0.2923,+ "2": 0.3239+ },+ "confidence": 0.0058,+ "answer_confidence": 0.3838,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1726,+ "confidence": 0.8274,+ "answer_confidence": 0.8274,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2384,+ "state_tokens_dropped": 1394,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7622,+ "technical": 0.0639,+ "other": 0.1739+ },+ "confidence": 0.3748,+ "answer_confidence": 0.7622,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.562,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.1098,+ "1": 0.2184,+ "2": 0.6718+ },+ "confidence": 0.2335,+ "answer_confidence": 0.6718,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.6263,+ "confidence": 0.6263,+ "answer_confidence": 0.6263,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 4012,+ "state_tokens_dropped": 3022,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.444,+ "technical": 0.1555,+ "other": 0.4005+ },+ "confidence": 0.0749,+ "answer_confidence": 0.444,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8498,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4282,+ "1": 0.2938,+ "2": 0.278+ },+ "confidence": 0.0179,+ "answer_confidence": 0.4282,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.2183,+ "confidence": 0.7817,+ "answer_confidence": 0.7817,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 3072,+ "output_tokens": 0,+ "state_tokens": 2448,+ "state_tokens_dropped": 1458,+ "truncated": true,+ "truncated_questions": [+ "topic",+ "urgency",+ "cancel"+ ]+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7054,+ "technical": 0.1834,+ "other": 0.1111+ },+ "confidence": 0.2705,+ "answer_confidence": 0.7054,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8371,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0193,+ "1": 0.1243,+ "2": 0.8564+ },+ "confidence": 0.574,+ "answer_confidence": 0.8564,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7914,+ "confidence": 0.7914,+ "answer_confidence": 0.7914,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 265,+ "output_tokens": 0,+ "state_tokens": 57,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 9,+ 1024+ ],+ [+ 3,+ 1024+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_unsorted_windows.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_unsorted_windows.jsonnew file mode 100644index 00000000..3702715d--- /dev/null+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/case_batch_unsorted_windows.json@@ -0,0 +1,1100 @@+{+ "name": "batch_unsorted_windows",+ "states": [+ "Routine status note 0. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 1. Routine status note 1. ",+ "Routine status note 2. Routine status note 2. Routine status note 2. ",+ "Routine status note 3. Routine status note 3. Routine status note 3. Routine status note 3. ",+ "Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. Routine status note 4. ",+ "Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Routine status note 5. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. Routine status note 6. ",+ "Routine status note 7. ",+ "Routine status note 8. Routine status note 8. ",+ "Routine status note 9. Routine status note 9. Routine status note 9. ",+ "Routine status note 10. Routine status note 10. Routine status note 10. Routine status note 10. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. Routine status note 11. ",+ "Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. Routine status note 12. ",+ "Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. Routine status note 13. ",+ "Routine status note 14. ",+ "Routine status note 15. Routine status note 15. Subject: Double charged on invoice 88213\n\nHi, I was billed twice this month for the Pro plan and the second charge has not been refunded. This is the third time I have written in. If it is not fixed today I am cancelling the account.",+ "Routine status note 16. Routine status note 16. Routine status note 16. ",+ "Routine status note 17. Routine status note 17. Routine status note 17. Routine status note 17. "+ ],+ "questions": {+ "topic": {+ "type": "choice",+ "instructions": "What is the request about?",+ "criteria": {+ "refund": "money back, duplicate charge",+ "technical": "bugs and outages",+ "other": null+ }+ },+ "urgency": {+ "type": "score",+ "instructions": "How urgent is this request?",+ "criteria": [+ "not urgent",+ "this week",+ "today"+ ]+ },+ "cancel": {+ "type": "noul",+ "instructions": "The customer threatens to cancel the account."+ }+ },+ "options": {+ "batch_size": 2+ },+ "state_widths": [+ 97,+ 47,+ 53,+ 59,+ 65,+ 127,+ 77,+ 41,+ 47,+ 53,+ 115,+ 65,+ 71,+ 77,+ 41,+ 103,+ 53,+ 59+ ],+ "results": [+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7222,+ "technical": 0.1761,+ "other": 0.1017+ },+ "confidence": 0.2961,+ "answer_confidence": 0.7222,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7209,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0356,+ "1": 0.2079,+ "2": 0.7565+ },+ "confidence": 0.4025,+ "answer_confidence": 0.7565,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7675,+ "confidence": 0.7675,+ "answer_confidence": 0.7675,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 283,+ "output_tokens": 0,+ "state_tokens": 63,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.173,+ "technical": 0.2872,+ "other": 0.5397+ },+ "confidence": 0.0946,+ "answer_confidence": 0.5397,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8082,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4468,+ "1": 0.2981,+ "2": 0.2551+ },+ "confidence": 0.0267,+ "answer_confidence": 0.4468,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1223,+ "confidence": 0.8777,+ "answer_confidence": 0.8777,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1405,+ "technical": 0.2954,+ "other": 0.5642+ },+ "confidence": 0.1272,+ "answer_confidence": 0.5642,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.0013,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.345,+ "1": 0.3087,+ "2": 0.3463+ },+ "confidence": 0.0013,+ "answer_confidence": 0.3463,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1068,+ "confidence": 0.8932,+ "answer_confidence": 0.8932,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1397,+ "technical": 0.3011,+ "other": 0.5591+ },+ "confidence": 0.1249,+ "answer_confidence": 0.5591,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.9601,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3593,+ "1": 0.3212,+ "2": 0.3195+ },+ "confidence": 0.0014,+ "answer_confidence": 0.3593,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1071,+ "confidence": 0.8929,+ "answer_confidence": 0.8929,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1414,+ "technical": 0.3011,+ "other": 0.5575+ },+ "confidence": 0.1228,+ "answer_confidence": 0.5575,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8981,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.3945,+ "1": 0.313,+ "2": 0.2926+ },+ "confidence": 0.0078,+ "answer_confidence": 0.3945,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0955,+ "confidence": 0.9045,+ "answer_confidence": 0.9045,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7204,+ "technical": 0.197,+ "other": 0.0826+ },+ "confidence": 0.3061,+ "answer_confidence": 0.7204,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7992,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0198,+ "1": 0.1612,+ "2": 0.819+ },+ "confidence": 0.5126,+ "answer_confidence": 0.819,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7907,+ "confidence": 0.7907,+ "answer_confidence": 0.7907,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 373,+ "output_tokens": 0,+ "state_tokens": 93,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1401,+ "technical": 0.319,+ "other": 0.541+ },+ "confidence": 0.1151,+ "answer_confidence": 0.541,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.7457,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4863,+ "1": 0.2818,+ "2": 0.2319+ },+ "confidence": 0.0475,+ "answer_confidence": 0.4863,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.0991,+ "confidence": 0.9009,+ "answer_confidence": 0.9009,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1908,+ "technical": 0.2627,+ "other": 0.5465+ },+ "confidence": 0.0921,+ "answer_confidence": 0.5465,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8267,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.431,+ "1": 0.3113,+ "2": 0.2577+ },+ "confidence": 0.0211,+ "answer_confidence": 0.431,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1412,+ "confidence": 0.8588,+ "answer_confidence": 0.8588,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1548,+ "technical": 0.2982,+ "other": 0.547+ },+ "confidence": 0.1083,+ "answer_confidence": 0.547,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8704,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4209,+ "1": 0.2879,+ "2": 0.2913+ },+ "confidence": 0.0151,+ "answer_confidence": 0.4209,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1222,+ "confidence": 0.8778,+ "answer_confidence": 0.8778,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 133,+ "output_tokens": 0,+ "state_tokens": 13,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1351,+ "technical": 0.3056,+ "other": 0.5592+ },+ "confidence": 0.1282,+ "answer_confidence": 0.5592,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8124,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.446,+ "1": 0.2956,+ "2": 0.2584+ },+ "confidence": 0.026,+ "answer_confidence": 0.446,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1097,+ "confidence": 0.8903,+ "answer_confidence": 0.8903,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.7135,+ "technical": 0.1905,+ "other": 0.096+ },+ "confidence": 0.2884,+ "answer_confidence": 0.7135,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.8225,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0182,+ "1": 0.1412,+ "2": 0.8406+ },+ "confidence": 0.5493,+ "answer_confidence": 0.8406,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7732,+ "confidence": 0.7732,+ "answer_confidence": 0.7732,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 337,+ "output_tokens": 0,+ "state_tokens": 81,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1358,+ "technical": 0.3244,+ "other": 0.5398+ },+ "confidence": 0.1178,+ "answer_confidence": 0.5398,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.827,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4369,+ "1": 0.2992,+ "2": 0.2639+ },+ "confidence": 0.0221,+ "answer_confidence": 0.4369,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1021,+ "confidence": 0.8979,+ "answer_confidence": 0.8979,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 187,+ "output_tokens": 0,+ "state_tokens": 31,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1337,+ "technical": 0.3239,+ "other": 0.5424+ },+ "confidence": 0.1208,+ "answer_confidence": 0.5424,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8311,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4345,+ "1": 0.2998,+ "2": 0.2656+ },+ "confidence": 0.0211,+ "answer_confidence": 0.4345,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1031,+ "confidence": 0.8969,+ "answer_confidence": 0.8969,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 205,+ "output_tokens": 0,+ "state_tokens": 37,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1339,+ "technical": 0.3298,+ "other": 0.5363+ },+ "confidence": 0.1178,+ "answer_confidence": 0.5363,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.74,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4864,+ "1": 0.2872,+ "2": 0.2264+ },+ "confidence": 0.0486,+ "answer_confidence": 0.4864,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1028,+ "confidence": 0.8972,+ "answer_confidence": 0.8972,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 223,+ "output_tokens": 0,+ "state_tokens": 43,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1964,+ "technical": 0.2657,+ "other": 0.5379+ },+ "confidence": 0.0849,+ "answer_confidence": 0.5379,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.836,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4238,+ "1": 0.3164,+ "2": 0.2598+ },+ "confidence": 0.0187,+ "answer_confidence": 0.4238,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1404,+ "confidence": 0.8596,+ "answer_confidence": 0.8596,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 115,+ "output_tokens": 0,+ "state_tokens": 7,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "refund",+ "probabilities": {+ "refund": 0.6932,+ "technical": 0.2125,+ "other": 0.0943+ },+ "confidence": 0.2665,+ "answer_confidence": 0.6932,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 1.7768,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.0217,+ "1": 0.1798,+ "2": 0.7985+ },+ "confidence": 0.48,+ "answer_confidence": 0.7985,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.7737,+ "confidence": 0.7737,+ "answer_confidence": 0.7737,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 301,+ "output_tokens": 0,+ "state_tokens": 69,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.134,+ "technical": 0.3007,+ "other": 0.5653+ },+ "confidence": 0.1325,+ "answer_confidence": 0.5653,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8129,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4444,+ "1": 0.2983,+ "2": 0.2573+ },+ "confidence": 0.0256,+ "answer_confidence": 0.4444,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1135,+ "confidence": 0.8865,+ "answer_confidence": 0.8865,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 151,+ "output_tokens": 0,+ "state_tokens": 19,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ },+ {+ "model": "laya-rl-agent-onnx",+ "answers": {+ "topic": {+ "type": "choice",+ "choice": "other",+ "probabilities": {+ "refund": 0.1429,+ "technical": 0.3085,+ "other": 0.5486+ },+ "confidence": 0.1168,+ "answer_confidence": 0.5486,+ "action": {+ "act_probability": 1.0+ }+ },+ "urgency": {+ "type": "score",+ "score": 0.8114,+ "legend": {+ "0": "not urgent",+ "1": "this week",+ "2": "today"+ },+ "probabilities": {+ "0": 0.4437,+ "1": 0.3012,+ "2": 0.2551+ },+ "confidence": 0.0256,+ "answer_confidence": 0.4437,+ "action": {+ "act_probability": 1.0+ }+ },+ "cancel": {+ "type": "noul",+ "noul": 0.1153,+ "confidence": 0.8847,+ "answer_confidence": 0.8847,+ "action": {+ "act_probability": 1.0+ }+ }+ },+ "usage": {+ "input_tokens": 169,+ "output_tokens": 0,+ "state_tokens": 25,+ "state_tokens_dropped": 0,+ "truncated": false,+ "truncated_questions": []+ }+ }+ ],+ "runs": [+ [+ 6,+ 97+ ],+ [+ 6,+ 59+ ],+ [+ 6,+ 127+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 53+ ],+ [+ 6,+ 115+ ],+ [+ 6,+ 77+ ],+ [+ 6,+ 103+ ],+ [+ 6,+ 59+ ]+ ]+}diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/index.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/index.jsonindex 5c2bf1ce..eb70e281 100644--- a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/index.json+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/index.json@@ -162,5 +162,191 @@"file": "case_long_no_state_room.json","expects_error": true,"kind": "long"+ },+ {+ "name": "batch_one_state",+ "file": "case_batch_one_state.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_mixed",+ "file": "case_batch_mixed.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_1",+ "file": "case_batch_size_1.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_3",+ "file": "case_batch_size_3.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_over_len",+ "file": "case_batch_size_over_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_zero",+ "file": "case_batch_size_zero.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_size_negative",+ "file": "case_batch_size_negative.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_on",+ "file": "case_batch_sort_on.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_off",+ "file": "case_batch_sort_off.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_3",+ "file": "case_batch_sort_size_3.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_partial_window",+ "file": "case_batch_sort_partial_window.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_no_batch_size",+ "file": "case_batch_sort_no_batch_size.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_1",+ "file": "case_batch_sort_size_1.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_eq_len",+ "file": "case_batch_sort_size_eq_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_over_len",+ "file": "case_batch_sort_size_over_len.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sort_size_zero",+ "file": "case_batch_sort_size_zero.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_truncated",+ "file": "case_batch_truncated.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_truncated_sorted",+ "file": "case_batch_truncated_sorted.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_duplicate_states",+ "file": "case_batch_duplicate_states.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_states",+ "file": "case_batch_empty_states.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_states_invalid_questions",+ "file": "case_batch_empty_states_invalid_questions.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_questions",+ "file": "case_batch_empty_questions.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_both",+ "file": "case_batch_empty_both.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sorted",+ "file": "case_batch_sorted.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_sorted_windows",+ "file": "case_batch_sorted_windows.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_unsorted_windows",+ "file": "case_batch_unsorted_windows.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_chunked",+ "file": "case_batch_chunked.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_single_question",+ "file": "case_batch_single_question.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_empty_questions_with_options",+ "file": "case_batch_empty_questions_with_options.json",+ "expects_error": false,+ "kind": "batch"+ },+ {+ "name": "batch_none_state",+ "file": "case_batch_none_state.json",+ "expects_error": true,+ "kind": "batch"+ },+ {+ "name": "batch_options_exceed_head",+ "file": "case_batch_options_exceed_head.json",+ "expects_error": true,+ "kind": "batch"}]diff --git a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/meta.json b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/meta.jsonindex 7e4bec91..738c8cd4 100644--- a/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/meta.json+++ b/laya-dotnet/tests/Laya.Tests/golden/typed-decisions/meta.json@@ -1,7 +1,7 @@{"generator": "tools/dump_golden.py","onnx_dir": "typed-decisions",- "laya_version": "0.4.11",+ "laya_version": "0.4.14","onnxruntime_version": "1.30.0","transformers_version": "5.17.0","config": {diff --git a/laya-dotnet/tools/dump_golden.py b/laya-dotnet/tools/dump_golden.pyindex fc890cab..2862c5f0 100644--- a/laya-dotnet/tools/dump_golden.py+++ b/laya-dotnet/tools/dump_golden.py@@ -9,6 +9,8 @@ paraphrase of it. It also means no 1.3 GB safetensors checkpoint is needed: theONNX graph supplies the forward pass.Long cases run the genuine `ONNXAgent.predict_long`, sharing that same verified session.+Batch cases run the genuine `ONNXAgent.predict_batch` the same way, and record the shape of every+session run it makes, which is how `sort_by_length` reordering is pinned.Before writing anything the script checks its ONNX session against the PyTorch referencevectors bundled in `fixtures.npz`, so a bad session can never silently poison the goldens.@@ -38,7 +40,15 @@ REPO = os.path.dirname(os.path.dirname(TOOLS))sys.path.insert(0, REPO)sys.path.insert(0, TOOLS)-from golden_cases import CASES, ERROR_CASES, LONG_CASES, LONG_ERROR_CASES, SHORTLIST_E2E_CASES # noqa: E402+from golden_cases import ( # noqa: E402+ BATCH_CASES,+ BATCH_ERROR_CASES,+ CASES,+ ERROR_CASES,+ LONG_CASES,+ LONG_ERROR_CASES,+ SHORTLIST_E2E_CASES,+)import hashing_embedder # noqa: E402@@ -438,6 +448,60 @@ def record_long_case(agent: Agent, case: dict, expects_error: bool = False) -> dreturn rec+class RecordingSession:+ """Forwards to the verified ONNX session and notes each run's input shape, so a batch case+ can record how `predict_batch` actually chunked and ordered its states."""++ def __init__(self, session: ort.InferenceSession):+ self.session = session+ self.runs = []++ def run(self, names, feeds):+ self.runs.append([int(d) for d in feeds["input_ids"].shape])+ return self.session.run(names, feeds)+++def record_batch_case(agent: Agent, case: dict, expects_error: bool = False) -> dict:+ """Run the genuine ONNXAgent.predict_batch, sharing the already verified session/tokenizer."""+ from laya.onnx_agent import ONNXAgent++ session = RecordingSession(agent.model.sess)+ onnx = ONNXAgent.__new__(ONNXAgent)+ onnx.cfg, onnx.tok, onnx.session = agent.cfg, agent.tok, session+ onnx.temperature = agent.temperature+ onnx.temperature_by_options = agent.temperature_by_options+ onnx.lang_temperatures = {}+ onnx.hooks = []+ onnx.model_id = "golden"+ states, questions = case["states"], case["questions"]+ options = case.get("options", {})+ rec = {"name": case["name"], "states": states, "questions": questions, "options": options}+ if expects_error:+ expected = {"TypeError": TypeError, "ValueError": ValueError}[case["error_type"]]+ try:+ onnx.predict_batch(states, questions, **options)+ except expected as e:+ rec.update(error_type=type(e).__name__, error_message=str(e))+ return rec+ raise SystemExit("batch case %r was expected to raise %s but did not" % (case["name"], case["error_type"]))++ # Each state's widest question row: the key sort_by_length orders by. Recorded separately from+ # the results so the C# chunk planning can be checked against Python's own token counts.+ widths = []+ if questions and states:+ ids = list(questions.keys())+ internal = {qid: onnx._to_internal(questions[qid]) for qid in ids}+ for state in states:+ items = onnx._encode_state(state, ids, internal, onnx.cfg.get("max_len", 512),+ onnx.cfg.get("head_max_len", 192))+ widths.append(max(len(item["ids"]) for item in items))+ rec["state_widths"] = widths+ session.runs.clear()+ rec["results"] = onnx.predict_batch(states, questions, **options)+ rec["runs"] = list(session.runs)+ return rec++def dump(obj, path: str):with open(path, "w", encoding="utf-8", newline="\n") as f:json.dump(obj, f, ensure_ascii=False, indent=2, sort_keys=False)@@ -540,6 +604,15 @@ def run_checkpoint(onnx_dir: str, out_dir: str) -> int:"expects_error": expects_error, "kind": "long",})+ for cases, expects_error in ((BATCH_CASES, False), (BATCH_ERROR_CASES, True)):+ for case in cases:+ rec = record_batch_case(agent, case, expects_error)+ dump(rec, os.path.join(out_dir, "case_%s.json" % case["name"]))+ index.append({+ "name": case["name"], "file": "case_%s.json" % case["name"],+ "expects_error": expects_error, "kind": "batch",+ })+dump(index, os.path.join(out_dir, "index.json"))print("done: %d cases -> %s" % (len(index), out_dir))return 0diff --git a/laya-dotnet/tools/dump_routing_golden.py b/laya-dotnet/tools/dump_routing_golden.pyindex b14cc02b..d2f84f76 100644--- a/laya-dotnet/tools/dump_routing_golden.py+++ b/laya-dotnet/tools/dump_routing_golden.py@@ -11,6 +11,9 @@ corpus from `laya-dotnet/tools/routing_cases.py` and writes one JSON file per prroute_probe.json Router.route() decisions (model, reason, detection,workflow -- `repo` is intentionally omitted: the portedRouteDecision has no Repo field) for every ROUTE_CASES entry.+ route_batch_probe.json Router.route_batch() decisions for every ROUTE_BATCH_CASES entry, and+ the exception type/message for every ROUTE_BATCH_ERROR_CASES entry+ (route_batch loads nothing, so no model is needed).email_probe.json clean_email_body and email_state for every EMAIL_CLEAN_CASES /EMAIL_STATE_CASES entry.shortlist_probe.json shortlist_choice(labels, scores, passthrough) for every@@ -52,6 +55,8 @@ from routing_cases import ( # noqa: E402EMAIL_CLEAN_CASES,EMAIL_STATE_CASES,LANG_STATES,+ ROUTE_BATCH_CASES,+ ROUTE_BATCH_ERROR_CASES,ROUTE_CASES,SAMPLE_BANKING_CRITERIA,SAMPLE_BANKING_INSTRUCTIONS,@@ -187,6 +192,34 @@ def build_route_probe():return out+# ============================================================================ route_batch_probe+def build_route_batch_probe():+ cases = []+ for label, router_kwargs, requests in ROUTE_BATCH_CASES:+ decisions = Router(**router_kwargs).route_batch(requests)+ cases.append({+ "label": label,+ "router_kwargs": router_kwargs,+ "requests": requests,+ "decisions": [_decision_payload(d) for d in decisions],+ })+ errors = []+ for label, router_kwargs, requests in ROUTE_BATCH_ERROR_CASES:+ try:+ Router(**router_kwargs).route_batch(requests)+ except (TypeError, ValueError) as e:+ errors.append({+ "label": label,+ "router_kwargs": router_kwargs,+ "requests": requests,+ "error_type": type(e).__name__,+ "error_message": str(e),+ })+ else:+ raise SystemExit("route_batch case %r was expected to raise but did not" % label)+ return {"cases": cases, "errors": errors}++# ============================================================================ email_probedef build_email_probe():clean = []@@ -356,6 +389,7 @@ def main() -> int:lang_probe = build_lang_probe()route_probe = build_route_probe()+ route_batch_probe = build_route_batch_probe()email_probe = build_email_probe()shortlist_probe = build_shortlist_probe()hashing_probe = build_hashing_embedder_probe()@@ -376,6 +410,8 @@ def main() -> int:"counts": {"lang_probe": len(lang_probe),"route_probe": len(route_probe),+ "route_batch_probe": len(route_batch_probe["cases"]),+ "route_batch_probe_errors": len(route_batch_probe["errors"]),"email_probe_clean": len(email_probe["clean"]),"email_probe_state": len(email_probe["state"]),"shortlist_probe": len(shortlist_probe),@@ -386,6 +422,9 @@ def main() -> int:results = {}results["lang_probe.json"] = dump(lang_probe, os.path.join(out_dir, "lang_probe.json"), args.force)results["route_probe.json"] = dump(route_probe, os.path.join(out_dir, "route_probe.json"), args.force)+ results["route_batch_probe.json"] = dump(+ route_batch_probe, os.path.join(out_dir, "route_batch_probe.json"), args.force+ )results["email_probe.json"] = dump(email_probe, os.path.join(out_dir, "email_probe.json"), args.force)results["shortlist_probe.json"] = dump(shortlist_probe, os.path.join(out_dir, "shortlist_probe.json"), args.force)results["hashing_embedder_probe.json"] = dump(diff --git a/laya-dotnet/tools/golden_cases.py b/laya-dotnet/tools/golden_cases.pyindex 25f4733a..80792ddd 100644--- a/laya-dotnet/tools/golden_cases.py+++ b/laya-dotnet/tools/golden_cases.py@@ -386,3 +386,128 @@ LONG_ERROR_CASES = ["options": {"aggregate": "mean"}},{"name": "long_no_state_room", "state": "short", "questions": ERROR_CASES[0]["questions"]},]+++# ONNXAgent.predict_batch: the same questions over many states, with the batching knobs.+# States are the order-sensitive part: widths differ so `sort_by_length` has something to+# reorder, and list states are long enough to be left-truncated. `options` go to predict_batch+# verbatim (`batch_size`, `sort_by_length`).+BATCH_QUESTIONS = LONG_QUESTIONS++_BATCH_FILLER = "Routine account check completed. "+_BATCH_TURNS = " ".join(+ "Turn %d: the agent restated the refund policy and the customer repeated the complaint." % i+ for i in range(140)+)++# Widths in the order given are deliberately shuffled, so a stable sort has real work to do and+# repeated widths (k % 5) exercise its tie-breaking.+BATCH_SORT_STATES = [_BATCH_FILLER * k + QUICKSTART_STATE for k in+ (18, 2, 9, 0, 14, 5, 11, 1, 16, 7, 3, 12, 19, 4, 8, 13, 6, 17, 10, 15)]++BATCH_MIXED_STATES = [+ QUICKSTART_STATE,+ {"subject": "Double charged on invoice 88213", "body": QUICKSTART_STATE},+ [{"role": "user", "content": "Hi, I need help with my invoice."},+ {"role": "assistant", "content": "Of course, what is wrong?"},+ {"role": "user", "content": QUICKSTART_STATE}],+ "",+ _BATCH_FILLER * 12 + QUICKSTART_STATE,+ "Thanks, that is all sorted now.",+ {"notes": _BATCH_FILLER * 8, "message": "Please cancel my account today."},+ "Mein Konto wurde zweimal belastet. Bitte erstatten Sie den Betrag.",+]++# Long enough to overflow every checkpoint's window: a list state keeps its newest turns+# (left truncation), a string or dict keeps its start.+BATCH_TRUNCATED_STATES = [+ "Customer support transcript. " + _BATCH_TURNS,+ [{"role": "user" if i % 2 == 0 else "assistant",+ "content": "Turn %d: the agent restated the refund policy and the customer repeated the complaint." % i}+ for i in range(140)] + [{"role": "user", "content": "I want a refund or I will cancel today."}],+ {"notes": _BATCH_TURNS, "message": QUICKSTART_STATE},+ QUICKSTART_STATE,+]++# Shared with the Rust SDK's corpus. A mix of kinds and widths, one of them long enough to truncate.+BATCH_STATES = [+ QUICKSTART_STATE,+ "Thanks, the refund arrived and everything works now.",+ {"ticket": 4821, "message": QUICKSTART_STATE, "notes": "Routine checks. " * 12},+ [{"role": "assistant", "content": "How can I help?"},+ {"role": "user", "content": "I was billed twice this month and nobody has answered."}],+ LONG_STATE,+ "The app crashes on login since yesterday's update.",+ "ok",+]++# Eighteen states of varied length, so a batch size of two crosses the eight-batch sort window.+BATCH_WINDOW_STATES = [+ ("Routine status note %d. " % i) * (i % 7 + 1) + (QUICKSTART_STATE if i % 5 == 0 else "")+ for i in range(18)+]++BATCH_CASES = [+ {"name": "batch_one_state", "states": [QUICKSTART_STATE], "questions": BATCH_QUESTIONS},+ {"name": "batch_mixed", "states": BATCH_MIXED_STATES, "questions": BATCH_QUESTIONS},+ {"name": "batch_size_1", "states": BATCH_MIXED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 1}},+ {"name": "batch_size_3", "states": BATCH_MIXED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 3}},+ {"name": "batch_size_over_len", "states": BATCH_MIXED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 100}},+ # `batch_size and batch_size > 0` is falsy for zero and negatives: one run, no error.+ {"name": "batch_size_zero", "states": BATCH_MIXED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 0}},+ {"name": "batch_size_negative", "states": BATCH_MIXED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": -2}},+ # sort_by_length takes effect only for 1 < batch_size < len(states); the sort window is 8 batches.+ {"name": "batch_sort_on", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2, "sort_by_length": True}},+ {"name": "batch_sort_off", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2}},+ {"name": "batch_sort_size_3", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 3, "sort_by_length": True}},+ {"name": "batch_sort_partial_window", "states": BATCH_SORT_STATES[:3], "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2, "sort_by_length": True}},+ {"name": "batch_sort_no_batch_size", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"sort_by_length": True}},+ {"name": "batch_sort_size_1", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 1, "sort_by_length": True}},+ {"name": "batch_sort_size_eq_len", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 20, "sort_by_length": True}},+ {"name": "batch_sort_size_over_len", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 25, "sort_by_length": True}},+ {"name": "batch_sort_size_zero", "states": BATCH_SORT_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 0, "sort_by_length": True}},+ {"name": "batch_truncated", "states": BATCH_TRUNCATED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2}},+ {"name": "batch_truncated_sorted", "states": BATCH_TRUNCATED_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 3, "sort_by_length": True}},+ {"name": "batch_duplicate_states", "states": [QUICKSTART_STATE] * 3, "questions": BATCH_QUESTIONS},+ # An empty list is answered without looking at the questions, even ones that cannot be asked.+ {"name": "batch_empty_states", "states": [], "questions": BATCH_QUESTIONS},+ {"name": "batch_empty_states_invalid_questions", "states": [], "questions": ERROR_CASES[0]["questions"]},+ {"name": "batch_empty_questions", "states": [QUICKSTART_STATE, ""], "questions": {}},+ {"name": "batch_empty_both", "states": [], "questions": {}},+ {"name": "batch_sorted", "states": BATCH_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2, "sort_by_length": True}},+ {"name": "batch_sorted_windows", "states": BATCH_WINDOW_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2, "sort_by_length": True}},+ {"name": "batch_unsorted_windows", "states": BATCH_WINDOW_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 2}},+ {"name": "batch_chunked", "states": BATCH_STATES, "questions": BATCH_QUESTIONS,+ "options": {"batch_size": 3}},+ # A single question per state.+ {"name": "batch_single_question", "states": BATCH_STATES[:4],+ "questions": {"cancel": BATCH_QUESTIONS["cancel"]}, "options": {"batch_size": 2}},+ {"name": "batch_empty_questions_with_options", "states": BATCH_STATES[:3], "questions": {},+ "options": {"batch_size": 2, "sort_by_length": True}},+]++BATCH_ERROR_CASES = [+ {"name": "batch_none_state", "states": [QUICKSTART_STATE, None], "questions": BATCH_QUESTIONS,+ "error_type": "TypeError"},+ {"name": "batch_options_exceed_head", "states": ["short", QUICKSTART_STATE],+ "questions": ERROR_CASES[0]["questions"], "error_type": "ValueError"},+]diff --git a/laya-dotnet/tools/routing_cases.py b/laya-dotnet/tools/routing_cases.pyindex 651efe80..63ccbedd 100644--- a/laya-dotnet/tools/routing_cases.py+++ b/laya-dotnet/tools/routing_cases.py@@ -11,6 +11,7 @@ Four sections, one per probe file:LANG_STATES -> lang_probe.json (lang.analyse / detect_script / script_profile /latin_profile / state_text)ROUTE_CASES -> route_probe.json (router.Router.route)+ ROUTE_BATCH_CASES -> route_batch_probe.json (router.Router.route_batch, model-free)EMAIL_CASES -> email_probe.json (email.clean_email_body / email_state)SHORTLIST_CASES -> shortlist_probe.json (shortlist.shortlist_choice)@@ -576,6 +577,78 @@ ROUTE_CASES = []+++# ============================================================================ route_batch_probe+# Router.route_batch(requests): (label, Router kwargs, request dicts). Requests are JSON-able+# (lang_guess as a language code) because the corpus is replayed from JSON by the .NET suite.+# route_batch loads nothing, so these need no model.++ROUTE_BATCH_CASES = [+ ("empty", {}, []),+ ("single_english", {}, [{"state": "I was charged twice, please refund.", "questions": Q_GENERIC}]),+ ("mixed_order", {}, [+ {"state": "I was charged twice, please refund.", "questions": Q_GENERIC},+ {"state": "Der Kunde wurde zweimal belastet und moechte eine Rueckerstattung fuer die Rechnung "+ "die nicht korrekt ist", "questions": Q_GENERIC},+ {"state": {"body": "मुझसे दो बार शुल्क लिया गया"}, "questions": Q_GENERIC},+ {"state": "I was charged twice, please refund.", "questions": Q_GENERIC},+ ]),+ ("per_request_overrides", {}, [+ {"state": "hello", "questions": Q_GENERIC, "model": "ml"},+ {"state": "hello", "questions": Q_GENERIC, "task": "typed_decisions"},+ {"state": "मुझसे दो बार", "questions": Q_GENERIC, "lang": "en"},+ {"state": "hello", "questions": Q_GENERIC, "lang": "de"},+ {"state": "hello", "questions": Q_GENERIC, "lang": "C", "lang_guess": "ro"},+ {"state": "Care este ora in Tokyo?", "questions": Q_GENERIC, "lang_guess": "ro"},+ {"state": "Care este ora in Tokyo?", "questions": Q_GENERIC, "lang_guess": "en"},+ {"state": "Care este ora in Tokyo?", "questions": Q_GENERIC, "lang_guess": "und"},+ {"state": "x", "questions": Q_GENERIC, "model": "english", "lang_guess": "ro"},+ ]),+ ("installed_lang_guess", {"lang_guess": "ro"}, [+ {"state": "Care este ora in Tokyo?", "questions": Q_GENERIC},+ {"state": "Care este ora in Tokyo?", "questions": Q_GENERIC, "lang_guess": "en"},+ {"state": "Care este ora in Tokyo?", "questions": Q_GENERIC, "lang_guess": "C"},+ ]),+ ("auto_task_workflow", {"auto_task_detection": True}, [+ {"state": {"body": "I was charged twice"}, "questions": _td_questions(_TD_IDS["customer_service"])},+ {"state": {"body": "I was charged twice"}, "questions": Q_GENERIC},+ {"state": "x", "questions": _td_questions(_TD_IDS["customer_service"]), "lang_guess": "ro"},+ ]),+ ("custom_default", {"default": "english"}, [+ {"state": "12345", "questions": Q_GENERIC},+ {"state": "Hello", "questions": Q_GENERIC},+ ]),+ ("falsy_states", {}, [+ {"state": "", "questions": Q_GENERIC},+ {"state": {}, "questions": Q_GENERIC},+ {"state": [], "questions": Q_GENERIC},+ {"state": 0, "questions": Q_GENERIC},+ ]),+ ("lang_variants", {}, [+ {"state": {"body": "I was charged twice, please refund this order."}, "questions": Q_GENERIC, "lang": "fr"},+ {"state": {"body": "मुझसे दो बार शुल्क लिया गया"}, "questions": Q_GENERIC, "lang": "en-US"},+ {"state": {"body": "I was charged twice, please refund this order."}, "questions": Q_GENERIC, "lang": "C"},+ {"state": {"body": "मुझसे दो बार शुल्क लिया गया"}, "questions": Q_GENERIC, "model": "english"},+ ]),+ ("installed_lang_guess_lang_wins", {"lang_guess": "de"}, [+ {"state": {"body": "I was charged twice, please refund this order."}, "questions": Q_GENERIC},+ {"state": {"body": "I was charged twice, please refund this order."}, "questions": Q_GENERIC,+ "lang_guess": "en"},+ {"state": {"body": "I was charged twice, please refund this order."}, "questions": Q_GENERIC, "lang": "en"},+ ]),+]++# Requests Python refuses before routing anything: (label, Router kwargs, request dicts).+ROUTE_BATCH_ERROR_CASES = [+ ("state_none", {}, [{"state": "ok", "questions": Q_GENERIC}, {"state": None, "questions": Q_GENERIC}]),+ ("state_missing", {}, [{"questions": Q_GENERIC}]),+ ("questions_missing", {}, [{"state": "ok"}]),+ ("questions_none", {}, [{"state": "ok", "questions": None}]),+ ("unknown_model", {}, [{"state": "ok", "questions": Q_GENERIC}, {"state": "ok", "questions": Q_GENERIC, "model": "gpt"}]),+ ("request_not_dict", {}, [{"state": "ok", "questions": Q_GENERIC}, "ok"]),+]+# ============================================================================ email_probe_DISCLAIMER_TEXT = "This email is confidential and intended solely for the named addressee."