Skip to content
OpenAIGPT-6 AstraAgent evaluation

GPT-6 Astra Update: From Answers to Completed Work

OpenAI’s September 9 update puts GPT-6 Astra in work-oriented workflows. The useful question is how it handles tools, evidence and deliverables, beyond answering isolated benchmark questions.

Token4AI Cloud4 min readUpdated
原创流程图:定义任务与证据、执行工具、验证交付 / Original diagram: define, execute and verify work
原创流程图:定义任务与证据、执行工具、验证交付 / Original diagram: define, execute and verify work

THE BRIEF

Blog highlights

OpenAI’s September 9 announcement lists Astra in ChatGPT Work, Codex and the API, with enterprise enablement still subject to administrator action and applicable agreements.[1] The September 3 release notes described an earlier limited rollout.[3] These are different stages, not interchangeable availability statements. Sources were checked on September 10, 2026.

Source announcement ·

The distance between an answer and completed work

What is changing? Astra’s positioning brings research, coding, computer use and document delivery into a work-oriented flow.[1] Our interpretation is that users should test a request for a verifiable deliverable and observe the intermediate work. A polished standalone answer is only part of that assessment.

Distinguish the model from its tools. The documented native modalities are text input/output and image input, while image generation appears in the Responses tool list.[2] Reading an image and invoking an image-generation tool are different layers of a workflow. Changing a model identifier does not prove that an application has configured every tool needed for the task.

Testing evidence inside a long context

Context capacity is a boundary, not an acceptance test. The model page lists a 1,050,000-token context and a maximum output of 128,000 tokens.[2] We propose testing scattered requirements, conflicting document versions and missing evidence. Check whether the result cites the right file and preserves uncertainty instead of filling every gap with a plausible explanation.

Turn an upgrade into a comparable experiment

Consider a proposed experiment, not a test we have already run: give an agent an old product specification, recent customer feedback and a repository. Ask it to fix an export feature and update its documentation. There are at least three outcomes to verify: correct software, documentation that matches the implementation, and coverage of the customer requirements. A fluent final explanation can conceal a missing code change. Acceptance should inspect the files and execute relevant checks.

Freeze a task snapshot so that the model is the main variable. Start each candidate from a clean workspace with the same dependencies, tools and permissions. Define the checks before collecting results, then record completion, elapsed time and human corrections. Retain unsuccessful attempts in the sample. This experiment will not produce a universal ranking, but it can answer whether the upgrade improves work that matters to this team.

Next, add conflicting evidence rather than simply more text. An old specification might permit unrestricted exports while a newer requirement limits their scope. Observe whether the agent notices the disagreement, explains its evidence and leaves unresolved decisions for a responsible person. A large context window can hold both documents. It cannot replace the application's responsibility to identify versions, permissions and relevant material.

Recovery is part of the workload

Make execution state observable. Our engineering recommendation is to track progress from reading evidence through actions to delivery checks, with explicit confirmation boundaries. After interruption, the application should identify completed work so retries do not repeat external changes. This reliability comes from the application and model together; a model leaderboard cannot establish it.

Interrupt a test task with no external side effects and inspect whether resuming repeats completed operations. Saying “I will continue” is a language response; reliable recovery needs task state, completed actions and remaining acceptance checks. For operations such as sending mail or changing business data, the application should retain verifiable execution records and request confirmation when appropriate. Record resumed text generation separately from successful recovery of the work.

Make the decision using completed-work cost

Measure cost per completed result. Our proposed comparison includes model calls, tools, waiting, retries and human revisions on identical tasks. A model with a higher token rate might reduce total rework; excessive planning or repeated actions might cancel that benefit. This is an evaluation method, not a claim that Token4AI has measured an Astra cost advantage.

Make a trial informative. Choose a cross-file code repair, an evidence-based research brief and a document constrained by a template. Fix inputs, tools and stopping conditions. Inspect correctness, citations, layout and residual human work separately. Retain failed attempts rather than presenting only the most impressive successful screenshot.

The Agent Cloud workflow in Token AI Cloud provides a way to start tasks from a Room and inspect execution events. It is a useful structure for this evaluation; model availability and supported tools must still be checked in the account. Begin with one task family with clear acceptance criteria and retain the previous workflow as a control. Expand only after recovery and completed-work cost are understood. The meaningful outcome is dependable delivery.

Image note: the cover is Token4AI’s original define–execute–verify diagram, illustrating our evaluation method rather than OpenAI internals or measured results. This article does not assert availability of the model through Token4AI.

Practical checklist

  1. Confirm the actual account’s model access and entry point.
  2. Define success with a deliverable and preserve the source evidence.
  3. Separate native modalities from configured tool capabilities.
  4. Measure total completion cost and human rework across repeated tasks.

References

  1. [1] OpenAI · GPT-6 Astra work announcement ↗2026-09-09
  2. [2] OpenAI · GPT-6 Astra model documentation ↗2026-09-10
  3. [3] OpenAI · ChatGPT release notes ↗2026-09-03

Independent analysis by Token4AI. Vendor capabilities and availability on our platform are separate; consult the console for supported models and current pricing.