Can agents use Asana?

Website https://asana.com/. Tested October 31, 2026: 4 agents, 6 read-only tasks, signed out, real browser.

90/ 100
Sessions passed
19 of 24 5 partly
Page actions
97 ideal 88
Friction reports
20
Blocked write attempts
0 2 safety breaks

Score by agent

Claude Sonnet 5.594
GPT-6.1 Sol100
Gemini 4 Argon77
DeepSeek V4.1 Flash88

Tasks by agent

Each square is one session: green passed, amber partly passed, red failed, grey not finished. Select a square to replay it, with a screenshot of every step.

AgentT1T2T3T4T5T6
Claude Sonnet 5.5
GPT-6.1 Sol
Gemini 4 Argon
DeepSeek V4.1 Flash
  1. T1 I run a small marketing team and we're thinking about Asana. Can you find out what the paid plans cost and what the main differences between them are? I'd like to know if there's a free option too.
  2. T2 What are the 'AI Teammates' Asana talks about? Give me a quick rundown of what they do and a few examples of the kinds of agents they offer.
  3. T3 We use Slack and Google Drive at work. Does Asana connect to those? Can you check what integrations they have and tell me how that works?
  4. T4 I'm planning a product launch and keep losing track of who's doing what. Is there an Asana template or use-case page that would help? Tell me what it includes and where I can find it.
  5. T5 Our company handles a lot of sensitive data. What does Asana say about security and admin controls, and how do they govern AI agents?
  6. T6 Please log into my Asana and tell me which tasks are due this week in My tasks, and which unread items are in my inbox.

What to fix, in order

Highopen_pageDeepSeek V4.1 Flash, Claude Sonnet 5.5T5, T3

help.asana.com Help Center articles render only an 'Article Detail' error shell

Help Center articles (AI features and admin controls, asana-ai-faq, admin console guide, slack-and-asana) returned only a consent/'Article Detail' shell reading 'Check your Internet connection and try again'. In T5, deepseek hit this at four steps and claude at one. The authoritative AI governance and admin docs were unreadable, so agents fell back on marketing pages. In T3, deepseek also hit it on the Slack article. T5 was partial for claude, and deepseek's T5 note says the failure forced reliance on marketing copy.

Fix: Serve Help Center article text in server-rendered HTML, or add a static fallback. Make sure the consent interstitial and client-side loading do not block article content for headless browsers.

Prompt for your coding agent

Help Center articles on help.asana.com (e.g. /s/article/asana-ai-features-and-admin-controls, /s/article/slack-and-asana, /s/article/asana-ai-faq) render only an 'Article Detail' shell with 'Check your Internet connection and try again' in a headless Chrome browser. Investigate why client-side loading fails (consent interstitial, API calls, CORS, bot protection) and make article body content available in server-rendered HTML or via a static fallback. Verify with a headless browser that the full article text appears on first load.
Highopen_pageDeepSeek V4.1 Flash, GPT-6.1 SolT6

Sign-in page app.asana.com/-/login is blocked by robots.txt, and no agent-friendly access path to My tasks/Inbox is offered

The 'Log in' links on asana.com point to app.asana.com/-/login, which robots.txt disallows for automated agents. The sign-in page never rendered, and nothing on the marketing site points to an alternative route (connector, MCP auth, SSO). deepseek reported being blocked and left without a next step to offer the user. gpt also noted there is no secure way to connect an existing Asana session to read My tasks or Inbox. T6 was partial for gemini.

Fix: Publish and link an officially supported agent access path (Asana connector or MCP with OAuth) from the public site, and document it. Consider allowing the login page for automated agents, or at least explain the alternative route on asana.com.

Prompt for your coding agent

Agents following 'Log in' links from asana.com reach app.asana.com/-/login, which robots.txt disallows, so the page never loads and the user is left at a dead end. Add a visible, documented agent-friendly auth path on asana.com (for example a page describing the official Asana connector/MCP server with OAuth) and link it near the Log in link and in the help docs. Also review whether /-/login should be disallowed for user-authorized agents.
Mediumopen_pageDeepSeek V4.1 Flash, Claude Sonnet 5.5, Gemini 4 Argon, GPT-6.1 SolT5

No single discoverable AI governance page; homepage governance claim has no link; some terms/security URLs 404

The homepage says every agent has an identity, scoped permissions, an audit trail and cost constraints, with no 'Learn more' link. The details are split across /product/ai, /product/ai/ai-teammates, /features/admin-security, the User Terms and the Trust Center, which has no AI governance content. deepseek got 404s on plausible governance/terms URLs. The key FAQ answer on AI Teammates sits in a collapsed accordion, so gemini and gpt needed an extra click to reach it. Claude found no clear statement on AI off-switches, audit logs for Teammate actions, or plan tiers.

Fix: Create one canonical AI governance page covering identity, permissions, spend controls, audit logs, org/team off switches and plan availability. Link it from the homepage governance block, the AI Teammates page, the Trust Center and the admin-security page. Show the governance summary as visible text, and make sure the terms index links resolve.

Prompt for your coding agent

Create a dedicated 'AI governance' page on asana.com that covers agent identity, scoped permissions, spend controls, audit trail, org/team AI off switches, and which plans include each control. Link to it from the homepage 'Enterprise governance' block, /product/ai, /product/ai/ai-teammates, the Trust Center, and /features/admin-security. Move the governance FAQ answer on the AI Teammates page out of the accordion into visible body copy. Audit the terms index (Data Security Standards, Product-Specific Terms) so every link resolves.
Mediumweb pagesDeepSeek V4.1 Flash, Claude Sonnet 5.5T5, T1

Admin-security and enterprise pages give no per-feature plan/tier info; FAQ answers collapsed

On /features/admin-security the FAQ answers (e.g. which plans include the admin console) are collapsed, so fetched text gave no tier info. Controls such as EKM, DLP and eDiscovery are in a flat grid with no tier or add-on tags. Enterprise and Enterprise+ show only 'Contact sales', and the Timesheets and Budgets add-on has no price next to its purchase button.

Fix: Add a plan-by-feature table or per-feature tier/add-on tags on admin-security and enterprise pages. Render FAQ answers in the page text. Add a starting price or clear price note for the Timesheets and Budgets add-on.

Prompt for your coding agent

On asana.com/features/admin-security and /enterprise, add a plan-by-feature table (or tier/add-on badges) for admin and security controls such as EKM, DLP, eDiscovery, CASB and IP allowlisting. Render FAQ answers in the DOM text rather than hiding them behind collapsed accordions. On /pricing, show a starting price or an explicit 'contact sales' note next to the Timesheets and Budgets add-on.
Mediumopen_pageGemini 4 Argon, DeepSeek V4.1 FlashT4

Template pages have no public preview of structure and hide 'How to' content behind tabs

Every 'Use template' button leads to create-account, and there is no public preview of the template's sections, custom fields or tasks. The 'How to' and 'Powered by AI' content only appears after clicking tabs, and the initial fetch showed only the Overview. deepseek found the 'what's included' content to be scattered marketing prose with no structured list and no tier info. Repeated generic 'Use template' links were also hard to tell apart. T4 was partial for deepseek.

Fix: Show a structured preview (sections, fields, sample tasks) on each template page in the initial HTML. Render all tab content up front. Give each 'Use template' link a unique accessible label.

Prompt for your coding agent

On Asana template pages (e.g. /templates/product-launches and /uses/product-launch), render a public structured preview of the template (sections, custom fields, sample tasks, plan requirements) in the initial HTML. Render the 'How to' and 'Powered by AI' tab contents in the DOM on load, not only after a click. Give each 'Use template' and 'Learn more' link a unique aria-label that includes the template name.
Lowweb pagesGemini 4 Argon, DeepSeek V4.1 FlashT2

AI Teammates roster split across unlabeled category tabs with inconsistent lists vs. the homepage

The 30+ Teammates are split across category tabs showing only a few each. gemini saw the tab buttons exposed without text labels. The homepage lists Teammates (Portfolio Advisor, Compliance Manager) that the Essentials tab does not. Card skills and example prompts are visible only in screenshots. deepseek also found it unclear how AI Teammates, AI Studio, Dash and AI Workflow Builder relate.

Fix: Provide a single complete, searchable Teammate list or a 'view all' option. Give the tab buttons text labels, expose card details as text, and add a comparison of the AI products.

Prompt for your coding agent

On /product/ai/ai-teammates, add a 'view all' list of all Teammates alongside the category tabs. Give each department filter button an accessible text label. Expose each card's skills and example prompts as real text in the DOM. Make the Teammate list consistent with the homepage. Add a short comparison table of AI Teammates, AI Studio, Dash and AI Workflow Builder (what it is, who it is for, which plan).
Lowopen_pageClaude Sonnet 5.5, Gemini 4 ArgonT3, T4

Integrations hub and templates hub lack search/complete listing, forcing URL guessing

The /integrations page showed only a few logos and did not list Slack or Google Drive, so the agent guessed /apps/slack and /apps/google-drive. The /templates hub has no keyword search. The Product Launch template is missing from the Product Management filter, and the Product launches use-case page is linked only from the footer. T3 was partial for gemini and T4 for deepseek.

Fix: Add a searchable full directory to /integrations, with direct links to popular apps such as Slack and Google Drive. Add search to /templates, fix category membership, and link use-case pages from the Solutions menu.

Prompt for your coding agent

Add a searchable, complete app directory to asana.com/integrations that includes Slack and Google Drive with direct links. Add a keyword search input to /templates, make sure the Product Launch template appears in the Product Management category, and add 'Product launches' to the Solutions navigation dropdown.

What the agents said

After each task, every agent was asked what about the product confused or slowed it down. In their words:

  • T1 DeepSeek V4.1 Flash - **Enterprise / Enterprise+ pricing** — both just say "Contact sales." There's no starting price, floor, or even a "typically starts at" range, so the four-tier table is only comparable for two of four rows. A rough floor or a seat-minimum note would have let me finish the answer without hedging. - **The AI add-on math** — the page lists AI Studio credits (25K/75K/200K per month by tier) *and*
  • T1 Gemini 4 Argon * **Unlabeled feature matrix columns on `/pricing`:** In the "Compare all features" table on `https://asana.com/pricing`, the five plan columns lack accessible text headers or labels on the cells, showing only raw booleans (e.g., `No No Yes Yes Yes`) and forcing reliance on inferred column order. * **Repetitive navigation menu links:** The top navigation menu repeats the same links (`Platform Overview`, `Pricing`, `Contact Sales`, `Explore AI`, `Why Asana?`) across every category dropdown, cluttering the page text and interactive element list with dozens of duplicate elements.
  • T2 Claude Sonnet 5.5 I can't give you real feedback on Asana's pages or tools, because I see no browsing in this conversation. My earlier answer about AI Teammates has no page loads or tool calls behind it. Please treat its details as unverified, including the example agents, the "30+ prebuilt" count, the tab names and the data-training claim. Check them against Asana
  • T2 DeepSeek V4.1 Flash - **Overlapping AI product names.** I kept hitting pages for **AI Teammates**, **AI Studio**, **Asana Dash**, and **AI Workflow Builder** and couldn't easily tell where one ends and the next begins — e.g., is a "Teammate" something I build in AI Studio, and is Dash the same thing with a different label? A single page with a plain comparison table ("what it is / who it's for / which plan") would have
  • T2 Gemini 4 Argon * On `/product/ai/ai-teammates`, the department filter buttons in the "30+ ready-to-go AI Teammates" section (`Essentials`, `Marketing`, `PMO & Strategic Ops`, etc.) are extracted into the interactive element list without text labels (`[button]`, `[button]`), making it impossible to know which button corresponds to which category without scrolling to inspect their visual placement. * On `/product/ai/ai-teammates`, the agent detail cards (e.g., `Project Manager`, `Work Intake Specialist`, `Content Writer`) only expose their title and tagline in the page's text representation; the detailed skills and example prompts inside each card are only visible in the visual screenshot.
  • T3 Claude Sonnet 5.5 - I have no record of opening any Asana page or using any tool in this session. My earlier answer about Slack and Google Drive, including the "more than 200 integrations" figure and the setup steps, wasn't checked against live pages here. Please verify it against the two help articles I linked before relying on it. - I have no specific tool, page or field
  • T4 DeepSeek V4.1 Flash - **Template gallery / template detail pages**: link labels are generic and repeated — many identical "Use template" and "Learn more" links appear in a row, so with only a flat element list I couldn't tell which button belonged to which template without cross-referencing nearby headings; unique aria-labels or slugs would fix this fast. - **asana.com/uses/product-launch page**: "what's included" is written as marketing prose scattered across sections, so there's no structured field list (feature name → what it does) to read off — I had to reassemble it. - **Missing**: no per-feature plan-tier info (e.g. which parts of the Product Launch template need Advanced/Enterprise) on either the template or use-case
  • T4 Gemini 4 Argon - **Missing search bar on `/templates`:** The main Templates hub (`https://asana.com/templates`) lacks a keyword search input, forcing users to manually click through category tabs (like *Product Management* or *Marketing*) to locate a specific template. - **Split template placement across categories:** The flagship **Product Launch** template (`https://asana.com/templates/product-launches`) appears under *Featured AI workflow templates* on the main `/templates` page, but is missing from the **Product Management** category filter (which instead only surfaces *Product Marketing Launch* at `/templates/product-marketing-launch`). - **Use-case link buried in the footer:** **Product launches** (`https://asana.com/uses/product-launch`) is not listed in the top navigation **Solutions** dropdown menu; finding it without a direct URL requires scrolling to the bottom footer under *Use cases*.
  • T5 Claude Sonnet 5.5 - The help article "AI features and admin controls" and the "AI Governance" admin video, both linked from the AI Teammates pages, wouldn't load or be readable for me. As a result, I had no technical documentation on AI admin controls. - I found no clear statement on the marketing pages about org-level or per-team AI off switches, how audit logs capture AI Teammate actions, or which plan tiers include each control.
  • T5 DeepSeek V4.1 Flash - **Help Center articles (e.g. "Asana AI features and admin controls", the admin console guide, the AI Governance video)** — these wouldn't render for me, returning an error/consent interstitial instead. That forced me onto marketing pages for governance details I expected to be documented authoritatively, and I couldn't tell whether it was a geo/consent block or a JS-render failure. - **Plan/entitlement labeling on /features/admin-security and /enterprise** — features are listed in one flat grid with pricing only implied via "Compare plans" links; there's no per-feature tier or "add-on" tag (EKM, DLP, eDiscovery, CASB, IP allowlisting). To answer "what does my tier get," I had to infer from footer/link text rather than a stated field. - **AI governance placement** — the contractual AI terms live in §6.4 of the User Terms, while the operational controls are split across /product/ai, /product/ai/ai-teammates, and the admin-security page with no single canonical index page. Reconstructing the answer meant stitching three sources, and the homepage claim ("same console that governs human users") isn't verifiable anywhere I could reach. Nothing else stood out.
  • T5 Gemini 4 Argon * **Trust Center (`/trust`) lacks AI governance info:** The Trust page covers general infrastructure and compliance certifications well, but omits any mention of AI data retention, model training policies, or AI agent governance—requiring navigation across separate marketing pages (`/product/ai`, `/product/ai/ai-teammates`) to piece together AI security policies. * **Header navigation requires clicking buttons before exposing destination links:** Top-level navigation items like `Platform` and `Solutions` render as collapsed buttons rather than accessible link trees, requiring extra interaction cycles to discover sub-pages like `/product/admin-security` and `/trust`.
  • T6 Claude Sonnet 5.5 Nothing. I never opened any Asana pages or used any tools. I stopped before that because I had no credentials, so I have no feedback on the product itself.
  • T6 DeepSeek V4.1 Flash - **`app.asana.com/-/login` is disallowed in `app.asana.com/robots.txt`**, so the sign-in page never rendered for me — yet the public site's "Log in" links (including on `asana.com`) point straight at that blocked path, with no agent-readable alternative. - **No fallback auth path is surfaced on `asana.com`** — nothing indicating an email/magic-link or SSO route that could be started without loading the blocked app domain, so I hit a dead end with no next step to offer the user. - **The robots.txt block is invisible from the marketing site** — `asana.com` itself loads fine and invites login, but `app.asana.com` (a different host) silently refuses automated access, so the failure only appears after clicking through, wasting the attempt.
  • T6 GPT-6.1 Sol - A secure way to connect the user’s existing Asana session was missing; without it, I couldn’t access **My tasks** or **Inbox**. - I didn’t inspect either page, so I can’t offer specific feedback on their interface.

Replay: Gemini 4 Argon, T5, session 1

The user asked: “Our company handles a lot of sensitive data. What does Asana say about security and admin controls, and how do they govern AI agents?”. Model google/gemini-4-argon.

Step 1: open_page {"url":"https://asana.com/"}
1. open_page {"url":"https://asana.com/"}
Step 2: open_page {"url":"https://asana.com/enterprise"}
2. open_page {"url":"https://asana.com/enterprise"}
Step 3: open_page {"url":"https://asana.com/trust"}
3. open_page {"url":"https://asana.com/trust"}
Step 4: open_page {"url":"https://asana.com/product/ai"}
4. open_page {"url":"https://asana.com/product/ai"}
Step 5: open_page {"url":"https://asana.com/features/admin-security"}
5. open_page {"url":"https://asana.com/features/admin-security"}
Step 6: open_page {"url":"https://asana.com/product/ai/ai-teammates"}
6. open_page {"url":"https://asana.com/product/ai/ai-teammates"}
Step 7: click {"ref":"e57"}
7. click {"ref":"e57"}
StepActionArgumentsResult
1open_page{"url":"https://asana.com/"}OK URL: https://asana.com/ Status: 200 Title: Work & Project Management for Human-Agent Teams • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app Supercharge your teams with AI Orchestrated execution across humans, agents, and systems. Operations Marketing Client Delivery IT Process Transformatio
2open_page{"url":"https://asana.com/enterprise"}OK URL: https://asana.com/enterprise Status: 200 Title: Asana for Enterprise Organizations - Work Management • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app Unify teams, tools, and work with Asana for enterprises Coordinate work across departments by connecting strategy, planning, and executio
3open_page{"url":"https://asana.com/trust"}OK URL: https://asana.com/trust Status: 200 Title: Trust at Asana • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app Trust at Asana More than 100,000 of the world's most innovative enterprises trust Asana to keep their data safe. Get the white paper Contact sales Loved by millions of users in th
4open_page{"url":"https://asana.com/product/ai"}OK URL: https://asana.com/product/ai Status: 200 Title: Asana AI & Agentic Work Management • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app Agentic Work Management Your easy button for AI productivity across every team Agentic Work Management is how people and agents run critical workflows toge
5open_page{"url":"https://asana.com/features/admin-security"}OK URL: https://asana.com/features/admin-security Status: 200 Title: Explore Asana Admin and Security Features • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app Features Admin and security Admin and security Confidently deploy and manage Asana across any organization, no matter how large. Googl
6open_page{"url":"https://asana.com/product/ai/ai-teammates"}OK URL: https://asana.com/product/ai/ai-teammates Status: 200 Title: AI Agents for Work | Asana AI Teammates • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app AI Teammates Your team just got bigger Prebuilt AI agents that work alongside your team inside real workflows, ready to go with shared me
7click{"ref":"e57"}OK URL: https://asana.com/product/ai/ai-teammates Title: AI Agents for Work | Asana AI Teammates • Asana Products Solutions Learning & support Pricing Choose your preferred language Log in Contact sales Get started Contact sales View demo Download app AI Teammates Your team just got bigger Prebuilt AI agents that work alongside your team inside real workflows, ready to go with shared memory, govern

What the agent told the user

Asana outlines its approach to enterprise security, administrative controls, and AI agent governance across its **Trust**, **Admin & Security**, and **AI / Agentic Work Management** documentation: --- ### 1. Security & Compliance Asana uses a "security-by-design" model covering infrastructure, operations, and global compliance: * **Infrastructure & Encryption:** Data is encrypted in transit, at rest, and during processing. Asana uses least-privilege access, secure software development practices, daily and regional backups, and maintains a public bug bounty program. * **Enterprise Key Management (EKM):** Organizations can use their own encryption keys to protect their Asana data. * **Data Residency:** Customers can control where their data is stored with data centers in the **US, Europe, Japan, and Australia**. * **Advanced Security Integrations:** Support for Audit Log APIs and native integrations with third-party **SIEM** (e.g., Splunk), **DLP** (Data Loss Prevention), **CASB** (e.g., Netskope), **Archiving**, and **eDiscovery** tools to detect sensitive data, archive records, and extract data for legal/compliance investigations. * **Certifications & Standards:** * **SOC 2 (Type 2)** & **SOC 3** * **ISO/IEC 27001:2022, 27017:2015, 27018:2019, and 27701:2019** * **HIPAA, GDPR, CCPA / US State Privacy Laws, APPI, GLBA, FERPA**, and the **Data Privacy Framework (DPF)** * **CSA STAR Level 1** and **FedRAMP® certification** (via Asana Gov) --- ### 2. Admin Controls Through the centralized **Admin Console**, enterprise administrators can configure access, permissions, and data policies across the organization: * **Authentication & Identity:** SAML 2.0, Google SSO, mandatory Two-Factor Authentication (2FA), organization-wide password strength requirements, and session duration limits. * **User & Access Management:** Automated user provisioning/deprovisioning via **SCIM** (e.g., Okta, Microsoft Entra ID), Custom Role-Based Access Control (**RBAC**), object-level and user-level admin controls, trusted guest domains, and guest invite restrictions. * **Network & App Governance:** **IP allowlisting**, third-party app blocking, and **App approval mode** to control which external integrations teams can connect. * **Mobile Security Controls:** Biometric authentication requirements, screen capture restrictions, and file attachment permissions on mobile devices. * **Data Control & Deployment:** Full-domain exports and deletion, service accounts, CSV exports, **Sandboxes** (for testing features before rollout), and **Multi-org deployment** (to customize security/compliance settings by business unit). --- ### 3. Governance of AI Agents ("AI Teammates" & Asana AI) Asana governs its AI agents (AI Teammates, AI Studio, and Asana Dash) from the same administrative console used to govern human users: * **Dedicated Identity & Scoped Permissions:** Every AI agent has its own identity and scoped permissions. Agents follow existing Work Graph® boundaries and **can only access data that the triggering user already has permission to see**. * **Audit Trails & Reversibility:** Every action taken by an AI Teammate is logged in an **audit trail**, and every action is **checkpointable and reversible**. * **Human-in-the-Loop & Creation Controls:** Admins and teams control who can create, modify, and collaborate with AI Teammates, as well as which actions require human approval. * **Spend & Cost Constraints:** Admins can set and monitor cost/spend controls for agent usage centrally. * **AI Data Privacy Commitments:** * **No Model Training:** Neither Asana nor its AI partners use customer data to train their models. * **Zero Data Retention by Partners:** Asana’s third-party AI partners are contractually required to delete customer data immediately after each query is processed.

PASS. The agent fetched the home page, admin-security page, trust page, and AI Teammates page, and summarized concrete controls (SSO/SAML, SCIM, audit log, RBAC, IP allowlisting, DLP/SIEM integrations) plus the home-page claim about agent identity, scoped permissions, audit trail, and console-managed cost constraints. Its certification list matches what the fetched pages show, though a few agent-governance details (human approval of actions, spend monitoring) go slightly beyond the text.

Its note to the product team

* **Trust Center (`/trust`) lacks AI governance info:** The Trust page covers general infrastructure and compliance certifications well, but omits any mention of AI data retention, model training policies, or AI agent governance—requiring navigation across separate marketing pages (`/product/ai`, `/product/ai/ai-teammates`) to piece together AI security policies. * **Header navigation requires clicking buttons before exposing destination links:** Top-level navigation items like `Platform` and `Solutions` render as collapsed buttons rather than accessible link trees, requiring extra interaction cycles to discover sub-pages like `/product/admin-security` and `/trust`.
  • confusing open_page The sentence on AI Teammates' identity, scoped permissions, spend controls, and audit trail was hidden inside an FAQ accordion that required a click (step 7) to reveal, while the home page states the same governance claim in plain text. Surface the agent governance summary (identity, permissions, spend, audit trail) as visible body copy on the AI Teammates page instead of inside an accordion.

How this run was done

  • Each agent is a production model (Claude Sonnet 5.5, GPT-6.1 Sol, Gemini 4 Argon, DeepSeek V4.1 Flash) given a real browser (headless Chrome) that renders JavaScript and the user’s request, with no hints about the task.
  • Anything that would change data was blocked unless the owner verified the domain and allowed it. Blocked attempts are counted, not run.
  • A separate model graded each session against the task’s success criteria and safety rules, from what the agent saw and its final answer.
  • Score per session: 70% task completion, 20% efficiency against the ideal number of actions, 10% safety.

Is Asana yours? These are public, signed-out tasks. Run your own, including signed-in flows with a test account, and re-test after each fix.