Skip to content

Conversation

@Boegie19
Copy link
Contributor

@Boegie19 Boegie19 commented Jan 14, 2026

Description of Changes

Fix LLM benachmarks in rust since they used Result instead of ResultRow in the request to the LLM making it always fail.

  1. see the answer's file there it is ResultRow.
  2. Result is a keyword so it will always fail

API and ABI breaking changes

Expected complexity level and risk

1

Testing

Run /update-llm-benchmark to see if more passes.

@CLAassistant
Copy link

CLAassistant commented Jan 14, 2026

CLA assistant check
All committers have signed the CLA.

@Boegie19
Copy link
Contributor Author

/update-llm-benchmark

@Boegie19
Copy link
Contributor Author

seems like I can't run /update-llm-benchmark

@cloutiertyler
Copy link
Contributor

/update-llm-benchmark

@clockwork-labs-bot
Copy link
Collaborator

clockwork-labs-bot commented Jan 14, 2026

LLM Benchmark Results (ci-quickfix)

Language Mode Category Tests Passed Pass % Task Pass %
Rust rustdoc_json basics 26/27 96.3% 91.7%
Rust rustdoc_json schema 29/34 85.3% 80.0%
Rust rustdoc_json total 55/61 90.2% 86.4%
C# docs basics 27/27 100.0% 100.0%
C# docs schema 28/34 82.4% 80.0%
C# docs total 55/61 90.2% 90.9%

Generated at: 2026-01-16T01:11:54.962Z

@cloutiertyler
Copy link
Contributor

/update-llm-benchmark

@bfops bfops added this pull request to the merge queue Jan 16, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jan 16, 2026
@bfops bfops added this pull request to the merge queue Jan 16, 2026
Merged via the queue into clockworklabs:master with commit eb11d67 Jan 16, 2026
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants