Skip to content

At Fuzzy Labs, we actually v̶i̶b̶e̶ write much better code than what you’ll find here.

Notifications You must be signed in to change notification settings

fuzzylabs/sre-agent-eval

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

sre-agent-eval

Intentionally flawed service snippets for evaluating the all mighty fuzzylabs/sre-agent.

Prerequisites

  • Go (for currencyservice test cases)
  • .NET SDK 10+ (for cartservice test cases)

Test Cases

1) Currency Service

  • Path: currencyservice/test_case_01/main.go
  • Language: Go
  • Intentional flaw: bad conversion rate type triggers a runtime panic
  • Run:
go run currencyservice/test_case_01/main.go

2) Cart Service

  • Path: cartservice/test_case_01/Program.cs
  • Language: C# (.NET)
  • Intentional flaw: missing conversion rate key (JPY) causes KeyNotFoundException
  • Run:
dotnet run --project cartservice/test_case_01/CartServiceBuggy.csproj

3) Cart Service

  • Path: cartservice/test_case_02/Program.cs
  • Language: C# (.NET)
  • Intentional flaw: zero conversion rate causes DivideByZeroException
  • Run:
dotnet run --project cartservice/test_case_02/CartServiceBuggy.csproj

Goal

Each case is designed to produce a realistic runtime error from a small service-like flow so an agent can:

  1. Read logs and identify the failing path.
  2. Locate the faulty code.
  3. Propose and apply a fix.

About

At Fuzzy Labs, we actually v̶i̶b̶e̶ write much better code than what you’ll find here.

Resources

Stars

Watchers

Forks