Skip to content

RubyLLM integration #3096

Description

@dingsdax

Problem

sentry-ruby has no AI instrumentation. To see agent runs in the Agents Dashboard, Ruby users have to create child spans and set every gen_ai.* attribute by hand.

Solution

A RubyLLM integration that emits gen_ai spans automatically for chat, tool calls, agent/workflow runs and token usage. Agent and workflow spans should reach the Agents Dashboard.

  • Hook into RubyLLM 2.0's config.instrumenter
  • Follow sentry-conventions for attributes.
  • Gate message content behind a new GenAI data_collection category.
  • Ship as a separate sentry-ruby_llm gem.

Embeddings, streaming, images, transcription, moderation and rerank come later.

supersedes #2405 and #2406. re-scopes #2884.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions