Skip to content

FIX: Treating simulated conversations properly - #2629

Merged
Richard Lundeen (richlundeen) merged 7 commits into
microsoft:mainfrom
richlundeen:richlundeen-track-preparation-conversations
Sep 15, 2026
Merged

Richard Lundeen (richlundeen) merged 7 commits into
microsoft:mainfrom
richlundeen:richlundeen-track-preparation-conversations

Conversation

@richlundeen

@richlundeen Richard Lundeen (richlundeen) commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Simulated conversations are generated by a nested RedTeamingAttack before the primary attack runs. That nested attack was persisted as an independent attack result, so the GUI could show internal preparation work as a separate history row. For example, a scenario against GPT-5.1 could display an extra RedTeamingAttack that targeted the Grok model used to generate the simulated prefix.

The fix prevents the nested preparation attack from creating its own attack-result row while keeping its messages in memory. AttackResult now tracks simulated conversations as typed related conversations, similar to how it tracks pruned conversations. It links the simulated target conversation as PREPARATION and retains the generator conversation as ADVERSARIAL; these diagnostic conversations remain tracked but are not selectable as normal chat conversations.

Prevent nested simulated-conversation attacks from creating standalone attack history rows while retaining their conversation lineage on the primary attack.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Comment thread pyrit/backend/services/attack_service.py
Comment thread pyrit/executor/attack/multi_turn/simulated_conversation.py Outdated
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@richlundeen
Richard Lundeen (richlundeen) added this pull request to the merge queue Sep 15, 2026
Merged via the queue into microsoft:main with commit cd59b78 Sep 15, 2026
49 checks passed
@richlundeen
Richard Lundeen (richlundeen) deleted the richlundeen-track-preparation-conversations branch September 15, 2026 21:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants