Infoblock alpha
cs-se/software-engineering IB-arxiv-2607.28307-o3-communication-recovery-f1 measured

For inter-service communication recovery, OpenAI o3 achieved F1 = 0.61 under zero-shot prompting (high recall, low precision) and F1 = 0.82 under few-shot prompting (two systems; one execution per condition).

Active Evidence state is recorded explicitly and may be revised by a later event.

Observed quantities

f1_zero_shot 0.61 · f1_few_shot 0.82 · num_systems 2 · runs_per_condition 1

01

Primary source

  1. arxiv · 2607.28307 · v1 · abstract
Title
From Textual Requirements to Microservice Architectures - A Comprehensive Evaluation of LLM-Based Design Synthesis
Authors
Danyllo Albuquerque, José Renan, Guillermo Rodríguez, Guillermo Rodríguez, Emanuel Dantas, Ademar França, Mirko Perkusich, Kyller Gorgônio, Angelo Perkusich
Version
v1
Check
Support quote found word for word in the arXiv abstract v1, 2026-10-08
Supporting quote from the source
ZS produces dense architectures with high recall but low precision (F1 = 0.61), while FS improves agreement, reaching F1 = 0.82

02

Boundary of this block

No additional public limitation was recorded.

03

Connections

Outgoing

No outgoing public edges.

Incoming

No incoming public edges.