AIORG-W033 Practitioner & vendor artifacts

Generative AI in Real-World Workplaces

MSR-TR-2024-29 · Microsoft Research workplace GenAI technical report

vendor research technical report

Recorded claims
2
coded from the inspected source
Evidence classes
1
survey-or-synthesis
Recorded limitations
4
stated, never hidden

From the wave-0 evidence ledger

Recorded claims

Each claim states what the inspected source says, at the recorded location—bounded by its scope and graded by its confidence. Nothing here is a synthesis across works.

The technical report synthesizes real-world workplace research spanning more than 60 organizations and more than 6,000 workers, providing a bridge between short online tasks and organization-embedded trials.

confidence: medium-high for described corpus; medium for synthesis conclusions survey-or-synthesis

Scope: Included studies and organizations through 2024; not an independently conducted meta-analysis.

Across the synthesized studies, effect sizes and adoption vary by task, role, expertise, and implementation, supporting experimentation, training, and workflow fit rather than a single average productivity assumption.

confidence: medium survey-or-synthesis

Scope: Pattern across the report's workplace studies; does not quantify a universal effect.

Boundaries

Limitations & independence

Recorded at coding time, carried with the work forever. A claim without its limits is not evidence.

Recorded limitations

  • Vendor-affiliated authors and product settings
  • Aggregated findings span heterogeneous organizations/tasks
  • Technical report rather than one pre-specified meta-analysis
  • Adoption and productivity measures vary

Source independence

Vendor-research synthesis of experiments and deployments, many involving vendor tools; underlying designs vary.