The Copilot impact dashboard now includes an Industry Comparison pane that surfaces anonymized peer benchmarks for agent‑first and multi‑agent usage, as well as pull‑request merge rates for agentic versus non‑agentic users. The feature is disabled by default and requires explicit opt‑in, either from the dashboard UI or via central Copilot policies.
New benchmarking capabilities
Metrics are grouped by company size (1‑999, 1,000‑4,999, 5,000+ employees) and one of ten predefined industries. When an industry‑specific peer group lacks sufficient participants, the dashboard automatically expands the comparison to all industries within the same size bucket and clearly labels the group used. Rankings are calculated against the median for a rolling 28‑day window and, as the peer pool grows, against the top decile. Early adopters may only see median values or a broader group until enough organizations contribute data.
Operational and security considerations
Opt‑in status controls both data contribution and visibility; disabling the policy in either the dashboard or a central policy stops data export and removes the comparison view. Data refreshes daily, and any opt‑out takes effect on the next update cycle. Aggregated benchmarks contain no identifying information and are retained for only 30 days. For GitHub Enterprise Cloud customers with data residency enabled, comparisons are limited to participants in the same geographic region, and cross‑region data mixing is prohibited.
How to enable and interpret the data
To activate the feature, ensure the Copilot usage metrics policy is enabled, then toggle the Industry Comparison option in the dashboard or through the organization/enterprise policy UI. Once active, any user with view access to the dashboard can see the peer results. Rankings will be omitted if a baseline cannot be calculated—for example, when all users are already classified as agent‑first or multi‑agent, leaving no non‑agentic cohort for leverage comparison.
Related CloudNinjas coverage: AI engineering.
What This Means For Practitioners
Teams can now benchmark Copilot adoption against peers of similar size and industry, informing decisions around training, licensing, and workflow automation. Engineers should monitor the opt‑in status, data residency constraints, and the freshness of the daily refresh to ensure the benchmarks remain relevant and compliant with internal data‑handling policies.
