We have added Cache hit rate and Max concurrent to AI activity in Skill Assessment. You can also now see the skills and MCP servers that members actually used. In addition, we added "Other" to the usage breakdown and fixed how active hours are displayed.

Skill Assessment is currently offered as a beta. For details, see Viewing the AI Monitoring Dashboard.

Background

Until now, AI activity showed the number of requests and the amount of tokens, but not how efficiently and how much in parallel AI tools were being used. In addition, how members use skills and MCP servers relates to Environment Engineering in AI Collaboration Skills, but it could not be seen on the screen.

This update lets you review the quality of AI tool usage and how the environment is set up on the same screen as usage volume.

What's new

Cache hit rate and max concurrency

We added the following two items to AI activity on My Page and Member Detail.

Item Description
Cache hit rate The share of the input to AI tools that was read from the cache
Max concurrent The maximum number of AI tool sessions running at the same time. The average concurrency is also shown

Depending on when measurement started, these two items may have no value and show "-". This is distinct from 0% or 0 concurrent.

We also removed "Average prompt length" from AI activity on My Page and Member Detail.

Skills and MCP servers actually used

We added Skill / MCP usage to My Page and Member Detail. It shows the top five skills and MCP servers used in the last 30 days, split into Top skills and Top MCP servers / plugins, along with the number of uses. You can switch between AI tools (Claude Code / Codex) for each.

Only skills and MCP servers that were actually used are shown. Ones that are installed but not used do not appear.

"Other" in the usage breakdown

We added "Other" to Usage breakdown (by request ratio). AI usage that is not development work, such as preparing sales materials or administrative tasks, is classified as "Other". Usage whose purpose could not be determined is still shown as "Unknown".

Active hours in the viewer's time zone

Active hours on the AI Monitoring Overview (organization-wide) is now shown in the viewer's time zone. Previously it was shown in Coordinated Universal Time (UTC), which was nine hours off in Japan Standard Time. The peak hours caption has been fixed in the same way.

Availability

A Skill Assessment contract is required to use Skill Assessment. For details, please contact your Customer Success representative.