venikman avatar

fpf-skillmetric-score-usability

Calculates the SkillUsabilityScore (U.Metric) for Zero-Shot Enactment.

提供方 venikman|开源

metric/score-usability Kernel

Context

This skill calculates a specific composite metric: SkillUsabilityScore. As defined in the experiment, this is an Ordinal 1-5 scale measuring "Zero-Shot Enactment".

Instructions

Calculate the score based on the following rubric:

1. Factors

Evaluate two inputs:

  • Discovery (D): Did the user find the skill without clarification? (Boolean)
  • Compliance (C): Did the interface invocation succeed without error? (Boolean)

2. Scoring Logic

  • 5 (Perfect): D=True AND C=True.
  • 3 (Friction): D=False (required help) OR C=False (retry needed), but eventually succeeded.
  • 1 (Failure): Could not complete even with help.

3. Output

Return the integer score (1, 3, or 5).