Vss Search Archive

# Evaluation Report

Evaluation of the `vss-search-archive` skill before publication through NVSkills-Eval.

This benchmark summarizes 3-Tier Evaluation from NVSkills-Eval results for the skill. The goal is to document whether the skill is safe, discoverable, effective, and useful for agents before it is published for broader workflow use.

## Evaluation Summary

- Skill: `vss-search-archive`
- Evaluation date: 2026-05-29
- NVSkills-Eval profile: `external`
- Overall verdict: PASS
- Tier 3 live agent evaluation: not available in this report

## Agents Used

- Tier 3 agent details were not available in this report.

## Metrics Used

Reported benchmark dimensions:

- Security: checks whether skill-assisted execution avoids unsafe behavior such as secret leakage, destructive commands, or unauthorized access.
- Correctness: checks whether the agent follows the expected workflow and produces the correct final output.
- Discoverability: checks whether the agent loads the skill when relevant and avoids using it when irrelevant.
- Effectiveness: checks whether the agent performs measurably better with the skill than without it.
- Efficiency: checks whether the agent uses fewer tokens and avoids redundant work.

Underlying evaluation signals used in this run:

- No Tier 3 evaluation signal details were available in this report.

## Test Tasks

Tier 3 evaluation task details were not available in this report.

## Results

Tier 3 dimension rollup was not available in this report.

## Tier 1: Static Validation Summary

Tier 1 validation passed with observations. NVSkills-Eval ran 9 checks and found 3 total findings.

Top findings:

- LOW SCHEMA/unexpected_file: Unexpected 'skill-card.md' in skill root (`skills/vss-search-archive/skill-card.md`)
- LOW SCHEMA/unexpected_file: Unexpected 'skill.oms.sig' in skill root (`skills/vss-search-archive/skill.oms.sig`)
- LOW SCHEMA/author_format: Author must be of the form 'Name <email@host>' (`skills/vss-search-archive/SKILL.md`)

## Tier 2: Deduplication Summary

Tier 2 validation passed. NVSkills-Eval ran 2 checks and found 0 total findings.

Notable observations:

- Context Deduplication: Collected 3 file(s)
- Inter-Skill Deduplication: Parsed skill 'vss-search-archive': 148 char description

## Publication Recommendation

The skill is suitable to proceed toward NVSkills-Eval publication based on this benchmark. Skill owners should keep this file with the skill and refresh it when the evaluation dataset, skill behavior, or target agents materially change.


{
  "skills": ["vss-search-archive"],
  "profile": "search",
  "resources": {
    "platforms": {
      "RTXPRO6000BW": {
        "gpu_count": 2
      }
    }
  },
  "env": "A **full-remote deployed VSS search profile** (deploy mode = `remote-all` — LLM and VLM both via remote launchpad endpoints, no local NIMs; Cosmos Embed1 still runs locally on the GPU, so the profile requires a GPU host even in remote-all). Run on ONE platform only — the search answers come from Cosmos Embed1 and Elasticsearch, which are hardware-agnostic and the LLM/VLM run remotely, so fanning out discovers nothing new. Pinned to `RTXPRO6000BW` with `gpu_count: 2` (operator allocation). Required: VSS agent reachable at http://localhost:8000/docs (OpenAPI visible), VST reachable at http://localhost:30888/vst/api/v1, Elasticsearch reachable at http://localhost:9200, the Brev secure-link env vars set (BREV_ENV_ID from /etc/environment, BREV_LINK_PREFIX defaulting to 7777 per current Brev secure-link convention — see skills/vss-deploy-profile/references/brev.md), AND all sample videos downloaded from ngc registry resource download-version nvidia/vss-developer/dev-profile-sample-data:3.1.0 then extracted with tar -xzvf then pre-ingested using the agent video ingest handshake (`POST /api/v1/videos` -> chunked VST upload URL -> `POST /api/v1/videos/{sensorId}/complete`) according to the video ingestion section of troubleshooting.md, before running these checks.",
  "expects": [