# wandb-eval-tables

Turns existing W&B Table data into EvalTable previews in new runs (source runs stay untouched), with scan, verify, and removal steps.

Skill by Weights & Biases. Category: Testing.

## Install

Project (for this project only):

```sh
npx skills add wandb/skills --skill wandb-eval-tables
```

Works with: Claude Code, Codex CLI, Cursor, Antigravity, Copilot CLI, opencode.

Global (for every project on this machine):

```sh
npx skills add wandb/skills --skill wandb-eval-tables -g
```

Works with: Claude Code, Codex CLI, Cursor, Antigravity, Copilot CLI, opencode.

## Tags

- Runs on your computer: It runs as a program on your machine, with your access.

## Security audits

- Gen Agent Trust Hub: Pass
- Socket: Pass
- Snyk: Warn

Installs: 226. Installs counted by skills.sh. [Open on skills.sh](https://www.skills.sh/wandb/skills/wandb-eval-tables)

## Source

[Open the source](https://github.com/wandb/skills/tree/HEAD/skills/wandb-eval-tables). Checked 2026-10-10. This summary may contain AI-generated text, so it can be wrong. Check the source before you rely on it.

## SKILL.md

````markdown
---
name: wandb-eval-tables
description: "Convert W&B Table artifacts into non-destructive EvalTable previews with scan-first planning, typed input/output/score columns, bounded batches, verification, and safe removal. Use when a coding agent needs to create, inspect, compare, verify, or remove W&B EvalTable previews."
---
<!--
SPDX-FileCopyrightText: 2026 CoreWeave, Inc.
SPDX-License-Identifier: Apache-2.0
SPDX-PackageName: skills
-->

# W&B EvalTable previews

Use the bundled helper to preview existing `wandb.Table` data as
`wandb.EvalTable` data. A preview creates new runs and keys; it never overwrites
the source runs or tables.

Read `references/EVAL_TABLES.md` before converting. It is the canonical source
for EvalTable semantics, source selection, limits, column roles, verification,
and removal.

## Environment

Run the helper from an environment that provides a W&B SDK with
`wandb.EvalTable` and Weave. Use `uv` to supply missing dependencies:

```bash
uv run --with 'wandb[workspaces]>=0.28.1' --with weave \
  python skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py --help
```

Credentials and default scope may come from `WANDB_API_KEY`, `WANDB_ENTITY`,
and `WANDB_PROJECT`; otherwise pass explicit entity/project arguments.
Downloads use the operating system's temporary directory, not a fixed current
working directory.

## Required workflow

1. Choose the narrowest source that matches the request: exact artifact, one
   run, one sweep, or a project/workspace. Do not broaden an explicitly named
   source.
2. Run `scan`. This is read-only preflight and is not proof of conversion.
3. Review `eligible_summary_by_table_key`, table shapes, truncations, warnings,
   and existing-preview metadata. Select one table key unless the user asks for
   a broader batch.
4. Classify columns only when confident. Input tuples must uniquely identify
   rows; score columns must be numeric or boolean; free-text labels and
   rationales are outputs. Leave ambiguous tables untyped.
5. Run `preview` for exactly one `--table-key` per invocation. Keep the target
   in the source project unless the user requests another writable project.
6. If runs were created, run `verify-preview` on the final created run and the
   exact logged key. Report success only when it returns `verified: true`.
7. Report created and skipped sources plus every truncation or failed check.

```bash
T=skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py

uv run python "$T" scan \
  --source-workspace ENTITY/PROJECT --max-runs 4

uv run python "$T" preview \
  --source-workspace ENTITY/PROJECT \
  --target-project ENTITY/PROJECT \
  --max-runs 4 \
  --table-key predictions

uv run python "$T" verify-preview \
  --run ENTITY/PROJECT/PREVIEW_RUN_ID \
  --table-key predictions_preview
```

## Safety

- `scan` and `preview --dry-run` are read-only. `preview` creates W&B runs,
  EvalTables, and Weave evaluations; run it only when the user requested a
  conversion.
- The helper caps tables at 10,000 rows and 100 columns, warns above 1,000
  rows, and refuses more than 50 eligible table artifacts for one key. Surface
  every cap; never imply a truncated preview is complete.
- Do not bypass helper failures with ad-hoc logging. Narrow or correct helper
  arguments, then retry only when the change is safe.
- Removal deletes both Weave evaluations and preview runs. Run
  `delete-preview --dry-run` first, verify every target is helper-created, and
  obtain confirmation before the irreversible invocation. Never delete source
  runs.
````

- Previous: [wandb-primary](https://syn4pse.dev/terminal/wandb-primary.md)
- Next: [wandb-autoresearch](https://syn4pse.dev/terminal/wandb-autoresearch.md)
- [Terminal](https://syn4pse.dev/terminal.md)
- [Suggest a change](mailto:terminal@syn4pse.dev?subject=Terminal%20suggestion)
