Terminal
Terminal/Skill
Moves LangSmith runs, datasets, and prompts into Arize AX, for teams switching observability platforms.
By Arize AI
Works with
npx skills add arize-ai/arize-skills --skill arize-migrate-langsmithMove LangSmith data into Arize AX. Historical traces are in scope — export LangSmith runs and ingest them into AX via OTLP with explicit attribute mapping. Also migrate datasets and optionally cut over live traffic.
SPACE—--space/ARIZE_SPACEaccept a space name or base64 ID. Prefer the user-provided name; do not paginateax spaces listjust to look it up.
scripts/migrate_vendor_traces.py — do not fake migration by only sending new live traffic to AX.output.value as text — never put the raw tool/message timeline into output.value.session_id / thread_id → attributes.session.id (and user_id → user.id when present).ax profiles / env for Arize. Do not read .env from disk.Proceed with the task. If something fails, troubleshoot from the error:
ax missing / version error → ax setup401 Unauthorized / missing Arize key → ax profiles (or ask the user for ARIZE_API_KEY + ARIZE_SPACE_ID for OTLP)LANGSMITH_API_KEY (and workspace id if needed); never invent keys.env files or search the filesystem for credentials| Data | Move? | Path |
|---|---|---|
| Historical runs / traces | Yes | scripts/migrate_vendor_traces.py --vendor langsmith → Arize OTLP |
| Datasets | Yes | LangSmith export → ax datasets create |
| Prompts | Yes | LangSmith Prompt Hub API → ax prompts create / create_version + labels |
| Live traffic going forward | Separate | Point new traffic at AX after import (not part of this skill) |
| Evaluators / experiments | Recreate / re-run for now | Do not import old scores as AX experiment truth |
| LangSmith | Arize OpenInference |
|---|---|
Run outputs (final return; unwrap {"output": "..."} if present) | output.value (string) |
extra.metadata.session_id / thread_id | session.id |
extra.metadata.user_id | user.id |
Run inputs | input.value (string) |
run_type / name heuristics | openinference.span.kind (LLM, TOOL, CHAIN, AGENT, …) |
parent_run_id | OTLP parentSpanId |
| Root run id | OTLP traceId (stable hash) |
| — | migration.source=langsmith |
Chat message arrays belong in llm.* / gen_ai.* only when the source already has that shape. Do not dump tool-call timelines into output.value.
Migration progress:
- [ ] 0. Confirm scope (space, AX project, resource types)
- [ ] 1. Preflight (ax + LangSmith auth)
- [ ] 2. Import historical traces (required when migrating traces)
- [ ] 3. Datasets
- [ ] 4. Prompts / evaluators (optional)
- [ ] 5. Live cutover (optional, after import verified)
- [ ] 6. Verify in AX
Target AX space + destination project name (create with ax projects create if needed). Confirm the LangSmith source project name.
ax projects list --space SPACE (or create destination project)LANGSMITH_API_KEY and that runs exist for the source projectLocate this installed skill's root and run its bundled commands by absolute path, so they work from any workspace. Check the chosen interpreter is Python 3.10 or later. Create an isolated environment if needed and install the helper dependencies (langsmith).
--limit is the number of root runs (newest first). The importer over-fetches and includes each selected root's children so --limit does not split a tree. If a parent still falls outside the fetched window, the script warns on stderr and promotes that span to a root — raise --limit (or omit it) instead of treating the orphan as a real root.
export ARIZE_API_KEY=... ARIZE_SPACE_ID=... LANGSMITH_API_KEY=...
python scripts/migrate_vendor_traces.py \
--vendor langsmith \
--source-project SOURCE_PROJECT \
--arize-project DEST_PROJECT \
--limit 200
Optional: --dry-run to preview mapping without ingest.
Then verify:
ax spans export DEST_PROJECT --space SPACE -l 50 --days 7 --stdout
Confirm:
attributes.output.value matching LangSmith Output (not a JSON message/parts array)attributes.session.id is set when LangSmith had session_id / thread_idparent_id linking the run tree. A span with no parent is a real root only when LangSmith also had no parent_run_id. If the importer warned about a missing parent, that span is an orphan from a truncated window — re-import with a higher --limit.Export examples → flatten → ax datasets create. See LangSmith export recipes.
Ask whether to import latest only or all commits. Then:
client.list_prompts() (or REST) to inventory reposlist_prompt_commits / pull commit (or latest / tag)LLMMessageRequest roles (SYSTEM / USER / ASSISTANT / TOOL)input_variable_format: {var} → F_STRING, {{var}} → MUSTACHE; ask if mixedax prompts create (or Python client.prompts.create) for the oldest commit, then create_version for newer commits in chronological orderprod) → AX labels via set_labels when presentDo not invent prompt text. If a commit is a non-chat / tool-heavy manifest the agent cannot flatten, import the readable message template and note what was skipped.
Recreate or re-run in AX for now; do not treat historical LangSmith feedback as AX experiment truth.
Summarize: spans imported, sample output.value, session coverage, datasets, prompts/versions/labels created, what was left behind.
Use .arize-tmp-migrate/langsmith/ for raw exports and verify dumps (gitignored at repo root).
arize-instrumentation, arize-dataset, arize-trace, arize-migrate-braintrust, arize-migrate-langfuse