Skip to content

feat(cli): add telemetry - #2283

Open
OwenKephart wants to merge 1 commit into
mainfrom
feat/eve-cli-telemetry-identity
Open

feat(cli): add telemetry#2283
OwenKephart wants to merge 1 commit into
mainfrom
feat/eve-cli-telemetry-identity

Conversation

@OwenKephart

@OwenKephart OwenKephart commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds opt-out CLI telemetry for canonical command usage and structured outcomes, with a dedicated policy page that documents the current allowlist, exclusions, controls, storage, and versioned notice. eve dev records only local/remote target and TUI/headless UI dimensions; telemetry does not send command arguments, prompts, URLs, paths, environment values, file contents, error messages, or arbitrary error properties.

The telemetry identity model follows Next.js rather than Vercel CLI’s account-associated model: a random installation ID, a per-invocation session ID, and a salted one-way project ID. The raw Git remote, REPOSITORY_URL, working directory, and salt remain local. CI and Docker use in-memory identity state, and identity or project-resolution failures skip telemetry without changing the user command.

Validation

Focused telemetry coverage passed with 24 tests, including command controls, salted project derivation, persisted and ephemeral identity behavior, disabled telemetry, failure isolation, and notice refresh. pnpm --filter eve typecheck and pnpm docs:check passed.

Checklist

  • I linked an issue with prior discussion confirming this change is wanted
  • I ran the relevant checks from CONTRIBUTING.md
  • I added tests and documentation where relevant
  • I added a changeset if this touches the published eve package
  • DCO sign-off passes for every commit (git commit --signoff)

Diff size

Docs — 4 files · +72 / -5

Adds the canonical telemetry policy page, links the CLI reference to it, and includes release notes.

Implementation — 6 files · +715 / -327

Implements telemetry controls, detached delivery, identity correlation, and preference storage. Extracting the existing dev command accounts for most of the mechanical implementation movement.

Tests — 5 files · +314 / -0

Covers command controls, event allowlisting, persistence, identity derivation, ephemeral environments, and failure isolation.

@vercel

vercel Bot commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
eve-docs Ready Ready Preview Aug 19, 2026 6:13pm
eve-docs-4759 Ready Ready Preview, v0 Aug 19, 2026 6:13pm
1 Skipped Deployment
Project Deployment Actions Updated (UTC)
eve-pkg Skipped Skipped Aug 19, 2026 6:13pm

Comment thread packages/eve/src/cli/telemetry/index.ts Outdated
@github-actions

github-actions Bot commented Aug 19, 2026

Copy link
Copy Markdown
Contributor

Bundle + Package Summary: apps/fixtures/weather-agent

Key takeaways

  • No notable deltas vs main (6ee5860).

Delta vs main (6ee5860)

Area Metric Baseline Current Delta
Package Packed tarball 8.24 MB 8.24 MB +4.6 kB ⚠️
Package Unpacked publish size 30.93 MB 30.95 MB +16.2 kB ⚠️
Package Installed footprint 74.97 MB 74.98 MB +16.2 kB ⚠️
Package Published files 3338 3351 +13
Package Installed files 7046 7059 +13
Package Installed package instances 35 35 0
Package Distinct installed package names 34 34 0
Package Installed dependency edges 53 53 0
Package Installed optional peer edges 47 47 0
Runtime Unique function payloads 2 2 0
Runtime Total function bytes 17.98 MB 17.98 MB -40 B ✅
Runtime Public routes 16 16 0
Changed function payloads vs main (6ee5860) (2)
Function Status Baseline Current Delta Route changes
functions/__server.func changed 8.99 MB 8.99 MB -20 B ✅ none
functions/.well-known/workflow/v1/flow.func changed 8.99 MB 8.99 MB -20 B ✅ none

eve init install

Metric Baseline Current Delta
Installed footprint 113.38 MB 113.39 MB +16.2 kB ⚠️
Installed packages 121 121 0
dependencies 4 4 0
devDependencies 2 2 0
Dependency package bytes 45.43 MB 45.45 MB +16.2 kB ⚠️
devDependency package bytes 5.04 MB 5.04 MB 0 B ➖
Build Metadata
  • Preset: vercel
  • Nitro: nitro@3.0.260610-beta
  • Output directory: apps/fixtures/weather-agent/.vercel/output
  • Build metadata timestamp: 2026-08-19T18:14:54.572Z
  • Route aliases: 16 public, 1 internal (17 total aliases)
  • Vercel routes in config: 19
  • Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down

Package Details

  • Package: eve@0.39.2
  • Package directory: packages/eve
  • Tarball: 8.24 MB (eve-0.39.2.tgz)
  • Unpacked payload: 30.95 MB across 3351 published files
  • Installed footprint: 74.98 MB across 7059 installed files
  • Installed root package: 29.59 MB
  • Installed dependencies: 45.39 MB
  • Installed package instances: 35
  • Distinct installed package names: 34
  • Installed dependency edges: 53
  • Installed optional peer edges: 47
  • Runtime dependencies: 2
  • Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Graph metrics read only package.json files in package directories directly beneath a node_modules boundary, including nested boundaries. Each directory is one package instance; distinct names come from those manifests. Dependency edges count each unique name in dependencies or optionalDependencies per instance; optional peer edges count peerDependencies marked optional.

Heavy installed dependencies

  • eve: 29.59 MB (39.5%)
  • @rolldown/binding-linux-x64-gnu: 19.91 MB (26.6%)
  • ai: 6.69 MB (8.9%)
  • zod: 5.07 MB (6.8%)
  • undici: 3.50 MB (4.7%)
Publish payload breakdown
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [################........] 10.20 MB 33.0%
🟠 dist/src/compiled/@photon-ai/chat-adapter-ime... [####....................] 2.44 MB 7.9%
🟠 dist/src/compiled/experimental-ai-sdk-code-mo... [##......................] 1.51 MB 4.9%
🟡 dist/src/compiled/_chunks/node/undici-CUIybhQ... [#.......................] 508.8 kB 1.6%
🟡 dist/src/compiled/_chunks/workflow/undici-BBG... [#.......................] 508.8 kB 1.6%
🔴 Other published files                            [########################] 15.78 MB 51.0%
Installed footprint breakdown
Installed package size
🔴 eve                             [########################] 29.59 MB 39.5%
🔴 @rolldown/binding-linux-x64-gnu [################........] 19.91 MB 26.6%
🔴 ai                              [#####...................] 6.69 MB 8.9%
🔴 zod                             [####....................] 5.07 MB 6.8%
🟠 undici                          [###.....................] 3.50 MB 4.7%
🟠 nitro                           [##......................] 2.41 MB 3.2%
🔴 Other installed packages        [######..................] 7.81 MB 10.4%
Runtime dependencies (2)
Package Range Notes
nitro 3.0.260610-beta
undici 8.9.0
Peer dependencies (5)
Package Range Notes
@opentelemetry/api ^1.0.0 optional peer
ai catalog:
braintrust ^3.0.0 optional peer
just-bash ^3.0.0 optional peer
microsandbox ^0.5.0 optional peer
eve init install drill-down

eve init install details

  • Command: eve init my-agent
  • Package manager: npm
  • Installed footprint: 113.39 MB across 8935 installed files
  • Installed packages: 121 total (115 transitive-only)
  • dependencies: 4 direct packages totaling 45.45 MB
  • devDependencies: 2 direct packages totaling 5.04 MB
  • Other transitive package files: 62.90 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

  • eve: 29.59 MB (26.1%)
  • @typescript/typescript-linux-x64: 27.95 MB (24.6%)
  • @rolldown/binding-linux-x64-gnu: 19.91 MB (17.6%)
  • zod: 9.02 MB (8.0%)
  • ai: 6.69 MB (5.9%)
Installed footprint breakdown
Installed package size
🔴 eve                              [########################] 29.59 MB 26.1%
🔴 @typescript/typescript-linux-x64 [#######################.] 27.95 MB 24.6%
🔴 @rolldown/binding-linux-x64-gnu  [################........] 19.91 MB 17.6%
🔴 zod                              [#######.................] 9.02 MB 8.0%
🔴 ai                               [#####...................] 6.69 MB 5.9%
🟠 undici                           [###.....................] 3.50 MB 3.1%
🔴 Other installed packages         [##############..........] 16.72 MB 14.7%
dependencies (4)
Package Range Installed size Share
@vercel/connect 0.4.3 141.0 kB 0.1%
ai ^7.0.58 6.69 MB 5.9%
eve file:eve-0.39.2.tgz 29.59 MB 26.1%
zod 4.4.3 9.02 MB 8.0%
devDependencies (2)
Package Range Installed size Share
@types/node 24.x 2.54 MB 2.2%
typescript 7.0.2 2.50 MB 2.2%
Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 8.99 MB 50.0%
🔴 functions/__server.func                         [########################] 8.99 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 8.99 MB
Metric Value
Public routes /.well-known/workflow/v1/flow
Runtime nodejs24.x
Handler index.mjs
Payload 8.99 MB
Function files 8.99 MB across 50 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 1.98 MB (22.1%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                     [#################.......] 1.98 MB 22.1%
🟠 _chunks/runtime-artifacts.mjs [###############.........] 1.78 MB 19.7%
🟡 _libs/undici.mjs              [########................] 980.5 kB 10.9%
🟡 _chunks/sandbox.mjs           [#######.................] 781.9 kB 8.7%
🟡 _chunks/frames-DoexhtxJ.mjs   [######..................] 672.6 kB 7.5%
🟠 Other bundled files           [########################] 2.80 MB 31.1%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}

🟠 functions/__server.func • 15 public routes, 1 internal alias • 8.99 MB
Metric Value
Public routes /
/eve/v1/callback/[token]
/eve/v1/connections/[name]/callback/[attemptId]/[token]
/eve/v1/connections/[name]/callback/[token]
/eve/v1/health
/eve/v1/info
/eve/v1/session
/eve/v1/session/[parentSessionId]/subagents/[callId]/[childSessionId]/stream
/eve/v1/session/[sessionId]
/eve/v1/session/[sessionId]/cancel
/eve/v1/session/[sessionId]/clear
/eve/v1/session/[sessionId]/compact
/eve/v1/session/[sessionId]/reset
/eve/v1/session/[sessionId]/stream
/eve/v1/task-input/[token]
Internal aliases /__server
Runtime nodejs24.x
Handler index.mjs
Payload 8.99 MB
Function files 8.99 MB across 50 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 1.98 MB (22.1%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                     [#################.......] 1.98 MB 22.1%
🟠 _chunks/runtime-artifacts.mjs [###############.........] 1.78 MB 19.7%
🟡 _libs/undici.mjs              [########................] 980.5 kB 10.9%
🟡 _chunks/sandbox.mjs           [#######.................] 781.9 kB 8.7%
🟡 _chunks/frames-DoexhtxJ.mjs   [######..................] 672.6 kB 7.5%
🟠 Other bundled files           [########################] 2.80 MB 31.1%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: e2e/fixtures/agent-tools-sandbox

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

  • Build pipeline: 1.73 s -> 1.74 s (+5.8 ms) vs main (6ee5860).
  • Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `main (6ee5860)`
Phase Baseline Current Delta
extension.check 0.8 ms 0.8 ms 0.0 ms
project.resolve 0.2 ms 0.2 ms 0.0 ms
workspace.create 0.5 ms 0.4 ms -0.1 ms
host.prepare 207.1 ms 191.5 ms -15.6 ms
vercel.service-prefix.resolve 1.5 ms 1.7 ms +0.2 ms
nitro.create 180.4 ms 184.3 ms +3.9 ms
sandbox.prewarm 151.4 ms 180.5 ms +29.1 ms
nitro.cache.prepare 0.2 ms 0.2 ms 0.0 ms
nitro.prepare 0.5 ms 0.6 ms +0.1 ms
nitro.public-assets 0.6 ms 0.6 ms 0.0 ms
nitro.prerender 0.3 ms 0.3 ms 0.0 ms
nitro.bundle 1.12 s 1.12 s -1.6 ms
nitro.cache.write 0.3 ms 0.2 ms -0.1 ms
vercel.workflow-function.materialize 42.3 ms 44.7 ms +2.4 ms
agent-summary.emit 0.4 ms 0.4 ms 0.0 ms
nitro.close 0.1 ms 0.1 ms 0.0 ms
output.publish 12.6 ms 4.5 ms -8.1 ms
workspace.remove 5.6 ms 1.5 ms -4.1 ms

@@ -0,0 +1,345 @@
import { Command, InvalidArgumentError } from "#compiled/commander/index.js";

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note: this is a pure extraction from run.ts, which was getting too large on its own

Signed-off-by: owenkephart <owen.kephart@vercel.com>
Comment on lines +23 to +40
function eveConfigPath(): string {
const home = homedir();
if (process.platform === "win32") {
return join(
configuredDirectory(process.env.APPDATA, join(home, "AppData", "Roaming")),
"eve",
"config.json",
);
}
if (process.platform === "darwin") {
return join(home, "Library", "Preferences", "eve", "config.json");
}
return join(
configuredDirectory(process.env.XDG_CONFIG_HOME, join(home, ".config")),
"eve",
"config.json",
);
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This steers away from the existing path that has the configuration being scoped to the immediate project.

Assuming this is intentional as we want to capture user intent across projects. If that's the case, I wouldn't scope this to telemetry/ as it is config that's meant to be shared with other domains.

Comment on lines +45 to +49
enabled: z.boolean().optional(),
installationId: z.string().optional(),
noticeVersion: z.number().int().positive().optional(),
notifiedAt: z.string().optional(),
projectSalt: z.string().optional(),

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this is a looseObject (ie already accepts defaults), I'd expect for enabled to be a required prop.

Comment on lines +14 to +16
export function createEveTelemetryIdentity(): EveCliTelemetryIdentity {
return { installationId: randomUUID(), projectSalt: randomUUID() };
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIUC:

  • installationId and projectSalt are both generated at random and persisted at a user-level config
  • is read whenever present

How do we disambiguate between different eve projects? What is the point of having these ids?

@!e0

@e0-gh-vercel-connect

Copy link
Copy Markdown

projectSalt is a random UUID stored in the local eve config. It salts the SHA-256 hash of the Git remote, REPOSITORY_URL, or cwd used for project_id.

That keeps project_id stable on one installation without sending the raw repository URL/path, while the same project hashes differently on another installation. The salt itself is not sent.

@OwenKephart
OwenKephart marked this pull request as ready for review August 25, 2026 16:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants