Skip to content

Role-by-role telemetry

See the Signal For Every Role

Different roles leave different fingerprints. Here's what Promptster captures that your current process misses — role by role.

What they do

The candidate lands in a Node.js monorepo they've never seen. The brief: add per-tenant rate limiting to the REST API without breaking three downstream services. They spend the first seven minutes reading — not prompting. They grep for middleware patterns, trace the request lifecycle, find where auth tokens are verified. When they finally open a conversation with Claude Code, their first message is a 90-word specification with explicit constraints: sliding window, Redis-backed, reject at 429 not 503, propagate the Retry-After header. They don't ask Claude what to do. They tell it exactly what to build.

What Promptster captures

What Promptster captures that you'd miss: the seven minutes of deliberate, pre-prompt exploration. Most tools see only the AI conversation. Promptster captures the Read sequence (routes.ts → middleware/auth.ts → lib/redis.ts → tests/integration/api.test.ts) that preceded the first prompt. It records that the candidate read the test suite before touching a single file. It flags a decision event at 14:22 when they manually rewrote the Redis key schema that Claude proposed — because the AI's version would've broken multi-region reads. Prompt quality score: 9.1/10. Human attribution: 81%.

How this changes the hire

How this changes your decision: you were prepared to debate whether to advance them based on the final PR. Now you can see they caught a distributed-systems footgun that your senior reviewer might have missed on code review. You advance them to final-round without a phone screen, because the telemetry already answered your architectural competency questions. The next candidate submitted faster and had cleaner code. Their telemetry showed 23 prompt-fire-and-hope cycles, zero exploration, and 94% AI attribution. You pass.

Session timeline · Senior Backend Engineer

00:00–07:12Read 4 files (repo exploration)
07:13prompt.send — rate limiter spec (90 words)
07:15–09:30Read routes.ts + lib/redis.ts
09:31Edit middleware/index.ts (+18 lines)
14:22decision — rewrote Redis key schema manually
22:05bash — npm test (integration suite, 2 fails)
24:18Edit rate-limit.ts — fix edge case
28:41bash — npm test (all pass)

Key signals captured

Signal

Pre-Prompt Exploration Depth

Captured: 7m 12s of file reads before first prompt. Sequence: routes → auth → redis → tests.

Why it matters: Architects read before they write. Vibe-coders prompt blind. This is the single most predictive signal for senior engineering instinct.

Signal

Manual Override Rate

Captured: 3 AI suggestions accepted, 2 modified, 1 fully rewritten. Redis key schema rewrite captured as decision event.

Why it matters: Accepting 100% of AI suggestions is a red flag. Critical thinking shows up in edit divergence, not in clean diffs.

Signal

Test-First Sequencing

Captured: Candidate read integration tests before touching implementation. Test run at 22m flagged two failures; fixed without re-prompting.

Why it matters: Senior engineers know where the contract lives. Reading tests before code is a workflow signal that LeetCode prep never teaches.

"The telemetry showed him reading our test fixtures before writing a single line. I've been engineering for 12 years and I don't have a better proxy for production-readiness than that."

VP Engineering, Series B SaaS · 280-person eng org

Ready to See How Engineers Actually Work?

Design partner slots are limited. Early partners get founding pricing, direct product input, and a dedicated onboarding session. We respond within 48 hours.

Design partner program — limited slots. Founding pricing locked in.