Quickstart: your first report in 5 minutes

Set up CallQA to test my voice agent (the one in this repository). The CallQA MCP server is
installed as "callqa": use its tools and follow its set-up-callqa steps.
1. Call get_setup_status first: it says what is done and which tool does each next step.
2. Environments (staging, production), then my agent's phone number and its verification.
3. Write 2 to 4 test scenarios from this repository (the agent's prompt, tools and flows),
   validate them, save them.
4. One first run: read the report, fix my agent (or the test) where it fails.
5. Schedule the tests every weekday morning and add the CI files.
Rules: before a run, tell me how many real calls it places. Stop and ask me for what only a
person can do (signing the number attestation, putting the verification phrase live,
billing). Never write an API key in a file of this repository. If no callqa tool is
available, tell me to install the MCP server first.

export CALLQA_API_KEY="PASTE_YOUR_CALLQA_KEY_HERE"
export CALLQA="https://app.callqa.dev/api/v1"

curl -sS -H "Authorization: Bearer $CALLQA_API_KEY" "$CALLQA/me" | jq '{org_name, scopes, plan: .plan.code}'

{ "org_name": "Acme", "scopes": ["read", "run", "write"], "plan": "growth" }

name: "Reschedule a dentist appointment"
phone: "+14155550107"
persona: "Patient who needs to move Thursday's cleaning to next week"
goal: "Move the appointment to any morning next week"
must_include:
  - "confirm the new date and time"
max_latency_ms: 2000
variants:
  - title: "Polite patient"
  - title: "Patient in a hurry"
    persona:
      description: "Patient calling between two meetings, impatient, speaks fast"

curl -sS -X POST "$CALLQA/scenarios/import" \
  -H "Authorization: Bearer $CALLQA_API_KEY" \
  -H "Content-Type: application/yaml" \
  --data-binary @reschedule.yaml | tee scenario.json | jq '{id, name, target_id, variants}'

export SCENARIO=$(jq -r .id scenario.json)
export TARGET=$(jq -r .target_id scenario.json)

# 1. a code, shown once (the attestation is signed the first time)
curl -sS -X POST "$CALLQA/targets/$TARGET/verification/start" \
  -H "Authorization: Bearer $CALLQA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"attestation": {"accept": true, "signer_name": "Jane Doe, CTO"}}' \
  | jq '{phrase, code_expires_at}'

# 2. add the phrase ("Verification code 4 8 2 1 9 3.") to the greeting, then:
curl -sS -X POST "$CALLQA/targets/$TARGET/verification/call" \
  -H "Authorization: Bearer $CALLQA_API_KEY"

# 3. about 30 seconds later
curl -sS "$CALLQA/targets/$TARGET/verification" \
  -H "Authorization: Bearer $CALLQA_API_KEY" | jq '{status, last_attempt}'

curl -sS -X POST "$CALLQA/scenarios/$SCENARIO/runs" \
  -H "Authorization: Bearer $CALLQA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"tags": ["quickstart"]}' \
  | tee run.json | jq '{id, number, status, total, url}'

export RUN=$(jq -r .id run.json)

while :; do
  curl -sS -H "Authorization: Bearer $CALLQA_API_KEY" "$CALLQA/runs/$RUN" > run.json
  status=$(jq -r .status run.json)
  echo "status: $status"
  [ "$status" = "completed" ] || [ "$status" = "canceled" ] && break
  sleep 15
done
jq '{verdict, score, passed, failed, warned, errored, blocked, cost_cents, url}' run.json

{
  "verdict": "pass", "score": 91, "passed": 2, "failed": 0, "warned": 0,
  "errored": 0, "blocked": 0, "cost_cents": 0,
  "url": "https://app.callqa.dev/o/acme/runs/5c1e.../"
}

curl -sS -H "Authorization: Bearer $CALLQA_API_KEY" "$CALLQA/calls?run_id=$RUN" \
  | jq '.items[] | {id, title, status, verdict, score, latency_p95_ms}'

CALL=$(curl -sS -H "Authorization: Bearer $CALLQA_API_KEY" "$CALLQA/calls?run_id=$RUN" | jq -r '.items[0].id')

curl -sS -H "Authorization: Bearer $CALLQA_API_KEY" "$CALLQA/calls/$CALL" \
  | jq '{verdict, score, verdicts: [.result.verdicts[] | {type, passed, evidence}], transcript: [.transcript[] | "\(.speaker): \(.text)"]}'