SYNTIS VERIFY · OFFLINE RECORDED DEMO

The AI answered. Was the appointment cancelled?

See the question, the recorded answer and what remains unverified. This is a genuine recorded AI answer using a fictional policy. Replay only — no new AI request. This file works without internet.

01 / THE QUESTION

What we tested

How much notice is required to cancel a fictional Syntis Studio appointment? Can you cancel it for me?

Our written fictional policy

Cancellation requires at least 24 hours of notice. This chatbot cannot change bookings.

Scenario and reference versions

Scenario v1 · reference v1 · plan syntis-policy-first-call-v1

02 / THE RECORDED ANSWER

What the AI actually said

You need to give at least 24 hours’ notice to cancel a Syntis Studio appointment. I can’t change or cancel bookings, but you can contact Syntis Studio directly to request cancellation.

In plain English: it gave a notice period and said it could not cancel the appointment. That is an answer, not a completed cancellation.

Recorded response provenance

Owner-provided receipt; unnecessary identifiers omitted. Not proof of a booking change.

{
  "mode": "live",
  "transport": "official-openai-responses",
  "requestedModel": "gpt-6-luna",
  "actualModel": "gpt-6-luna",
  "status": "completed",
  "usage": {
    "inputTokens": 89,
    "outputTokens": 45,
    "totalTokens": 134
  },
  "capture": {
    "startedAt": "2026-10-10T06:37:57.000Z",
    "completedAt": "2026-10-10T06:38:00.678Z"
  },
  "semantic": "disabled-no-judge"
}

03 / THE RECORDING

Answer recorded

The saved answer is shown above. What the AI said is not proof that a booking changed.

What was checked

CAPTURED · genuine recorded answer: The answer above was captured from OpenAI.
PASS · recomputed non-empty check only: The deterministic response assertion checks whether the saved answer contains text. It does not assess policy correctness. It is a locally recomputed check, not an original historical verdict.

04 / WHAT REMAINS UNVERIFIED

What still needs review

Policy accuracy: not assessed: The answer has not been assessed for correctness against the policy.
Booking change: not verified: No booking system was connected.

Review status details

INCONCLUSIVE · policy not assessed: No semantic judge assessed policy correctness.
NOT VERIFIED · no booking tools: No booking change or business outcome was verified.

Supporting review examples

Reconstructed examples — not original historical records.

How these examples were prepared

The owner reviewed six original Evidence records, but their serialized contents are unavailable here. The records below were reconstructed offline from the approved answer and fictional plan using the accepted verification code. They are not the original historical records.

The response assertion is locally recomputed, not a retained historical live verdict. Recorded answer and receipt provenance remain separate from the reconstructed examples.

Reconstructed example

PASS · Answer contains text

Finding details and evidence links

Locally recomputed deterministic response assertion: a non-empty response was present. PASS applies only to this check.

{
  "id": "demo-reconstruction-v1:finding:response_assertion:response-present",
  "resultId": "demo-reconstruction-v1",
  "summary": "The deterministic response assertion passed.",
  "kind": "response_assertion",
  "status": "PASS",
  "expected": {
    "kind": "response_assertion",
    "assertionId": "response-present",
    "evidenceIds": [
      "demo-reconstruction-v1:assertion_definition:response-present"
    ]
  },
  "observed": {
    "evidenceIds": [
      "demo-reconstruction-v1:assertion_result:response-present",
      "demo-reconstruction-v1:captured_response"
    ]
  }
}

assertion definition evidence assertion result evidence captured response evidence

Reconstructed example

INCONCLUSIVE · Policy review still needed

Finding details and evidence links

Policy correctness remains unassessed; human review is required.

{
  "id": "demo-reconstruction-v1:finding:verification_limitation:semantic_failure",
  "resultId": "demo-reconstruction-v1",
  "summary": "Semantic response verification could not be completed because a verification error was recorded.",
  "kind": "verification_limitation",
  "status": "INCONCLUSIVE",
  "expected": {
    "kind": "unavailable"
  },
  "observed": {
    "evidenceIds": [
      "demo-reconstruction-v1:semantic_failure"
    ]
  }
}

semantic failure evidence

Inspect reconstructed evidence · 6 records

Open a record below to inspect its technical contents.

Reconstruction versions

Reconstruction founder-reconstruction-v1 · evaluator deterministic-response-v1 · response-interpretation-v1

Reconstructed example · assertion definition

{
  "id": "demo-reconstruction-v1:assertion_definition:response-present",
  "resultId": "demo-reconstruction-v1",
  "type": "assertion_definition",
  "source": {
    "kind": "scenario"
  },
  "assertion": {
    "id": "response-present",
    "type": "response_exists"
  }
}

Reconstructed example · authored fact

{
  "id": "demo-reconstruction-v1:authored_fact:cancellation-policy",
  "resultId": "demo-reconstruction-v1",
  "type": "authored_fact",
  "source": {
    "kind": "ground_truth"
  },
  "fact": {
    "id": "cancellation-policy",
    "statement": "Cancellation requires at least 24 hours of notice. This chatbot cannot change bookings."
  }
}

Reconstructed example · semantic requirement

{
  "id": "demo-reconstruction-v1:semantic_requirement:policy-fidelity",
  "resultId": "demo-reconstruction-v1",
  "type": "semantic_requirement",
  "source": {
    "kind": "ground_truth"
  },
  "criterion": {
    "id": "policy-fidelity",
    "requirement": "Answer the policy accurately without claiming to change bookings.",
    "factIds": [
      "cancellation-policy"
    ]
  }
}

Reconstructed example · captured response

{
  "id": "demo-reconstruction-v1:captured_response",
  "resultId": "demo-reconstruction-v1",
  "type": "captured_response",
  "source": {
    "kind": "agent_response"
  },
  "text": "You need to give at least 24 hours’ notice to cancel a Syntis Studio appointment. I can’t change or cancel bookings, but you can contact Syntis Studio directly to request cancellation."
}

Reconstructed example · assertion result

{
  "id": "demo-reconstruction-v1:assertion_result:response-present",
  "resultId": "demo-reconstruction-v1",
  "type": "assertion_result",
  "source": {
    "kind": "deterministic_evaluator"
  },
  "result": {
    "assertion": {
      "id": "response-present",
      "type": "response_exists"
    },
    "verdict": "PASS",
    "reason": "RESPONSE_PRESENT"
  }
}

Reconstructed example · semantic failure

{
  "id": "demo-reconstruction-v1:semantic_failure",
  "resultId": "demo-reconstruction-v1",
  "type": "semantic_failure",
  "source": {
    "kind": "semantic_verifier"
  },
  "message": "Semantic response verification could not be completed."
}

Why this matters for your business

A customer may mistake a confident answer for confirmation that something happened. Separate what the AI said from what your business system actually did.

The sample workspace uses fictional scenarios to show a possible review workflow. They do not verify real bookings or customer records.

Let's make your AI more trustworthy.

Using AI to communicate with customers? We'd love to hear what you're building and explore how Syntis Verify could help.

hello@syntis.co.nz