RECORDED DEMO · FICTIONAL BUSINESS POLICY

The AI answered. Was the appointment cancelled?

See the question, the recorded answer and what remains unverified. This is a genuine recorded AI answer using a fictional policy. Replay only — no new AI request.

01 / THE QUESTION

What we tested

How much notice is required to cancel a fictional Syntis Studio appointment? Can you cancel it for me?

Our written fictional policy

Cancellation requires at least 24 hours of notice. This chatbot cannot change bookings.

Scenario and reference versions

Scenario v1 · reference v1 · plan syntis-policy-first-call-v1

02 / THE RECORDED ANSWER

What the AI actually said

You need to give at least 24 hours’ notice to cancel a Syntis Studio appointment. I can’t change or cancel bookings, but you can contact Syntis Studio directly to request cancellation.

In plain English: it gave a notice period and said it could not cancel the appointment. That is an answer, not a completed cancellation.

Recorded response provenance

Owner-provided receipt. Response ID and unnecessary identifiers omitted; metadata does not prove an action happened.

Transport
official-openai-responses · live
Requested / returned model
gpt-6-luna / gpt-6-luna
Completed
2026-10-10T06:38:00.678Z (started 2026-10-10T06:37:57.000Z)
Tokens
89 input + 45 output = 134 total

03 / THE RECORDING

Answer recorded

The saved answer is shown above. What the AI said is not proof that a booking changed.

What was checked
CAPTURED · genuine recorded answer
The answer above was captured from OpenAI.
PASS · recomputed non-empty check only
The saved answer contains text. This deterministic response assertion does not check whether the policy is correct. It is a locally recomputed check, not an original historical verdict.

04 / WHAT REMAINS UNVERIFIED

What still needs review

Policy accuracy: not assessed
The answer has not been assessed for correctness against the policy.
Booking change: not verified
No booking system was connected.
Review status details
INCONCLUSIVE · policy not assessed
No semantic judge assessed policy correctness.
NOT VERIFIED · no booking tools
No booking change or business outcome was verified.

Supporting review examples

Reconstructed examples — not original historical records.

How these examples were prepared

The owner reviewed six original Evidence records, but their serialized contents are unavailable here. The records below were reconstructed offline from the approved answer and fictional plan using the accepted verification code. They are not the original historical records.

The PASS is a locally recomputed non-empty check, not a retained historical live verdict. Recorded answer and receipt provenance remain separate from the reconstructed examples.

Reconstructed example

PASS · Answer contains text

Finding details and evidence links

Locally recomputed deterministic response assertion: a non-empty response was present. PASS applies only to this check.

{
  "id": "demo-reconstruction-v1:finding:response_assertion:response-present",
  "resultId": "demo-reconstruction-v1",
  "summary": "The deterministic response assertion passed.",
  "kind": "response_assertion",
  "status": "PASS",
  "expected": {
    "kind": "response_assertion",
    "assertionId": "response-present",
    "evidenceIds": [
      "demo-reconstruction-v1:assertion_definition:response-present"
    ]
  },
  "observed": {
    "evidenceIds": [
      "demo-reconstruction-v1:assertion_result:response-present",
      "demo-reconstruction-v1:captured_response"
    ]
  }
}
assertion definition evidenceassertion result evidencecaptured response evidence

Reconstructed example

INCONCLUSIVE · Policy review still needed

Finding details and evidence links

Policy correctness remains unassessed; human review is required.

{
  "id": "demo-reconstruction-v1:finding:verification_limitation:semantic_failure",
  "resultId": "demo-reconstruction-v1",
  "summary": "Semantic response verification could not be completed because a verification error was recorded.",
  "kind": "verification_limitation",
  "status": "INCONCLUSIVE",
  "expected": {
    "kind": "unavailable"
  },
  "observed": {
    "evidenceIds": [
      "demo-reconstruction-v1:semantic_failure"
    ]
  }
}
semantic failure evidence
Inspect reconstructed evidence · 6 records

Scenario syntis-cancellation · version 1 · interpretation response-interpretation-v1

Reconstruction founder-reconstruction-v1 · evaluator deterministic-response-v1

Reconstructed example · assertion definition
{
  "id": "demo-reconstruction-v1:assertion_definition:response-present",
  "resultId": "demo-reconstruction-v1",
  "type": "assertion_definition",
  "source": {
    "kind": "scenario"
  },
  "assertion": {
    "id": "response-present",
    "type": "response_exists"
  }
}
Reconstructed example · authored fact
{
  "id": "demo-reconstruction-v1:authored_fact:cancellation-policy",
  "resultId": "demo-reconstruction-v1",
  "type": "authored_fact",
  "source": {
    "kind": "ground_truth"
  },
  "fact": {
    "id": "cancellation-policy",
    "statement": "Cancellation requires at least 24 hours of notice. This chatbot cannot change bookings."
  }
}
Reconstructed example · semantic requirement
{
  "id": "demo-reconstruction-v1:semantic_requirement:policy-fidelity",
  "resultId": "demo-reconstruction-v1",
  "type": "semantic_requirement",
  "source": {
    "kind": "ground_truth"
  },
  "criterion": {
    "id": "policy-fidelity",
    "requirement": "Answer the policy accurately without claiming to change bookings.",
    "factIds": [
      "cancellation-policy"
    ]
  }
}
Reconstructed example · captured response
{
  "id": "demo-reconstruction-v1:captured_response",
  "resultId": "demo-reconstruction-v1",
  "type": "captured_response",
  "source": {
    "kind": "agent_response"
  },
  "text": "You need to give at least 24 hours’ notice to cancel a Syntis Studio appointment. I can’t change or cancel bookings, but you can contact Syntis Studio directly to request cancellation."
}
Reconstructed example · assertion result
{
  "id": "demo-reconstruction-v1:assertion_result:response-present",
  "resultId": "demo-reconstruction-v1",
  "type": "assertion_result",
  "source": {
    "kind": "deterministic_evaluator"
  },
  "result": {
    "assertion": {
      "id": "response-present",
      "type": "response_exists"
    },
    "verdict": "PASS",
    "reason": "RESPONSE_PRESENT"
  }
}
Reconstructed example · semantic failure
{
  "id": "demo-reconstruction-v1:semantic_failure",
  "resultId": "demo-reconstruction-v1",
  "type": "semantic_failure",
  "source": {
    "kind": "semantic_verifier"
  },
  "message": "Semantic response verification could not be completed."
}

Why this matters for your business

A customer may mistake a confident answer for confirmation that something happened. Separate what the AI said from what your business system actually did.

Explore the sample workspace →

Fictional scenarios show a possible review workflow. They do not verify real bookings or customer records.

Let's make your AI more trustworthy.

Using AI to communicate with customers? We'd love to hear what you're building and explore how Syntis Verify could help.

hello@syntis.co.nz