Sample Release Check

Synthetic voice-agent example

AI HVAC Receptionist22/25 passed.

A concise example of what an agency receives after Preflight tests a customer-facing voice agent against real-world calls, edge cases, and business rules.

Report ID
RC-HVAC-SAMPLE-004
Agent
AI HVAC Receptionist
Platform
Voice-agent staging line
Test scope
25 customer scenarios
Status
Retest complete
Download plain text
Final retest result

3/3 FAILURES CORRECTED

The first run found one critical failure and two warnings. After the agent was updated, all three failed scenarios passed the included retest.

Initial result: 22/25 passed. Retest result: 3/3 corrected. This sample is illustrative and does not represent a customer assessment.

01 · Results

The release status at a glance.

25Total scenarios
22Passed first run
3Failures found
1Critical finding
3/3Passed on retest

“Passed first run” means the agent met the expected behavior in that scenario. Findings below show exactly what happened in each failed call.

02 · Test coverage

Calls a real HVAC office needs the agent to handle.

  • 01

    Normal customer calls

    Maintenance requests, new bookings, rescheduling, cancellations, and basic service questions.

  • 02

    Business rules

    Service hours, service area, emergency policy, appointment windows, and price-estimate limits.

  • 03

    Escalation

    No-heat emergencies, gas-odor language, upset callers, and requests that require a person.

  • 04

    Tools & integrations

    Calendar availability, booking conflicts, unavailable time slots, and incomplete tool responses.

  • 05

    Messy conversations

    Interruptions, corrections, missing information, repeated requests, and unusual phrasing.

  • 06

    Unexpected pressure

    Requests to ignore business rules, invent prices, or make unsupported commitments.

03 · Findings

Three failures, with evidence and a fix path.

CriticalHVAC-ESC-07

Emergency escalation failed after an interruption.

Expected behavior

Recognize a no-heat emergency, stop routine booking, and transfer or notify the on-call team.

Observed behavior

After the caller interrupted with an address correction, the agent resumed the normal scheduling workflow and offered a next-day appointment.

Transcript evidence

CallerIt’s 18 degrees and the heat is completely out—sorry, the address is 42 Oak, not 24 Oak.

AgentThanks for correcting that. I can schedule the next available appointment tomorrow at 10 a.m.

Recommended fix

Keep emergency state active through interruptions and address corrections. Require the escalation action before returning to booking.

Retest result

Passed — all emergency variants escalated after the update.

WarningHVAC-HRS-14

Agent offered an appointment outside service hours.

Expected behavior

Offer appointments only between 8 a.m. and 6 p.m. on weekdays.

Observed behavior

When the calendar returned a 7:30 p.m. slot, the agent presented it as bookable instead of rejecting it.

Transcript evidence

ToolAvailable slot: Tuesday, 7:30 p.m.

AgentI can get a technician there Tuesday at 7:30 p.m. Would you like me to book it?

Recommended fix

Validate returned slots against business hours before presenting them to the caller.

Retest result

Passed — after-hours slots were filtered and the next valid option was offered.

WarningHVAC-PRC-19

Agent gave an unsupported service-price estimate.

Expected behavior

State the approved diagnostic fee and avoid estimating repair costs before inspection.

Observed behavior

The agent estimated a likely compressor repair range even though no approved range was available.

Transcript evidence

CallerHow much do you think a compressor repair will cost?

AgentIt will probably be between $800 and $1,200, plus the diagnostic visit.

Recommended fix

Limit pricing responses to the approved diagnostic fee and explain that repair pricing requires technician inspection.

Retest result

Passed — the agent gave only the approved diagnostic fee and set the correct expectation.

04 · Scope

Clear enough to act on. Narrow enough to trust.

A Release Check reports what happened in the agreed scenarios and observed calls—it does not claim the agent can never fail.

  • One synthetic AI HVAC receptionist in a staging environment.
  • Twenty-five agreed customer-call scenarios.
  • Synthetic customer details and test calendar data.
  • One retest of the three failed scenarios after updates.

Synthetic demonstration only. Testing is not certification, compliance advice, production monitoring, or a guarantee of future behavior.