01 — The LiveKit Room
LiveKit Room (per call)
📞
Guest Audio Track
Inbound audio from caller
🤖
Agent Audio Track
AI voice response back to guest
⚡
Data Channel
FlowPilot directives, supervisor whispers, real-time events — invisible to guest
🎧
Supervisor Track
Silent listener, muted by default. Unmute = takeover
02 — The Per-Turn Pipeline
01
VAD
Voice Activity Detection
Detects end of guest utterance. Triggers the pipeline.
02
STT
Deepgram Nova-2
Streaming transcription. Text available in <300ms.
03
FlowPilot
Parallel analyzer
Reads transcript in real-time. Decides if injection needed this turn.
★ Injection Point
04
LLM Payload
Claude / GPT-4o
System prompt + history + guest utterance + FlowPilot directive (if any).
05
LLM Response
Streaming tokens
Agent generates response guided by all three directive layers.
06
TTS → Guest
ElevenLabs
Audio streamed back. Late-night FM DJ voice profile. Guest hears nothing else.
03 — The Three-Layer Directive System
Layer 1 · Always On
ETHOS
Forbes 5-star baseline. Static. Non-negotiable. Every single call.
Never say "no" — always "what I can do is…"
Never say "I don't know" — "Allow me to find that"
Use guest name within 30 seconds
No filler words: um, like, actually, of course
Warm, unhurried pace — Late Night FM DJ voice
Close every call with something personal
Never transfer without a full briefing
Layer 2 · Context-Driven
LOGOS
Sales methodology. Injected by FlowPilot based on detected call state.
Intent confirmed → consultative questions ("What's the occasion?")
Price objection → Accusation Audit + Scarcity if inventory low
Hesitation → Mirroring + Tactical Empathy
Near close → Commitment anchoring ("You mentioned Saturday…")
Enhancement pitch → Reciprocity frame
Competitor mention → redirect to unique property value
Layer 3 · Signal-Triggered
PATHOS
Charisma and connection. The unexpected warmth. What makes it feel human.
Variable pacing — slow down for emphasis, speed up in energy
Genuine curiosity — "Oh, how many years is this anniversary?"
Unexpected warmth — birthday detected → flag for property team
Confident self-awareness about being AI, never apologetic
Humor — dry, appropriate, one moment per call max
Remember what was said earlier in the same call
04 — FlowPilot Signal → Tactic Engine
Signals Detected
Price objection + guest still engaged
→ ACCUSATION AUDIT
Dates + room confirmed, near payment stage
→ SCARCITY + COMMITMENT
Conversation drifting off-topic
→ SOFT REDIRECT
Silent >6s after price quoted
→ PAYMENT PLAN OFFER
Anniversary / birthday detected
→ PERSONALIZATION + FLAG PROPERTY
Price objection detected · Accusation Audit
Pre-empt the objection before they voice it
"You're probably thinking you can find a similar rate elsewhere — and you might. What you won't find is a 14th floor ocean view on a Saturday in June with two rooms left at this price."
High intent + available inventory low · Scarcity
Create urgency without pressure
"I want to make sure I hold this for you — we only have two of these rooms available for that weekend and they tend to go by Thursday."
Hesitation detected · Mirroring + Tactical Empathy
Repeat last words as question, label the emotion
"It sounds like you want to make sure this is the right choice for the trip. What would help you feel confident about moving forward?"
Booking near close · Loyalty pitch
Integrate loyalty as a value-add, not an add-on sell
"Since you're booking direct, you're also eligible for our Conquistador Club — complimentary enrollment, and your points start accumulating from this stay."
05 — Live Call Example (FlowPilot Intervention)
2:08
GUEST
"I love the Ocean Suite but honestly... $1,400 a night feels like a lot."
2:11
SIGNAL
⚠ Price objection detected. Funnel stage: Room Selected. Guest engaged (6 min). Inventory: 2 rooms remaining.
2:11
INJECT
Apply Accusation Audit. Guest is price-sensitive but engaged — do NOT offer discount. Mention 2 rooms remaining at this rate. Voice: slow down. Layer 3: they mentioned it's their anniversary — weave that in.
2:14
AGENT
"You're probably thinking you can find a similar rate somewhere else — and you might. What you won't find is a 14th floor Atlantic view in June for an anniversary, with two rooms left at this price. I want to make sure I hold this for you."
2:19
GUEST
"...Okay. Yeah, let's do it. How do we pay?"
2:20
SIGNAL
✅ Recovery successful. Funnel advancing to Payment stage. FlowPilot: Accusation Audit — CLOSED.
06 — Supervisor Intervention Levels
Supervisor → LiveKit Data Channel → Agent Worker → Injected next turn (<100ms latency)
💬
Whisper / Steer
Level 1 · Invisible
Type a directive in HQ. Agent reads it silently and adjusts next response. Guest hears nothing different. Agent just suddenly... knows what to do.
LiveKit Data Channel → Agent Worker queue → LLM injection
🤝
Take Over
Level 2 · Seamless
Supervisor unmutes microphone. Agent pipeline pauses. Supervisor speaks directly to guest. Supervisor mutes → agent resumes. Guest hears seamless transition.
LiveKit native multi-participant audio. Agent detects active supervisor track.
🔀
Transfer
Level 3 · Hard Exit
AI ends involvement. Guest routed to human agent. Full call context briefed to recipient before transfer completes. No cold handoff.
VAPI/LiveKit transfer → hotel PBX or human queue with context payload
07 — Frameworks Behind the Tactics
Never Split the Difference
Chris Voss — FBI Hostage Negotiation
Mirroring — repeat last 3 words as a question. Guest keeps talking, reveals the real objection.
Tactical Empathy — label the emotion before addressing it. "It sounds like you want to be sure this is worth it."
Accusation Audit — pre-empt objections before guest voices them. Disarms resistance.
Late Night FM DJ Voice — slow, low, calm. Directly maps to ElevenLabs voice tuning.
Unreasonable Hospitality
Will Guidara — Eleven Madison Park
The $2 Hot Dog Rule — the smallest gesture, perfectly timed, creates a customer for life. Detect the signal. Act on it unexpectedly.
See the Guest — not their order, not their room type. The person. Anniversary → acknowledge it. Birthday → flag for property.
Unreasonable Acts — don't follow the script. Go one step beyond what was asked. The AI's Layer 3.
The Charisma Myth
Olivia Fox Cabane — Engineerable Charisma
Presence — full attention, reference what the guest said 3 minutes ago. They feel heard.
Power — confident, knowledgeable, never hedging. "I think maybe..." kills trust. Eliminate it.
Warmth — genuine interest in the person, not the transaction. The AI asks a follow-up that wasn't required.
08 — FlowIntel: What the GM Sees From All This
Accusation Audit
74%
Recovery rate when applied after price objection (847 instances this month)
↑ +9pts vs last month — tactic improving with call volume
Scarcity Play
84%
Close rate on Fri/Sat calls when scarcity signal injected
⚠ Underperforms Sun/Mon (61%) — pattern flagged for review
Anniversary Detection
+31%
Upsell rate increase when anniversary referenced in close (vs not mentioned)
↑ Now triggered on every anniversary call automatically
Silent Pause (>6s)
67%
Close rate when payment plan immediately offered after 6s silence post-price
↑ New pattern, added to FlowPilot trigger library Mar 22