Setting Up Your AI Interview Agent
This guide walks you through how to create, customize, test, and launch end-to-end hiring workflows with AI recruiting agents in HeyMilo. Everything here is designed to help recruiters move fast, stay consistent, and build high-performing interview flows with confidence.
Before You Start
You'll need:
A job description or job posting URL
A clear understanding of what matters most in the role
Access to your HeyMilo dashboard
A general interview flow in mind (resume → SMS → voice/video, etc.)
Important: The job description is used to generate questions, but it does NOT get passed directly into the AI agent’s underlying conversation prompt. If you want the AI to reference specifics from your JD during the interview, add those details manually inside the correct Context sections during setup.
Step 1 Create a New Interviewer
Log in to your HeyMilo dashboard.
Click the "Create Interviewer" button on the left-hand sidebar.

This opens the New Interview Flow, where HeyMilo builds your custom interview experience.
Step 2 Generate Your Interview Plan
You’ll see the “Create an Interview Experience with a Job Description” screen.

You can:
Best for speed. HeyMilo parses it into core skills and responsibilities.
HeyMilo extracts the text automatically.
Good when you want inspiration or industry-standard questions.
Click Generate Interview Plan.
What HeyMilo does here:
Reads the JD
Identifies responsibilities, skills, and expectations
Creates a baseline interview plan
Generates recommended stages and high-quality questions
Note: The JD is used for plan creation only — not passed into the live conversation prompt.
Step 3 Set Basic Interview Info
Customize how the interviewer appears to candidates:

You’ll configure:
Interview URL Name
This becomes the candidate-facing link (e.g., gointerview.co/yourcompany/full-stack-engineer).
Best practices:
Use lowercase + hyphens
Keep it clear and searchable
Make it specific to the role and location
Examples:
fce-full-stack-engineersales-rep-nyc-2025warehouse-nightshift-denver
Avoid:
agent1testrandom strings
Changing this later changes the URL — so finalize before sharing.
Step 4 Build Your Interview Flow
You’ll now choose which screening stages to include.

Available agents:
Voice Interview (Sarah)
Resume Screening (Roscoe)
SMS Screening (Tyler)
Form Screening (Fred)
Drag stages into your workflow.
Cost Projector (Live Cost Breakdown)
As you add and reorder stages, HeyMilo shows a live cost projection for your interview flow so there are no surprises later.

The cost projector updates in real time and shows:
Cost per stage (SMS, Resume, Voice, Form)
Estimated total cost based on your workflow
Candidate drop-off assumptions between stages
How many candidates are expected to reach each step
This helps you quickly answer questions like:
What happens to cost if I add a voice interview?
Should SMS come before or after resume screening?
How much does this flow cost at scale?
You can drag stages around and immediately see how cost changes before moving forward. Optionally use this to decide on a budget in the later steps.
View Pricebook (Cost Preview)
Before moving on, click View Pricebook to see projected costs for your interview flow. Pricing updates automatically based on the agents and stages you add, helping you fine-tune your workflow before activation.

Essential Workflow Settings
These settings apply across your entire interview experience and control how candidates see, access, and complete the interview.
Agent Identity (Required)
Choose how your AI agents identify themselves to candidates.

Single Identity (Seamless Experience): One agent name is used across all interview stages. Best for a consistent, human experience.
Multiple Identities (Handoff Experience): Each interview stage can have its own agent name. Configure names directly within each workflow stage. Agent names appear on each stage card.
Default Interviewer Language
Select the primary language your AI interviewer will use.
Supports 15+ languages and dialects
Multilingual Auto-Detection:
The interview starts in the default language, then adapts automatically if the candidate responds in another language.
Timeline & Completion (Optional)
Interview Deadline
Set a hard cutoff date. Candidates cannot start or continue after this date.
Days to Complete
How long candidates have to finish once invited. Timely nudges, and a final reminder is sent before expiration.
Interview Retake Policy
Allow or block retakes if candidates don’t pass.
Communication & Branding (Optional)
Email Template Group
Customize candidate emails for branding or compliance.
Phone Number
Used for SMS and voice interviews (if enabled).
SMS Invitations
Send interview links and reminders via text when a phone number is available.
Email Report to Candidate
When enabled, candidates automatically receive an email with a link to view and download their interview report (PDF), which includes the same scoring and analysis your team sees.
Links & Redirects (Optional)
Scheduling Link
Shows a “Schedule Interview” button once candidates meet your criteria.
Redirect Link
Sends candidates to a specific page after they complete all interview stages.
Advanced Settings (Optional)
Used to give the AI deeper context and improve interview quality:
Company Information
Role Details
Hiring Process Overview
Interview Style & Approach
Sender Email (send from your own domain)
Click Preview anytime to see the candidate-facing design.
Why this matters: This step determines the order and logic of how candidates move through your process — the backbone of your AI recruiting workflow.
Step 5 Configure Your Desired Screening Stages
Voice / Video Interview Setup
This is your main conversational interview experience.
Settings Tab:
This controls how the interview runs and behaves.

Identity
Agent Name: pulled from Essential Settings (e.g. Sarah)
Voice: selected AI voice
Uses a unified identity across all stages unless overridden
Modality
Choose how candidates interview:
Voice
Video
Phone Calls (if numbers are provisioned)
You can enable multiple options if needed.
Experience
Show Transcript: optionally display a live transcript to candidates
Useful for accessibility and transparency. Transcripts are always saved internally.
Enable Cheat Detection: toggle detection on or off
Cheat Detection Controls
Detection Threshold (0–100): controls strictness
Detection Types:
Facial behaviour
Multiple people
Phone detection
AI/scripted answers
Unusual delays
Tab switching
AI Model
Standard Model: clear, predictable
Enhanced Model: smoother, interruption-aware
Advanced Model*:* most humanlike
Advanced (Visual + Behavior)

Backdrop: background for voice interviews
Avatar: interviewer visual
Response Timing (Before Speaking): Low = faster, High = more thoughtful
Response Timing (After Interruption): pause length after interruption
Max Reminders: number of nudges if the candidate goes silent
Silence Timeout: seconds before prompting again
Closing Guidance: default end-of-interview message
Conversation Tab:
This controls what the AI asks, how it evaluates, and how it speaks.

Structure
Number of Questions: 1–10 (5 recommended)
Sets how many questions will be auto-generated in the next step
Qualification Requirements
Enforce Objective Evaluation
Set a Minimum Score (0–100%) candidates must reach to pass
Messages
Optionally customize how the interviewer communicates:
Introduction Message
Welcome Back Message
Web Interview Closing Message
You can load defaults and use variables like:
{{name}}, {{interviewer_name}}, {{company_name}}, {{job_title}}
Context
Enable Context: shared across all stages (override per stage if needed)
Populate from JD (optional starting point)
Use Context to add:
core traits you’re screening for
required tools or experience
what “good” looks like for this role
hiring process details
Reminder: The full job description is not passed into the live conversation prompt unless you include key details here.
Conversation Style
Choose how the AI speaks:
Formal & Direct: structured, compliance-friendly
Balanced & Professional: most commonly used
Relaxed & Natural: conversational and warm
Resume Screening Setup

Configure:
Require resume upload (yes/no)
Number of required qualifications (1-8)
Pass/fail dealbreakers
1–10 scoring criteria
Minimum score to advance
Resume relevance signals
Perfect for filtering large applicant pools.
SMS Screening Setup
SMS Screening is optimized for fast, high-volume qualification and candidate engagement.

Quick Setup & Configuration Tab:
Prompt Version
V1 (legacy)
V3 (latest)
Includes custom messages, multilingual support, and advanced nudges
Structure
Number of Questions: 1, 3, or 6 (3 recommended)
Enforce Required Qualifications: auto-disqualify if criteria aren’t met
Customize Messages Tab:
Control exactly how candidates experience SMS conversations.

Intro Message
Sent when the conversation starts
Uses variables like:
{{name}}, {{interviewer_name}}, {{company_name}}, {{job_title}}
Call Invitation Message
Sent to qualified candidates to move them into a phone or voice interview
You can:
Load defaults
Customize copy
Let AI generate messages automatically (toggle on/off)
Context
Enable Context: shared across stages
Populate from JD (optional)
Give the agent guidance on interview style & approach, company information, role details, hiring process overview in this section.
Nudge & Timing Settings
Cooldown Period
Hours to wait before nudging a candidate (e.g. 24 hours)
Maximum Nudges
Max follow-ups per candidate (e.g. 3)
Blackout Period
Time window when messages should not be sent
Helps protect candidate experience and compliance across time zones
Form Screening Setup

Use structured form questions to collect:
Experience
Certifications
Availability
Files (e.g., licenses)
Numeric or date values
Dealbreakers can automatically move only qualified candidates forward.
Step 6 Preview The Flow You Built

Use Preview to confirm:
Flow order
Messages
Question relevance
Branding
Previews reduce errors and ensure a polished experience.
Step 7 Set Up Your Questions & Scoring (For Every Interview Stage)
This is one of the most important parts of setting up your interview experience.
Every agent type — Voice/Video, Resume, SMS, and Form Screening — includes a Questions & Scoring section.
This is where you define what good looks like and how the AI evaluates candidates.

⭐ What You Can Do in Questions & Scoring (All Agents)
Across every screening stage, you can:
Edit or Replace Any Auto-Generated Content
HeyMilo always generates a structured baseline for you:
5 core interview questions (Voice/Video)
Recommended resume criteria
Suggested SMS dealbreakers
Sample form intake questions
You can keep, edit, delete, or add your own.
Add New Questions or Criteria

Each question/criterion supports:
Scored (1–5 scoring)
Structured (pass/fail or expected-answer logic)
Weighted scoring (to prioritize certain questions)
Follow-up ranges (how many follow-up questions the AI should ask)
This lets you tailor evaluations to the job’s true requirements.
Customize Evaluation Criteria
For scored questions, define:
What a strong answer looks like
What a weak answer looks like
Additional instructions for the AI interviewer
For structured questions, define:
The correct answer
Accepted formats (YES/NO, numeric, multiple choice)
Minimum values or required selections
This ensures consistent scoring across candidates.
Use Required Qualifications (Auto-Disqualifiers)

You can mark certain items as dealbreakers, such as:
Work authorization
Years of experience
Certifications
Schedule/shift availability
If a candidate fails these, HeyMilo auto-disqualifies them and stops further stages (if enabled).
Works across:
Resume Screening
SMS Screening
Form Screening
Voice/Video (via structured questions)
Add Tags (Optional)

Tags listen in the background and help you surface specific information, to help you flag important candidate details such as:
Location
Work authorization
Certification
Salary expectations
Shift availability
Tags appear in the candidate’s report but do not affect scoring.
Test Your Questions Before Going Live

Click Test Now at the bottom of any Questions & Scoring section.
This allows you to experience:
how the AI asks your questions
how follow-ups behave
how scoring logic triggers
how candidates see the flow
If something feels unclear, you can revise questions immediately.
Step 8 Configure Email Alerts & Optional Budget

Email Subscribers
Team members receive a notification when interviews are completed.
Budget Allocation
Useful for predictable cost control.
You can set:
Total budget
Daily budget
Maximum interviews allowed
Protects cost during large hiring pushes.
Step 9 Activate & Share

After you click Create Interview & Generate Questions, you’ll now see all sharing and integration options in one place.
Interview Link
Your main candidate-facing URL to include in job ads, SMS, email outreach, or internal referrals.
Printable QR Poster
Generates a branded PDF with a QR code for walk-ins, hiring events, and on-site recruiting.
ATS Integration
Connect to Bullhorn, Avionté, JobDiva, Greenhouse, and more so candidates and completed interviews sync automatically.
Webhook Ingestion
A webhook URL is provided to automatically send candidates from internal systems, job boards, or automations (Zapier, Make, custom scripts).
Indeed Email Ingestion
A unique email address is generated for each interview. Add it to your Indeed job posting to auto-ingest all applicants into your pipeline and trigger interviews instantly.
Ingestion Gateway
A bulk import portal for uploading large candidate lists or migrating applicants from external sources (CSV upload, API-based ingestion, tagging options).
These ingestion methods ensure all candidates flow into your interview experience automatically, keeping your pipeline clean, fast, and fully automated.
What Happens Next?
You get a full candidate profile including:
Automatic Analysis: AI evaluates all responses
Scorecard Generation: Detailed candidate profiles created
Dashboard Updates: View candidate reports and updates in HeyMilo or your connected ATS
Team Collaboration: Share read-only reports with hiring teams or clients
Export Options: Download PDFs or share links for easy access and review
Notifications: Alerts when candidates complete interviews
Edit or Clone a Workflow After Candidates Have Started
Once candidates have completed an interview, HeyMilo locks that interview version to protect scoring consistency. This is intentional.
It ensures candidates are always evaluated against the same questions, criteria, and logic.
Here’s how it works:
When you can edit an interview directly
If no candidates have completed the interview yet
You can freely edit:
questions
scoring criteria
budget & notifications
Under Actions, you’ll see Edit Questions and configuration options available.

When you cannot edit an interview directly
Once one or more candidates complete the interview
Editing options are removed to preserve version integrity
This prevents:
mixed scoring logic
inconsistent evaluations
hard-to-explain results later
Cloning an Agent: Make Changes After Candidates Have Completed Interviews
If something feels off, or you'd like to edit the flow, or adjust questions or scoring, the correct workflow is to duplicate the interviewer.
Here’s what to do:
Go to an agent you want to clone
Click Actions
Select Duplicate Interviewer

Edit the questions, scoring, or stages in the duplicated version
Share or connect the new interview moving forward
Your original interview remains intact for earlier candidates. The new version applies only to future candidates.
Just don’t forget to unlink the previous agent, and reconnect the new interviewer to your ATS if you were using one!
Why HeyMilo Works This Way
This approach keeps your hiring process:
fair
auditable
easy to explain to stakeholders
safe for ATS syncing and reporting
Note: If you clone an agent and decide to change the job description, it won’t auto-update the interview, so you’ll need to regenerate or adjust the content manually. Cloning preserves the original questions and messaging.
Common First-Time Tips
✅ Start Simple
Begin with 5-7 core questions
Add complexity as you get comfortable
Focus on your most important requirements
✅ Test Thoroughly
Complete the interview yourself first
Ask a colleague to test it
Refine based on the experience
✅ Monitor Early Results
Review your first 5-10 candidates carefully
Create a new agent and adjust scoring criteria if needed
Fine-tune questions based on responses if needed
✅ Iterate and Improve
Your first agent won’t be perfect. Once candidates complete your workflow, you’ll need to duplicate the interview to make changes. This preserves scoring consistency while letting you iterate safely.
Use candidate feedback to improve
Continuously refine your approach
Common Configuration Mistakes to Avoid
❌ Too Many Questions
Limit to 5-7 core questions initially
Long interviews reduce completion rates
Focus on most critical qualifications
❌ Unclear Instructions
Provide clear guidance to candidates
Explain the process and expectations
Include technical requirements
❌ Overly Restrictive Knockout Criteria
Don't eliminate good candidates unnecessarily
Consider "preferred" vs "required" qualifications
Allow for equivalent experience
❌ Inconsistent Scoring
Ensure scoring criteria align with job requirements
Weight questions appropriately
Test scoring with sample responses
Remember: You can only modify your agent settings after creation when candidates haven't interacted with it yet. Alternatively, you can clone your agent to keep the same settings. It's important to start with a good foundation and refine based on real candidate interactions.
Last updated