Setting Up Your AI Interview Agent

This guide walks you through how to create, customize, test, and launch end-to-end hiring workflows with AI recruiting agents in HeyMilo. Everything here is designed to help recruiters move fast, stay consistent, and build high-performing interview flows with confidence.

Before You Start

You'll need:

  • A job description or job posting URL

  • A clear understanding of what matters most in the role

  • Access to your HeyMilo dashboard

  • A general interview flow in mind (resume → SMS → voice/video, etc.)

circle-check
1

Step 1 Create a New Interviewer

Log in to your HeyMilo dashboard.

  • Click the "Create Interviewer" button on the left-hand sidebar.

This opens the New Interview Flow, where HeyMilo builds your custom interview experience.

2

Step 2 Generate Your Interview Plan

You’ll see the “Create an Interview Experience with a Job Description” screen.

You can:

Best for speed. HeyMilo parses it into core skills and responsibilities.

Click Generate Interview Plan.

What HeyMilo does here:

  • Reads the JD

  • Identifies responsibilities, skills, and expectations

  • Creates a baseline interview plan

  • Generates recommended stages and high-quality questions

circle-check
3

Step 3 Set Basic Interview Info

Customize how the interviewer appears to candidates:

You’ll configure:

chevron-rightInterview URL Namehashtag

This becomes the candidate-facing link (e.g., gointerview.co/yourcompany/full-stack-engineer).

Best practices:

  • Use lowercase + hyphens

  • Keep it clear and searchable

  • Make it specific to the role and location

Examples:

  • fce-full-stack-engineer

  • sales-rep-nyc-2025

  • warehouse-nightshift-denver

Avoid:

  • agent1

  • test

  • random strings

Changing this later changes the URL — so finalize before sharing.

chevron-rightPosition Titlehashtag

Auto-filled from your JD, but editable.

Click Continue to Interview Workflow.

Why this matters:

A clean URL and correct job title improve candidate trust and reduce drop-off.

4

Step 4 Build Your Interview Flow

You’ll now choose which screening stages to include.

Available agents:

  • Voice Interview (Sarah)

  • Resume Screening (Roscoe)

  • SMS Screening (Tyler)

  • Form Screening (Fred)

Drag stages into your workflow.

chevron-rightExample workflowshashtag
  • Resume → Voice Interview

  • SMS → Phone

  • Resume → SMS → Voice

  • Form → Resume → Voice

chevron-rightCost Projector (Live Cost Breakdown)hashtag

As you add and reorder stages, HeyMilo shows a live cost projection for your interview flow so there are no surprises later.

The cost projector updates in real time and shows:

  • Cost per stage (SMS, Resume, Voice, Form)

  • Estimated total cost based on your workflow

  • Candidate drop-off assumptions between stages

  • How many candidates are expected to reach each step

This helps you quickly answer questions like:

  • What happens to cost if I add a voice interview?

  • Should SMS come before or after resume screening?

  • How much does this flow cost at scale?

You can drag stages around and immediately see how cost changes before moving forward. Optionally use this to decide on a budget in the later steps.

chevron-rightView Pricebook (Cost Preview)hashtag

Before moving on, click View Pricebook to see projected costs for your interview flow. Pricing updates automatically based on the agents and stages you add, helping you fine-tune your workflow before activation.

chevron-rightEssential Workflow Settingshashtag

These settings apply across your entire interview experience and control how candidates see, access, and complete the interview.

Agent Identity (Required)

Choose how your AI agents identify themselves to candidates.

  • Single Identity (Seamless Experience): One agent name is used across all interview stages. Best for a consistent, human experience.

  • Multiple Identities (Handoff Experience): Each interview stage can have its own agent name. Configure names directly within each workflow stage. Agent names appear on each stage card.

Default Interviewer Language

Select the primary language your AI interviewer will use.

  • Supports 15+ languages and dialects

  • Multilingual Auto-Detection:

    The interview starts in the default language, then adapts automatically if the candidate responds in another language.

Timeline & Completion (Optional)

  • Interview Deadline

    Set a hard cutoff date. Candidates cannot start or continue after this date.

  • Days to Complete

    How long candidates have to finish once invited. Timely nudges, and a final reminder is sent before expiration.

  • Interview Retake Policy

    Allow or block retakes if candidates don’t pass.

Communication & Branding (Optional)

  • Email Template Group

    Customize candidate emails for branding or compliance.

  • Phone Number

    Used for SMS and voice interviews (if enabled).

  • SMS Invitations

    Send interview links and reminders via text when a phone number is available.

  • Email Report to Candidate

    When enabled, candidates automatically receive an email with a link to view and download their interview report (PDF), which includes the same scoring and analysis your team sees.

Links & Redirects (Optional)

  • Scheduling Link

    Shows a “Schedule Interview” button once candidates meet your criteria.

  • Redirect Link

    Sends candidates to a specific page after they complete all interview stages.

Advanced Settings (Optional)

Used to give the AI deeper context and improve interview quality:

  • Company Information

  • Role Details

  • Hiring Process Overview

  • Interview Style & Approach

  • Sender Email (send from your own domain)

Click Preview anytime to see the candidate-facing design.

circle-check
5

Step 5 Configure Your Desired Screening Stages

Voice / Video Interview Setup

This is your main conversational interview experience.

Settings Tab:

This controls how the interview runs and behaves.

chevron-rightIdentityhashtag
  • Agent Name: pulled from Essential Settings (e.g. Sarah)

  • Voice: selected AI voice

  • Uses a unified identity across all stages unless overridden

chevron-rightModalityhashtag

Choose how candidates interview:

  • Voice

  • Video

  • Phone Calls (if numbers are provisioned)

You can enable multiple options if needed.

chevron-rightExperiencehashtag
  • Show Transcript: optionally display a live transcript to candidates

Useful for accessibility and transparency. Transcripts are always saved internally.

  • Enable Cheat Detection: toggle detection on or off

chevron-rightCheat Detection Controlshashtag
  • Detection Threshold (0–100): controls strictness

  • Detection Types:

    • Facial behaviour

    • Multiple people

    • Phone detection

    • AI/scripted answers

    • Unusual delays

    • Tab switching

chevron-rightAI Modelhashtag
  • Standard Model: clear, predictable

  • Enhanced Model: smoother, interruption-aware

  • Advanced Model*:* most humanlike

chevron-rightAdvanced (Visual + Behavior)hashtag
  • Backdrop: background for voice interviews

  • Avatar: interviewer visual

  • Response Timing (Before Speaking): Low = faster, High = more thoughtful

  • Response Timing (After Interruption): pause length after interruption

  • Max Reminders: number of nudges if the candidate goes silent

  • Silence Timeout: seconds before prompting again

  • Closing Guidance: default end-of-interview message

Conversation Tab:

This controls what the AI asks, how it evaluates, and how it speaks.

chevron-rightStructurehashtag
  • Number of Questions: 1–10 (5 recommended)

  • Sets how many questions will be auto-generated in the next step

chevron-rightQualification Requirementshashtag
  • Enforce Objective Evaluation

  • Set a Minimum Score (0–100%) candidates must reach to pass

chevron-rightMessageshashtag

Optionally customize how the interviewer communicates:

  • Introduction Message

  • Welcome Back Message

  • Web Interview Closing Message

You can load defaults and use variables like:

{{name}}, {{interviewer_name}}, {{company_name}}, {{job_title}}

chevron-rightContexthashtag
  • Enable Context: shared across all stages (override per stage if needed)

  • Populate from JD (optional starting point)

Use Context to add:

  • core traits you’re screening for

  • required tools or experience

  • what “good” looks like for this role

  • hiring process details

circle-exclamation
chevron-rightConversation Stylehashtag

Choose how the AI speaks:

  • Formal & Direct: structured, compliance-friendly

  • Balanced & Professional: most commonly used

  • Relaxed & Natural: conversational and warm

Resume Screening Setup

Configure:

  • Require resume upload (yes/no)

  • Number of required qualifications (1-8)

  • Pass/fail dealbreakers

  • 1–10 scoring criteria

  • Minimum score to advance

  • Resume relevance signals

Perfect for filtering large applicant pools.

SMS Screening Setup

SMS Screening is optimized for fast, high-volume qualification and candidate engagement.

Quick Setup & Configuration Tab:

chevron-rightPrompt Versionhashtag
  • V1 (legacy)

  • V3 (latest)

    Includes custom messages, multilingual support, and advanced nudges

chevron-rightPhone Numberhashtag

Pulled from Interview Stages or Essential Settings

chevron-rightMultilingualhashtag

Enabled from Essential Settings (if configured)

chevron-rightAgent Namehashtag

Uses unified name from Essential Settings

chevron-rightStructurehashtag
  • Number of Questions: 1, 3, or 6 (3 recommended)

  • Enforce Required Qualifications: auto-disqualify if criteria aren’t met

Customize Messages Tab:

Control exactly how candidates experience SMS conversations.

chevron-rightIntro Messagehashtag

Sent when the conversation starts

Uses variables like:

{{name}}, {{interviewer_name}}, {{company_name}}, {{job_title}}

chevron-rightDisqualification Messagehashtag

Sent when a candidate fails knockout criteria

chevron-rightFollow-up Messagehashtag

Used to nudge candidates who haven’t responded

chevron-rightCall Invitation Messagehashtag

Sent to qualified candidates to move them into a phone or voice interview

You can:

  • Load defaults

  • Customize copy

  • Let AI generate messages automatically (toggle on/off)

chevron-rightContexthashtag
  • Enable Context: shared across stages

  • Populate from JD (optional)

Give the agent guidance on interview style & approach, company information, role details, hiring process overview in this section.

chevron-rightNudge & Timing Settingshashtag

Cooldown Period

  • Hours to wait before nudging a candidate (e.g. 24 hours)

Maximum Nudges

  • Max follow-ups per candidate (e.g. 3)

Blackout Period

  • Time window when messages should not be sent

    Helps protect candidate experience and compliance across time zones

Form Screening Setup

Use structured form questions to collect:

  • Experience

  • Certifications

  • Availability

  • Files (e.g., licenses)

  • Numeric or date values

Dealbreakers can automatically move only qualified candidates forward.

6

Step 6 Preview The Flow You Built

Use Preview to confirm:

  • Flow order

  • Messages

  • Question relevance

  • Branding

Previews reduce errors and ensure a polished experience.

7

Step 7 Set Up Your Questions & Scoring (For Every Interview Stage)

This is one of the most important parts of setting up your interview experience.

Every agent type — Voice/Video, Resume, SMS, and Form Screening — includes a Questions & Scoring section.

This is where you define what good looks like and how the AI evaluates candidates.

⭐ What You Can Do in Questions & Scoring (All Agents)

Across every screening stage, you can:

chevron-rightEdit or Replace Any Auto-Generated Contenthashtag

HeyMilo always generates a structured baseline for you:

  • 5 core interview questions (Voice/Video)

  • Recommended resume criteria

  • Suggested SMS dealbreakers

  • Sample form intake questions

You can keep, edit, delete, or add your own.

chevron-rightAdd New Questions or Criteriahashtag

Each question/criterion supports:

  • Scored (1–5 scoring)

  • Structured (pass/fail or expected-answer logic)

  • Weighted scoring (to prioritize certain questions)

  • Follow-up ranges (how many follow-up questions the AI should ask)

This lets you tailor evaluations to the job’s true requirements.

chevron-rightCustomize Evaluation Criteriahashtag

For scored questions, define:

  • What a strong answer looks like

  • What a weak answer looks like

  • Additional instructions for the AI interviewer

For structured questions, define:

  • The correct answer

  • Accepted formats (YES/NO, numeric, multiple choice)

  • Minimum values or required selections

This ensures consistent scoring across candidates.

chevron-rightUse Required Qualifications (Auto-Disqualifiers)hashtag

You can mark certain items as dealbreakers, such as:

  • Work authorization

  • Years of experience

  • Certifications

  • Schedule/shift availability

If a candidate fails these, HeyMilo auto-disqualifies them and stops further stages (if enabled).

Works across:

  • Resume Screening

  • SMS Screening

  • Form Screening

  • Voice/Video (via structured questions)

chevron-rightAdd Tags (Optional)hashtag

Tags listen in the background and help you surface specific information, to help you flag important candidate details such as:

  • Location

  • Work authorization

  • Certification

  • Salary expectations

  • Shift availability

Tags appear in the candidate’s report but do not affect scoring.

chevron-rightTest Your Questions Before Going Livehashtag

Click Test Now at the bottom of any Questions & Scoring section.

This allows you to experience:

  • how the AI asks your questions

  • how follow-ups behave

  • how scoring logic triggers

  • how candidates see the flow

If something feels unclear, you can revise questions immediately.

8

Step 8 Configure Email Alerts & Optional Budget

Email Subscribers

  • Team members receive a notification when interviews are completed.

Budget Allocation

  • Useful for predictable cost control.

You can set:

  • Total budget

  • Daily budget

  • Maximum interviews allowed

Protects cost during large hiring pushes.

9

Step 9 Activate & Share

After you click Create Interview & Generate Questions, you’ll now see all sharing and integration options in one place.

chevron-rightPrintable QR Posterhashtag

Generates a branded PDF with a QR code for walk-ins, hiring events, and on-site recruiting.

chevron-rightATS Integrationhashtag

Connect to Bullhorn, Avionté, JobDiva, Greenhouse, and more so candidates and completed interviews sync automatically.

chevron-rightWebhook Ingestionhashtag

A webhook URL is provided to automatically send candidates from internal systems, job boards, or automations (Zapier, Make, custom scripts).

chevron-rightIndeed Email Ingestionhashtag

A unique email address is generated for each interview. Add it to your Indeed job posting to auto-ingest all applicants into your pipeline and trigger interviews instantly.

chevron-rightIngestion Gatewayhashtag

A bulk import portal for uploading large candidate lists or migrating applicants from external sources (CSV upload, API-based ingestion, tagging options).

These ingestion methods ensure all candidates flow into your interview experience automatically, keeping your pipeline clean, fast, and fully automated.

What Happens Next?

You get a full candidate profile including:

  1. Automatic Analysis: AI evaluates all responses

  2. Scorecard Generation: Detailed candidate profiles created

  3. Dashboard Updates: View candidate reports and updates in HeyMilo or your connected ATS

  4. Team Collaboration: Share read-only reports with hiring teams or clients

  5. Export Options: Download PDFs or share links for easy access and review

  6. Notifications: Alerts when candidates complete interviews

Edit or Clone a Workflow After Candidates Have Started

Once candidates have completed an interview, HeyMilo locks that interview version to protect scoring consistency. This is intentional.

It ensures candidates are always evaluated against the same questions, criteria, and logic.

Here’s how it works:

chevron-rightWhen you can edit an interview directlyhashtag
  • If no candidates have completed the interview yet

  • You can freely edit:

    • questions

    • scoring criteria

    • budget & notifications

Under Actions, you’ll see Edit Questions and configuration options available.

chevron-rightWhen you cannot edit an interview directlyhashtag
  • Once one or more candidates complete the interview

  • Editing options are removed to preserve version integrity

This prevents:

  • mixed scoring logic

  • inconsistent evaluations

  • hard-to-explain results later

Cloning an Agent: Make Changes After Candidates Have Completed Interviews

If something feels off, or you'd like to edit the flow, or adjust questions or scoring, the correct workflow is to duplicate the interviewer.

Here’s what to do:

  1. Go to an agent you want to clone

  2. Click Actions

  3. Select Duplicate Interviewer

  1. Edit the questions, scoring, or stages in the duplicated version

  2. Share or connect the new interview moving forward

Your original interview remains intact for earlier candidates. The new version applies only to future candidates.

Just don’t forget to unlink the previous agent, and reconnect the new interviewer to your ATS if you were using one!

chevron-rightWhy HeyMilo Works This Wayhashtag

This approach keeps your hiring process:

  • fair

  • auditable

  • easy to explain to stakeholders

  • safe for ATS syncing and reporting

circle-check

Common First-Time Tips

chevron-right✅ Start Simplehashtag
  • Begin with 5-7 core questions

  • Add complexity as you get comfortable

  • Focus on your most important requirements

chevron-right✅ Test Thoroughlyhashtag
  • Complete the interview yourself first

  • Ask a colleague to test it

  • Refine based on the experience

chevron-right✅ Monitor Early Resultshashtag
  • Review your first 5-10 candidates carefully

  • Create a new agent and adjust scoring criteria if needed

  • Fine-tune questions based on responses if needed

chevron-right✅ Iterate and Improvehashtag
  • Your first agent won’t be perfect. Once candidates complete your workflow, you’ll need to duplicate the interview to make changes. This preserves scoring consistency while letting you iterate safely.

  • Use candidate feedback to improve

  • Continuously refine your approach

Common Configuration Mistakes to Avoid

chevron-right❌ Too Many Questionshashtag
  • Limit to 5-7 core questions initially

  • Long interviews reduce completion rates

  • Focus on most critical qualifications

chevron-right❌ Unclear Instructionshashtag
  • Provide clear guidance to candidates

  • Explain the process and expectations

  • Include technical requirements

chevron-right❌ Overly Restrictive Knockout Criteriahashtag
  • Don't eliminate good candidates unnecessarily

  • Consider "preferred" vs "required" qualifications

  • Allow for equivalent experience

chevron-right❌ Inconsistent Scoringhashtag
  • Ensure scoring criteria align with job requirements

  • Weight questions appropriately

  • Test scoring with sample responses

circle-exclamation

Last updated