# Crafting Compelling Interview Questions

> Learn how to craft effective interview questions to find the best candidates, with tips, examples, and customization tools to make your interviews more insightful and efficient!

The quality of your interview questions directly impacts the quality of candidates you identify. HeyMilo automatically generates interview questions for every role. You can review, edit, reorder, or replace these questions at any time.

This guide shows you how to review, refine, and customize those questions to get stronger signal from candidates

## AI-Generated or Custom Questions

{% tabs %}
{% tab title="🤖 Let AI Generate Questions " %}
Our AI can automatically create relevant questions based on your job description:

* **Saves time** - Questions ready in seconds
* **Industry-specific** - Tailored to your role and sector
* **Best practices** - Based on successful interview patterns
* **Comprehensive coverage** - Ensures all key areas are addressed
  {% endtab %}

{% tab title="✏️ Craft Your Own Questions" %}
For more control and customization you can add your own questions or start from scratch:

* **Company-specific scenarios** - Use your actual challenges
* **Unique requirements** - Address specialized skills
* **Cultural fit** - Reflect your company values
* **Proven questions** - Use your most successful interview questions
  {% endtab %}
  {% endtabs %}

<details>

<summary>Editing AI-Generated Questions</summary>

HeyMilo automatically generates a starter set of interview questions for every role, typically beginning with five questions for voice or video interviews.

You can customize AI-generated questions at any time to better match your role and expectations:

* **Edit the question text** to make it more specific, concise, or role-relevant
* **Adjust tone or openness** to encourage more detailed or more direct responses
* **Regenerate evaluation guidance** if the question intent changes
* **Reorder or remove questions** to control interview flow

<figure><img src="/files/xCzhmaERHFrikHKvHHex" alt=""><figcaption></figcaption></figure>

AI-generated questions are designed as a strong baseline. Most teams get the best results by refining wording and examples rather than starting from scratch.

</details>

{% hint style="success" %}
**Recommendation**: Start with AI-generated questions, then customize based on your specific needs and experience.
{% endhint %}

### Re-use Existing Questions

When adding questions to your agent, you can pull from questions you've already created in other agents.

1. In the **Questions & Scoring** step, click **Re-use Existing Question**
2. The Question Library drawer opens, showing questions from your workspace
3. Search or browse questions by type (voice, SMS, resume, form)
4. Click a question to add it to your current agent

Questions are automatically saved to your library as you create agents—no extra steps needed.

{% hint style="info" %}
**Tip:** This is useful when you frequently assess the same skills across roles (e.g., communication, problem-solving) and want consistent questions.
{% endhint %}

## Types of Effective Interview Questions & Examples

<details>

<summary>💬 Competency-Based Questions</summary>

Focus on specific skills and abilities required for the role.

**Examples:**

* "Describe a time when you had to learn a new technology quickly. How did you approach it?"
* "Tell me about a project where you had to work with a difficult team member."
* "Give me an example of how you've handled a tight deadline."

**Best for:**

* Technical roles
* Skill-specific positions
* Experience validation

</details>

<details>

<summary>💬 Behavioral Questions</summary>

Explore past experiences to predict future performance.

**Examples:**

* "Tell me about a time when you had to work under pressure. How did you manage it?"
* "Describe a situation where you had to persuade someone to see your point of view."
* "Give me an example of a mistake you made and how you handled it."

**Best for:**

* Leadership roles
* Customer-facing positions
* Team collaboration assessment

</details>

<details>

<summary>💬 Situational Questions</summary>

Present hypothetical scenarios to assess problem-solving skills.

**Examples:**

* "What would you do if you were faced with a tight deadline and multiple conflicting priorities?"
* "How would you handle a situation where a client was unhappy with your service?"
* "If you discovered a process that could save the company money, how would you present it?"

**Best for:**

* Management positions
* Problem-solving roles
* Decision-making assessment

</details>

<details>

<summary>💬 Technical Questions</summary>

Assess specific technical knowledge and skills.

**Examples:**

* "Explain how you would approach debugging a performance issue in a web application."
* "Describe your experience with \[specific software/tool/methodology]."
* "Walk me through how you would design a solution for \[specific technical challenge]."

**Best for:**

* Engineering roles
* Specialized technical positions
* Skills verification

</details>

<details>

<summary>💬 Cultural Fit Questions</summary>

Understand how candidates align with your team values and ways of working.

**Examples**:

* "What type of work environment helps you do your best work?"
* "How do you approach giving and receiving feedback?"
* "What do you value most in a team culture?"

**Best for**:

* Company values alignment
* Team fit
* Communication and collaboration styles

</details>

## Question Crafting Best Practices

<details>

<summary>✅ Make Questions Open-Ended</summary>

* **Good**: "Tell me about a challenging project you worked on."
* **Avoid**: "Have you worked on challenging projects?" (Yes/No answer)

</details>

<details>

<summary>✅ Be Specific</summary>

* **Good**: "Describe how you prioritize tasks when managing multiple deadlines."
* **Avoid**: "How do you manage your time?" (Too vague)

</details>

<details>

<summary>✅ Focus on Examples</summary>

* **Good**: "Give me a specific example of when you improved a process."
* **Avoid**: "Do you like improving processes?" (Hypothetical)

</details>

<details>

<summary>✅ Use the STAR Method Framework</summary>

Encourage candidates to structure responses using:

* **Situation**: Context and background
* **Task**: What needed to be accomplished
* **Action**: Steps they took
* **Result**: Outcome and impact

</details>

<details>

<summary>✅ Avoid Leading Questions</summary>

* **Good**: "How do you handle conflict in the workplace?"
* **Avoid**: "You're good at handling conflict, right?" (Suggests desired answer)

</details>

<details>

<summary>✅ Write for How It Will Sound</summary>

* **Good**: Spell words correctly, use natural phrasing, and test how the question sounds in TTS.
* **Avoid**: Typos, awkward wording, or symbols that could be mispronounced or confuse candidates.

</details>

## Customizing Follow-Ups

Each voice or video interview question can include smart follow-up questions that adapt to the candidate’s response.

Follow-ups help clarify vague answers and encourage candidates to expand when more detail is needed.

<figure><img src="/files/f5aRncVGrY4djQ1edGiP" alt=""><figcaption></figcaption></figure>

You can:

* **Set a follow-up range** using the slider (for example, 0–1 or up to 5 follow-ups)
* **Control depth per question**, allowing more probing only where it matters
* **Keep interviews balanced**—the UI will warn you if too many follow-ups may impact candidate experience or performance

<figure><img src="/files/ymbDsCwhegip35walVBq" alt="" width="375"><figcaption></figcaption></figure>

**How follow-ups work:**

* Follow-ups are generated dynamically based on what the candidate says
* The slider sets a maximum range, not a guaranteed number
* Follow-ups are optional and never required

**Best practice:**\
Start with 0–1 follow-ups for most questions. Increase only for questions where additional context is critical. Always test before going live to ensure the pacing feels natural.

## Setting Up Scoring Criteria

<details>

<summary>🎯 Define What Good Looks Like</summary>

Ex. For each question, establish:

* **Excellent Response** (9-10 points): Specific criteria for top answers
* **Good Response** (7-8 points): Solid but not exceptional answers
* **Average Response** (5-6 points): Meets basic requirements
* **Poor Response** (1-4 points): Inadequate or concerning answers

</details>

<details>

<summary>🎯 Weight Questions Appropriately</summary>

* **Critical Skills**: 25-30% of total score
* **Important Skills**: 15-20% of total score
* **Nice-to-Have Skills**: 5-10% of total score

</details>

<details>

<summary>🎯 Include Knockout Criteria</summary>

Set automatic disqualifiers for:

* **Required Experience**: Minimum years in specific areas
* **Essential Skills**: Must-have technical competencies
* **Legal Requirements**: Certifications, licenses, work authorization
* **Cultural Misalignment**: Values conflicts

</details>

## Question Weight Distribution

When your questions have different score weights, a **Question Weight Distribution** pie chart appears below your questions list. This gives you a visual breakdown of how much each question contributes to the candidate's overall score.

<figure><img src="/files/LFKiy58fCZ422VbWP2l4" alt="" width="375"><figcaption></figcaption></figure>

Each segment of the pie chart represents one scored question. The size of the segment shows its relative weight compared to other questions.

<details>

<summary><strong>How to use the chart</strong></summary>

* **Hover** over any segment to see the question text and its weight value
* **Click** a segment to jump directly to that question in the list
* Percentage labels appear on segments large enough to display them

</details>

<details>

<summary><strong>When does the chart appear?</strong></summary>

The pie chart only appears when:

* You have at least one scored question (questions marked as "not scored" are excluded)
* Your questions have **different** weight values

If all scored questions have equal weight, the chart is hidden since every question contributes equally.

</details>

<details>

<summary><strong>Why this matters</strong></summary>

The pie chart helps you quickly spot if your weights match your priorities:

* Is a critical skills question getting enough weight?
* Is a nice-to-have question accidentally weighted too high?
* Are your weights balanced the way you intended?

If the visual breakdown doesn't match your hiring priorities, adjust the score weights on individual questions until the distribution looks right.

</details>

{% hint style="success" %}
**Tip:** Use the pie chart as a gut check before going live. If your most important question is a tiny sliver, bump its weight. If a minor question dominates the chart, dial it back.
{% endhint %}

## Question Optimization Tips

<details>

<summary>💬 Start Simple</summary>

* Begin with 5-7 core questions
* Add complexity as you gain experience
* Focus on your most important requirements

</details>

<details>

<summary>💬 Test and Iterate</summary>

* Review candidate responses regularly
* Identify questions that don't provide useful insights
* Refine scoring criteria based on hiring outcomes

</details>

<details>

<summary>💬 Get Team Input</summary>

* Involve hiring managers in question development
* Use successful interview questions from your team
* Align questions with actual job requirements

</details>

<details>

<summary>💬 Monitor Performance</summary>

* Track which questions best predict success
* Adjust weightings based on hiring results
* Remove questions that don't differentiate candidates

</details>

## Leveraging Data and Insights

<details>

<summary>📊 Use Historical Data</summary>

* Analyze your most successful hires
* Identify common traits and experiences
* Incorporate insights into question design

</details>

<details>

<summary>📊 Industry Benchmarks</summary>

* Research best practices for your industry
* Use proven question frameworks
* Adapt successful approaches to your context

</details>

<details>

<summary>📊 Continuous Improvement</summary>

* Regularly review question effectiveness
* Update questions based on role evolution
* Stay current with industry trends

</details>

{% hint style="success" %}
**Pro Tip**: The best interview questions are those that help you predict on-the-job success. Focus on behaviors and experiences that directly relate to the role requirements.
{% endhint %}

## Ready to Configure Scoring?

Once you've crafted compelling questions, the next step is setting up scoring criteria that helps you identify top candidates quickly and objectively. We'll show you how to weight different factors and create scoring rubrics that align with your hiring goals.

Remember: Great questions are just the beginning. The real power comes from consistent evaluation criteria that help you make data-driven hiring decisions.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.admin.heymilo.ai/creating-your-interview-agents/setup/questions.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.