Example content; the people and companies are fictional. In real use, guides and debriefs are built from your own resume, the JD, and your notes from every round.
Forward Deployed Engineer · Round 1 · Technical + customer
This round checks whether you can carry a customer from pilot to production on your own
The JD wants someone who faces enterprise customers alone and takes LLM apps to production. A senior FDE or delivery lead will mix pipeline, evals and access control with customer scenarios. Strength: a hands-on pilot over 3,000 docs. Risk: it didn't convert, and a fuzzy reason reads as demo only
Most likely a senior FDE or delivery lead who has done on-site projects. Half the time on technical detail to confirm you built it yourself, half on customer scenarios to see how you handle them. What they care about most: can you own a customer alone and get past the pilot
Candidate: 3 years: 2 in backend API work and 1 in solutions at an enterprise software company (fictional). Last year ran an internal knowledge assistant pilot for an equipment manufacturer (fictional): ~3,000 manuals and process docs, retrieval-augmented generation. After the 4-week pilot, the customer didn't sign a full contract
Show the job description
What this round really tests
How far the pilot really got
how data came in, how access was controlled, how quality was measured. Fuzzy on these three and you get filed as "demo only"
Source · Resume: “knowledge assistant”Source · JD item 2Evals
how many cases, where they came from, who labeled them, and how wrong answers were traced to retrieval vs. generation
Source · JD item 6Facing the customer
how you set scope and acceptance criteria when requirements are vague and expectations are too high
Source · JD item 7Why the pilot didn't convert. They will ask. This is the most important question of the round
Source · Resume: “full contract”How you measure success after launch
not model metrics, but what the customer's business saved
Source · JD item 3
Know the business
Concepts to brush up on
| Concept | What it is | Where it comes up |
|---|---|---|
| Retrieval-augmented generation Source · JD item 1 | Retrieve relevant passages from the customer's documents first, then have the model answer from them | When an answer is wrong you need to tell retrieval problems from generation problems |
| On-premise deployment Source · JD item 2 | Model and app run on the customer's own servers; data never leaves their network | Manufacturers care most that data stays inside; it's a precondition for the deal |
| Acceptance criteria Source · JD item 1 | Agree up front which questions get scored and what score counts as a pass | Pilots often fail to convert because this was never agreed |
| Pilot conversion | Of customers who ran a pilot, how many signed a full project | Revenue at companies like this depends on it, and they'll ask about your pilot |
Business points that earn credit Ideas you can raise
Enterprise LLM application companies usually open accounts with pilots; the real revenue is the full project and renewal after
Work it in When you talk about the pilot, say how you'd set it up to convert
Check · Customer stories on their siteProducts at companies like this are typically still moving from custom projects to something standard, so patterns an FDE brings back are valuable
Work it in Name one issue from your pilot that could become a product feature
Check · Ratio of product to FDE roles on their careers pageManufacturing customers usually have long decision chains: the business side wants it, IT and security have to sign off
Work it in When requirements are unclear, say how you'd align business and IT at once
Check · Ask which industries the team mostly serves
Questions they may follow with · 3
- The customer wants an accuracy the model can't reach. What do you do?AngleFind which questions fail first, then talk scope and fallbacks
- Which customers shouldn't get a pilot?AngleThink about data readiness, a business owner, and whether a pass line can be agreed
- As general models get stronger, will the FDE role disappear?AngleBe clear about what models can't replace: the customer's process, data and trust
Industry and company points are AI inferences. Check them before the interview
Your opening minute
They will ask why the pilot didn't convert. Raise it yourself with the lesson and you look clear-eyed, not cornered
Likely questions and how to answer
01Walk me through your knowledge assistant pilot, from data ingestion to a user's question
What they want to know
They're confirming you built it, not watched. They'll pick one step and keep drilling: chunking, tables, scanned docs
How to answer
Open with the business goal: field engineers dig through thousands of pages to troubleshoot; the goal was to cut lookup time. Then walk the pipeline with one decision per step: parsing (OCR for scans, tables extracted as structured data), chunking (by heading hierarchy, not fixed length, and why), retrieval (hybrid vector + keyword, because model codes match poorly on vectors), generation (must cite source passages). Have one war story per step
02How did you evaluate quality? How did you build the eval set?
What they want to know
This is where people who shipped and people who demoed split apart. No eval set and they'll assume the project never left the demo stage
How to answer
Cover size, source, labeling, grading, attribution. E.g. 200 real questions from the customer's engineers, answer keys written by two of their engineers, graded as correct / partial / wrong / should have refused. Then attribution: did retrieval surface the right passage? If not, retrieval bug; if yes but still wrong, generation bug. Fix them separately. If you didn't go this deep, say how far you got and what you'd add
03The customer's docs are split by department and clearance level. How do you handle permissions?
What they want to know
Every enterprise launch gets stuck here. They want to know you enforce permissions at retrieval, not by filtering after generation
How to answer
Principle first: permissions travel with the document, never delegated to the model. Tag every chunk with department and clearance at ingestion; at query time filter by the user's identity before retrieval, so restricted content never enters the context. Two details: syncing permission changes from the customer's org directory, and query logs for audit. Be upfront on gaps, e.g. "the pilot only split by department; clearance levels were phase two"
04The customer says it has to be 100% accurate. How do you respond?
What they want to know
A customer scenario. Can you turn an unrealistic expectation into acceptance criteria, instead of agreeing on the spot or lecturing on how models work
How to answer
First name the real fear: wrong answers misleading field work, especially safety procedures. Then replace "100%" with three testable terms: a usable-answer target on an eval set the customer helps write; when unsure, it must say so and cite the source; safety procedures return the source text only, no summaries. Use a number, e.g. "85%+ usable on 200 cases," and say these go into the acceptance doc
05Why didn't that pilot turn into a full contract?
What they want to know
The key question of the round. Do you trace the failure to your own judgment, and do you get that an FDE's result is customer adoption, not a working demo
How to answer
Facts, then your mistake, then what you do now. E.g. eval quality reached ~80% usable, but few engineers used it. You only gathered requirements from IT and never went to the shop floor: engineers stand by the machine with oily hands and won't go type at a PC. Now you spend day one with frontline users and make "average lookup time" a pilot metric, not just accuracy. Do not blame budget
06The customer keeps changing requirements. How do you hold the scope?
What they want to know
The classic FDE failure is a project that keeps growing and never launches. They want to see how you pin the scope down
How to answer
Three concrete moves. Before kickoff, a one-page scope doc (which question types, what's out, how acceptance works), signed by the customer. New asks go on a list you prioritize with the customer every two weeks; if one delays launch, say "this adds two weeks, or it goes to phase two" and let them choose. Post-launch asks go to phase two. Use a real case from the pilot if you have one; if not, say so and describe what you'd do
Numbers to have ready
| Number | Where it's from | How they'll probe | Your definition |
|---|---|---|---|
| ~3,000 manuals and process docs | Resume: “~3,000 manuals” | Formats, how they were parsed, how tables and figures were handled, chunk size | About 3,000 docs, of which [format mix, e.g. PDFs, scans]. Chunked by [your rule] into [number] chunks; scans were [how you handled them] |
| [eval set size] | JD item 6 | Where the eval cases came from, who labeled them, how answers were graded, how failures were split between retrieval and generation | [number] cases from [source], labeled by [who]. Usable means [your bar]. Of the failures, [share] were retrieval misses and [share] were generation errors |
| 4-week pilot | Resume: “4-week pilot” | What happened each week, who on the customer side used it, how many people | In week [number] we handed it to [number] frontline users. Acceptance criteria were [your criteria]. At the end of week 4 it stopped at [which step] |
Before the interview
Stories to have ready
- The full pilot pipeline: doc volume, parsing and chunking decisions, why hybrid search needed keywords, one war story per step
- Eval numbers: how many cases, who labeled, how graded, final usable rate, rough breakdown of failures
- Why the pilot didn't convert: the one judgment you got wrong, and what you'd do differently
- A time you negotiated scope or expectations with a customer, with the actual conversation and outcome
Check these first
- Dig up the pilot's eval numbers (case count, usable rate, failure breakdown) and verify them. Don't estimate in the room
- Be clear on what the pilot actually shipped for access control vs. what was only planned
Where you're most likely to lose points
- Only covering the technical pipeline, never the customer outcome. They leave not knowing what the customer saved
- Presenting pilot results as production results, then getting exposed by "how many people use it"
- Blaming the failed conversion on the customer's budget or lack of cooperation
- Describing access control as "filter sensitive content after generation." That reads as never having done enterprise delivery
Get these done
- Draw the pilot pipeline; at each node write one decision you made and one problem you hit
- Write the three acceptance terms for the "100% accurate" question; say it out loud in under 90 seconds
- Prepare the pilot post-mortem in the form "I assumed X, it turned out to be Y"
- Prepare two questions: how long do projects here take from pilot to production, and where do they usually get stuck
Feedback & debrief
After the interview, log what you were asked and how you answered. You get: where each answer lost points, what to say next time, and what the next round will probe
The technical half was solid: a clear pipeline, real reasons for heading-based chunking and hybrid search, and you held up through two layers of follow-up. It was obvious you built it. The losses were all on the customer half: you blamed the failed conversion on budget, described permissions as post-generation filtering, and spent most of the "100% accurate" question on model theory. Likely read: "good backend engineer, not yet an FDE who can own a customer." Shore up the customer side before round 2
01Walk me through the pilot, from data ingestion to a user's question
Strong
Best answer of the round. 3,000 docs, OCR for scans, heading-based chunking, hybrid vector + keyword search, with a reason at every step. When pressed on model codes retrieving poorly, you gave a concrete example
Missed
Six minutes of pure technology, without one sentence on what the customer used it for or what it fixed
Next time
02How did you evaluate quality? How did you build the eval set?
Strong
You had a real eval set and the numbers: 200 cases from real customer questions, labeled by two of their engineers, about 80% usable at the end of the pilot
Missed
Weak on attribution. Asked "how many of the wrong answers were retrieval misses," you couldn't say
Next time
03Different departments have different permissions. How do you handle it?
Strong
You knew permissions are a hard gate for enterprise launch and raised audit logs on your own
Missed
Your design was "retrieve first, then have the model filter out restricted content." Asked "what if the model leaks it," you had no answer. The biggest technical loss of the round
Next time
04The customer wants 100% accuracy. How do you respond?
Strong
You didn't agree on the spot, and you were clear that LLMs can be wrong
Missed
Spent a long time on why models hallucinate and how retrieval works. The interviewer pulled you back to "what do you tell the customer" twice. Customers don't need theory; they need criteria they can sign off on
Next time
05Why didn't the pilot become a full contract?
Strong
You didn't dodge it and admitted the pilot fell short
Missed
You blamed the customer's tighter budget. Then asked "did many engineers use it," you said no, which proved the problem wasn't budget. An FDE's result is adoption, so this pulled down role fit directly
Next time
06The customer keeps changing requirements. How do you hold scope?
Strong
Mentioned a backlog and prioritization, so the basic instinct is there
Missed
Your example was a requirements change between you and a PM back in backend work, which isn't the same situation. And you didn't say how you'd talk to the customer when a change delays launch
Next time
Likely next round
- In hybrid search, how do you merge vector and keyword results, and how did you set the weights
- After launch, how do you detect quality regressions, and what happens when the customer updates their docs
- If the customer requires fully on-prem with no internet access, what changes in your design
- You get a new customer. What exactly do you do in week one
After the debrief, these go into your long-term memory and shape the next prep guide:
- Strengths Solid on the technical pipeline: can justify parsing, chunking and hybrid search, holds up two layers deep
- Weak spots Tells projects as pure tech with no customer outcome; missing a one-line business goal up front
- Weak spots Attributes failures externally (customer budget). Needs to trace them to own judgment
- Common follow-ups Always asked about permissions: filter by identity before retrieval, never rely on the model
- Project stories Manufacturing pilot: ~3,000 docs, 200-case eval labeled by customer, ~80% usable, low adoption, no contract
Same question, two answers
Why didn't that pilot turn into a full contract?
A general-purpose AI usually says
Stay objective and avoid blaming the client. Consider multiple factors such as budget constraints, shifting requirements, and technical limitations. Emphasize what you learned, such as the importance of stakeholder communication and managing expectations, and show a growth mindset
What you get here
They're not asking for a balanced analysis. They're checking whether you know what an FDE's result is. "Budget got cut" is the riskiest answer: the next question is always "did people use it," and when you say "not much" you've proven it wasn't budget. Name the call you got wrong: you only gathered requirements from IT and never went to the shop floor, where engineers stand by machines with oily hands and won't type at a PC. Then the fix: day one with frontline users, and "average lookup time" as a pilot metric, not just accuracy. Get this right and it reverses the "just a tech person" read
Now try it with your own resume and JD
Create a job file and get a prep guide written for you before your next round, then a debrief right after.