Virtual Medical Coaching | Blogs

AI Engineering for Medical Simulation: Foundations Before Tools

Written by James Hayes | Sep 8, 2026, 4:31:02 AM

AI Engineering for Medical Simulation: Foundations Before Tools

LLMs, RAG, agents, vector databases, memory, fine-tuning and new interoperability standards can make AI engineering look like a shopping list. In healthcare education, the more useful question is simpler: what problem are we solving, and what is the safest, most reliable way to solve it?

Quick answer Strong AI engineering in medical simulation starts with the learning objective, not the model. Deterministic software should handle relationships that are known and repeatable. AI should be used where it adds genuine value, such as adaptation, language interaction, pattern recognition or synthetic data. Context, retrieval, memory, evaluation, human oversight and data boundaries matter just as much as the model itself.

A recent graphic by Neo Kim, titled 15 AI Engineering Concepts, makes a useful point: strong AI engineering begins with foundations rather than simply relying on tools.

That matters even more in medical simulation.

A system can contain an impressive collection of AI technologies and still be a poor learning system. It can also use relatively little AI and be technically stronger because the architecture is understandable, testable and matched to the educational task.

The goal is not to use more AI. The goal is to engineer a better learning system.

The 15 concepts are useful, but they are not a checklist

The concepts in the graphic can be grouped into five practical layers. The grouping matters because it shifts the discussion from individual tools to the role each component plays inside a system.

Layer Examples Why it matters
Core understanding and quality LLM basics, LLM evaluations, context engineering You need to understand what a model can and cannot do, what information it receives, and how its behaviour is tested.
Knowledge and state RAG, vector databases, AI agent memory and state These components determine what information a system can retrieve, retain and use during an interaction.
Orchestration and interoperability AI agents, agentic patterns, multi-agent architectures, MCP, A2A These approaches let models use tools, coordinate tasks and communicate with other systems or agents.
Interaction and model adaptation Prompt engineering, AI chat assistants, fine-tuning These affect how users communicate with the system and how model behaviour is shaped for a particular purpose.
Engineering workflow AI coding workflow AI can also support the people building the software, but generated code still needs architecture, review, testing and ownership.

None of these technologies is inherently valuable because it appears in an architecture diagram. Their value depends on whether they solve a defined problem better than a simpler alternative.

What changes when the system is built for healthcare education?

Medical simulation is not a generic chatbot problem. A learner may be positioning a patient, selecting an exposure factor, interpreting an image, changing fluoroscopic geometry or responding to a clinical scenario. Some consequences are governed by known physical or procedural relationships. Others require judgement, adaptation or interpretation.

That distinction should influence the architecture.

1. Use deterministic software where reality is deterministic

If the same technical action should produce the same simulated consequence, a probabilistic model may be the wrong tool.

Radiographic geometry, defined equipment behaviour, known workflow rules and many radiation protection relationships can often be handled more transparently with conventional software, mathematical models or validated simulation logic.

An LLM does not improve a known equation by guessing it differently each time.

This is one reason Virtual Medical Coaching uses AI selectively. Our public position is straightforward: use AI for a defined reason, and use deterministic systems when determinism matters. Read how VMC uses AI selectively in healthcare simulation.

2. Treat context engineering as part of system control

Prompt engineering gets much of the attention, but context engineering is often more important.

The question is not only what instruction the model receives. It is what information the model is allowed to see, which tools it can access, what previous state is included, what domain material is retrieved, and what is deliberately excluded.

In a healthcare education system, context can act as a boundary. A narrowly defined model working with controlled educational material may be more useful than a more capable model given broad, poorly governed access.

3. Use retrieval when the model should work from controlled knowledge

Retrieval-augmented generation, usually shortened to RAG, allows a model to retrieve relevant material from a controlled knowledge source before generating a response.

For education, that can be useful when a response should be grounded in a curriculum, policy, technical reference, educator-approved explanation or other defined source rather than relying only on the model's general training.

RAG is not a guarantee of correctness. Retrieval can fail, source material can be wrong, and a model can still misinterpret what it retrieves. The important point is that the knowledge path becomes more controllable and more testable.

4. Make evaluation part of the product, not a final QA step

AI evaluation is sometimes treated like ordinary software testing performed just before release. That is not enough for systems with probabilistic outputs.

Evaluation needs to ask whether the system is accurate enough for the task, whether behaviour changes when context changes, how it handles uncertainty, where it fails, and whether an update improves one area while degrading another.

NIST's AI Risk Management Framework puts measurement and ongoing risk management at the centre of trustworthy AI. Its Generative AI Profile extends that thinking to risks specific to generative systems. The principle is directly relevant to educational AI: capability needs to be measured, not assumed.

5. Give agents limited authority

AI agents can do more than generate text. They can select tools, perform actions, inspect results and continue toward a goal.

That can be useful, but agency creates a new engineering question: what is the system actually permitted to do?

In medical education, an agent may be appropriate for tasks such as finding relevant learning material, selecting a follow-up exercise or helping an educator analyse a cohort. That does not mean the same agent should have unrestricted access to learner data, external systems or high-impact decisions.

More autonomy is not automatically better architecture.

6. Use memory because it helps learning, not because it is technically possible

Memory and state can make an educational system more coherent. A system can remember what a learner has already demonstrated, where they have struggled and what material has already been presented.

That can support adaptive learning, but it also creates questions about necessity, retention, transparency and control.

For VMC's adaptive learning work, the important idea is not a chatbot that remembers everything. It is a changing model of relevant learning evidence that helps determine what the learner may need next. See what adaptive learning can look like in radiography education.

7. Fine-tuning should not be the first response to every problem

Fine-tuning can be useful when a model needs consistent behaviour that cannot be achieved reliably through a base model, controlled context, retrieval or other system design.

But it creates additional work. Training data needs to be appropriate. Performance needs to be evaluated. New model versions may change the trade-offs. A fine-tuned model can also make incorrect behaviour more consistent if the underlying data or objective is poor.

In many systems, better context, retrieval, tool design and evaluation should be explored before model adaptation.

A practical AI engineering stack for medical simulation

For VMC, a more useful architecture starts with the educational purpose and works outward from there.

Layer 1

Learning objective

What should the learner understand, practise or demonstrate? What evidence would show that learning has occurred?

Layer 2

Simulation and decision logic

Use deterministic physics, rules and workflow logic where predictable behaviour matters. Add AI only where it improves the task.

Layer 3

Context, knowledge and state

Control what the AI can see, retrieve and remember. Give it the information needed for the task rather than everything that is available.

Layer 4

Evaluation and human oversight

Test outputs, define failure behaviour, review scientific content and keep educators and subject matter experts in control of the learning design.

This is also consistent with the direction of international guidance. WHO guidance on AI for health emphasises governance, accountability, transparency, safety and human oversight. Its guidance on large multimodal models addresses many of the same issues for newer general-purpose AI systems.

How VMC applies this thinking

Virtual Medical Coaching develops simulation software for radiography, radiation safety, CT and other areas of healthcare education. We do not treat AI as the architecture for everything we build.

  • Known relationships stay controlled. Where a result can be calculated, simulated or defined using established rules, we can keep that behaviour deterministic.
  • Adaptive learning is driven by learning evidence. We are developing systems that respond to patterns in learner performance rather than simply adding a chatbot beside a fixed course.
  • AI can solve specific technical problems. This can include pattern recognition, synthetic data generation, adaptive educational decisions and other tasks where conventional logic alone is not the best fit.
  • Infrastructure is a design decision. Where appropriate, VMC can run AI models on GPU infrastructure we control rather than automatically sending information to an external AI provider.
  • Clinical and scientific review remains human. Subject matter expertise, validation and educational judgement remain part of the system around the model.

Our adaptive learning work in medical imaging is an example of this broader approach. The objective is not to make the learner interact with as much AI as possible. It is to build a better model of what the learner appears to understand and use that evidence to select more useful teaching. Explore VMC's adaptive learning work for medical imaging and radiation sciences.

Questions universities and hospitals should ask about AI-powered simulation

  • What specific educational or technical problem is the AI solving?
  • Which parts of the system are deterministic, and which are probabilistic?
  • What information is supplied to the model?
  • Does any learner or institutional data leave the provider's environment?
  • How is model output evaluated before and after release?
  • What happens when the model is uncertain, inconsistent or wrong?
  • Can educators inspect, override or constrain the system?
  • What does the system remember, and why is that memory necessary?
  • Are retrieved sources controlled and reviewable?
  • Will the learning experience still work if an AI component is unavailable?

These questions are more revealing than asking whether a product uses the latest model, has multiple agents or supports a fashionable protocol.

The best AI may be the AI the learner barely notices

Strong AI engineering is not about collecting technologies.

It is about deciding where intelligence belongs, where determinism matters, what context a model needs, how knowledge is grounded, how state is controlled, how behaviour is evaluated and where human judgement remains essential.

That is particularly important in healthcare education, where the objective is not to impress the learner with an AI system. It is to help them develop knowledge, judgement and practical competence that can transfer into the real world.

The tools will keep changing.

The engineering principles should survive the change.

Building better healthcare simulation

Virtual Medical Coaching develops immersive and desktop simulation for radiography, radiation safety, CT and healthcare education, with AI used selectively where it provides a clear learning or technical benefit.

Explore radiography simulation Talk to VMC

Frequently asked questions

What is AI engineering in medical simulation?

AI engineering in medical simulation is the design, integration, evaluation and governance of AI components inside a wider educational simulation system. It includes models, context, retrieval, memory, tools, evaluation, data controls and human oversight.

Does medical simulation need an LLM?

No. Many simulation functions are better handled by deterministic software, established physics, workflow logic or conventional algorithms. An LLM is useful only when language understanding or generation solves a defined problem better than those alternatives.

What is RAG in healthcare education?

Retrieval-augmented generation allows an AI model to retrieve relevant information from a defined knowledge source before generating a response. In healthcare education, this can help ground responses in educator-approved or domain-specific material, although retrieval and generated outputs still need evaluation.

Are AI agents appropriate for healthcare training?

They can be, provided their role and authority are clearly limited. Agents may help select learning activities, retrieve information or support analytics, but the system should define what actions they can perform, what information they can access and how their behaviour is evaluated.

Why are AI evaluations important?

Generative models can produce variable outputs. Evaluations help determine how well a system performs on the actual educational task, where it fails, how changes affect behaviour and whether it remains within acceptable boundaries.

How does Virtual Medical Coaching use AI?

VMC uses AI selectively for defined educational and technical problems, while retaining deterministic software where predictable behaviour is more appropriate. Human subject matter expertise, testing and educational judgement remain part of the surrounding system.

References and further reading

  1. National Institute of Standards and Technology. AI Risk Management Framework. NIST.
  2. Autio C, Schwartz R, Dunietz J, et al. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. NIST AI 600-1. 2024.
  3. World Health Organization. Ethics and governance of artificial intelligence for health. 2021.
  4. World Health Organization. Ethics and governance of artificial intelligence for health: Guidance on large multi-modal models. 2025.