Skip to content
arXiv Board & Classic Game AI· Shuo Yuan·· 2026-10-21PickAI score35

D-Skill: Distilling teacher knowledge through agent skills

D-Skill: Distilling Teacher Knowledge through Agent Skills

AI summary

D-Skill distills the paired trajectory differences between a teacher and a student model into interpretable natural-language skill documents. The student uses these documents at inference time without updating its weights. The paper reports that the method closes 75%–95% of the performance gap between teacher and student on SpreadsheetBench-Verified, ALFWorld, and chess puzzles. Within the same model family, the student's per-task inference cost is 5.7x–8.3x lower than the teacher's.

Why it matters

Unlike traditional distillation, which rewrites the student's weights, it records the teacher's experience as readable skill documents, making the approach easier to examine and compare.

Source: arXiv Board & Classic Game AI · arxiv.org