BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//pretalx.devconf.info//devconf-cz-2026//talk//S77HFM
BEGIN:VTIMEZONE
TZID:CET
BEGIN:STANDARD
DTSTART:20001029T040000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=10
TZNAME:CET
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20000326T030000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=3
TZNAME:CEST
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
UID:pretalx-devconf-cz-2026-S77HFM@pretalx.devconf.info
DTSTART;TZID=CET:20260619T123000
DTEND;TZID=CET:20260619T130500
DESCRIPTION:Edge-runnable smaller language models have a significant appeal
  to privacy-conscious technical users. \n\nKimi K2 Instruct\, an extremely
  large language model (1T parameter MoE)\, has developed a "vibe" uniquely
  attractive to technical users. with low sycophancy and high creativity. \
 n\nAttempting to distill a heavy "vibe" into a 1.5B model (IBM Granite 4-h
  Nano) has run into a number of issues but produced interesting results\, 
 with different training methods and optimizers tried.
DTSTAMP:20260430T125204Z
LOCATION:D105 (capacity 300)
SUMMARY:Fine-tuning a small model for style/vibe (a Kimi distillation and b
 eyond) - Misha Ramendik
URL:https://pretalx.devconf.info/devconf-cz-2026/talk/S77HFM/
END:VEVENT
END:VCALENDAR