I am trying to find how the synthetic data was created (looking through the repo... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		CaseFlatline 25 days ago \| parent \| context \| favorite \| on: Show HN: I built a tiny LLM to demystify how langu... I am trying to find how the synthetic data was created (looking through the repo) and didn't find it. Maybe I am missing it - Would love to see the prompts and process on that aspect of the training data generation!

vunderba 25 days ago [–]

It's here:

https://github.com/arman-bd/guppylm/blob/main/guppylm/genera...

Uses a sort of mad-libs templatized style to generate all the permutations.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact