A short anime · from roho.foo

My dog vs. my pre‑registered experiment

EPISODE 1

MY
EXPERIMENT

MY DOG

Most AI models read text as word pieces.

Mine reads raw bytes, and learns where to cut.

Would it rediscover Python's grammar?

I wrote the answer key first.

Rediscovers grammar?40% no

Nudging it helps?50% yes

NO MOVING GOALPOSTS

11 runs, overnight, on one GPU.

HOURS IN00:00

Five runs done. Going great.

● HOUR 16

Then: Sylvie.

YANK!!

POWER LOST

"It's all ruined," I thought.

It wasn't.

Every finished run had saved a checkpoint.

Lost: 38 minutes

11 / 11 DONE

Did it rediscover Python's grammar?

new-line rule0.80 my model0.089

all three seedsNO

Does nudging it toward grammar help?

slightly worse, every seedNO

And the best result...

A DUMB
REGEX

One seed, so a lead, not a finding.

Save your workin pieces. Make restartingboring.

Sylvie, unrepentant.

♪ closing song ♪

roho.foothe full write-up · @roho.foo

0:00

Made from the post "My dog vs. my pre-registered experiment". All the numbers are the real ones. Music is generated live in your browser. More posts. No sound on an iPhone? Check the volume, and that the phone isn’t on silent.