Model6h ago
Model
Talkie: A 13B Model Trained On 1930s Text
A new 13B parameter model called Talkie uses a dataset exclusively from 1930. It mimics the vocabulary and syntax of the era. This experiment demonstrates how training data strictly limits a model's world knowledge. Practitioners can use it to study the effects of temporal data bias on LLM linguistic patterns.