yuzhaouoe / pretraining-data-packing

[ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
18Updated 3 months ago

Related projects

Alternatives and complementary repositories for pretraining-data-packing