langtech-bsc / salamandra

Related projects ⓘ

Alternatives and complementary repositories for salamandra

• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆52Updated 3 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆92Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆96Updated 6 months ago
• ltgoslo / ltg-bert
  LTG-Bert
  ☆29Updated 10 months ago
• huggingface / that_is_good_data
  ☆65Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆55Updated 5 months ago
• MilaNLProc / simple-generation
  A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.
  ☆25Updated last month
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆22Updated last month
• google-research / metricx
  ☆62Updated 9 months ago
• flairNLP / transformer-ranker
  Efficiently find the best-suited language model (LM) for your NLP task
  ☆14Updated this week
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆77Updated 2 weeks ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆29Updated 3 weeks ago
• bjoernpl / GermanBenchmark
  A repository containing the code for translating popular LLM benchmarks to German.
  ☆24Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆149Updated 4 months ago
• google-research / t5x_retrieval
  ☆95Updated last year
• r-three / common-pile
  Repo to hold code and track issues for the collection of permissively licensed data
  ☆22Updated this week
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆91Updated last year
• google-research / xtreme-up
  ☆51Updated last year
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆66Updated last year
• nateraw / huggingface-datasets-converter
  Scripts to convert datasets from various sources to Hugging Face Datasets.
  ☆57Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆115Updated 3 weeks ago
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆67Updated 3 weeks ago
• AnswerDotAI / bert24
  ☆64Updated this week
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆48Updated 2 months ago
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆65Updated last year
• allenai / bff
  ☆38Updated 6 months ago
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆60Updated last year
• cisnlp / GlotLID
  Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆89Updated last week
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆70Updated 8 months ago