malaysia-ai / pretrain-text-dataset
Prepare pretrain dataset for Malaysian context.
☆12Updated 4 months ago
Alternatives and similar repositories for pretrain-text-dataset:
Users that are interested in pretrain-text-dataset are comparing it to the libraries listed below
- Implementation of the DocLLM paper for Llama models.☆12Updated last month
- ☆28Updated last year
- Source codes for the paper "Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints"☆27Updated last year
- ☆30Updated 2 years ago
- ☆20Updated 3 years ago
- Using short models to classify long texts☆21Updated last year
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Updated 2 years ago
- Fine-tune Mistral 7B to generate fashion style suggestions☆33Updated last year
- Examples of using Evidently to evaluate, test and monitor ML models.☆18Updated last month
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆31Updated 2 years ago
- ☆21Updated 10 months ago
- Comparing PyTorch, JIT and ONNX for inference with Transformers☆17Updated 3 years ago
- ☆17Updated 2 years ago
- Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant☆12Updated 2 years ago
- 🦖 Streamlined Recommender Systems with TensorFlow and KubeFlow☆18Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever☆35Updated this week
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆15Updated 9 months ago
- The collection of bulding blocks building fine-tunable metric learning models☆32Updated last week
- A collection of my data science articles published in Towards Data Science and Towards AI.☆16Updated last year
- Finetune Malaysian LLM for Malaysian context embedding task.☆20Updated 8 months ago
- NLP command-line assistant powered by OpenAI☆21Updated 11 months ago
- Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversation…☆12Updated last year
- Cross-lingual Fact-to-Text Alignment and Generation for Low-Resource Languages☆9Updated 2 years ago
- Finetune LayoutLM on SROIE dataset using W&B tools☆18Updated 3 years ago
- All my experiments with the various transformers and various transformer frameworks available☆14Updated 3 years ago
- ☆22Updated 2 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated last year
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆33Updated 2 months ago
- ☆11Updated 2 years ago