A unified tokenization tool for Images, Chinese and English.
☆153Mar 23, 2023Updated 2 years ago
Alternatives and similar repositories for icetk
Users that are interested in icetk are comparing it to the libraries listed below
Sorting:
- SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.☆1,112Dec 26, 2024Updated last year
- GLM (General Language Model)☆3,437Nov 3, 2023Updated 2 years ago
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Nov 19, 2022Updated 3 years ago
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,669Jul 25, 2023Updated 2 years ago
- Simple script to compute CLIP-based scores given a DALL-e trained model.☆29Jun 13, 2021Updated 4 years ago
- Efficient Inference for Big Models☆587Jan 24, 2023Updated 3 years ago
- Code for fintune ChatGLM-6b using low-rank adaptation (LoRA)☆718Jul 18, 2023Updated 2 years ago
- deep learning☆150May 6, 2025Updated 9 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,436Mar 20, 2024Updated last year
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆938Oct 6, 2022Updated 3 years ago
- Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型☆4,176Aug 23, 2024Updated last year
- Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations☆23Nov 5, 2025Updated 3 months ago
- Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集☆3,055Apr 14, 2024Updated last year
- chatglm 6b finetuning and alpaca finetuning☆1,536Mar 9, 2025Updated 11 months ago
- Large-scale model inference.☆627Sep 12, 2023Updated 2 years ago
- AgentTuning: Enabling Generalized Agent Abilities for LLMs☆1,477Oct 31, 2023Updated 2 years ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆26Aug 30, 2024Updated last year
- KuaiSearch PERKS☆12Nov 16, 2021Updated 4 years ago
- The official implementation of "Relay Diffusion: Unifying diffusion process across resolutions for image synthesis" [ICLR 2024 Spotlight]☆313Apr 29, 2024Updated last year
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,759Nov 25, 2023Updated 2 years ago
- pCLUE: 1000000+多任务提示学习数据集☆506Oct 4, 2022Updated 3 years ago
- WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)☆1,606Mar 25, 2025Updated 11 months ago
- Implementation for EACL 2024 paper "Corpus-Steered Query Expansion with Large Language Models"☆12Mar 19, 2024Updated last year
- Html article content extractor in Golang.☆12Oct 31, 2022Updated 3 years ago
- Source code and dataset for IJCAI 2022 paper "Rethinking the Setting of Semi-supervised Learning on Graphs"☆10May 31, 2022Updated 3 years ago
- ☆10Mar 31, 2022Updated 3 years ago
- distill large scale web page text☆12Jul 29, 2023Updated 2 years ago
- A fast MoE impl for PyTorch☆1,840Feb 10, 2025Updated last year
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆43Apr 7, 2024Updated last year
- unified embedding model☆876Sep 1, 2023Updated 2 years ago
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,611Aug 30, 2023Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆475Mar 7, 2024Updated last year
- Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.☆169Nov 3, 2022Updated 3 years ago
- Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".☆1,796Sep 25, 2023Updated 2 years ago
- Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo☆1,089Aug 4, 2024Updated last year
- ☆11Dec 17, 2025Updated 2 months ago
- The official implementation of HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization☆18Mar 7, 2025Updated 11 months ago
- Short Text Similarity as described in https://dl.acm.org/citation.cfm?id=2806475☆17Feb 7, 2019Updated 7 years ago
- This repository provides the materials used in "Unsupervised Melody-to-Lyric Generation" by Yufei Tian, Anjali Narayan-Chen, Shereen Orab…☆11Jul 6, 2023Updated 2 years ago