High-performance LLM inference based on our optimized version of FastTransfomer
☆122Dec 14, 2023Updated 2 years ago
Alternatives and similar repositories for FasterTransformer4CodeFuse
Users that are interested in FasterTransformer4CodeFuse are comparing it to the libraries listed below
Sorting:
- High Accuracy and efficiency multi-task fine-tuning framework for Code LLMs. This work has been accepted by KDD 2024.☆710Dec 30, 2024Updated last year
- Industrial-level evaluation benchmarks for Coding LLMs in the full life-cycle of AI native software developing.企业级代码大模型评测体系,持续开放中☆106Apr 28, 2025Updated 10 months ago
- ☆40Oct 17, 2024Updated last year
- Code for ASE'21 paper "AID: Efficient Prediction of Aggregated Intensity of Dependency in Large-scale Cloud Systems"☆15Nov 2, 2021Updated 4 years ago
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 2 years ago
- some demos of Knowledge Distillation in NLP☆23Dec 31, 2020Updated 5 years ago
- ☆10Jul 20, 2024Updated last year
- Runtimex package help to expose Go Runtime internals representation safely.☆13Feb 19, 2025Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆175Aug 15, 2025Updated 7 months ago
- ☆62Jun 17, 2024Updated last year
- Inference deployment of the llama3☆10Apr 21, 2024Updated last year
- Ling-Coder-Lite is a MoE LLM provided and open-sourced by CodeFuse and InclusionAI.☆14Apr 22, 2025Updated 10 months ago
- 模拟东北大学教务处网站登录 并获取全部学生信息 目前可能随着教务处网站的更新变得不可用☆11Mar 2, 2019Updated 7 years ago
- ☆65Jan 16, 2025Updated last year
- ☆23Dec 11, 2025Updated 3 months ago
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆12Jan 30, 2026Updated last month
- os lectures 2022 spring☆10Aug 25, 2025Updated 6 months ago
- A Golang implementation of Keras.☆12Nov 24, 2016Updated 9 years ago
- Query-Based Code Analysis Engine☆348Sep 21, 2025Updated 5 months ago
- ☆14May 19, 2023Updated 2 years ago
- The project covers common metrics for super-resolution performance evaluation.☆12Dec 27, 2021Updated 4 years ago
- A competition on DataCastle which is about text keyword extraction ! Rank 6 / 622 !☆16Jan 27, 2019Updated 7 years ago
- ☆17Apr 29, 2024Updated last year
- An intelligent assistant serving the entire software development lifecycle, powered by a Multi-Agent Framework, working with DevOps Toolk…☆1,278Jul 1, 2024Updated last year
- Efficient Hyper-parameter Tuning at Scale (VLDB'22)☆10Dec 1, 2021Updated 4 years ago
- ☆19May 26, 2025Updated 9 months ago
- AutoGpt 智能推理SDK，利用AI本身的能力进行多次对话推理，回复效果更加理想，更智能。☆27Jan 12, 2025Updated last year
- [DEPRECIATED] [PyTorch 2.0] [638M] [85.33% acc] Full-attention multi-instrumental music transformer for supervised music generation, opti…☆32Nov 23, 2023Updated 2 years ago
- CausIL is an approach to estimate the causal graph for a cloud microservice system, where the nodes are the service-specific metrics whil…☆13Jul 3, 2023Updated 2 years ago
- Finetune baichuan pretrained model with QLora method☆16Jul 13, 2023Updated 2 years ago
- Industrial-first evaluation benchmark for LLMs in the DevOps/AIOps domain.☆651Jul 10, 2024Updated last year
- pure go for rwkv☆19Dec 31, 2023Updated 2 years ago
- A minimalist Go implementation of Microsoft's GraphRAG☆21Aug 25, 2024Updated last year
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Feb 9, 2025Updated last year
- Android 音视频工程示例。☆12Feb 8, 2023Updated 3 years ago
- ☆34Jul 23, 2024Updated last year
- Uniapp使用GoEasy实现websocket实时通讯☆15Mar 26, 2020Updated 5 years ago
- PyTorch in Go, using LibTorch.☆15May 21, 2019Updated 6 years ago
- MediaPlayer音频播放器，一行代码就能播！☆16Dec 4, 2020Updated 5 years ago