VikParuchuri / libgen_to_txt
Convert all of libgen to high quality markdown
☆249Updated last year
Alternatives and similar repositories for libgen_to_txt:
Users that are interested in libgen_to_txt are comparing it to the libraries listed below
- data cleaning and curation for unstructured text☆329Updated 7 months ago
- Generate textbook-quality synthetic LLM pretraining data☆498Updated last year
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 11 months ago
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Full finetuning of large language models without large memory requirements☆93Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- ☆412Updated last year
- Let's create synthetic textbooks together :)☆74Updated last year
- ☆136Updated last year
- ☆152Updated 8 months ago
- An automated tool for discovering insights from research papaer corpora☆137Updated 9 months ago
- ☆111Updated 3 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆186Updated 11 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆233Updated 10 months ago
- Run GGML models with Kubernetes.☆174Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆230Updated 5 months ago
- ☆195Updated 10 months ago
- ☆48Updated last year
- An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning☆165Updated last year
- Logging and caching superpowers for the openai sdk☆103Updated last year
- Improve your questions! The AI for Inquiry - QuestionImprover Agent is an LLM-driven “tool for thought” designed to enhance the depth and…☆141Updated last month
- automatic sentence highlights based on their significance to the document☆189Updated last year
- MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…☆169Updated last week
- clean up your LLM datasets☆115Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 11 months ago